Aug 17 11:35:38 user nova-compute[73449]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Aug 17 11:35:41 user nova-compute[73449]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=73449) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 17 11:35:41 user nova-compute[73449]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=73449) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 17 11:35:41 user nova-compute[73449]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=73449) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 17 11:35:41 user nova-compute[73449]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Aug 17 11:35:41 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:35:41 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.018s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:35:42 user nova-compute[73449]: INFO nova.virt.driver [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] Loading compute driver 'libvirt.LibvirtDriver'
Aug 17 11:35:42 user nova-compute[73449]: INFO nova.compute.provider_config [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] Acquiring lock "singleton_lock" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] Acquired lock "singleton_lock" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] Releasing lock "singleton_lock" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] Full set of CONF: {{(pid=73449) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] ******************************************************************************** {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] Configuration options gathered from: {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] ================================================================================ {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] allow_resize_to_same_host      = True {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] arq_binding_timeout            = 300 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] backdoor_port                  = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] backdoor_socket                = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] block_device_allocate_retries  = 300 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] block_device_allocate_retries_interval = 5 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] cert                           = self.pem {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] compute_monitors               = [] {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] config_dir                     = [] {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] config_drive_format            = iso9660 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] config_source                  = [] {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] console_host                   = user {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] control_exchange               = nova {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] cpu_allocation_ratio           = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] daemon                         = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] debug                          = True {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] default_access_ip_network_name = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] default_availability_zone      = nova {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] default_ephemeral_format       = ext4 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] default_schedule_zone          = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] disk_allocation_ratio          = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] enable_new_services            = True {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] enabled_apis                   = ['osapi_compute'] {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] enabled_ssl_apis               = [] {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] flat_injected                  = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] force_config_drive             = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] force_raw_images               = True {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] graceful_shutdown_timeout      = 5 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] heal_instance_info_cache_interval = 60 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] host                           = user {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] initial_disk_allocation_ratio  = 1.0 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] initial_ram_allocation_ratio   = 1.0 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] instance_build_timeout         = 0 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] instance_delete_interval       = 300 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] instance_format                = [instance: %(uuid)s]  {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] instance_name_template         = instance-%08x {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] instance_usage_audit           = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] instance_usage_audit_period    = month {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] internal_service_availability_zone = internal {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] key                            = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] live_migration_retry_count     = 30 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] log_config_append              = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] log_dir                        = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] log_file                       = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] log_options                    = True {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] log_rotate_interval            = 1 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] log_rotate_interval_type       = days {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] log_rotation_type              = none {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] long_rpc_timeout               = 1800 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] max_concurrent_builds          = 10 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] max_concurrent_live_migrations = 1 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] max_concurrent_snapshots       = 5 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] max_local_block_devices        = 3 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] max_logfile_count              = 30 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] max_logfile_size_mb            = 200 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] maximum_instance_delete_attempts = 5 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] metadata_listen                = 0.0.0.0 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] metadata_listen_port           = 8775 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] metadata_workers               = 3 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] migrate_max_retries            = -1 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] mkisofs_cmd                    = genisoimage {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] my_block_storage_ip            = 10.0.0.210 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] my_ip                          = 10.0.0.210 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] network_allocate_retries       = 0 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] osapi_compute_listen           = 0.0.0.0 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] osapi_compute_listen_port      = 8774 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] osapi_compute_unique_server_name_scope =  {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] osapi_compute_workers          = 3 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] password_length                = 12 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] periodic_enable                = True {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] periodic_fuzzy_delay           = 60 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] pointer_model                  = ps2mouse {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] preallocate_images             = none {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] publish_errors                 = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] pybasedir                      = /opt/stack/nova {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] ram_allocation_ratio           = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] rate_limit_burst               = 0 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] rate_limit_except_level        = CRITICAL {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] rate_limit_interval            = 0 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] reboot_timeout                 = 0 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] reclaim_instance_interval      = 0 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] record                         = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] reimage_timeout_per_gb         = 60 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] report_interval                = 120 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] rescue_timeout                 = 0 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] reserved_host_cpus             = 0 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] reserved_host_disk_mb          = 0 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] reserved_host_memory_mb        = 512 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] reserved_huge_pages            = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] resize_confirm_window          = 0 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] resize_fs_using_block_device   = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] resume_guests_state_on_host_boot = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] rpc_response_timeout           = 60 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] run_external_periodic_tasks    = True {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] running_deleted_instance_action = reap {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] running_deleted_instance_poll_interval = 1800 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] running_deleted_instance_timeout = 0 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] scheduler_instance_sync_interval = 120 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] service_down_time              = 720 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] servicegroup_driver            = db {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] shelved_offload_time           = 0 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] shelved_poll_interval          = 3600 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] shutdown_timeout               = 0 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] source_is_ipv6                 = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] ssl_only                       = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] state_path                     = /opt/stack/data/nova {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] sync_power_state_interval      = 600 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] sync_power_state_pool_size     = 1000 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] syslog_log_facility            = LOG_USER {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] tempdir                        = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] timeout_nbd                    = 10 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] transport_url                  = **** {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] update_resources_interval      = 0 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] use_cow_images                 = True {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] use_eventlog                   = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] use_journal                    = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] use_json                       = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] use_rootwrap_daemon            = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] use_stderr                     = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] use_syslog                     = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] vcpu_pin_set                   = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] vif_plugging_is_fatal          = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] vif_plugging_timeout           = 0 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] virt_mkfs                      = [] {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] volume_usage_poll_interval     = 0 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] watch_log_file                 = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] web                            = /usr/share/spice-html5 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] oslo_concurrency.disable_process_locking = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] api.auth_strategy              = keystone {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] api.compute_link_prefix        = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] api.dhcp_domain                = novalocal {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] api.enable_instance_password   = True {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] api.glance_link_prefix         = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] api.instance_list_cells_batch_strategy = distributed {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] api.instance_list_per_project_cells = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] api.list_records_by_skipping_down_cells = True {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] api.local_metadata_per_cell    = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] api.max_limit                  = 1000 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] api.metadata_cache_expiration  = 15 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] api.neutron_default_tenant_id  = default {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] api.use_forwarded_for          = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] api.use_neutron_default_nets   = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] api.vendordata_dynamic_failure_fatal = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] api.vendordata_dynamic_targets = [] {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] api.vendordata_jsonfile_path   = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] cache.backend                  = dogpile.cache.memcached {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] cache.backend_argument         = **** {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] cache.config_prefix            = cache.oslo {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] cache.dead_timeout             = 60.0 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] cache.debug_cache_backend      = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] cache.enable_retry_client      = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] cache.enable_socket_keepalive  = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] cache.enabled                  = True {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] cache.expiration_time          = 600 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] cache.hashclient_retry_attempts = 2 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] cache.hashclient_retry_delay   = 1.0 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] cache.memcache_dead_retry      = 300 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] cache.memcache_password        =  {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] cache.memcache_pool_maxsize    = 10 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] cache.memcache_pool_unused_timeout = 60 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] cache.memcache_sasl_enabled    = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] cache.memcache_socket_timeout  = 1.0 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] cache.memcache_username        =  {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] cache.proxies                  = [] {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] cache.retry_attempts           = 2 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] cache.retry_delay              = 0.0 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] cache.socket_keepalive_count   = 1 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] cache.socket_keepalive_idle    = 1 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] cache.socket_keepalive_interval = 1 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] cache.tls_allowed_ciphers      = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] cache.tls_cafile               = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] cache.tls_certfile             = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] cache.tls_enabled              = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] cache.tls_keyfile              = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] cinder.auth_section            = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] cinder.auth_type               = password {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] cinder.cafile                  = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] cinder.catalog_info            = volumev3::publicURL {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] cinder.certfile                = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] cinder.collect_timing          = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] cinder.cross_az_attach         = True {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] cinder.debug                   = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] cinder.endpoint_template       = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] cinder.http_retries            = 3 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] cinder.insecure                = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] cinder.keyfile                 = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] cinder.os_region_name          = RegionOne {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] cinder.split_loggers           = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] cinder.timeout                 = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] compute.cpu_dedicated_set      = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] compute.cpu_shared_set         = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] compute.image_type_exclude_list = [] {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] compute.live_migration_wait_for_vif_plug = True {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] compute.max_concurrent_disk_ops = 0 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] compute.max_disk_devices_to_attach = -1 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] compute.resource_provider_association_refresh = 300 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] compute.shutdown_retry_interval = 10 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] conductor.workers              = 3 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] console.allowed_origins        = [] {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] console.ssl_ciphers            = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] console.ssl_minimum_version    = default {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] consoleauth.token_ttl          = 600 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] cyborg.cafile                  = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] cyborg.certfile                = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] cyborg.collect_timing          = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] cyborg.connect_retries         = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] cyborg.connect_retry_delay     = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] cyborg.endpoint_override       = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] cyborg.insecure                = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] cyborg.keyfile                 = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] cyborg.max_version             = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] cyborg.min_version             = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] cyborg.region_name             = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] cyborg.service_name            = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] cyborg.service_type            = accelerator {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] cyborg.split_loggers           = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] cyborg.status_code_retries     = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] cyborg.status_code_retry_delay = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] cyborg.timeout                 = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] cyborg.version                 = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] database.backend               = sqlalchemy {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] database.connection            = **** {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] database.connection_debug      = 0 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] database.connection_parameters =  {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] database.connection_recycle_time = 3600 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] database.connection_trace      = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] database.db_inc_retry_interval = True {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] database.db_max_retries        = 20 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] database.db_max_retry_interval = 10 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] database.db_retry_interval     = 1 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] database.max_overflow          = 50 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] database.max_pool_size         = 5 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] database.max_retries           = 10 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] database.mysql_enable_ndb      = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] database.mysql_wsrep_sync_wait = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] database.pool_timeout          = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] database.retry_interval        = 10 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] database.slave_connection      = **** {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] database.sqlite_synchronous    = True {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] api_database.backend           = sqlalchemy {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] api_database.connection        = **** {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] api_database.connection_debug  = 0 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] api_database.connection_parameters =  {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] api_database.connection_recycle_time = 3600 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] api_database.connection_trace  = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] api_database.db_inc_retry_interval = True {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] api_database.db_max_retries    = 20 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] api_database.db_max_retry_interval = 10 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] api_database.db_retry_interval = 1 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] api_database.max_overflow      = 50 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] api_database.max_pool_size     = 5 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] api_database.max_retries       = 10 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] api_database.mysql_enable_ndb  = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] api_database.mysql_wsrep_sync_wait = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] api_database.pool_timeout      = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] api_database.retry_interval    = 10 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] api_database.slave_connection  = **** {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] api_database.sqlite_synchronous = True {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] devices.enabled_mdev_types     = [] {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] ephemeral_storage_encryption.enabled = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] ephemeral_storage_encryption.key_size = 512 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] glance.api_servers             = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] glance.cafile                  = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] glance.certfile                = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] glance.collect_timing          = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] glance.connect_retries         = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] glance.connect_retry_delay     = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] glance.debug                   = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] glance.default_trusted_certificate_ids = [] {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] glance.enable_certificate_validation = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] glance.enable_rbd_download     = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] glance.endpoint_override       = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] glance.insecure                = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] glance.keyfile                 = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] glance.max_version             = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] glance.min_version             = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] glance.num_retries             = 3 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] glance.rbd_ceph_conf           =  {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] glance.rbd_connect_timeout     = 5 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] glance.rbd_pool                =  {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] glance.rbd_user                =  {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] glance.region_name             = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] glance.service_name            = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] glance.service_type            = image {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] glance.split_loggers           = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] glance.status_code_retries     = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] glance.status_code_retry_delay = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] glance.timeout                 = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] glance.verify_glance_signatures = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] glance.version                 = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] guestfs.debug                  = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] hyperv.config_drive_cdrom      = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] hyperv.config_drive_inject_password = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] hyperv.enable_instance_metrics_collection = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] hyperv.enable_remotefx         = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] hyperv.instances_path_share    =  {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] hyperv.iscsi_initiator_list    = [] {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] hyperv.limit_cpu_features      = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] hyperv.power_state_check_timeframe = 60 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] hyperv.power_state_event_polling_interval = 2 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] hyperv.use_multipath_io        = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] hyperv.volume_attach_retry_count = 10 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] hyperv.volume_attach_retry_interval = 5 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] hyperv.vswitch_name            = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] mks.enabled                    = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] image_cache.manager_interval   = 2400 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] image_cache.precache_concurrency = 1 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] image_cache.remove_unused_base_images = True {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] image_cache.subdirectory_name  = _base {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] ironic.api_max_retries         = 60 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] ironic.api_retry_interval      = 2 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] ironic.auth_section            = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] ironic.auth_type               = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] ironic.cafile                  = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] ironic.certfile                = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] ironic.collect_timing          = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] ironic.connect_retries         = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] ironic.connect_retry_delay     = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] ironic.endpoint_override       = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] ironic.insecure                = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] ironic.keyfile                 = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] ironic.max_version             = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] ironic.min_version             = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] ironic.partition_key           = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] ironic.peer_list               = [] {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] ironic.region_name             = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] ironic.serial_console_state_timeout = 10 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] ironic.service_name            = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] ironic.service_type            = baremetal {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] ironic.split_loggers           = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] ironic.status_code_retries     = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] ironic.status_code_retry_delay = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] ironic.timeout                 = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] ironic.version                 = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] key_manager.fixed_key          = **** {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] barbican.barbican_api_version  = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] barbican.barbican_endpoint     = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] barbican.barbican_endpoint_type = public {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] barbican.barbican_region_name  = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] barbican.cafile                = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] barbican.certfile              = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] barbican.collect_timing        = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] barbican.insecure              = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] barbican.keyfile               = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] barbican.number_of_retries     = 60 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] barbican.retry_delay           = 1 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] barbican.send_service_user_token = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] barbican.split_loggers         = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] barbican.timeout               = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] barbican.verify_ssl            = True {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] barbican.verify_ssl_path       = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] barbican_service_user.auth_section = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] barbican_service_user.auth_type = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] barbican_service_user.cafile   = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] barbican_service_user.certfile = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] barbican_service_user.collect_timing = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] barbican_service_user.insecure = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] barbican_service_user.keyfile  = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] barbican_service_user.split_loggers = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] barbican_service_user.timeout  = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] vault.approle_role_id          = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] vault.approle_secret_id        = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] vault.cafile                   = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] vault.certfile                 = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] vault.collect_timing           = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] vault.insecure                 = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] vault.keyfile                  = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] vault.kv_mountpoint            = secret {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] vault.kv_version               = 2 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] vault.namespace                = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] vault.root_token_id            = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] vault.split_loggers            = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] vault.ssl_ca_crt_file          = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] vault.timeout                  = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] vault.use_ssl                  = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] keystone.cafile                = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] keystone.certfile              = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] keystone.collect_timing        = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] keystone.connect_retries       = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] keystone.connect_retry_delay   = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] keystone.endpoint_override     = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] keystone.insecure              = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] keystone.keyfile               = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] keystone.max_version           = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] keystone.min_version           = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] keystone.region_name           = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] keystone.service_name          = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] keystone.service_type          = identity {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] keystone.split_loggers         = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] keystone.status_code_retries   = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] keystone.status_code_retry_delay = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] keystone.timeout               = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] keystone.version               = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] libvirt.connection_uri         =  {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] libvirt.cpu_mode               = custom {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] libvirt.cpu_model_extra_flags  = [] {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: WARNING oslo_config.cfg [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] libvirt.cpu_power_governor_high = performance {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] libvirt.cpu_power_governor_low = powersave {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] libvirt.cpu_power_management   = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] libvirt.device_detach_attempts = 8 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] libvirt.device_detach_timeout  = 20 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] libvirt.disk_cachemodes        = [] {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] libvirt.disk_prefix            = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] libvirt.enabled_perf_events    = [] {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] libvirt.file_backed_memory     = 0 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] libvirt.gid_maps               = [] {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] libvirt.hw_disk_discard        = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] libvirt.hw_machine_type        = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] libvirt.images_rbd_ceph_conf   =  {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] libvirt.images_rbd_glance_store_name =  {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] libvirt.images_rbd_pool        = rbd {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] libvirt.images_type            = default {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] libvirt.images_volume_group    = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] libvirt.inject_key             = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] libvirt.inject_partition       = -2 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] libvirt.inject_password        = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] libvirt.iscsi_iface            = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] libvirt.iser_use_multipath     = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] libvirt.live_migration_bandwidth = 0 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] libvirt.live_migration_completion_timeout = 800 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] libvirt.live_migration_downtime = 500 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] libvirt.live_migration_downtime_delay = 75 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] libvirt.live_migration_downtime_steps = 10 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] libvirt.live_migration_inbound_addr = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] libvirt.live_migration_permit_auto_converge = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] libvirt.live_migration_permit_post_copy = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] libvirt.live_migration_scheme  = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] libvirt.live_migration_timeout_action = abort {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] libvirt.live_migration_tunnelled = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: WARNING oslo_config.cfg [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Aug 17 11:35:42 user nova-compute[73449]: live_migration_uri is deprecated for removal in favor of two other options that
Aug 17 11:35:42 user nova-compute[73449]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Aug 17 11:35:42 user nova-compute[73449]: and ``live_migration_inbound_addr`` respectively.
Aug 17 11:35:42 user nova-compute[73449]: ).  Its value may be silently ignored in the future.
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] libvirt.live_migration_with_native_tls = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] libvirt.max_queues             = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] libvirt.mem_stats_period_seconds = 10 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] libvirt.nfs_mount_options      = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] libvirt.num_aoe_discover_tries = 3 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] libvirt.num_iser_scan_tries    = 5 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] libvirt.num_memory_encrypted_guests = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] libvirt.num_nvme_discover_tries = 5 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] libvirt.num_pcie_ports         = 0 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] libvirt.num_volume_scan_tries  = 5 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] libvirt.pmem_namespaces        = [] {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] libvirt.quobyte_client_cfg     = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] libvirt.rbd_connect_timeout    = 5 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] libvirt.rbd_secret_uuid        = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] libvirt.rbd_user               = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] libvirt.realtime_scheduler_priority = 1 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] libvirt.remote_filesystem_transport = ssh {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] libvirt.rescue_image_id        = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] libvirt.rescue_kernel_id       = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] libvirt.rescue_ramdisk_id      = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] libvirt.rx_queue_size          = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] libvirt.smbfs_mount_options    =  {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] libvirt.snapshot_compression   = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] libvirt.snapshot_image_format  = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] libvirt.sparse_logical_volumes = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] libvirt.swtpm_enabled          = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] libvirt.swtpm_group            = tss {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] libvirt.swtpm_user             = tss {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] libvirt.sysinfo_serial         = unique {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] libvirt.tb_cache_size          = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] libvirt.tx_queue_size          = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] libvirt.uid_maps               = [] {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] libvirt.use_virtio_for_bridges = True {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] libvirt.virt_type              = kvm {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] libvirt.volume_clear           = zero {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] libvirt.volume_clear_size      = 0 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] libvirt.volume_use_multipath   = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] libvirt.vzstorage_cache_path   = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] libvirt.vzstorage_mount_group  = qemu {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] libvirt.vzstorage_mount_opts   = [] {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] libvirt.vzstorage_mount_user   = stack {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] neutron.auth_section           = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] neutron.auth_type              = password {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] neutron.cafile                 = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] neutron.certfile               = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] neutron.collect_timing         = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] neutron.connect_retries        = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] neutron.connect_retry_delay    = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] neutron.default_floating_pool  = public {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] neutron.endpoint_override      = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] neutron.extension_sync_interval = 600 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] neutron.http_retries           = 3 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] neutron.insecure               = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] neutron.keyfile                = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] neutron.max_version            = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] neutron.metadata_proxy_shared_secret = **** {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] neutron.min_version            = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] neutron.ovs_bridge             = br-int {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] neutron.physnets               = [] {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] neutron.region_name            = RegionOne {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] neutron.service_metadata_proxy = True {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] neutron.service_name           = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] neutron.service_type           = network {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] neutron.split_loggers          = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] neutron.status_code_retries    = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] neutron.status_code_retry_delay = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] neutron.timeout                = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] neutron.version                = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] notifications.bdms_in_notifications = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] notifications.default_level    = INFO {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] notifications.notification_format = unversioned {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] notifications.notify_on_state_change = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] pci.alias                      = [] {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] pci.device_spec                = [] {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] pci.report_in_placement        = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] placement.auth_section         = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] placement.auth_type            = password {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] placement.cafile               = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] placement.certfile             = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] placement.collect_timing       = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] placement.connect_retries      = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] placement.connect_retry_delay  = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] placement.default_domain_id    = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] placement.default_domain_name  = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] placement.domain_id            = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] placement.domain_name          = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] placement.endpoint_override    = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] placement.insecure             = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] placement.keyfile              = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] placement.max_version          = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] placement.min_version          = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] placement.password             = **** {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] placement.project_domain_id    = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] placement.project_domain_name  = Default {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] placement.project_id           = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] placement.project_name         = service {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] placement.region_name          = RegionOne {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] placement.service_name         = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] placement.service_type         = placement {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] placement.split_loggers        = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] placement.status_code_retries  = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] placement.status_code_retry_delay = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] placement.system_scope         = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] placement.timeout              = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] placement.trust_id             = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] placement.user_domain_id       = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] placement.user_domain_name     = Default {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] placement.user_id              = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] placement.username             = placement {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] placement.version              = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] quota.cores                    = 20 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] quota.count_usage_from_placement = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] quota.injected_file_content_bytes = 10240 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] quota.injected_file_path_length = 255 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] quota.injected_files           = 5 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] quota.instances                = 10 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] quota.key_pairs                = 100 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] quota.metadata_items           = 128 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] quota.ram                      = 51200 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] quota.recheck_quota            = True {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] quota.server_group_members     = 10 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] quota.server_groups            = 10 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] rdp.enabled                    = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] scheduler.image_metadata_prefilter = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] scheduler.max_attempts         = 3 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] scheduler.max_placement_results = 1000 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] scheduler.query_placement_for_availability_zone = True {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] scheduler.query_placement_for_image_type_support = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] scheduler.workers              = 3 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] filter_scheduler.host_subset_size = 1 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] filter_scheduler.image_properties_default_architecture = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] filter_scheduler.isolated_hosts = [] {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] filter_scheduler.isolated_images = [] {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] filter_scheduler.max_instances_per_host = 50 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] filter_scheduler.pci_in_placement = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] filter_scheduler.track_instance_changes = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] metrics.required               = True {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] metrics.weight_multiplier      = 1.0 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] metrics.weight_setting         = [] {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] serial_console.enabled         = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] serial_console.port_range      = 10000:20000 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] serial_console.serialproxy_port = 6083 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] service_user.auth_section      = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] service_user.auth_type         = password {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] service_user.cafile            = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] service_user.certfile          = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] service_user.collect_timing    = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] service_user.insecure          = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] service_user.keyfile           = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] service_user.send_service_user_token = True {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] service_user.split_loggers     = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] service_user.timeout           = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] spice.agent_enabled            = True {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] spice.enabled                  = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] spice.html5proxy_port          = 6082 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] spice.image_compression        = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] spice.jpeg_compression         = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] spice.playback_compression     = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] spice.server_listen            = 127.0.0.1 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] spice.streaming_mode           = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] spice.zlib_compression         = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] upgrade_levels.baseapi         = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] upgrade_levels.cert            = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] upgrade_levels.compute         = auto {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] upgrade_levels.conductor       = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] upgrade_levels.scheduler       = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] vendordata_dynamic_auth.auth_section = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] vendordata_dynamic_auth.auth_type = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] vendordata_dynamic_auth.cafile = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] vendordata_dynamic_auth.certfile = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] vendordata_dynamic_auth.collect_timing = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] vendordata_dynamic_auth.insecure = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] vendordata_dynamic_auth.keyfile = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] vendordata_dynamic_auth.split_loggers = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] vendordata_dynamic_auth.timeout = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] vmware.api_retry_count         = 10 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] vmware.ca_file                 = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] vmware.cache_prefix            = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] vmware.cluster_name            = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] vmware.connection_pool_size    = 10 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] vmware.console_delay_seconds   = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] vmware.datastore_regex         = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] vmware.host_ip                 = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] vmware.host_password           = **** {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] vmware.host_port               = 443 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] vmware.host_username           = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] vmware.insecure                = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] vmware.integration_bridge      = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] vmware.maximum_objects         = 100 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] vmware.pbm_default_policy      = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] vmware.pbm_enabled             = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] vmware.pbm_wsdl_location       = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] vmware.serial_port_proxy_uri   = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] vmware.serial_port_service_uri = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] vmware.task_poll_interval      = 0.5 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] vmware.use_linked_clone        = True {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] vmware.vnc_keymap              = en-us {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] vmware.vnc_port                = 5900 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] vmware.vnc_port_total          = 10000 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] vnc.auth_schemes               = ['none'] {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] vnc.enabled                    = True {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] vnc.novncproxy_port            = 6080 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] vnc.server_listen              = 0.0.0.0 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] vnc.vencrypt_ca_certs          = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] vnc.vencrypt_client_cert       = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] vnc.vencrypt_client_key        = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] workarounds.disable_fallback_pcpu_query = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] workarounds.disable_group_policy_check_upcall = True {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] workarounds.disable_rootwrap   = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] workarounds.enable_numa_live_migration = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] workarounds.handle_virt_lifecycle_events = True {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] workarounds.libvirt_disable_apic = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] workarounds.never_download_image_if_on_rbd = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] wsgi.client_socket_timeout     = 900 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] wsgi.default_pool_size         = 1000 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] wsgi.keep_alive                = True {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] wsgi.max_header_line           = 16384 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] wsgi.secure_proxy_ssl_header   = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] wsgi.ssl_ca_file               = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] wsgi.ssl_cert_file             = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] wsgi.ssl_key_file              = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] wsgi.tcp_keepidle              = 600 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] zvm.ca_file                    = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] zvm.cloud_connector_url        = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] zvm.reachable_timeout          = 300 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] oslo_policy.enforce_new_defaults = True {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] oslo_policy.enforce_scope      = True {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] oslo_policy.policy_default_rule = default {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] oslo_policy.policy_file        = policy.yaml {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] profiler.connection_string     = messaging:// {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] profiler.enabled               = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] profiler.es_doc_type           = notification {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] profiler.es_scroll_size        = 10000 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] profiler.es_scroll_time        = 2m {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] profiler.filter_error_trace    = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] profiler.hmac_keys             = **** {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] profiler.sentinel_service_name = mymaster {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] profiler.socket_timeout        = 0.1 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] profiler.trace_requests        = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] profiler.trace_sqlalchemy      = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] profiler_jaeger.process_tags   = {} {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] profiler_jaeger.service_name_prefix = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] profiler_otlp.service_name_prefix = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] remote_debug.host              = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] remote_debug.port              = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] oslo_messaging_rabbit.ssl      = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] oslo_messaging_rabbit.ssl_version =  {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] oslo_messaging_notifications.retry = -1 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] oslo_messaging_notifications.transport_url = **** {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] oslo_limit.auth_section        = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] oslo_limit.auth_type           = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] oslo_limit.cafile              = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] oslo_limit.certfile            = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] oslo_limit.collect_timing      = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] oslo_limit.connect_retries     = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] oslo_limit.connect_retry_delay = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] oslo_limit.endpoint_id         = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] oslo_limit.endpoint_override   = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] oslo_limit.insecure            = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] oslo_limit.keyfile             = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] oslo_limit.max_version         = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] oslo_limit.min_version         = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] oslo_limit.region_name         = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] oslo_limit.service_name        = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] oslo_limit.service_type        = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] oslo_limit.split_loggers       = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] oslo_limit.status_code_retries = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] oslo_limit.status_code_retry_delay = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] oslo_limit.timeout             = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] oslo_limit.valid_interfaces    = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] oslo_limit.version             = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] oslo_reports.file_event_handler = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] oslo_reports.file_event_handler_interval = 1 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] oslo_reports.log_dir           = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] vif_plug_linux_bridge_privileged.group = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] vif_plug_linux_bridge_privileged.user = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] vif_plug_ovs_privileged.group  = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] vif_plug_ovs_privileged.helper_command = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] vif_plug_ovs_privileged.user   = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] os_vif_linux_bridge.flat_interface = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] os_vif_linux_bridge.vlan_interface = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] os_vif_ovs.isolate_vif         = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] os_vif_ovs.ovsdb_interface     = native {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] os_vif_ovs.per_port_bridge     = False {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] os_brick.lock_path             = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] privsep_osbrick.capabilities   = [21] {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] privsep_osbrick.group          = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] privsep_osbrick.helper_command = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] privsep_osbrick.thread_pool_size = 12 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] privsep_osbrick.user           = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] nova_sys_admin.group           = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] nova_sys_admin.helper_command  = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] nova_sys_admin.thread_pool_size = 12 {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] nova_sys_admin.user            = None {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG oslo_service.service [None req-ece0ab7c-ff08-4eca-9958-c13186835bda None None] ******************************************************************************** {{(pid=73449) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Aug 17 11:35:42 user nova-compute[73449]: INFO nova.service [-] Starting compute node (version 0.0.0)
Aug 17 11:35:42 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Starting native event thread {{(pid=73449) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Starting green dispatch thread {{(pid=73449) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Starting connection event dispatch thread {{(pid=73449) initialize /opt/stack/nova/nova/virt/libvirt/host.py:620}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Connecting to libvirt: qemu:///system {{(pid=73449) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7fe77c1a8f40> {{(pid=73449) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:509}}
Aug 17 11:35:42 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7fe77c1a8f40> {{(pid=73449) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:530}}
Aug 17 11:35:42 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Connection event '1' reason 'None'
Aug 17 11:35:42 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 17 11:35:42 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.mount [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Initialising _HostMountState generation 0 {{(pid=73449) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Aug 17 11:35:50 user nova-compute[73449]: INFO nova.virt.libvirt.host [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Libvirt host capabilities <capabilities>
Aug 17 11:35:50 user nova-compute[73449]:   <host>
Aug 17 11:35:50 user nova-compute[73449]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Aug 17 11:35:50 user nova-compute[73449]:     <cpu>
Aug 17 11:35:50 user nova-compute[73449]:       <arch>x86_64</arch>
Aug 17 11:35:50 user nova-compute[73449]:       <model>IvyBridge-IBRS</model>
Aug 17 11:35:50 user nova-compute[73449]:       <vendor>Intel</vendor>
Aug 17 11:35:50 user nova-compute[73449]:       <microcode version='1070'/>
Aug 17 11:35:50 user nova-compute[73449]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Aug 17 11:35:50 user nova-compute[73449]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature name='ss'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature name='vmx'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature name='pcid'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature name='osxsave'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature name='hypervisor'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature name='arat'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature name='tsc_adjust'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature name='md-clear'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature name='stibp'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature name='arch-capabilities'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature name='ssbd'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature name='invtsc'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature name='rsba'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature name='skip-l1dfl-vmentry'/>
Aug 17 11:35:50 user nova-compute[73449]:       <pages unit='KiB' size='4'/>
Aug 17 11:35:50 user nova-compute[73449]:       <pages unit='KiB' size='2048'/>
Aug 17 11:35:50 user nova-compute[73449]:     </cpu>
Aug 17 11:35:50 user nova-compute[73449]:     <power_management>
Aug 17 11:35:50 user nova-compute[73449]:       <suspend_mem/>
Aug 17 11:35:50 user nova-compute[73449]:       <suspend_disk/>
Aug 17 11:35:50 user nova-compute[73449]:       <suspend_hybrid/>
Aug 17 11:35:50 user nova-compute[73449]:     </power_management>
Aug 17 11:35:50 user nova-compute[73449]:     <iommu support='no'/>
Aug 17 11:35:50 user nova-compute[73449]:     <migration_features>
Aug 17 11:35:50 user nova-compute[73449]:       <live/>
Aug 17 11:35:50 user nova-compute[73449]:       <uri_transports>
Aug 17 11:35:50 user nova-compute[73449]:         <uri_transport>tcp</uri_transport>
Aug 17 11:35:50 user nova-compute[73449]:         <uri_transport>rdma</uri_transport>
Aug 17 11:35:50 user nova-compute[73449]:       </uri_transports>
Aug 17 11:35:50 user nova-compute[73449]:     </migration_features>
Aug 17 11:35:50 user nova-compute[73449]:     <topology>
Aug 17 11:35:50 user nova-compute[73449]:       <cells num='2'>
Aug 17 11:35:50 user nova-compute[73449]:         <cell id='0'>
Aug 17 11:35:50 user nova-compute[73449]:           <memory unit='KiB'>8189224</memory>
Aug 17 11:35:50 user nova-compute[73449]:           <pages unit='KiB' size='4'>2047306</pages>
Aug 17 11:35:50 user nova-compute[73449]:           <pages unit='KiB' size='2048'>0</pages>
Aug 17 11:35:50 user nova-compute[73449]:           <distances>
Aug 17 11:35:50 user nova-compute[73449]:             <sibling id='0' value='10'/>
Aug 17 11:35:50 user nova-compute[73449]:             <sibling id='1' value='20'/>
Aug 17 11:35:50 user nova-compute[73449]:           </distances>
Aug 17 11:35:50 user nova-compute[73449]:           <cpus num='6'>
Aug 17 11:35:50 user nova-compute[73449]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Aug 17 11:35:50 user nova-compute[73449]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Aug 17 11:35:50 user nova-compute[73449]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Aug 17 11:35:50 user nova-compute[73449]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Aug 17 11:35:50 user nova-compute[73449]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Aug 17 11:35:50 user nova-compute[73449]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Aug 17 11:35:50 user nova-compute[73449]:           </cpus>
Aug 17 11:35:50 user nova-compute[73449]:         </cell>
Aug 17 11:35:50 user nova-compute[73449]:         <cell id='1'>
Aug 17 11:35:50 user nova-compute[73449]:           <memory unit='KiB'>8206460</memory>
Aug 17 11:35:50 user nova-compute[73449]:           <pages unit='KiB' size='4'>2051615</pages>
Aug 17 11:35:50 user nova-compute[73449]:           <pages unit='KiB' size='2048'>0</pages>
Aug 17 11:35:50 user nova-compute[73449]:           <distances>
Aug 17 11:35:50 user nova-compute[73449]:             <sibling id='0' value='20'/>
Aug 17 11:35:50 user nova-compute[73449]:             <sibling id='1' value='10'/>
Aug 17 11:35:50 user nova-compute[73449]:           </distances>
Aug 17 11:35:50 user nova-compute[73449]:           <cpus num='6'>
Aug 17 11:35:50 user nova-compute[73449]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Aug 17 11:35:50 user nova-compute[73449]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Aug 17 11:35:50 user nova-compute[73449]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Aug 17 11:35:50 user nova-compute[73449]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Aug 17 11:35:50 user nova-compute[73449]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Aug 17 11:35:50 user nova-compute[73449]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Aug 17 11:35:50 user nova-compute[73449]:           </cpus>
Aug 17 11:35:50 user nova-compute[73449]:         </cell>
Aug 17 11:35:50 user nova-compute[73449]:       </cells>
Aug 17 11:35:50 user nova-compute[73449]:     </topology>
Aug 17 11:35:50 user nova-compute[73449]:     <cache>
Aug 17 11:35:50 user nova-compute[73449]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Aug 17 11:35:50 user nova-compute[73449]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Aug 17 11:35:50 user nova-compute[73449]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Aug 17 11:35:50 user nova-compute[73449]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Aug 17 11:35:50 user nova-compute[73449]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Aug 17 11:35:50 user nova-compute[73449]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Aug 17 11:35:50 user nova-compute[73449]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Aug 17 11:35:50 user nova-compute[73449]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Aug 17 11:35:50 user nova-compute[73449]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Aug 17 11:35:50 user nova-compute[73449]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Aug 17 11:35:50 user nova-compute[73449]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Aug 17 11:35:50 user nova-compute[73449]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Aug 17 11:35:50 user nova-compute[73449]:     </cache>
Aug 17 11:35:50 user nova-compute[73449]:     <secmodel>
Aug 17 11:35:50 user nova-compute[73449]:       <model>apparmor</model>
Aug 17 11:35:50 user nova-compute[73449]:       <doi>0</doi>
Aug 17 11:35:50 user nova-compute[73449]:     </secmodel>
Aug 17 11:35:50 user nova-compute[73449]:     <secmodel>
Aug 17 11:35:50 user nova-compute[73449]:       <model>dac</model>
Aug 17 11:35:50 user nova-compute[73449]:       <doi>0</doi>
Aug 17 11:35:50 user nova-compute[73449]:       <baselabel type='kvm'>+64055:+108</baselabel>
Aug 17 11:35:50 user nova-compute[73449]:       <baselabel type='qemu'>+64055:+108</baselabel>
Aug 17 11:35:50 user nova-compute[73449]:     </secmodel>
Aug 17 11:35:50 user nova-compute[73449]:   </host>
Aug 17 11:35:50 user nova-compute[73449]:   <guest>
Aug 17 11:35:50 user nova-compute[73449]:     <os_type>hvm</os_type>
Aug 17 11:35:50 user nova-compute[73449]:     <arch name='alpha'>
Aug 17 11:35:50 user nova-compute[73449]:       <wordsize>64</wordsize>
Aug 17 11:35:50 user nova-compute[73449]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='4'>clipper</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <domain type='qemu'/>
Aug 17 11:35:50 user nova-compute[73449]:     </arch>
Aug 17 11:35:50 user nova-compute[73449]:     <features>
Aug 17 11:35:50 user nova-compute[73449]:       <cpuselection/>
Aug 17 11:35:50 user nova-compute[73449]:       <deviceboot/>
Aug 17 11:35:50 user nova-compute[73449]:       <disksnapshot default='on' toggle='no'/>
Aug 17 11:35:50 user nova-compute[73449]:     </features>
Aug 17 11:35:50 user nova-compute[73449]:   </guest>
Aug 17 11:35:50 user nova-compute[73449]:   <guest>
Aug 17 11:35:50 user nova-compute[73449]:     <os_type>hvm</os_type>
Aug 17 11:35:50 user nova-compute[73449]:     <arch name='armv6l'>
Aug 17 11:35:50 user nova-compute[73449]:       <wordsize>32</wordsize>
Aug 17 11:35:50 user nova-compute[73449]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>integratorcp</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>borzoi</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>spitz</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2'>nuri</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2'>musca-b1</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>versatileab</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>kzm</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2'>musca-a</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2'>smdkc210</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>sx1</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>z2</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>tosa</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='4'>sabrelite</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>realview-eb</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>n810</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>n800</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>versatilepb</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>terrier</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>mainstone</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='4'>midway</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>musicpal</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>microbit</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>cubieboard</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>verdex</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>netduino2</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='4'>raspi2b</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>cheetah</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='4'>highbank</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>akita</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>connex</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>collie</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>raspi0</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <domain type='qemu'/>
Aug 17 11:35:50 user nova-compute[73449]:     </arch>
Aug 17 11:35:50 user nova-compute[73449]:     <features>
Aug 17 11:35:50 user nova-compute[73449]:       <cpuselection/>
Aug 17 11:35:50 user nova-compute[73449]:       <deviceboot/>
Aug 17 11:35:50 user nova-compute[73449]:       <disksnapshot default='on' toggle='no'/>
Aug 17 11:35:50 user nova-compute[73449]:     </features>
Aug 17 11:35:50 user nova-compute[73449]:   </guest>
Aug 17 11:35:50 user nova-compute[73449]:   <guest>
Aug 17 11:35:50 user nova-compute[73449]:     <os_type>hvm</os_type>
Aug 17 11:35:50 user nova-compute[73449]:     <arch name='armv7l'>
Aug 17 11:35:50 user nova-compute[73449]:       <wordsize>32</wordsize>
Aug 17 11:35:50 user nova-compute[73449]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>integratorcp</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>borzoi</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>spitz</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2'>nuri</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2'>musca-b1</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>versatileab</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>kzm</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2'>musca-a</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2'>smdkc210</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>sx1</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>z2</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>tosa</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='4'>sabrelite</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>realview-eb</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>n810</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>n800</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>versatilepb</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>terrier</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>mainstone</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='4'>midway</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>musicpal</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>microbit</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>cubieboard</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>verdex</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>netduino2</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='4'>raspi2b</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>cheetah</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='4'>highbank</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>akita</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>connex</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>collie</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>raspi0</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <domain type='qemu'/>
Aug 17 11:35:50 user nova-compute[73449]:     </arch>
Aug 17 11:35:50 user nova-compute[73449]:     <features>
Aug 17 11:35:50 user nova-compute[73449]:       <cpuselection/>
Aug 17 11:35:50 user nova-compute[73449]:       <deviceboot/>
Aug 17 11:35:50 user nova-compute[73449]:       <disksnapshot default='on' toggle='no'/>
Aug 17 11:35:50 user nova-compute[73449]:     </features>
Aug 17 11:35:50 user nova-compute[73449]:   </guest>
Aug 17 11:35:50 user nova-compute[73449]:   <guest>
Aug 17 11:35:50 user nova-compute[73449]:     <os_type>hvm</os_type>
Aug 17 11:35:50 user nova-compute[73449]:     <arch name='aarch64'>
Aug 17 11:35:50 user nova-compute[73449]:       <wordsize>64</wordsize>
Aug 17 11:35:50 user nova-compute[73449]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>integratorcp</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>borzoi</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>spitz</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2'>nuri</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2'>musca-b1</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>versatileab</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>kzm</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2'>musca-a</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2'>smdkc210</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>sx1</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>z2</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>tosa</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='4'>sabrelite</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>realview-eb</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='512'>sbsa-ref</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>n810</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>n800</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>versatilepb</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>terrier</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>mainstone</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='4'>midway</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>musicpal</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>microbit</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='4'>raspi3ap</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>cubieboard</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>verdex</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>netduino2</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='4'>raspi3b</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='4'>raspi2b</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>cheetah</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='4'>highbank</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>akita</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>connex</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>collie</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>raspi0</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <domain type='qemu'/>
Aug 17 11:35:50 user nova-compute[73449]:     </arch>
Aug 17 11:35:50 user nova-compute[73449]:     <features>
Aug 17 11:35:50 user nova-compute[73449]:       <acpi default='on' toggle='yes'/>
Aug 17 11:35:50 user nova-compute[73449]:       <cpuselection/>
Aug 17 11:35:50 user nova-compute[73449]:       <deviceboot/>
Aug 17 11:35:50 user nova-compute[73449]:       <disksnapshot default='on' toggle='no'/>
Aug 17 11:35:50 user nova-compute[73449]:     </features>
Aug 17 11:35:50 user nova-compute[73449]:   </guest>
Aug 17 11:35:50 user nova-compute[73449]:   <guest>
Aug 17 11:35:50 user nova-compute[73449]:     <os_type>hvm</os_type>
Aug 17 11:35:50 user nova-compute[73449]:     <arch name='cris'>
Aug 17 11:35:50 user nova-compute[73449]:       <wordsize>32</wordsize>
Aug 17 11:35:50 user nova-compute[73449]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>axis-dev88</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <domain type='qemu'/>
Aug 17 11:35:50 user nova-compute[73449]:     </arch>
Aug 17 11:35:50 user nova-compute[73449]:     <features>
Aug 17 11:35:50 user nova-compute[73449]:       <cpuselection/>
Aug 17 11:35:50 user nova-compute[73449]:       <deviceboot/>
Aug 17 11:35:50 user nova-compute[73449]:       <disksnapshot default='on' toggle='no'/>
Aug 17 11:35:50 user nova-compute[73449]:     </features>
Aug 17 11:35:50 user nova-compute[73449]:   </guest>
Aug 17 11:35:50 user nova-compute[73449]:   <guest>
Aug 17 11:35:50 user nova-compute[73449]:     <os_type>hvm</os_type>
Aug 17 11:35:50 user nova-compute[73449]:     <arch name='i686'>
Aug 17 11:35:50 user nova-compute[73449]:       <wordsize>32</wordsize>
Aug 17 11:35:50 user nova-compute[73449]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>x-remote</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>isapc</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='288'>microvm</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <domain type='qemu'/>
Aug 17 11:35:50 user nova-compute[73449]:       <domain type='kvm'/>
Aug 17 11:35:50 user nova-compute[73449]:     </arch>
Aug 17 11:35:50 user nova-compute[73449]:     <features>
Aug 17 11:35:50 user nova-compute[73449]:       <pae/>
Aug 17 11:35:50 user nova-compute[73449]:       <nonpae/>
Aug 17 11:35:50 user nova-compute[73449]:       <acpi default='on' toggle='yes'/>
Aug 17 11:35:50 user nova-compute[73449]:       <apic default='on' toggle='no'/>
Aug 17 11:35:50 user nova-compute[73449]:       <cpuselection/>
Aug 17 11:35:50 user nova-compute[73449]:       <deviceboot/>
Aug 17 11:35:50 user nova-compute[73449]:       <disksnapshot default='on' toggle='no'/>
Aug 17 11:35:50 user nova-compute[73449]:     </features>
Aug 17 11:35:50 user nova-compute[73449]:   </guest>
Aug 17 11:35:50 user nova-compute[73449]:   <guest>
Aug 17 11:35:50 user nova-compute[73449]:     <os_type>hvm</os_type>
Aug 17 11:35:50 user nova-compute[73449]:     <arch name='m68k'>
Aug 17 11:35:50 user nova-compute[73449]:       <wordsize>32</wordsize>
Aug 17 11:35:50 user nova-compute[73449]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>mcf5208evb</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>an5206</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>virt-6.0</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>q800</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>virt-6.2</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>next-cube</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>virt-6.1</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <domain type='qemu'/>
Aug 17 11:35:50 user nova-compute[73449]:     </arch>
Aug 17 11:35:50 user nova-compute[73449]:     <features>
Aug 17 11:35:50 user nova-compute[73449]:       <cpuselection/>
Aug 17 11:35:50 user nova-compute[73449]:       <deviceboot/>
Aug 17 11:35:50 user nova-compute[73449]:       <disksnapshot default='on' toggle='no'/>
Aug 17 11:35:50 user nova-compute[73449]:     </features>
Aug 17 11:35:50 user nova-compute[73449]:   </guest>
Aug 17 11:35:50 user nova-compute[73449]:   <guest>
Aug 17 11:35:50 user nova-compute[73449]:     <os_type>hvm</os_type>
Aug 17 11:35:50 user nova-compute[73449]:     <arch name='microblaze'>
Aug 17 11:35:50 user nova-compute[73449]:       <wordsize>32</wordsize>
Aug 17 11:35:50 user nova-compute[73449]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <domain type='qemu'/>
Aug 17 11:35:50 user nova-compute[73449]:     </arch>
Aug 17 11:35:50 user nova-compute[73449]:     <features>
Aug 17 11:35:50 user nova-compute[73449]:       <cpuselection/>
Aug 17 11:35:50 user nova-compute[73449]:       <deviceboot/>
Aug 17 11:35:50 user nova-compute[73449]:       <disksnapshot default='on' toggle='no'/>
Aug 17 11:35:50 user nova-compute[73449]:     </features>
Aug 17 11:35:50 user nova-compute[73449]:   </guest>
Aug 17 11:35:50 user nova-compute[73449]:   <guest>
Aug 17 11:35:50 user nova-compute[73449]:     <os_type>hvm</os_type>
Aug 17 11:35:50 user nova-compute[73449]:     <arch name='microblazeel'>
Aug 17 11:35:50 user nova-compute[73449]:       <wordsize>32</wordsize>
Aug 17 11:35:50 user nova-compute[73449]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <domain type='qemu'/>
Aug 17 11:35:50 user nova-compute[73449]:     </arch>
Aug 17 11:35:50 user nova-compute[73449]:     <features>
Aug 17 11:35:50 user nova-compute[73449]:       <cpuselection/>
Aug 17 11:35:50 user nova-compute[73449]:       <deviceboot/>
Aug 17 11:35:50 user nova-compute[73449]:       <disksnapshot default='on' toggle='no'/>
Aug 17 11:35:50 user nova-compute[73449]:     </features>
Aug 17 11:35:50 user nova-compute[73449]:   </guest>
Aug 17 11:35:50 user nova-compute[73449]:   <guest>
Aug 17 11:35:50 user nova-compute[73449]:     <os_type>hvm</os_type>
Aug 17 11:35:50 user nova-compute[73449]:     <arch name='mips'>
Aug 17 11:35:50 user nova-compute[73449]:       <wordsize>32</wordsize>
Aug 17 11:35:50 user nova-compute[73449]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='16'>malta</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>mipssim</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <domain type='qemu'/>
Aug 17 11:35:50 user nova-compute[73449]:     </arch>
Aug 17 11:35:50 user nova-compute[73449]:     <features>
Aug 17 11:35:50 user nova-compute[73449]:       <cpuselection/>
Aug 17 11:35:50 user nova-compute[73449]:       <deviceboot/>
Aug 17 11:35:50 user nova-compute[73449]:       <disksnapshot default='on' toggle='no'/>
Aug 17 11:35:50 user nova-compute[73449]:     </features>
Aug 17 11:35:50 user nova-compute[73449]:   </guest>
Aug 17 11:35:50 user nova-compute[73449]:   <guest>
Aug 17 11:35:50 user nova-compute[73449]:     <os_type>hvm</os_type>
Aug 17 11:35:50 user nova-compute[73449]:     <arch name='mipsel'>
Aug 17 11:35:50 user nova-compute[73449]:       <wordsize>32</wordsize>
Aug 17 11:35:50 user nova-compute[73449]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='16'>malta</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>mipssim</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <domain type='qemu'/>
Aug 17 11:35:50 user nova-compute[73449]:     </arch>
Aug 17 11:35:50 user nova-compute[73449]:     <features>
Aug 17 11:35:50 user nova-compute[73449]:       <cpuselection/>
Aug 17 11:35:50 user nova-compute[73449]:       <deviceboot/>
Aug 17 11:35:50 user nova-compute[73449]:       <disksnapshot default='on' toggle='no'/>
Aug 17 11:35:50 user nova-compute[73449]:     </features>
Aug 17 11:35:50 user nova-compute[73449]:   </guest>
Aug 17 11:35:50 user nova-compute[73449]:   <guest>
Aug 17 11:35:50 user nova-compute[73449]:     <os_type>hvm</os_type>
Aug 17 11:35:50 user nova-compute[73449]:     <arch name='mips64'>
Aug 17 11:35:50 user nova-compute[73449]:       <wordsize>64</wordsize>
Aug 17 11:35:50 user nova-compute[73449]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='16'>malta</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>mipssim</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>pica61</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>magnum</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <domain type='qemu'/>
Aug 17 11:35:50 user nova-compute[73449]:     </arch>
Aug 17 11:35:50 user nova-compute[73449]:     <features>
Aug 17 11:35:50 user nova-compute[73449]:       <cpuselection/>
Aug 17 11:35:50 user nova-compute[73449]:       <deviceboot/>
Aug 17 11:35:50 user nova-compute[73449]:       <disksnapshot default='on' toggle='no'/>
Aug 17 11:35:50 user nova-compute[73449]:     </features>
Aug 17 11:35:50 user nova-compute[73449]:   </guest>
Aug 17 11:35:50 user nova-compute[73449]:   <guest>
Aug 17 11:35:50 user nova-compute[73449]:     <os_type>hvm</os_type>
Aug 17 11:35:50 user nova-compute[73449]:     <arch name='mips64el'>
Aug 17 11:35:50 user nova-compute[73449]:       <wordsize>64</wordsize>
Aug 17 11:35:50 user nova-compute[73449]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='16'>malta</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='16'>loongson3-virt</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>mipssim</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>pica61</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>magnum</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='16'>boston</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>fuloong2e</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <domain type='qemu'/>
Aug 17 11:35:50 user nova-compute[73449]:     </arch>
Aug 17 11:35:50 user nova-compute[73449]:     <features>
Aug 17 11:35:50 user nova-compute[73449]:       <cpuselection/>
Aug 17 11:35:50 user nova-compute[73449]:       <deviceboot/>
Aug 17 11:35:50 user nova-compute[73449]:       <disksnapshot default='on' toggle='no'/>
Aug 17 11:35:50 user nova-compute[73449]:     </features>
Aug 17 11:35:50 user nova-compute[73449]:   </guest>
Aug 17 11:35:50 user nova-compute[73449]:   <guest>
Aug 17 11:35:50 user nova-compute[73449]:     <os_type>hvm</os_type>
Aug 17 11:35:50 user nova-compute[73449]:     <arch name='ppc'>
Aug 17 11:35:50 user nova-compute[73449]:       <wordsize>32</wordsize>
Aug 17 11:35:50 user nova-compute[73449]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>g3beige</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>mac99</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='32'>ppce500</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>pegasos2</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>sam460ex</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>bamboo</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>40p</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>ref405ep</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>taihu</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <domain type='qemu'/>
Aug 17 11:35:50 user nova-compute[73449]:     </arch>
Aug 17 11:35:50 user nova-compute[73449]:     <features>
Aug 17 11:35:50 user nova-compute[73449]:       <cpuselection/>
Aug 17 11:35:50 user nova-compute[73449]:       <deviceboot/>
Aug 17 11:35:50 user nova-compute[73449]:       <disksnapshot default='on' toggle='no'/>
Aug 17 11:35:50 user nova-compute[73449]:     </features>
Aug 17 11:35:50 user nova-compute[73449]:   </guest>
Aug 17 11:35:50 user nova-compute[73449]:   <guest>
Aug 17 11:35:50 user nova-compute[73449]:     <os_type>hvm</os_type>
Aug 17 11:35:50 user nova-compute[73449]:     <arch name='ppc64'>
Aug 17 11:35:50 user nova-compute[73449]:       <wordsize>64</wordsize>
Aug 17 11:35:50 user nova-compute[73449]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2048'>powernv9</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>taihu</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2048'>powernv10</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='32'>ppce500</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>40p</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>pegasos2</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>bamboo</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>g3beige</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>mac99</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>sam460ex</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>ref405ep</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2048'>powernv8</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <domain type='qemu'/>
Aug 17 11:35:50 user nova-compute[73449]:     </arch>
Aug 17 11:35:50 user nova-compute[73449]:     <features>
Aug 17 11:35:50 user nova-compute[73449]:       <cpuselection/>
Aug 17 11:35:50 user nova-compute[73449]:       <deviceboot/>
Aug 17 11:35:50 user nova-compute[73449]:       <disksnapshot default='on' toggle='no'/>
Aug 17 11:35:50 user nova-compute[73449]:     </features>
Aug 17 11:35:50 user nova-compute[73449]:   </guest>
Aug 17 11:35:50 user nova-compute[73449]:   <guest>
Aug 17 11:35:50 user nova-compute[73449]:     <os_type>hvm</os_type>
Aug 17 11:35:50 user nova-compute[73449]:     <arch name='ppc64le'>
Aug 17 11:35:50 user nova-compute[73449]:       <wordsize>64</wordsize>
Aug 17 11:35:50 user nova-compute[73449]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2048'>powernv9</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>taihu</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2048'>powernv10</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='32'>ppce500</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>40p</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>pegasos2</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>bamboo</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>g3beige</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>mac99</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>sam460ex</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>ref405ep</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2048'>powernv8</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <domain type='qemu'/>
Aug 17 11:35:50 user nova-compute[73449]:     </arch>
Aug 17 11:35:50 user nova-compute[73449]:     <features>
Aug 17 11:35:50 user nova-compute[73449]:       <cpuselection/>
Aug 17 11:35:50 user nova-compute[73449]:       <deviceboot/>
Aug 17 11:35:50 user nova-compute[73449]:       <disksnapshot default='on' toggle='no'/>
Aug 17 11:35:50 user nova-compute[73449]:     </features>
Aug 17 11:35:50 user nova-compute[73449]:   </guest>
Aug 17 11:35:50 user nova-compute[73449]:   <guest>
Aug 17 11:35:50 user nova-compute[73449]:     <os_type>hvm</os_type>
Aug 17 11:35:50 user nova-compute[73449]:     <arch name='riscv32'>
Aug 17 11:35:50 user nova-compute[73449]:       <wordsize>32</wordsize>
Aug 17 11:35:50 user nova-compute[73449]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='8'>spike</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>opentitan</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='5'>sifive_u</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>sifive_e</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='8'>virt</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <domain type='qemu'/>
Aug 17 11:35:50 user nova-compute[73449]:     </arch>
Aug 17 11:35:50 user nova-compute[73449]:     <features>
Aug 17 11:35:50 user nova-compute[73449]:       <cpuselection/>
Aug 17 11:35:50 user nova-compute[73449]:       <deviceboot/>
Aug 17 11:35:50 user nova-compute[73449]:       <disksnapshot default='on' toggle='no'/>
Aug 17 11:35:50 user nova-compute[73449]:     </features>
Aug 17 11:35:50 user nova-compute[73449]:   </guest>
Aug 17 11:35:50 user nova-compute[73449]:   <guest>
Aug 17 11:35:50 user nova-compute[73449]:     <os_type>hvm</os_type>
Aug 17 11:35:50 user nova-compute[73449]:     <arch name='riscv64'>
Aug 17 11:35:50 user nova-compute[73449]:       <wordsize>64</wordsize>
Aug 17 11:35:50 user nova-compute[73449]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='8'>spike</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='5'>sifive_u</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>shakti_c</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>sifive_e</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='8'>virt</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <domain type='qemu'/>
Aug 17 11:35:50 user nova-compute[73449]:     </arch>
Aug 17 11:35:50 user nova-compute[73449]:     <features>
Aug 17 11:35:50 user nova-compute[73449]:       <cpuselection/>
Aug 17 11:35:50 user nova-compute[73449]:       <deviceboot/>
Aug 17 11:35:50 user nova-compute[73449]:       <disksnapshot default='on' toggle='no'/>
Aug 17 11:35:50 user nova-compute[73449]:     </features>
Aug 17 11:35:50 user nova-compute[73449]:   </guest>
Aug 17 11:35:50 user nova-compute[73449]:   <guest>
Aug 17 11:35:50 user nova-compute[73449]:     <os_type>hvm</os_type>
Aug 17 11:35:50 user nova-compute[73449]:     <arch name='s390x'>
Aug 17 11:35:50 user nova-compute[73449]:       <wordsize>64</wordsize>
Aug 17 11:35:50 user nova-compute[73449]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <domain type='qemu'/>
Aug 17 11:35:50 user nova-compute[73449]:     </arch>
Aug 17 11:35:50 user nova-compute[73449]:     <features>
Aug 17 11:35:50 user nova-compute[73449]:       <cpuselection/>
Aug 17 11:35:50 user nova-compute[73449]:       <deviceboot/>
Aug 17 11:35:50 user nova-compute[73449]:       <disksnapshot default='on' toggle='no'/>
Aug 17 11:35:50 user nova-compute[73449]:     </features>
Aug 17 11:35:50 user nova-compute[73449]:   </guest>
Aug 17 11:35:50 user nova-compute[73449]:   <guest>
Aug 17 11:35:50 user nova-compute[73449]:     <os_type>hvm</os_type>
Aug 17 11:35:50 user nova-compute[73449]:     <arch name='sh4'>
Aug 17 11:35:50 user nova-compute[73449]:       <wordsize>32</wordsize>
Aug 17 11:35:50 user nova-compute[73449]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>shix</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>r2d</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <domain type='qemu'/>
Aug 17 11:35:50 user nova-compute[73449]:     </arch>
Aug 17 11:35:50 user nova-compute[73449]:     <features>
Aug 17 11:35:50 user nova-compute[73449]:       <cpuselection/>
Aug 17 11:35:50 user nova-compute[73449]:       <deviceboot/>
Aug 17 11:35:50 user nova-compute[73449]:       <disksnapshot default='on' toggle='no'/>
Aug 17 11:35:50 user nova-compute[73449]:     </features>
Aug 17 11:35:50 user nova-compute[73449]:   </guest>
Aug 17 11:35:50 user nova-compute[73449]:   <guest>
Aug 17 11:35:50 user nova-compute[73449]:     <os_type>hvm</os_type>
Aug 17 11:35:50 user nova-compute[73449]:     <arch name='sh4eb'>
Aug 17 11:35:50 user nova-compute[73449]:       <wordsize>64</wordsize>
Aug 17 11:35:50 user nova-compute[73449]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>shix</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>r2d</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <domain type='qemu'/>
Aug 17 11:35:50 user nova-compute[73449]:     </arch>
Aug 17 11:35:50 user nova-compute[73449]:     <features>
Aug 17 11:35:50 user nova-compute[73449]:       <cpuselection/>
Aug 17 11:35:50 user nova-compute[73449]:       <deviceboot/>
Aug 17 11:35:50 user nova-compute[73449]:       <disksnapshot default='on' toggle='no'/>
Aug 17 11:35:50 user nova-compute[73449]:     </features>
Aug 17 11:35:50 user nova-compute[73449]:   </guest>
Aug 17 11:35:50 user nova-compute[73449]:   <guest>
Aug 17 11:35:50 user nova-compute[73449]:     <os_type>hvm</os_type>
Aug 17 11:35:50 user nova-compute[73449]:     <arch name='sparc'>
Aug 17 11:35:50 user nova-compute[73449]:       <wordsize>32</wordsize>
Aug 17 11:35:50 user nova-compute[73449]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>SS-5</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='4'>SS-20</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>LX</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>SPARCClassic</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>leon3_generic</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>SPARCbook</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>SS-4</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='4'>SS-600MP</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='4'>SS-10</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>Voyager</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <domain type='qemu'/>
Aug 17 11:35:50 user nova-compute[73449]:     </arch>
Aug 17 11:35:50 user nova-compute[73449]:     <features>
Aug 17 11:35:50 user nova-compute[73449]:       <cpuselection/>
Aug 17 11:35:50 user nova-compute[73449]:       <deviceboot/>
Aug 17 11:35:50 user nova-compute[73449]:       <disksnapshot default='on' toggle='no'/>
Aug 17 11:35:50 user nova-compute[73449]:     </features>
Aug 17 11:35:50 user nova-compute[73449]:   </guest>
Aug 17 11:35:50 user nova-compute[73449]:   <guest>
Aug 17 11:35:50 user nova-compute[73449]:     <os_type>hvm</os_type>
Aug 17 11:35:50 user nova-compute[73449]:     <arch name='sparc64'>
Aug 17 11:35:50 user nova-compute[73449]:       <wordsize>64</wordsize>
Aug 17 11:35:50 user nova-compute[73449]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>sun4u</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>niagara</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>sun4v</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <domain type='qemu'/>
Aug 17 11:35:50 user nova-compute[73449]:     </arch>
Aug 17 11:35:50 user nova-compute[73449]:     <features>
Aug 17 11:35:50 user nova-compute[73449]:       <cpuselection/>
Aug 17 11:35:50 user nova-compute[73449]:       <deviceboot/>
Aug 17 11:35:50 user nova-compute[73449]:       <disksnapshot default='on' toggle='no'/>
Aug 17 11:35:50 user nova-compute[73449]:     </features>
Aug 17 11:35:50 user nova-compute[73449]:   </guest>
Aug 17 11:35:50 user nova-compute[73449]:   <guest>
Aug 17 11:35:50 user nova-compute[73449]:     <os_type>hvm</os_type>
Aug 17 11:35:50 user nova-compute[73449]:     <arch name='x86_64'>
Aug 17 11:35:50 user nova-compute[73449]:       <wordsize>64</wordsize>
Aug 17 11:35:50 user nova-compute[73449]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>x-remote</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='1'>isapc</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='288'>microvm</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <domain type='qemu'/>
Aug 17 11:35:50 user nova-compute[73449]:       <domain type='kvm'/>
Aug 17 11:35:50 user nova-compute[73449]:     </arch>
Aug 17 11:35:50 user nova-compute[73449]:     <features>
Aug 17 11:35:50 user nova-compute[73449]:       <acpi default='on' toggle='yes'/>
Aug 17 11:35:50 user nova-compute[73449]:       <apic default='on' toggle='no'/>
Aug 17 11:35:50 user nova-compute[73449]:       <cpuselection/>
Aug 17 11:35:50 user nova-compute[73449]:       <deviceboot/>
Aug 17 11:35:50 user nova-compute[73449]:       <disksnapshot default='on' toggle='no'/>
Aug 17 11:35:50 user nova-compute[73449]:     </features>
Aug 17 11:35:50 user nova-compute[73449]:   </guest>
Aug 17 11:35:50 user nova-compute[73449]:   <guest>
Aug 17 11:35:50 user nova-compute[73449]:     <os_type>hvm</os_type>
Aug 17 11:35:50 user nova-compute[73449]:     <arch name='xtensa'>
Aug 17 11:35:50 user nova-compute[73449]:       <wordsize>32</wordsize>
Aug 17 11:35:50 user nova-compute[73449]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='4'>sim</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='32'>kc705</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='32'>ml605</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='32'>virt</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='32'>lx200</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='32'>lx60</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <domain type='qemu'/>
Aug 17 11:35:50 user nova-compute[73449]:     </arch>
Aug 17 11:35:50 user nova-compute[73449]:     <features>
Aug 17 11:35:50 user nova-compute[73449]:       <cpuselection/>
Aug 17 11:35:50 user nova-compute[73449]:       <deviceboot/>
Aug 17 11:35:50 user nova-compute[73449]:       <disksnapshot default='on' toggle='no'/>
Aug 17 11:35:50 user nova-compute[73449]:     </features>
Aug 17 11:35:50 user nova-compute[73449]:   </guest>
Aug 17 11:35:50 user nova-compute[73449]:   <guest>
Aug 17 11:35:50 user nova-compute[73449]:     <os_type>hvm</os_type>
Aug 17 11:35:50 user nova-compute[73449]:     <arch name='xtensaeb'>
Aug 17 11:35:50 user nova-compute[73449]:       <wordsize>32</wordsize>
Aug 17 11:35:50 user nova-compute[73449]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='4'>sim</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='32'>kc705</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='32'>ml605</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='32'>virt</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='32'>lx200</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='32'>lx60</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 17 11:35:50 user nova-compute[73449]:       <domain type='qemu'/>
Aug 17 11:35:50 user nova-compute[73449]:     </arch>
Aug 17 11:35:50 user nova-compute[73449]:     <features>
Aug 17 11:35:50 user nova-compute[73449]:       <cpuselection/>
Aug 17 11:35:50 user nova-compute[73449]:       <deviceboot/>
Aug 17 11:35:50 user nova-compute[73449]:       <disksnapshot default='on' toggle='no'/>
Aug 17 11:35:50 user nova-compute[73449]:     </features>
Aug 17 11:35:50 user nova-compute[73449]:   </guest>
Aug 17 11:35:50 user nova-compute[73449]: </capabilities>
Aug 17 11:35:50 user nova-compute[73449]: 
Aug 17 11:35:50 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=73449) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 11:35:50 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=73449) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 11:35:50 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=73449) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 11:35:50 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=73449) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 11:35:50 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=73449) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 11:35:50 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=73449) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 11:35:50 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=73449) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 11:35:50 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=73449) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 11:35:50 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=73449) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 11:35:50 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=73449) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 11:35:50 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=73449) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 11:35:50 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Getting domain capabilities for i686 via machine types: {'q35', 'pc', 'ubuntu', 'ubuntu-q35'} {{(pid=73449) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 11:35:50 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Aug 17 11:35:50 user nova-compute[73449]: <domainCapabilities>
Aug 17 11:35:50 user nova-compute[73449]:   <path>/usr/bin/qemu-system-i386</path>
Aug 17 11:35:50 user nova-compute[73449]:   <domain>kvm</domain>
Aug 17 11:35:50 user nova-compute[73449]:   <machine>pc-q35-6.2</machine>
Aug 17 11:35:50 user nova-compute[73449]:   <arch>i686</arch>
Aug 17 11:35:50 user nova-compute[73449]:   <vcpu max='288'/>
Aug 17 11:35:50 user nova-compute[73449]:   <iothreads supported='yes'/>
Aug 17 11:35:50 user nova-compute[73449]:   <os supported='yes'>
Aug 17 11:35:50 user nova-compute[73449]:     <enum name='firmware'/>
Aug 17 11:35:50 user nova-compute[73449]:     <loader supported='yes'>
Aug 17 11:35:50 user nova-compute[73449]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 17 11:35:50 user nova-compute[73449]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 17 11:35:50 user nova-compute[73449]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 17 11:35:50 user nova-compute[73449]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 17 11:35:50 user nova-compute[73449]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='type'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>rom</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>pflash</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='readonly'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>yes</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>no</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='secure'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>no</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:     </loader>
Aug 17 11:35:50 user nova-compute[73449]:   </os>
Aug 17 11:35:50 user nova-compute[73449]:   <cpu>
Aug 17 11:35:50 user nova-compute[73449]:     <mode name='host-passthrough' supported='yes'>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='hostPassthroughMigratable'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>off</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:     </mode>
Aug 17 11:35:50 user nova-compute[73449]:     <mode name='maximum' supported='yes'>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='maximumMigratable'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>on</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>off</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:     </mode>
Aug 17 11:35:50 user nova-compute[73449]:     <mode name='host-model' supported='yes'>
Aug 17 11:35:50 user nova-compute[73449]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 17 11:35:50 user nova-compute[73449]:       <vendor>Intel</vendor>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='ss'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='vmx'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='pcid'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='hypervisor'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='arat'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='tsc_adjust'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='umip'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='md-clear'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='stibp'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='arch-capabilities'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='ssbd'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='ibpb'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='ibrs'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='amd-stibp'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='amd-ssbd'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='disable' name='erms'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='disable' name='xsaveopt'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='disable' name='lm'/>
Aug 17 11:35:50 user nova-compute[73449]:     </mode>
Aug 17 11:35:50 user nova-compute[73449]:     <mode name='custom' supported='yes'>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>qemu64</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='yes'>qemu32</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>phenom</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='yes'>pentium3</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='yes'>pentium2</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='yes'>pentium</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>n270</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>kvm64</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='yes'>kvm32</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='yes'>coreduo</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>core2duo</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>athlon</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Westmere-IBRS</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Westmere</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Snowridge</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Skylake-Server</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Skylake-Client</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>SandyBridge</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Penryn</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Opteron_G5</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Opteron_G4</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Opteron_G3</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Opteron_G2</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Opteron_G1</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Nehalem-IBRS</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Nehalem</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>IvyBridge</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Icelake-Server</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Haswell-noTSX</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Haswell-IBRS</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Haswell</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>EPYC-Rome</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>EPYC-Milan</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>EPYC-IBPB</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>EPYC</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Dhyana</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Cooperlake</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Conroe</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Cascadelake-Server</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Broadwell-noTSX</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Broadwell-IBRS</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Broadwell</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='yes'>486</model>
Aug 17 11:35:50 user nova-compute[73449]:     </mode>
Aug 17 11:35:50 user nova-compute[73449]:   </cpu>
Aug 17 11:35:50 user nova-compute[73449]:   <memoryBacking supported='yes'>
Aug 17 11:35:50 user nova-compute[73449]:     <enum name='sourceType'>
Aug 17 11:35:50 user nova-compute[73449]:       <value>file</value>
Aug 17 11:35:50 user nova-compute[73449]:       <value>anonymous</value>
Aug 17 11:35:50 user nova-compute[73449]:       <value>memfd</value>
Aug 17 11:35:50 user nova-compute[73449]:     </enum>
Aug 17 11:35:50 user nova-compute[73449]:   </memoryBacking>
Aug 17 11:35:50 user nova-compute[73449]:   <devices>
Aug 17 11:35:50 user nova-compute[73449]:     <disk supported='yes'>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='diskDevice'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>disk</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>cdrom</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>floppy</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>lun</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='bus'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>fdc</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>scsi</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>virtio</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>usb</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>sata</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='model'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>virtio</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>virtio-transitional</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>virtio-non-transitional</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:     </disk>
Aug 17 11:35:50 user nova-compute[73449]:     <graphics supported='yes'>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='type'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>sdl</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>vnc</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>spice</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>egl-headless</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:     </graphics>
Aug 17 11:35:50 user nova-compute[73449]:     <video supported='yes'>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='modelType'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>vga</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>cirrus</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>vmvga</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>qxl</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>virtio</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>none</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>bochs</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>ramfb</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:     </video>
Aug 17 11:35:50 user nova-compute[73449]:     <hostdev supported='yes'>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='mode'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>subsystem</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='startupPolicy'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>default</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>mandatory</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>requisite</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>optional</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='subsysType'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>usb</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>pci</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>scsi</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='capsType'/>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='pciBackend'/>
Aug 17 11:35:50 user nova-compute[73449]:     </hostdev>
Aug 17 11:35:50 user nova-compute[73449]:     <rng supported='yes'>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='model'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>virtio</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>virtio-transitional</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>virtio-non-transitional</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='backendModel'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>random</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>egd</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>builtin</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:     </rng>
Aug 17 11:35:50 user nova-compute[73449]:     <filesystem supported='yes'>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='driverType'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>path</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>handle</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>virtiofs</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:     </filesystem>
Aug 17 11:35:50 user nova-compute[73449]:     <tpm supported='yes'>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='model'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>tpm-tis</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>tpm-crb</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='backendModel'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>passthrough</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>emulator</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:     </tpm>
Aug 17 11:35:50 user nova-compute[73449]:   </devices>
Aug 17 11:35:50 user nova-compute[73449]:   <features>
Aug 17 11:35:50 user nova-compute[73449]:     <gic supported='no'/>
Aug 17 11:35:50 user nova-compute[73449]:     <vmcoreinfo supported='yes'/>
Aug 17 11:35:50 user nova-compute[73449]:     <genid supported='yes'/>
Aug 17 11:35:50 user nova-compute[73449]:     <backingStoreInput supported='yes'/>
Aug 17 11:35:50 user nova-compute[73449]:     <backup supported='yes'/>
Aug 17 11:35:50 user nova-compute[73449]:     <sev supported='no'/>
Aug 17 11:35:50 user nova-compute[73449]:   </features>
Aug 17 11:35:50 user nova-compute[73449]: </domainCapabilities>
Aug 17 11:35:50 user nova-compute[73449]:  {{(pid=73449) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 17 11:35:50 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Aug 17 11:35:50 user nova-compute[73449]: <domainCapabilities>
Aug 17 11:35:50 user nova-compute[73449]:   <path>/usr/bin/qemu-system-i386</path>
Aug 17 11:35:50 user nova-compute[73449]:   <domain>kvm</domain>
Aug 17 11:35:50 user nova-compute[73449]:   <machine>pc-i440fx-6.2</machine>
Aug 17 11:35:50 user nova-compute[73449]:   <arch>i686</arch>
Aug 17 11:35:50 user nova-compute[73449]:   <vcpu max='255'/>
Aug 17 11:35:50 user nova-compute[73449]:   <iothreads supported='yes'/>
Aug 17 11:35:50 user nova-compute[73449]:   <os supported='yes'>
Aug 17 11:35:50 user nova-compute[73449]:     <enum name='firmware'/>
Aug 17 11:35:50 user nova-compute[73449]:     <loader supported='yes'>
Aug 17 11:35:50 user nova-compute[73449]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 17 11:35:50 user nova-compute[73449]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 17 11:35:50 user nova-compute[73449]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 17 11:35:50 user nova-compute[73449]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 17 11:35:50 user nova-compute[73449]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='type'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>rom</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>pflash</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='readonly'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>yes</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>no</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='secure'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>no</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:     </loader>
Aug 17 11:35:50 user nova-compute[73449]:   </os>
Aug 17 11:35:50 user nova-compute[73449]:   <cpu>
Aug 17 11:35:50 user nova-compute[73449]:     <mode name='host-passthrough' supported='yes'>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='hostPassthroughMigratable'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>off</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:     </mode>
Aug 17 11:35:50 user nova-compute[73449]:     <mode name='maximum' supported='yes'>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='maximumMigratable'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>on</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>off</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:     </mode>
Aug 17 11:35:50 user nova-compute[73449]:     <mode name='host-model' supported='yes'>
Aug 17 11:35:50 user nova-compute[73449]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 17 11:35:50 user nova-compute[73449]:       <vendor>Intel</vendor>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='ss'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='vmx'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='pcid'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='hypervisor'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='arat'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='tsc_adjust'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='umip'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='md-clear'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='stibp'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='arch-capabilities'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='ssbd'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='ibpb'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='ibrs'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='amd-stibp'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='amd-ssbd'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='disable' name='erms'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='disable' name='xsaveopt'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='disable' name='lm'/>
Aug 17 11:35:50 user nova-compute[73449]:     </mode>
Aug 17 11:35:50 user nova-compute[73449]:     <mode name='custom' supported='yes'>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>qemu64</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='yes'>qemu32</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>phenom</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='yes'>pentium3</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='yes'>pentium2</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='yes'>pentium</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>n270</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>kvm64</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='yes'>kvm32</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='yes'>coreduo</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>core2duo</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>athlon</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Westmere-IBRS</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Westmere</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Snowridge</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Skylake-Server</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Skylake-Client</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>SandyBridge</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Penryn</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Opteron_G5</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Opteron_G4</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Opteron_G3</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Opteron_G2</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Opteron_G1</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Nehalem-IBRS</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Nehalem</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>IvyBridge</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Icelake-Server</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Haswell-noTSX</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Haswell-IBRS</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Haswell</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>EPYC-Rome</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>EPYC-Milan</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>EPYC-IBPB</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>EPYC</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Dhyana</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Cooperlake</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Conroe</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Cascadelake-Server</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Broadwell-noTSX</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Broadwell-IBRS</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Broadwell</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='yes'>486</model>
Aug 17 11:35:50 user nova-compute[73449]:     </mode>
Aug 17 11:35:50 user nova-compute[73449]:   </cpu>
Aug 17 11:35:50 user nova-compute[73449]:   <memoryBacking supported='yes'>
Aug 17 11:35:50 user nova-compute[73449]:     <enum name='sourceType'>
Aug 17 11:35:50 user nova-compute[73449]:       <value>file</value>
Aug 17 11:35:50 user nova-compute[73449]:       <value>anonymous</value>
Aug 17 11:35:50 user nova-compute[73449]:       <value>memfd</value>
Aug 17 11:35:50 user nova-compute[73449]:     </enum>
Aug 17 11:35:50 user nova-compute[73449]:   </memoryBacking>
Aug 17 11:35:50 user nova-compute[73449]:   <devices>
Aug 17 11:35:50 user nova-compute[73449]:     <disk supported='yes'>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='diskDevice'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>disk</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>cdrom</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>floppy</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>lun</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='bus'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>ide</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>fdc</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>scsi</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>virtio</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>usb</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>sata</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='model'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>virtio</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>virtio-transitional</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>virtio-non-transitional</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:     </disk>
Aug 17 11:35:50 user nova-compute[73449]:     <graphics supported='yes'>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='type'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>sdl</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>vnc</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>spice</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>egl-headless</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:     </graphics>
Aug 17 11:35:50 user nova-compute[73449]:     <video supported='yes'>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='modelType'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>vga</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>cirrus</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>vmvga</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>qxl</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>virtio</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>none</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>bochs</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>ramfb</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:     </video>
Aug 17 11:35:50 user nova-compute[73449]:     <hostdev supported='yes'>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='mode'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>subsystem</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='startupPolicy'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>default</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>mandatory</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>requisite</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>optional</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='subsysType'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>usb</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>pci</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>scsi</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='capsType'/>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='pciBackend'/>
Aug 17 11:35:50 user nova-compute[73449]:     </hostdev>
Aug 17 11:35:50 user nova-compute[73449]:     <rng supported='yes'>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='model'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>virtio</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>virtio-transitional</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>virtio-non-transitional</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='backendModel'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>random</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>egd</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>builtin</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:     </rng>
Aug 17 11:35:50 user nova-compute[73449]:     <filesystem supported='yes'>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='driverType'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>path</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>handle</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>virtiofs</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:     </filesystem>
Aug 17 11:35:50 user nova-compute[73449]:     <tpm supported='yes'>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='model'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>tpm-tis</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>tpm-crb</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='backendModel'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>passthrough</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>emulator</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:     </tpm>
Aug 17 11:35:50 user nova-compute[73449]:   </devices>
Aug 17 11:35:50 user nova-compute[73449]:   <features>
Aug 17 11:35:50 user nova-compute[73449]:     <gic supported='no'/>
Aug 17 11:35:50 user nova-compute[73449]:     <vmcoreinfo supported='yes'/>
Aug 17 11:35:50 user nova-compute[73449]:     <genid supported='yes'/>
Aug 17 11:35:50 user nova-compute[73449]:     <backingStoreInput supported='yes'/>
Aug 17 11:35:50 user nova-compute[73449]:     <backup supported='yes'/>
Aug 17 11:35:50 user nova-compute[73449]:     <sev supported='no'/>
Aug 17 11:35:50 user nova-compute[73449]:   </features>
Aug 17 11:35:50 user nova-compute[73449]: </domainCapabilities>
Aug 17 11:35:50 user nova-compute[73449]:  {{(pid=73449) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 17 11:35:50 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Aug 17 11:35:50 user nova-compute[73449]: <domainCapabilities>
Aug 17 11:35:50 user nova-compute[73449]:   <path>/usr/bin/qemu-system-i386</path>
Aug 17 11:35:50 user nova-compute[73449]:   <domain>kvm</domain>
Aug 17 11:35:50 user nova-compute[73449]:   <machine>pc-i440fx-jammy</machine>
Aug 17 11:35:50 user nova-compute[73449]:   <arch>i686</arch>
Aug 17 11:35:50 user nova-compute[73449]:   <vcpu max='255'/>
Aug 17 11:35:50 user nova-compute[73449]:   <iothreads supported='yes'/>
Aug 17 11:35:50 user nova-compute[73449]:   <os supported='yes'>
Aug 17 11:35:50 user nova-compute[73449]:     <enum name='firmware'/>
Aug 17 11:35:50 user nova-compute[73449]:     <loader supported='yes'>
Aug 17 11:35:50 user nova-compute[73449]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 17 11:35:50 user nova-compute[73449]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 17 11:35:50 user nova-compute[73449]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 17 11:35:50 user nova-compute[73449]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 17 11:35:50 user nova-compute[73449]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='type'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>rom</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>pflash</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='readonly'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>yes</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>no</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='secure'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>no</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:     </loader>
Aug 17 11:35:50 user nova-compute[73449]:   </os>
Aug 17 11:35:50 user nova-compute[73449]:   <cpu>
Aug 17 11:35:50 user nova-compute[73449]:     <mode name='host-passthrough' supported='yes'>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='hostPassthroughMigratable'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>off</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:     </mode>
Aug 17 11:35:50 user nova-compute[73449]:     <mode name='maximum' supported='yes'>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='maximumMigratable'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>on</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>off</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:     </mode>
Aug 17 11:35:50 user nova-compute[73449]:     <mode name='host-model' supported='yes'>
Aug 17 11:35:50 user nova-compute[73449]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 17 11:35:50 user nova-compute[73449]:       <vendor>Intel</vendor>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='ss'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='vmx'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='pcid'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='hypervisor'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='arat'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='tsc_adjust'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='umip'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='md-clear'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='stibp'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='arch-capabilities'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='ssbd'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='ibpb'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='ibrs'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='amd-stibp'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='amd-ssbd'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='disable' name='erms'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='disable' name='xsaveopt'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='disable' name='lm'/>
Aug 17 11:35:50 user nova-compute[73449]:     </mode>
Aug 17 11:35:50 user nova-compute[73449]:     <mode name='custom' supported='yes'>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>qemu64</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='yes'>qemu32</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>phenom</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='yes'>pentium3</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='yes'>pentium2</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='yes'>pentium</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>n270</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>kvm64</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='yes'>kvm32</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='yes'>coreduo</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>core2duo</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>athlon</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Westmere-IBRS</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Westmere</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Snowridge</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Skylake-Server</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Skylake-Client</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>SandyBridge</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Penryn</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Opteron_G5</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Opteron_G4</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Opteron_G3</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Opteron_G2</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Opteron_G1</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Nehalem-IBRS</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Nehalem</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>IvyBridge</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Icelake-Server</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Haswell-noTSX</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Haswell-IBRS</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Haswell</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>EPYC-Rome</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>EPYC-Milan</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>EPYC-IBPB</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>EPYC</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Dhyana</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Cooperlake</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Conroe</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Cascadelake-Server</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Broadwell-noTSX</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Broadwell-IBRS</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Broadwell</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='yes'>486</model>
Aug 17 11:35:50 user nova-compute[73449]:     </mode>
Aug 17 11:35:50 user nova-compute[73449]:   </cpu>
Aug 17 11:35:50 user nova-compute[73449]:   <memoryBacking supported='yes'>
Aug 17 11:35:50 user nova-compute[73449]:     <enum name='sourceType'>
Aug 17 11:35:50 user nova-compute[73449]:       <value>file</value>
Aug 17 11:35:50 user nova-compute[73449]:       <value>anonymous</value>
Aug 17 11:35:50 user nova-compute[73449]:       <value>memfd</value>
Aug 17 11:35:50 user nova-compute[73449]:     </enum>
Aug 17 11:35:50 user nova-compute[73449]:   </memoryBacking>
Aug 17 11:35:50 user nova-compute[73449]:   <devices>
Aug 17 11:35:50 user nova-compute[73449]:     <disk supported='yes'>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='diskDevice'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>disk</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>cdrom</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>floppy</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>lun</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='bus'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>ide</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>fdc</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>scsi</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>virtio</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>usb</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>sata</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='model'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>virtio</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>virtio-transitional</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>virtio-non-transitional</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:     </disk>
Aug 17 11:35:50 user nova-compute[73449]:     <graphics supported='yes'>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='type'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>sdl</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>vnc</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>spice</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>egl-headless</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:     </graphics>
Aug 17 11:35:50 user nova-compute[73449]:     <video supported='yes'>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='modelType'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>vga</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>cirrus</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>vmvga</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>qxl</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>virtio</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>none</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>bochs</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>ramfb</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:     </video>
Aug 17 11:35:50 user nova-compute[73449]:     <hostdev supported='yes'>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='mode'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>subsystem</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='startupPolicy'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>default</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>mandatory</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>requisite</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>optional</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='subsysType'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>usb</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>pci</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>scsi</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='capsType'/>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='pciBackend'/>
Aug 17 11:35:50 user nova-compute[73449]:     </hostdev>
Aug 17 11:35:50 user nova-compute[73449]:     <rng supported='yes'>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='model'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>virtio</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>virtio-transitional</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>virtio-non-transitional</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='backendModel'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>random</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>egd</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>builtin</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:     </rng>
Aug 17 11:35:50 user nova-compute[73449]:     <filesystem supported='yes'>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='driverType'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>path</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>handle</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>virtiofs</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:     </filesystem>
Aug 17 11:35:50 user nova-compute[73449]:     <tpm supported='yes'>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='model'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>tpm-tis</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>tpm-crb</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='backendModel'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>passthrough</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>emulator</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:     </tpm>
Aug 17 11:35:50 user nova-compute[73449]:   </devices>
Aug 17 11:35:50 user nova-compute[73449]:   <features>
Aug 17 11:35:50 user nova-compute[73449]:     <gic supported='no'/>
Aug 17 11:35:50 user nova-compute[73449]:     <vmcoreinfo supported='yes'/>
Aug 17 11:35:50 user nova-compute[73449]:     <genid supported='yes'/>
Aug 17 11:35:50 user nova-compute[73449]:     <backingStoreInput supported='yes'/>
Aug 17 11:35:50 user nova-compute[73449]:     <backup supported='yes'/>
Aug 17 11:35:50 user nova-compute[73449]:     <sev supported='no'/>
Aug 17 11:35:50 user nova-compute[73449]:   </features>
Aug 17 11:35:50 user nova-compute[73449]: </domainCapabilities>
Aug 17 11:35:50 user nova-compute[73449]:  {{(pid=73449) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 17 11:35:50 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Aug 17 11:35:50 user nova-compute[73449]: <domainCapabilities>
Aug 17 11:35:50 user nova-compute[73449]:   <path>/usr/bin/qemu-system-i386</path>
Aug 17 11:35:50 user nova-compute[73449]:   <domain>kvm</domain>
Aug 17 11:35:50 user nova-compute[73449]:   <machine>pc-q35-jammy</machine>
Aug 17 11:35:50 user nova-compute[73449]:   <arch>i686</arch>
Aug 17 11:35:50 user nova-compute[73449]:   <vcpu max='288'/>
Aug 17 11:35:50 user nova-compute[73449]:   <iothreads supported='yes'/>
Aug 17 11:35:50 user nova-compute[73449]:   <os supported='yes'>
Aug 17 11:35:50 user nova-compute[73449]:     <enum name='firmware'/>
Aug 17 11:35:50 user nova-compute[73449]:     <loader supported='yes'>
Aug 17 11:35:50 user nova-compute[73449]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 17 11:35:50 user nova-compute[73449]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 17 11:35:50 user nova-compute[73449]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 17 11:35:50 user nova-compute[73449]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 17 11:35:50 user nova-compute[73449]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='type'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>rom</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>pflash</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='readonly'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>yes</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>no</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='secure'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>no</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:     </loader>
Aug 17 11:35:50 user nova-compute[73449]:   </os>
Aug 17 11:35:50 user nova-compute[73449]:   <cpu>
Aug 17 11:35:50 user nova-compute[73449]:     <mode name='host-passthrough' supported='yes'>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='hostPassthroughMigratable'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>off</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:     </mode>
Aug 17 11:35:50 user nova-compute[73449]:     <mode name='maximum' supported='yes'>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='maximumMigratable'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>on</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>off</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:     </mode>
Aug 17 11:35:50 user nova-compute[73449]:     <mode name='host-model' supported='yes'>
Aug 17 11:35:50 user nova-compute[73449]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 17 11:35:50 user nova-compute[73449]:       <vendor>Intel</vendor>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='ss'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='vmx'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='pcid'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='hypervisor'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='arat'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='tsc_adjust'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='umip'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='md-clear'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='stibp'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='arch-capabilities'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='ssbd'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='ibpb'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='ibrs'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='amd-stibp'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='amd-ssbd'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='disable' name='erms'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='disable' name='xsaveopt'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='disable' name='lm'/>
Aug 17 11:35:50 user nova-compute[73449]:     </mode>
Aug 17 11:35:50 user nova-compute[73449]:     <mode name='custom' supported='yes'>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>qemu64</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='yes'>qemu32</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>phenom</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='yes'>pentium3</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='yes'>pentium2</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='yes'>pentium</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>n270</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>kvm64</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='yes'>kvm32</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='yes'>coreduo</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>core2duo</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>athlon</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Westmere-IBRS</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Westmere</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Snowridge</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Skylake-Server</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Skylake-Client</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>SandyBridge</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Penryn</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Opteron_G5</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Opteron_G4</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Opteron_G3</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Opteron_G2</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Opteron_G1</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Nehalem-IBRS</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Nehalem</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>IvyBridge</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Icelake-Server</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Haswell-noTSX</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Haswell-IBRS</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Haswell</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>EPYC-Rome</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>EPYC-Milan</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>EPYC-IBPB</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>EPYC</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Dhyana</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Cooperlake</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Conroe</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Cascadelake-Server</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Broadwell-noTSX</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Broadwell-IBRS</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Broadwell</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='yes'>486</model>
Aug 17 11:35:50 user nova-compute[73449]:     </mode>
Aug 17 11:35:50 user nova-compute[73449]:   </cpu>
Aug 17 11:35:50 user nova-compute[73449]:   <memoryBacking supported='yes'>
Aug 17 11:35:50 user nova-compute[73449]:     <enum name='sourceType'>
Aug 17 11:35:50 user nova-compute[73449]:       <value>file</value>
Aug 17 11:35:50 user nova-compute[73449]:       <value>anonymous</value>
Aug 17 11:35:50 user nova-compute[73449]:       <value>memfd</value>
Aug 17 11:35:50 user nova-compute[73449]:     </enum>
Aug 17 11:35:50 user nova-compute[73449]:   </memoryBacking>
Aug 17 11:35:50 user nova-compute[73449]:   <devices>
Aug 17 11:35:50 user nova-compute[73449]:     <disk supported='yes'>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='diskDevice'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>disk</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>cdrom</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>floppy</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>lun</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='bus'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>fdc</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>scsi</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>virtio</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>usb</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>sata</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='model'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>virtio</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>virtio-transitional</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>virtio-non-transitional</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:     </disk>
Aug 17 11:35:50 user nova-compute[73449]:     <graphics supported='yes'>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='type'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>sdl</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>vnc</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>spice</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>egl-headless</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:     </graphics>
Aug 17 11:35:50 user nova-compute[73449]:     <video supported='yes'>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='modelType'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>vga</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>cirrus</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>vmvga</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>qxl</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>virtio</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>none</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>bochs</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>ramfb</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:     </video>
Aug 17 11:35:50 user nova-compute[73449]:     <hostdev supported='yes'>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='mode'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>subsystem</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='startupPolicy'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>default</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>mandatory</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>requisite</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>optional</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='subsysType'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>usb</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>pci</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>scsi</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='capsType'/>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='pciBackend'/>
Aug 17 11:35:50 user nova-compute[73449]:     </hostdev>
Aug 17 11:35:50 user nova-compute[73449]:     <rng supported='yes'>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='model'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>virtio</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>virtio-transitional</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>virtio-non-transitional</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='backendModel'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>random</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>egd</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>builtin</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:     </rng>
Aug 17 11:35:50 user nova-compute[73449]:     <filesystem supported='yes'>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='driverType'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>path</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>handle</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>virtiofs</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:     </filesystem>
Aug 17 11:35:50 user nova-compute[73449]:     <tpm supported='yes'>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='model'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>tpm-tis</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>tpm-crb</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='backendModel'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>passthrough</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>emulator</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:     </tpm>
Aug 17 11:35:50 user nova-compute[73449]:   </devices>
Aug 17 11:35:50 user nova-compute[73449]:   <features>
Aug 17 11:35:50 user nova-compute[73449]:     <gic supported='no'/>
Aug 17 11:35:50 user nova-compute[73449]:     <vmcoreinfo supported='yes'/>
Aug 17 11:35:50 user nova-compute[73449]:     <genid supported='yes'/>
Aug 17 11:35:50 user nova-compute[73449]:     <backingStoreInput supported='yes'/>
Aug 17 11:35:50 user nova-compute[73449]:     <backup supported='yes'/>
Aug 17 11:35:50 user nova-compute[73449]:     <sev supported='no'/>
Aug 17 11:35:50 user nova-compute[73449]:   </features>
Aug 17 11:35:50 user nova-compute[73449]: </domainCapabilities>
Aug 17 11:35:50 user nova-compute[73449]:  {{(pid=73449) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 17 11:35:50 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=73449) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 11:35:50 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=73449) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 11:35:50 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=73449) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 11:35:50 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=73449) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 11:35:50 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=73449) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 11:35:50 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=73449) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 11:35:50 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=73449) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 11:35:50 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=73449) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 11:35:50 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=73449) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 11:35:50 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=73449) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 11:35:50 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=73449) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 11:35:50 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=73449) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 11:35:50 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=73449) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 11:35:50 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=73449) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 11:35:50 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=73449) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 11:35:50 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=73449) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 11:35:50 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=73449) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 11:35:50 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Getting domain capabilities for ppc64 via machine types: {'pseries', 'powernv', None} {{(pid=73449) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 11:35:50 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=73449) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 11:35:50 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=73449) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 11:35:50 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=73449) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 11:35:50 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=73449) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 11:35:50 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=73449) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 11:35:50 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=73449) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 11:35:50 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=73449) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 11:35:50 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=73449) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 11:35:50 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=73449) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 11:35:50 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=73449) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 11:35:50 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=73449) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 11:35:50 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=73449) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 11:35:50 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=73449) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 11:35:50 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=73449) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 11:35:50 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=73449) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 11:35:50 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=73449) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 11:35:50 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=73449) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 11:35:50 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=73449) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 11:35:50 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=73449) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 11:35:50 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=73449) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 11:35:50 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Getting domain capabilities for x86_64 via machine types: {'q35', 'pc', 'ubuntu', 'ubuntu-q35'} {{(pid=73449) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 11:35:50 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Aug 17 11:35:50 user nova-compute[73449]: <domainCapabilities>
Aug 17 11:35:50 user nova-compute[73449]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 17 11:35:50 user nova-compute[73449]:   <domain>kvm</domain>
Aug 17 11:35:50 user nova-compute[73449]:   <machine>pc-q35-6.2</machine>
Aug 17 11:35:50 user nova-compute[73449]:   <arch>x86_64</arch>
Aug 17 11:35:50 user nova-compute[73449]:   <vcpu max='288'/>
Aug 17 11:35:50 user nova-compute[73449]:   <iothreads supported='yes'/>
Aug 17 11:35:50 user nova-compute[73449]:   <os supported='yes'>
Aug 17 11:35:50 user nova-compute[73449]:     <enum name='firmware'>
Aug 17 11:35:50 user nova-compute[73449]:       <value>efi</value>
Aug 17 11:35:50 user nova-compute[73449]:     </enum>
Aug 17 11:35:50 user nova-compute[73449]:     <loader supported='yes'>
Aug 17 11:35:50 user nova-compute[73449]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 17 11:35:50 user nova-compute[73449]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 17 11:35:50 user nova-compute[73449]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='type'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>rom</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>pflash</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='readonly'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>yes</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>no</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='secure'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>yes</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>no</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:     </loader>
Aug 17 11:35:50 user nova-compute[73449]:   </os>
Aug 17 11:35:50 user nova-compute[73449]:   <cpu>
Aug 17 11:35:50 user nova-compute[73449]:     <mode name='host-passthrough' supported='yes'>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='hostPassthroughMigratable'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>on</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>off</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:     </mode>
Aug 17 11:35:50 user nova-compute[73449]:     <mode name='maximum' supported='yes'>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='maximumMigratable'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>on</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>off</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:     </mode>
Aug 17 11:35:50 user nova-compute[73449]:     <mode name='host-model' supported='yes'>
Aug 17 11:35:50 user nova-compute[73449]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 17 11:35:50 user nova-compute[73449]:       <vendor>Intel</vendor>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='ss'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='vmx'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='pcid'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='hypervisor'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='arat'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='tsc_adjust'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='umip'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='md-clear'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='stibp'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='arch-capabilities'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='ssbd'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='invtsc'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='ibpb'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='ibrs'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='amd-stibp'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='amd-ssbd'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='rsba'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='pschange-mc-no'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='disable' name='erms'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='disable' name='xsaveopt'/>
Aug 17 11:35:50 user nova-compute[73449]:     </mode>
Aug 17 11:35:50 user nova-compute[73449]:     <mode name='custom' supported='yes'>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>qemu64</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='yes'>qemu32</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>phenom</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='yes'>pentium3</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='yes'>pentium2</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='yes'>pentium</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>n270</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='yes'>kvm64</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='yes'>kvm32</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='yes'>coreduo</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='yes'>core2duo</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>athlon</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='yes'>Westmere-IBRS</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='yes'>Westmere</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Snowridge</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Skylake-Server</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Skylake-Client</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>SandyBridge</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='yes'>Penryn</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Opteron_G5</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Opteron_G4</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Opteron_G3</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Opteron_G2</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='yes'>Opteron_G1</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='yes'>Nehalem</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>IvyBridge</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Icelake-Server</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Haswell-noTSX</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Haswell-IBRS</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Haswell</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>EPYC-Rome</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>EPYC-Milan</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>EPYC-IBPB</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>EPYC</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Dhyana</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Cooperlake</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='yes'>Conroe</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Cascadelake-Server</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Broadwell-noTSX</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Broadwell-IBRS</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Broadwell</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='yes'>486</model>
Aug 17 11:35:50 user nova-compute[73449]:     </mode>
Aug 17 11:35:50 user nova-compute[73449]:   </cpu>
Aug 17 11:35:50 user nova-compute[73449]:   <memoryBacking supported='yes'>
Aug 17 11:35:50 user nova-compute[73449]:     <enum name='sourceType'>
Aug 17 11:35:50 user nova-compute[73449]:       <value>file</value>
Aug 17 11:35:50 user nova-compute[73449]:       <value>anonymous</value>
Aug 17 11:35:50 user nova-compute[73449]:       <value>memfd</value>
Aug 17 11:35:50 user nova-compute[73449]:     </enum>
Aug 17 11:35:50 user nova-compute[73449]:   </memoryBacking>
Aug 17 11:35:50 user nova-compute[73449]:   <devices>
Aug 17 11:35:50 user nova-compute[73449]:     <disk supported='yes'>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='diskDevice'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>disk</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>cdrom</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>floppy</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>lun</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='bus'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>fdc</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>scsi</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>virtio</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>usb</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>sata</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='model'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>virtio</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>virtio-transitional</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>virtio-non-transitional</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:     </disk>
Aug 17 11:35:50 user nova-compute[73449]:     <graphics supported='yes'>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='type'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>sdl</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>vnc</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>spice</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>egl-headless</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:     </graphics>
Aug 17 11:35:50 user nova-compute[73449]:     <video supported='yes'>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='modelType'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>vga</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>cirrus</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>vmvga</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>qxl</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>virtio</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>none</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>bochs</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>ramfb</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:     </video>
Aug 17 11:35:50 user nova-compute[73449]:     <hostdev supported='yes'>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='mode'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>subsystem</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='startupPolicy'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>default</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>mandatory</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>requisite</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>optional</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='subsysType'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>usb</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>pci</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>scsi</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='capsType'/>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='pciBackend'/>
Aug 17 11:35:50 user nova-compute[73449]:     </hostdev>
Aug 17 11:35:50 user nova-compute[73449]:     <rng supported='yes'>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='model'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>virtio</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>virtio-transitional</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>virtio-non-transitional</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='backendModel'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>random</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>egd</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>builtin</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:     </rng>
Aug 17 11:35:50 user nova-compute[73449]:     <filesystem supported='yes'>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='driverType'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>path</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>handle</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>virtiofs</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:     </filesystem>
Aug 17 11:35:50 user nova-compute[73449]:     <tpm supported='yes'>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='model'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>tpm-tis</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>tpm-crb</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='backendModel'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>passthrough</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>emulator</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:     </tpm>
Aug 17 11:35:50 user nova-compute[73449]:   </devices>
Aug 17 11:35:50 user nova-compute[73449]:   <features>
Aug 17 11:35:50 user nova-compute[73449]:     <gic supported='no'/>
Aug 17 11:35:50 user nova-compute[73449]:     <vmcoreinfo supported='yes'/>
Aug 17 11:35:50 user nova-compute[73449]:     <genid supported='yes'/>
Aug 17 11:35:50 user nova-compute[73449]:     <backingStoreInput supported='yes'/>
Aug 17 11:35:50 user nova-compute[73449]:     <backup supported='yes'/>
Aug 17 11:35:50 user nova-compute[73449]:     <sev supported='no'/>
Aug 17 11:35:50 user nova-compute[73449]:   </features>
Aug 17 11:35:50 user nova-compute[73449]: </domainCapabilities>
Aug 17 11:35:50 user nova-compute[73449]:  {{(pid=73449) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 17 11:35:50 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Aug 17 11:35:50 user nova-compute[73449]: <domainCapabilities>
Aug 17 11:35:50 user nova-compute[73449]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 17 11:35:50 user nova-compute[73449]:   <domain>kvm</domain>
Aug 17 11:35:50 user nova-compute[73449]:   <machine>pc-i440fx-6.2</machine>
Aug 17 11:35:50 user nova-compute[73449]:   <arch>x86_64</arch>
Aug 17 11:35:50 user nova-compute[73449]:   <vcpu max='255'/>
Aug 17 11:35:50 user nova-compute[73449]:   <iothreads supported='yes'/>
Aug 17 11:35:50 user nova-compute[73449]:   <os supported='yes'>
Aug 17 11:35:50 user nova-compute[73449]:     <enum name='firmware'>
Aug 17 11:35:50 user nova-compute[73449]:       <value>efi</value>
Aug 17 11:35:50 user nova-compute[73449]:     </enum>
Aug 17 11:35:50 user nova-compute[73449]:     <loader supported='yes'>
Aug 17 11:35:50 user nova-compute[73449]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='type'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>rom</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>pflash</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='readonly'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>yes</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>no</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='secure'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>no</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:     </loader>
Aug 17 11:35:50 user nova-compute[73449]:   </os>
Aug 17 11:35:50 user nova-compute[73449]:   <cpu>
Aug 17 11:35:50 user nova-compute[73449]:     <mode name='host-passthrough' supported='yes'>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='hostPassthroughMigratable'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>on</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>off</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:     </mode>
Aug 17 11:35:50 user nova-compute[73449]:     <mode name='maximum' supported='yes'>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='maximumMigratable'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>on</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>off</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:     </mode>
Aug 17 11:35:50 user nova-compute[73449]:     <mode name='host-model' supported='yes'>
Aug 17 11:35:50 user nova-compute[73449]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 17 11:35:50 user nova-compute[73449]:       <vendor>Intel</vendor>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='ss'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='vmx'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='pcid'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='hypervisor'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='arat'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='tsc_adjust'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='umip'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='md-clear'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='stibp'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='arch-capabilities'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='ssbd'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='invtsc'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='ibpb'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='ibrs'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='amd-stibp'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='amd-ssbd'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='rsba'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='pschange-mc-no'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='disable' name='erms'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='disable' name='xsaveopt'/>
Aug 17 11:35:50 user nova-compute[73449]:     </mode>
Aug 17 11:35:50 user nova-compute[73449]:     <mode name='custom' supported='yes'>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>qemu64</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='yes'>qemu32</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>phenom</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='yes'>pentium3</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='yes'>pentium2</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='yes'>pentium</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>n270</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='yes'>kvm64</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='yes'>kvm32</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='yes'>coreduo</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='yes'>core2duo</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>athlon</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='yes'>Westmere-IBRS</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='yes'>Westmere</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Snowridge</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Skylake-Server</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Skylake-Client</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>SandyBridge</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='yes'>Penryn</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Opteron_G5</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Opteron_G4</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Opteron_G3</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Opteron_G2</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='yes'>Opteron_G1</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='yes'>Nehalem</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>IvyBridge</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Icelake-Server</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Haswell-noTSX</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Haswell-IBRS</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Haswell</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>EPYC-Rome</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>EPYC-Milan</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>EPYC-IBPB</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>EPYC</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Dhyana</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Cooperlake</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='yes'>Conroe</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Cascadelake-Server</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Broadwell-noTSX</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Broadwell-IBRS</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Broadwell</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='yes'>486</model>
Aug 17 11:35:50 user nova-compute[73449]:     </mode>
Aug 17 11:35:50 user nova-compute[73449]:   </cpu>
Aug 17 11:35:50 user nova-compute[73449]:   <memoryBacking supported='yes'>
Aug 17 11:35:50 user nova-compute[73449]:     <enum name='sourceType'>
Aug 17 11:35:50 user nova-compute[73449]:       <value>file</value>
Aug 17 11:35:50 user nova-compute[73449]:       <value>anonymous</value>
Aug 17 11:35:50 user nova-compute[73449]:       <value>memfd</value>
Aug 17 11:35:50 user nova-compute[73449]:     </enum>
Aug 17 11:35:50 user nova-compute[73449]:   </memoryBacking>
Aug 17 11:35:50 user nova-compute[73449]:   <devices>
Aug 17 11:35:50 user nova-compute[73449]:     <disk supported='yes'>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='diskDevice'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>disk</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>cdrom</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>floppy</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>lun</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='bus'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>ide</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>fdc</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>scsi</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>virtio</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>usb</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>sata</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='model'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>virtio</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>virtio-transitional</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>virtio-non-transitional</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:     </disk>
Aug 17 11:35:50 user nova-compute[73449]:     <graphics supported='yes'>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='type'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>sdl</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>vnc</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>spice</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>egl-headless</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:     </graphics>
Aug 17 11:35:50 user nova-compute[73449]:     <video supported='yes'>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='modelType'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>vga</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>cirrus</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>vmvga</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>qxl</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>virtio</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>none</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>bochs</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>ramfb</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:     </video>
Aug 17 11:35:50 user nova-compute[73449]:     <hostdev supported='yes'>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='mode'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>subsystem</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='startupPolicy'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>default</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>mandatory</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>requisite</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>optional</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='subsysType'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>usb</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>pci</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>scsi</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='capsType'/>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='pciBackend'/>
Aug 17 11:35:50 user nova-compute[73449]:     </hostdev>
Aug 17 11:35:50 user nova-compute[73449]:     <rng supported='yes'>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='model'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>virtio</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>virtio-transitional</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>virtio-non-transitional</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='backendModel'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>random</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>egd</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>builtin</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:     </rng>
Aug 17 11:35:50 user nova-compute[73449]:     <filesystem supported='yes'>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='driverType'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>path</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>handle</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>virtiofs</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:     </filesystem>
Aug 17 11:35:50 user nova-compute[73449]:     <tpm supported='yes'>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='model'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>tpm-tis</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>tpm-crb</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='backendModel'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>passthrough</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>emulator</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:     </tpm>
Aug 17 11:35:50 user nova-compute[73449]:   </devices>
Aug 17 11:35:50 user nova-compute[73449]:   <features>
Aug 17 11:35:50 user nova-compute[73449]:     <gic supported='no'/>
Aug 17 11:35:50 user nova-compute[73449]:     <vmcoreinfo supported='yes'/>
Aug 17 11:35:50 user nova-compute[73449]:     <genid supported='yes'/>
Aug 17 11:35:50 user nova-compute[73449]:     <backingStoreInput supported='yes'/>
Aug 17 11:35:50 user nova-compute[73449]:     <backup supported='yes'/>
Aug 17 11:35:50 user nova-compute[73449]:     <sev supported='no'/>
Aug 17 11:35:50 user nova-compute[73449]:   </features>
Aug 17 11:35:50 user nova-compute[73449]: </domainCapabilities>
Aug 17 11:35:50 user nova-compute[73449]:  {{(pid=73449) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 17 11:35:50 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Aug 17 11:35:50 user nova-compute[73449]: <domainCapabilities>
Aug 17 11:35:50 user nova-compute[73449]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 17 11:35:50 user nova-compute[73449]:   <domain>kvm</domain>
Aug 17 11:35:50 user nova-compute[73449]:   <machine>pc-i440fx-jammy</machine>
Aug 17 11:35:50 user nova-compute[73449]:   <arch>x86_64</arch>
Aug 17 11:35:50 user nova-compute[73449]:   <vcpu max='255'/>
Aug 17 11:35:50 user nova-compute[73449]:   <iothreads supported='yes'/>
Aug 17 11:35:50 user nova-compute[73449]:   <os supported='yes'>
Aug 17 11:35:50 user nova-compute[73449]:     <enum name='firmware'>
Aug 17 11:35:50 user nova-compute[73449]:       <value>efi</value>
Aug 17 11:35:50 user nova-compute[73449]:     </enum>
Aug 17 11:35:50 user nova-compute[73449]:     <loader supported='yes'>
Aug 17 11:35:50 user nova-compute[73449]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='type'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>rom</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>pflash</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='readonly'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>yes</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>no</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='secure'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>no</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:     </loader>
Aug 17 11:35:50 user nova-compute[73449]:   </os>
Aug 17 11:35:50 user nova-compute[73449]:   <cpu>
Aug 17 11:35:50 user nova-compute[73449]:     <mode name='host-passthrough' supported='yes'>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='hostPassthroughMigratable'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>on</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>off</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:     </mode>
Aug 17 11:35:50 user nova-compute[73449]:     <mode name='maximum' supported='yes'>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='maximumMigratable'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>on</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>off</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:     </mode>
Aug 17 11:35:50 user nova-compute[73449]:     <mode name='host-model' supported='yes'>
Aug 17 11:35:50 user nova-compute[73449]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 17 11:35:50 user nova-compute[73449]:       <vendor>Intel</vendor>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='ss'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='vmx'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='pcid'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='hypervisor'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='arat'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='tsc_adjust'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='umip'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='md-clear'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='stibp'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='arch-capabilities'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='ssbd'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='invtsc'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='ibpb'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='ibrs'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='amd-stibp'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='amd-ssbd'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='rsba'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='pschange-mc-no'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='disable' name='erms'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='disable' name='xsaveopt'/>
Aug 17 11:35:50 user nova-compute[73449]:     </mode>
Aug 17 11:35:50 user nova-compute[73449]:     <mode name='custom' supported='yes'>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>qemu64</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='yes'>qemu32</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>phenom</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='yes'>pentium3</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='yes'>pentium2</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='yes'>pentium</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>n270</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='yes'>kvm64</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='yes'>kvm32</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='yes'>coreduo</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='yes'>core2duo</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>athlon</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='yes'>Westmere-IBRS</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='yes'>Westmere</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Snowridge</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Skylake-Server</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Skylake-Client</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>SandyBridge</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='yes'>Penryn</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Opteron_G5</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Opteron_G4</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Opteron_G3</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Opteron_G2</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='yes'>Opteron_G1</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='yes'>Nehalem</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>IvyBridge</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Icelake-Server</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Haswell-noTSX</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Haswell-IBRS</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Haswell</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>EPYC-Rome</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>EPYC-Milan</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>EPYC-IBPB</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>EPYC</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Dhyana</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Cooperlake</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='yes'>Conroe</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Cascadelake-Server</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Broadwell-noTSX</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Broadwell-IBRS</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Broadwell</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='yes'>486</model>
Aug 17 11:35:50 user nova-compute[73449]:     </mode>
Aug 17 11:35:50 user nova-compute[73449]:   </cpu>
Aug 17 11:35:50 user nova-compute[73449]:   <memoryBacking supported='yes'>
Aug 17 11:35:50 user nova-compute[73449]:     <enum name='sourceType'>
Aug 17 11:35:50 user nova-compute[73449]:       <value>file</value>
Aug 17 11:35:50 user nova-compute[73449]:       <value>anonymous</value>
Aug 17 11:35:50 user nova-compute[73449]:       <value>memfd</value>
Aug 17 11:35:50 user nova-compute[73449]:     </enum>
Aug 17 11:35:50 user nova-compute[73449]:   </memoryBacking>
Aug 17 11:35:50 user nova-compute[73449]:   <devices>
Aug 17 11:35:50 user nova-compute[73449]:     <disk supported='yes'>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='diskDevice'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>disk</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>cdrom</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>floppy</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>lun</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='bus'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>ide</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>fdc</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>scsi</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>virtio</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>usb</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>sata</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='model'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>virtio</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>virtio-transitional</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>virtio-non-transitional</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:     </disk>
Aug 17 11:35:50 user nova-compute[73449]:     <graphics supported='yes'>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='type'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>sdl</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>vnc</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>spice</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>egl-headless</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:     </graphics>
Aug 17 11:35:50 user nova-compute[73449]:     <video supported='yes'>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='modelType'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>vga</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>cirrus</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>vmvga</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>qxl</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>virtio</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>none</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>bochs</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>ramfb</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:     </video>
Aug 17 11:35:50 user nova-compute[73449]:     <hostdev supported='yes'>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='mode'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>subsystem</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='startupPolicy'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>default</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>mandatory</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>requisite</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>optional</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='subsysType'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>usb</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>pci</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>scsi</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='capsType'/>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='pciBackend'/>
Aug 17 11:35:50 user nova-compute[73449]:     </hostdev>
Aug 17 11:35:50 user nova-compute[73449]:     <rng supported='yes'>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='model'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>virtio</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>virtio-transitional</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>virtio-non-transitional</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='backendModel'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>random</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>egd</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>builtin</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:     </rng>
Aug 17 11:35:50 user nova-compute[73449]:     <filesystem supported='yes'>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='driverType'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>path</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>handle</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>virtiofs</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:     </filesystem>
Aug 17 11:35:50 user nova-compute[73449]:     <tpm supported='yes'>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='model'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>tpm-tis</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>tpm-crb</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='backendModel'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>passthrough</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>emulator</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:     </tpm>
Aug 17 11:35:50 user nova-compute[73449]:   </devices>
Aug 17 11:35:50 user nova-compute[73449]:   <features>
Aug 17 11:35:50 user nova-compute[73449]:     <gic supported='no'/>
Aug 17 11:35:50 user nova-compute[73449]:     <vmcoreinfo supported='yes'/>
Aug 17 11:35:50 user nova-compute[73449]:     <genid supported='yes'/>
Aug 17 11:35:50 user nova-compute[73449]:     <backingStoreInput supported='yes'/>
Aug 17 11:35:50 user nova-compute[73449]:     <backup supported='yes'/>
Aug 17 11:35:50 user nova-compute[73449]:     <sev supported='no'/>
Aug 17 11:35:50 user nova-compute[73449]:   </features>
Aug 17 11:35:50 user nova-compute[73449]: </domainCapabilities>
Aug 17 11:35:50 user nova-compute[73449]:  {{(pid=73449) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 17 11:35:50 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Aug 17 11:35:50 user nova-compute[73449]: <domainCapabilities>
Aug 17 11:35:50 user nova-compute[73449]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 17 11:35:50 user nova-compute[73449]:   <domain>kvm</domain>
Aug 17 11:35:50 user nova-compute[73449]:   <machine>pc-q35-jammy</machine>
Aug 17 11:35:50 user nova-compute[73449]:   <arch>x86_64</arch>
Aug 17 11:35:50 user nova-compute[73449]:   <vcpu max='288'/>
Aug 17 11:35:50 user nova-compute[73449]:   <iothreads supported='yes'/>
Aug 17 11:35:50 user nova-compute[73449]:   <os supported='yes'>
Aug 17 11:35:50 user nova-compute[73449]:     <enum name='firmware'>
Aug 17 11:35:50 user nova-compute[73449]:       <value>efi</value>
Aug 17 11:35:50 user nova-compute[73449]:     </enum>
Aug 17 11:35:50 user nova-compute[73449]:     <loader supported='yes'>
Aug 17 11:35:50 user nova-compute[73449]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 17 11:35:50 user nova-compute[73449]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 17 11:35:50 user nova-compute[73449]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='type'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>rom</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>pflash</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='readonly'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>yes</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>no</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='secure'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>yes</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>no</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:     </loader>
Aug 17 11:35:50 user nova-compute[73449]:   </os>
Aug 17 11:35:50 user nova-compute[73449]:   <cpu>
Aug 17 11:35:50 user nova-compute[73449]:     <mode name='host-passthrough' supported='yes'>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='hostPassthroughMigratable'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>on</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>off</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:     </mode>
Aug 17 11:35:50 user nova-compute[73449]:     <mode name='maximum' supported='yes'>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='maximumMigratable'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>on</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>off</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:     </mode>
Aug 17 11:35:50 user nova-compute[73449]:     <mode name='host-model' supported='yes'>
Aug 17 11:35:50 user nova-compute[73449]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 17 11:35:50 user nova-compute[73449]:       <vendor>Intel</vendor>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='ss'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='vmx'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='pcid'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='hypervisor'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='arat'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='tsc_adjust'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='umip'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='md-clear'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='stibp'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='arch-capabilities'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='ssbd'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='invtsc'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='ibpb'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='ibrs'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='amd-stibp'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='amd-ssbd'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='rsba'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='require' name='pschange-mc-no'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='disable' name='erms'/>
Aug 17 11:35:50 user nova-compute[73449]:       <feature policy='disable' name='xsaveopt'/>
Aug 17 11:35:50 user nova-compute[73449]:     </mode>
Aug 17 11:35:50 user nova-compute[73449]:     <mode name='custom' supported='yes'>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>qemu64</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='yes'>qemu32</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>phenom</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='yes'>pentium3</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='yes'>pentium2</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='yes'>pentium</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>n270</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='yes'>kvm64</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='yes'>kvm32</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='yes'>coreduo</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='yes'>core2duo</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>athlon</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='yes'>Westmere-IBRS</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='yes'>Westmere</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Snowridge</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Skylake-Server</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Skylake-Client</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>SandyBridge</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='yes'>Penryn</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Opteron_G5</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Opteron_G4</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Opteron_G3</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Opteron_G2</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='yes'>Opteron_G1</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='yes'>Nehalem</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>IvyBridge</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Icelake-Server</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Haswell-noTSX</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Haswell-IBRS</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Haswell</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>EPYC-Rome</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>EPYC-Milan</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>EPYC-IBPB</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>EPYC</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Dhyana</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Cooperlake</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='yes'>Conroe</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Cascadelake-Server</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Broadwell-noTSX</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Broadwell-IBRS</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='no'>Broadwell</model>
Aug 17 11:35:50 user nova-compute[73449]:       <model usable='yes'>486</model>
Aug 17 11:35:50 user nova-compute[73449]:     </mode>
Aug 17 11:35:50 user nova-compute[73449]:   </cpu>
Aug 17 11:35:50 user nova-compute[73449]:   <memoryBacking supported='yes'>
Aug 17 11:35:50 user nova-compute[73449]:     <enum name='sourceType'>
Aug 17 11:35:50 user nova-compute[73449]:       <value>file</value>
Aug 17 11:35:50 user nova-compute[73449]:       <value>anonymous</value>
Aug 17 11:35:50 user nova-compute[73449]:       <value>memfd</value>
Aug 17 11:35:50 user nova-compute[73449]:     </enum>
Aug 17 11:35:50 user nova-compute[73449]:   </memoryBacking>
Aug 17 11:35:50 user nova-compute[73449]:   <devices>
Aug 17 11:35:50 user nova-compute[73449]:     <disk supported='yes'>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='diskDevice'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>disk</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>cdrom</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>floppy</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>lun</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='bus'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>fdc</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>scsi</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>virtio</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>usb</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>sata</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='model'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>virtio</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>virtio-transitional</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>virtio-non-transitional</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:     </disk>
Aug 17 11:35:50 user nova-compute[73449]:     <graphics supported='yes'>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='type'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>sdl</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>vnc</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>spice</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>egl-headless</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:     </graphics>
Aug 17 11:35:50 user nova-compute[73449]:     <video supported='yes'>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='modelType'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>vga</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>cirrus</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>vmvga</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>qxl</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>virtio</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>none</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>bochs</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>ramfb</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:     </video>
Aug 17 11:35:50 user nova-compute[73449]:     <hostdev supported='yes'>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='mode'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>subsystem</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='startupPolicy'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>default</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>mandatory</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>requisite</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>optional</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='subsysType'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>usb</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>pci</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>scsi</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='capsType'/>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='pciBackend'/>
Aug 17 11:35:50 user nova-compute[73449]:     </hostdev>
Aug 17 11:35:50 user nova-compute[73449]:     <rng supported='yes'>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='model'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>virtio</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>virtio-transitional</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>virtio-non-transitional</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='backendModel'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>random</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>egd</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>builtin</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:     </rng>
Aug 17 11:35:50 user nova-compute[73449]:     <filesystem supported='yes'>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='driverType'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>path</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>handle</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>virtiofs</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:     </filesystem>
Aug 17 11:35:50 user nova-compute[73449]:     <tpm supported='yes'>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='model'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>tpm-tis</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>tpm-crb</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:       <enum name='backendModel'>
Aug 17 11:35:50 user nova-compute[73449]:         <value>passthrough</value>
Aug 17 11:35:50 user nova-compute[73449]:         <value>emulator</value>
Aug 17 11:35:50 user nova-compute[73449]:       </enum>
Aug 17 11:35:50 user nova-compute[73449]:     </tpm>
Aug 17 11:35:50 user nova-compute[73449]:   </devices>
Aug 17 11:35:50 user nova-compute[73449]:   <features>
Aug 17 11:35:50 user nova-compute[73449]:     <gic supported='no'/>
Aug 17 11:35:50 user nova-compute[73449]:     <vmcoreinfo supported='yes'/>
Aug 17 11:35:50 user nova-compute[73449]:     <genid supported='yes'/>
Aug 17 11:35:50 user nova-compute[73449]:     <backingStoreInput supported='yes'/>
Aug 17 11:35:50 user nova-compute[73449]:     <backup supported='yes'/>
Aug 17 11:35:50 user nova-compute[73449]:     <sev supported='no'/>
Aug 17 11:35:50 user nova-compute[73449]:   </features>
Aug 17 11:35:50 user nova-compute[73449]: </domainCapabilities>
Aug 17 11:35:50 user nova-compute[73449]:  {{(pid=73449) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 17 11:35:50 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=73449) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 11:35:50 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=73449) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 11:35:50 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=73449) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 11:35:50 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=73449) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 11:35:50 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Checking secure boot support for host arch (x86_64) {{(pid=73449) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 17 11:35:50 user nova-compute[73449]: INFO nova.virt.libvirt.host [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Secure Boot support detected
Aug 17 11:35:50 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] cpu compare xml: <cpu match="exact">
Aug 17 11:35:50 user nova-compute[73449]:   <model>Nehalem</model>
Aug 17 11:35:50 user nova-compute[73449]: </cpu>
Aug 17 11:35:50 user nova-compute[73449]:  {{(pid=73449) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Aug 17 11:35:50 user nova-compute[73449]: INFO nova.virt.node [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Generated node identity 20986bee-3f54-4b89-bec1-f8387ef700c4
Aug 17 11:35:50 user nova-compute[73449]: INFO nova.virt.node [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Wrote node identity 20986bee-3f54-4b89-bec1-f8387ef700c4 to /opt/stack/data/nova/compute_id
Aug 17 11:35:50 user nova-compute[73449]: WARNING nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Compute nodes ['20986bee-3f54-4b89-bec1-f8387ef700c4'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Aug 17 11:35:50 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Aug 17 11:35:50 user nova-compute[73449]: WARNING nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 17 11:35:50 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:35:50 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:35:50 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:35:50 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Auditing locally available compute resources for user (node: user) {{(pid=73449) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 11:35:50 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:35:50 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:35:50 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Hypervisor/Node resource view: name=user free_ram=10842MB free_disk=26.174083709716797GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73449) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 11:35:50 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:35:50 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:35:50 user nova-compute[73449]: WARNING nova.compute.resource_tracker [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] No compute node record for user:20986bee-3f54-4b89-bec1-f8387ef700c4: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 20986bee-3f54-4b89-bec1-f8387ef700c4 could not be found.
Aug 17 11:35:50 user nova-compute[73449]: INFO nova.compute.resource_tracker [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Compute node record created for user:user with uuid: 20986bee-3f54-4b89-bec1-f8387ef700c4
Aug 17 11:35:50 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73449) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 11:35:50 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73449) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 11:35:51 user nova-compute[73449]: INFO nova.scheduler.client.report [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [req-0af839f5-08c7-4b91-9fa6-0fad27938891] Created resource provider record via placement API for resource provider with UUID 20986bee-3f54-4b89-bec1-f8387ef700c4 and name user.
Aug 17 11:35:51 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=73449) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Aug 17 11:35:51 user nova-compute[73449]: INFO nova.virt.libvirt.host [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] kernel doesn't support AMD SEV
Aug 17 11:35:51 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Updating inventory in ProviderTree for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 11:35:51 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73449) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 11:35:51 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Libvirt baseline CPU <cpu>
Aug 17 11:35:51 user nova-compute[73449]:   <arch>x86_64</arch>
Aug 17 11:35:51 user nova-compute[73449]:   <model>Nehalem</model>
Aug 17 11:35:51 user nova-compute[73449]:   <vendor>Intel</vendor>
Aug 17 11:35:51 user nova-compute[73449]:   <topology sockets="6" cores="1" threads="1"/>
Aug 17 11:35:51 user nova-compute[73449]: </cpu>
Aug 17 11:35:51 user nova-compute[73449]:  {{(pid=73449) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Aug 17 11:35:51 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Updated inventory for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Aug 17 11:35:51 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Updating resource provider 20986bee-3f54-4b89-bec1-f8387ef700c4 generation from 0 to 1 during operation: update_inventory {{(pid=73449) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 17 11:35:51 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Updating inventory in ProviderTree for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 11:35:51 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Updating resource provider 20986bee-3f54-4b89-bec1-f8387ef700c4 generation from 1 to 2 during operation: update_traits {{(pid=73449) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 17 11:35:51 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Compute_service record updated for user:user {{(pid=73449) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 11:35:51 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.598s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:35:51 user nova-compute[73449]: DEBUG nova.service [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Creating RPC server for service compute {{(pid=73449) start /opt/stack/nova/nova/service.py:182}}
Aug 17 11:35:51 user nova-compute[73449]: DEBUG nova.service [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Join ServiceGroup membership for this service compute {{(pid=73449) start /opt/stack/nova/nova/service.py:199}}
Aug 17 11:35:51 user nova-compute[73449]: DEBUG nova.servicegroup.drivers.db [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=73449) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Aug 17 11:36:20 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:36:20 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:36:41 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:36:41 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:36:41 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Starting heal instance info cache {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 11:36:41 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Rebuilding the list of instances to heal {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 11:36:41 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Didn't find any instances for network info cache update. {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 11:36:41 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:36:41 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:36:41 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:36:41 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:36:41 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:36:41 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:36:41 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73449) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 11:36:41 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:36:42 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:36:42 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:36:42 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:36:42 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=73449) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 11:36:42 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:36:42 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:36:42 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Hypervisor/Node resource view: name=user free_ram=10234MB free_disk=26.07784652709961GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73449) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 11:36:42 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:36:42 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:36:42 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73449) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 11:36:42 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73449) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 11:36:42 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 11:36:42 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 11:36:42 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Compute_service record updated for user:user {{(pid=73449) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 11:36:42 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.176s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:37:42 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:37:42 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:37:42 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:37:42 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:37:42 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:37:42 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:37:42 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Starting heal instance info cache {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 11:37:42 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Rebuilding the list of instances to heal {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 11:37:42 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Didn't find any instances for network info cache update. {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 11:37:42 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:37:42 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:37:42 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:37:42 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:37:42 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:37:42 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=73449) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 11:37:43 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:37:43 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:37:43 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Hypervisor/Node resource view: name=user free_ram=10186MB free_disk=26.12439727783203GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73449) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 11:37:43 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:37:43 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:37:43 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73449) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 11:37:43 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73449) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 11:37:43 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 11:37:43 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 11:37:43 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Compute_service record updated for user:user {{(pid=73449) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 11:37:43 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.104s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:37:44 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:37:44 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:37:44 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73449) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 11:38:41 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:38:42 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:38:42 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Starting heal instance info cache {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 11:38:42 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Rebuilding the list of instances to heal {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 11:38:42 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Didn't find any instances for network info cache update. {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 11:38:42 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:38:42 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:38:42 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:38:43 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:38:44 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:38:44 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:38:44 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73449) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 11:38:44 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:38:44 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:38:44 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:38:44 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:38:44 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=73449) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 11:38:45 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:38:45 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:38:45 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Hypervisor/Node resource view: name=user free_ram=10189MB free_disk=25.908092498779297GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73449) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 11:38:45 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:38:45 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:38:45 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73449) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 11:38:45 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73449) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 11:38:45 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 11:38:45 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 11:38:45 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Compute_service record updated for user:user {{(pid=73449) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 11:38:45 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.140s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:39:42 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:39:42 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:39:42 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:39:43 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:39:43 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Starting heal instance info cache {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 11:39:43 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Rebuilding the list of instances to heal {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 11:39:43 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Didn't find any instances for network info cache update. {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 11:39:43 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:39:44 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:39:44 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:39:44 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:39:44 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:39:44 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73449) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 11:39:44 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:39:44 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:39:44 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:39:44 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:39:44 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=73449) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 11:39:45 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:39:45 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:39:45 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Hypervisor/Node resource view: name=user free_ram=9443MB free_disk=25.930999755859375GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73449) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 11:39:45 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:39:45 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:39:45 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73449) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 11:39:45 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73449) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 11:39:45 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 11:39:45 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 11:39:45 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Compute_service record updated for user:user {{(pid=73449) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 11:39:45 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.395s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:39:53 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b0098627-8c78-4de2-8c8c-dfcb292d2d30 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] Acquiring lock "a40e1f85-a7e6-46da-8f98-df7a278aaade" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:39:53 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b0098627-8c78-4de2-8c8c-dfcb292d2d30 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] Lock "a40e1f85-a7e6-46da-8f98-df7a278aaade" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:39:53 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b0098627-8c78-4de2-8c8c-dfcb292d2d30 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] [instance: a40e1f85-a7e6-46da-8f98-df7a278aaade] Starting instance... {{(pid=73449) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 11:39:53 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b0098627-8c78-4de2-8c8c-dfcb292d2d30 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:39:53 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b0098627-8c78-4de2-8c8c-dfcb292d2d30 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:39:53 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-b0098627-8c78-4de2-8c8c-dfcb292d2d30 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73449) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 11:39:53 user nova-compute[73449]: INFO nova.compute.claims [None req-b0098627-8c78-4de2-8c8c-dfcb292d2d30 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] [instance: a40e1f85-a7e6-46da-8f98-df7a278aaade] Claim successful on node user
Aug 17 11:39:54 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-b0098627-8c78-4de2-8c8c-dfcb292d2d30 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 11:39:54 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-b0098627-8c78-4de2-8c8c-dfcb292d2d30 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 11:39:54 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b0098627-8c78-4de2-8c8c-dfcb292d2d30 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.364s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:39:54 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b0098627-8c78-4de2-8c8c-dfcb292d2d30 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] [instance: a40e1f85-a7e6-46da-8f98-df7a278aaade] Start building networks asynchronously for instance. {{(pid=73449) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 11:39:54 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b0098627-8c78-4de2-8c8c-dfcb292d2d30 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] [instance: a40e1f85-a7e6-46da-8f98-df7a278aaade] Allocating IP information in the background. {{(pid=73449) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 11:39:54 user nova-compute[73449]: DEBUG nova.network.neutron [None req-b0098627-8c78-4de2-8c8c-dfcb292d2d30 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] [instance: a40e1f85-a7e6-46da-8f98-df7a278aaade] allocate_for_instance() {{(pid=73449) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 11:39:54 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-b0098627-8c78-4de2-8c8c-dfcb292d2d30 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] [instance: a40e1f85-a7e6-46da-8f98-df7a278aaade] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 11:39:54 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b0098627-8c78-4de2-8c8c-dfcb292d2d30 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] [instance: a40e1f85-a7e6-46da-8f98-df7a278aaade] Start building block device mappings for instance. {{(pid=73449) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 11:39:54 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b0098627-8c78-4de2-8c8c-dfcb292d2d30 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] [instance: a40e1f85-a7e6-46da-8f98-df7a278aaade] Start spawning the instance on the hypervisor. {{(pid=73449) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 11:39:54 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b0098627-8c78-4de2-8c8c-dfcb292d2d30 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] [instance: a40e1f85-a7e6-46da-8f98-df7a278aaade] Creating instance directory {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 11:39:54 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-b0098627-8c78-4de2-8c8c-dfcb292d2d30 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] [instance: a40e1f85-a7e6-46da-8f98-df7a278aaade] Creating image(s)
Aug 17 11:39:54 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b0098627-8c78-4de2-8c8c-dfcb292d2d30 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] Acquiring lock "/opt/stack/data/nova/instances/a40e1f85-a7e6-46da-8f98-df7a278aaade/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:39:54 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b0098627-8c78-4de2-8c8c-dfcb292d2d30 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] Lock "/opt/stack/data/nova/instances/a40e1f85-a7e6-46da-8f98-df7a278aaade/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:39:54 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b0098627-8c78-4de2-8c8c-dfcb292d2d30 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] Lock "/opt/stack/data/nova/instances/a40e1f85-a7e6-46da-8f98-df7a278aaade/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:39:54 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b0098627-8c78-4de2-8c8c-dfcb292d2d30 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] Acquiring lock "7e267a577c062ee862e95ede6b48cfd5632f3ea3" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:39:54 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b0098627-8c78-4de2-8c8c-dfcb292d2d30 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] Lock "7e267a577c062ee862e95ede6b48cfd5632f3ea3" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:39:55 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-b0098627-8c78-4de2-8c8c-dfcb292d2d30 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3.part --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:39:55 user nova-compute[73449]: DEBUG nova.policy [None req-b0098627-8c78-4de2-8c8c-dfcb292d2d30 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '31cdb313169e49709185780d4cfbfcd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dd321fccefc4bb6b89c59b1cc70df0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73449) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 11:39:55 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-b0098627-8c78-4de2-8c8c-dfcb292d2d30 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3.part --force-share --output=json" returned: 0 in 0.170s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:39:55 user nova-compute[73449]: DEBUG nova.virt.images [None req-b0098627-8c78-4de2-8c8c-dfcb292d2d30 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] 0a2904ae-083d-41c8-83db-343132b36148 was qcow2, converting to raw {{(pid=73449) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 17 11:39:55 user nova-compute[73449]: DEBUG nova.privsep.utils [None req-b0098627-8c78-4de2-8c8c-dfcb292d2d30 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73449) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 11:39:55 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-b0098627-8c78-4de2-8c8c-dfcb292d2d30 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3.part /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3.converted {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:39:56 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-b0098627-8c78-4de2-8c8c-dfcb292d2d30 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3.part /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3.converted" returned: 0 in 0.483s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:39:56 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-b0098627-8c78-4de2-8c8c-dfcb292d2d30 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3.converted --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:39:56 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-b0098627-8c78-4de2-8c8c-dfcb292d2d30 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3.converted --force-share --output=json" returned: 0 in 0.166s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:39:56 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b0098627-8c78-4de2-8c8c-dfcb292d2d30 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] Lock "7e267a577c062ee862e95ede6b48cfd5632f3ea3" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.677s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:39:56 user nova-compute[73449]: INFO oslo.privsep.daemon [None req-b0098627-8c78-4de2-8c8c-dfcb292d2d30 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpi8kofk8y/privsep.sock']
Aug 17 11:39:56 user sudo[82719]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpi8kofk8y/privsep.sock
Aug 17 11:39:56 user sudo[82719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 17 11:39:58 user sudo[82719]: pam_unix(sudo:session): session closed for user root
Aug 17 11:39:58 user nova-compute[73449]: INFO oslo.privsep.daemon [None req-b0098627-8c78-4de2-8c8c-dfcb292d2d30 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] Spawned new privsep daemon via rootwrap
Aug 17 11:39:58 user nova-compute[73449]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 17 11:39:58 user nova-compute[73449]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 17 11:39:58 user nova-compute[73449]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Aug 17 11:39:58 user nova-compute[73449]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82722
Aug 17 11:39:58 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-b0098627-8c78-4de2-8c8c-dfcb292d2d30 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:39:58 user nova-compute[73449]: DEBUG nova.network.neutron [None req-b0098627-8c78-4de2-8c8c-dfcb292d2d30 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] [instance: a40e1f85-a7e6-46da-8f98-df7a278aaade] Successfully created port: 6f565f5b-de2a-4190-86fd-0d2606a9c5e9 {{(pid=73449) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 11:39:58 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-b0098627-8c78-4de2-8c8c-dfcb292d2d30 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json" returned: 0 in 0.180s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:39:58 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b0098627-8c78-4de2-8c8c-dfcb292d2d30 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] Acquiring lock "7e267a577c062ee862e95ede6b48cfd5632f3ea3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:39:58 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b0098627-8c78-4de2-8c8c-dfcb292d2d30 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] Lock "7e267a577c062ee862e95ede6b48cfd5632f3ea3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:39:58 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-b0098627-8c78-4de2-8c8c-dfcb292d2d30 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:39:58 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-b0098627-8c78-4de2-8c8c-dfcb292d2d30 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json" returned: 0 in 0.179s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:39:58 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-b0098627-8c78-4de2-8c8c-dfcb292d2d30 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3,backing_fmt=raw /opt/stack/data/nova/instances/a40e1f85-a7e6-46da-8f98-df7a278aaade/disk 1073741824 {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:39:58 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-b0098627-8c78-4de2-8c8c-dfcb292d2d30 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3,backing_fmt=raw /opt/stack/data/nova/instances/a40e1f85-a7e6-46da-8f98-df7a278aaade/disk 1073741824" returned: 0 in 0.052s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:39:58 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b0098627-8c78-4de2-8c8c-dfcb292d2d30 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] Lock "7e267a577c062ee862e95ede6b48cfd5632f3ea3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:39:58 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-b0098627-8c78-4de2-8c8c-dfcb292d2d30 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:39:58 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-b0098627-8c78-4de2-8c8c-dfcb292d2d30 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json" returned: 0 in 0.178s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:39:58 user nova-compute[73449]: DEBUG nova.virt.disk.api [None req-b0098627-8c78-4de2-8c8c-dfcb292d2d30 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a40e1f85-a7e6-46da-8f98-df7a278aaade/disk. size=1073741824 {{(pid=73449) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 11:39:58 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-b0098627-8c78-4de2-8c8c-dfcb292d2d30 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a40e1f85-a7e6-46da-8f98-df7a278aaade/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:39:59 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-b0098627-8c78-4de2-8c8c-dfcb292d2d30 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a40e1f85-a7e6-46da-8f98-df7a278aaade/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:39:59 user nova-compute[73449]: DEBUG nova.virt.disk.api [None req-b0098627-8c78-4de2-8c8c-dfcb292d2d30 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] Cannot resize image /opt/stack/data/nova/instances/a40e1f85-a7e6-46da-8f98-df7a278aaade/disk to a smaller size. {{(pid=73449) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 11:39:59 user nova-compute[73449]: DEBUG nova.objects.instance [None req-b0098627-8c78-4de2-8c8c-dfcb292d2d30 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] Lazy-loading 'migration_context' on Instance uuid a40e1f85-a7e6-46da-8f98-df7a278aaade {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:39:59 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b0098627-8c78-4de2-8c8c-dfcb292d2d30 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] [instance: a40e1f85-a7e6-46da-8f98-df7a278aaade] Created local disks {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 11:39:59 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b0098627-8c78-4de2-8c8c-dfcb292d2d30 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] [instance: a40e1f85-a7e6-46da-8f98-df7a278aaade] Ensure instance console log exists: /opt/stack/data/nova/instances/a40e1f85-a7e6-46da-8f98-df7a278aaade/console.log {{(pid=73449) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 11:39:59 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b0098627-8c78-4de2-8c8c-dfcb292d2d30 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:39:59 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b0098627-8c78-4de2-8c8c-dfcb292d2d30 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:39:59 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b0098627-8c78-4de2-8c8c-dfcb292d2d30 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:40:00 user nova-compute[73449]: DEBUG nova.network.neutron [None req-b0098627-8c78-4de2-8c8c-dfcb292d2d30 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] [instance: a40e1f85-a7e6-46da-8f98-df7a278aaade] Successfully updated port: 6f565f5b-de2a-4190-86fd-0d2606a9c5e9 {{(pid=73449) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 11:40:00 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b0098627-8c78-4de2-8c8c-dfcb292d2d30 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] Acquiring lock "refresh_cache-a40e1f85-a7e6-46da-8f98-df7a278aaade" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:40:00 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b0098627-8c78-4de2-8c8c-dfcb292d2d30 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] Acquired lock "refresh_cache-a40e1f85-a7e6-46da-8f98-df7a278aaade" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:40:00 user nova-compute[73449]: DEBUG nova.network.neutron [None req-b0098627-8c78-4de2-8c8c-dfcb292d2d30 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] [instance: a40e1f85-a7e6-46da-8f98-df7a278aaade] Building network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 11:40:01 user nova-compute[73449]: DEBUG nova.network.neutron [None req-b0098627-8c78-4de2-8c8c-dfcb292d2d30 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] [instance: a40e1f85-a7e6-46da-8f98-df7a278aaade] Instance cache missing network info. {{(pid=73449) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 11:40:01 user nova-compute[73449]: DEBUG nova.compute.manager [req-dacff27f-2679-40c3-9cc5-637e1129a7c1 req-4a09a842-88f6-41ed-9ebb-2699c21c3f5c service nova] [instance: a40e1f85-a7e6-46da-8f98-df7a278aaade] Received event network-changed-6f565f5b-de2a-4190-86fd-0d2606a9c5e9 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:40:01 user nova-compute[73449]: DEBUG nova.compute.manager [req-dacff27f-2679-40c3-9cc5-637e1129a7c1 req-4a09a842-88f6-41ed-9ebb-2699c21c3f5c service nova] [instance: a40e1f85-a7e6-46da-8f98-df7a278aaade] Refreshing instance network info cache due to event network-changed-6f565f5b-de2a-4190-86fd-0d2606a9c5e9. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 11:40:01 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-dacff27f-2679-40c3-9cc5-637e1129a7c1 req-4a09a842-88f6-41ed-9ebb-2699c21c3f5c service nova] Acquiring lock "refresh_cache-a40e1f85-a7e6-46da-8f98-df7a278aaade" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:40:02 user nova-compute[73449]: DEBUG nova.network.neutron [None req-b0098627-8c78-4de2-8c8c-dfcb292d2d30 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] [instance: a40e1f85-a7e6-46da-8f98-df7a278aaade] Updating instance_info_cache with network_info: [{"id": "6f565f5b-de2a-4190-86fd-0d2606a9c5e9", "address": "fa:16:3e:e4:b6:ea", "network": {"id": "4275d6ae-c74d-4900-93d9-65ec567b5abe", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1540860684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dd321fccefc4bb6b89c59b1cc70df0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f565f5b-de", "ovs_interfaceid": "6f565f5b-de2a-4190-86fd-0d2606a9c5e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:40:02 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b0098627-8c78-4de2-8c8c-dfcb292d2d30 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] Releasing lock "refresh_cache-a40e1f85-a7e6-46da-8f98-df7a278aaade" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:40:02 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b0098627-8c78-4de2-8c8c-dfcb292d2d30 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] [instance: a40e1f85-a7e6-46da-8f98-df7a278aaade] Instance network_info: |[{"id": "6f565f5b-de2a-4190-86fd-0d2606a9c5e9", "address": "fa:16:3e:e4:b6:ea", "network": {"id": "4275d6ae-c74d-4900-93d9-65ec567b5abe", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1540860684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dd321fccefc4bb6b89c59b1cc70df0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f565f5b-de", "ovs_interfaceid": "6f565f5b-de2a-4190-86fd-0d2606a9c5e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73449) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 11:40:02 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-dacff27f-2679-40c3-9cc5-637e1129a7c1 req-4a09a842-88f6-41ed-9ebb-2699c21c3f5c service nova] Acquired lock "refresh_cache-a40e1f85-a7e6-46da-8f98-df7a278aaade" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:40:02 user nova-compute[73449]: DEBUG nova.network.neutron [req-dacff27f-2679-40c3-9cc5-637e1129a7c1 req-4a09a842-88f6-41ed-9ebb-2699c21c3f5c service nova] [instance: a40e1f85-a7e6-46da-8f98-df7a278aaade] Refreshing network info cache for port 6f565f5b-de2a-4190-86fd-0d2606a9c5e9 {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 11:40:02 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b0098627-8c78-4de2-8c8c-dfcb292d2d30 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] [instance: a40e1f85-a7e6-46da-8f98-df7a278aaade] Start _get_guest_xml network_info=[{"id": "6f565f5b-de2a-4190-86fd-0d2606a9c5e9", "address": "fa:16:3e:e4:b6:ea", "network": {"id": "4275d6ae-c74d-4900-93d9-65ec567b5abe", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1540860684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dd321fccefc4bb6b89c59b1cc70df0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f565f5b-de", "ovs_interfaceid": "6f565f5b-de2a-4190-86fd-0d2606a9c5e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T11:36:11Z,direct_url=<?>,disk_format='qcow2',id=0a2904ae-083d-41c8-83db-343132b36148,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7a77880136a54ef195c82e018e1939db',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T11:36:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': '0a2904ae-083d-41c8-83db-343132b36148'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 11:40:02 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-b0098627-8c78-4de2-8c8c-dfcb292d2d30 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:40:02 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-b0098627-8c78-4de2-8c8c-dfcb292d2d30 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:40:02 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-b0098627-8c78-4de2-8c8c-dfcb292d2d30 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 11:40:02 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-b0098627-8c78-4de2-8c8c-dfcb292d2d30 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] CPU controller missing on host. {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 11:40:02 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-b0098627-8c78-4de2-8c8c-dfcb292d2d30 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 11:40:02 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-b0098627-8c78-4de2-8c8c-dfcb292d2d30 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] CPU controller found on host. {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 11:40:02 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b0098627-8c78-4de2-8c8c-dfcb292d2d30 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73449) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 11:40:02 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-b0098627-8c78-4de2-8c8c-dfcb292d2d30 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T11:35:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T11:36:11Z,direct_url=<?>,disk_format='qcow2',id=0a2904ae-083d-41c8-83db-343132b36148,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7a77880136a54ef195c82e018e1939db',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T11:36:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 11:40:02 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-b0098627-8c78-4de2-8c8c-dfcb292d2d30 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] Flavor limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 11:40:02 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-b0098627-8c78-4de2-8c8c-dfcb292d2d30 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] Image limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 11:40:02 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-b0098627-8c78-4de2-8c8c-dfcb292d2d30 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] Flavor pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 11:40:02 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-b0098627-8c78-4de2-8c8c-dfcb292d2d30 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] Image pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 11:40:02 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-b0098627-8c78-4de2-8c8c-dfcb292d2d30 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 11:40:02 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-b0098627-8c78-4de2-8c8c-dfcb292d2d30 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 11:40:02 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-b0098627-8c78-4de2-8c8c-dfcb292d2d30 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 11:40:02 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-b0098627-8c78-4de2-8c8c-dfcb292d2d30 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] Got 1 possible topologies {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 11:40:02 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-b0098627-8c78-4de2-8c8c-dfcb292d2d30 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 11:40:02 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-b0098627-8c78-4de2-8c8c-dfcb292d2d30 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 11:40:02 user nova-compute[73449]: DEBUG nova.privsep.utils [None req-b0098627-8c78-4de2-8c8c-dfcb292d2d30 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73449) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 11:40:02 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-b0098627-8c78-4de2-8c8c-dfcb292d2d30 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:39:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-726436740',display_name='tempest-DeleteServersTestJSON-server-726436740',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-726436740',id=1,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3dd321fccefc4bb6b89c59b1cc70df0b',ramdisk_id='',reservation_id='r-nlwr3lhn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-417173257',owner_user_name='tempest-DeleteServersTestJSON-417173257-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T11:39:54Z,user_data=None,user_id='31cdb313169e49709185780d4cfbfcd1',uuid=a40e1f85-a7e6-46da-8f98-df7a278aaade,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6f565f5b-de2a-4190-86fd-0d2606a9c5e9", "address": "fa:16:3e:e4:b6:ea", "network": {"id": "4275d6ae-c74d-4900-93d9-65ec567b5abe", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1540860684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dd321fccefc4bb6b89c59b1cc70df0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f565f5b-de", "ovs_interfaceid": "6f565f5b-de2a-4190-86fd-0d2606a9c5e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73449) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 11:40:02 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-b0098627-8c78-4de2-8c8c-dfcb292d2d30 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] Converting VIF {"id": "6f565f5b-de2a-4190-86fd-0d2606a9c5e9", "address": "fa:16:3e:e4:b6:ea", "network": {"id": "4275d6ae-c74d-4900-93d9-65ec567b5abe", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1540860684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dd321fccefc4bb6b89c59b1cc70df0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f565f5b-de", "ovs_interfaceid": "6f565f5b-de2a-4190-86fd-0d2606a9c5e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:40:02 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-b0098627-8c78-4de2-8c8c-dfcb292d2d30 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:b6:ea,bridge_name='br-int',has_traffic_filtering=True,id=6f565f5b-de2a-4190-86fd-0d2606a9c5e9,network=Network(4275d6ae-c74d-4900-93d9-65ec567b5abe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f565f5b-de') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:40:02 user nova-compute[73449]: DEBUG nova.objects.instance [None req-b0098627-8c78-4de2-8c8c-dfcb292d2d30 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] Lazy-loading 'pci_devices' on Instance uuid a40e1f85-a7e6-46da-8f98-df7a278aaade {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:40:02 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b0098627-8c78-4de2-8c8c-dfcb292d2d30 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] [instance: a40e1f85-a7e6-46da-8f98-df7a278aaade] End _get_guest_xml xml=<domain type="kvm">
Aug 17 11:40:02 user nova-compute[73449]:   <uuid>a40e1f85-a7e6-46da-8f98-df7a278aaade</uuid>
Aug 17 11:40:02 user nova-compute[73449]:   <name>instance-00000001</name>
Aug 17 11:40:02 user nova-compute[73449]:   <memory>524288</memory>
Aug 17 11:40:02 user nova-compute[73449]:   <vcpu>1</vcpu>
Aug 17 11:40:02 user nova-compute[73449]:   <metadata>
Aug 17 11:40:02 user nova-compute[73449]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 11:40:02 user nova-compute[73449]:       <nova:package version="0.0.0"/>
Aug 17 11:40:02 user nova-compute[73449]:       <nova:name>tempest-DeleteServersTestJSON-server-726436740</nova:name>
Aug 17 11:40:02 user nova-compute[73449]:       <nova:creationTime>2023-08-17 11:40:02</nova:creationTime>
Aug 17 11:40:02 user nova-compute[73449]:       <nova:flavor name="m1.tiny">
Aug 17 11:40:02 user nova-compute[73449]:         <nova:memory>512</nova:memory>
Aug 17 11:40:02 user nova-compute[73449]:         <nova:disk>1</nova:disk>
Aug 17 11:40:02 user nova-compute[73449]:         <nova:swap>0</nova:swap>
Aug 17 11:40:02 user nova-compute[73449]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 11:40:02 user nova-compute[73449]:         <nova:vcpus>1</nova:vcpus>
Aug 17 11:40:02 user nova-compute[73449]:       </nova:flavor>
Aug 17 11:40:02 user nova-compute[73449]:       <nova:owner>
Aug 17 11:40:02 user nova-compute[73449]:         <nova:user uuid="31cdb313169e49709185780d4cfbfcd1">tempest-DeleteServersTestJSON-417173257-project-member</nova:user>
Aug 17 11:40:02 user nova-compute[73449]:         <nova:project uuid="3dd321fccefc4bb6b89c59b1cc70df0b">tempest-DeleteServersTestJSON-417173257</nova:project>
Aug 17 11:40:02 user nova-compute[73449]:       </nova:owner>
Aug 17 11:40:02 user nova-compute[73449]:       <nova:root type="image" uuid="0a2904ae-083d-41c8-83db-343132b36148"/>
Aug 17 11:40:02 user nova-compute[73449]:       <nova:ports>
Aug 17 11:40:02 user nova-compute[73449]:         <nova:port uuid="6f565f5b-de2a-4190-86fd-0d2606a9c5e9">
Aug 17 11:40:02 user nova-compute[73449]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 17 11:40:02 user nova-compute[73449]:         </nova:port>
Aug 17 11:40:02 user nova-compute[73449]:       </nova:ports>
Aug 17 11:40:02 user nova-compute[73449]:     </nova:instance>
Aug 17 11:40:02 user nova-compute[73449]:   </metadata>
Aug 17 11:40:02 user nova-compute[73449]:   <sysinfo type="smbios">
Aug 17 11:40:02 user nova-compute[73449]:     <system>
Aug 17 11:40:02 user nova-compute[73449]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 11:40:02 user nova-compute[73449]:       <entry name="product">OpenStack Nova</entry>
Aug 17 11:40:02 user nova-compute[73449]:       <entry name="version">0.0.0</entry>
Aug 17 11:40:02 user nova-compute[73449]:       <entry name="serial">a40e1f85-a7e6-46da-8f98-df7a278aaade</entry>
Aug 17 11:40:02 user nova-compute[73449]:       <entry name="uuid">a40e1f85-a7e6-46da-8f98-df7a278aaade</entry>
Aug 17 11:40:02 user nova-compute[73449]:       <entry name="family">Virtual Machine</entry>
Aug 17 11:40:02 user nova-compute[73449]:     </system>
Aug 17 11:40:02 user nova-compute[73449]:   </sysinfo>
Aug 17 11:40:02 user nova-compute[73449]:   <os>
Aug 17 11:40:02 user nova-compute[73449]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 11:40:02 user nova-compute[73449]:     <boot dev="hd"/>
Aug 17 11:40:02 user nova-compute[73449]:     <smbios mode="sysinfo"/>
Aug 17 11:40:02 user nova-compute[73449]:   </os>
Aug 17 11:40:02 user nova-compute[73449]:   <features>
Aug 17 11:40:02 user nova-compute[73449]:     <acpi/>
Aug 17 11:40:02 user nova-compute[73449]:     <apic/>
Aug 17 11:40:02 user nova-compute[73449]:     <vmcoreinfo/>
Aug 17 11:40:02 user nova-compute[73449]:   </features>
Aug 17 11:40:02 user nova-compute[73449]:   <clock offset="utc">
Aug 17 11:40:02 user nova-compute[73449]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 11:40:02 user nova-compute[73449]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 11:40:02 user nova-compute[73449]:     <timer name="hpet" present="no"/>
Aug 17 11:40:02 user nova-compute[73449]:   </clock>
Aug 17 11:40:02 user nova-compute[73449]:   <cpu mode="custom" match="exact">
Aug 17 11:40:02 user nova-compute[73449]:     <model>Nehalem</model>
Aug 17 11:40:02 user nova-compute[73449]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 11:40:02 user nova-compute[73449]:   </cpu>
Aug 17 11:40:02 user nova-compute[73449]:   <devices>
Aug 17 11:40:02 user nova-compute[73449]:     <disk type="file" device="disk">
Aug 17 11:40:02 user nova-compute[73449]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 11:40:02 user nova-compute[73449]:       <source file="/opt/stack/data/nova/instances/a40e1f85-a7e6-46da-8f98-df7a278aaade/disk"/>
Aug 17 11:40:02 user nova-compute[73449]:       <target dev="vda" bus="virtio"/>
Aug 17 11:40:02 user nova-compute[73449]:     </disk>
Aug 17 11:40:02 user nova-compute[73449]:     <interface type="ethernet">
Aug 17 11:40:02 user nova-compute[73449]:       <mac address="fa:16:3e:e4:b6:ea"/>
Aug 17 11:40:02 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 11:40:02 user nova-compute[73449]:       <mtu size="1442"/>
Aug 17 11:40:02 user nova-compute[73449]:       <target dev="tap6f565f5b-de"/>
Aug 17 11:40:02 user nova-compute[73449]:     </interface>
Aug 17 11:40:02 user nova-compute[73449]:     <serial type="pty">
Aug 17 11:40:02 user nova-compute[73449]:       <log file="/opt/stack/data/nova/instances/a40e1f85-a7e6-46da-8f98-df7a278aaade/console.log" append="off"/>
Aug 17 11:40:02 user nova-compute[73449]:     </serial>
Aug 17 11:40:02 user nova-compute[73449]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 11:40:02 user nova-compute[73449]:     <video>
Aug 17 11:40:02 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 11:40:02 user nova-compute[73449]:     </video>
Aug 17 11:40:02 user nova-compute[73449]:     <rng model="virtio">
Aug 17 11:40:02 user nova-compute[73449]:       <backend model="random">/dev/urandom</backend>
Aug 17 11:40:02 user nova-compute[73449]:     </rng>
Aug 17 11:40:02 user nova-compute[73449]:     <controller type="usb" index="0" model="none"/>
Aug 17 11:40:02 user nova-compute[73449]:     <memballoon model="virtio">
Aug 17 11:40:02 user nova-compute[73449]:       <stats period="10"/>
Aug 17 11:40:02 user nova-compute[73449]:     </memballoon>
Aug 17 11:40:02 user nova-compute[73449]:   </devices>
Aug 17 11:40:02 user nova-compute[73449]: </domain>
Aug 17 11:40:02 user nova-compute[73449]:  {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 11:40:02 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-b0098627-8c78-4de2-8c8c-dfcb292d2d30 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:39:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-726436740',display_name='tempest-DeleteServersTestJSON-server-726436740',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-726436740',id=1,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3dd321fccefc4bb6b89c59b1cc70df0b',ramdisk_id='',reservation_id='r-nlwr3lhn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-417173257',owner_user_name='tempest-DeleteServersTestJSON-417173257-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T11:39:54Z,user_data=None,user_id='31cdb313169e49709185780d4cfbfcd1',uuid=a40e1f85-a7e6-46da-8f98-df7a278aaade,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6f565f5b-de2a-4190-86fd-0d2606a9c5e9", "address": "fa:16:3e:e4:b6:ea", "network": {"id": "4275d6ae-c74d-4900-93d9-65ec567b5abe", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1540860684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dd321fccefc4bb6b89c59b1cc70df0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f565f5b-de", "ovs_interfaceid": "6f565f5b-de2a-4190-86fd-0d2606a9c5e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 11:40:02 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-b0098627-8c78-4de2-8c8c-dfcb292d2d30 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] Converting VIF {"id": "6f565f5b-de2a-4190-86fd-0d2606a9c5e9", "address": "fa:16:3e:e4:b6:ea", "network": {"id": "4275d6ae-c74d-4900-93d9-65ec567b5abe", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1540860684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dd321fccefc4bb6b89c59b1cc70df0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f565f5b-de", "ovs_interfaceid": "6f565f5b-de2a-4190-86fd-0d2606a9c5e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:40:02 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-b0098627-8c78-4de2-8c8c-dfcb292d2d30 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:b6:ea,bridge_name='br-int',has_traffic_filtering=True,id=6f565f5b-de2a-4190-86fd-0d2606a9c5e9,network=Network(4275d6ae-c74d-4900-93d9-65ec567b5abe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f565f5b-de') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:40:02 user nova-compute[73449]: DEBUG os_vif [None req-b0098627-8c78-4de2-8c8c-dfcb292d2d30 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:b6:ea,bridge_name='br-int',has_traffic_filtering=True,id=6f565f5b-de2a-4190-86fd-0d2606a9c5e9,network=Network(4275d6ae-c74d-4900-93d9-65ec567b5abe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f565f5b-de') {{(pid=73449) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 11:40:03 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl [None req-b0098627-8c78-4de2-8c8c-dfcb292d2d30 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] Created schema index Interface.name {{(pid=73449) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 17 11:40:03 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl [None req-b0098627-8c78-4de2-8c8c-dfcb292d2d30 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] Created schema index Port.name {{(pid=73449) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 17 11:40:03 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl [None req-b0098627-8c78-4de2-8c8c-dfcb292d2d30 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] Created schema index Bridge.name {{(pid=73449) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 17 11:40:03 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-b0098627-8c78-4de2-8c8c-dfcb292d2d30 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 11:40:03 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-95055937-9f5f-4721-b781-11bb31f51c2f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Acquiring lock "4a9e8ad2-19db-4975-87e4-2efce603a7d7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:40:03 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-95055937-9f5f-4721-b781-11bb31f51c2f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Lock "4a9e8ad2-19db-4975-87e4-2efce603a7d7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:40:03 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-b0098627-8c78-4de2-8c8c-dfcb292d2d30 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] [POLLOUT] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:40:03 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-b0098627-8c78-4de2-8c8c-dfcb292d2d30 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 11:40:03 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-b0098627-8c78-4de2-8c8c-dfcb292d2d30 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:40:03 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-b0098627-8c78-4de2-8c8c-dfcb292d2d30 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:40:03 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-b0098627-8c78-4de2-8c8c-dfcb292d2d30 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:40:03 user nova-compute[73449]: DEBUG nova.compute.manager [None req-95055937-9f5f-4721-b781-11bb31f51c2f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: 4a9e8ad2-19db-4975-87e4-2efce603a7d7] Starting instance... {{(pid=73449) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 11:40:03 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:40:03 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:40:03 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 11:40:03 user nova-compute[73449]: INFO oslo.privsep.daemon [None req-b0098627-8c78-4de2-8c8c-dfcb292d2d30 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmp_ojjk3e9/privsep.sock']
Aug 17 11:40:03 user sudo[82751]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmp_ojjk3e9/privsep.sock
Aug 17 11:40:03 user sudo[82751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 17 11:40:03 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-95055937-9f5f-4721-b781-11bb31f51c2f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:40:03 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-95055937-9f5f-4721-b781-11bb31f51c2f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:40:03 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-95055937-9f5f-4721-b781-11bb31f51c2f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73449) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 11:40:03 user nova-compute[73449]: INFO nova.compute.claims [None req-95055937-9f5f-4721-b781-11bb31f51c2f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: 4a9e8ad2-19db-4975-87e4-2efce603a7d7] Claim successful on node user
Aug 17 11:40:03 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-95055937-9f5f-4721-b781-11bb31f51c2f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 11:40:03 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-95055937-9f5f-4721-b781-11bb31f51c2f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 11:40:03 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-95055937-9f5f-4721-b781-11bb31f51c2f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.319s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:40:03 user nova-compute[73449]: DEBUG nova.compute.manager [None req-95055937-9f5f-4721-b781-11bb31f51c2f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: 4a9e8ad2-19db-4975-87e4-2efce603a7d7] Start building networks asynchronously for instance. {{(pid=73449) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 11:40:03 user nova-compute[73449]: DEBUG nova.compute.manager [None req-95055937-9f5f-4721-b781-11bb31f51c2f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: 4a9e8ad2-19db-4975-87e4-2efce603a7d7] Allocating IP information in the background. {{(pid=73449) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 11:40:03 user nova-compute[73449]: DEBUG nova.network.neutron [None req-95055937-9f5f-4721-b781-11bb31f51c2f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: 4a9e8ad2-19db-4975-87e4-2efce603a7d7] allocate_for_instance() {{(pid=73449) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 11:40:03 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-95055937-9f5f-4721-b781-11bb31f51c2f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: 4a9e8ad2-19db-4975-87e4-2efce603a7d7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 11:40:03 user nova-compute[73449]: DEBUG nova.compute.manager [None req-95055937-9f5f-4721-b781-11bb31f51c2f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: 4a9e8ad2-19db-4975-87e4-2efce603a7d7] Start building block device mappings for instance. {{(pid=73449) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 11:40:03 user nova-compute[73449]: DEBUG nova.policy [None req-95055937-9f5f-4721-b781-11bb31f51c2f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e44f6d8893da4d95a8ebe95180355c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '068c5270255744a18208a0ad9b35f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73449) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 11:40:03 user nova-compute[73449]: DEBUG nova.compute.manager [None req-95055937-9f5f-4721-b781-11bb31f51c2f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: 4a9e8ad2-19db-4975-87e4-2efce603a7d7] Start spawning the instance on the hypervisor. {{(pid=73449) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 11:40:03 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-95055937-9f5f-4721-b781-11bb31f51c2f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: 4a9e8ad2-19db-4975-87e4-2efce603a7d7] Creating instance directory {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 11:40:03 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-95055937-9f5f-4721-b781-11bb31f51c2f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: 4a9e8ad2-19db-4975-87e4-2efce603a7d7] Creating image(s)
Aug 17 11:40:03 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-95055937-9f5f-4721-b781-11bb31f51c2f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Acquiring lock "/opt/stack/data/nova/instances/4a9e8ad2-19db-4975-87e4-2efce603a7d7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:40:03 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-95055937-9f5f-4721-b781-11bb31f51c2f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Lock "/opt/stack/data/nova/instances/4a9e8ad2-19db-4975-87e4-2efce603a7d7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:40:03 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-95055937-9f5f-4721-b781-11bb31f51c2f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Lock "/opt/stack/data/nova/instances/4a9e8ad2-19db-4975-87e4-2efce603a7d7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:40:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-95055937-9f5f-4721-b781-11bb31f51c2f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:40:04 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:40:04 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-95055937-9f5f-4721-b781-11bb31f51c2f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json" returned: 0 in 0.231s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:40:04 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-95055937-9f5f-4721-b781-11bb31f51c2f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Acquiring lock "7e267a577c062ee862e95ede6b48cfd5632f3ea3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:40:04 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-95055937-9f5f-4721-b781-11bb31f51c2f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Lock "7e267a577c062ee862e95ede6b48cfd5632f3ea3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:40:04 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-95055937-9f5f-4721-b781-11bb31f51c2f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:40:04 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-95055937-9f5f-4721-b781-11bb31f51c2f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json" returned: 0 in 0.190s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:40:04 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-95055937-9f5f-4721-b781-11bb31f51c2f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3,backing_fmt=raw /opt/stack/data/nova/instances/4a9e8ad2-19db-4975-87e4-2efce603a7d7/disk 1073741824 {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:40:04 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-95055937-9f5f-4721-b781-11bb31f51c2f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3,backing_fmt=raw /opt/stack/data/nova/instances/4a9e8ad2-19db-4975-87e4-2efce603a7d7/disk 1073741824" returned: 0 in 0.050s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:40:04 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-95055937-9f5f-4721-b781-11bb31f51c2f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Lock "7e267a577c062ee862e95ede6b48cfd5632f3ea3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:40:04 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-95055937-9f5f-4721-b781-11bb31f51c2f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:40:04 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-95055937-9f5f-4721-b781-11bb31f51c2f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json" returned: 0 in 0.194s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:40:04 user nova-compute[73449]: DEBUG nova.virt.disk.api [None req-95055937-9f5f-4721-b781-11bb31f51c2f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4a9e8ad2-19db-4975-87e4-2efce603a7d7/disk. size=1073741824 {{(pid=73449) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 11:40:04 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-95055937-9f5f-4721-b781-11bb31f51c2f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a9e8ad2-19db-4975-87e4-2efce603a7d7/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:40:04 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-95055937-9f5f-4721-b781-11bb31f51c2f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a9e8ad2-19db-4975-87e4-2efce603a7d7/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:40:04 user nova-compute[73449]: DEBUG nova.virt.disk.api [None req-95055937-9f5f-4721-b781-11bb31f51c2f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Cannot resize image /opt/stack/data/nova/instances/4a9e8ad2-19db-4975-87e4-2efce603a7d7/disk to a smaller size. {{(pid=73449) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 11:40:04 user nova-compute[73449]: DEBUG nova.objects.instance [None req-95055937-9f5f-4721-b781-11bb31f51c2f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Lazy-loading 'migration_context' on Instance uuid 4a9e8ad2-19db-4975-87e4-2efce603a7d7 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:40:04 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-95055937-9f5f-4721-b781-11bb31f51c2f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: 4a9e8ad2-19db-4975-87e4-2efce603a7d7] Created local disks {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 11:40:04 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-95055937-9f5f-4721-b781-11bb31f51c2f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: 4a9e8ad2-19db-4975-87e4-2efce603a7d7] Ensure instance console log exists: /opt/stack/data/nova/instances/4a9e8ad2-19db-4975-87e4-2efce603a7d7/console.log {{(pid=73449) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 11:40:04 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-95055937-9f5f-4721-b781-11bb31f51c2f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:40:04 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-95055937-9f5f-4721-b781-11bb31f51c2f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:40:04 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-95055937-9f5f-4721-b781-11bb31f51c2f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:40:04 user nova-compute[73449]: DEBUG nova.network.neutron [req-dacff27f-2679-40c3-9cc5-637e1129a7c1 req-4a09a842-88f6-41ed-9ebb-2699c21c3f5c service nova] [instance: a40e1f85-a7e6-46da-8f98-df7a278aaade] Updated VIF entry in instance network info cache for port 6f565f5b-de2a-4190-86fd-0d2606a9c5e9. {{(pid=73449) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 11:40:04 user nova-compute[73449]: DEBUG nova.network.neutron [req-dacff27f-2679-40c3-9cc5-637e1129a7c1 req-4a09a842-88f6-41ed-9ebb-2699c21c3f5c service nova] [instance: a40e1f85-a7e6-46da-8f98-df7a278aaade] Updating instance_info_cache with network_info: [{"id": "6f565f5b-de2a-4190-86fd-0d2606a9c5e9", "address": "fa:16:3e:e4:b6:ea", "network": {"id": "4275d6ae-c74d-4900-93d9-65ec567b5abe", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1540860684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dd321fccefc4bb6b89c59b1cc70df0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f565f5b-de", "ovs_interfaceid": "6f565f5b-de2a-4190-86fd-0d2606a9c5e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:40:04 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-dacff27f-2679-40c3-9cc5-637e1129a7c1 req-4a09a842-88f6-41ed-9ebb-2699c21c3f5c service nova] Releasing lock "refresh_cache-a40e1f85-a7e6-46da-8f98-df7a278aaade" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:40:05 user sudo[82751]: pam_unix(sudo:session): session closed for user root
Aug 17 11:40:05 user nova-compute[73449]: INFO oslo.privsep.daemon [None req-b0098627-8c78-4de2-8c8c-dfcb292d2d30 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] Spawned new privsep daemon via rootwrap
Aug 17 11:40:05 user nova-compute[73449]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 17 11:40:05 user nova-compute[73449]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 17 11:40:05 user nova-compute[73449]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Aug 17 11:40:05 user nova-compute[73449]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82770
Aug 17 11:40:05 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:40:05 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6f565f5b-de, may_exist=True, interface_attrs={}) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:40:05 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6f565f5b-de, col_values=(('external_ids', {'iface-id': '6f565f5b-de2a-4190-86fd-0d2606a9c5e9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e4:b6:ea', 'vm-uuid': 'a40e1f85-a7e6-46da-8f98-df7a278aaade'}),), if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:40:05 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:40:05 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:40:05 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:40:05 user nova-compute[73449]: INFO os_vif [None req-b0098627-8c78-4de2-8c8c-dfcb292d2d30 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:b6:ea,bridge_name='br-int',has_traffic_filtering=True,id=6f565f5b-de2a-4190-86fd-0d2606a9c5e9,network=Network(4275d6ae-c74d-4900-93d9-65ec567b5abe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f565f5b-de')
Aug 17 11:40:05 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b0098627-8c78-4de2-8c8c-dfcb292d2d30 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] No BDM found with device name vda, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 11:40:05 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b0098627-8c78-4de2-8c8c-dfcb292d2d30 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] No VIF found with MAC fa:16:3e:e4:b6:ea, not building metadata {{(pid=73449) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 11:40:06 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-fadea91d-ec15-4883-af67-361746e8add5 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Acquiring lock "a3523d22-7165-46ad-be10-5e6ae374f91d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:40:06 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-fadea91d-ec15-4883-af67-361746e8add5 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Lock "a3523d22-7165-46ad-be10-5e6ae374f91d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:40:06 user nova-compute[73449]: DEBUG nova.compute.manager [None req-fadea91d-ec15-4883-af67-361746e8add5 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Starting instance... {{(pid=73449) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 11:40:06 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-fadea91d-ec15-4883-af67-361746e8add5 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:40:06 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-fadea91d-ec15-4883-af67-361746e8add5 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:40:06 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-fadea91d-ec15-4883-af67-361746e8add5 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73449) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 11:40:06 user nova-compute[73449]: INFO nova.compute.claims [None req-fadea91d-ec15-4883-af67-361746e8add5 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Claim successful on node user
Aug 17 11:40:06 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:40:06 user nova-compute[73449]: DEBUG nova.network.neutron [None req-95055937-9f5f-4721-b781-11bb31f51c2f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: 4a9e8ad2-19db-4975-87e4-2efce603a7d7] Successfully created port: 3c5f8e97-0654-42f0-9575-eab6d833283a {{(pid=73449) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 11:40:07 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:40:07 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-fadea91d-ec15-4883-af67-361746e8add5 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 11:40:07 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-fadea91d-ec15-4883-af67-361746e8add5 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 11:40:07 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-fadea91d-ec15-4883-af67-361746e8add5 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.359s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:40:07 user nova-compute[73449]: DEBUG nova.compute.manager [None req-fadea91d-ec15-4883-af67-361746e8add5 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Start building networks asynchronously for instance. {{(pid=73449) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 11:40:07 user nova-compute[73449]: DEBUG nova.compute.manager [None req-fadea91d-ec15-4883-af67-361746e8add5 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Allocating IP information in the background. {{(pid=73449) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 11:40:07 user nova-compute[73449]: DEBUG nova.network.neutron [None req-fadea91d-ec15-4883-af67-361746e8add5 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] allocate_for_instance() {{(pid=73449) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 11:40:07 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-fadea91d-ec15-4883-af67-361746e8add5 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 11:40:07 user nova-compute[73449]: DEBUG nova.compute.manager [None req-fadea91d-ec15-4883-af67-361746e8add5 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Start building block device mappings for instance. {{(pid=73449) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 11:40:07 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:40:07 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:40:07 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:40:07 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:40:07 user nova-compute[73449]: DEBUG nova.compute.manager [None req-fadea91d-ec15-4883-af67-361746e8add5 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Start spawning the instance on the hypervisor. {{(pid=73449) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 11:40:07 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-fadea91d-ec15-4883-af67-361746e8add5 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Creating instance directory {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 11:40:07 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-fadea91d-ec15-4883-af67-361746e8add5 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Creating image(s)
Aug 17 11:40:07 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-fadea91d-ec15-4883-af67-361746e8add5 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Acquiring lock "/opt/stack/data/nova/instances/a3523d22-7165-46ad-be10-5e6ae374f91d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:40:07 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-fadea91d-ec15-4883-af67-361746e8add5 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Lock "/opt/stack/data/nova/instances/a3523d22-7165-46ad-be10-5e6ae374f91d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:40:07 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-fadea91d-ec15-4883-af67-361746e8add5 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Lock "/opt/stack/data/nova/instances/a3523d22-7165-46ad-be10-5e6ae374f91d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:40:07 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-fadea91d-ec15-4883-af67-361746e8add5 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:40:07 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-fadea91d-ec15-4883-af67-361746e8add5 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json" returned: 0 in 0.190s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:40:07 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-fadea91d-ec15-4883-af67-361746e8add5 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Acquiring lock "7e267a577c062ee862e95ede6b48cfd5632f3ea3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:40:07 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-fadea91d-ec15-4883-af67-361746e8add5 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Lock "7e267a577c062ee862e95ede6b48cfd5632f3ea3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:40:07 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-fadea91d-ec15-4883-af67-361746e8add5 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:40:07 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-fadea91d-ec15-4883-af67-361746e8add5 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json" returned: 0 in 0.189s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:40:07 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-fadea91d-ec15-4883-af67-361746e8add5 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3,backing_fmt=raw /opt/stack/data/nova/instances/a3523d22-7165-46ad-be10-5e6ae374f91d/disk 1073741824 {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:40:07 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:40:07 user nova-compute[73449]: DEBUG nova.policy [None req-fadea91d-ec15-4883-af67-361746e8add5 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd01f62699d2648cfa940fd73d9a82dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eed9899860d4e7ca8a4500bbda4be13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73449) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 11:40:07 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-fadea91d-ec15-4883-af67-361746e8add5 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3,backing_fmt=raw /opt/stack/data/nova/instances/a3523d22-7165-46ad-be10-5e6ae374f91d/disk 1073741824" returned: 0 in 0.057s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:40:07 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-fadea91d-ec15-4883-af67-361746e8add5 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Lock "7e267a577c062ee862e95ede6b48cfd5632f3ea3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:40:07 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-fadea91d-ec15-4883-af67-361746e8add5 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:40:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-fadea91d-ec15-4883-af67-361746e8add5 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json" returned: 0 in 0.168s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:40:08 user nova-compute[73449]: DEBUG nova.virt.disk.api [None req-fadea91d-ec15-4883-af67-361746e8add5 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a3523d22-7165-46ad-be10-5e6ae374f91d/disk. size=1073741824 {{(pid=73449) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 11:40:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-fadea91d-ec15-4883-af67-361746e8add5 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3523d22-7165-46ad-be10-5e6ae374f91d/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:40:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-fadea91d-ec15-4883-af67-361746e8add5 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3523d22-7165-46ad-be10-5e6ae374f91d/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:40:08 user nova-compute[73449]: DEBUG nova.virt.disk.api [None req-fadea91d-ec15-4883-af67-361746e8add5 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Cannot resize image /opt/stack/data/nova/instances/a3523d22-7165-46ad-be10-5e6ae374f91d/disk to a smaller size. {{(pid=73449) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 11:40:08 user nova-compute[73449]: DEBUG nova.objects.instance [None req-fadea91d-ec15-4883-af67-361746e8add5 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Lazy-loading 'migration_context' on Instance uuid a3523d22-7165-46ad-be10-5e6ae374f91d {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:40:08 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-fadea91d-ec15-4883-af67-361746e8add5 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Created local disks {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 11:40:08 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-fadea91d-ec15-4883-af67-361746e8add5 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Ensure instance console log exists: /opt/stack/data/nova/instances/a3523d22-7165-46ad-be10-5e6ae374f91d/console.log {{(pid=73449) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 11:40:08 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-fadea91d-ec15-4883-af67-361746e8add5 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:40:08 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-fadea91d-ec15-4883-af67-361746e8add5 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:40:08 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-fadea91d-ec15-4883-af67-361746e8add5 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:40:09 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692272409.440016, a40e1f85-a7e6-46da-8f98-df7a278aaade => Resumed> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:40:09 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: a40e1f85-a7e6-46da-8f98-df7a278aaade] VM Resumed (Lifecycle Event)
Aug 17 11:40:09 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b0098627-8c78-4de2-8c8c-dfcb292d2d30 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] [instance: a40e1f85-a7e6-46da-8f98-df7a278aaade] Instance event wait completed in 0 seconds for  {{(pid=73449) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 11:40:09 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b0098627-8c78-4de2-8c8c-dfcb292d2d30 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] [instance: a40e1f85-a7e6-46da-8f98-df7a278aaade] Guest created on hypervisor {{(pid=73449) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 11:40:09 user nova-compute[73449]: DEBUG nova.network.neutron [None req-95055937-9f5f-4721-b781-11bb31f51c2f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: 4a9e8ad2-19db-4975-87e4-2efce603a7d7] Successfully updated port: 3c5f8e97-0654-42f0-9575-eab6d833283a {{(pid=73449) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 11:40:09 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: a40e1f85-a7e6-46da-8f98-df7a278aaade] Instance spawned successfully.
Aug 17 11:40:09 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b0098627-8c78-4de2-8c8c-dfcb292d2d30 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] [instance: a40e1f85-a7e6-46da-8f98-df7a278aaade] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 11:40:09 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-95055937-9f5f-4721-b781-11bb31f51c2f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Acquiring lock "refresh_cache-4a9e8ad2-19db-4975-87e4-2efce603a7d7" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:40:09 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-95055937-9f5f-4721-b781-11bb31f51c2f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Acquired lock "refresh_cache-4a9e8ad2-19db-4975-87e4-2efce603a7d7" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:40:09 user nova-compute[73449]: DEBUG nova.network.neutron [None req-95055937-9f5f-4721-b781-11bb31f51c2f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: 4a9e8ad2-19db-4975-87e4-2efce603a7d7] Building network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 11:40:09 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b0098627-8c78-4de2-8c8c-dfcb292d2d30 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] [instance: a40e1f85-a7e6-46da-8f98-df7a278aaade] Found default for hw_cdrom_bus of ide {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:40:09 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b0098627-8c78-4de2-8c8c-dfcb292d2d30 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] [instance: a40e1f85-a7e6-46da-8f98-df7a278aaade] Found default for hw_disk_bus of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:40:09 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b0098627-8c78-4de2-8c8c-dfcb292d2d30 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] [instance: a40e1f85-a7e6-46da-8f98-df7a278aaade] Found default for hw_input_bus of None {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:40:09 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b0098627-8c78-4de2-8c8c-dfcb292d2d30 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] [instance: a40e1f85-a7e6-46da-8f98-df7a278aaade] Found default for hw_pointer_model of None {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:40:09 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b0098627-8c78-4de2-8c8c-dfcb292d2d30 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] [instance: a40e1f85-a7e6-46da-8f98-df7a278aaade] Found default for hw_video_model of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:40:09 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b0098627-8c78-4de2-8c8c-dfcb292d2d30 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] [instance: a40e1f85-a7e6-46da-8f98-df7a278aaade] Found default for hw_vif_model of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:40:09 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: a40e1f85-a7e6-46da-8f98-df7a278aaade] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:40:09 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: a40e1f85-a7e6-46da-8f98-df7a278aaade] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 11:40:09 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: a40e1f85-a7e6-46da-8f98-df7a278aaade] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 11:40:09 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692272409.4401817, a40e1f85-a7e6-46da-8f98-df7a278aaade => Started> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:40:09 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: a40e1f85-a7e6-46da-8f98-df7a278aaade] VM Started (Lifecycle Event)
Aug 17 11:40:09 user nova-compute[73449]: INFO nova.compute.manager [None req-b0098627-8c78-4de2-8c8c-dfcb292d2d30 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] [instance: a40e1f85-a7e6-46da-8f98-df7a278aaade] Took 15.13 seconds to spawn the instance on the hypervisor.
Aug 17 11:40:09 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b0098627-8c78-4de2-8c8c-dfcb292d2d30 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] [instance: a40e1f85-a7e6-46da-8f98-df7a278aaade] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:40:09 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: a40e1f85-a7e6-46da-8f98-df7a278aaade] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:40:09 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: a40e1f85-a7e6-46da-8f98-df7a278aaade] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 11:40:09 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: a40e1f85-a7e6-46da-8f98-df7a278aaade] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 11:40:09 user nova-compute[73449]: DEBUG nova.network.neutron [None req-95055937-9f5f-4721-b781-11bb31f51c2f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: 4a9e8ad2-19db-4975-87e4-2efce603a7d7] Instance cache missing network info. {{(pid=73449) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 11:40:09 user nova-compute[73449]: INFO nova.compute.manager [None req-b0098627-8c78-4de2-8c8c-dfcb292d2d30 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] [instance: a40e1f85-a7e6-46da-8f98-df7a278aaade] Took 16.10 seconds to build instance.
Aug 17 11:40:09 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b0098627-8c78-4de2-8c8c-dfcb292d2d30 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] Lock "a40e1f85-a7e6-46da-8f98-df7a278aaade" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.323s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:40:10 user nova-compute[73449]: DEBUG nova.compute.manager [req-1faceb8a-c6aa-4eeb-ad8c-4b7fe82a3247 req-a6a43b24-fd1e-4eac-8cbe-fba8425a9317 service nova] [instance: 4a9e8ad2-19db-4975-87e4-2efce603a7d7] Received event network-changed-3c5f8e97-0654-42f0-9575-eab6d833283a {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:40:10 user nova-compute[73449]: DEBUG nova.compute.manager [req-1faceb8a-c6aa-4eeb-ad8c-4b7fe82a3247 req-a6a43b24-fd1e-4eac-8cbe-fba8425a9317 service nova] [instance: 4a9e8ad2-19db-4975-87e4-2efce603a7d7] Refreshing instance network info cache due to event network-changed-3c5f8e97-0654-42f0-9575-eab6d833283a. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 11:40:10 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-1faceb8a-c6aa-4eeb-ad8c-4b7fe82a3247 req-a6a43b24-fd1e-4eac-8cbe-fba8425a9317 service nova] Acquiring lock "refresh_cache-4a9e8ad2-19db-4975-87e4-2efce603a7d7" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:40:10 user nova-compute[73449]: DEBUG nova.network.neutron [None req-95055937-9f5f-4721-b781-11bb31f51c2f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: 4a9e8ad2-19db-4975-87e4-2efce603a7d7] Updating instance_info_cache with network_info: [{"id": "3c5f8e97-0654-42f0-9575-eab6d833283a", "address": "fa:16:3e:c8:b7:51", "network": {"id": "72c50a42-688f-4868-8e19-c40b103a49cd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1792423641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "068c5270255744a18208a0ad9b35f168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c5f8e97-06", "ovs_interfaceid": "3c5f8e97-0654-42f0-9575-eab6d833283a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:40:10 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-95055937-9f5f-4721-b781-11bb31f51c2f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Releasing lock "refresh_cache-4a9e8ad2-19db-4975-87e4-2efce603a7d7" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:40:10 user nova-compute[73449]: DEBUG nova.compute.manager [None req-95055937-9f5f-4721-b781-11bb31f51c2f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: 4a9e8ad2-19db-4975-87e4-2efce603a7d7] Instance network_info: |[{"id": "3c5f8e97-0654-42f0-9575-eab6d833283a", "address": "fa:16:3e:c8:b7:51", "network": {"id": "72c50a42-688f-4868-8e19-c40b103a49cd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1792423641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "068c5270255744a18208a0ad9b35f168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c5f8e97-06", "ovs_interfaceid": "3c5f8e97-0654-42f0-9575-eab6d833283a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73449) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 11:40:10 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-1faceb8a-c6aa-4eeb-ad8c-4b7fe82a3247 req-a6a43b24-fd1e-4eac-8cbe-fba8425a9317 service nova] Acquired lock "refresh_cache-4a9e8ad2-19db-4975-87e4-2efce603a7d7" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:40:10 user nova-compute[73449]: DEBUG nova.network.neutron [req-1faceb8a-c6aa-4eeb-ad8c-4b7fe82a3247 req-a6a43b24-fd1e-4eac-8cbe-fba8425a9317 service nova] [instance: 4a9e8ad2-19db-4975-87e4-2efce603a7d7] Refreshing network info cache for port 3c5f8e97-0654-42f0-9575-eab6d833283a {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 11:40:10 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-95055937-9f5f-4721-b781-11bb31f51c2f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: 4a9e8ad2-19db-4975-87e4-2efce603a7d7] Start _get_guest_xml network_info=[{"id": "3c5f8e97-0654-42f0-9575-eab6d833283a", "address": "fa:16:3e:c8:b7:51", "network": {"id": "72c50a42-688f-4868-8e19-c40b103a49cd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1792423641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "068c5270255744a18208a0ad9b35f168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c5f8e97-06", "ovs_interfaceid": "3c5f8e97-0654-42f0-9575-eab6d833283a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T11:36:11Z,direct_url=<?>,disk_format='qcow2',id=0a2904ae-083d-41c8-83db-343132b36148,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7a77880136a54ef195c82e018e1939db',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T11:36:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': '0a2904ae-083d-41c8-83db-343132b36148'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 11:40:10 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-95055937-9f5f-4721-b781-11bb31f51c2f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:40:10 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-95055937-9f5f-4721-b781-11bb31f51c2f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:40:10 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-95055937-9f5f-4721-b781-11bb31f51c2f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 11:40:10 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-95055937-9f5f-4721-b781-11bb31f51c2f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] CPU controller missing on host. {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 11:40:10 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-95055937-9f5f-4721-b781-11bb31f51c2f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 11:40:10 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-95055937-9f5f-4721-b781-11bb31f51c2f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] CPU controller found on host. {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 11:40:10 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-95055937-9f5f-4721-b781-11bb31f51c2f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73449) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 11:40:10 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-95055937-9f5f-4721-b781-11bb31f51c2f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T11:35:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T11:36:11Z,direct_url=<?>,disk_format='qcow2',id=0a2904ae-083d-41c8-83db-343132b36148,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7a77880136a54ef195c82e018e1939db',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T11:36:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 11:40:10 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-95055937-9f5f-4721-b781-11bb31f51c2f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Flavor limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 11:40:10 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-95055937-9f5f-4721-b781-11bb31f51c2f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Image limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 11:40:10 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-95055937-9f5f-4721-b781-11bb31f51c2f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Flavor pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 11:40:10 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-95055937-9f5f-4721-b781-11bb31f51c2f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Image pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 11:40:10 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-95055937-9f5f-4721-b781-11bb31f51c2f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 11:40:10 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-95055937-9f5f-4721-b781-11bb31f51c2f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 11:40:10 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-95055937-9f5f-4721-b781-11bb31f51c2f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 11:40:10 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-95055937-9f5f-4721-b781-11bb31f51c2f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Got 1 possible topologies {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 11:40:10 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-95055937-9f5f-4721-b781-11bb31f51c2f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 11:40:10 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-95055937-9f5f-4721-b781-11bb31f51c2f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 11:40:10 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-95055937-9f5f-4721-b781-11bb31f51c2f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:40:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1526960876',display_name='tempest-ServerActionsTestOtherA-server-1526960876',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1526960876',id=2,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCjLihiqnR89DD+L9AvKMPg4aJ24FTEbroZyaBsKATQAbGhLg8fsSlSGdiYIhidGfsmIAOo7d+B78UcRA6oBB5kBwNop43IFNlD0zoDm7uS+jBpAFARKuZg2/qBioB0EGg==',key_name='tempest-keypair-71173965',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='068c5270255744a18208a0ad9b35f168',ramdisk_id='',reservation_id='r-uhieyi1b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-303961666',owner_user_name='tempest-ServerActionsTestOtherA-303961666-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T11:40:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e44f6d8893da4d95a8ebe95180355c04',uuid=4a9e8ad2-19db-4975-87e4-2efce603a7d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3c5f8e97-0654-42f0-9575-eab6d833283a", "address": "fa:16:3e:c8:b7:51", "network": {"id": "72c50a42-688f-4868-8e19-c40b103a49cd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1792423641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "068c5270255744a18208a0ad9b35f168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c5f8e97-06", "ovs_interfaceid": "3c5f8e97-0654-42f0-9575-eab6d833283a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73449) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 11:40:10 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-95055937-9f5f-4721-b781-11bb31f51c2f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Converting VIF {"id": "3c5f8e97-0654-42f0-9575-eab6d833283a", "address": "fa:16:3e:c8:b7:51", "network": {"id": "72c50a42-688f-4868-8e19-c40b103a49cd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1792423641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "068c5270255744a18208a0ad9b35f168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c5f8e97-06", "ovs_interfaceid": "3c5f8e97-0654-42f0-9575-eab6d833283a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:40:10 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-95055937-9f5f-4721-b781-11bb31f51c2f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:b7:51,bridge_name='br-int',has_traffic_filtering=True,id=3c5f8e97-0654-42f0-9575-eab6d833283a,network=Network(72c50a42-688f-4868-8e19-c40b103a49cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c5f8e97-06') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:40:10 user nova-compute[73449]: DEBUG nova.objects.instance [None req-95055937-9f5f-4721-b781-11bb31f51c2f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Lazy-loading 'pci_devices' on Instance uuid 4a9e8ad2-19db-4975-87e4-2efce603a7d7 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:40:10 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-95055937-9f5f-4721-b781-11bb31f51c2f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: 4a9e8ad2-19db-4975-87e4-2efce603a7d7] End _get_guest_xml xml=<domain type="kvm">
Aug 17 11:40:10 user nova-compute[73449]:   <uuid>4a9e8ad2-19db-4975-87e4-2efce603a7d7</uuid>
Aug 17 11:40:10 user nova-compute[73449]:   <name>instance-00000002</name>
Aug 17 11:40:10 user nova-compute[73449]:   <memory>524288</memory>
Aug 17 11:40:10 user nova-compute[73449]:   <vcpu>1</vcpu>
Aug 17 11:40:10 user nova-compute[73449]:   <metadata>
Aug 17 11:40:10 user nova-compute[73449]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 11:40:10 user nova-compute[73449]:       <nova:package version="0.0.0"/>
Aug 17 11:40:10 user nova-compute[73449]:       <nova:name>tempest-ServerActionsTestOtherA-server-1526960876</nova:name>
Aug 17 11:40:10 user nova-compute[73449]:       <nova:creationTime>2023-08-17 11:40:10</nova:creationTime>
Aug 17 11:40:10 user nova-compute[73449]:       <nova:flavor name="m1.tiny">
Aug 17 11:40:10 user nova-compute[73449]:         <nova:memory>512</nova:memory>
Aug 17 11:40:10 user nova-compute[73449]:         <nova:disk>1</nova:disk>
Aug 17 11:40:10 user nova-compute[73449]:         <nova:swap>0</nova:swap>
Aug 17 11:40:10 user nova-compute[73449]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 11:40:10 user nova-compute[73449]:         <nova:vcpus>1</nova:vcpus>
Aug 17 11:40:10 user nova-compute[73449]:       </nova:flavor>
Aug 17 11:40:10 user nova-compute[73449]:       <nova:owner>
Aug 17 11:40:10 user nova-compute[73449]:         <nova:user uuid="e44f6d8893da4d95a8ebe95180355c04">tempest-ServerActionsTestOtherA-303961666-project-member</nova:user>
Aug 17 11:40:10 user nova-compute[73449]:         <nova:project uuid="068c5270255744a18208a0ad9b35f168">tempest-ServerActionsTestOtherA-303961666</nova:project>
Aug 17 11:40:10 user nova-compute[73449]:       </nova:owner>
Aug 17 11:40:10 user nova-compute[73449]:       <nova:root type="image" uuid="0a2904ae-083d-41c8-83db-343132b36148"/>
Aug 17 11:40:10 user nova-compute[73449]:       <nova:ports>
Aug 17 11:40:10 user nova-compute[73449]:         <nova:port uuid="3c5f8e97-0654-42f0-9575-eab6d833283a">
Aug 17 11:40:10 user nova-compute[73449]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 17 11:40:10 user nova-compute[73449]:         </nova:port>
Aug 17 11:40:10 user nova-compute[73449]:       </nova:ports>
Aug 17 11:40:10 user nova-compute[73449]:     </nova:instance>
Aug 17 11:40:10 user nova-compute[73449]:   </metadata>
Aug 17 11:40:10 user nova-compute[73449]:   <sysinfo type="smbios">
Aug 17 11:40:10 user nova-compute[73449]:     <system>
Aug 17 11:40:10 user nova-compute[73449]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 11:40:10 user nova-compute[73449]:       <entry name="product">OpenStack Nova</entry>
Aug 17 11:40:10 user nova-compute[73449]:       <entry name="version">0.0.0</entry>
Aug 17 11:40:10 user nova-compute[73449]:       <entry name="serial">4a9e8ad2-19db-4975-87e4-2efce603a7d7</entry>
Aug 17 11:40:10 user nova-compute[73449]:       <entry name="uuid">4a9e8ad2-19db-4975-87e4-2efce603a7d7</entry>
Aug 17 11:40:10 user nova-compute[73449]:       <entry name="family">Virtual Machine</entry>
Aug 17 11:40:10 user nova-compute[73449]:     </system>
Aug 17 11:40:10 user nova-compute[73449]:   </sysinfo>
Aug 17 11:40:10 user nova-compute[73449]:   <os>
Aug 17 11:40:10 user nova-compute[73449]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 11:40:10 user nova-compute[73449]:     <boot dev="hd"/>
Aug 17 11:40:10 user nova-compute[73449]:     <smbios mode="sysinfo"/>
Aug 17 11:40:10 user nova-compute[73449]:   </os>
Aug 17 11:40:10 user nova-compute[73449]:   <features>
Aug 17 11:40:10 user nova-compute[73449]:     <acpi/>
Aug 17 11:40:10 user nova-compute[73449]:     <apic/>
Aug 17 11:40:10 user nova-compute[73449]:     <vmcoreinfo/>
Aug 17 11:40:10 user nova-compute[73449]:   </features>
Aug 17 11:40:10 user nova-compute[73449]:   <clock offset="utc">
Aug 17 11:40:10 user nova-compute[73449]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 11:40:10 user nova-compute[73449]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 11:40:10 user nova-compute[73449]:     <timer name="hpet" present="no"/>
Aug 17 11:40:10 user nova-compute[73449]:   </clock>
Aug 17 11:40:10 user nova-compute[73449]:   <cpu mode="custom" match="exact">
Aug 17 11:40:10 user nova-compute[73449]:     <model>Nehalem</model>
Aug 17 11:40:10 user nova-compute[73449]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 11:40:10 user nova-compute[73449]:   </cpu>
Aug 17 11:40:10 user nova-compute[73449]:   <devices>
Aug 17 11:40:10 user nova-compute[73449]:     <disk type="file" device="disk">
Aug 17 11:40:10 user nova-compute[73449]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 11:40:10 user nova-compute[73449]:       <source file="/opt/stack/data/nova/instances/4a9e8ad2-19db-4975-87e4-2efce603a7d7/disk"/>
Aug 17 11:40:10 user nova-compute[73449]:       <target dev="vda" bus="virtio"/>
Aug 17 11:40:10 user nova-compute[73449]:     </disk>
Aug 17 11:40:10 user nova-compute[73449]:     <interface type="ethernet">
Aug 17 11:40:10 user nova-compute[73449]:       <mac address="fa:16:3e:c8:b7:51"/>
Aug 17 11:40:10 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 11:40:10 user nova-compute[73449]:       <mtu size="1442"/>
Aug 17 11:40:10 user nova-compute[73449]:       <target dev="tap3c5f8e97-06"/>
Aug 17 11:40:10 user nova-compute[73449]:     </interface>
Aug 17 11:40:10 user nova-compute[73449]:     <serial type="pty">
Aug 17 11:40:10 user nova-compute[73449]:       <log file="/opt/stack/data/nova/instances/4a9e8ad2-19db-4975-87e4-2efce603a7d7/console.log" append="off"/>
Aug 17 11:40:10 user nova-compute[73449]:     </serial>
Aug 17 11:40:10 user nova-compute[73449]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 11:40:10 user nova-compute[73449]:     <video>
Aug 17 11:40:10 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 11:40:10 user nova-compute[73449]:     </video>
Aug 17 11:40:10 user nova-compute[73449]:     <rng model="virtio">
Aug 17 11:40:10 user nova-compute[73449]:       <backend model="random">/dev/urandom</backend>
Aug 17 11:40:10 user nova-compute[73449]:     </rng>
Aug 17 11:40:10 user nova-compute[73449]:     <controller type="usb" index="0" model="none"/>
Aug 17 11:40:10 user nova-compute[73449]:     <memballoon model="virtio">
Aug 17 11:40:10 user nova-compute[73449]:       <stats period="10"/>
Aug 17 11:40:10 user nova-compute[73449]:     </memballoon>
Aug 17 11:40:10 user nova-compute[73449]:   </devices>
Aug 17 11:40:10 user nova-compute[73449]: </domain>
Aug 17 11:40:10 user nova-compute[73449]:  {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 11:40:10 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-95055937-9f5f-4721-b781-11bb31f51c2f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:40:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1526960876',display_name='tempest-ServerActionsTestOtherA-server-1526960876',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1526960876',id=2,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCjLihiqnR89DD+L9AvKMPg4aJ24FTEbroZyaBsKATQAbGhLg8fsSlSGdiYIhidGfsmIAOo7d+B78UcRA6oBB5kBwNop43IFNlD0zoDm7uS+jBpAFARKuZg2/qBioB0EGg==',key_name='tempest-keypair-71173965',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='068c5270255744a18208a0ad9b35f168',ramdisk_id='',reservation_id='r-uhieyi1b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-303961666',owner_user_name='tempest-ServerActionsTestOtherA-303961666-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T11:40:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e44f6d8893da4d95a8ebe95180355c04',uuid=4a9e8ad2-19db-4975-87e4-2efce603a7d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3c5f8e97-0654-42f0-9575-eab6d833283a", "address": "fa:16:3e:c8:b7:51", "network": {"id": "72c50a42-688f-4868-8e19-c40b103a49cd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1792423641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "068c5270255744a18208a0ad9b35f168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c5f8e97-06", "ovs_interfaceid": "3c5f8e97-0654-42f0-9575-eab6d833283a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 11:40:10 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-95055937-9f5f-4721-b781-11bb31f51c2f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Converting VIF {"id": "3c5f8e97-0654-42f0-9575-eab6d833283a", "address": "fa:16:3e:c8:b7:51", "network": {"id": "72c50a42-688f-4868-8e19-c40b103a49cd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1792423641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "068c5270255744a18208a0ad9b35f168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c5f8e97-06", "ovs_interfaceid": "3c5f8e97-0654-42f0-9575-eab6d833283a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:40:10 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-95055937-9f5f-4721-b781-11bb31f51c2f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:b7:51,bridge_name='br-int',has_traffic_filtering=True,id=3c5f8e97-0654-42f0-9575-eab6d833283a,network=Network(72c50a42-688f-4868-8e19-c40b103a49cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c5f8e97-06') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:40:10 user nova-compute[73449]: DEBUG os_vif [None req-95055937-9f5f-4721-b781-11bb31f51c2f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:b7:51,bridge_name='br-int',has_traffic_filtering=True,id=3c5f8e97-0654-42f0-9575-eab6d833283a,network=Network(72c50a42-688f-4868-8e19-c40b103a49cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c5f8e97-06') {{(pid=73449) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 11:40:10 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:40:10 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:40:10 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 11:40:10 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:40:10 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:40:10 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3c5f8e97-06, may_exist=True, interface_attrs={}) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:40:10 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3c5f8e97-06, col_values=(('external_ids', {'iface-id': '3c5f8e97-0654-42f0-9575-eab6d833283a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c8:b7:51', 'vm-uuid': '4a9e8ad2-19db-4975-87e4-2efce603a7d7'}),), if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:40:10 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:40:10 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:40:10 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:40:10 user nova-compute[73449]: INFO os_vif [None req-95055937-9f5f-4721-b781-11bb31f51c2f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:b7:51,bridge_name='br-int',has_traffic_filtering=True,id=3c5f8e97-0654-42f0-9575-eab6d833283a,network=Network(72c50a42-688f-4868-8e19-c40b103a49cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c5f8e97-06')
Aug 17 11:40:10 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-95055937-9f5f-4721-b781-11bb31f51c2f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] No BDM found with device name vda, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 11:40:10 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-95055937-9f5f-4721-b781-11bb31f51c2f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] No VIF found with MAC fa:16:3e:c8:b7:51, not building metadata {{(pid=73449) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 11:40:11 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:40:11 user nova-compute[73449]: DEBUG nova.network.neutron [None req-fadea91d-ec15-4883-af67-361746e8add5 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Successfully created port: 2a0eb61f-9398-4db6-9ae0-f142ad2e60c4 {{(pid=73449) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 11:40:11 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:40:12 user nova-compute[73449]: DEBUG nova.network.neutron [req-1faceb8a-c6aa-4eeb-ad8c-4b7fe82a3247 req-a6a43b24-fd1e-4eac-8cbe-fba8425a9317 service nova] [instance: 4a9e8ad2-19db-4975-87e4-2efce603a7d7] Updated VIF entry in instance network info cache for port 3c5f8e97-0654-42f0-9575-eab6d833283a. {{(pid=73449) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 11:40:12 user nova-compute[73449]: DEBUG nova.network.neutron [req-1faceb8a-c6aa-4eeb-ad8c-4b7fe82a3247 req-a6a43b24-fd1e-4eac-8cbe-fba8425a9317 service nova] [instance: 4a9e8ad2-19db-4975-87e4-2efce603a7d7] Updating instance_info_cache with network_info: [{"id": "3c5f8e97-0654-42f0-9575-eab6d833283a", "address": "fa:16:3e:c8:b7:51", "network": {"id": "72c50a42-688f-4868-8e19-c40b103a49cd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1792423641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "068c5270255744a18208a0ad9b35f168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c5f8e97-06", "ovs_interfaceid": "3c5f8e97-0654-42f0-9575-eab6d833283a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:40:12 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-1faceb8a-c6aa-4eeb-ad8c-4b7fe82a3247 req-a6a43b24-fd1e-4eac-8cbe-fba8425a9317 service nova] Releasing lock "refresh_cache-4a9e8ad2-19db-4975-87e4-2efce603a7d7" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:40:12 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:40:12 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:40:12 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:40:13 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:40:13 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:40:14 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:40:14 user nova-compute[73449]: DEBUG nova.network.neutron [None req-fadea91d-ec15-4883-af67-361746e8add5 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Successfully updated port: 2a0eb61f-9398-4db6-9ae0-f142ad2e60c4 {{(pid=73449) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 11:40:14 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-fadea91d-ec15-4883-af67-361746e8add5 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Acquiring lock "refresh_cache-a3523d22-7165-46ad-be10-5e6ae374f91d" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:40:14 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-fadea91d-ec15-4883-af67-361746e8add5 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Acquired lock "refresh_cache-a3523d22-7165-46ad-be10-5e6ae374f91d" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:40:14 user nova-compute[73449]: DEBUG nova.network.neutron [None req-fadea91d-ec15-4883-af67-361746e8add5 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Building network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 11:40:14 user nova-compute[73449]: DEBUG nova.network.neutron [None req-fadea91d-ec15-4883-af67-361746e8add5 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Instance cache missing network info. {{(pid=73449) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 11:40:14 user nova-compute[73449]: DEBUG nova.compute.manager [req-9907eff3-36e3-4a88-adb0-3947897eb256 req-f370a15c-c9aa-472d-9725-08524a882456 service nova] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Received event network-changed-2a0eb61f-9398-4db6-9ae0-f142ad2e60c4 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:40:14 user nova-compute[73449]: DEBUG nova.compute.manager [req-9907eff3-36e3-4a88-adb0-3947897eb256 req-f370a15c-c9aa-472d-9725-08524a882456 service nova] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Refreshing instance network info cache due to event network-changed-2a0eb61f-9398-4db6-9ae0-f142ad2e60c4. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 11:40:14 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-9907eff3-36e3-4a88-adb0-3947897eb256 req-f370a15c-c9aa-472d-9725-08524a882456 service nova] Acquiring lock "refresh_cache-a3523d22-7165-46ad-be10-5e6ae374f91d" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:40:15 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692272415.2694693, 4a9e8ad2-19db-4975-87e4-2efce603a7d7 => Resumed> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:40:15 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 4a9e8ad2-19db-4975-87e4-2efce603a7d7] VM Resumed (Lifecycle Event)
Aug 17 11:40:15 user nova-compute[73449]: DEBUG nova.compute.manager [None req-95055937-9f5f-4721-b781-11bb31f51c2f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: 4a9e8ad2-19db-4975-87e4-2efce603a7d7] Instance event wait completed in 0 seconds for  {{(pid=73449) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 11:40:15 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-95055937-9f5f-4721-b781-11bb31f51c2f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: 4a9e8ad2-19db-4975-87e4-2efce603a7d7] Guest created on hypervisor {{(pid=73449) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 11:40:15 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: 4a9e8ad2-19db-4975-87e4-2efce603a7d7] Instance spawned successfully.
Aug 17 11:40:15 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-95055937-9f5f-4721-b781-11bb31f51c2f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: 4a9e8ad2-19db-4975-87e4-2efce603a7d7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 11:40:15 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 4a9e8ad2-19db-4975-87e4-2efce603a7d7] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:40:15 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 4a9e8ad2-19db-4975-87e4-2efce603a7d7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 11:40:15 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-95055937-9f5f-4721-b781-11bb31f51c2f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: 4a9e8ad2-19db-4975-87e4-2efce603a7d7] Found default for hw_cdrom_bus of ide {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:40:15 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-95055937-9f5f-4721-b781-11bb31f51c2f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: 4a9e8ad2-19db-4975-87e4-2efce603a7d7] Found default for hw_disk_bus of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:40:15 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-95055937-9f5f-4721-b781-11bb31f51c2f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: 4a9e8ad2-19db-4975-87e4-2efce603a7d7] Found default for hw_input_bus of None {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:40:15 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-95055937-9f5f-4721-b781-11bb31f51c2f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: 4a9e8ad2-19db-4975-87e4-2efce603a7d7] Found default for hw_pointer_model of None {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:40:15 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-95055937-9f5f-4721-b781-11bb31f51c2f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: 4a9e8ad2-19db-4975-87e4-2efce603a7d7] Found default for hw_video_model of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:40:15 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-95055937-9f5f-4721-b781-11bb31f51c2f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: 4a9e8ad2-19db-4975-87e4-2efce603a7d7] Found default for hw_vif_model of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:40:15 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 4a9e8ad2-19db-4975-87e4-2efce603a7d7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 11:40:15 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692272415.282054, 4a9e8ad2-19db-4975-87e4-2efce603a7d7 => Started> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:40:15 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 4a9e8ad2-19db-4975-87e4-2efce603a7d7] VM Started (Lifecycle Event)
Aug 17 11:40:15 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:40:15 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 4a9e8ad2-19db-4975-87e4-2efce603a7d7] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:40:15 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:40:15 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 4a9e8ad2-19db-4975-87e4-2efce603a7d7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 11:40:15 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:40:15 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 4a9e8ad2-19db-4975-87e4-2efce603a7d7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 11:40:15 user nova-compute[73449]: INFO nova.compute.manager [None req-95055937-9f5f-4721-b781-11bb31f51c2f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: 4a9e8ad2-19db-4975-87e4-2efce603a7d7] Took 11.62 seconds to spawn the instance on the hypervisor.
Aug 17 11:40:15 user nova-compute[73449]: DEBUG nova.compute.manager [None req-95055937-9f5f-4721-b781-11bb31f51c2f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: 4a9e8ad2-19db-4975-87e4-2efce603a7d7] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:40:15 user nova-compute[73449]: INFO nova.compute.manager [None req-95055937-9f5f-4721-b781-11bb31f51c2f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: 4a9e8ad2-19db-4975-87e4-2efce603a7d7] Took 12.48 seconds to build instance.
Aug 17 11:40:15 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-95055937-9f5f-4721-b781-11bb31f51c2f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Lock "4a9e8ad2-19db-4975-87e4-2efce603a7d7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.709s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:40:15 user nova-compute[73449]: DEBUG nova.network.neutron [None req-fadea91d-ec15-4883-af67-361746e8add5 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Updating instance_info_cache with network_info: [{"id": "2a0eb61f-9398-4db6-9ae0-f142ad2e60c4", "address": "fa:16:3e:15:cd:09", "network": {"id": "d54a402f-1fa9-43d8-b68e-0aa7ae6f0e73", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1441085328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eed9899860d4e7ca8a4500bbda4be13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a0eb61f-93", "ovs_interfaceid": "2a0eb61f-9398-4db6-9ae0-f142ad2e60c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:40:15 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-fadea91d-ec15-4883-af67-361746e8add5 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Releasing lock "refresh_cache-a3523d22-7165-46ad-be10-5e6ae374f91d" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:40:15 user nova-compute[73449]: DEBUG nova.compute.manager [None req-fadea91d-ec15-4883-af67-361746e8add5 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Instance network_info: |[{"id": "2a0eb61f-9398-4db6-9ae0-f142ad2e60c4", "address": "fa:16:3e:15:cd:09", "network": {"id": "d54a402f-1fa9-43d8-b68e-0aa7ae6f0e73", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1441085328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eed9899860d4e7ca8a4500bbda4be13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a0eb61f-93", "ovs_interfaceid": "2a0eb61f-9398-4db6-9ae0-f142ad2e60c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73449) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 11:40:15 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-9907eff3-36e3-4a88-adb0-3947897eb256 req-f370a15c-c9aa-472d-9725-08524a882456 service nova] Acquired lock "refresh_cache-a3523d22-7165-46ad-be10-5e6ae374f91d" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:40:15 user nova-compute[73449]: DEBUG nova.network.neutron [req-9907eff3-36e3-4a88-adb0-3947897eb256 req-f370a15c-c9aa-472d-9725-08524a882456 service nova] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Refreshing network info cache for port 2a0eb61f-9398-4db6-9ae0-f142ad2e60c4 {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 11:40:15 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-fadea91d-ec15-4883-af67-361746e8add5 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Start _get_guest_xml network_info=[{"id": "2a0eb61f-9398-4db6-9ae0-f142ad2e60c4", "address": "fa:16:3e:15:cd:09", "network": {"id": "d54a402f-1fa9-43d8-b68e-0aa7ae6f0e73", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1441085328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eed9899860d4e7ca8a4500bbda4be13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a0eb61f-93", "ovs_interfaceid": "2a0eb61f-9398-4db6-9ae0-f142ad2e60c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T11:36:11Z,direct_url=<?>,disk_format='qcow2',id=0a2904ae-083d-41c8-83db-343132b36148,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7a77880136a54ef195c82e018e1939db',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T11:36:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': '0a2904ae-083d-41c8-83db-343132b36148'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 11:40:15 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-fadea91d-ec15-4883-af67-361746e8add5 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:40:15 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-fadea91d-ec15-4883-af67-361746e8add5 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:40:15 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:40:15 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-fadea91d-ec15-4883-af67-361746e8add5 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 11:40:15 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-fadea91d-ec15-4883-af67-361746e8add5 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] CPU controller missing on host. {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 11:40:15 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-fadea91d-ec15-4883-af67-361746e8add5 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 11:40:15 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-fadea91d-ec15-4883-af67-361746e8add5 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] CPU controller found on host. {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 11:40:15 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-fadea91d-ec15-4883-af67-361746e8add5 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73449) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 11:40:15 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-fadea91d-ec15-4883-af67-361746e8add5 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T11:35:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T11:36:11Z,direct_url=<?>,disk_format='qcow2',id=0a2904ae-083d-41c8-83db-343132b36148,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7a77880136a54ef195c82e018e1939db',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T11:36:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 11:40:15 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-fadea91d-ec15-4883-af67-361746e8add5 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Flavor limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 11:40:15 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-fadea91d-ec15-4883-af67-361746e8add5 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Image limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 11:40:15 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-fadea91d-ec15-4883-af67-361746e8add5 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Flavor pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 11:40:15 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-fadea91d-ec15-4883-af67-361746e8add5 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Image pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 11:40:15 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-fadea91d-ec15-4883-af67-361746e8add5 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 11:40:15 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-fadea91d-ec15-4883-af67-361746e8add5 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 11:40:15 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-fadea91d-ec15-4883-af67-361746e8add5 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 11:40:15 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-fadea91d-ec15-4883-af67-361746e8add5 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Got 1 possible topologies {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 11:40:15 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-fadea91d-ec15-4883-af67-361746e8add5 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 11:40:15 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-fadea91d-ec15-4883-af67-361746e8add5 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 11:40:15 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-fadea91d-ec15-4883-af67-361746e8add5 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:40:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1694310922',display_name='tempest-ServerStableDeviceRescueTest-server-1694310922',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1694310922',id=3,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHtRTrQb6UH8zrb1TbmYhNcUUKT9x8E5WNd+hiFJcSJTxxGQa8gp0XBdyZFjt5NbH6w45uBC2lCrVZUblWmjSKUPuTRaSHQWpvcVWlL40C4ztfmmZssisFEp6QhzuuUl/g==',key_name='tempest-keypair-75432170',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9eed9899860d4e7ca8a4500bbda4be13',ramdisk_id='',reservation_id='r-rl7fxx5l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-2093936836',owner_user_name='tempest-ServerStableDeviceRescueTest-2093936836-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T11:40:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d01f62699d2648cfa940fd73d9a82dbe',uuid=a3523d22-7165-46ad-be10-5e6ae374f91d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2a0eb61f-9398-4db6-9ae0-f142ad2e60c4", "address": "fa:16:3e:15:cd:09", "network": {"id": "d54a402f-1fa9-43d8-b68e-0aa7ae6f0e73", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1441085328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eed9899860d4e7ca8a4500bbda4be13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a0eb61f-93", "ovs_interfaceid": "2a0eb61f-9398-4db6-9ae0-f142ad2e60c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73449) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 11:40:15 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-fadea91d-ec15-4883-af67-361746e8add5 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Converting VIF {"id": "2a0eb61f-9398-4db6-9ae0-f142ad2e60c4", "address": "fa:16:3e:15:cd:09", "network": {"id": "d54a402f-1fa9-43d8-b68e-0aa7ae6f0e73", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1441085328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eed9899860d4e7ca8a4500bbda4be13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a0eb61f-93", "ovs_interfaceid": "2a0eb61f-9398-4db6-9ae0-f142ad2e60c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:40:15 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-fadea91d-ec15-4883-af67-361746e8add5 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:cd:09,bridge_name='br-int',has_traffic_filtering=True,id=2a0eb61f-9398-4db6-9ae0-f142ad2e60c4,network=Network(d54a402f-1fa9-43d8-b68e-0aa7ae6f0e73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a0eb61f-93') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:40:15 user nova-compute[73449]: DEBUG nova.objects.instance [None req-fadea91d-ec15-4883-af67-361746e8add5 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Lazy-loading 'pci_devices' on Instance uuid a3523d22-7165-46ad-be10-5e6ae374f91d {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:40:15 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-fadea91d-ec15-4883-af67-361746e8add5 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] End _get_guest_xml xml=<domain type="kvm">
Aug 17 11:40:15 user nova-compute[73449]:   <uuid>a3523d22-7165-46ad-be10-5e6ae374f91d</uuid>
Aug 17 11:40:15 user nova-compute[73449]:   <name>instance-00000003</name>
Aug 17 11:40:15 user nova-compute[73449]:   <memory>524288</memory>
Aug 17 11:40:15 user nova-compute[73449]:   <vcpu>1</vcpu>
Aug 17 11:40:15 user nova-compute[73449]:   <metadata>
Aug 17 11:40:15 user nova-compute[73449]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 11:40:15 user nova-compute[73449]:       <nova:package version="0.0.0"/>
Aug 17 11:40:15 user nova-compute[73449]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1694310922</nova:name>
Aug 17 11:40:15 user nova-compute[73449]:       <nova:creationTime>2023-08-17 11:40:15</nova:creationTime>
Aug 17 11:40:15 user nova-compute[73449]:       <nova:flavor name="m1.tiny">
Aug 17 11:40:15 user nova-compute[73449]:         <nova:memory>512</nova:memory>
Aug 17 11:40:15 user nova-compute[73449]:         <nova:disk>1</nova:disk>
Aug 17 11:40:15 user nova-compute[73449]:         <nova:swap>0</nova:swap>
Aug 17 11:40:15 user nova-compute[73449]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 11:40:15 user nova-compute[73449]:         <nova:vcpus>1</nova:vcpus>
Aug 17 11:40:15 user nova-compute[73449]:       </nova:flavor>
Aug 17 11:40:15 user nova-compute[73449]:       <nova:owner>
Aug 17 11:40:15 user nova-compute[73449]:         <nova:user uuid="d01f62699d2648cfa940fd73d9a82dbe">tempest-ServerStableDeviceRescueTest-2093936836-project-member</nova:user>
Aug 17 11:40:15 user nova-compute[73449]:         <nova:project uuid="9eed9899860d4e7ca8a4500bbda4be13">tempest-ServerStableDeviceRescueTest-2093936836</nova:project>
Aug 17 11:40:15 user nova-compute[73449]:       </nova:owner>
Aug 17 11:40:15 user nova-compute[73449]:       <nova:root type="image" uuid="0a2904ae-083d-41c8-83db-343132b36148"/>
Aug 17 11:40:15 user nova-compute[73449]:       <nova:ports>
Aug 17 11:40:15 user nova-compute[73449]:         <nova:port uuid="2a0eb61f-9398-4db6-9ae0-f142ad2e60c4">
Aug 17 11:40:15 user nova-compute[73449]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 17 11:40:15 user nova-compute[73449]:         </nova:port>
Aug 17 11:40:15 user nova-compute[73449]:       </nova:ports>
Aug 17 11:40:15 user nova-compute[73449]:     </nova:instance>
Aug 17 11:40:15 user nova-compute[73449]:   </metadata>
Aug 17 11:40:15 user nova-compute[73449]:   <sysinfo type="smbios">
Aug 17 11:40:15 user nova-compute[73449]:     <system>
Aug 17 11:40:15 user nova-compute[73449]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 11:40:15 user nova-compute[73449]:       <entry name="product">OpenStack Nova</entry>
Aug 17 11:40:15 user nova-compute[73449]:       <entry name="version">0.0.0</entry>
Aug 17 11:40:15 user nova-compute[73449]:       <entry name="serial">a3523d22-7165-46ad-be10-5e6ae374f91d</entry>
Aug 17 11:40:15 user nova-compute[73449]:       <entry name="uuid">a3523d22-7165-46ad-be10-5e6ae374f91d</entry>
Aug 17 11:40:15 user nova-compute[73449]:       <entry name="family">Virtual Machine</entry>
Aug 17 11:40:15 user nova-compute[73449]:     </system>
Aug 17 11:40:15 user nova-compute[73449]:   </sysinfo>
Aug 17 11:40:15 user nova-compute[73449]:   <os>
Aug 17 11:40:15 user nova-compute[73449]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 11:40:15 user nova-compute[73449]:     <boot dev="hd"/>
Aug 17 11:40:15 user nova-compute[73449]:     <smbios mode="sysinfo"/>
Aug 17 11:40:15 user nova-compute[73449]:   </os>
Aug 17 11:40:15 user nova-compute[73449]:   <features>
Aug 17 11:40:15 user nova-compute[73449]:     <acpi/>
Aug 17 11:40:15 user nova-compute[73449]:     <apic/>
Aug 17 11:40:15 user nova-compute[73449]:     <vmcoreinfo/>
Aug 17 11:40:15 user nova-compute[73449]:   </features>
Aug 17 11:40:15 user nova-compute[73449]:   <clock offset="utc">
Aug 17 11:40:15 user nova-compute[73449]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 11:40:15 user nova-compute[73449]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 11:40:15 user nova-compute[73449]:     <timer name="hpet" present="no"/>
Aug 17 11:40:15 user nova-compute[73449]:   </clock>
Aug 17 11:40:15 user nova-compute[73449]:   <cpu mode="custom" match="exact">
Aug 17 11:40:15 user nova-compute[73449]:     <model>Nehalem</model>
Aug 17 11:40:15 user nova-compute[73449]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 11:40:15 user nova-compute[73449]:   </cpu>
Aug 17 11:40:15 user nova-compute[73449]:   <devices>
Aug 17 11:40:15 user nova-compute[73449]:     <disk type="file" device="disk">
Aug 17 11:40:15 user nova-compute[73449]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 11:40:15 user nova-compute[73449]:       <source file="/opt/stack/data/nova/instances/a3523d22-7165-46ad-be10-5e6ae374f91d/disk"/>
Aug 17 11:40:15 user nova-compute[73449]:       <target dev="vda" bus="virtio"/>
Aug 17 11:40:15 user nova-compute[73449]:     </disk>
Aug 17 11:40:15 user nova-compute[73449]:     <interface type="ethernet">
Aug 17 11:40:15 user nova-compute[73449]:       <mac address="fa:16:3e:15:cd:09"/>
Aug 17 11:40:15 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 11:40:15 user nova-compute[73449]:       <mtu size="1442"/>
Aug 17 11:40:15 user nova-compute[73449]:       <target dev="tap2a0eb61f-93"/>
Aug 17 11:40:15 user nova-compute[73449]:     </interface>
Aug 17 11:40:15 user nova-compute[73449]:     <serial type="pty">
Aug 17 11:40:15 user nova-compute[73449]:       <log file="/opt/stack/data/nova/instances/a3523d22-7165-46ad-be10-5e6ae374f91d/console.log" append="off"/>
Aug 17 11:40:15 user nova-compute[73449]:     </serial>
Aug 17 11:40:15 user nova-compute[73449]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 11:40:15 user nova-compute[73449]:     <video>
Aug 17 11:40:15 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 11:40:15 user nova-compute[73449]:     </video>
Aug 17 11:40:15 user nova-compute[73449]:     <rng model="virtio">
Aug 17 11:40:15 user nova-compute[73449]:       <backend model="random">/dev/urandom</backend>
Aug 17 11:40:15 user nova-compute[73449]:     </rng>
Aug 17 11:40:15 user nova-compute[73449]:     <controller type="usb" index="0" model="none"/>
Aug 17 11:40:15 user nova-compute[73449]:     <memballoon model="virtio">
Aug 17 11:40:15 user nova-compute[73449]:       <stats period="10"/>
Aug 17 11:40:15 user nova-compute[73449]:     </memballoon>
Aug 17 11:40:15 user nova-compute[73449]:   </devices>
Aug 17 11:40:15 user nova-compute[73449]: </domain>
Aug 17 11:40:15 user nova-compute[73449]:  {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 11:40:15 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-fadea91d-ec15-4883-af67-361746e8add5 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:40:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1694310922',display_name='tempest-ServerStableDeviceRescueTest-server-1694310922',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1694310922',id=3,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHtRTrQb6UH8zrb1TbmYhNcUUKT9x8E5WNd+hiFJcSJTxxGQa8gp0XBdyZFjt5NbH6w45uBC2lCrVZUblWmjSKUPuTRaSHQWpvcVWlL40C4ztfmmZssisFEp6QhzuuUl/g==',key_name='tempest-keypair-75432170',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9eed9899860d4e7ca8a4500bbda4be13',ramdisk_id='',reservation_id='r-rl7fxx5l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-2093936836',owner_user_name='tempest-ServerStableDeviceRescueTest-2093936836-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T11:40:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d01f62699d2648cfa940fd73d9a82dbe',uuid=a3523d22-7165-46ad-be10-5e6ae374f91d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2a0eb61f-9398-4db6-9ae0-f142ad2e60c4", "address": "fa:16:3e:15:cd:09", "network": {"id": "d54a402f-1fa9-43d8-b68e-0aa7ae6f0e73", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1441085328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eed9899860d4e7ca8a4500bbda4be13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a0eb61f-93", "ovs_interfaceid": "2a0eb61f-9398-4db6-9ae0-f142ad2e60c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 11:40:15 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-fadea91d-ec15-4883-af67-361746e8add5 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Converting VIF {"id": "2a0eb61f-9398-4db6-9ae0-f142ad2e60c4", "address": "fa:16:3e:15:cd:09", "network": {"id": "d54a402f-1fa9-43d8-b68e-0aa7ae6f0e73", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1441085328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eed9899860d4e7ca8a4500bbda4be13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a0eb61f-93", "ovs_interfaceid": "2a0eb61f-9398-4db6-9ae0-f142ad2e60c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:40:15 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-fadea91d-ec15-4883-af67-361746e8add5 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:cd:09,bridge_name='br-int',has_traffic_filtering=True,id=2a0eb61f-9398-4db6-9ae0-f142ad2e60c4,network=Network(d54a402f-1fa9-43d8-b68e-0aa7ae6f0e73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a0eb61f-93') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:40:15 user nova-compute[73449]: DEBUG os_vif [None req-fadea91d-ec15-4883-af67-361746e8add5 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:cd:09,bridge_name='br-int',has_traffic_filtering=True,id=2a0eb61f-9398-4db6-9ae0-f142ad2e60c4,network=Network(d54a402f-1fa9-43d8-b68e-0aa7ae6f0e73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a0eb61f-93') {{(pid=73449) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 11:40:15 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:40:15 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:40:15 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 11:40:15 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:40:15 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2a0eb61f-93, may_exist=True, interface_attrs={}) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:40:15 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2a0eb61f-93, col_values=(('external_ids', {'iface-id': '2a0eb61f-9398-4db6-9ae0-f142ad2e60c4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:15:cd:09', 'vm-uuid': 'a3523d22-7165-46ad-be10-5e6ae374f91d'}),), if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:40:15 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:40:15 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:40:15 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:40:15 user nova-compute[73449]: INFO os_vif [None req-fadea91d-ec15-4883-af67-361746e8add5 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:cd:09,bridge_name='br-int',has_traffic_filtering=True,id=2a0eb61f-9398-4db6-9ae0-f142ad2e60c4,network=Network(d54a402f-1fa9-43d8-b68e-0aa7ae6f0e73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a0eb61f-93')
Aug 17 11:40:16 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-fadea91d-ec15-4883-af67-361746e8add5 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] No BDM found with device name vda, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 11:40:16 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-fadea91d-ec15-4883-af67-361746e8add5 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] No VIF found with MAC fa:16:3e:15:cd:09, not building metadata {{(pid=73449) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 11:40:16 user nova-compute[73449]: DEBUG nova.compute.manager [req-e045ac8d-bdd8-413f-b04a-6d8b9770e4e6 req-32b923a4-6e22-4bc5-940f-533608a7bfab service nova] [instance: a40e1f85-a7e6-46da-8f98-df7a278aaade] Received event network-vif-plugged-6f565f5b-de2a-4190-86fd-0d2606a9c5e9 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:40:16 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-e045ac8d-bdd8-413f-b04a-6d8b9770e4e6 req-32b923a4-6e22-4bc5-940f-533608a7bfab service nova] Acquiring lock "a40e1f85-a7e6-46da-8f98-df7a278aaade-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:40:16 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-e045ac8d-bdd8-413f-b04a-6d8b9770e4e6 req-32b923a4-6e22-4bc5-940f-533608a7bfab service nova] Lock "a40e1f85-a7e6-46da-8f98-df7a278aaade-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:40:16 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-e045ac8d-bdd8-413f-b04a-6d8b9770e4e6 req-32b923a4-6e22-4bc5-940f-533608a7bfab service nova] Lock "a40e1f85-a7e6-46da-8f98-df7a278aaade-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:40:16 user nova-compute[73449]: DEBUG nova.compute.manager [req-e045ac8d-bdd8-413f-b04a-6d8b9770e4e6 req-32b923a4-6e22-4bc5-940f-533608a7bfab service nova] [instance: a40e1f85-a7e6-46da-8f98-df7a278aaade] No waiting events found dispatching network-vif-plugged-6f565f5b-de2a-4190-86fd-0d2606a9c5e9 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:40:16 user nova-compute[73449]: WARNING nova.compute.manager [req-e045ac8d-bdd8-413f-b04a-6d8b9770e4e6 req-32b923a4-6e22-4bc5-940f-533608a7bfab service nova] [instance: a40e1f85-a7e6-46da-8f98-df7a278aaade] Received unexpected event network-vif-plugged-6f565f5b-de2a-4190-86fd-0d2606a9c5e9 for instance with vm_state active and task_state None.
Aug 17 11:40:16 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:40:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:40:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:40:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:40:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:40:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:40:17 user nova-compute[73449]: DEBUG nova.network.neutron [req-9907eff3-36e3-4a88-adb0-3947897eb256 req-f370a15c-c9aa-472d-9725-08524a882456 service nova] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Updated VIF entry in instance network info cache for port 2a0eb61f-9398-4db6-9ae0-f142ad2e60c4. {{(pid=73449) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 11:40:17 user nova-compute[73449]: DEBUG nova.network.neutron [req-9907eff3-36e3-4a88-adb0-3947897eb256 req-f370a15c-c9aa-472d-9725-08524a882456 service nova] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Updating instance_info_cache with network_info: [{"id": "2a0eb61f-9398-4db6-9ae0-f142ad2e60c4", "address": "fa:16:3e:15:cd:09", "network": {"id": "d54a402f-1fa9-43d8-b68e-0aa7ae6f0e73", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1441085328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eed9899860d4e7ca8a4500bbda4be13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a0eb61f-93", "ovs_interfaceid": "2a0eb61f-9398-4db6-9ae0-f142ad2e60c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:40:18 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-9907eff3-36e3-4a88-adb0-3947897eb256 req-f370a15c-c9aa-472d-9725-08524a882456 service nova] Releasing lock "refresh_cache-a3523d22-7165-46ad-be10-5e6ae374f91d" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:40:18 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:40:18 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:40:18 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:40:18 user nova-compute[73449]: DEBUG nova.compute.manager [req-a3daa59f-b4bf-4386-818e-69f3a5fda556 req-58660372-a35c-4daa-b9be-aec1c9bbbcc8 service nova] [instance: a40e1f85-a7e6-46da-8f98-df7a278aaade] Received event network-vif-plugged-6f565f5b-de2a-4190-86fd-0d2606a9c5e9 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:40:18 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-a3daa59f-b4bf-4386-818e-69f3a5fda556 req-58660372-a35c-4daa-b9be-aec1c9bbbcc8 service nova] Acquiring lock "a40e1f85-a7e6-46da-8f98-df7a278aaade-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:40:18 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-a3daa59f-b4bf-4386-818e-69f3a5fda556 req-58660372-a35c-4daa-b9be-aec1c9bbbcc8 service nova] Lock "a40e1f85-a7e6-46da-8f98-df7a278aaade-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:40:18 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-a3daa59f-b4bf-4386-818e-69f3a5fda556 req-58660372-a35c-4daa-b9be-aec1c9bbbcc8 service nova] Lock "a40e1f85-a7e6-46da-8f98-df7a278aaade-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:40:18 user nova-compute[73449]: DEBUG nova.compute.manager [req-a3daa59f-b4bf-4386-818e-69f3a5fda556 req-58660372-a35c-4daa-b9be-aec1c9bbbcc8 service nova] [instance: a40e1f85-a7e6-46da-8f98-df7a278aaade] No waiting events found dispatching network-vif-plugged-6f565f5b-de2a-4190-86fd-0d2606a9c5e9 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:40:18 user nova-compute[73449]: WARNING nova.compute.manager [req-a3daa59f-b4bf-4386-818e-69f3a5fda556 req-58660372-a35c-4daa-b9be-aec1c9bbbcc8 service nova] [instance: a40e1f85-a7e6-46da-8f98-df7a278aaade] Received unexpected event network-vif-plugged-6f565f5b-de2a-4190-86fd-0d2606a9c5e9 for instance with vm_state active and task_state None.
Aug 17 11:40:18 user nova-compute[73449]: DEBUG nova.compute.manager [req-a3daa59f-b4bf-4386-818e-69f3a5fda556 req-58660372-a35c-4daa-b9be-aec1c9bbbcc8 service nova] [instance: 4a9e8ad2-19db-4975-87e4-2efce603a7d7] Received event network-vif-plugged-3c5f8e97-0654-42f0-9575-eab6d833283a {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:40:18 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-a3daa59f-b4bf-4386-818e-69f3a5fda556 req-58660372-a35c-4daa-b9be-aec1c9bbbcc8 service nova] Acquiring lock "4a9e8ad2-19db-4975-87e4-2efce603a7d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:40:18 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-a3daa59f-b4bf-4386-818e-69f3a5fda556 req-58660372-a35c-4daa-b9be-aec1c9bbbcc8 service nova] Lock "4a9e8ad2-19db-4975-87e4-2efce603a7d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:40:18 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-a3daa59f-b4bf-4386-818e-69f3a5fda556 req-58660372-a35c-4daa-b9be-aec1c9bbbcc8 service nova] Lock "4a9e8ad2-19db-4975-87e4-2efce603a7d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:40:18 user nova-compute[73449]: DEBUG nova.compute.manager [req-a3daa59f-b4bf-4386-818e-69f3a5fda556 req-58660372-a35c-4daa-b9be-aec1c9bbbcc8 service nova] [instance: 4a9e8ad2-19db-4975-87e4-2efce603a7d7] No waiting events found dispatching network-vif-plugged-3c5f8e97-0654-42f0-9575-eab6d833283a {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:40:18 user nova-compute[73449]: WARNING nova.compute.manager [req-a3daa59f-b4bf-4386-818e-69f3a5fda556 req-58660372-a35c-4daa-b9be-aec1c9bbbcc8 service nova] [instance: 4a9e8ad2-19db-4975-87e4-2efce603a7d7] Received unexpected event network-vif-plugged-3c5f8e97-0654-42f0-9575-eab6d833283a for instance with vm_state active and task_state None.
Aug 17 11:40:19 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:40:19 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:40:19 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:40:20 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:40:21 user nova-compute[73449]: DEBUG nova.compute.manager [req-244b9de8-e010-47e0-b100-2b4f64d6b206 req-daf04e1b-7c0a-4097-be5f-a77f1ac9240c service nova] [instance: 4a9e8ad2-19db-4975-87e4-2efce603a7d7] Received event network-vif-plugged-3c5f8e97-0654-42f0-9575-eab6d833283a {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:40:21 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-244b9de8-e010-47e0-b100-2b4f64d6b206 req-daf04e1b-7c0a-4097-be5f-a77f1ac9240c service nova] Acquiring lock "4a9e8ad2-19db-4975-87e4-2efce603a7d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:40:21 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-244b9de8-e010-47e0-b100-2b4f64d6b206 req-daf04e1b-7c0a-4097-be5f-a77f1ac9240c service nova] Lock "4a9e8ad2-19db-4975-87e4-2efce603a7d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:40:21 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-244b9de8-e010-47e0-b100-2b4f64d6b206 req-daf04e1b-7c0a-4097-be5f-a77f1ac9240c service nova] Lock "4a9e8ad2-19db-4975-87e4-2efce603a7d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:40:21 user nova-compute[73449]: DEBUG nova.compute.manager [req-244b9de8-e010-47e0-b100-2b4f64d6b206 req-daf04e1b-7c0a-4097-be5f-a77f1ac9240c service nova] [instance: 4a9e8ad2-19db-4975-87e4-2efce603a7d7] No waiting events found dispatching network-vif-plugged-3c5f8e97-0654-42f0-9575-eab6d833283a {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:40:21 user nova-compute[73449]: WARNING nova.compute.manager [req-244b9de8-e010-47e0-b100-2b4f64d6b206 req-daf04e1b-7c0a-4097-be5f-a77f1ac9240c service nova] [instance: 4a9e8ad2-19db-4975-87e4-2efce603a7d7] Received unexpected event network-vif-plugged-3c5f8e97-0654-42f0-9575-eab6d833283a for instance with vm_state active and task_state None.
Aug 17 11:40:21 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692272421.128105, a3523d22-7165-46ad-be10-5e6ae374f91d => Resumed> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:40:21 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] VM Resumed (Lifecycle Event)
Aug 17 11:40:21 user nova-compute[73449]: DEBUG nova.compute.manager [None req-fadea91d-ec15-4883-af67-361746e8add5 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Instance event wait completed in 0 seconds for  {{(pid=73449) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 11:40:21 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-fadea91d-ec15-4883-af67-361746e8add5 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Guest created on hypervisor {{(pid=73449) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 11:40:21 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Instance spawned successfully.
Aug 17 11:40:21 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-fadea91d-ec15-4883-af67-361746e8add5 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 11:40:21 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:40:21 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 11:40:21 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-fadea91d-ec15-4883-af67-361746e8add5 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Found default for hw_cdrom_bus of ide {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:40:21 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-fadea91d-ec15-4883-af67-361746e8add5 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Found default for hw_disk_bus of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:40:21 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-fadea91d-ec15-4883-af67-361746e8add5 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Found default for hw_input_bus of None {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:40:21 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-fadea91d-ec15-4883-af67-361746e8add5 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Found default for hw_pointer_model of None {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:40:21 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-fadea91d-ec15-4883-af67-361746e8add5 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Found default for hw_video_model of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:40:21 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-fadea91d-ec15-4883-af67-361746e8add5 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Found default for hw_vif_model of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:40:21 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 11:40:21 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692272421.1352036, a3523d22-7165-46ad-be10-5e6ae374f91d => Started> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:40:21 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] VM Started (Lifecycle Event)
Aug 17 11:40:21 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:40:21 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:40:21 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 11:40:21 user nova-compute[73449]: INFO nova.compute.manager [None req-fadea91d-ec15-4883-af67-361746e8add5 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Took 13.83 seconds to spawn the instance on the hypervisor.
Aug 17 11:40:21 user nova-compute[73449]: DEBUG nova.compute.manager [None req-fadea91d-ec15-4883-af67-361746e8add5 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:40:21 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 11:40:21 user nova-compute[73449]: INFO nova.compute.manager [None req-fadea91d-ec15-4883-af67-361746e8add5 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Took 14.71 seconds to build instance.
Aug 17 11:40:21 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-fadea91d-ec15-4883-af67-361746e8add5 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Lock "a3523d22-7165-46ad-be10-5e6ae374f91d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.840s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:40:21 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:40:22 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-bf3d7343-b9cc-4601-8a01-17b3e65861ba tempest-VolumesAssistedSnapshotsTest-410166037 tempest-VolumesAssistedSnapshotsTest-410166037-project-member] Acquiring lock "fd8d4549-db8f-4c74-8706-8ac21f049c2e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:40:22 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-bf3d7343-b9cc-4601-8a01-17b3e65861ba tempest-VolumesAssistedSnapshotsTest-410166037 tempest-VolumesAssistedSnapshotsTest-410166037-project-member] Lock "fd8d4549-db8f-4c74-8706-8ac21f049c2e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:40:22 user nova-compute[73449]: DEBUG nova.compute.manager [None req-bf3d7343-b9cc-4601-8a01-17b3e65861ba tempest-VolumesAssistedSnapshotsTest-410166037 tempest-VolumesAssistedSnapshotsTest-410166037-project-member] [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e] Starting instance... {{(pid=73449) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 11:40:22 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-bf3d7343-b9cc-4601-8a01-17b3e65861ba tempest-VolumesAssistedSnapshotsTest-410166037 tempest-VolumesAssistedSnapshotsTest-410166037-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:40:22 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-bf3d7343-b9cc-4601-8a01-17b3e65861ba tempest-VolumesAssistedSnapshotsTest-410166037 tempest-VolumesAssistedSnapshotsTest-410166037-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:40:22 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-bf3d7343-b9cc-4601-8a01-17b3e65861ba tempest-VolumesAssistedSnapshotsTest-410166037 tempest-VolumesAssistedSnapshotsTest-410166037-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73449) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 11:40:22 user nova-compute[73449]: INFO nova.compute.claims [None req-bf3d7343-b9cc-4601-8a01-17b3e65861ba tempest-VolumesAssistedSnapshotsTest-410166037 tempest-VolumesAssistedSnapshotsTest-410166037-project-member] [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e] Claim successful on node user
Aug 17 11:40:22 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-bf3d7343-b9cc-4601-8a01-17b3e65861ba tempest-VolumesAssistedSnapshotsTest-410166037 tempest-VolumesAssistedSnapshotsTest-410166037-project-member] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 11:40:22 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-bf3d7343-b9cc-4601-8a01-17b3e65861ba tempest-VolumesAssistedSnapshotsTest-410166037 tempest-VolumesAssistedSnapshotsTest-410166037-project-member] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 11:40:22 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-bf3d7343-b9cc-4601-8a01-17b3e65861ba tempest-VolumesAssistedSnapshotsTest-410166037 tempest-VolumesAssistedSnapshotsTest-410166037-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.444s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:40:22 user nova-compute[73449]: DEBUG nova.compute.manager [None req-bf3d7343-b9cc-4601-8a01-17b3e65861ba tempest-VolumesAssistedSnapshotsTest-410166037 tempest-VolumesAssistedSnapshotsTest-410166037-project-member] [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e] Start building networks asynchronously for instance. {{(pid=73449) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 11:40:22 user nova-compute[73449]: DEBUG nova.compute.manager [None req-bf3d7343-b9cc-4601-8a01-17b3e65861ba tempest-VolumesAssistedSnapshotsTest-410166037 tempest-VolumesAssistedSnapshotsTest-410166037-project-member] [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e] Allocating IP information in the background. {{(pid=73449) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 11:40:22 user nova-compute[73449]: DEBUG nova.network.neutron [None req-bf3d7343-b9cc-4601-8a01-17b3e65861ba tempest-VolumesAssistedSnapshotsTest-410166037 tempest-VolumesAssistedSnapshotsTest-410166037-project-member] [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e] allocate_for_instance() {{(pid=73449) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 11:40:22 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-bf3d7343-b9cc-4601-8a01-17b3e65861ba tempest-VolumesAssistedSnapshotsTest-410166037 tempest-VolumesAssistedSnapshotsTest-410166037-project-member] [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 11:40:22 user nova-compute[73449]: DEBUG nova.compute.manager [None req-bf3d7343-b9cc-4601-8a01-17b3e65861ba tempest-VolumesAssistedSnapshotsTest-410166037 tempest-VolumesAssistedSnapshotsTest-410166037-project-member] [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e] Start building block device mappings for instance. {{(pid=73449) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 11:40:22 user nova-compute[73449]: DEBUG nova.policy [None req-bf3d7343-b9cc-4601-8a01-17b3e65861ba tempest-VolumesAssistedSnapshotsTest-410166037 tempest-VolumesAssistedSnapshotsTest-410166037-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '72d21423ba884ca4845bc2782f7e2e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93aebc1246f34b81a883a70dd6e6e7f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73449) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 11:40:23 user nova-compute[73449]: DEBUG nova.compute.manager [None req-bf3d7343-b9cc-4601-8a01-17b3e65861ba tempest-VolumesAssistedSnapshotsTest-410166037 tempest-VolumesAssistedSnapshotsTest-410166037-project-member] [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e] Start spawning the instance on the hypervisor. {{(pid=73449) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 11:40:23 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-bf3d7343-b9cc-4601-8a01-17b3e65861ba tempest-VolumesAssistedSnapshotsTest-410166037 tempest-VolumesAssistedSnapshotsTest-410166037-project-member] [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e] Creating instance directory {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 11:40:23 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-bf3d7343-b9cc-4601-8a01-17b3e65861ba tempest-VolumesAssistedSnapshotsTest-410166037 tempest-VolumesAssistedSnapshotsTest-410166037-project-member] [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e] Creating image(s)
Aug 17 11:40:23 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-bf3d7343-b9cc-4601-8a01-17b3e65861ba tempest-VolumesAssistedSnapshotsTest-410166037 tempest-VolumesAssistedSnapshotsTest-410166037-project-member] Acquiring lock "/opt/stack/data/nova/instances/fd8d4549-db8f-4c74-8706-8ac21f049c2e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:40:23 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-bf3d7343-b9cc-4601-8a01-17b3e65861ba tempest-VolumesAssistedSnapshotsTest-410166037 tempest-VolumesAssistedSnapshotsTest-410166037-project-member] Lock "/opt/stack/data/nova/instances/fd8d4549-db8f-4c74-8706-8ac21f049c2e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:40:23 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-bf3d7343-b9cc-4601-8a01-17b3e65861ba tempest-VolumesAssistedSnapshotsTest-410166037 tempest-VolumesAssistedSnapshotsTest-410166037-project-member] Lock "/opt/stack/data/nova/instances/fd8d4549-db8f-4c74-8706-8ac21f049c2e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:40:23 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-bf3d7343-b9cc-4601-8a01-17b3e65861ba tempest-VolumesAssistedSnapshotsTest-410166037 tempest-VolumesAssistedSnapshotsTest-410166037-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:40:23 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-bf3d7343-b9cc-4601-8a01-17b3e65861ba tempest-VolumesAssistedSnapshotsTest-410166037 tempest-VolumesAssistedSnapshotsTest-410166037-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json" returned: 0 in 0.278s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:40:23 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-bf3d7343-b9cc-4601-8a01-17b3e65861ba tempest-VolumesAssistedSnapshotsTest-410166037 tempest-VolumesAssistedSnapshotsTest-410166037-project-member] Acquiring lock "7e267a577c062ee862e95ede6b48cfd5632f3ea3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:40:23 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-bf3d7343-b9cc-4601-8a01-17b3e65861ba tempest-VolumesAssistedSnapshotsTest-410166037 tempest-VolumesAssistedSnapshotsTest-410166037-project-member] Lock "7e267a577c062ee862e95ede6b48cfd5632f3ea3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:40:23 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-bf3d7343-b9cc-4601-8a01-17b3e65861ba tempest-VolumesAssistedSnapshotsTest-410166037 tempest-VolumesAssistedSnapshotsTest-410166037-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:40:23 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-bf3d7343-b9cc-4601-8a01-17b3e65861ba tempest-VolumesAssistedSnapshotsTest-410166037 tempest-VolumesAssistedSnapshotsTest-410166037-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json" returned: 0 in 0.216s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:40:23 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-bf3d7343-b9cc-4601-8a01-17b3e65861ba tempest-VolumesAssistedSnapshotsTest-410166037 tempest-VolumesAssistedSnapshotsTest-410166037-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3,backing_fmt=raw /opt/stack/data/nova/instances/fd8d4549-db8f-4c74-8706-8ac21f049c2e/disk 1073741824 {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:40:23 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-bf3d7343-b9cc-4601-8a01-17b3e65861ba tempest-VolumesAssistedSnapshotsTest-410166037 tempest-VolumesAssistedSnapshotsTest-410166037-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3,backing_fmt=raw /opt/stack/data/nova/instances/fd8d4549-db8f-4c74-8706-8ac21f049c2e/disk 1073741824" returned: 0 in 0.064s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:40:23 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-bf3d7343-b9cc-4601-8a01-17b3e65861ba tempest-VolumesAssistedSnapshotsTest-410166037 tempest-VolumesAssistedSnapshotsTest-410166037-project-member] Lock "7e267a577c062ee862e95ede6b48cfd5632f3ea3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.289s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:40:23 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-bf3d7343-b9cc-4601-8a01-17b3e65861ba tempest-VolumesAssistedSnapshotsTest-410166037 tempest-VolumesAssistedSnapshotsTest-410166037-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:40:23 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-bf3d7343-b9cc-4601-8a01-17b3e65861ba tempest-VolumesAssistedSnapshotsTest-410166037 tempest-VolumesAssistedSnapshotsTest-410166037-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json" returned: 0 in 0.250s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:40:23 user nova-compute[73449]: DEBUG nova.virt.disk.api [None req-bf3d7343-b9cc-4601-8a01-17b3e65861ba tempest-VolumesAssistedSnapshotsTest-410166037 tempest-VolumesAssistedSnapshotsTest-410166037-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fd8d4549-db8f-4c74-8706-8ac21f049c2e/disk. size=1073741824 {{(pid=73449) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 11:40:23 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-bf3d7343-b9cc-4601-8a01-17b3e65861ba tempest-VolumesAssistedSnapshotsTest-410166037 tempest-VolumesAssistedSnapshotsTest-410166037-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd8d4549-db8f-4c74-8706-8ac21f049c2e/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:40:24 user nova-compute[73449]: DEBUG nova.network.neutron [None req-bf3d7343-b9cc-4601-8a01-17b3e65861ba tempest-VolumesAssistedSnapshotsTest-410166037 tempest-VolumesAssistedSnapshotsTest-410166037-project-member] [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e] Successfully created port: 98c22823-114c-45bf-bc36-876f2f587b55 {{(pid=73449) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 11:40:24 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-bf3d7343-b9cc-4601-8a01-17b3e65861ba tempest-VolumesAssistedSnapshotsTest-410166037 tempest-VolumesAssistedSnapshotsTest-410166037-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd8d4549-db8f-4c74-8706-8ac21f049c2e/disk --force-share --output=json" returned: 0 in 0.296s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:40:24 user nova-compute[73449]: DEBUG nova.virt.disk.api [None req-bf3d7343-b9cc-4601-8a01-17b3e65861ba tempest-VolumesAssistedSnapshotsTest-410166037 tempest-VolumesAssistedSnapshotsTest-410166037-project-member] Cannot resize image /opt/stack/data/nova/instances/fd8d4549-db8f-4c74-8706-8ac21f049c2e/disk to a smaller size. {{(pid=73449) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 11:40:24 user nova-compute[73449]: DEBUG nova.objects.instance [None req-bf3d7343-b9cc-4601-8a01-17b3e65861ba tempest-VolumesAssistedSnapshotsTest-410166037 tempest-VolumesAssistedSnapshotsTest-410166037-project-member] Lazy-loading 'migration_context' on Instance uuid fd8d4549-db8f-4c74-8706-8ac21f049c2e {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:40:24 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-bf3d7343-b9cc-4601-8a01-17b3e65861ba tempest-VolumesAssistedSnapshotsTest-410166037 tempest-VolumesAssistedSnapshotsTest-410166037-project-member] [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e] Created local disks {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 11:40:24 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-bf3d7343-b9cc-4601-8a01-17b3e65861ba tempest-VolumesAssistedSnapshotsTest-410166037 tempest-VolumesAssistedSnapshotsTest-410166037-project-member] [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e] Ensure instance console log exists: /opt/stack/data/nova/instances/fd8d4549-db8f-4c74-8706-8ac21f049c2e/console.log {{(pid=73449) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 11:40:24 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-bf3d7343-b9cc-4601-8a01-17b3e65861ba tempest-VolumesAssistedSnapshotsTest-410166037 tempest-VolumesAssistedSnapshotsTest-410166037-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:40:24 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-bf3d7343-b9cc-4601-8a01-17b3e65861ba tempest-VolumesAssistedSnapshotsTest-410166037 tempest-VolumesAssistedSnapshotsTest-410166037-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:40:24 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-bf3d7343-b9cc-4601-8a01-17b3e65861ba tempest-VolumesAssistedSnapshotsTest-410166037 tempest-VolumesAssistedSnapshotsTest-410166037-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:40:25 user nova-compute[73449]: DEBUG nova.network.neutron [None req-bf3d7343-b9cc-4601-8a01-17b3e65861ba tempest-VolumesAssistedSnapshotsTest-410166037 tempest-VolumesAssistedSnapshotsTest-410166037-project-member] [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e] Successfully updated port: 98c22823-114c-45bf-bc36-876f2f587b55 {{(pid=73449) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 11:40:25 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-bf3d7343-b9cc-4601-8a01-17b3e65861ba tempest-VolumesAssistedSnapshotsTest-410166037 tempest-VolumesAssistedSnapshotsTest-410166037-project-member] Acquiring lock "refresh_cache-fd8d4549-db8f-4c74-8706-8ac21f049c2e" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:40:25 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-bf3d7343-b9cc-4601-8a01-17b3e65861ba tempest-VolumesAssistedSnapshotsTest-410166037 tempest-VolumesAssistedSnapshotsTest-410166037-project-member] Acquired lock "refresh_cache-fd8d4549-db8f-4c74-8706-8ac21f049c2e" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:40:25 user nova-compute[73449]: DEBUG nova.network.neutron [None req-bf3d7343-b9cc-4601-8a01-17b3e65861ba tempest-VolumesAssistedSnapshotsTest-410166037 tempest-VolumesAssistedSnapshotsTest-410166037-project-member] [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e] Building network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 11:40:25 user nova-compute[73449]: DEBUG nova.compute.manager [req-ece39747-e195-4f58-b909-c2ec29686a29 req-78c8557a-cc3b-47a7-aedc-8a73f074c904 service nova] [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e] Received event network-changed-98c22823-114c-45bf-bc36-876f2f587b55 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:40:25 user nova-compute[73449]: DEBUG nova.compute.manager [req-ece39747-e195-4f58-b909-c2ec29686a29 req-78c8557a-cc3b-47a7-aedc-8a73f074c904 service nova] [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e] Refreshing instance network info cache due to event network-changed-98c22823-114c-45bf-bc36-876f2f587b55. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 11:40:25 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-ece39747-e195-4f58-b909-c2ec29686a29 req-78c8557a-cc3b-47a7-aedc-8a73f074c904 service nova] Acquiring lock "refresh_cache-fd8d4549-db8f-4c74-8706-8ac21f049c2e" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:40:25 user nova-compute[73449]: DEBUG nova.network.neutron [None req-bf3d7343-b9cc-4601-8a01-17b3e65861ba tempest-VolumesAssistedSnapshotsTest-410166037 tempest-VolumesAssistedSnapshotsTest-410166037-project-member] [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e] Instance cache missing network info. {{(pid=73449) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 11:40:25 user nova-compute[73449]: DEBUG nova.network.neutron [None req-bf3d7343-b9cc-4601-8a01-17b3e65861ba tempest-VolumesAssistedSnapshotsTest-410166037 tempest-VolumesAssistedSnapshotsTest-410166037-project-member] [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e] Updating instance_info_cache with network_info: [{"id": "98c22823-114c-45bf-bc36-876f2f587b55", "address": "fa:16:3e:e2:ef:b0", "network": {"id": "c4a2b8cb-821d-4dd9-a737-ee2e5b474491", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1403649220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93aebc1246f34b81a883a70dd6e6e7f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98c22823-11", "ovs_interfaceid": "98c22823-114c-45bf-bc36-876f2f587b55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:40:25 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-bf3d7343-b9cc-4601-8a01-17b3e65861ba tempest-VolumesAssistedSnapshotsTest-410166037 tempest-VolumesAssistedSnapshotsTest-410166037-project-member] Releasing lock "refresh_cache-fd8d4549-db8f-4c74-8706-8ac21f049c2e" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:40:25 user nova-compute[73449]: DEBUG nova.compute.manager [None req-bf3d7343-b9cc-4601-8a01-17b3e65861ba tempest-VolumesAssistedSnapshotsTest-410166037 tempest-VolumesAssistedSnapshotsTest-410166037-project-member] [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e] Instance network_info: |[{"id": "98c22823-114c-45bf-bc36-876f2f587b55", "address": "fa:16:3e:e2:ef:b0", "network": {"id": "c4a2b8cb-821d-4dd9-a737-ee2e5b474491", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1403649220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93aebc1246f34b81a883a70dd6e6e7f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98c22823-11", "ovs_interfaceid": "98c22823-114c-45bf-bc36-876f2f587b55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73449) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 11:40:25 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-ece39747-e195-4f58-b909-c2ec29686a29 req-78c8557a-cc3b-47a7-aedc-8a73f074c904 service nova] Acquired lock "refresh_cache-fd8d4549-db8f-4c74-8706-8ac21f049c2e" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:40:25 user nova-compute[73449]: DEBUG nova.network.neutron [req-ece39747-e195-4f58-b909-c2ec29686a29 req-78c8557a-cc3b-47a7-aedc-8a73f074c904 service nova] [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e] Refreshing network info cache for port 98c22823-114c-45bf-bc36-876f2f587b55 {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 11:40:25 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-bf3d7343-b9cc-4601-8a01-17b3e65861ba tempest-VolumesAssistedSnapshotsTest-410166037 tempest-VolumesAssistedSnapshotsTest-410166037-project-member] [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e] Start _get_guest_xml network_info=[{"id": "98c22823-114c-45bf-bc36-876f2f587b55", "address": "fa:16:3e:e2:ef:b0", "network": {"id": "c4a2b8cb-821d-4dd9-a737-ee2e5b474491", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1403649220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93aebc1246f34b81a883a70dd6e6e7f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98c22823-11", "ovs_interfaceid": "98c22823-114c-45bf-bc36-876f2f587b55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T11:36:11Z,direct_url=<?>,disk_format='qcow2',id=0a2904ae-083d-41c8-83db-343132b36148,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7a77880136a54ef195c82e018e1939db',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T11:36:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': '0a2904ae-083d-41c8-83db-343132b36148'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 11:40:25 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-bf3d7343-b9cc-4601-8a01-17b3e65861ba tempest-VolumesAssistedSnapshotsTest-410166037 tempest-VolumesAssistedSnapshotsTest-410166037-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:40:25 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-bf3d7343-b9cc-4601-8a01-17b3e65861ba tempest-VolumesAssistedSnapshotsTest-410166037 tempest-VolumesAssistedSnapshotsTest-410166037-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:40:25 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-bf3d7343-b9cc-4601-8a01-17b3e65861ba tempest-VolumesAssistedSnapshotsTest-410166037 tempest-VolumesAssistedSnapshotsTest-410166037-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 11:40:25 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-bf3d7343-b9cc-4601-8a01-17b3e65861ba tempest-VolumesAssistedSnapshotsTest-410166037 tempest-VolumesAssistedSnapshotsTest-410166037-project-member] CPU controller missing on host. {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 11:40:25 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-bf3d7343-b9cc-4601-8a01-17b3e65861ba tempest-VolumesAssistedSnapshotsTest-410166037 tempest-VolumesAssistedSnapshotsTest-410166037-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 11:40:25 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-bf3d7343-b9cc-4601-8a01-17b3e65861ba tempest-VolumesAssistedSnapshotsTest-410166037 tempest-VolumesAssistedSnapshotsTest-410166037-project-member] CPU controller found on host. {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 11:40:25 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-bf3d7343-b9cc-4601-8a01-17b3e65861ba tempest-VolumesAssistedSnapshotsTest-410166037 tempest-VolumesAssistedSnapshotsTest-410166037-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73449) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 11:40:25 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-bf3d7343-b9cc-4601-8a01-17b3e65861ba tempest-VolumesAssistedSnapshotsTest-410166037 tempest-VolumesAssistedSnapshotsTest-410166037-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T11:35:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T11:36:11Z,direct_url=<?>,disk_format='qcow2',id=0a2904ae-083d-41c8-83db-343132b36148,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7a77880136a54ef195c82e018e1939db',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T11:36:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 11:40:25 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-bf3d7343-b9cc-4601-8a01-17b3e65861ba tempest-VolumesAssistedSnapshotsTest-410166037 tempest-VolumesAssistedSnapshotsTest-410166037-project-member] Flavor limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 11:40:25 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-bf3d7343-b9cc-4601-8a01-17b3e65861ba tempest-VolumesAssistedSnapshotsTest-410166037 tempest-VolumesAssistedSnapshotsTest-410166037-project-member] Image limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 11:40:25 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-bf3d7343-b9cc-4601-8a01-17b3e65861ba tempest-VolumesAssistedSnapshotsTest-410166037 tempest-VolumesAssistedSnapshotsTest-410166037-project-member] Flavor pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 11:40:25 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-bf3d7343-b9cc-4601-8a01-17b3e65861ba tempest-VolumesAssistedSnapshotsTest-410166037 tempest-VolumesAssistedSnapshotsTest-410166037-project-member] Image pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 11:40:25 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-bf3d7343-b9cc-4601-8a01-17b3e65861ba tempest-VolumesAssistedSnapshotsTest-410166037 tempest-VolumesAssistedSnapshotsTest-410166037-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 11:40:25 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-bf3d7343-b9cc-4601-8a01-17b3e65861ba tempest-VolumesAssistedSnapshotsTest-410166037 tempest-VolumesAssistedSnapshotsTest-410166037-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 11:40:25 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-bf3d7343-b9cc-4601-8a01-17b3e65861ba tempest-VolumesAssistedSnapshotsTest-410166037 tempest-VolumesAssistedSnapshotsTest-410166037-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 11:40:25 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-bf3d7343-b9cc-4601-8a01-17b3e65861ba tempest-VolumesAssistedSnapshotsTest-410166037 tempest-VolumesAssistedSnapshotsTest-410166037-project-member] Got 1 possible topologies {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 11:40:25 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-bf3d7343-b9cc-4601-8a01-17b3e65861ba tempest-VolumesAssistedSnapshotsTest-410166037 tempest-VolumesAssistedSnapshotsTest-410166037-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 11:40:25 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-bf3d7343-b9cc-4601-8a01-17b3e65861ba tempest-VolumesAssistedSnapshotsTest-410166037 tempest-VolumesAssistedSnapshotsTest-410166037-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 11:40:25 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-bf3d7343-b9cc-4601-8a01-17b3e65861ba tempest-VolumesAssistedSnapshotsTest-410166037 tempest-VolumesAssistedSnapshotsTest-410166037-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:40:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-863819384',display_name='tempest-VolumesAssistedSnapshotsTest-server-863819384',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-863819384',id=4,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP5cerBSEOFy0ZJynSsV8ct5TCMQkklg0oVUN8308KhbzIg0UcMuaQMZMlbsr6SbBFx8w1ukdm1/QyZ1DHs538Lga/AcZXpj3HtVOMivfnstX+kM3AmcupDu1j/Gp4lAyQ==',key_name='tempest-keypair-2100999617',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='93aebc1246f34b81a883a70dd6e6e7f3',ramdisk_id='',reservation_id='r-xzkdl4hr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-410166037',owner_user_name='tempest-VolumesAssistedSnapshotsTest-410166037-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T11:40:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='72d21423ba884ca4845bc2782f7e2e06',uuid=fd8d4549-db8f-4c74-8706-8ac21f049c2e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "98c22823-114c-45bf-bc36-876f2f587b55", "address": "fa:16:3e:e2:ef:b0", "network": {"id": "c4a2b8cb-821d-4dd9-a737-ee2e5b474491", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1403649220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93aebc1246f34b81a883a70dd6e6e7f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98c22823-11", "ovs_interfaceid": "98c22823-114c-45bf-bc36-876f2f587b55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73449) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 11:40:25 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-bf3d7343-b9cc-4601-8a01-17b3e65861ba tempest-VolumesAssistedSnapshotsTest-410166037 tempest-VolumesAssistedSnapshotsTest-410166037-project-member] Converting VIF {"id": "98c22823-114c-45bf-bc36-876f2f587b55", "address": "fa:16:3e:e2:ef:b0", "network": {"id": "c4a2b8cb-821d-4dd9-a737-ee2e5b474491", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1403649220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93aebc1246f34b81a883a70dd6e6e7f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98c22823-11", "ovs_interfaceid": "98c22823-114c-45bf-bc36-876f2f587b55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:40:25 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-bf3d7343-b9cc-4601-8a01-17b3e65861ba tempest-VolumesAssistedSnapshotsTest-410166037 tempest-VolumesAssistedSnapshotsTest-410166037-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:ef:b0,bridge_name='br-int',has_traffic_filtering=True,id=98c22823-114c-45bf-bc36-876f2f587b55,network=Network(c4a2b8cb-821d-4dd9-a737-ee2e5b474491),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98c22823-11') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:40:25 user nova-compute[73449]: DEBUG nova.objects.instance [None req-bf3d7343-b9cc-4601-8a01-17b3e65861ba tempest-VolumesAssistedSnapshotsTest-410166037 tempest-VolumesAssistedSnapshotsTest-410166037-project-member] Lazy-loading 'pci_devices' on Instance uuid fd8d4549-db8f-4c74-8706-8ac21f049c2e {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:40:25 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-bf3d7343-b9cc-4601-8a01-17b3e65861ba tempest-VolumesAssistedSnapshotsTest-410166037 tempest-VolumesAssistedSnapshotsTest-410166037-project-member] [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e] End _get_guest_xml xml=<domain type="kvm">
Aug 17 11:40:25 user nova-compute[73449]:   <uuid>fd8d4549-db8f-4c74-8706-8ac21f049c2e</uuid>
Aug 17 11:40:25 user nova-compute[73449]:   <name>instance-00000004</name>
Aug 17 11:40:25 user nova-compute[73449]:   <memory>524288</memory>
Aug 17 11:40:25 user nova-compute[73449]:   <vcpu>1</vcpu>
Aug 17 11:40:25 user nova-compute[73449]:   <metadata>
Aug 17 11:40:25 user nova-compute[73449]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 11:40:25 user nova-compute[73449]:       <nova:package version="0.0.0"/>
Aug 17 11:40:25 user nova-compute[73449]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-863819384</nova:name>
Aug 17 11:40:25 user nova-compute[73449]:       <nova:creationTime>2023-08-17 11:40:25</nova:creationTime>
Aug 17 11:40:25 user nova-compute[73449]:       <nova:flavor name="m1.tiny">
Aug 17 11:40:25 user nova-compute[73449]:         <nova:memory>512</nova:memory>
Aug 17 11:40:25 user nova-compute[73449]:         <nova:disk>1</nova:disk>
Aug 17 11:40:25 user nova-compute[73449]:         <nova:swap>0</nova:swap>
Aug 17 11:40:25 user nova-compute[73449]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 11:40:25 user nova-compute[73449]:         <nova:vcpus>1</nova:vcpus>
Aug 17 11:40:25 user nova-compute[73449]:       </nova:flavor>
Aug 17 11:40:25 user nova-compute[73449]:       <nova:owner>
Aug 17 11:40:25 user nova-compute[73449]:         <nova:user uuid="72d21423ba884ca4845bc2782f7e2e06">tempest-VolumesAssistedSnapshotsTest-410166037-project-member</nova:user>
Aug 17 11:40:25 user nova-compute[73449]:         <nova:project uuid="93aebc1246f34b81a883a70dd6e6e7f3">tempest-VolumesAssistedSnapshotsTest-410166037</nova:project>
Aug 17 11:40:25 user nova-compute[73449]:       </nova:owner>
Aug 17 11:40:25 user nova-compute[73449]:       <nova:root type="image" uuid="0a2904ae-083d-41c8-83db-343132b36148"/>
Aug 17 11:40:25 user nova-compute[73449]:       <nova:ports>
Aug 17 11:40:25 user nova-compute[73449]:         <nova:port uuid="98c22823-114c-45bf-bc36-876f2f587b55">
Aug 17 11:40:25 user nova-compute[73449]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 17 11:40:25 user nova-compute[73449]:         </nova:port>
Aug 17 11:40:25 user nova-compute[73449]:       </nova:ports>
Aug 17 11:40:25 user nova-compute[73449]:     </nova:instance>
Aug 17 11:40:25 user nova-compute[73449]:   </metadata>
Aug 17 11:40:25 user nova-compute[73449]:   <sysinfo type="smbios">
Aug 17 11:40:25 user nova-compute[73449]:     <system>
Aug 17 11:40:25 user nova-compute[73449]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 11:40:25 user nova-compute[73449]:       <entry name="product">OpenStack Nova</entry>
Aug 17 11:40:25 user nova-compute[73449]:       <entry name="version">0.0.0</entry>
Aug 17 11:40:25 user nova-compute[73449]:       <entry name="serial">fd8d4549-db8f-4c74-8706-8ac21f049c2e</entry>
Aug 17 11:40:25 user nova-compute[73449]:       <entry name="uuid">fd8d4549-db8f-4c74-8706-8ac21f049c2e</entry>
Aug 17 11:40:25 user nova-compute[73449]:       <entry name="family">Virtual Machine</entry>
Aug 17 11:40:25 user nova-compute[73449]:     </system>
Aug 17 11:40:25 user nova-compute[73449]:   </sysinfo>
Aug 17 11:40:25 user nova-compute[73449]:   <os>
Aug 17 11:40:25 user nova-compute[73449]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 11:40:25 user nova-compute[73449]:     <boot dev="hd"/>
Aug 17 11:40:25 user nova-compute[73449]:     <smbios mode="sysinfo"/>
Aug 17 11:40:25 user nova-compute[73449]:   </os>
Aug 17 11:40:25 user nova-compute[73449]:   <features>
Aug 17 11:40:25 user nova-compute[73449]:     <acpi/>
Aug 17 11:40:25 user nova-compute[73449]:     <apic/>
Aug 17 11:40:25 user nova-compute[73449]:     <vmcoreinfo/>
Aug 17 11:40:25 user nova-compute[73449]:   </features>
Aug 17 11:40:25 user nova-compute[73449]:   <clock offset="utc">
Aug 17 11:40:25 user nova-compute[73449]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 11:40:25 user nova-compute[73449]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 11:40:25 user nova-compute[73449]:     <timer name="hpet" present="no"/>
Aug 17 11:40:25 user nova-compute[73449]:   </clock>
Aug 17 11:40:25 user nova-compute[73449]:   <cpu mode="custom" match="exact">
Aug 17 11:40:25 user nova-compute[73449]:     <model>Nehalem</model>
Aug 17 11:40:25 user nova-compute[73449]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 11:40:25 user nova-compute[73449]:   </cpu>
Aug 17 11:40:25 user nova-compute[73449]:   <devices>
Aug 17 11:40:25 user nova-compute[73449]:     <disk type="file" device="disk">
Aug 17 11:40:25 user nova-compute[73449]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 11:40:25 user nova-compute[73449]:       <source file="/opt/stack/data/nova/instances/fd8d4549-db8f-4c74-8706-8ac21f049c2e/disk"/>
Aug 17 11:40:25 user nova-compute[73449]:       <target dev="vda" bus="virtio"/>
Aug 17 11:40:25 user nova-compute[73449]:     </disk>
Aug 17 11:40:25 user nova-compute[73449]:     <interface type="ethernet">
Aug 17 11:40:25 user nova-compute[73449]:       <mac address="fa:16:3e:e2:ef:b0"/>
Aug 17 11:40:25 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 11:40:25 user nova-compute[73449]:       <mtu size="1442"/>
Aug 17 11:40:25 user nova-compute[73449]:       <target dev="tap98c22823-11"/>
Aug 17 11:40:25 user nova-compute[73449]:     </interface>
Aug 17 11:40:25 user nova-compute[73449]:     <serial type="pty">
Aug 17 11:40:25 user nova-compute[73449]:       <log file="/opt/stack/data/nova/instances/fd8d4549-db8f-4c74-8706-8ac21f049c2e/console.log" append="off"/>
Aug 17 11:40:25 user nova-compute[73449]:     </serial>
Aug 17 11:40:25 user nova-compute[73449]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 11:40:25 user nova-compute[73449]:     <video>
Aug 17 11:40:25 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 11:40:25 user nova-compute[73449]:     </video>
Aug 17 11:40:25 user nova-compute[73449]:     <rng model="virtio">
Aug 17 11:40:25 user nova-compute[73449]:       <backend model="random">/dev/urandom</backend>
Aug 17 11:40:25 user nova-compute[73449]:     </rng>
Aug 17 11:40:25 user nova-compute[73449]:     <controller type="usb" index="0" model="none"/>
Aug 17 11:40:25 user nova-compute[73449]:     <memballoon model="virtio">
Aug 17 11:40:25 user nova-compute[73449]:       <stats period="10"/>
Aug 17 11:40:25 user nova-compute[73449]:     </memballoon>
Aug 17 11:40:25 user nova-compute[73449]:   </devices>
Aug 17 11:40:25 user nova-compute[73449]: </domain>
Aug 17 11:40:25 user nova-compute[73449]:  {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 11:40:25 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-bf3d7343-b9cc-4601-8a01-17b3e65861ba tempest-VolumesAssistedSnapshotsTest-410166037 tempest-VolumesAssistedSnapshotsTest-410166037-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:40:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-863819384',display_name='tempest-VolumesAssistedSnapshotsTest-server-863819384',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-863819384',id=4,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP5cerBSEOFy0ZJynSsV8ct5TCMQkklg0oVUN8308KhbzIg0UcMuaQMZMlbsr6SbBFx8w1ukdm1/QyZ1DHs538Lga/AcZXpj3HtVOMivfnstX+kM3AmcupDu1j/Gp4lAyQ==',key_name='tempest-keypair-2100999617',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='93aebc1246f34b81a883a70dd6e6e7f3',ramdisk_id='',reservation_id='r-xzkdl4hr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-410166037',owner_user_name='tempest-VolumesAssistedSnapshotsTest-410166037-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T11:40:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='72d21423ba884ca4845bc2782f7e2e06',uuid=fd8d4549-db8f-4c74-8706-8ac21f049c2e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "98c22823-114c-45bf-bc36-876f2f587b55", "address": "fa:16:3e:e2:ef:b0", "network": {"id": "c4a2b8cb-821d-4dd9-a737-ee2e5b474491", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1403649220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93aebc1246f34b81a883a70dd6e6e7f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98c22823-11", "ovs_interfaceid": "98c22823-114c-45bf-bc36-876f2f587b55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 11:40:25 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-bf3d7343-b9cc-4601-8a01-17b3e65861ba tempest-VolumesAssistedSnapshotsTest-410166037 tempest-VolumesAssistedSnapshotsTest-410166037-project-member] Converting VIF {"id": "98c22823-114c-45bf-bc36-876f2f587b55", "address": "fa:16:3e:e2:ef:b0", "network": {"id": "c4a2b8cb-821d-4dd9-a737-ee2e5b474491", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1403649220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93aebc1246f34b81a883a70dd6e6e7f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98c22823-11", "ovs_interfaceid": "98c22823-114c-45bf-bc36-876f2f587b55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:40:25 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-bf3d7343-b9cc-4601-8a01-17b3e65861ba tempest-VolumesAssistedSnapshotsTest-410166037 tempest-VolumesAssistedSnapshotsTest-410166037-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:ef:b0,bridge_name='br-int',has_traffic_filtering=True,id=98c22823-114c-45bf-bc36-876f2f587b55,network=Network(c4a2b8cb-821d-4dd9-a737-ee2e5b474491),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98c22823-11') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:40:25 user nova-compute[73449]: DEBUG os_vif [None req-bf3d7343-b9cc-4601-8a01-17b3e65861ba tempest-VolumesAssistedSnapshotsTest-410166037 tempest-VolumesAssistedSnapshotsTest-410166037-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:ef:b0,bridge_name='br-int',has_traffic_filtering=True,id=98c22823-114c-45bf-bc36-876f2f587b55,network=Network(c4a2b8cb-821d-4dd9-a737-ee2e5b474491),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98c22823-11') {{(pid=73449) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 11:40:25 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:40:25 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:40:25 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 11:40:25 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:40:25 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap98c22823-11, may_exist=True, interface_attrs={}) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:40:25 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap98c22823-11, col_values=(('external_ids', {'iface-id': '98c22823-114c-45bf-bc36-876f2f587b55', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e2:ef:b0', 'vm-uuid': 'fd8d4549-db8f-4c74-8706-8ac21f049c2e'}),), if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:40:25 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:40:25 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:40:25 user nova-compute[73449]: INFO os_vif [None req-bf3d7343-b9cc-4601-8a01-17b3e65861ba tempest-VolumesAssistedSnapshotsTest-410166037 tempest-VolumesAssistedSnapshotsTest-410166037-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:ef:b0,bridge_name='br-int',has_traffic_filtering=True,id=98c22823-114c-45bf-bc36-876f2f587b55,network=Network(c4a2b8cb-821d-4dd9-a737-ee2e5b474491),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98c22823-11')
Aug 17 11:40:26 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-bf3d7343-b9cc-4601-8a01-17b3e65861ba tempest-VolumesAssistedSnapshotsTest-410166037 tempest-VolumesAssistedSnapshotsTest-410166037-project-member] No BDM found with device name vda, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 11:40:26 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-bf3d7343-b9cc-4601-8a01-17b3e65861ba tempest-VolumesAssistedSnapshotsTest-410166037 tempest-VolumesAssistedSnapshotsTest-410166037-project-member] No VIF found with MAC fa:16:3e:e2:ef:b0, not building metadata {{(pid=73449) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 11:40:26 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a43517cb-243f-498e-b7eb-d2d7db16ee08 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Acquiring lock "fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:40:26 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a43517cb-243f-498e-b7eb-d2d7db16ee08 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Lock "fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:40:26 user nova-compute[73449]: DEBUG nova.network.neutron [req-ece39747-e195-4f58-b909-c2ec29686a29 req-78c8557a-cc3b-47a7-aedc-8a73f074c904 service nova] [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e] Updated VIF entry in instance network info cache for port 98c22823-114c-45bf-bc36-876f2f587b55. {{(pid=73449) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 11:40:26 user nova-compute[73449]: DEBUG nova.network.neutron [req-ece39747-e195-4f58-b909-c2ec29686a29 req-78c8557a-cc3b-47a7-aedc-8a73f074c904 service nova] [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e] Updating instance_info_cache with network_info: [{"id": "98c22823-114c-45bf-bc36-876f2f587b55", "address": "fa:16:3e:e2:ef:b0", "network": {"id": "c4a2b8cb-821d-4dd9-a737-ee2e5b474491", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1403649220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93aebc1246f34b81a883a70dd6e6e7f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98c22823-11", "ovs_interfaceid": "98c22823-114c-45bf-bc36-876f2f587b55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:40:26 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-54e2df88-1379-4dee-9cae-e42fda0ce721 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Acquiring lock "7d3e07fa-4823-48e9-a959-e7bac0e0b25b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:40:26 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-54e2df88-1379-4dee-9cae-e42fda0ce721 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Lock "7d3e07fa-4823-48e9-a959-e7bac0e0b25b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:40:26 user nova-compute[73449]: DEBUG nova.compute.manager [None req-a43517cb-243f-498e-b7eb-d2d7db16ee08 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] [instance: fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2] Starting instance... {{(pid=73449) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 11:40:26 user nova-compute[73449]: DEBUG nova.compute.manager [None req-54e2df88-1379-4dee-9cae-e42fda0ce721 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] [instance: 7d3e07fa-4823-48e9-a959-e7bac0e0b25b] Starting instance... {{(pid=73449) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 11:40:26 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-ece39747-e195-4f58-b909-c2ec29686a29 req-78c8557a-cc3b-47a7-aedc-8a73f074c904 service nova] Releasing lock "refresh_cache-fd8d4549-db8f-4c74-8706-8ac21f049c2e" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:40:26 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a43517cb-243f-498e-b7eb-d2d7db16ee08 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:40:26 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a43517cb-243f-498e-b7eb-d2d7db16ee08 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:40:26 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-a43517cb-243f-498e-b7eb-d2d7db16ee08 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73449) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 11:40:26 user nova-compute[73449]: INFO nova.compute.claims [None req-a43517cb-243f-498e-b7eb-d2d7db16ee08 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] [instance: fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2] Claim successful on node user
Aug 17 11:40:26 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-54e2df88-1379-4dee-9cae-e42fda0ce721 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:40:26 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:40:27 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-a43517cb-243f-498e-b7eb-d2d7db16ee08 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 11:40:27 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-a43517cb-243f-498e-b7eb-d2d7db16ee08 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 11:40:27 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a43517cb-243f-498e-b7eb-d2d7db16ee08 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.569s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:40:27 user nova-compute[73449]: DEBUG nova.compute.manager [None req-a43517cb-243f-498e-b7eb-d2d7db16ee08 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] [instance: fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2] Start building networks asynchronously for instance. {{(pid=73449) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 11:40:27 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-54e2df88-1379-4dee-9cae-e42fda0ce721 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.561s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:40:27 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-54e2df88-1379-4dee-9cae-e42fda0ce721 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73449) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 11:40:27 user nova-compute[73449]: INFO nova.compute.claims [None req-54e2df88-1379-4dee-9cae-e42fda0ce721 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] [instance: 7d3e07fa-4823-48e9-a959-e7bac0e0b25b] Claim successful on node user
Aug 17 11:40:27 user nova-compute[73449]: DEBUG nova.compute.manager [None req-a43517cb-243f-498e-b7eb-d2d7db16ee08 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] [instance: fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2] Allocating IP information in the background. {{(pid=73449) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 11:40:27 user nova-compute[73449]: DEBUG nova.network.neutron [None req-a43517cb-243f-498e-b7eb-d2d7db16ee08 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] [instance: fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2] allocate_for_instance() {{(pid=73449) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 11:40:27 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-a43517cb-243f-498e-b7eb-d2d7db16ee08 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] [instance: fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 11:40:27 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:40:27 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:40:27 user nova-compute[73449]: DEBUG nova.compute.manager [None req-a43517cb-243f-498e-b7eb-d2d7db16ee08 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] [instance: fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2] Start building block device mappings for instance. {{(pid=73449) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 11:40:27 user nova-compute[73449]: DEBUG nova.compute.manager [None req-a43517cb-243f-498e-b7eb-d2d7db16ee08 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] [instance: fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2] Start spawning the instance on the hypervisor. {{(pid=73449) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 11:40:27 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-a43517cb-243f-498e-b7eb-d2d7db16ee08 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] [instance: fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2] Creating instance directory {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 11:40:27 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-a43517cb-243f-498e-b7eb-d2d7db16ee08 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] [instance: fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2] Creating image(s)
Aug 17 11:40:27 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a43517cb-243f-498e-b7eb-d2d7db16ee08 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Acquiring lock "/opt/stack/data/nova/instances/fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:40:27 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a43517cb-243f-498e-b7eb-d2d7db16ee08 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Lock "/opt/stack/data/nova/instances/fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:40:27 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a43517cb-243f-498e-b7eb-d2d7db16ee08 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Lock "/opt/stack/data/nova/instances/fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:40:27 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-a43517cb-243f-498e-b7eb-d2d7db16ee08 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:40:27 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-54e2df88-1379-4dee-9cae-e42fda0ce721 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 11:40:27 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-54e2df88-1379-4dee-9cae-e42fda0ce721 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 11:40:28 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-54e2df88-1379-4dee-9cae-e42fda0ce721 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.748s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:40:28 user nova-compute[73449]: DEBUG nova.compute.manager [None req-54e2df88-1379-4dee-9cae-e42fda0ce721 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] [instance: 7d3e07fa-4823-48e9-a959-e7bac0e0b25b] Start building networks asynchronously for instance. {{(pid=73449) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 11:40:28 user nova-compute[73449]: DEBUG nova.policy [None req-a43517cb-243f-498e-b7eb-d2d7db16ee08 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4cfe2e3e87454eb38768c2ed81450b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2513ad48149f45e2a2bd4b404ebc13b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73449) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 11:40:28 user nova-compute[73449]: DEBUG nova.compute.manager [None req-54e2df88-1379-4dee-9cae-e42fda0ce721 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] [instance: 7d3e07fa-4823-48e9-a959-e7bac0e0b25b] Allocating IP information in the background. {{(pid=73449) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 11:40:28 user nova-compute[73449]: DEBUG nova.network.neutron [None req-54e2df88-1379-4dee-9cae-e42fda0ce721 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] [instance: 7d3e07fa-4823-48e9-a959-e7bac0e0b25b] allocate_for_instance() {{(pid=73449) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 11:40:28 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-54e2df88-1379-4dee-9cae-e42fda0ce721 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] [instance: 7d3e07fa-4823-48e9-a959-e7bac0e0b25b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 11:40:28 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-a43517cb-243f-498e-b7eb-d2d7db16ee08 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json" returned: 0 in 0.312s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:40:28 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a43517cb-243f-498e-b7eb-d2d7db16ee08 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Acquiring lock "7e267a577c062ee862e95ede6b48cfd5632f3ea3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:40:28 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a43517cb-243f-498e-b7eb-d2d7db16ee08 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Lock "7e267a577c062ee862e95ede6b48cfd5632f3ea3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:40:28 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-a43517cb-243f-498e-b7eb-d2d7db16ee08 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:40:28 user nova-compute[73449]: DEBUG nova.compute.manager [None req-54e2df88-1379-4dee-9cae-e42fda0ce721 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] [instance: 7d3e07fa-4823-48e9-a959-e7bac0e0b25b] Start building block device mappings for instance. {{(pid=73449) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 11:40:28 user nova-compute[73449]: DEBUG nova.policy [None req-54e2df88-1379-4dee-9cae-e42fda0ce721 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9df670f3f7da4815bdcb9915a4999380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c75ffb297b94222a4502db0e0814538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73449) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 11:40:28 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-a43517cb-243f-498e-b7eb-d2d7db16ee08 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json" returned: 0 in 0.242s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:40:28 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-a43517cb-243f-498e-b7eb-d2d7db16ee08 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3,backing_fmt=raw /opt/stack/data/nova/instances/fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2/disk 1073741824 {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:40:28 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-a43517cb-243f-498e-b7eb-d2d7db16ee08 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3,backing_fmt=raw /opt/stack/data/nova/instances/fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2/disk 1073741824" returned: 0 in 0.066s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:40:28 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a43517cb-243f-498e-b7eb-d2d7db16ee08 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Lock "7e267a577c062ee862e95ede6b48cfd5632f3ea3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.315s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:40:28 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-a43517cb-243f-498e-b7eb-d2d7db16ee08 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:40:28 user nova-compute[73449]: DEBUG nova.compute.manager [None req-54e2df88-1379-4dee-9cae-e42fda0ce721 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] [instance: 7d3e07fa-4823-48e9-a959-e7bac0e0b25b] Start spawning the instance on the hypervisor. {{(pid=73449) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 11:40:28 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-54e2df88-1379-4dee-9cae-e42fda0ce721 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] [instance: 7d3e07fa-4823-48e9-a959-e7bac0e0b25b] Creating instance directory {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 11:40:28 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-54e2df88-1379-4dee-9cae-e42fda0ce721 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] [instance: 7d3e07fa-4823-48e9-a959-e7bac0e0b25b] Creating image(s)
Aug 17 11:40:28 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-54e2df88-1379-4dee-9cae-e42fda0ce721 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Acquiring lock "/opt/stack/data/nova/instances/7d3e07fa-4823-48e9-a959-e7bac0e0b25b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:40:28 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-54e2df88-1379-4dee-9cae-e42fda0ce721 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Lock "/opt/stack/data/nova/instances/7d3e07fa-4823-48e9-a959-e7bac0e0b25b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:40:28 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-54e2df88-1379-4dee-9cae-e42fda0ce721 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Lock "/opt/stack/data/nova/instances/7d3e07fa-4823-48e9-a959-e7bac0e0b25b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:40:28 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-54e2df88-1379-4dee-9cae-e42fda0ce721 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:40:28 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:40:28 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:40:28 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-a43517cb-243f-498e-b7eb-d2d7db16ee08 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json" returned: 0 in 0.252s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:40:28 user nova-compute[73449]: DEBUG nova.virt.disk.api [None req-a43517cb-243f-498e-b7eb-d2d7db16ee08 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2/disk. size=1073741824 {{(pid=73449) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 11:40:28 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-a43517cb-243f-498e-b7eb-d2d7db16ee08 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:40:28 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-54e2df88-1379-4dee-9cae-e42fda0ce721 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json" returned: 0 in 0.267s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:40:28 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-54e2df88-1379-4dee-9cae-e42fda0ce721 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Acquiring lock "7e267a577c062ee862e95ede6b48cfd5632f3ea3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:40:28 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-54e2df88-1379-4dee-9cae-e42fda0ce721 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Lock "7e267a577c062ee862e95ede6b48cfd5632f3ea3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:40:28 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-54e2df88-1379-4dee-9cae-e42fda0ce721 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:40:29 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-a43517cb-243f-498e-b7eb-d2d7db16ee08 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2/disk --force-share --output=json" returned: 0 in 0.296s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:40:29 user nova-compute[73449]: DEBUG nova.virt.disk.api [None req-a43517cb-243f-498e-b7eb-d2d7db16ee08 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Cannot resize image /opt/stack/data/nova/instances/fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2/disk to a smaller size. {{(pid=73449) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 11:40:29 user nova-compute[73449]: DEBUG nova.objects.instance [None req-a43517cb-243f-498e-b7eb-d2d7db16ee08 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Lazy-loading 'migration_context' on Instance uuid fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:40:29 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-a43517cb-243f-498e-b7eb-d2d7db16ee08 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] [instance: fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2] Created local disks {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 11:40:29 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-a43517cb-243f-498e-b7eb-d2d7db16ee08 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] [instance: fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2] Ensure instance console log exists: /opt/stack/data/nova/instances/fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2/console.log {{(pid=73449) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 11:40:29 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a43517cb-243f-498e-b7eb-d2d7db16ee08 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:40:29 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a43517cb-243f-498e-b7eb-d2d7db16ee08 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:40:29 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a43517cb-243f-498e-b7eb-d2d7db16ee08 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:40:29 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-54e2df88-1379-4dee-9cae-e42fda0ce721 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json" returned: 0 in 0.253s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:40:29 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-54e2df88-1379-4dee-9cae-e42fda0ce721 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3,backing_fmt=raw /opt/stack/data/nova/instances/7d3e07fa-4823-48e9-a959-e7bac0e0b25b/disk 1073741824 {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:40:29 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-54e2df88-1379-4dee-9cae-e42fda0ce721 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3,backing_fmt=raw /opt/stack/data/nova/instances/7d3e07fa-4823-48e9-a959-e7bac0e0b25b/disk 1073741824" returned: 0 in 0.070s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:40:29 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-54e2df88-1379-4dee-9cae-e42fda0ce721 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Lock "7e267a577c062ee862e95ede6b48cfd5632f3ea3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.331s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:40:29 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-54e2df88-1379-4dee-9cae-e42fda0ce721 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:40:29 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-54e2df88-1379-4dee-9cae-e42fda0ce721 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json" returned: 0 in 0.190s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:40:29 user nova-compute[73449]: DEBUG nova.virt.disk.api [None req-54e2df88-1379-4dee-9cae-e42fda0ce721 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7d3e07fa-4823-48e9-a959-e7bac0e0b25b/disk. size=1073741824 {{(pid=73449) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 11:40:29 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-54e2df88-1379-4dee-9cae-e42fda0ce721 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d3e07fa-4823-48e9-a959-e7bac0e0b25b/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:40:29 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-54e2df88-1379-4dee-9cae-e42fda0ce721 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d3e07fa-4823-48e9-a959-e7bac0e0b25b/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:40:29 user nova-compute[73449]: DEBUG nova.virt.disk.api [None req-54e2df88-1379-4dee-9cae-e42fda0ce721 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Cannot resize image /opt/stack/data/nova/instances/7d3e07fa-4823-48e9-a959-e7bac0e0b25b/disk to a smaller size. {{(pid=73449) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 11:40:29 user nova-compute[73449]: DEBUG nova.objects.instance [None req-54e2df88-1379-4dee-9cae-e42fda0ce721 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Lazy-loading 'migration_context' on Instance uuid 7d3e07fa-4823-48e9-a959-e7bac0e0b25b {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:40:29 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-54e2df88-1379-4dee-9cae-e42fda0ce721 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] [instance: 7d3e07fa-4823-48e9-a959-e7bac0e0b25b] Created local disks {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 11:40:29 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-54e2df88-1379-4dee-9cae-e42fda0ce721 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] [instance: 7d3e07fa-4823-48e9-a959-e7bac0e0b25b] Ensure instance console log exists: /opt/stack/data/nova/instances/7d3e07fa-4823-48e9-a959-e7bac0e0b25b/console.log {{(pid=73449) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 11:40:29 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-54e2df88-1379-4dee-9cae-e42fda0ce721 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:40:29 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-54e2df88-1379-4dee-9cae-e42fda0ce721 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:40:29 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-54e2df88-1379-4dee-9cae-e42fda0ce721 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:40:29 user nova-compute[73449]: DEBUG nova.network.neutron [None req-a43517cb-243f-498e-b7eb-d2d7db16ee08 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] [instance: fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2] Successfully created port: 850d3d8f-2b5b-4e82-9c33-83f440f2a428 {{(pid=73449) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 11:40:29 user nova-compute[73449]: DEBUG nova.network.neutron [None req-54e2df88-1379-4dee-9cae-e42fda0ce721 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] [instance: 7d3e07fa-4823-48e9-a959-e7bac0e0b25b] Successfully created port: 60dadb1a-7680-434e-975f-8ef1ec1b4088 {{(pid=73449) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 11:40:30 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692272430.457386, fd8d4549-db8f-4c74-8706-8ac21f049c2e => Resumed> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:40:30 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e] VM Resumed (Lifecycle Event)
Aug 17 11:40:30 user nova-compute[73449]: DEBUG nova.compute.manager [None req-bf3d7343-b9cc-4601-8a01-17b3e65861ba tempest-VolumesAssistedSnapshotsTest-410166037 tempest-VolumesAssistedSnapshotsTest-410166037-project-member] [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e] Instance event wait completed in 0 seconds for  {{(pid=73449) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 11:40:30 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-bf3d7343-b9cc-4601-8a01-17b3e65861ba tempest-VolumesAssistedSnapshotsTest-410166037 tempest-VolumesAssistedSnapshotsTest-410166037-project-member] [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e] Guest created on hypervisor {{(pid=73449) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 11:40:30 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e] Instance spawned successfully.
Aug 17 11:40:30 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-bf3d7343-b9cc-4601-8a01-17b3e65861ba tempest-VolumesAssistedSnapshotsTest-410166037 tempest-VolumesAssistedSnapshotsTest-410166037-project-member] [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 11:40:30 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:40:30 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 11:40:30 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-bf3d7343-b9cc-4601-8a01-17b3e65861ba tempest-VolumesAssistedSnapshotsTest-410166037 tempest-VolumesAssistedSnapshotsTest-410166037-project-member] [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e] Found default for hw_cdrom_bus of ide {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:40:30 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-bf3d7343-b9cc-4601-8a01-17b3e65861ba tempest-VolumesAssistedSnapshotsTest-410166037 tempest-VolumesAssistedSnapshotsTest-410166037-project-member] [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e] Found default for hw_disk_bus of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:40:30 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-bf3d7343-b9cc-4601-8a01-17b3e65861ba tempest-VolumesAssistedSnapshotsTest-410166037 tempest-VolumesAssistedSnapshotsTest-410166037-project-member] [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e] Found default for hw_input_bus of None {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:40:30 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-bf3d7343-b9cc-4601-8a01-17b3e65861ba tempest-VolumesAssistedSnapshotsTest-410166037 tempest-VolumesAssistedSnapshotsTest-410166037-project-member] [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e] Found default for hw_pointer_model of None {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:40:30 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-bf3d7343-b9cc-4601-8a01-17b3e65861ba tempest-VolumesAssistedSnapshotsTest-410166037 tempest-VolumesAssistedSnapshotsTest-410166037-project-member] [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e] Found default for hw_video_model of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:40:30 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-bf3d7343-b9cc-4601-8a01-17b3e65861ba tempest-VolumesAssistedSnapshotsTest-410166037 tempest-VolumesAssistedSnapshotsTest-410166037-project-member] [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e] Found default for hw_vif_model of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:40:30 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 11:40:30 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692272430.4601617, fd8d4549-db8f-4c74-8706-8ac21f049c2e => Started> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:40:30 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e] VM Started (Lifecycle Event)
Aug 17 11:40:30 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:40:30 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 11:40:30 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 11:40:30 user nova-compute[73449]: INFO nova.compute.manager [None req-bf3d7343-b9cc-4601-8a01-17b3e65861ba tempest-VolumesAssistedSnapshotsTest-410166037 tempest-VolumesAssistedSnapshotsTest-410166037-project-member] [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e] Took 7.63 seconds to spawn the instance on the hypervisor.
Aug 17 11:40:30 user nova-compute[73449]: DEBUG nova.compute.manager [None req-bf3d7343-b9cc-4601-8a01-17b3e65861ba tempest-VolumesAssistedSnapshotsTest-410166037 tempest-VolumesAssistedSnapshotsTest-410166037-project-member] [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:40:30 user nova-compute[73449]: DEBUG nova.network.neutron [None req-a43517cb-243f-498e-b7eb-d2d7db16ee08 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] [instance: fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2] Successfully updated port: 850d3d8f-2b5b-4e82-9c33-83f440f2a428 {{(pid=73449) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 11:40:30 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a43517cb-243f-498e-b7eb-d2d7db16ee08 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Acquiring lock "refresh_cache-fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:40:30 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a43517cb-243f-498e-b7eb-d2d7db16ee08 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Acquired lock "refresh_cache-fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:40:30 user nova-compute[73449]: DEBUG nova.network.neutron [None req-a43517cb-243f-498e-b7eb-d2d7db16ee08 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] [instance: fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2] Building network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 11:40:30 user nova-compute[73449]: DEBUG nova.compute.manager [req-3073d557-c16e-485c-9a82-e00e6baca224 req-eed10909-750f-4555-a5be-3e07cd2011c2 service nova] [instance: fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2] Received event network-changed-850d3d8f-2b5b-4e82-9c33-83f440f2a428 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:40:30 user nova-compute[73449]: DEBUG nova.compute.manager [req-3073d557-c16e-485c-9a82-e00e6baca224 req-eed10909-750f-4555-a5be-3e07cd2011c2 service nova] [instance: fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2] Refreshing instance network info cache due to event network-changed-850d3d8f-2b5b-4e82-9c33-83f440f2a428. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 11:40:30 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-3073d557-c16e-485c-9a82-e00e6baca224 req-eed10909-750f-4555-a5be-3e07cd2011c2 service nova] Acquiring lock "refresh_cache-fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:40:30 user nova-compute[73449]: DEBUG nova.network.neutron [None req-54e2df88-1379-4dee-9cae-e42fda0ce721 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] [instance: 7d3e07fa-4823-48e9-a959-e7bac0e0b25b] Successfully updated port: 60dadb1a-7680-434e-975f-8ef1ec1b4088 {{(pid=73449) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 11:40:30 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-54e2df88-1379-4dee-9cae-e42fda0ce721 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Acquiring lock "refresh_cache-7d3e07fa-4823-48e9-a959-e7bac0e0b25b" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:40:30 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-54e2df88-1379-4dee-9cae-e42fda0ce721 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Acquired lock "refresh_cache-7d3e07fa-4823-48e9-a959-e7bac0e0b25b" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:40:30 user nova-compute[73449]: DEBUG nova.network.neutron [None req-54e2df88-1379-4dee-9cae-e42fda0ce721 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] [instance: 7d3e07fa-4823-48e9-a959-e7bac0e0b25b] Building network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 11:40:30 user nova-compute[73449]: DEBUG nova.network.neutron [None req-a43517cb-243f-498e-b7eb-d2d7db16ee08 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] [instance: fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2] Instance cache missing network info. {{(pid=73449) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 11:40:30 user nova-compute[73449]: DEBUG nova.compute.manager [req-83ad3960-5ddf-4544-8cf1-ffd3e2bc8a6b req-384976d8-5efd-42d0-9aa2-aa853deca985 service nova] [instance: 7d3e07fa-4823-48e9-a959-e7bac0e0b25b] Received event network-changed-60dadb1a-7680-434e-975f-8ef1ec1b4088 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:40:30 user nova-compute[73449]: DEBUG nova.compute.manager [req-83ad3960-5ddf-4544-8cf1-ffd3e2bc8a6b req-384976d8-5efd-42d0-9aa2-aa853deca985 service nova] [instance: 7d3e07fa-4823-48e9-a959-e7bac0e0b25b] Refreshing instance network info cache due to event network-changed-60dadb1a-7680-434e-975f-8ef1ec1b4088. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 11:40:30 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-83ad3960-5ddf-4544-8cf1-ffd3e2bc8a6b req-384976d8-5efd-42d0-9aa2-aa853deca985 service nova] Acquiring lock "refresh_cache-7d3e07fa-4823-48e9-a959-e7bac0e0b25b" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:40:30 user nova-compute[73449]: INFO nova.compute.manager [None req-bf3d7343-b9cc-4601-8a01-17b3e65861ba tempest-VolumesAssistedSnapshotsTest-410166037 tempest-VolumesAssistedSnapshotsTest-410166037-project-member] [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e] Took 8.69 seconds to build instance.
Aug 17 11:40:30 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-bf3d7343-b9cc-4601-8a01-17b3e65861ba tempest-VolumesAssistedSnapshotsTest-410166037 tempest-VolumesAssistedSnapshotsTest-410166037-project-member] Lock "fd8d4549-db8f-4c74-8706-8ac21f049c2e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.839s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:40:30 user nova-compute[73449]: DEBUG nova.network.neutron [None req-54e2df88-1379-4dee-9cae-e42fda0ce721 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] [instance: 7d3e07fa-4823-48e9-a959-e7bac0e0b25b] Instance cache missing network info. {{(pid=73449) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 11:40:30 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:40:30 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6ffd380a-91e7-41c7-ae82-3cb9776d85f7 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] Acquiring lock "c7ef11da-09ce-47a1-ba56-02af6a77206c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:40:30 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6ffd380a-91e7-41c7-ae82-3cb9776d85f7 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] Lock "c7ef11da-09ce-47a1-ba56-02af6a77206c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.005s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:40:31 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6ffd380a-91e7-41c7-ae82-3cb9776d85f7 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] [instance: c7ef11da-09ce-47a1-ba56-02af6a77206c] Starting instance... {{(pid=73449) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 11:40:31 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6ffd380a-91e7-41c7-ae82-3cb9776d85f7 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:40:31 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6ffd380a-91e7-41c7-ae82-3cb9776d85f7 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:40:31 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-6ffd380a-91e7-41c7-ae82-3cb9776d85f7 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73449) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 11:40:31 user nova-compute[73449]: INFO nova.compute.claims [None req-6ffd380a-91e7-41c7-ae82-3cb9776d85f7 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] [instance: c7ef11da-09ce-47a1-ba56-02af6a77206c] Claim successful on node user
Aug 17 11:40:31 user nova-compute[73449]: DEBUG nova.network.neutron [None req-a43517cb-243f-498e-b7eb-d2d7db16ee08 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] [instance: fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2] Updating instance_info_cache with network_info: [{"id": "850d3d8f-2b5b-4e82-9c33-83f440f2a428", "address": "fa:16:3e:de:a4:f4", "network": {"id": "ef0c44c4-ef68-433d-bfbc-71272ed64948", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-24887935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2513ad48149f45e2a2bd4b404ebc13b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap850d3d8f-2b", "ovs_interfaceid": "850d3d8f-2b5b-4e82-9c33-83f440f2a428", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:40:31 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a43517cb-243f-498e-b7eb-d2d7db16ee08 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Releasing lock "refresh_cache-fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:40:31 user nova-compute[73449]: DEBUG nova.compute.manager [None req-a43517cb-243f-498e-b7eb-d2d7db16ee08 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] [instance: fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2] Instance network_info: |[{"id": "850d3d8f-2b5b-4e82-9c33-83f440f2a428", "address": "fa:16:3e:de:a4:f4", "network": {"id": "ef0c44c4-ef68-433d-bfbc-71272ed64948", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-24887935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2513ad48149f45e2a2bd4b404ebc13b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap850d3d8f-2b", "ovs_interfaceid": "850d3d8f-2b5b-4e82-9c33-83f440f2a428", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73449) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 11:40:31 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-3073d557-c16e-485c-9a82-e00e6baca224 req-eed10909-750f-4555-a5be-3e07cd2011c2 service nova] Acquired lock "refresh_cache-fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:40:31 user nova-compute[73449]: DEBUG nova.network.neutron [req-3073d557-c16e-485c-9a82-e00e6baca224 req-eed10909-750f-4555-a5be-3e07cd2011c2 service nova] [instance: fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2] Refreshing network info cache for port 850d3d8f-2b5b-4e82-9c33-83f440f2a428 {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 11:40:31 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-a43517cb-243f-498e-b7eb-d2d7db16ee08 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] [instance: fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2] Start _get_guest_xml network_info=[{"id": "850d3d8f-2b5b-4e82-9c33-83f440f2a428", "address": "fa:16:3e:de:a4:f4", "network": {"id": "ef0c44c4-ef68-433d-bfbc-71272ed64948", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-24887935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2513ad48149f45e2a2bd4b404ebc13b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap850d3d8f-2b", "ovs_interfaceid": "850d3d8f-2b5b-4e82-9c33-83f440f2a428", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T11:36:11Z,direct_url=<?>,disk_format='qcow2',id=0a2904ae-083d-41c8-83db-343132b36148,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7a77880136a54ef195c82e018e1939db',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T11:36:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': '0a2904ae-083d-41c8-83db-343132b36148'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 11:40:31 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-a43517cb-243f-498e-b7eb-d2d7db16ee08 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:40:31 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-a43517cb-243f-498e-b7eb-d2d7db16ee08 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:40:31 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-a43517cb-243f-498e-b7eb-d2d7db16ee08 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 11:40:31 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-a43517cb-243f-498e-b7eb-d2d7db16ee08 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] CPU controller missing on host. {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 11:40:31 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-a43517cb-243f-498e-b7eb-d2d7db16ee08 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 11:40:31 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-a43517cb-243f-498e-b7eb-d2d7db16ee08 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] CPU controller found on host. {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 11:40:31 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-a43517cb-243f-498e-b7eb-d2d7db16ee08 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73449) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 11:40:31 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-a43517cb-243f-498e-b7eb-d2d7db16ee08 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T11:35:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T11:36:11Z,direct_url=<?>,disk_format='qcow2',id=0a2904ae-083d-41c8-83db-343132b36148,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7a77880136a54ef195c82e018e1939db',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T11:36:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 11:40:31 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-a43517cb-243f-498e-b7eb-d2d7db16ee08 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Flavor limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 11:40:31 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-a43517cb-243f-498e-b7eb-d2d7db16ee08 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Image limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 11:40:31 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-a43517cb-243f-498e-b7eb-d2d7db16ee08 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Flavor pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 11:40:31 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-a43517cb-243f-498e-b7eb-d2d7db16ee08 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Image pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 11:40:31 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-a43517cb-243f-498e-b7eb-d2d7db16ee08 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 11:40:31 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-a43517cb-243f-498e-b7eb-d2d7db16ee08 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 11:40:31 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-a43517cb-243f-498e-b7eb-d2d7db16ee08 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 11:40:31 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-a43517cb-243f-498e-b7eb-d2d7db16ee08 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Got 1 possible topologies {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 11:40:31 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-a43517cb-243f-498e-b7eb-d2d7db16ee08 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 11:40:31 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-a43517cb-243f-498e-b7eb-d2d7db16ee08 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 11:40:31 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-a43517cb-243f-498e-b7eb-d2d7db16ee08 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:40:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-818139989',display_name='tempest-VolumesAdminNegativeTest-server-818139989',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-818139989',id=5,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAYt3jjD8mFJIRzFJzYvggXhUydY1gZjkAmdg2KmwvJIRG1V5SRsfFdQMOj/WSLs2yODZFgpWb1vJz4f4y/s0dcZSQs6XzaAwUCBcvnAOIaRlbUiaiWaV72mm4zDO+vVWA==',key_name='tempest-keypair-61366657',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2513ad48149f45e2a2bd4b404ebc13b6',ramdisk_id='',reservation_id='r-h39aecbb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1247532735',owner_user_name='tempest-VolumesAdminNegativeTest-1247532735-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T11:40:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4cfe2e3e87454eb38768c2ed81450b1d',uuid=fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "850d3d8f-2b5b-4e82-9c33-83f440f2a428", "address": "fa:16:3e:de:a4:f4", "network": {"id": "ef0c44c4-ef68-433d-bfbc-71272ed64948", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-24887935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2513ad48149f45e2a2bd4b404ebc13b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap850d3d8f-2b", "ovs_interfaceid": "850d3d8f-2b5b-4e82-9c33-83f440f2a428", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73449) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 11:40:31 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-a43517cb-243f-498e-b7eb-d2d7db16ee08 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Converting VIF {"id": "850d3d8f-2b5b-4e82-9c33-83f440f2a428", "address": "fa:16:3e:de:a4:f4", "network": {"id": "ef0c44c4-ef68-433d-bfbc-71272ed64948", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-24887935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2513ad48149f45e2a2bd4b404ebc13b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap850d3d8f-2b", "ovs_interfaceid": "850d3d8f-2b5b-4e82-9c33-83f440f2a428", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:40:31 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-a43517cb-243f-498e-b7eb-d2d7db16ee08 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:a4:f4,bridge_name='br-int',has_traffic_filtering=True,id=850d3d8f-2b5b-4e82-9c33-83f440f2a428,network=Network(ef0c44c4-ef68-433d-bfbc-71272ed64948),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap850d3d8f-2b') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:40:31 user nova-compute[73449]: DEBUG nova.objects.instance [None req-a43517cb-243f-498e-b7eb-d2d7db16ee08 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Lazy-loading 'pci_devices' on Instance uuid fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:40:31 user nova-compute[73449]: DEBUG nova.network.neutron [None req-54e2df88-1379-4dee-9cae-e42fda0ce721 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] [instance: 7d3e07fa-4823-48e9-a959-e7bac0e0b25b] Updating instance_info_cache with network_info: [{"id": "60dadb1a-7680-434e-975f-8ef1ec1b4088", "address": "fa:16:3e:fd:e7:b1", "network": {"id": "2461f7a5-f076-40da-b7dc-c21b8cd64e55", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-146967442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c75ffb297b94222a4502db0e0814538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60dadb1a-76", "ovs_interfaceid": "60dadb1a-7680-434e-975f-8ef1ec1b4088", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:40:31 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-a43517cb-243f-498e-b7eb-d2d7db16ee08 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] [instance: fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2] End _get_guest_xml xml=<domain type="kvm">
Aug 17 11:40:31 user nova-compute[73449]:   <uuid>fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2</uuid>
Aug 17 11:40:31 user nova-compute[73449]:   <name>instance-00000005</name>
Aug 17 11:40:31 user nova-compute[73449]:   <memory>524288</memory>
Aug 17 11:40:31 user nova-compute[73449]:   <vcpu>1</vcpu>
Aug 17 11:40:31 user nova-compute[73449]:   <metadata>
Aug 17 11:40:31 user nova-compute[73449]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 11:40:31 user nova-compute[73449]:       <nova:package version="0.0.0"/>
Aug 17 11:40:31 user nova-compute[73449]:       <nova:name>tempest-VolumesAdminNegativeTest-server-818139989</nova:name>
Aug 17 11:40:31 user nova-compute[73449]:       <nova:creationTime>2023-08-17 11:40:31</nova:creationTime>
Aug 17 11:40:31 user nova-compute[73449]:       <nova:flavor name="m1.tiny">
Aug 17 11:40:31 user nova-compute[73449]:         <nova:memory>512</nova:memory>
Aug 17 11:40:31 user nova-compute[73449]:         <nova:disk>1</nova:disk>
Aug 17 11:40:31 user nova-compute[73449]:         <nova:swap>0</nova:swap>
Aug 17 11:40:31 user nova-compute[73449]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 11:40:31 user nova-compute[73449]:         <nova:vcpus>1</nova:vcpus>
Aug 17 11:40:31 user nova-compute[73449]:       </nova:flavor>
Aug 17 11:40:31 user nova-compute[73449]:       <nova:owner>
Aug 17 11:40:31 user nova-compute[73449]:         <nova:user uuid="4cfe2e3e87454eb38768c2ed81450b1d">tempest-VolumesAdminNegativeTest-1247532735-project-member</nova:user>
Aug 17 11:40:31 user nova-compute[73449]:         <nova:project uuid="2513ad48149f45e2a2bd4b404ebc13b6">tempest-VolumesAdminNegativeTest-1247532735</nova:project>
Aug 17 11:40:31 user nova-compute[73449]:       </nova:owner>
Aug 17 11:40:31 user nova-compute[73449]:       <nova:root type="image" uuid="0a2904ae-083d-41c8-83db-343132b36148"/>
Aug 17 11:40:31 user nova-compute[73449]:       <nova:ports>
Aug 17 11:40:31 user nova-compute[73449]:         <nova:port uuid="850d3d8f-2b5b-4e82-9c33-83f440f2a428">
Aug 17 11:40:31 user nova-compute[73449]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 17 11:40:31 user nova-compute[73449]:         </nova:port>
Aug 17 11:40:31 user nova-compute[73449]:       </nova:ports>
Aug 17 11:40:31 user nova-compute[73449]:     </nova:instance>
Aug 17 11:40:31 user nova-compute[73449]:   </metadata>
Aug 17 11:40:31 user nova-compute[73449]:   <sysinfo type="smbios">
Aug 17 11:40:31 user nova-compute[73449]:     <system>
Aug 17 11:40:31 user nova-compute[73449]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 11:40:31 user nova-compute[73449]:       <entry name="product">OpenStack Nova</entry>
Aug 17 11:40:31 user nova-compute[73449]:       <entry name="version">0.0.0</entry>
Aug 17 11:40:31 user nova-compute[73449]:       <entry name="serial">fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2</entry>
Aug 17 11:40:31 user nova-compute[73449]:       <entry name="uuid">fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2</entry>
Aug 17 11:40:31 user nova-compute[73449]:       <entry name="family">Virtual Machine</entry>
Aug 17 11:40:31 user nova-compute[73449]:     </system>
Aug 17 11:40:31 user nova-compute[73449]:   </sysinfo>
Aug 17 11:40:31 user nova-compute[73449]:   <os>
Aug 17 11:40:31 user nova-compute[73449]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 11:40:31 user nova-compute[73449]:     <boot dev="hd"/>
Aug 17 11:40:31 user nova-compute[73449]:     <smbios mode="sysinfo"/>
Aug 17 11:40:31 user nova-compute[73449]:   </os>
Aug 17 11:40:31 user nova-compute[73449]:   <features>
Aug 17 11:40:31 user nova-compute[73449]:     <acpi/>
Aug 17 11:40:31 user nova-compute[73449]:     <apic/>
Aug 17 11:40:31 user nova-compute[73449]:     <vmcoreinfo/>
Aug 17 11:40:31 user nova-compute[73449]:   </features>
Aug 17 11:40:31 user nova-compute[73449]:   <clock offset="utc">
Aug 17 11:40:31 user nova-compute[73449]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 11:40:31 user nova-compute[73449]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 11:40:31 user nova-compute[73449]:     <timer name="hpet" present="no"/>
Aug 17 11:40:31 user nova-compute[73449]:   </clock>
Aug 17 11:40:31 user nova-compute[73449]:   <cpu mode="custom" match="exact">
Aug 17 11:40:31 user nova-compute[73449]:     <model>Nehalem</model>
Aug 17 11:40:31 user nova-compute[73449]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 11:40:31 user nova-compute[73449]:   </cpu>
Aug 17 11:40:31 user nova-compute[73449]:   <devices>
Aug 17 11:40:31 user nova-compute[73449]:     <disk type="file" device="disk">
Aug 17 11:40:31 user nova-compute[73449]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 11:40:31 user nova-compute[73449]:       <source file="/opt/stack/data/nova/instances/fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2/disk"/>
Aug 17 11:40:31 user nova-compute[73449]:       <target dev="vda" bus="virtio"/>
Aug 17 11:40:31 user nova-compute[73449]:     </disk>
Aug 17 11:40:31 user nova-compute[73449]:     <interface type="ethernet">
Aug 17 11:40:31 user nova-compute[73449]:       <mac address="fa:16:3e:de:a4:f4"/>
Aug 17 11:40:31 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 11:40:31 user nova-compute[73449]:       <mtu size="1442"/>
Aug 17 11:40:31 user nova-compute[73449]:       <target dev="tap850d3d8f-2b"/>
Aug 17 11:40:31 user nova-compute[73449]:     </interface>
Aug 17 11:40:31 user nova-compute[73449]:     <serial type="pty">
Aug 17 11:40:31 user nova-compute[73449]:       <log file="/opt/stack/data/nova/instances/fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2/console.log" append="off"/>
Aug 17 11:40:31 user nova-compute[73449]:     </serial>
Aug 17 11:40:31 user nova-compute[73449]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 11:40:31 user nova-compute[73449]:     <video>
Aug 17 11:40:31 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 11:40:31 user nova-compute[73449]:     </video>
Aug 17 11:40:31 user nova-compute[73449]:     <rng model="virtio">
Aug 17 11:40:31 user nova-compute[73449]:       <backend model="random">/dev/urandom</backend>
Aug 17 11:40:31 user nova-compute[73449]:     </rng>
Aug 17 11:40:31 user nova-compute[73449]:     <controller type="usb" index="0" model="none"/>
Aug 17 11:40:31 user nova-compute[73449]:     <memballoon model="virtio">
Aug 17 11:40:31 user nova-compute[73449]:       <stats period="10"/>
Aug 17 11:40:31 user nova-compute[73449]:     </memballoon>
Aug 17 11:40:31 user nova-compute[73449]:   </devices>
Aug 17 11:40:31 user nova-compute[73449]: </domain>
Aug 17 11:40:31 user nova-compute[73449]:  {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 11:40:31 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-a43517cb-243f-498e-b7eb-d2d7db16ee08 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:40:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-818139989',display_name='tempest-VolumesAdminNegativeTest-server-818139989',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-818139989',id=5,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAYt3jjD8mFJIRzFJzYvggXhUydY1gZjkAmdg2KmwvJIRG1V5SRsfFdQMOj/WSLs2yODZFgpWb1vJz4f4y/s0dcZSQs6XzaAwUCBcvnAOIaRlbUiaiWaV72mm4zDO+vVWA==',key_name='tempest-keypair-61366657',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2513ad48149f45e2a2bd4b404ebc13b6',ramdisk_id='',reservation_id='r-h39aecbb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1247532735',owner_user_name='tempest-VolumesAdminNegativeTest-1247532735-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T11:40:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4cfe2e3e87454eb38768c2ed81450b1d',uuid=fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "850d3d8f-2b5b-4e82-9c33-83f440f2a428", "address": "fa:16:3e:de:a4:f4", "network": {"id": "ef0c44c4-ef68-433d-bfbc-71272ed64948", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-24887935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2513ad48149f45e2a2bd4b404ebc13b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap850d3d8f-2b", "ovs_interfaceid": "850d3d8f-2b5b-4e82-9c33-83f440f2a428", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 11:40:31 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-a43517cb-243f-498e-b7eb-d2d7db16ee08 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Converting VIF {"id": "850d3d8f-2b5b-4e82-9c33-83f440f2a428", "address": "fa:16:3e:de:a4:f4", "network": {"id": "ef0c44c4-ef68-433d-bfbc-71272ed64948", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-24887935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2513ad48149f45e2a2bd4b404ebc13b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap850d3d8f-2b", "ovs_interfaceid": "850d3d8f-2b5b-4e82-9c33-83f440f2a428", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:40:31 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-a43517cb-243f-498e-b7eb-d2d7db16ee08 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:a4:f4,bridge_name='br-int',has_traffic_filtering=True,id=850d3d8f-2b5b-4e82-9c33-83f440f2a428,network=Network(ef0c44c4-ef68-433d-bfbc-71272ed64948),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap850d3d8f-2b') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:40:31 user nova-compute[73449]: DEBUG os_vif [None req-a43517cb-243f-498e-b7eb-d2d7db16ee08 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:a4:f4,bridge_name='br-int',has_traffic_filtering=True,id=850d3d8f-2b5b-4e82-9c33-83f440f2a428,network=Network(ef0c44c4-ef68-433d-bfbc-71272ed64948),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap850d3d8f-2b') {{(pid=73449) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 11:40:31 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:40:31 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:40:31 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 11:40:31 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:40:31 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap850d3d8f-2b, may_exist=True, interface_attrs={}) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:40:31 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap850d3d8f-2b, col_values=(('external_ids', {'iface-id': '850d3d8f-2b5b-4e82-9c33-83f440f2a428', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:de:a4:f4', 'vm-uuid': 'fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2'}),), if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:40:31 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-54e2df88-1379-4dee-9cae-e42fda0ce721 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Releasing lock "refresh_cache-7d3e07fa-4823-48e9-a959-e7bac0e0b25b" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:40:31 user nova-compute[73449]: DEBUG nova.compute.manager [None req-54e2df88-1379-4dee-9cae-e42fda0ce721 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] [instance: 7d3e07fa-4823-48e9-a959-e7bac0e0b25b] Instance network_info: |[{"id": "60dadb1a-7680-434e-975f-8ef1ec1b4088", "address": "fa:16:3e:fd:e7:b1", "network": {"id": "2461f7a5-f076-40da-b7dc-c21b8cd64e55", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-146967442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c75ffb297b94222a4502db0e0814538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60dadb1a-76", "ovs_interfaceid": "60dadb1a-7680-434e-975f-8ef1ec1b4088", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73449) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 11:40:31 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:40:31 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-83ad3960-5ddf-4544-8cf1-ffd3e2bc8a6b req-384976d8-5efd-42d0-9aa2-aa853deca985 service nova] Acquired lock "refresh_cache-7d3e07fa-4823-48e9-a959-e7bac0e0b25b" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:40:31 user nova-compute[73449]: DEBUG nova.network.neutron [req-83ad3960-5ddf-4544-8cf1-ffd3e2bc8a6b req-384976d8-5efd-42d0-9aa2-aa853deca985 service nova] [instance: 7d3e07fa-4823-48e9-a959-e7bac0e0b25b] Refreshing network info cache for port 60dadb1a-7680-434e-975f-8ef1ec1b4088 {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 11:40:31 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-54e2df88-1379-4dee-9cae-e42fda0ce721 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] [instance: 7d3e07fa-4823-48e9-a959-e7bac0e0b25b] Start _get_guest_xml network_info=[{"id": "60dadb1a-7680-434e-975f-8ef1ec1b4088", "address": "fa:16:3e:fd:e7:b1", "network": {"id": "2461f7a5-f076-40da-b7dc-c21b8cd64e55", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-146967442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c75ffb297b94222a4502db0e0814538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60dadb1a-76", "ovs_interfaceid": "60dadb1a-7680-434e-975f-8ef1ec1b4088", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T11:36:11Z,direct_url=<?>,disk_format='qcow2',id=0a2904ae-083d-41c8-83db-343132b36148,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7a77880136a54ef195c82e018e1939db',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T11:36:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': '0a2904ae-083d-41c8-83db-343132b36148'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 11:40:31 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:40:31 user nova-compute[73449]: INFO os_vif [None req-a43517cb-243f-498e-b7eb-d2d7db16ee08 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:a4:f4,bridge_name='br-int',has_traffic_filtering=True,id=850d3d8f-2b5b-4e82-9c33-83f440f2a428,network=Network(ef0c44c4-ef68-433d-bfbc-71272ed64948),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap850d3d8f-2b')
Aug 17 11:40:31 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-54e2df88-1379-4dee-9cae-e42fda0ce721 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:40:31 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-54e2df88-1379-4dee-9cae-e42fda0ce721 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:40:31 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-54e2df88-1379-4dee-9cae-e42fda0ce721 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 11:40:31 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-54e2df88-1379-4dee-9cae-e42fda0ce721 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] CPU controller missing on host. {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 11:40:31 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-54e2df88-1379-4dee-9cae-e42fda0ce721 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 11:40:31 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-54e2df88-1379-4dee-9cae-e42fda0ce721 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] CPU controller found on host. {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 11:40:31 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-54e2df88-1379-4dee-9cae-e42fda0ce721 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73449) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 11:40:31 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-54e2df88-1379-4dee-9cae-e42fda0ce721 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T11:35:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T11:36:11Z,direct_url=<?>,disk_format='qcow2',id=0a2904ae-083d-41c8-83db-343132b36148,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7a77880136a54ef195c82e018e1939db',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T11:36:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 11:40:31 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-54e2df88-1379-4dee-9cae-e42fda0ce721 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Flavor limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 11:40:31 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-54e2df88-1379-4dee-9cae-e42fda0ce721 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Image limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 11:40:31 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-54e2df88-1379-4dee-9cae-e42fda0ce721 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Flavor pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 11:40:31 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-54e2df88-1379-4dee-9cae-e42fda0ce721 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Image pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 11:40:31 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-54e2df88-1379-4dee-9cae-e42fda0ce721 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 11:40:31 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-54e2df88-1379-4dee-9cae-e42fda0ce721 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 11:40:31 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-54e2df88-1379-4dee-9cae-e42fda0ce721 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 11:40:31 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-54e2df88-1379-4dee-9cae-e42fda0ce721 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Got 1 possible topologies {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 11:40:31 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-54e2df88-1379-4dee-9cae-e42fda0ce721 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 11:40:31 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-54e2df88-1379-4dee-9cae-e42fda0ce721 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 11:40:31 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-54e2df88-1379-4dee-9cae-e42fda0ce721 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T11:40:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2017749474',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2017749474',id=6,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKDfVSRbJOSL96IIDH0v0XJrsx/+BlroyuWS03V0CQU7P0dyi56boP0N4YVepj2zGZdJ92Q/eiUfqBiWlxOzCQZKWvHOldZF0ArsphTeKIZc5KRdUwh+L9qgCVMp15KALw==',key_name='tempest-keypair-1953925692',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3c75ffb297b94222a4502db0e0814538',ramdisk_id='',reservation_id='r-35nrqkzd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1681245717',owner_user_name='tempest-TaggedAttachmentsTest-1681245717-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T11:40:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9df670f3f7da4815bdcb9915a4999380',uuid=7d3e07fa-4823-48e9-a959-e7bac0e0b25b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "60dadb1a-7680-434e-975f-8ef1ec1b4088", "address": "fa:16:3e:fd:e7:b1", "network": {"id": "2461f7a5-f076-40da-b7dc-c21b8cd64e55", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-146967442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c75ffb297b94222a4502db0e0814538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60dadb1a-76", "ovs_interfaceid": "60dadb1a-7680-434e-975f-8ef1ec1b4088", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73449) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 11:40:31 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-54e2df88-1379-4dee-9cae-e42fda0ce721 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Converting VIF {"id": "60dadb1a-7680-434e-975f-8ef1ec1b4088", "address": "fa:16:3e:fd:e7:b1", "network": {"id": "2461f7a5-f076-40da-b7dc-c21b8cd64e55", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-146967442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c75ffb297b94222a4502db0e0814538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60dadb1a-76", "ovs_interfaceid": "60dadb1a-7680-434e-975f-8ef1ec1b4088", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:40:31 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-54e2df88-1379-4dee-9cae-e42fda0ce721 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:e7:b1,bridge_name='br-int',has_traffic_filtering=True,id=60dadb1a-7680-434e-975f-8ef1ec1b4088,network=Network(2461f7a5-f076-40da-b7dc-c21b8cd64e55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60dadb1a-76') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:40:31 user nova-compute[73449]: DEBUG nova.objects.instance [None req-54e2df88-1379-4dee-9cae-e42fda0ce721 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Lazy-loading 'pci_devices' on Instance uuid 7d3e07fa-4823-48e9-a959-e7bac0e0b25b {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:40:31 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-54e2df88-1379-4dee-9cae-e42fda0ce721 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] [instance: 7d3e07fa-4823-48e9-a959-e7bac0e0b25b] End _get_guest_xml xml=<domain type="kvm">
Aug 17 11:40:31 user nova-compute[73449]:   <uuid>7d3e07fa-4823-48e9-a959-e7bac0e0b25b</uuid>
Aug 17 11:40:31 user nova-compute[73449]:   <name>instance-00000006</name>
Aug 17 11:40:31 user nova-compute[73449]:   <memory>524288</memory>
Aug 17 11:40:31 user nova-compute[73449]:   <vcpu>1</vcpu>
Aug 17 11:40:31 user nova-compute[73449]:   <metadata>
Aug 17 11:40:31 user nova-compute[73449]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 11:40:31 user nova-compute[73449]:       <nova:package version="0.0.0"/>
Aug 17 11:40:31 user nova-compute[73449]:       <nova:name>tempest-device-tagging-server-2017749474</nova:name>
Aug 17 11:40:31 user nova-compute[73449]:       <nova:creationTime>2023-08-17 11:40:31</nova:creationTime>
Aug 17 11:40:31 user nova-compute[73449]:       <nova:flavor name="m1.tiny">
Aug 17 11:40:31 user nova-compute[73449]:         <nova:memory>512</nova:memory>
Aug 17 11:40:31 user nova-compute[73449]:         <nova:disk>1</nova:disk>
Aug 17 11:40:31 user nova-compute[73449]:         <nova:swap>0</nova:swap>
Aug 17 11:40:31 user nova-compute[73449]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 11:40:31 user nova-compute[73449]:         <nova:vcpus>1</nova:vcpus>
Aug 17 11:40:31 user nova-compute[73449]:       </nova:flavor>
Aug 17 11:40:31 user nova-compute[73449]:       <nova:owner>
Aug 17 11:40:31 user nova-compute[73449]:         <nova:user uuid="9df670f3f7da4815bdcb9915a4999380">tempest-TaggedAttachmentsTest-1681245717-project-member</nova:user>
Aug 17 11:40:31 user nova-compute[73449]:         <nova:project uuid="3c75ffb297b94222a4502db0e0814538">tempest-TaggedAttachmentsTest-1681245717</nova:project>
Aug 17 11:40:31 user nova-compute[73449]:       </nova:owner>
Aug 17 11:40:31 user nova-compute[73449]:       <nova:root type="image" uuid="0a2904ae-083d-41c8-83db-343132b36148"/>
Aug 17 11:40:31 user nova-compute[73449]:       <nova:ports>
Aug 17 11:40:31 user nova-compute[73449]:         <nova:port uuid="60dadb1a-7680-434e-975f-8ef1ec1b4088">
Aug 17 11:40:31 user nova-compute[73449]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 17 11:40:31 user nova-compute[73449]:         </nova:port>
Aug 17 11:40:31 user nova-compute[73449]:       </nova:ports>
Aug 17 11:40:31 user nova-compute[73449]:     </nova:instance>
Aug 17 11:40:31 user nova-compute[73449]:   </metadata>
Aug 17 11:40:31 user nova-compute[73449]:   <sysinfo type="smbios">
Aug 17 11:40:31 user nova-compute[73449]:     <system>
Aug 17 11:40:31 user nova-compute[73449]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 11:40:31 user nova-compute[73449]:       <entry name="product">OpenStack Nova</entry>
Aug 17 11:40:31 user nova-compute[73449]:       <entry name="version">0.0.0</entry>
Aug 17 11:40:31 user nova-compute[73449]:       <entry name="serial">7d3e07fa-4823-48e9-a959-e7bac0e0b25b</entry>
Aug 17 11:40:31 user nova-compute[73449]:       <entry name="uuid">7d3e07fa-4823-48e9-a959-e7bac0e0b25b</entry>
Aug 17 11:40:31 user nova-compute[73449]:       <entry name="family">Virtual Machine</entry>
Aug 17 11:40:31 user nova-compute[73449]:     </system>
Aug 17 11:40:31 user nova-compute[73449]:   </sysinfo>
Aug 17 11:40:31 user nova-compute[73449]:   <os>
Aug 17 11:40:31 user nova-compute[73449]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 11:40:31 user nova-compute[73449]:     <boot dev="hd"/>
Aug 17 11:40:31 user nova-compute[73449]:     <smbios mode="sysinfo"/>
Aug 17 11:40:31 user nova-compute[73449]:   </os>
Aug 17 11:40:31 user nova-compute[73449]:   <features>
Aug 17 11:40:31 user nova-compute[73449]:     <acpi/>
Aug 17 11:40:31 user nova-compute[73449]:     <apic/>
Aug 17 11:40:31 user nova-compute[73449]:     <vmcoreinfo/>
Aug 17 11:40:31 user nova-compute[73449]:   </features>
Aug 17 11:40:31 user nova-compute[73449]:   <clock offset="utc">
Aug 17 11:40:31 user nova-compute[73449]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 11:40:31 user nova-compute[73449]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 11:40:31 user nova-compute[73449]:     <timer name="hpet" present="no"/>
Aug 17 11:40:31 user nova-compute[73449]:   </clock>
Aug 17 11:40:31 user nova-compute[73449]:   <cpu mode="custom" match="exact">
Aug 17 11:40:31 user nova-compute[73449]:     <model>Nehalem</model>
Aug 17 11:40:31 user nova-compute[73449]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 11:40:31 user nova-compute[73449]:   </cpu>
Aug 17 11:40:31 user nova-compute[73449]:   <devices>
Aug 17 11:40:31 user nova-compute[73449]:     <disk type="file" device="disk">
Aug 17 11:40:31 user nova-compute[73449]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 11:40:31 user nova-compute[73449]:       <source file="/opt/stack/data/nova/instances/7d3e07fa-4823-48e9-a959-e7bac0e0b25b/disk"/>
Aug 17 11:40:31 user nova-compute[73449]:       <target dev="vda" bus="virtio"/>
Aug 17 11:40:31 user nova-compute[73449]:     </disk>
Aug 17 11:40:31 user nova-compute[73449]:     <disk type="file" device="cdrom">
Aug 17 11:40:31 user nova-compute[73449]:       <driver name="qemu" type="raw" cache="none"/>
Aug 17 11:40:31 user nova-compute[73449]:       <source file="/opt/stack/data/nova/instances/7d3e07fa-4823-48e9-a959-e7bac0e0b25b/disk.config"/>
Aug 17 11:40:31 user nova-compute[73449]:       <target dev="hda" bus="ide"/>
Aug 17 11:40:31 user nova-compute[73449]:     </disk>
Aug 17 11:40:31 user nova-compute[73449]:     <interface type="ethernet">
Aug 17 11:40:31 user nova-compute[73449]:       <mac address="fa:16:3e:fd:e7:b1"/>
Aug 17 11:40:31 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 11:40:31 user nova-compute[73449]:       <mtu size="1442"/>
Aug 17 11:40:31 user nova-compute[73449]:       <target dev="tap60dadb1a-76"/>
Aug 17 11:40:31 user nova-compute[73449]:     </interface>
Aug 17 11:40:31 user nova-compute[73449]:     <serial type="pty">
Aug 17 11:40:31 user nova-compute[73449]:       <log file="/opt/stack/data/nova/instances/7d3e07fa-4823-48e9-a959-e7bac0e0b25b/console.log" append="off"/>
Aug 17 11:40:31 user nova-compute[73449]:     </serial>
Aug 17 11:40:31 user nova-compute[73449]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 11:40:31 user nova-compute[73449]:     <video>
Aug 17 11:40:31 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 11:40:31 user nova-compute[73449]:     </video>
Aug 17 11:40:31 user nova-compute[73449]:     <rng model="virtio">
Aug 17 11:40:31 user nova-compute[73449]:       <backend model="random">/dev/urandom</backend>
Aug 17 11:40:31 user nova-compute[73449]:     </rng>
Aug 17 11:40:31 user nova-compute[73449]:     <controller type="usb" index="0" model="none"/>
Aug 17 11:40:31 user nova-compute[73449]:     <memballoon model="virtio">
Aug 17 11:40:31 user nova-compute[73449]:       <stats period="10"/>
Aug 17 11:40:31 user nova-compute[73449]:     </memballoon>
Aug 17 11:40:31 user nova-compute[73449]:   </devices>
Aug 17 11:40:31 user nova-compute[73449]: </domain>
Aug 17 11:40:31 user nova-compute[73449]:  {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 11:40:31 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-54e2df88-1379-4dee-9cae-e42fda0ce721 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T11:40:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2017749474',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2017749474',id=6,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKDfVSRbJOSL96IIDH0v0XJrsx/+BlroyuWS03V0CQU7P0dyi56boP0N4YVepj2zGZdJ92Q/eiUfqBiWlxOzCQZKWvHOldZF0ArsphTeKIZc5KRdUwh+L9qgCVMp15KALw==',key_name='tempest-keypair-1953925692',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3c75ffb297b94222a4502db0e0814538',ramdisk_id='',reservation_id='r-35nrqkzd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1681245717',owner_user_name='tempest-TaggedAttachmentsTest-1681245717-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T11:40:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9df670f3f7da4815bdcb9915a4999380',uuid=7d3e07fa-4823-48e9-a959-e7bac0e0b25b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "60dadb1a-7680-434e-975f-8ef1ec1b4088", "address": "fa:16:3e:fd:e7:b1", "network": {"id": "2461f7a5-f076-40da-b7dc-c21b8cd64e55", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-146967442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c75ffb297b94222a4502db0e0814538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60dadb1a-76", "ovs_interfaceid": "60dadb1a-7680-434e-975f-8ef1ec1b4088", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 11:40:31 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-54e2df88-1379-4dee-9cae-e42fda0ce721 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Converting VIF {"id": "60dadb1a-7680-434e-975f-8ef1ec1b4088", "address": "fa:16:3e:fd:e7:b1", "network": {"id": "2461f7a5-f076-40da-b7dc-c21b8cd64e55", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-146967442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c75ffb297b94222a4502db0e0814538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60dadb1a-76", "ovs_interfaceid": "60dadb1a-7680-434e-975f-8ef1ec1b4088", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:40:31 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-54e2df88-1379-4dee-9cae-e42fda0ce721 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:e7:b1,bridge_name='br-int',has_traffic_filtering=True,id=60dadb1a-7680-434e-975f-8ef1ec1b4088,network=Network(2461f7a5-f076-40da-b7dc-c21b8cd64e55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60dadb1a-76') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:40:31 user nova-compute[73449]: DEBUG os_vif [None req-54e2df88-1379-4dee-9cae-e42fda0ce721 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:e7:b1,bridge_name='br-int',has_traffic_filtering=True,id=60dadb1a-7680-434e-975f-8ef1ec1b4088,network=Network(2461f7a5-f076-40da-b7dc-c21b8cd64e55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60dadb1a-76') {{(pid=73449) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 11:40:31 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:40:31 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:40:31 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 11:40:31 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:40:31 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap60dadb1a-76, may_exist=True, interface_attrs={}) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:40:31 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap60dadb1a-76, col_values=(('external_ids', {'iface-id': '60dadb1a-7680-434e-975f-8ef1ec1b4088', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fd:e7:b1', 'vm-uuid': '7d3e07fa-4823-48e9-a959-e7bac0e0b25b'}),), if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:40:31 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-a43517cb-243f-498e-b7eb-d2d7db16ee08 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] No BDM found with device name vda, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 11:40:31 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-a43517cb-243f-498e-b7eb-d2d7db16ee08 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] No VIF found with MAC fa:16:3e:de:a4:f4, not building metadata {{(pid=73449) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 11:40:31 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:40:31 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:40:31 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:40:31 user nova-compute[73449]: INFO os_vif [None req-54e2df88-1379-4dee-9cae-e42fda0ce721 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:e7:b1,bridge_name='br-int',has_traffic_filtering=True,id=60dadb1a-7680-434e-975f-8ef1ec1b4088,network=Network(2461f7a5-f076-40da-b7dc-c21b8cd64e55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60dadb1a-76')
Aug 17 11:40:31 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-6ffd380a-91e7-41c7-ae82-3cb9776d85f7 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 11:40:31 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-6ffd380a-91e7-41c7-ae82-3cb9776d85f7 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 11:40:31 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-54e2df88-1379-4dee-9cae-e42fda0ce721 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] No BDM found with device name vda, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 11:40:31 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-54e2df88-1379-4dee-9cae-e42fda0ce721 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] No BDM found with device name hda, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 11:40:31 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-54e2df88-1379-4dee-9cae-e42fda0ce721 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] No VIF found with MAC fa:16:3e:fd:e7:b1, not building metadata {{(pid=73449) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 11:40:31 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-54e2df88-1379-4dee-9cae-e42fda0ce721 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] [instance: 7d3e07fa-4823-48e9-a959-e7bac0e0b25b] Using config drive
Aug 17 11:40:31 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6ffd380a-91e7-41c7-ae82-3cb9776d85f7 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.649s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:40:31 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6ffd380a-91e7-41c7-ae82-3cb9776d85f7 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] [instance: c7ef11da-09ce-47a1-ba56-02af6a77206c] Start building networks asynchronously for instance. {{(pid=73449) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 11:40:31 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:40:31 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6ffd380a-91e7-41c7-ae82-3cb9776d85f7 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] [instance: c7ef11da-09ce-47a1-ba56-02af6a77206c] Allocating IP information in the background. {{(pid=73449) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 11:40:31 user nova-compute[73449]: DEBUG nova.network.neutron [None req-6ffd380a-91e7-41c7-ae82-3cb9776d85f7 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] [instance: c7ef11da-09ce-47a1-ba56-02af6a77206c] allocate_for_instance() {{(pid=73449) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 11:40:31 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-6ffd380a-91e7-41c7-ae82-3cb9776d85f7 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] [instance: c7ef11da-09ce-47a1-ba56-02af6a77206c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 11:40:31 user nova-compute[73449]: DEBUG nova.network.neutron [req-3073d557-c16e-485c-9a82-e00e6baca224 req-eed10909-750f-4555-a5be-3e07cd2011c2 service nova] [instance: fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2] Updated VIF entry in instance network info cache for port 850d3d8f-2b5b-4e82-9c33-83f440f2a428. {{(pid=73449) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 11:40:31 user nova-compute[73449]: DEBUG nova.network.neutron [req-3073d557-c16e-485c-9a82-e00e6baca224 req-eed10909-750f-4555-a5be-3e07cd2011c2 service nova] [instance: fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2] Updating instance_info_cache with network_info: [{"id": "850d3d8f-2b5b-4e82-9c33-83f440f2a428", "address": "fa:16:3e:de:a4:f4", "network": {"id": "ef0c44c4-ef68-433d-bfbc-71272ed64948", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-24887935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2513ad48149f45e2a2bd4b404ebc13b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap850d3d8f-2b", "ovs_interfaceid": "850d3d8f-2b5b-4e82-9c33-83f440f2a428", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:40:31 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6ffd380a-91e7-41c7-ae82-3cb9776d85f7 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] [instance: c7ef11da-09ce-47a1-ba56-02af6a77206c] Start building block device mappings for instance. {{(pid=73449) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 11:40:31 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-3073d557-c16e-485c-9a82-e00e6baca224 req-eed10909-750f-4555-a5be-3e07cd2011c2 service nova] Releasing lock "refresh_cache-fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:40:32 user nova-compute[73449]: DEBUG nova.policy [None req-6ffd380a-91e7-41c7-ae82-3cb9776d85f7 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9d971ebb2873481ab6812dd8fa282961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1ad62fc00f644808abbfc3712321ccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73449) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 11:40:32 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6ffd380a-91e7-41c7-ae82-3cb9776d85f7 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] [instance: c7ef11da-09ce-47a1-ba56-02af6a77206c] Start spawning the instance on the hypervisor. {{(pid=73449) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 11:40:32 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6ffd380a-91e7-41c7-ae82-3cb9776d85f7 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] [instance: c7ef11da-09ce-47a1-ba56-02af6a77206c] Creating instance directory {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 11:40:32 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-6ffd380a-91e7-41c7-ae82-3cb9776d85f7 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] [instance: c7ef11da-09ce-47a1-ba56-02af6a77206c] Creating image(s)
Aug 17 11:40:32 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6ffd380a-91e7-41c7-ae82-3cb9776d85f7 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] Acquiring lock "/opt/stack/data/nova/instances/c7ef11da-09ce-47a1-ba56-02af6a77206c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:40:32 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6ffd380a-91e7-41c7-ae82-3cb9776d85f7 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] Lock "/opt/stack/data/nova/instances/c7ef11da-09ce-47a1-ba56-02af6a77206c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:40:32 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6ffd380a-91e7-41c7-ae82-3cb9776d85f7 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] Lock "/opt/stack/data/nova/instances/c7ef11da-09ce-47a1-ba56-02af6a77206c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:40:32 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-54e2df88-1379-4dee-9cae-e42fda0ce721 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] [instance: 7d3e07fa-4823-48e9-a959-e7bac0e0b25b] Creating config drive at /opt/stack/data/nova/instances/7d3e07fa-4823-48e9-a959-e7bac0e0b25b/disk.config
Aug 17 11:40:32 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-54e2df88-1379-4dee-9cae-e42fda0ce721 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/7d3e07fa-4823-48e9-a959-e7bac0e0b25b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpqz49r267 {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:40:32 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6ffd380a-91e7-41c7-ae82-3cb9776d85f7 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:40:32 user nova-compute[73449]: DEBUG nova.network.neutron [req-83ad3960-5ddf-4544-8cf1-ffd3e2bc8a6b req-384976d8-5efd-42d0-9aa2-aa853deca985 service nova] [instance: 7d3e07fa-4823-48e9-a959-e7bac0e0b25b] Updated VIF entry in instance network info cache for port 60dadb1a-7680-434e-975f-8ef1ec1b4088. {{(pid=73449) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 11:40:32 user nova-compute[73449]: DEBUG nova.network.neutron [req-83ad3960-5ddf-4544-8cf1-ffd3e2bc8a6b req-384976d8-5efd-42d0-9aa2-aa853deca985 service nova] [instance: 7d3e07fa-4823-48e9-a959-e7bac0e0b25b] Updating instance_info_cache with network_info: [{"id": "60dadb1a-7680-434e-975f-8ef1ec1b4088", "address": "fa:16:3e:fd:e7:b1", "network": {"id": "2461f7a5-f076-40da-b7dc-c21b8cd64e55", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-146967442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c75ffb297b94222a4502db0e0814538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60dadb1a-76", "ovs_interfaceid": "60dadb1a-7680-434e-975f-8ef1ec1b4088", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:40:32 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-54e2df88-1379-4dee-9cae-e42fda0ce721 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/7d3e07fa-4823-48e9-a959-e7bac0e0b25b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpqz49r267" returned: 0 in 0.091s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:40:32 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-83ad3960-5ddf-4544-8cf1-ffd3e2bc8a6b req-384976d8-5efd-42d0-9aa2-aa853deca985 service nova] Releasing lock "refresh_cache-7d3e07fa-4823-48e9-a959-e7bac0e0b25b" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:40:32 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6ffd380a-91e7-41c7-ae82-3cb9776d85f7 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json" returned: 0 in 0.238s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:40:32 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6ffd380a-91e7-41c7-ae82-3cb9776d85f7 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] Acquiring lock "7e267a577c062ee862e95ede6b48cfd5632f3ea3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:40:32 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6ffd380a-91e7-41c7-ae82-3cb9776d85f7 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] Lock "7e267a577c062ee862e95ede6b48cfd5632f3ea3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:40:32 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6ffd380a-91e7-41c7-ae82-3cb9776d85f7 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:40:32 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6ffd380a-91e7-41c7-ae82-3cb9776d85f7 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json" returned: 0 in 0.195s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:40:32 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6ffd380a-91e7-41c7-ae82-3cb9776d85f7 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3,backing_fmt=raw /opt/stack/data/nova/instances/c7ef11da-09ce-47a1-ba56-02af6a77206c/disk 1073741824 {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:40:33 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6ffd380a-91e7-41c7-ae82-3cb9776d85f7 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3,backing_fmt=raw /opt/stack/data/nova/instances/c7ef11da-09ce-47a1-ba56-02af6a77206c/disk 1073741824" returned: 0 in 0.200s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:40:33 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6ffd380a-91e7-41c7-ae82-3cb9776d85f7 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] Lock "7e267a577c062ee862e95ede6b48cfd5632f3ea3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.405s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:40:33 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6ffd380a-91e7-41c7-ae82-3cb9776d85f7 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:40:33 user nova-compute[73449]: DEBUG nova.network.neutron [None req-6ffd380a-91e7-41c7-ae82-3cb9776d85f7 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] [instance: c7ef11da-09ce-47a1-ba56-02af6a77206c] Successfully created port: 2f53f520-423a-4791-b98b-6be90f9d5f55 {{(pid=73449) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 11:40:33 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6ffd380a-91e7-41c7-ae82-3cb9776d85f7 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json" returned: 0 in 0.221s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:40:33 user nova-compute[73449]: DEBUG nova.virt.disk.api [None req-6ffd380a-91e7-41c7-ae82-3cb9776d85f7 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c7ef11da-09ce-47a1-ba56-02af6a77206c/disk. size=1073741824 {{(pid=73449) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 11:40:33 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6ffd380a-91e7-41c7-ae82-3cb9776d85f7 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7ef11da-09ce-47a1-ba56-02af6a77206c/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:40:33 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6ffd380a-91e7-41c7-ae82-3cb9776d85f7 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7ef11da-09ce-47a1-ba56-02af6a77206c/disk --force-share --output=json" returned: 0 in 0.329s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:40:33 user nova-compute[73449]: DEBUG nova.virt.disk.api [None req-6ffd380a-91e7-41c7-ae82-3cb9776d85f7 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] Cannot resize image /opt/stack/data/nova/instances/c7ef11da-09ce-47a1-ba56-02af6a77206c/disk to a smaller size. {{(pid=73449) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 11:40:33 user nova-compute[73449]: DEBUG nova.objects.instance [None req-6ffd380a-91e7-41c7-ae82-3cb9776d85f7 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] Lazy-loading 'migration_context' on Instance uuid c7ef11da-09ce-47a1-ba56-02af6a77206c {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:40:33 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6ffd380a-91e7-41c7-ae82-3cb9776d85f7 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] [instance: c7ef11da-09ce-47a1-ba56-02af6a77206c] Created local disks {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 11:40:33 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6ffd380a-91e7-41c7-ae82-3cb9776d85f7 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] [instance: c7ef11da-09ce-47a1-ba56-02af6a77206c] Ensure instance console log exists: /opt/stack/data/nova/instances/c7ef11da-09ce-47a1-ba56-02af6a77206c/console.log {{(pid=73449) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 11:40:33 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6ffd380a-91e7-41c7-ae82-3cb9776d85f7 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:40:33 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6ffd380a-91e7-41c7-ae82-3cb9776d85f7 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:40:33 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6ffd380a-91e7-41c7-ae82-3cb9776d85f7 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:40:34 user nova-compute[73449]: DEBUG nova.network.neutron [None req-6ffd380a-91e7-41c7-ae82-3cb9776d85f7 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] [instance: c7ef11da-09ce-47a1-ba56-02af6a77206c] Successfully updated port: 2f53f520-423a-4791-b98b-6be90f9d5f55 {{(pid=73449) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 11:40:34 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6ffd380a-91e7-41c7-ae82-3cb9776d85f7 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] Acquiring lock "refresh_cache-c7ef11da-09ce-47a1-ba56-02af6a77206c" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:40:34 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6ffd380a-91e7-41c7-ae82-3cb9776d85f7 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] Acquired lock "refresh_cache-c7ef11da-09ce-47a1-ba56-02af6a77206c" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:40:34 user nova-compute[73449]: DEBUG nova.network.neutron [None req-6ffd380a-91e7-41c7-ae82-3cb9776d85f7 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] [instance: c7ef11da-09ce-47a1-ba56-02af6a77206c] Building network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 11:40:34 user nova-compute[73449]: DEBUG nova.compute.manager [req-76618041-6ca8-4885-bf2c-fe89869f81b2 req-d1245929-32c6-4c0a-b76a-fc317aaea164 service nova] [instance: c7ef11da-09ce-47a1-ba56-02af6a77206c] Received event network-changed-2f53f520-423a-4791-b98b-6be90f9d5f55 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:40:34 user nova-compute[73449]: DEBUG nova.compute.manager [req-76618041-6ca8-4885-bf2c-fe89869f81b2 req-d1245929-32c6-4c0a-b76a-fc317aaea164 service nova] [instance: c7ef11da-09ce-47a1-ba56-02af6a77206c] Refreshing instance network info cache due to event network-changed-2f53f520-423a-4791-b98b-6be90f9d5f55. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 11:40:34 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-76618041-6ca8-4885-bf2c-fe89869f81b2 req-d1245929-32c6-4c0a-b76a-fc317aaea164 service nova] Acquiring lock "refresh_cache-c7ef11da-09ce-47a1-ba56-02af6a77206c" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:40:34 user nova-compute[73449]: DEBUG nova.network.neutron [None req-6ffd380a-91e7-41c7-ae82-3cb9776d85f7 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] [instance: c7ef11da-09ce-47a1-ba56-02af6a77206c] Instance cache missing network info. {{(pid=73449) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 11:40:34 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:40:34 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:40:34 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:40:34 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:40:35 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:40:35 user nova-compute[73449]: DEBUG nova.network.neutron [None req-6ffd380a-91e7-41c7-ae82-3cb9776d85f7 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] [instance: c7ef11da-09ce-47a1-ba56-02af6a77206c] Updating instance_info_cache with network_info: [{"id": "2f53f520-423a-4791-b98b-6be90f9d5f55", "address": "fa:16:3e:3b:b6:03", "network": {"id": "e41fb10a-8d95-4907-9bc9-8bf33868fb1f", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1297880435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1ad62fc00f644808abbfc3712321ccf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f53f520-42", "ovs_interfaceid": "2f53f520-423a-4791-b98b-6be90f9d5f55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:40:35 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:40:35 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:40:35 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6ffd380a-91e7-41c7-ae82-3cb9776d85f7 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] Releasing lock "refresh_cache-c7ef11da-09ce-47a1-ba56-02af6a77206c" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:40:35 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6ffd380a-91e7-41c7-ae82-3cb9776d85f7 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] [instance: c7ef11da-09ce-47a1-ba56-02af6a77206c] Instance network_info: |[{"id": "2f53f520-423a-4791-b98b-6be90f9d5f55", "address": "fa:16:3e:3b:b6:03", "network": {"id": "e41fb10a-8d95-4907-9bc9-8bf33868fb1f", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1297880435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1ad62fc00f644808abbfc3712321ccf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f53f520-42", "ovs_interfaceid": "2f53f520-423a-4791-b98b-6be90f9d5f55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73449) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 11:40:35 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-76618041-6ca8-4885-bf2c-fe89869f81b2 req-d1245929-32c6-4c0a-b76a-fc317aaea164 service nova] Acquired lock "refresh_cache-c7ef11da-09ce-47a1-ba56-02af6a77206c" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:40:35 user nova-compute[73449]: DEBUG nova.network.neutron [req-76618041-6ca8-4885-bf2c-fe89869f81b2 req-d1245929-32c6-4c0a-b76a-fc317aaea164 service nova] [instance: c7ef11da-09ce-47a1-ba56-02af6a77206c] Refreshing network info cache for port 2f53f520-423a-4791-b98b-6be90f9d5f55 {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 11:40:35 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6ffd380a-91e7-41c7-ae82-3cb9776d85f7 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] [instance: c7ef11da-09ce-47a1-ba56-02af6a77206c] Start _get_guest_xml network_info=[{"id": "2f53f520-423a-4791-b98b-6be90f9d5f55", "address": "fa:16:3e:3b:b6:03", "network": {"id": "e41fb10a-8d95-4907-9bc9-8bf33868fb1f", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1297880435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1ad62fc00f644808abbfc3712321ccf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f53f520-42", "ovs_interfaceid": "2f53f520-423a-4791-b98b-6be90f9d5f55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T11:36:11Z,direct_url=<?>,disk_format='qcow2',id=0a2904ae-083d-41c8-83db-343132b36148,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7a77880136a54ef195c82e018e1939db',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T11:36:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': '0a2904ae-083d-41c8-83db-343132b36148'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 11:40:35 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-6ffd380a-91e7-41c7-ae82-3cb9776d85f7 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:40:35 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-6ffd380a-91e7-41c7-ae82-3cb9776d85f7 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:40:35 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-6ffd380a-91e7-41c7-ae82-3cb9776d85f7 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 11:40:35 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-6ffd380a-91e7-41c7-ae82-3cb9776d85f7 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] CPU controller missing on host. {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 11:40:35 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-6ffd380a-91e7-41c7-ae82-3cb9776d85f7 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 11:40:35 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-6ffd380a-91e7-41c7-ae82-3cb9776d85f7 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] CPU controller found on host. {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 11:40:35 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6ffd380a-91e7-41c7-ae82-3cb9776d85f7 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73449) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 11:40:35 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-6ffd380a-91e7-41c7-ae82-3cb9776d85f7 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T11:35:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T11:36:11Z,direct_url=<?>,disk_format='qcow2',id=0a2904ae-083d-41c8-83db-343132b36148,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7a77880136a54ef195c82e018e1939db',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T11:36:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 11:40:35 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-6ffd380a-91e7-41c7-ae82-3cb9776d85f7 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] Flavor limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 11:40:35 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-6ffd380a-91e7-41c7-ae82-3cb9776d85f7 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] Image limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 11:40:35 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-6ffd380a-91e7-41c7-ae82-3cb9776d85f7 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] Flavor pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 11:40:35 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-6ffd380a-91e7-41c7-ae82-3cb9776d85f7 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] Image pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 11:40:35 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-6ffd380a-91e7-41c7-ae82-3cb9776d85f7 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 11:40:35 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-6ffd380a-91e7-41c7-ae82-3cb9776d85f7 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 11:40:35 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-6ffd380a-91e7-41c7-ae82-3cb9776d85f7 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 11:40:35 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-6ffd380a-91e7-41c7-ae82-3cb9776d85f7 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] Got 1 possible topologies {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 11:40:35 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-6ffd380a-91e7-41c7-ae82-3cb9776d85f7 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 11:40:35 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-6ffd380a-91e7-41c7-ae82-3cb9776d85f7 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 11:40:35 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-6ffd380a-91e7-41c7-ae82-3cb9776d85f7 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:40:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-654997075',display_name='tempest-TestVolumeSwap-server-654997075',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-654997075',id=7,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA3g8ZwxAThFrItl+csjyxzO376w5iFWVd3QzQ/A9B99ZjZ0krZBWKoX0TgJthBhHusiXcySN62H67GVo9mvZQgUKD1YNJsHUwO5pLDJWmSPa3RKel0zx83U2CQnHTl7Iw==',key_name='tempest-keypair-939075134',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f1ad62fc00f644808abbfc3712321ccf',ramdisk_id='',reservation_id='r-t1itycv9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1403133471',owner_user_name='tempest-TestVolumeSwap-1403133471-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T11:40:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9d971ebb2873481ab6812dd8fa282961',uuid=c7ef11da-09ce-47a1-ba56-02af6a77206c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2f53f520-423a-4791-b98b-6be90f9d5f55", "address": "fa:16:3e:3b:b6:03", "network": {"id": "e41fb10a-8d95-4907-9bc9-8bf33868fb1f", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1297880435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1ad62fc00f644808abbfc3712321ccf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f53f520-42", "ovs_interfaceid": "2f53f520-423a-4791-b98b-6be90f9d5f55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73449) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 11:40:35 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-6ffd380a-91e7-41c7-ae82-3cb9776d85f7 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] Converting VIF {"id": "2f53f520-423a-4791-b98b-6be90f9d5f55", "address": "fa:16:3e:3b:b6:03", "network": {"id": "e41fb10a-8d95-4907-9bc9-8bf33868fb1f", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1297880435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1ad62fc00f644808abbfc3712321ccf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f53f520-42", "ovs_interfaceid": "2f53f520-423a-4791-b98b-6be90f9d5f55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:40:35 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-6ffd380a-91e7-41c7-ae82-3cb9776d85f7 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:b6:03,bridge_name='br-int',has_traffic_filtering=True,id=2f53f520-423a-4791-b98b-6be90f9d5f55,network=Network(e41fb10a-8d95-4907-9bc9-8bf33868fb1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f53f520-42') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:40:35 user nova-compute[73449]: DEBUG nova.objects.instance [None req-6ffd380a-91e7-41c7-ae82-3cb9776d85f7 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] Lazy-loading 'pci_devices' on Instance uuid c7ef11da-09ce-47a1-ba56-02af6a77206c {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:40:35 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6ffd380a-91e7-41c7-ae82-3cb9776d85f7 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] [instance: c7ef11da-09ce-47a1-ba56-02af6a77206c] End _get_guest_xml xml=<domain type="kvm">
Aug 17 11:40:35 user nova-compute[73449]:   <uuid>c7ef11da-09ce-47a1-ba56-02af6a77206c</uuid>
Aug 17 11:40:35 user nova-compute[73449]:   <name>instance-00000007</name>
Aug 17 11:40:35 user nova-compute[73449]:   <memory>524288</memory>
Aug 17 11:40:35 user nova-compute[73449]:   <vcpu>1</vcpu>
Aug 17 11:40:35 user nova-compute[73449]:   <metadata>
Aug 17 11:40:35 user nova-compute[73449]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 11:40:35 user nova-compute[73449]:       <nova:package version="0.0.0"/>
Aug 17 11:40:35 user nova-compute[73449]:       <nova:name>tempest-TestVolumeSwap-server-654997075</nova:name>
Aug 17 11:40:35 user nova-compute[73449]:       <nova:creationTime>2023-08-17 11:40:35</nova:creationTime>
Aug 17 11:40:35 user nova-compute[73449]:       <nova:flavor name="m1.tiny">
Aug 17 11:40:35 user nova-compute[73449]:         <nova:memory>512</nova:memory>
Aug 17 11:40:35 user nova-compute[73449]:         <nova:disk>1</nova:disk>
Aug 17 11:40:35 user nova-compute[73449]:         <nova:swap>0</nova:swap>
Aug 17 11:40:35 user nova-compute[73449]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 11:40:35 user nova-compute[73449]:         <nova:vcpus>1</nova:vcpus>
Aug 17 11:40:35 user nova-compute[73449]:       </nova:flavor>
Aug 17 11:40:35 user nova-compute[73449]:       <nova:owner>
Aug 17 11:40:35 user nova-compute[73449]:         <nova:user uuid="9d971ebb2873481ab6812dd8fa282961">tempest-TestVolumeSwap-1403133471-project-member</nova:user>
Aug 17 11:40:35 user nova-compute[73449]:         <nova:project uuid="f1ad62fc00f644808abbfc3712321ccf">tempest-TestVolumeSwap-1403133471</nova:project>
Aug 17 11:40:35 user nova-compute[73449]:       </nova:owner>
Aug 17 11:40:35 user nova-compute[73449]:       <nova:root type="image" uuid="0a2904ae-083d-41c8-83db-343132b36148"/>
Aug 17 11:40:35 user nova-compute[73449]:       <nova:ports>
Aug 17 11:40:35 user nova-compute[73449]:         <nova:port uuid="2f53f520-423a-4791-b98b-6be90f9d5f55">
Aug 17 11:40:35 user nova-compute[73449]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 17 11:40:35 user nova-compute[73449]:         </nova:port>
Aug 17 11:40:35 user nova-compute[73449]:       </nova:ports>
Aug 17 11:40:35 user nova-compute[73449]:     </nova:instance>
Aug 17 11:40:35 user nova-compute[73449]:   </metadata>
Aug 17 11:40:35 user nova-compute[73449]:   <sysinfo type="smbios">
Aug 17 11:40:35 user nova-compute[73449]:     <system>
Aug 17 11:40:35 user nova-compute[73449]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 11:40:35 user nova-compute[73449]:       <entry name="product">OpenStack Nova</entry>
Aug 17 11:40:35 user nova-compute[73449]:       <entry name="version">0.0.0</entry>
Aug 17 11:40:35 user nova-compute[73449]:       <entry name="serial">c7ef11da-09ce-47a1-ba56-02af6a77206c</entry>
Aug 17 11:40:35 user nova-compute[73449]:       <entry name="uuid">c7ef11da-09ce-47a1-ba56-02af6a77206c</entry>
Aug 17 11:40:35 user nova-compute[73449]:       <entry name="family">Virtual Machine</entry>
Aug 17 11:40:35 user nova-compute[73449]:     </system>
Aug 17 11:40:35 user nova-compute[73449]:   </sysinfo>
Aug 17 11:40:35 user nova-compute[73449]:   <os>
Aug 17 11:40:35 user nova-compute[73449]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 11:40:35 user nova-compute[73449]:     <boot dev="hd"/>
Aug 17 11:40:35 user nova-compute[73449]:     <smbios mode="sysinfo"/>
Aug 17 11:40:35 user nova-compute[73449]:   </os>
Aug 17 11:40:35 user nova-compute[73449]:   <features>
Aug 17 11:40:35 user nova-compute[73449]:     <acpi/>
Aug 17 11:40:35 user nova-compute[73449]:     <apic/>
Aug 17 11:40:35 user nova-compute[73449]:     <vmcoreinfo/>
Aug 17 11:40:35 user nova-compute[73449]:   </features>
Aug 17 11:40:35 user nova-compute[73449]:   <clock offset="utc">
Aug 17 11:40:35 user nova-compute[73449]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 11:40:35 user nova-compute[73449]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 11:40:35 user nova-compute[73449]:     <timer name="hpet" present="no"/>
Aug 17 11:40:35 user nova-compute[73449]:   </clock>
Aug 17 11:40:35 user nova-compute[73449]:   <cpu mode="custom" match="exact">
Aug 17 11:40:35 user nova-compute[73449]:     <model>Nehalem</model>
Aug 17 11:40:35 user nova-compute[73449]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 11:40:35 user nova-compute[73449]:   </cpu>
Aug 17 11:40:35 user nova-compute[73449]:   <devices>
Aug 17 11:40:35 user nova-compute[73449]:     <disk type="file" device="disk">
Aug 17 11:40:35 user nova-compute[73449]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 11:40:35 user nova-compute[73449]:       <source file="/opt/stack/data/nova/instances/c7ef11da-09ce-47a1-ba56-02af6a77206c/disk"/>
Aug 17 11:40:35 user nova-compute[73449]:       <target dev="vda" bus="virtio"/>
Aug 17 11:40:35 user nova-compute[73449]:     </disk>
Aug 17 11:40:35 user nova-compute[73449]:     <interface type="ethernet">
Aug 17 11:40:35 user nova-compute[73449]:       <mac address="fa:16:3e:3b:b6:03"/>
Aug 17 11:40:35 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 11:40:35 user nova-compute[73449]:       <mtu size="1442"/>
Aug 17 11:40:35 user nova-compute[73449]:       <target dev="tap2f53f520-42"/>
Aug 17 11:40:35 user nova-compute[73449]:     </interface>
Aug 17 11:40:35 user nova-compute[73449]:     <serial type="pty">
Aug 17 11:40:35 user nova-compute[73449]:       <log file="/opt/stack/data/nova/instances/c7ef11da-09ce-47a1-ba56-02af6a77206c/console.log" append="off"/>
Aug 17 11:40:35 user nova-compute[73449]:     </serial>
Aug 17 11:40:35 user nova-compute[73449]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 11:40:35 user nova-compute[73449]:     <video>
Aug 17 11:40:35 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 11:40:35 user nova-compute[73449]:     </video>
Aug 17 11:40:35 user nova-compute[73449]:     <rng model="virtio">
Aug 17 11:40:35 user nova-compute[73449]:       <backend model="random">/dev/urandom</backend>
Aug 17 11:40:35 user nova-compute[73449]:     </rng>
Aug 17 11:40:35 user nova-compute[73449]:     <controller type="usb" index="0" model="none"/>
Aug 17 11:40:35 user nova-compute[73449]:     <memballoon model="virtio">
Aug 17 11:40:35 user nova-compute[73449]:       <stats period="10"/>
Aug 17 11:40:35 user nova-compute[73449]:     </memballoon>
Aug 17 11:40:35 user nova-compute[73449]:   </devices>
Aug 17 11:40:35 user nova-compute[73449]: </domain>
Aug 17 11:40:35 user nova-compute[73449]:  {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 11:40:35 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-6ffd380a-91e7-41c7-ae82-3cb9776d85f7 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:40:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-654997075',display_name='tempest-TestVolumeSwap-server-654997075',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-654997075',id=7,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA3g8ZwxAThFrItl+csjyxzO376w5iFWVd3QzQ/A9B99ZjZ0krZBWKoX0TgJthBhHusiXcySN62H67GVo9mvZQgUKD1YNJsHUwO5pLDJWmSPa3RKel0zx83U2CQnHTl7Iw==',key_name='tempest-keypair-939075134',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f1ad62fc00f644808abbfc3712321ccf',ramdisk_id='',reservation_id='r-t1itycv9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1403133471',owner_user_name='tempest-TestVolumeSwap-1403133471-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T11:40:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9d971ebb2873481ab6812dd8fa282961',uuid=c7ef11da-09ce-47a1-ba56-02af6a77206c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2f53f520-423a-4791-b98b-6be90f9d5f55", "address": "fa:16:3e:3b:b6:03", "network": {"id": "e41fb10a-8d95-4907-9bc9-8bf33868fb1f", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1297880435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1ad62fc00f644808abbfc3712321ccf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f53f520-42", "ovs_interfaceid": "2f53f520-423a-4791-b98b-6be90f9d5f55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 11:40:35 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-6ffd380a-91e7-41c7-ae82-3cb9776d85f7 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] Converting VIF {"id": "2f53f520-423a-4791-b98b-6be90f9d5f55", "address": "fa:16:3e:3b:b6:03", "network": {"id": "e41fb10a-8d95-4907-9bc9-8bf33868fb1f", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1297880435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1ad62fc00f644808abbfc3712321ccf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f53f520-42", "ovs_interfaceid": "2f53f520-423a-4791-b98b-6be90f9d5f55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:40:35 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-6ffd380a-91e7-41c7-ae82-3cb9776d85f7 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:b6:03,bridge_name='br-int',has_traffic_filtering=True,id=2f53f520-423a-4791-b98b-6be90f9d5f55,network=Network(e41fb10a-8d95-4907-9bc9-8bf33868fb1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f53f520-42') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:40:35 user nova-compute[73449]: DEBUG os_vif [None req-6ffd380a-91e7-41c7-ae82-3cb9776d85f7 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:b6:03,bridge_name='br-int',has_traffic_filtering=True,id=2f53f520-423a-4791-b98b-6be90f9d5f55,network=Network(e41fb10a-8d95-4907-9bc9-8bf33868fb1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f53f520-42') {{(pid=73449) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 11:40:35 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:40:35 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:40:35 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 11:40:35 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:40:35 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2f53f520-42, may_exist=True, interface_attrs={}) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:40:35 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2f53f520-42, col_values=(('external_ids', {'iface-id': '2f53f520-423a-4791-b98b-6be90f9d5f55', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3b:b6:03', 'vm-uuid': 'c7ef11da-09ce-47a1-ba56-02af6a77206c'}),), if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:40:35 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:40:35 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:40:35 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:40:35 user nova-compute[73449]: INFO os_vif [None req-6ffd380a-91e7-41c7-ae82-3cb9776d85f7 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:b6:03,bridge_name='br-int',has_traffic_filtering=True,id=2f53f520-423a-4791-b98b-6be90f9d5f55,network=Network(e41fb10a-8d95-4907-9bc9-8bf33868fb1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f53f520-42')
Aug 17 11:40:35 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6ffd380a-91e7-41c7-ae82-3cb9776d85f7 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] No BDM found with device name vda, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 11:40:35 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6ffd380a-91e7-41c7-ae82-3cb9776d85f7 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] No VIF found with MAC fa:16:3e:3b:b6:03, not building metadata {{(pid=73449) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 11:40:35 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:40:35 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:40:35 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:40:35 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:40:35 user nova-compute[73449]: DEBUG nova.network.neutron [req-76618041-6ca8-4885-bf2c-fe89869f81b2 req-d1245929-32c6-4c0a-b76a-fc317aaea164 service nova] [instance: c7ef11da-09ce-47a1-ba56-02af6a77206c] Updated VIF entry in instance network info cache for port 2f53f520-423a-4791-b98b-6be90f9d5f55. {{(pid=73449) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 11:40:35 user nova-compute[73449]: DEBUG nova.network.neutron [req-76618041-6ca8-4885-bf2c-fe89869f81b2 req-d1245929-32c6-4c0a-b76a-fc317aaea164 service nova] [instance: c7ef11da-09ce-47a1-ba56-02af6a77206c] Updating instance_info_cache with network_info: [{"id": "2f53f520-423a-4791-b98b-6be90f9d5f55", "address": "fa:16:3e:3b:b6:03", "network": {"id": "e41fb10a-8d95-4907-9bc9-8bf33868fb1f", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1297880435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1ad62fc00f644808abbfc3712321ccf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f53f520-42", "ovs_interfaceid": "2f53f520-423a-4791-b98b-6be90f9d5f55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:40:35 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-76618041-6ca8-4885-bf2c-fe89869f81b2 req-d1245929-32c6-4c0a-b76a-fc317aaea164 service nova] Releasing lock "refresh_cache-c7ef11da-09ce-47a1-ba56-02af6a77206c" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:40:36 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:40:36 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:40:36 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:40:36 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:40:36 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:40:36 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:40:37 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:40:37 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:40:37 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:40:37 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:40:38 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:40:38 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:40:38 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:40:38 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:40:38 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:40:39 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692272439.0907996, fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2 => Resumed> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:40:39 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2] VM Resumed (Lifecycle Event)
Aug 17 11:40:39 user nova-compute[73449]: DEBUG nova.compute.manager [None req-a43517cb-243f-498e-b7eb-d2d7db16ee08 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] [instance: fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2] Instance event wait completed in 0 seconds for  {{(pid=73449) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 11:40:39 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-a43517cb-243f-498e-b7eb-d2d7db16ee08 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] [instance: fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2] Guest created on hypervisor {{(pid=73449) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 11:40:39 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2] Instance spawned successfully.
Aug 17 11:40:39 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-a43517cb-243f-498e-b7eb-d2d7db16ee08 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] [instance: fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 11:40:39 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:40:39 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 11:40:39 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-a43517cb-243f-498e-b7eb-d2d7db16ee08 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] [instance: fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2] Found default for hw_cdrom_bus of ide {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:40:39 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-a43517cb-243f-498e-b7eb-d2d7db16ee08 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] [instance: fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2] Found default for hw_disk_bus of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:40:39 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-a43517cb-243f-498e-b7eb-d2d7db16ee08 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] [instance: fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2] Found default for hw_input_bus of None {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:40:39 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-a43517cb-243f-498e-b7eb-d2d7db16ee08 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] [instance: fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2] Found default for hw_pointer_model of None {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:40:39 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-a43517cb-243f-498e-b7eb-d2d7db16ee08 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] [instance: fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2] Found default for hw_video_model of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:40:39 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-a43517cb-243f-498e-b7eb-d2d7db16ee08 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] [instance: fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2] Found default for hw_vif_model of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:40:39 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 11:40:39 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692272439.098735, fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2 => Started> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:40:39 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2] VM Started (Lifecycle Event)
Aug 17 11:40:39 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:40:39 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 11:40:39 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 11:40:39 user nova-compute[73449]: INFO nova.compute.manager [None req-a43517cb-243f-498e-b7eb-d2d7db16ee08 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] [instance: fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2] Took 11.41 seconds to spawn the instance on the hypervisor.
Aug 17 11:40:39 user nova-compute[73449]: DEBUG nova.compute.manager [None req-a43517cb-243f-498e-b7eb-d2d7db16ee08 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] [instance: fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:40:39 user nova-compute[73449]: INFO nova.compute.manager [None req-a43517cb-243f-498e-b7eb-d2d7db16ee08 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] [instance: fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2] Took 12.75 seconds to build instance.
Aug 17 11:40:39 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a43517cb-243f-498e-b7eb-d2d7db16ee08 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Lock "fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.922s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:40:39 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692272439.5788262, 7d3e07fa-4823-48e9-a959-e7bac0e0b25b => Resumed> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:40:39 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 7d3e07fa-4823-48e9-a959-e7bac0e0b25b] VM Resumed (Lifecycle Event)
Aug 17 11:40:39 user nova-compute[73449]: DEBUG nova.compute.manager [None req-54e2df88-1379-4dee-9cae-e42fda0ce721 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] [instance: 7d3e07fa-4823-48e9-a959-e7bac0e0b25b] Instance event wait completed in 0 seconds for  {{(pid=73449) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 11:40:39 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-54e2df88-1379-4dee-9cae-e42fda0ce721 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] [instance: 7d3e07fa-4823-48e9-a959-e7bac0e0b25b] Guest created on hypervisor {{(pid=73449) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 11:40:39 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: 7d3e07fa-4823-48e9-a959-e7bac0e0b25b] Instance spawned successfully.
Aug 17 11:40:39 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-54e2df88-1379-4dee-9cae-e42fda0ce721 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] [instance: 7d3e07fa-4823-48e9-a959-e7bac0e0b25b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 11:40:39 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 7d3e07fa-4823-48e9-a959-e7bac0e0b25b] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:40:39 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 7d3e07fa-4823-48e9-a959-e7bac0e0b25b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 11:40:39 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-54e2df88-1379-4dee-9cae-e42fda0ce721 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] [instance: 7d3e07fa-4823-48e9-a959-e7bac0e0b25b] Found default for hw_cdrom_bus of ide {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:40:39 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-54e2df88-1379-4dee-9cae-e42fda0ce721 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] [instance: 7d3e07fa-4823-48e9-a959-e7bac0e0b25b] Found default for hw_disk_bus of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:40:39 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-54e2df88-1379-4dee-9cae-e42fda0ce721 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] [instance: 7d3e07fa-4823-48e9-a959-e7bac0e0b25b] Found default for hw_input_bus of None {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:40:39 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-54e2df88-1379-4dee-9cae-e42fda0ce721 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] [instance: 7d3e07fa-4823-48e9-a959-e7bac0e0b25b] Found default for hw_pointer_model of None {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:40:39 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-54e2df88-1379-4dee-9cae-e42fda0ce721 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] [instance: 7d3e07fa-4823-48e9-a959-e7bac0e0b25b] Found default for hw_video_model of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:40:39 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-54e2df88-1379-4dee-9cae-e42fda0ce721 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] [instance: 7d3e07fa-4823-48e9-a959-e7bac0e0b25b] Found default for hw_vif_model of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:40:39 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 7d3e07fa-4823-48e9-a959-e7bac0e0b25b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 11:40:39 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692272439.5823324, 7d3e07fa-4823-48e9-a959-e7bac0e0b25b => Started> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:40:39 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 7d3e07fa-4823-48e9-a959-e7bac0e0b25b] VM Started (Lifecycle Event)
Aug 17 11:40:39 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 7d3e07fa-4823-48e9-a959-e7bac0e0b25b] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:40:39 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 7d3e07fa-4823-48e9-a959-e7bac0e0b25b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 11:40:39 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 7d3e07fa-4823-48e9-a959-e7bac0e0b25b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 11:40:39 user nova-compute[73449]: INFO nova.compute.manager [None req-54e2df88-1379-4dee-9cae-e42fda0ce721 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] [instance: 7d3e07fa-4823-48e9-a959-e7bac0e0b25b] Took 11.21 seconds to spawn the instance on the hypervisor.
Aug 17 11:40:39 user nova-compute[73449]: DEBUG nova.compute.manager [None req-54e2df88-1379-4dee-9cae-e42fda0ce721 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] [instance: 7d3e07fa-4823-48e9-a959-e7bac0e0b25b] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:40:39 user nova-compute[73449]: INFO nova.compute.manager [None req-54e2df88-1379-4dee-9cae-e42fda0ce721 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] [instance: 7d3e07fa-4823-48e9-a959-e7bac0e0b25b] Took 13.20 seconds to build instance.
Aug 17 11:40:39 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-54e2df88-1379-4dee-9cae-e42fda0ce721 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Lock "7d3e07fa-4823-48e9-a959-e7bac0e0b25b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.409s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:40:40 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692272440.1970286, c7ef11da-09ce-47a1-ba56-02af6a77206c => Resumed> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:40:40 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: c7ef11da-09ce-47a1-ba56-02af6a77206c] VM Resumed (Lifecycle Event)
Aug 17 11:40:40 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6ffd380a-91e7-41c7-ae82-3cb9776d85f7 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] [instance: c7ef11da-09ce-47a1-ba56-02af6a77206c] Instance event wait completed in 0 seconds for  {{(pid=73449) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 11:40:40 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6ffd380a-91e7-41c7-ae82-3cb9776d85f7 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] [instance: c7ef11da-09ce-47a1-ba56-02af6a77206c] Guest created on hypervisor {{(pid=73449) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 11:40:40 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:40:40 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: c7ef11da-09ce-47a1-ba56-02af6a77206c] Instance spawned successfully.
Aug 17 11:40:40 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6ffd380a-91e7-41c7-ae82-3cb9776d85f7 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] [instance: c7ef11da-09ce-47a1-ba56-02af6a77206c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 11:40:40 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: c7ef11da-09ce-47a1-ba56-02af6a77206c] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:40:40 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6ffd380a-91e7-41c7-ae82-3cb9776d85f7 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] [instance: c7ef11da-09ce-47a1-ba56-02af6a77206c] Found default for hw_cdrom_bus of ide {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:40:40 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6ffd380a-91e7-41c7-ae82-3cb9776d85f7 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] [instance: c7ef11da-09ce-47a1-ba56-02af6a77206c] Found default for hw_disk_bus of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:40:40 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6ffd380a-91e7-41c7-ae82-3cb9776d85f7 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] [instance: c7ef11da-09ce-47a1-ba56-02af6a77206c] Found default for hw_input_bus of None {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:40:40 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6ffd380a-91e7-41c7-ae82-3cb9776d85f7 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] [instance: c7ef11da-09ce-47a1-ba56-02af6a77206c] Found default for hw_pointer_model of None {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:40:40 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6ffd380a-91e7-41c7-ae82-3cb9776d85f7 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] [instance: c7ef11da-09ce-47a1-ba56-02af6a77206c] Found default for hw_video_model of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:40:40 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6ffd380a-91e7-41c7-ae82-3cb9776d85f7 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] [instance: c7ef11da-09ce-47a1-ba56-02af6a77206c] Found default for hw_vif_model of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:40:40 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: c7ef11da-09ce-47a1-ba56-02af6a77206c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 11:40:40 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: c7ef11da-09ce-47a1-ba56-02af6a77206c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 11:40:40 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692272440.203234, c7ef11da-09ce-47a1-ba56-02af6a77206c => Started> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:40:40 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: c7ef11da-09ce-47a1-ba56-02af6a77206c] VM Started (Lifecycle Event)
Aug 17 11:40:40 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: c7ef11da-09ce-47a1-ba56-02af6a77206c] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:40:40 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: c7ef11da-09ce-47a1-ba56-02af6a77206c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 11:40:40 user nova-compute[73449]: INFO nova.compute.manager [None req-6ffd380a-91e7-41c7-ae82-3cb9776d85f7 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] [instance: c7ef11da-09ce-47a1-ba56-02af6a77206c] Took 8.08 seconds to spawn the instance on the hypervisor.
Aug 17 11:40:40 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6ffd380a-91e7-41c7-ae82-3cb9776d85f7 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] [instance: c7ef11da-09ce-47a1-ba56-02af6a77206c] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:40:40 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: c7ef11da-09ce-47a1-ba56-02af6a77206c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 11:40:40 user nova-compute[73449]: INFO nova.compute.manager [None req-6ffd380a-91e7-41c7-ae82-3cb9776d85f7 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] [instance: c7ef11da-09ce-47a1-ba56-02af6a77206c] Took 9.42 seconds to build instance.
Aug 17 11:40:40 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6ffd380a-91e7-41c7-ae82-3cb9776d85f7 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] Lock "c7ef11da-09ce-47a1-ba56-02af6a77206c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.617s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:40:41 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:40:41 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:40:41 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:40:41 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Cleaning up deleted instances {{(pid=73449) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 17 11:40:42 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] There are 0 instances to clean {{(pid=73449) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 17 11:40:42 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:40:42 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73449) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 17 11:40:42 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:40:44 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:40:44 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Starting heal instance info cache {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 11:40:44 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Rebuilding the list of instances to heal {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 11:40:44 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "refresh_cache-a40e1f85-a7e6-46da-8f98-df7a278aaade" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:40:44 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquired lock "refresh_cache-a40e1f85-a7e6-46da-8f98-df7a278aaade" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:40:44 user nova-compute[73449]: DEBUG nova.network.neutron [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: a40e1f85-a7e6-46da-8f98-df7a278aaade] Forcefully refreshing network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 11:40:44 user nova-compute[73449]: DEBUG nova.objects.instance [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lazy-loading 'info_cache' on Instance uuid a40e1f85-a7e6-46da-8f98-df7a278aaade {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:40:45 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:40:45 user nova-compute[73449]: DEBUG nova.network.neutron [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: a40e1f85-a7e6-46da-8f98-df7a278aaade] Updating instance_info_cache with network_info: [{"id": "6f565f5b-de2a-4190-86fd-0d2606a9c5e9", "address": "fa:16:3e:e4:b6:ea", "network": {"id": "4275d6ae-c74d-4900-93d9-65ec567b5abe", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1540860684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dd321fccefc4bb6b89c59b1cc70df0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f565f5b-de", "ovs_interfaceid": "6f565f5b-de2a-4190-86fd-0d2606a9c5e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:40:45 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Releasing lock "refresh_cache-a40e1f85-a7e6-46da-8f98-df7a278aaade" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:40:45 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: a40e1f85-a7e6-46da-8f98-df7a278aaade] Updated the network info_cache for instance {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 11:40:45 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:40:45 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:40:45 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:40:45 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:40:45 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:40:45 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:40:45 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:40:45 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:40:45 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=73449) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 11:40:45 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3523d22-7165-46ad-be10-5e6ae374f91d/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:40:45 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3523d22-7165-46ad-be10-5e6ae374f91d/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:40:45 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3523d22-7165-46ad-be10-5e6ae374f91d/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:40:46 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3523d22-7165-46ad-be10-5e6ae374f91d/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:40:46 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:40:46 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:40:46 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:40:46 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:40:46 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd8d4549-db8f-4c74-8706-8ac21f049c2e/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:40:46 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd8d4549-db8f-4c74-8706-8ac21f049c2e/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:40:46 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd8d4549-db8f-4c74-8706-8ac21f049c2e/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:40:46 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:40:47 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd8d4549-db8f-4c74-8706-8ac21f049c2e/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:40:47 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a9e8ad2-19db-4975-87e4-2efce603a7d7/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:40:47 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a9e8ad2-19db-4975-87e4-2efce603a7d7/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:40:47 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a9e8ad2-19db-4975-87e4-2efce603a7d7/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:40:47 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a9e8ad2-19db-4975-87e4-2efce603a7d7/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:40:47 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a40e1f85-a7e6-46da-8f98-df7a278aaade/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:40:47 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a40e1f85-a7e6-46da-8f98-df7a278aaade/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:40:47 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a40e1f85-a7e6-46da-8f98-df7a278aaade/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:40:47 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a40e1f85-a7e6-46da-8f98-df7a278aaade/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:40:47 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7ef11da-09ce-47a1-ba56-02af6a77206c/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:40:48 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7ef11da-09ce-47a1-ba56-02af6a77206c/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:40:48 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7ef11da-09ce-47a1-ba56-02af6a77206c/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:40:48 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7ef11da-09ce-47a1-ba56-02af6a77206c/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:40:48 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d3e07fa-4823-48e9-a959-e7bac0e0b25b/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:40:48 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d3e07fa-4823-48e9-a959-e7bac0e0b25b/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:40:48 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d3e07fa-4823-48e9-a959-e7bac0e0b25b/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:40:48 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d3e07fa-4823-48e9-a959-e7bac0e0b25b/disk --force-share --output=json" returned: 0 in 0.295s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:40:49 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:40:49 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:40:49 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Hypervisor/Node resource view: name=user free_ram=7877MB free_disk=25.763626098632812GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73449) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 11:40:49 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:40:49 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:40:49 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance a40e1f85-a7e6-46da-8f98-df7a278aaade actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:40:49 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 4a9e8ad2-19db-4975-87e4-2efce603a7d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:40:49 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance a3523d22-7165-46ad-be10-5e6ae374f91d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:40:49 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance fd8d4549-db8f-4c74-8706-8ac21f049c2e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:40:49 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:40:49 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 7d3e07fa-4823-48e9-a959-e7bac0e0b25b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:40:49 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance c7ef11da-09ce-47a1-ba56-02af6a77206c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:40:49 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=73449) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 11:40:49 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=73449) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 11:40:49 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:40:50 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 11:40:50 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 11:40:50 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Compute_service record updated for user:user {{(pid=73449) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 11:40:50 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.798s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:40:50 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:40:50 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:40:50 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:40:50 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73449) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 11:40:51 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:40:55 user nova-compute[73449]: DEBUG nova.compute.manager [req-e4cd4886-90ea-4540-812b-ffd24f8c2333 req-83eecc6d-ba13-4ad3-bb54-cd342bc4d81b service nova] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Received event network-vif-plugged-2a0eb61f-9398-4db6-9ae0-f142ad2e60c4 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:40:55 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-e4cd4886-90ea-4540-812b-ffd24f8c2333 req-83eecc6d-ba13-4ad3-bb54-cd342bc4d81b service nova] Acquiring lock "a3523d22-7165-46ad-be10-5e6ae374f91d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:40:55 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-e4cd4886-90ea-4540-812b-ffd24f8c2333 req-83eecc6d-ba13-4ad3-bb54-cd342bc4d81b service nova] Lock "a3523d22-7165-46ad-be10-5e6ae374f91d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:40:55 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-e4cd4886-90ea-4540-812b-ffd24f8c2333 req-83eecc6d-ba13-4ad3-bb54-cd342bc4d81b service nova] Lock "a3523d22-7165-46ad-be10-5e6ae374f91d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:40:55 user nova-compute[73449]: DEBUG nova.compute.manager [req-e4cd4886-90ea-4540-812b-ffd24f8c2333 req-83eecc6d-ba13-4ad3-bb54-cd342bc4d81b service nova] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] No waiting events found dispatching network-vif-plugged-2a0eb61f-9398-4db6-9ae0-f142ad2e60c4 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:40:55 user nova-compute[73449]: WARNING nova.compute.manager [req-e4cd4886-90ea-4540-812b-ffd24f8c2333 req-83eecc6d-ba13-4ad3-bb54-cd342bc4d81b service nova] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Received unexpected event network-vif-plugged-2a0eb61f-9398-4db6-9ae0-f142ad2e60c4 for instance with vm_state active and task_state None.
Aug 17 11:40:55 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:40:56 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:40:57 user nova-compute[73449]: DEBUG nova.compute.manager [req-ecbc4015-5013-4a3c-97dc-dcf476804b20 req-9cb3dc96-d16b-4259-a559-672ef39b25d1 service nova] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Received event network-vif-plugged-2a0eb61f-9398-4db6-9ae0-f142ad2e60c4 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:40:57 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-ecbc4015-5013-4a3c-97dc-dcf476804b20 req-9cb3dc96-d16b-4259-a559-672ef39b25d1 service nova] Acquiring lock "a3523d22-7165-46ad-be10-5e6ae374f91d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:40:57 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-ecbc4015-5013-4a3c-97dc-dcf476804b20 req-9cb3dc96-d16b-4259-a559-672ef39b25d1 service nova] Lock "a3523d22-7165-46ad-be10-5e6ae374f91d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:40:57 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-ecbc4015-5013-4a3c-97dc-dcf476804b20 req-9cb3dc96-d16b-4259-a559-672ef39b25d1 service nova] Lock "a3523d22-7165-46ad-be10-5e6ae374f91d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:40:57 user nova-compute[73449]: DEBUG nova.compute.manager [req-ecbc4015-5013-4a3c-97dc-dcf476804b20 req-9cb3dc96-d16b-4259-a559-672ef39b25d1 service nova] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] No waiting events found dispatching network-vif-plugged-2a0eb61f-9398-4db6-9ae0-f142ad2e60c4 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:40:57 user nova-compute[73449]: WARNING nova.compute.manager [req-ecbc4015-5013-4a3c-97dc-dcf476804b20 req-9cb3dc96-d16b-4259-a559-672ef39b25d1 service nova] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Received unexpected event network-vif-plugged-2a0eb61f-9398-4db6-9ae0-f142ad2e60c4 for instance with vm_state active and task_state None.
Aug 17 11:40:57 user nova-compute[73449]: DEBUG nova.compute.manager [req-ecbc4015-5013-4a3c-97dc-dcf476804b20 req-9cb3dc96-d16b-4259-a559-672ef39b25d1 service nova] [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e] Received event network-vif-plugged-98c22823-114c-45bf-bc36-876f2f587b55 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:40:57 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-ecbc4015-5013-4a3c-97dc-dcf476804b20 req-9cb3dc96-d16b-4259-a559-672ef39b25d1 service nova] Acquiring lock "fd8d4549-db8f-4c74-8706-8ac21f049c2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:40:57 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-ecbc4015-5013-4a3c-97dc-dcf476804b20 req-9cb3dc96-d16b-4259-a559-672ef39b25d1 service nova] Lock "fd8d4549-db8f-4c74-8706-8ac21f049c2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:40:57 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-ecbc4015-5013-4a3c-97dc-dcf476804b20 req-9cb3dc96-d16b-4259-a559-672ef39b25d1 service nova] Lock "fd8d4549-db8f-4c74-8706-8ac21f049c2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:40:57 user nova-compute[73449]: DEBUG nova.compute.manager [req-ecbc4015-5013-4a3c-97dc-dcf476804b20 req-9cb3dc96-d16b-4259-a559-672ef39b25d1 service nova] [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e] No waiting events found dispatching network-vif-plugged-98c22823-114c-45bf-bc36-876f2f587b55 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:40:57 user nova-compute[73449]: WARNING nova.compute.manager [req-ecbc4015-5013-4a3c-97dc-dcf476804b20 req-9cb3dc96-d16b-4259-a559-672ef39b25d1 service nova] [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e] Received unexpected event network-vif-plugged-98c22823-114c-45bf-bc36-876f2f587b55 for instance with vm_state active and task_state None.
Aug 17 11:40:57 user nova-compute[73449]: DEBUG nova.compute.manager [req-ecbc4015-5013-4a3c-97dc-dcf476804b20 req-9cb3dc96-d16b-4259-a559-672ef39b25d1 service nova] [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e] Received event network-vif-plugged-98c22823-114c-45bf-bc36-876f2f587b55 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:40:57 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-ecbc4015-5013-4a3c-97dc-dcf476804b20 req-9cb3dc96-d16b-4259-a559-672ef39b25d1 service nova] Acquiring lock "fd8d4549-db8f-4c74-8706-8ac21f049c2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:40:57 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-ecbc4015-5013-4a3c-97dc-dcf476804b20 req-9cb3dc96-d16b-4259-a559-672ef39b25d1 service nova] Lock "fd8d4549-db8f-4c74-8706-8ac21f049c2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:40:57 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-ecbc4015-5013-4a3c-97dc-dcf476804b20 req-9cb3dc96-d16b-4259-a559-672ef39b25d1 service nova] Lock "fd8d4549-db8f-4c74-8706-8ac21f049c2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:40:57 user nova-compute[73449]: DEBUG nova.compute.manager [req-ecbc4015-5013-4a3c-97dc-dcf476804b20 req-9cb3dc96-d16b-4259-a559-672ef39b25d1 service nova] [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e] No waiting events found dispatching network-vif-plugged-98c22823-114c-45bf-bc36-876f2f587b55 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:40:57 user nova-compute[73449]: WARNING nova.compute.manager [req-ecbc4015-5013-4a3c-97dc-dcf476804b20 req-9cb3dc96-d16b-4259-a559-672ef39b25d1 service nova] [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e] Received unexpected event network-vif-plugged-98c22823-114c-45bf-bc36-876f2f587b55 for instance with vm_state active and task_state None.
Aug 17 11:40:57 user nova-compute[73449]: DEBUG nova.compute.manager [req-ecbc4015-5013-4a3c-97dc-dcf476804b20 req-9cb3dc96-d16b-4259-a559-672ef39b25d1 service nova] [instance: fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2] Received event network-vif-plugged-850d3d8f-2b5b-4e82-9c33-83f440f2a428 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:40:57 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-ecbc4015-5013-4a3c-97dc-dcf476804b20 req-9cb3dc96-d16b-4259-a559-672ef39b25d1 service nova] Acquiring lock "fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:40:57 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-ecbc4015-5013-4a3c-97dc-dcf476804b20 req-9cb3dc96-d16b-4259-a559-672ef39b25d1 service nova] Lock "fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:40:57 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-ecbc4015-5013-4a3c-97dc-dcf476804b20 req-9cb3dc96-d16b-4259-a559-672ef39b25d1 service nova] Lock "fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:40:57 user nova-compute[73449]: DEBUG nova.compute.manager [req-ecbc4015-5013-4a3c-97dc-dcf476804b20 req-9cb3dc96-d16b-4259-a559-672ef39b25d1 service nova] [instance: fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2] No waiting events found dispatching network-vif-plugged-850d3d8f-2b5b-4e82-9c33-83f440f2a428 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:40:57 user nova-compute[73449]: WARNING nova.compute.manager [req-ecbc4015-5013-4a3c-97dc-dcf476804b20 req-9cb3dc96-d16b-4259-a559-672ef39b25d1 service nova] [instance: fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2] Received unexpected event network-vif-plugged-850d3d8f-2b5b-4e82-9c33-83f440f2a428 for instance with vm_state active and task_state None.
Aug 17 11:40:57 user nova-compute[73449]: DEBUG nova.compute.manager [req-ecbc4015-5013-4a3c-97dc-dcf476804b20 req-9cb3dc96-d16b-4259-a559-672ef39b25d1 service nova] [instance: fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2] Received event network-vif-plugged-850d3d8f-2b5b-4e82-9c33-83f440f2a428 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:40:57 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-ecbc4015-5013-4a3c-97dc-dcf476804b20 req-9cb3dc96-d16b-4259-a559-672ef39b25d1 service nova] Acquiring lock "fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:40:57 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-ecbc4015-5013-4a3c-97dc-dcf476804b20 req-9cb3dc96-d16b-4259-a559-672ef39b25d1 service nova] Lock "fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:40:57 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-ecbc4015-5013-4a3c-97dc-dcf476804b20 req-9cb3dc96-d16b-4259-a559-672ef39b25d1 service nova] Lock "fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:40:57 user nova-compute[73449]: DEBUG nova.compute.manager [req-ecbc4015-5013-4a3c-97dc-dcf476804b20 req-9cb3dc96-d16b-4259-a559-672ef39b25d1 service nova] [instance: fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2] No waiting events found dispatching network-vif-plugged-850d3d8f-2b5b-4e82-9c33-83f440f2a428 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:40:57 user nova-compute[73449]: WARNING nova.compute.manager [req-ecbc4015-5013-4a3c-97dc-dcf476804b20 req-9cb3dc96-d16b-4259-a559-672ef39b25d1 service nova] [instance: fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2] Received unexpected event network-vif-plugged-850d3d8f-2b5b-4e82-9c33-83f440f2a428 for instance with vm_state active and task_state None.
Aug 17 11:40:57 user nova-compute[73449]: DEBUG nova.compute.manager [req-ecbc4015-5013-4a3c-97dc-dcf476804b20 req-9cb3dc96-d16b-4259-a559-672ef39b25d1 service nova] [instance: 7d3e07fa-4823-48e9-a959-e7bac0e0b25b] Received event network-vif-plugged-60dadb1a-7680-434e-975f-8ef1ec1b4088 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:40:57 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-ecbc4015-5013-4a3c-97dc-dcf476804b20 req-9cb3dc96-d16b-4259-a559-672ef39b25d1 service nova] Acquiring lock "7d3e07fa-4823-48e9-a959-e7bac0e0b25b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:40:57 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-ecbc4015-5013-4a3c-97dc-dcf476804b20 req-9cb3dc96-d16b-4259-a559-672ef39b25d1 service nova] Lock "7d3e07fa-4823-48e9-a959-e7bac0e0b25b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:40:57 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-ecbc4015-5013-4a3c-97dc-dcf476804b20 req-9cb3dc96-d16b-4259-a559-672ef39b25d1 service nova] Lock "7d3e07fa-4823-48e9-a959-e7bac0e0b25b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:40:57 user nova-compute[73449]: DEBUG nova.compute.manager [req-ecbc4015-5013-4a3c-97dc-dcf476804b20 req-9cb3dc96-d16b-4259-a559-672ef39b25d1 service nova] [instance: 7d3e07fa-4823-48e9-a959-e7bac0e0b25b] No waiting events found dispatching network-vif-plugged-60dadb1a-7680-434e-975f-8ef1ec1b4088 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:40:57 user nova-compute[73449]: WARNING nova.compute.manager [req-ecbc4015-5013-4a3c-97dc-dcf476804b20 req-9cb3dc96-d16b-4259-a559-672ef39b25d1 service nova] [instance: 7d3e07fa-4823-48e9-a959-e7bac0e0b25b] Received unexpected event network-vif-plugged-60dadb1a-7680-434e-975f-8ef1ec1b4088 for instance with vm_state active and task_state None.
Aug 17 11:40:57 user nova-compute[73449]: DEBUG nova.compute.manager [req-ecbc4015-5013-4a3c-97dc-dcf476804b20 req-9cb3dc96-d16b-4259-a559-672ef39b25d1 service nova] [instance: 7d3e07fa-4823-48e9-a959-e7bac0e0b25b] Received event network-vif-plugged-60dadb1a-7680-434e-975f-8ef1ec1b4088 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:40:57 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-ecbc4015-5013-4a3c-97dc-dcf476804b20 req-9cb3dc96-d16b-4259-a559-672ef39b25d1 service nova] Acquiring lock "7d3e07fa-4823-48e9-a959-e7bac0e0b25b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:40:57 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-ecbc4015-5013-4a3c-97dc-dcf476804b20 req-9cb3dc96-d16b-4259-a559-672ef39b25d1 service nova] Lock "7d3e07fa-4823-48e9-a959-e7bac0e0b25b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:40:57 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-ecbc4015-5013-4a3c-97dc-dcf476804b20 req-9cb3dc96-d16b-4259-a559-672ef39b25d1 service nova] Lock "7d3e07fa-4823-48e9-a959-e7bac0e0b25b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:40:57 user nova-compute[73449]: DEBUG nova.compute.manager [req-ecbc4015-5013-4a3c-97dc-dcf476804b20 req-9cb3dc96-d16b-4259-a559-672ef39b25d1 service nova] [instance: 7d3e07fa-4823-48e9-a959-e7bac0e0b25b] No waiting events found dispatching network-vif-plugged-60dadb1a-7680-434e-975f-8ef1ec1b4088 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:40:57 user nova-compute[73449]: WARNING nova.compute.manager [req-ecbc4015-5013-4a3c-97dc-dcf476804b20 req-9cb3dc96-d16b-4259-a559-672ef39b25d1 service nova] [instance: 7d3e07fa-4823-48e9-a959-e7bac0e0b25b] Received unexpected event network-vif-plugged-60dadb1a-7680-434e-975f-8ef1ec1b4088 for instance with vm_state active and task_state None.
Aug 17 11:40:57 user nova-compute[73449]: DEBUG nova.compute.manager [req-ecbc4015-5013-4a3c-97dc-dcf476804b20 req-9cb3dc96-d16b-4259-a559-672ef39b25d1 service nova] [instance: c7ef11da-09ce-47a1-ba56-02af6a77206c] Received event network-vif-plugged-2f53f520-423a-4791-b98b-6be90f9d5f55 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:40:57 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-ecbc4015-5013-4a3c-97dc-dcf476804b20 req-9cb3dc96-d16b-4259-a559-672ef39b25d1 service nova] Acquiring lock "c7ef11da-09ce-47a1-ba56-02af6a77206c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:40:57 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-ecbc4015-5013-4a3c-97dc-dcf476804b20 req-9cb3dc96-d16b-4259-a559-672ef39b25d1 service nova] Lock "c7ef11da-09ce-47a1-ba56-02af6a77206c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:40:57 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-ecbc4015-5013-4a3c-97dc-dcf476804b20 req-9cb3dc96-d16b-4259-a559-672ef39b25d1 service nova] Lock "c7ef11da-09ce-47a1-ba56-02af6a77206c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:40:57 user nova-compute[73449]: DEBUG nova.compute.manager [req-ecbc4015-5013-4a3c-97dc-dcf476804b20 req-9cb3dc96-d16b-4259-a559-672ef39b25d1 service nova] [instance: c7ef11da-09ce-47a1-ba56-02af6a77206c] No waiting events found dispatching network-vif-plugged-2f53f520-423a-4791-b98b-6be90f9d5f55 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:40:57 user nova-compute[73449]: WARNING nova.compute.manager [req-ecbc4015-5013-4a3c-97dc-dcf476804b20 req-9cb3dc96-d16b-4259-a559-672ef39b25d1 service nova] [instance: c7ef11da-09ce-47a1-ba56-02af6a77206c] Received unexpected event network-vif-plugged-2f53f520-423a-4791-b98b-6be90f9d5f55 for instance with vm_state active and task_state None.
Aug 17 11:40:57 user nova-compute[73449]: DEBUG nova.compute.manager [req-ecbc4015-5013-4a3c-97dc-dcf476804b20 req-9cb3dc96-d16b-4259-a559-672ef39b25d1 service nova] [instance: c7ef11da-09ce-47a1-ba56-02af6a77206c] Received event network-vif-plugged-2f53f520-423a-4791-b98b-6be90f9d5f55 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:40:57 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-ecbc4015-5013-4a3c-97dc-dcf476804b20 req-9cb3dc96-d16b-4259-a559-672ef39b25d1 service nova] Acquiring lock "c7ef11da-09ce-47a1-ba56-02af6a77206c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:40:57 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-ecbc4015-5013-4a3c-97dc-dcf476804b20 req-9cb3dc96-d16b-4259-a559-672ef39b25d1 service nova] Lock "c7ef11da-09ce-47a1-ba56-02af6a77206c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:40:57 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-ecbc4015-5013-4a3c-97dc-dcf476804b20 req-9cb3dc96-d16b-4259-a559-672ef39b25d1 service nova] Lock "c7ef11da-09ce-47a1-ba56-02af6a77206c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:40:57 user nova-compute[73449]: DEBUG nova.compute.manager [req-ecbc4015-5013-4a3c-97dc-dcf476804b20 req-9cb3dc96-d16b-4259-a559-672ef39b25d1 service nova] [instance: c7ef11da-09ce-47a1-ba56-02af6a77206c] No waiting events found dispatching network-vif-plugged-2f53f520-423a-4791-b98b-6be90f9d5f55 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:40:57 user nova-compute[73449]: WARNING nova.compute.manager [req-ecbc4015-5013-4a3c-97dc-dcf476804b20 req-9cb3dc96-d16b-4259-a559-672ef39b25d1 service nova] [instance: c7ef11da-09ce-47a1-ba56-02af6a77206c] Received unexpected event network-vif-plugged-2f53f520-423a-4791-b98b-6be90f9d5f55 for instance with vm_state active and task_state None.
Aug 17 11:41:00 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:41:01 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:41:05 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:41:06 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:41:10 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:41:11 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:41:15 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:41:20 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:41:24 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Acquiring lock "b8e1def1-8303-4257-b9b5-0050f05cf2d0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:41:24 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Lock "b8e1def1-8303-4257-b9b5-0050f05cf2d0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:41:24 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Starting instance... {{(pid=73449) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 11:41:25 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:41:25 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:41:25 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73449) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 11:41:25 user nova-compute[73449]: INFO nova.compute.claims [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Claim successful on node user
Aug 17 11:41:25 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:41:25 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:41:25 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73449) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 11:41:25 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 11:41:25 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 11:41:25 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:41:25 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Refreshing inventories for resource provider 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 17 11:41:25 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Updating ProviderTree inventory for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 17 11:41:25 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Updating inventory in ProviderTree for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 11:41:25 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Refreshing aggregate associations for resource provider 20986bee-3f54-4b89-bec1-f8387ef700c4, aggregates: None {{(pid=73449) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 17 11:41:25 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Refreshing trait associations for resource provider 20986bee-3f54-4b89-bec1-f8387ef700c4, traits: COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NODE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE42,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSSE3,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_ISO {{(pid=73449) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 17 11:41:25 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 11:41:25 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 11:41:25 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.683s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:41:25 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Start building networks asynchronously for instance. {{(pid=73449) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 11:41:25 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Allocating IP information in the background. {{(pid=73449) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 11:41:25 user nova-compute[73449]: DEBUG nova.network.neutron [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] allocate_for_instance() {{(pid=73449) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 11:41:26 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 11:41:26 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Start building block device mappings for instance. {{(pid=73449) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 11:41:26 user nova-compute[73449]: INFO nova.virt.block_device [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Booting with volume 40bc2deb-5334-44c4-ae15-1c30e668ae47 at /dev/vda
Aug 17 11:41:26 user nova-compute[73449]: DEBUG nova.policy [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'be158f2bab204b3f874727a655b4bbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c18371fa6246888a742164afd60242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73449) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 11:41:26 user nova-compute[73449]: DEBUG os_brick.utils [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 11:41:26 user nova-compute[73449]: INFO oslo.privsep.daemon [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpx93sq6lj/privsep.sock']
Aug 17 11:41:26 user sudo[84285]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpx93sq6lj/privsep.sock
Aug 17 11:41:26 user sudo[84285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 17 11:41:27 user nova-compute[73449]: DEBUG nova.network.neutron [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Successfully created port: c877b9e9-f45c-4199-960c-2b9926518803 {{(pid=73449) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 11:41:27 user nova-compute[73449]: DEBUG nova.network.neutron [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Successfully created port: f9c9fca3-8f9c-4ea9-8ceb-ed19cb265786 {{(pid=73449) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 11:41:27 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Acquiring lock "f33a7013-82d0-477c-aa5e-b27e63f2b98d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:41:27 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Lock "f33a7013-82d0-477c-aa5e-b27e63f2b98d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:41:27 user nova-compute[73449]: DEBUG nova.compute.manager [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Starting instance... {{(pid=73449) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 11:41:27 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:41:27 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:41:27 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73449) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 11:41:27 user nova-compute[73449]: INFO nova.compute.claims [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Claim successful on node user
Aug 17 11:41:28 user nova-compute[73449]: DEBUG nova.network.neutron [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Successfully created port: 6888cb29-a1bc-42b0-bec3-57667e1b0350 {{(pid=73449) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 11:41:28 user sudo[84285]: pam_unix(sudo:session): session closed for user root
Aug 17 11:41:28 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 11:41:28 user nova-compute[73449]: INFO oslo.privsep.daemon [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Spawned new privsep daemon via rootwrap
Aug 17 11:41:28 user nova-compute[73449]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 17 11:41:28 user nova-compute[73449]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 17 11:41:28 user nova-compute[73449]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Aug 17 11:41:28 user nova-compute[73449]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84309
Aug 17 11:41:28 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[43b5c582-71d3-4288-bae1-fa0fb46c79a8]: (2,) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:41:28 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 11:41:28 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.448s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:41:28 user nova-compute[73449]: DEBUG nova.compute.manager [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Start building networks asynchronously for instance. {{(pid=73449) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 11:41:28 user nova-compute[73449]: DEBUG nova.compute.manager [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Allocating IP information in the background. {{(pid=73449) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 11:41:28 user nova-compute[73449]: DEBUG nova.network.neutron [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] allocate_for_instance() {{(pid=73449) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 11:41:28 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 11:41:28 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:41:28 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:41:28 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[123eb177-926c-4474-a0d4-0da49d84d31a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4d3924302012\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:41:28 user nova-compute[73449]: WARNING os_brick.initiator.connectors.nvmeof [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Aug 17 11:41:28 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:41:28 user nova-compute[73449]: DEBUG nova.compute.manager [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Start building block device mappings for instance. {{(pid=73449) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 11:41:28 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.105s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:41:28 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[b171ec1b-b159-439e-9cb9-50adc45a38c5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:41:28 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:41:28 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:41:28 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[b829bb1f-c398-43d7-a7cb-4942aea441d4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:41:28 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d5240d1-fe0b-4301-8be5-8b5b3721f2b9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:41:28 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Running cmd (subprocess): nvme version {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:41:28 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] 'nvme version' failed. Not Retrying. {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 11:41:28 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] nvme not present on system {{(pid=73449) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 11:41:28 user nova-compute[73449]: INFO nova.virt.block_device [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Booting with volume a6721389-fe15-4237-a595-2aa18e8ca919 at /dev/vda
Aug 17 11:41:28 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:41:28 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 11:41:28 user nova-compute[73449]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 11:41:28 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a1ef249-5822-435c-bea7-1f35fbc26802]: (4, '') {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:41:28 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73449) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 11:41:28 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73449) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 11:41:28 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] LIGHTOS: no hostnqn found. {{(pid=73449) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 11:41:28 user nova-compute[73449]: DEBUG os_brick.utils [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] <== get_connector_properties: return (2508ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4d3924302012', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 11:41:28 user nova-compute[73449]: DEBUG nova.virt.block_device [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Updating existing volume attachment record: af64f943-ece3-4a5b-a05f-e61901452800 {{(pid=73449) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 11:41:28 user nova-compute[73449]: DEBUG os_brick.utils [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 11:41:28 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:41:28 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:41:28 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[399b3388-6994-4a37-bbac-f35939a89e7e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4d3924302012\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:41:28 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:41:28 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:41:28 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[30cd5ef5-f322-4d3e-8a25-defb4aa7cc86]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:41:28 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:41:28 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:41:28 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[b255e07e-f3dd-473f-92fe-569d087586ec]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:41:28 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[09dfd6f1-9a47-4afc-a92f-443a42a2bc34]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:41:28 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Running cmd (subprocess): nvme version {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:41:29 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] 'nvme version' failed. Not Retrying. {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 11:41:29 user nova-compute[73449]: DEBUG nova.policy [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '092033fd15e74b859f9dc209f70841db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e6d918a4554cd89d9f40cee2a55d00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73449) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 11:41:29 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] nvme not present on system {{(pid=73449) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 11:41:29 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:41:29 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 11:41:29 user nova-compute[73449]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 11:41:29 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[fddd6ed1-f986-45d1-aa00-389f2e62457d]: (4, '') {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:41:29 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73449) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 11:41:29 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73449) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 11:41:29 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] LIGHTOS: no hostnqn found. {{(pid=73449) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 11:41:29 user nova-compute[73449]: DEBUG os_brick.utils [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4d3924302012', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 11:41:29 user nova-compute[73449]: DEBUG nova.virt.block_device [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Updating existing volume attachment record: a3c1c596-857d-4d35-bc3c-222facc8ab34 {{(pid=73449) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 11:41:29 user nova-compute[73449]: DEBUG nova.network.neutron [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Successfully created port: d85896ce-110a-41d6-a20e-6beaecb36b97 {{(pid=73449) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 11:41:30 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:41:30 user nova-compute[73449]: DEBUG nova.network.neutron [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Successfully created port: d2d51361-0f1a-41aa-89e2-c2211bbd0b42 {{(pid=73449) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 11:41:30 user nova-compute[73449]: DEBUG nova.network.neutron [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Successfully created port: 671f57db-57f1-4ba3-9e49-ebe4816404f6 {{(pid=73449) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 11:41:31 user nova-compute[73449]: DEBUG nova.network.neutron [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Successfully created port: 6fbc9ad6-da42-4492-8603-9efc7294dbab {{(pid=73449) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 11:41:31 user nova-compute[73449]: DEBUG nova.network.neutron [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Successfully updated port: c877b9e9-f45c-4199-960c-2b9926518803 {{(pid=73449) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 11:41:31 user nova-compute[73449]: DEBUG nova.compute.manager [req-219b12dc-4984-4461-a873-e0f307ad61af req-b43d37fa-392c-427d-adc1-f3fe83974e04 service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Received event network-changed-c877b9e9-f45c-4199-960c-2b9926518803 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:41:31 user nova-compute[73449]: DEBUG nova.compute.manager [req-219b12dc-4984-4461-a873-e0f307ad61af req-b43d37fa-392c-427d-adc1-f3fe83974e04 service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Refreshing instance network info cache due to event network-changed-c877b9e9-f45c-4199-960c-2b9926518803. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 11:41:31 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-219b12dc-4984-4461-a873-e0f307ad61af req-b43d37fa-392c-427d-adc1-f3fe83974e04 service nova] Acquiring lock "refresh_cache-b8e1def1-8303-4257-b9b5-0050f05cf2d0" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:41:31 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-219b12dc-4984-4461-a873-e0f307ad61af req-b43d37fa-392c-427d-adc1-f3fe83974e04 service nova] Acquired lock "refresh_cache-b8e1def1-8303-4257-b9b5-0050f05cf2d0" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:41:31 user nova-compute[73449]: DEBUG nova.network.neutron [req-219b12dc-4984-4461-a873-e0f307ad61af req-b43d37fa-392c-427d-adc1-f3fe83974e04 service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Refreshing network info cache for port c877b9e9-f45c-4199-960c-2b9926518803 {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 11:41:32 user nova-compute[73449]: DEBUG nova.network.neutron [req-219b12dc-4984-4461-a873-e0f307ad61af req-b43d37fa-392c-427d-adc1-f3fe83974e04 service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Instance cache missing network info. {{(pid=73449) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 11:41:32 user nova-compute[73449]: DEBUG nova.network.neutron [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Successfully created port: 854609a6-03f0-416c-8bbf-b5f85d13c688 {{(pid=73449) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 11:41:32 user nova-compute[73449]: DEBUG nova.network.neutron [req-219b12dc-4984-4461-a873-e0f307ad61af req-b43d37fa-392c-427d-adc1-f3fe83974e04 service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Updating instance_info_cache with network_info: [] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:41:32 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-219b12dc-4984-4461-a873-e0f307ad61af req-b43d37fa-392c-427d-adc1-f3fe83974e04 service nova] Releasing lock "refresh_cache-b8e1def1-8303-4257-b9b5-0050f05cf2d0" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:41:33 user nova-compute[73449]: DEBUG nova.network.neutron [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Successfully updated port: 71d82cc1-6895-4d52-b066-0a01a61b329b {{(pid=73449) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 11:41:33 user nova-compute[73449]: DEBUG nova.network.neutron [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Successfully created port: f04e7eb7-1170-4981-b342-44c664ef4c84 {{(pid=73449) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 11:41:33 user nova-compute[73449]: DEBUG nova.compute.manager [req-a29bb47d-cef9-494a-a5a1-c5651ab5dbcf req-4c200bf5-993b-4f85-a9a2-cf1ad664ed1d service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Received event network-changed-71d82cc1-6895-4d52-b066-0a01a61b329b {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:41:33 user nova-compute[73449]: DEBUG nova.compute.manager [req-a29bb47d-cef9-494a-a5a1-c5651ab5dbcf req-4c200bf5-993b-4f85-a9a2-cf1ad664ed1d service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Refreshing instance network info cache due to event network-changed-71d82cc1-6895-4d52-b066-0a01a61b329b. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 11:41:33 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-a29bb47d-cef9-494a-a5a1-c5651ab5dbcf req-4c200bf5-993b-4f85-a9a2-cf1ad664ed1d service nova] Acquiring lock "refresh_cache-b8e1def1-8303-4257-b9b5-0050f05cf2d0" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:41:33 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-a29bb47d-cef9-494a-a5a1-c5651ab5dbcf req-4c200bf5-993b-4f85-a9a2-cf1ad664ed1d service nova] Acquired lock "refresh_cache-b8e1def1-8303-4257-b9b5-0050f05cf2d0" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:41:33 user nova-compute[73449]: DEBUG nova.network.neutron [req-a29bb47d-cef9-494a-a5a1-c5651ab5dbcf req-4c200bf5-993b-4f85-a9a2-cf1ad664ed1d service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Refreshing network info cache for port 71d82cc1-6895-4d52-b066-0a01a61b329b {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 11:41:34 user nova-compute[73449]: DEBUG nova.network.neutron [req-a29bb47d-cef9-494a-a5a1-c5651ab5dbcf req-4c200bf5-993b-4f85-a9a2-cf1ad664ed1d service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Instance cache missing network info. {{(pid=73449) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 11:41:34 user nova-compute[73449]: DEBUG nova.network.neutron [req-a29bb47d-cef9-494a-a5a1-c5651ab5dbcf req-4c200bf5-993b-4f85-a9a2-cf1ad664ed1d service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Updating instance_info_cache with network_info: [] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:41:34 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-a29bb47d-cef9-494a-a5a1-c5651ab5dbcf req-4c200bf5-993b-4f85-a9a2-cf1ad664ed1d service nova] Releasing lock "refresh_cache-b8e1def1-8303-4257-b9b5-0050f05cf2d0" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:41:34 user nova-compute[73449]: DEBUG nova.network.neutron [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Successfully created port: c69d3b48-1443-4999-8369-8c5f61b35697 {{(pid=73449) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 11:41:35 user nova-compute[73449]: DEBUG nova.network.neutron [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Successfully updated port: b3fe8f9e-5b75-440e-b1c1-f888a4e91e9e {{(pid=73449) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 11:41:35 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:41:35 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:41:35 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73449) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 11:41:35 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 11:41:35 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 11:41:35 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:41:36 user nova-compute[73449]: DEBUG nova.compute.manager [req-0ffe1993-eeed-42d2-a5fa-5e33c2db9053 req-f5d2d1da-2443-49cd-b32a-d27a3f5a08a0 service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Received event network-changed-b3fe8f9e-5b75-440e-b1c1-f888a4e91e9e {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:41:36 user nova-compute[73449]: DEBUG nova.compute.manager [req-0ffe1993-eeed-42d2-a5fa-5e33c2db9053 req-f5d2d1da-2443-49cd-b32a-d27a3f5a08a0 service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Refreshing instance network info cache due to event network-changed-b3fe8f9e-5b75-440e-b1c1-f888a4e91e9e. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 11:41:36 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-0ffe1993-eeed-42d2-a5fa-5e33c2db9053 req-f5d2d1da-2443-49cd-b32a-d27a3f5a08a0 service nova] Acquiring lock "refresh_cache-b8e1def1-8303-4257-b9b5-0050f05cf2d0" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:41:36 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-0ffe1993-eeed-42d2-a5fa-5e33c2db9053 req-f5d2d1da-2443-49cd-b32a-d27a3f5a08a0 service nova] Acquired lock "refresh_cache-b8e1def1-8303-4257-b9b5-0050f05cf2d0" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:41:36 user nova-compute[73449]: DEBUG nova.network.neutron [req-0ffe1993-eeed-42d2-a5fa-5e33c2db9053 req-f5d2d1da-2443-49cd-b32a-d27a3f5a08a0 service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Refreshing network info cache for port b3fe8f9e-5b75-440e-b1c1-f888a4e91e9e {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 11:41:36 user nova-compute[73449]: DEBUG nova.network.neutron [req-0ffe1993-eeed-42d2-a5fa-5e33c2db9053 req-f5d2d1da-2443-49cd-b32a-d27a3f5a08a0 service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Instance cache missing network info. {{(pid=73449) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 11:41:36 user nova-compute[73449]: DEBUG nova.network.neutron [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Successfully updated port: d2d51361-0f1a-41aa-89e2-c2211bbd0b42 {{(pid=73449) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 11:41:36 user nova-compute[73449]: DEBUG nova.network.neutron [req-0ffe1993-eeed-42d2-a5fa-5e33c2db9053 req-f5d2d1da-2443-49cd-b32a-d27a3f5a08a0 service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Updating instance_info_cache with network_info: [] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:41:36 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-0ffe1993-eeed-42d2-a5fa-5e33c2db9053 req-f5d2d1da-2443-49cd-b32a-d27a3f5a08a0 service nova] Releasing lock "refresh_cache-b8e1def1-8303-4257-b9b5-0050f05cf2d0" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:41:36 user nova-compute[73449]: DEBUG nova.network.neutron [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Successfully updated port: f9c9fca3-8f9c-4ea9-8ceb-ed19cb265786 {{(pid=73449) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 11:41:38 user nova-compute[73449]: DEBUG nova.compute.manager [req-f044671d-9127-4442-8308-94e70a305100 req-c6e3326c-cb13-4302-a03c-329ceabfcefe service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Received event network-changed-d2d51361-0f1a-41aa-89e2-c2211bbd0b42 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:41:38 user nova-compute[73449]: DEBUG nova.compute.manager [req-f044671d-9127-4442-8308-94e70a305100 req-c6e3326c-cb13-4302-a03c-329ceabfcefe service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Refreshing instance network info cache due to event network-changed-d2d51361-0f1a-41aa-89e2-c2211bbd0b42. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 11:41:38 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-f044671d-9127-4442-8308-94e70a305100 req-c6e3326c-cb13-4302-a03c-329ceabfcefe service nova] Acquiring lock "refresh_cache-f33a7013-82d0-477c-aa5e-b27e63f2b98d" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:41:38 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-f044671d-9127-4442-8308-94e70a305100 req-c6e3326c-cb13-4302-a03c-329ceabfcefe service nova] Acquired lock "refresh_cache-f33a7013-82d0-477c-aa5e-b27e63f2b98d" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:41:38 user nova-compute[73449]: DEBUG nova.network.neutron [req-f044671d-9127-4442-8308-94e70a305100 req-c6e3326c-cb13-4302-a03c-329ceabfcefe service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Refreshing network info cache for port d2d51361-0f1a-41aa-89e2-c2211bbd0b42 {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 11:41:38 user nova-compute[73449]: DEBUG nova.network.neutron [req-f044671d-9127-4442-8308-94e70a305100 req-c6e3326c-cb13-4302-a03c-329ceabfcefe service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Instance cache missing network info. {{(pid=73449) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 11:41:38 user nova-compute[73449]: DEBUG nova.network.neutron [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Successfully updated port: b14f4f1d-d140-4bb9-a4f2-abbaa8c98a2d {{(pid=73449) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 11:41:38 user nova-compute[73449]: DEBUG nova.network.neutron [req-f044671d-9127-4442-8308-94e70a305100 req-c6e3326c-cb13-4302-a03c-329ceabfcefe service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Updating instance_info_cache with network_info: [] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:41:38 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-f044671d-9127-4442-8308-94e70a305100 req-c6e3326c-cb13-4302-a03c-329ceabfcefe service nova] Releasing lock "refresh_cache-f33a7013-82d0-477c-aa5e-b27e63f2b98d" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:41:38 user nova-compute[73449]: DEBUG nova.compute.manager [req-f044671d-9127-4442-8308-94e70a305100 req-c6e3326c-cb13-4302-a03c-329ceabfcefe service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Received event network-changed-f9c9fca3-8f9c-4ea9-8ceb-ed19cb265786 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:41:38 user nova-compute[73449]: DEBUG nova.compute.manager [req-f044671d-9127-4442-8308-94e70a305100 req-c6e3326c-cb13-4302-a03c-329ceabfcefe service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Refreshing instance network info cache due to event network-changed-f9c9fca3-8f9c-4ea9-8ceb-ed19cb265786. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 11:41:38 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-f044671d-9127-4442-8308-94e70a305100 req-c6e3326c-cb13-4302-a03c-329ceabfcefe service nova] Acquiring lock "refresh_cache-b8e1def1-8303-4257-b9b5-0050f05cf2d0" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:41:38 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-f044671d-9127-4442-8308-94e70a305100 req-c6e3326c-cb13-4302-a03c-329ceabfcefe service nova] Acquired lock "refresh_cache-b8e1def1-8303-4257-b9b5-0050f05cf2d0" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:41:38 user nova-compute[73449]: DEBUG nova.network.neutron [req-f044671d-9127-4442-8308-94e70a305100 req-c6e3326c-cb13-4302-a03c-329ceabfcefe service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Refreshing network info cache for port f9c9fca3-8f9c-4ea9-8ceb-ed19cb265786 {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 11:41:38 user nova-compute[73449]: DEBUG nova.network.neutron [req-f044671d-9127-4442-8308-94e70a305100 req-c6e3326c-cb13-4302-a03c-329ceabfcefe service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Instance cache missing network info. {{(pid=73449) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 11:41:38 user nova-compute[73449]: DEBUG nova.network.neutron [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Successfully updated port: 6888cb29-a1bc-42b0-bec3-57667e1b0350 {{(pid=73449) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 11:41:38 user nova-compute[73449]: DEBUG nova.network.neutron [req-f044671d-9127-4442-8308-94e70a305100 req-c6e3326c-cb13-4302-a03c-329ceabfcefe service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Updating instance_info_cache with network_info: [] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:41:38 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-f044671d-9127-4442-8308-94e70a305100 req-c6e3326c-cb13-4302-a03c-329ceabfcefe service nova] Releasing lock "refresh_cache-b8e1def1-8303-4257-b9b5-0050f05cf2d0" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:41:40 user nova-compute[73449]: DEBUG nova.network.neutron [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Successfully updated port: d8233c69-cc4f-4ae8-93ee-7f41234f72ec {{(pid=73449) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 11:41:40 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:41:40 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:41:40 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73449) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 11:41:40 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 11:41:40 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 11:41:40 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:41:40 user nova-compute[73449]: DEBUG nova.compute.manager [req-3c8720e3-1785-477e-a3bb-726935463620 req-bd07a5ee-17d2-4a3c-badd-66ef3d925003 service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Received event network-changed-b14f4f1d-d140-4bb9-a4f2-abbaa8c98a2d {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:41:40 user nova-compute[73449]: DEBUG nova.compute.manager [req-3c8720e3-1785-477e-a3bb-726935463620 req-bd07a5ee-17d2-4a3c-badd-66ef3d925003 service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Refreshing instance network info cache due to event network-changed-b14f4f1d-d140-4bb9-a4f2-abbaa8c98a2d. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 11:41:40 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-3c8720e3-1785-477e-a3bb-726935463620 req-bd07a5ee-17d2-4a3c-badd-66ef3d925003 service nova] Acquiring lock "refresh_cache-f33a7013-82d0-477c-aa5e-b27e63f2b98d" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:41:40 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-3c8720e3-1785-477e-a3bb-726935463620 req-bd07a5ee-17d2-4a3c-badd-66ef3d925003 service nova] Acquired lock "refresh_cache-f33a7013-82d0-477c-aa5e-b27e63f2b98d" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:41:40 user nova-compute[73449]: DEBUG nova.network.neutron [req-3c8720e3-1785-477e-a3bb-726935463620 req-bd07a5ee-17d2-4a3c-badd-66ef3d925003 service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Refreshing network info cache for port b14f4f1d-d140-4bb9-a4f2-abbaa8c98a2d {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 11:41:40 user nova-compute[73449]: DEBUG nova.network.neutron [req-3c8720e3-1785-477e-a3bb-726935463620 req-bd07a5ee-17d2-4a3c-badd-66ef3d925003 service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Instance cache missing network info. {{(pid=73449) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 11:41:40 user nova-compute[73449]: DEBUG nova.network.neutron [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Successfully updated port: d85896ce-110a-41d6-a20e-6beaecb36b97 {{(pid=73449) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 11:41:40 user nova-compute[73449]: DEBUG nova.network.neutron [req-3c8720e3-1785-477e-a3bb-726935463620 req-bd07a5ee-17d2-4a3c-badd-66ef3d925003 service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Updating instance_info_cache with network_info: [] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:41:40 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-3c8720e3-1785-477e-a3bb-726935463620 req-bd07a5ee-17d2-4a3c-badd-66ef3d925003 service nova] Releasing lock "refresh_cache-f33a7013-82d0-477c-aa5e-b27e63f2b98d" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:41:40 user nova-compute[73449]: DEBUG nova.compute.manager [req-3c8720e3-1785-477e-a3bb-726935463620 req-bd07a5ee-17d2-4a3c-badd-66ef3d925003 service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Received event network-changed-6888cb29-a1bc-42b0-bec3-57667e1b0350 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:41:40 user nova-compute[73449]: DEBUG nova.compute.manager [req-3c8720e3-1785-477e-a3bb-726935463620 req-bd07a5ee-17d2-4a3c-badd-66ef3d925003 service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Refreshing instance network info cache due to event network-changed-6888cb29-a1bc-42b0-bec3-57667e1b0350. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 11:41:40 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-3c8720e3-1785-477e-a3bb-726935463620 req-bd07a5ee-17d2-4a3c-badd-66ef3d925003 service nova] Acquiring lock "refresh_cache-b8e1def1-8303-4257-b9b5-0050f05cf2d0" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:41:40 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-3c8720e3-1785-477e-a3bb-726935463620 req-bd07a5ee-17d2-4a3c-badd-66ef3d925003 service nova] Acquired lock "refresh_cache-b8e1def1-8303-4257-b9b5-0050f05cf2d0" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:41:40 user nova-compute[73449]: DEBUG nova.network.neutron [req-3c8720e3-1785-477e-a3bb-726935463620 req-bd07a5ee-17d2-4a3c-badd-66ef3d925003 service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Refreshing network info cache for port 6888cb29-a1bc-42b0-bec3-57667e1b0350 {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 11:41:40 user nova-compute[73449]: DEBUG nova.network.neutron [req-3c8720e3-1785-477e-a3bb-726935463620 req-bd07a5ee-17d2-4a3c-badd-66ef3d925003 service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Instance cache missing network info. {{(pid=73449) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 11:41:40 user nova-compute[73449]: DEBUG nova.network.neutron [req-3c8720e3-1785-477e-a3bb-726935463620 req-bd07a5ee-17d2-4a3c-badd-66ef3d925003 service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Updating instance_info_cache with network_info: [] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:41:40 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-3c8720e3-1785-477e-a3bb-726935463620 req-bd07a5ee-17d2-4a3c-badd-66ef3d925003 service nova] Releasing lock "refresh_cache-b8e1def1-8303-4257-b9b5-0050f05cf2d0" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:41:40 user nova-compute[73449]: DEBUG nova.compute.manager [req-3c8720e3-1785-477e-a3bb-726935463620 req-bd07a5ee-17d2-4a3c-badd-66ef3d925003 service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Received event network-changed-d8233c69-cc4f-4ae8-93ee-7f41234f72ec {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:41:40 user nova-compute[73449]: DEBUG nova.compute.manager [req-3c8720e3-1785-477e-a3bb-726935463620 req-bd07a5ee-17d2-4a3c-badd-66ef3d925003 service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Refreshing instance network info cache due to event network-changed-d8233c69-cc4f-4ae8-93ee-7f41234f72ec. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 11:41:40 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-3c8720e3-1785-477e-a3bb-726935463620 req-bd07a5ee-17d2-4a3c-badd-66ef3d925003 service nova] Acquiring lock "refresh_cache-f33a7013-82d0-477c-aa5e-b27e63f2b98d" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:41:40 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-3c8720e3-1785-477e-a3bb-726935463620 req-bd07a5ee-17d2-4a3c-badd-66ef3d925003 service nova] Acquired lock "refresh_cache-f33a7013-82d0-477c-aa5e-b27e63f2b98d" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:41:40 user nova-compute[73449]: DEBUG nova.network.neutron [req-3c8720e3-1785-477e-a3bb-726935463620 req-bd07a5ee-17d2-4a3c-badd-66ef3d925003 service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Refreshing network info cache for port d8233c69-cc4f-4ae8-93ee-7f41234f72ec {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 11:41:40 user nova-compute[73449]: DEBUG nova.network.neutron [req-3c8720e3-1785-477e-a3bb-726935463620 req-bd07a5ee-17d2-4a3c-badd-66ef3d925003 service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Instance cache missing network info. {{(pid=73449) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 11:41:40 user nova-compute[73449]: INFO nova.virt.block_device [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Booting with volume f7b8c3fd-4a28-4cfb-80b4-f11212488bda at /dev/vdb
Aug 17 11:41:40 user nova-compute[73449]: INFO nova.virt.block_device [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Booting with volume 8d09e821-98f2-459f-a7b2-3a77e57f1b4e at /dev/vdb
Aug 17 11:41:41 user nova-compute[73449]: DEBUG os_brick.utils [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 11:41:41 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:41:41 user nova-compute[73449]: DEBUG os_brick.utils [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 11:41:41 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:41:41 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:41:41 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[627c6683-6545-4b0f-aef5-ecd35abbfcf5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4d3924302012\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:41:41 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:41:41 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:41:41 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9e6a1b9-1f4e-4f26-b837-bf94cecb3e5a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4d3924302012\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:41:41 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:41:41 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:41:41 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[181e8e6a-963c-4d95-a50e-c59d9486792a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:41:41 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:41:41 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:41:41 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[70156097-db16-4aa7-8ffe-d89d7eb52160]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:41:41 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:41:41 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:41:41 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d736cd2-2e3f-43e7-919f-78db5aff7cdc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:41:41 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4199b90-0de4-4d5e-97e8-858c176743d8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:41:41 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Running cmd (subprocess): nvme version {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:41:41 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] 'nvme version' failed. Not Retrying. {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 11:41:41 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:41:41 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[58d11967-390f-411c-b9b9-05cf40bae5dd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:41:41 user nova-compute[73449]: DEBUG nova.network.neutron [req-3c8720e3-1785-477e-a3bb-726935463620 req-bd07a5ee-17d2-4a3c-badd-66ef3d925003 service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Updating instance_info_cache with network_info: [] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:41:41 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] nvme not present on system {{(pid=73449) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 11:41:41 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:41:41 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9501d6d-45df-487e-96e0-59f8fde230fe]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:41:41 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Running cmd (subprocess): nvme version {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:41:41 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] 'nvme version' failed. Not Retrying. {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 11:41:41 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 11:41:41 user nova-compute[73449]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 11:41:41 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a531fbf-39a0-4070-beb3-dd99ddb6e501]: (4, '') {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:41:41 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] nvme not present on system {{(pid=73449) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 11:41:41 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-3c8720e3-1785-477e-a3bb-726935463620 req-bd07a5ee-17d2-4a3c-badd-66ef3d925003 service nova] Releasing lock "refresh_cache-f33a7013-82d0-477c-aa5e-b27e63f2b98d" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:41:41 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73449) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 11:41:41 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73449) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 11:41:41 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] LIGHTOS: no hostnqn found. {{(pid=73449) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 11:41:41 user nova-compute[73449]: DEBUG os_brick.utils [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] <== get_connector_properties: return (179ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4d3924302012', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 11:41:41 user nova-compute[73449]: DEBUG nova.virt.block_device [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Updating existing volume attachment record: 4ec283cb-805b-416d-a840-23ac9d0a7247 {{(pid=73449) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 11:41:41 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:41:41 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 11:41:41 user nova-compute[73449]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 11:41:41 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[586734ed-2dbd-4216-9809-d4c474fa43f4]: (4, '') {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:41:41 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73449) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 11:41:41 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73449) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 11:41:41 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] LIGHTOS: no hostnqn found. {{(pid=73449) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 11:41:41 user nova-compute[73449]: DEBUG os_brick.utils [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] <== get_connector_properties: return (185ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4d3924302012', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 11:41:41 user nova-compute[73449]: DEBUG nova.virt.block_device [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Updating existing volume attachment record: 11c7e87a-bd7d-4019-87aa-57a912bf5fb1 {{(pid=73449) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 11:41:41 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:41:42 user nova-compute[73449]: DEBUG nova.network.neutron [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Successfully updated port: 6fbc9ad6-da42-4492-8603-9efc7294dbab {{(pid=73449) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 11:41:42 user nova-compute[73449]: DEBUG nova.network.neutron [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Successfully updated port: 671f57db-57f1-4ba3-9e49-ebe4816404f6 {{(pid=73449) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 11:41:42 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Acquiring lock "refresh_cache-b8e1def1-8303-4257-b9b5-0050f05cf2d0" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:41:42 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Acquired lock "refresh_cache-b8e1def1-8303-4257-b9b5-0050f05cf2d0" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:41:42 user nova-compute[73449]: DEBUG nova.network.neutron [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Building network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 11:41:42 user nova-compute[73449]: DEBUG nova.compute.manager [req-fc6efa76-7519-4bc7-958c-e25dbdd45683 req-ec2f96ff-a3b0-44fc-81ca-8eb7e9ed7640 service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Received event network-changed-d85896ce-110a-41d6-a20e-6beaecb36b97 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:41:42 user nova-compute[73449]: DEBUG nova.compute.manager [req-fc6efa76-7519-4bc7-958c-e25dbdd45683 req-ec2f96ff-a3b0-44fc-81ca-8eb7e9ed7640 service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Refreshing instance network info cache due to event network-changed-d85896ce-110a-41d6-a20e-6beaecb36b97. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 11:41:42 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-fc6efa76-7519-4bc7-958c-e25dbdd45683 req-ec2f96ff-a3b0-44fc-81ca-8eb7e9ed7640 service nova] Acquiring lock "refresh_cache-b8e1def1-8303-4257-b9b5-0050f05cf2d0" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:41:42 user nova-compute[73449]: DEBUG nova.network.neutron [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Instance cache missing network info. {{(pid=73449) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 11:41:43 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-613ecfa9-c56a-433d-afad-5bbc4eba3320 tempest-VolumesNegativeTest-353487240 tempest-VolumesNegativeTest-353487240-project-member] Acquiring lock "e3a9252c-0e0a-4c5c-a46f-eaa004479bd2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:41:43 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-613ecfa9-c56a-433d-afad-5bbc4eba3320 tempest-VolumesNegativeTest-353487240 tempest-VolumesNegativeTest-353487240-project-member] Lock "e3a9252c-0e0a-4c5c-a46f-eaa004479bd2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:41:43 user nova-compute[73449]: DEBUG nova.network.neutron [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Successfully updated port: 854609a6-03f0-416c-8bbf-b5f85d13c688 {{(pid=73449) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 11:41:43 user nova-compute[73449]: DEBUG nova.compute.manager [None req-613ecfa9-c56a-433d-afad-5bbc4eba3320 tempest-VolumesNegativeTest-353487240 tempest-VolumesNegativeTest-353487240-project-member] [instance: e3a9252c-0e0a-4c5c-a46f-eaa004479bd2] Starting instance... {{(pid=73449) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 11:41:44 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-613ecfa9-c56a-433d-afad-5bbc4eba3320 tempest-VolumesNegativeTest-353487240 tempest-VolumesNegativeTest-353487240-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:41:44 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-613ecfa9-c56a-433d-afad-5bbc4eba3320 tempest-VolumesNegativeTest-353487240 tempest-VolumesNegativeTest-353487240-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:41:44 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-613ecfa9-c56a-433d-afad-5bbc4eba3320 tempest-VolumesNegativeTest-353487240 tempest-VolumesNegativeTest-353487240-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73449) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 11:41:44 user nova-compute[73449]: INFO nova.compute.claims [None req-613ecfa9-c56a-433d-afad-5bbc4eba3320 tempest-VolumesNegativeTest-353487240 tempest-VolumesNegativeTest-353487240-project-member] [instance: e3a9252c-0e0a-4c5c-a46f-eaa004479bd2] Claim successful on node user
Aug 17 11:41:44 user nova-compute[73449]: DEBUG nova.compute.manager [req-9b075bb0-71a4-4e0d-b8ed-e6dc6434c39f req-95008644-286a-4fb7-8116-c55313ed96a1 service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Received event network-changed-854609a6-03f0-416c-8bbf-b5f85d13c688 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:41:44 user nova-compute[73449]: DEBUG nova.compute.manager [req-9b075bb0-71a4-4e0d-b8ed-e6dc6434c39f req-95008644-286a-4fb7-8116-c55313ed96a1 service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Refreshing instance network info cache due to event network-changed-854609a6-03f0-416c-8bbf-b5f85d13c688. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 11:41:44 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-9b075bb0-71a4-4e0d-b8ed-e6dc6434c39f req-95008644-286a-4fb7-8116-c55313ed96a1 service nova] Acquiring lock "refresh_cache-f33a7013-82d0-477c-aa5e-b27e63f2b98d" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:41:44 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-9b075bb0-71a4-4e0d-b8ed-e6dc6434c39f req-95008644-286a-4fb7-8116-c55313ed96a1 service nova] Acquired lock "refresh_cache-f33a7013-82d0-477c-aa5e-b27e63f2b98d" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:41:44 user nova-compute[73449]: DEBUG nova.network.neutron [req-9b075bb0-71a4-4e0d-b8ed-e6dc6434c39f req-95008644-286a-4fb7-8116-c55313ed96a1 service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Refreshing network info cache for port 854609a6-03f0-416c-8bbf-b5f85d13c688 {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 11:41:44 user nova-compute[73449]: DEBUG nova.network.neutron [req-9b075bb0-71a4-4e0d-b8ed-e6dc6434c39f req-95008644-286a-4fb7-8116-c55313ed96a1 service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Instance cache missing network info. {{(pid=73449) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 11:41:44 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-613ecfa9-c56a-433d-afad-5bbc4eba3320 tempest-VolumesNegativeTest-353487240 tempest-VolumesNegativeTest-353487240-project-member] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 11:41:44 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-613ecfa9-c56a-433d-afad-5bbc4eba3320 tempest-VolumesNegativeTest-353487240 tempest-VolumesNegativeTest-353487240-project-member] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 11:41:44 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-613ecfa9-c56a-433d-afad-5bbc4eba3320 tempest-VolumesNegativeTest-353487240 tempest-VolumesNegativeTest-353487240-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.598s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:41:44 user nova-compute[73449]: DEBUG nova.compute.manager [None req-613ecfa9-c56a-433d-afad-5bbc4eba3320 tempest-VolumesNegativeTest-353487240 tempest-VolumesNegativeTest-353487240-project-member] [instance: e3a9252c-0e0a-4c5c-a46f-eaa004479bd2] Start building networks asynchronously for instance. {{(pid=73449) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 11:41:44 user nova-compute[73449]: DEBUG nova.compute.manager [None req-613ecfa9-c56a-433d-afad-5bbc4eba3320 tempest-VolumesNegativeTest-353487240 tempest-VolumesNegativeTest-353487240-project-member] [instance: e3a9252c-0e0a-4c5c-a46f-eaa004479bd2] Allocating IP information in the background. {{(pid=73449) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 11:41:44 user nova-compute[73449]: DEBUG nova.network.neutron [None req-613ecfa9-c56a-433d-afad-5bbc4eba3320 tempest-VolumesNegativeTest-353487240 tempest-VolumesNegativeTest-353487240-project-member] [instance: e3a9252c-0e0a-4c5c-a46f-eaa004479bd2] allocate_for_instance() {{(pid=73449) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 11:41:44 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-613ecfa9-c56a-433d-afad-5bbc4eba3320 tempest-VolumesNegativeTest-353487240 tempest-VolumesNegativeTest-353487240-project-member] [instance: e3a9252c-0e0a-4c5c-a46f-eaa004479bd2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 11:41:44 user nova-compute[73449]: DEBUG nova.network.neutron [req-9b075bb0-71a4-4e0d-b8ed-e6dc6434c39f req-95008644-286a-4fb7-8116-c55313ed96a1 service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Updating instance_info_cache with network_info: [] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:41:44 user nova-compute[73449]: DEBUG nova.compute.manager [None req-613ecfa9-c56a-433d-afad-5bbc4eba3320 tempest-VolumesNegativeTest-353487240 tempest-VolumesNegativeTest-353487240-project-member] [instance: e3a9252c-0e0a-4c5c-a46f-eaa004479bd2] Start building block device mappings for instance. {{(pid=73449) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 11:41:44 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-9b075bb0-71a4-4e0d-b8ed-e6dc6434c39f req-95008644-286a-4fb7-8116-c55313ed96a1 service nova] Releasing lock "refresh_cache-f33a7013-82d0-477c-aa5e-b27e63f2b98d" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:41:44 user nova-compute[73449]: DEBUG nova.compute.manager [None req-613ecfa9-c56a-433d-afad-5bbc4eba3320 tempest-VolumesNegativeTest-353487240 tempest-VolumesNegativeTest-353487240-project-member] [instance: e3a9252c-0e0a-4c5c-a46f-eaa004479bd2] Start spawning the instance on the hypervisor. {{(pid=73449) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 11:41:44 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-613ecfa9-c56a-433d-afad-5bbc4eba3320 tempest-VolumesNegativeTest-353487240 tempest-VolumesNegativeTest-353487240-project-member] [instance: e3a9252c-0e0a-4c5c-a46f-eaa004479bd2] Creating instance directory {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 11:41:44 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-613ecfa9-c56a-433d-afad-5bbc4eba3320 tempest-VolumesNegativeTest-353487240 tempest-VolumesNegativeTest-353487240-project-member] [instance: e3a9252c-0e0a-4c5c-a46f-eaa004479bd2] Creating image(s)
Aug 17 11:41:44 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-613ecfa9-c56a-433d-afad-5bbc4eba3320 tempest-VolumesNegativeTest-353487240 tempest-VolumesNegativeTest-353487240-project-member] Acquiring lock "/opt/stack/data/nova/instances/e3a9252c-0e0a-4c5c-a46f-eaa004479bd2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:41:44 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-613ecfa9-c56a-433d-afad-5bbc4eba3320 tempest-VolumesNegativeTest-353487240 tempest-VolumesNegativeTest-353487240-project-member] Lock "/opt/stack/data/nova/instances/e3a9252c-0e0a-4c5c-a46f-eaa004479bd2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:41:44 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-613ecfa9-c56a-433d-afad-5bbc4eba3320 tempest-VolumesNegativeTest-353487240 tempest-VolumesNegativeTest-353487240-project-member] Lock "/opt/stack/data/nova/instances/e3a9252c-0e0a-4c5c-a46f-eaa004479bd2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:41:44 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-613ecfa9-c56a-433d-afad-5bbc4eba3320 tempest-VolumesNegativeTest-353487240 tempest-VolumesNegativeTest-353487240-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:41:44 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:41:44 user nova-compute[73449]: DEBUG nova.policy [None req-613ecfa9-c56a-433d-afad-5bbc4eba3320 tempest-VolumesNegativeTest-353487240 tempest-VolumesNegativeTest-353487240-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aae80a28db1d4999937d418adf6e5f85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc04aafe1594cb5b33594577bc2c2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73449) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 11:41:44 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:41:44 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Starting heal instance info cache {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 11:41:45 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-613ecfa9-c56a-433d-afad-5bbc4eba3320 tempest-VolumesNegativeTest-353487240 tempest-VolumesNegativeTest-353487240-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json" returned: 0 in 0.220s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:41:45 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-613ecfa9-c56a-433d-afad-5bbc4eba3320 tempest-VolumesNegativeTest-353487240 tempest-VolumesNegativeTest-353487240-project-member] Acquiring lock "7e267a577c062ee862e95ede6b48cfd5632f3ea3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:41:45 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-613ecfa9-c56a-433d-afad-5bbc4eba3320 tempest-VolumesNegativeTest-353487240 tempest-VolumesNegativeTest-353487240-project-member] Lock "7e267a577c062ee862e95ede6b48cfd5632f3ea3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:41:45 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-613ecfa9-c56a-433d-afad-5bbc4eba3320 tempest-VolumesNegativeTest-353487240 tempest-VolumesNegativeTest-353487240-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:41:45 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "refresh_cache-4a9e8ad2-19db-4975-87e4-2efce603a7d7" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:41:45 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquired lock "refresh_cache-4a9e8ad2-19db-4975-87e4-2efce603a7d7" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:41:45 user nova-compute[73449]: DEBUG nova.network.neutron [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: 4a9e8ad2-19db-4975-87e4-2efce603a7d7] Forcefully refreshing network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 11:41:45 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:41:45 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-613ecfa9-c56a-433d-afad-5bbc4eba3320 tempest-VolumesNegativeTest-353487240 tempest-VolumesNegativeTest-353487240-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json" returned: 0 in 0.200s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:41:45 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-613ecfa9-c56a-433d-afad-5bbc4eba3320 tempest-VolumesNegativeTest-353487240 tempest-VolumesNegativeTest-353487240-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3,backing_fmt=raw /opt/stack/data/nova/instances/e3a9252c-0e0a-4c5c-a46f-eaa004479bd2/disk 1073741824 {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:41:45 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-613ecfa9-c56a-433d-afad-5bbc4eba3320 tempest-VolumesNegativeTest-353487240 tempest-VolumesNegativeTest-353487240-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3,backing_fmt=raw /opt/stack/data/nova/instances/e3a9252c-0e0a-4c5c-a46f-eaa004479bd2/disk 1073741824" returned: 0 in 0.067s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:41:45 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-613ecfa9-c56a-433d-afad-5bbc4eba3320 tempest-VolumesNegativeTest-353487240 tempest-VolumesNegativeTest-353487240-project-member] Lock "7e267a577c062ee862e95ede6b48cfd5632f3ea3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.273s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:41:45 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-613ecfa9-c56a-433d-afad-5bbc4eba3320 tempest-VolumesNegativeTest-353487240 tempest-VolumesNegativeTest-353487240-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:41:45 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-613ecfa9-c56a-433d-afad-5bbc4eba3320 tempest-VolumesNegativeTest-353487240 tempest-VolumesNegativeTest-353487240-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json" returned: 0 in 0.204s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:41:45 user nova-compute[73449]: DEBUG nova.virt.disk.api [None req-613ecfa9-c56a-433d-afad-5bbc4eba3320 tempest-VolumesNegativeTest-353487240 tempest-VolumesNegativeTest-353487240-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e3a9252c-0e0a-4c5c-a46f-eaa004479bd2/disk. size=1073741824 {{(pid=73449) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 11:41:45 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-613ecfa9-c56a-433d-afad-5bbc4eba3320 tempest-VolumesNegativeTest-353487240 tempest-VolumesNegativeTest-353487240-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3a9252c-0e0a-4c5c-a46f-eaa004479bd2/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:41:45 user nova-compute[73449]: DEBUG nova.network.neutron [None req-613ecfa9-c56a-433d-afad-5bbc4eba3320 tempest-VolumesNegativeTest-353487240 tempest-VolumesNegativeTest-353487240-project-member] [instance: e3a9252c-0e0a-4c5c-a46f-eaa004479bd2] Successfully created port: fec2c3eb-3fd7-4804-8474-6105b30373aa {{(pid=73449) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 11:41:45 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-613ecfa9-c56a-433d-afad-5bbc4eba3320 tempest-VolumesNegativeTest-353487240 tempest-VolumesNegativeTest-353487240-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3a9252c-0e0a-4c5c-a46f-eaa004479bd2/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:41:45 user nova-compute[73449]: DEBUG nova.virt.disk.api [None req-613ecfa9-c56a-433d-afad-5bbc4eba3320 tempest-VolumesNegativeTest-353487240 tempest-VolumesNegativeTest-353487240-project-member] Cannot resize image /opt/stack/data/nova/instances/e3a9252c-0e0a-4c5c-a46f-eaa004479bd2/disk to a smaller size. {{(pid=73449) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 11:41:45 user nova-compute[73449]: DEBUG nova.objects.instance [None req-613ecfa9-c56a-433d-afad-5bbc4eba3320 tempest-VolumesNegativeTest-353487240 tempest-VolumesNegativeTest-353487240-project-member] Lazy-loading 'migration_context' on Instance uuid e3a9252c-0e0a-4c5c-a46f-eaa004479bd2 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:41:45 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-613ecfa9-c56a-433d-afad-5bbc4eba3320 tempest-VolumesNegativeTest-353487240 tempest-VolumesNegativeTest-353487240-project-member] [instance: e3a9252c-0e0a-4c5c-a46f-eaa004479bd2] Created local disks {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 11:41:45 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-613ecfa9-c56a-433d-afad-5bbc4eba3320 tempest-VolumesNegativeTest-353487240 tempest-VolumesNegativeTest-353487240-project-member] [instance: e3a9252c-0e0a-4c5c-a46f-eaa004479bd2] Ensure instance console log exists: /opt/stack/data/nova/instances/e3a9252c-0e0a-4c5c-a46f-eaa004479bd2/console.log {{(pid=73449) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 11:41:45 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-613ecfa9-c56a-433d-afad-5bbc4eba3320 tempest-VolumesNegativeTest-353487240 tempest-VolumesNegativeTest-353487240-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:41:45 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-613ecfa9-c56a-433d-afad-5bbc4eba3320 tempest-VolumesNegativeTest-353487240 tempest-VolumesNegativeTest-353487240-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:41:45 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-613ecfa9-c56a-433d-afad-5bbc4eba3320 tempest-VolumesNegativeTest-353487240 tempest-VolumesNegativeTest-353487240-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:41:45 user nova-compute[73449]: DEBUG nova.network.neutron [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: 4a9e8ad2-19db-4975-87e4-2efce603a7d7] Updating instance_info_cache with network_info: [{"id": "3c5f8e97-0654-42f0-9575-eab6d833283a", "address": "fa:16:3e:c8:b7:51", "network": {"id": "72c50a42-688f-4868-8e19-c40b103a49cd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1792423641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "068c5270255744a18208a0ad9b35f168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c5f8e97-06", "ovs_interfaceid": "3c5f8e97-0654-42f0-9575-eab6d833283a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:41:45 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Releasing lock "refresh_cache-4a9e8ad2-19db-4975-87e4-2efce603a7d7" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:41:45 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: 4a9e8ad2-19db-4975-87e4-2efce603a7d7] Updated the network info_cache for instance {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 11:41:45 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:41:45 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:41:45 user nova-compute[73449]: DEBUG nova.network.neutron [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Successfully updated port: f04e7eb7-1170-4981-b342-44c664ef4c84 {{(pid=73449) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 11:41:46 user nova-compute[73449]: DEBUG nova.compute.manager [req-8f67861f-dc1c-4134-9217-0931a8410e9b req-f93ff0b9-2c6c-406e-8f36-9b8ae34e51ae service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Received event network-changed-f04e7eb7-1170-4981-b342-44c664ef4c84 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:41:46 user nova-compute[73449]: DEBUG nova.compute.manager [req-8f67861f-dc1c-4134-9217-0931a8410e9b req-f93ff0b9-2c6c-406e-8f36-9b8ae34e51ae service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Refreshing instance network info cache due to event network-changed-f04e7eb7-1170-4981-b342-44c664ef4c84. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 11:41:46 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-8f67861f-dc1c-4134-9217-0931a8410e9b req-f93ff0b9-2c6c-406e-8f36-9b8ae34e51ae service nova] Acquiring lock "refresh_cache-f33a7013-82d0-477c-aa5e-b27e63f2b98d" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:41:46 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-8f67861f-dc1c-4134-9217-0931a8410e9b req-f93ff0b9-2c6c-406e-8f36-9b8ae34e51ae service nova] Acquired lock "refresh_cache-f33a7013-82d0-477c-aa5e-b27e63f2b98d" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:41:46 user nova-compute[73449]: DEBUG nova.network.neutron [req-8f67861f-dc1c-4134-9217-0931a8410e9b req-f93ff0b9-2c6c-406e-8f36-9b8ae34e51ae service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Refreshing network info cache for port f04e7eb7-1170-4981-b342-44c664ef4c84 {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 11:41:46 user nova-compute[73449]: DEBUG nova.network.neutron [None req-613ecfa9-c56a-433d-afad-5bbc4eba3320 tempest-VolumesNegativeTest-353487240 tempest-VolumesNegativeTest-353487240-project-member] [instance: e3a9252c-0e0a-4c5c-a46f-eaa004479bd2] Successfully updated port: fec2c3eb-3fd7-4804-8474-6105b30373aa {{(pid=73449) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 11:41:46 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-613ecfa9-c56a-433d-afad-5bbc4eba3320 tempest-VolumesNegativeTest-353487240 tempest-VolumesNegativeTest-353487240-project-member] Acquiring lock "refresh_cache-e3a9252c-0e0a-4c5c-a46f-eaa004479bd2" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:41:46 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-613ecfa9-c56a-433d-afad-5bbc4eba3320 tempest-VolumesNegativeTest-353487240 tempest-VolumesNegativeTest-353487240-project-member] Acquired lock "refresh_cache-e3a9252c-0e0a-4c5c-a46f-eaa004479bd2" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:41:46 user nova-compute[73449]: DEBUG nova.network.neutron [None req-613ecfa9-c56a-433d-afad-5bbc4eba3320 tempest-VolumesNegativeTest-353487240 tempest-VolumesNegativeTest-353487240-project-member] [instance: e3a9252c-0e0a-4c5c-a46f-eaa004479bd2] Building network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 11:41:46 user nova-compute[73449]: DEBUG nova.compute.manager [req-2ea62d71-758c-4a15-962b-f8c4f3d7c0d0 req-838eb354-0c7b-4c3d-bb91-a7ed921fe01e service nova] [instance: e3a9252c-0e0a-4c5c-a46f-eaa004479bd2] Received event network-changed-fec2c3eb-3fd7-4804-8474-6105b30373aa {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:41:46 user nova-compute[73449]: DEBUG nova.compute.manager [req-2ea62d71-758c-4a15-962b-f8c4f3d7c0d0 req-838eb354-0c7b-4c3d-bb91-a7ed921fe01e service nova] [instance: e3a9252c-0e0a-4c5c-a46f-eaa004479bd2] Refreshing instance network info cache due to event network-changed-fec2c3eb-3fd7-4804-8474-6105b30373aa. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 11:41:46 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-2ea62d71-758c-4a15-962b-f8c4f3d7c0d0 req-838eb354-0c7b-4c3d-bb91-a7ed921fe01e service nova] Acquiring lock "refresh_cache-e3a9252c-0e0a-4c5c-a46f-eaa004479bd2" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:41:46 user nova-compute[73449]: DEBUG nova.network.neutron [req-8f67861f-dc1c-4134-9217-0931a8410e9b req-f93ff0b9-2c6c-406e-8f36-9b8ae34e51ae service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Instance cache missing network info. {{(pid=73449) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 11:41:46 user nova-compute[73449]: DEBUG nova.network.neutron [None req-613ecfa9-c56a-433d-afad-5bbc4eba3320 tempest-VolumesNegativeTest-353487240 tempest-VolumesNegativeTest-353487240-project-member] [instance: e3a9252c-0e0a-4c5c-a46f-eaa004479bd2] Instance cache missing network info. {{(pid=73449) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 11:41:46 user nova-compute[73449]: DEBUG nova.network.neutron [req-8f67861f-dc1c-4134-9217-0931a8410e9b req-f93ff0b9-2c6c-406e-8f36-9b8ae34e51ae service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Updating instance_info_cache with network_info: [] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:41:46 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-8f67861f-dc1c-4134-9217-0931a8410e9b req-f93ff0b9-2c6c-406e-8f36-9b8ae34e51ae service nova] Releasing lock "refresh_cache-f33a7013-82d0-477c-aa5e-b27e63f2b98d" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:41:46 user nova-compute[73449]: DEBUG nova.network.neutron [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Updating instance_info_cache with network_info: [{"id": "c877b9e9-f45c-4199-960c-2b9926518803", "address": "fa:16:3e:0d:7d:90", "network": {"id": "1596a923-35e5-45a5-85c8-5bae45f011b7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1809575924-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60c18371fa6246888a742164afd60242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc877b9e9-f4", "ovs_interfaceid": "c877b9e9-f45c-4199-960c-2b9926518803", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "71d82cc1-6895-4d52-b066-0a01a61b329b", "address": "fa:16:3e:48:bc:7c", "network": {"id": "2c2340dc-7ea1-4f63-8819-47844b2a536e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1423531895", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "60c18371fa6246888a742164afd60242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71d82cc1-68", "ovs_interfaceid": "71d82cc1-6895-4d52-b066-0a01a61b329b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b3fe8f9e-5b75-440e-b1c1-f888a4e91e9e", "address": "fa:16:3e:0e:2e:4c", "network": {"id": "2c2340dc-7ea1-4f63-8819-47844b2a536e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1423531895", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "60c18371fa6246888a742164afd60242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3fe8f9e-5b", "ovs_interfaceid": "b3fe8f9e-5b75-440e-b1c1-f888a4e91e9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f9c9fca3-8f9c-4ea9-8ceb-ed19cb265786", "address": "fa:16:3e:a2:22:da", "network": {"id": "2c2340dc-7ea1-4f63-8819-47844b2a536e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1423531895", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "60c18371fa6246888a742164afd60242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9c9fca3-8f", "ovs_interfaceid": "f9c9fca3-8f9c-4ea9-8ceb-ed19cb265786", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6888cb29-a1bc-42b0-bec3-57667e1b0350", "address": "fa:16:3e:6e:07:1b", "network": {"id": "2c2340dc-7ea1-4f63-8819-47844b2a536e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1423531895", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "60c18371fa6246888a742164afd60242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6888cb29-a1", "ovs_interfaceid": "6888cb29-a1bc-42b0-bec3-57667e1b0350", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d85896ce-110a-41d6-a20e-6beaecb36b97", "address": "fa:16:3e:e3:51:d1", "network": {"id": "8244e7f5-12cf-4ab5-baa2-956f148fc51f", "bridge": "br-int", "label": "tempest-device-tagging-net2-163620727", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "60c18371fa6246888a742164afd60242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd85896ce-11", "ovs_interfaceid": "d85896ce-110a-41d6-a20e-6beaecb36b97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "671f57db-57f1-4ba3-9e49-ebe4816404f6", "address": "fa:16:3e:04:1d:3e", "network": {"id": "8244e7f5-12cf-4ab5-baa2-956f148fc51f", "bridge": "br-int", "label": "tempest-device-tagging-net2-163620727", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "60c18371fa6246888a742164afd60242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap671f57db-57", "ovs_interfaceid": "671f57db-57f1-4ba3-9e49-ebe4816404f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:41:46 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Releasing lock "refresh_cache-b8e1def1-8303-4257-b9b5-0050f05cf2d0" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:41:46 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Instance network_info: |[{"id": "c877b9e9-f45c-4199-960c-2b9926518803", "address": "fa:16:3e:0d:7d:90", "network": {"id": "1596a923-35e5-45a5-85c8-5bae45f011b7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1809575924-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60c18371fa6246888a742164afd60242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc877b9e9-f4", "ovs_interfaceid": "c877b9e9-f45c-4199-960c-2b9926518803", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "71d82cc1-6895-4d52-b066-0a01a61b329b", "address": "fa:16:3e:48:bc:7c", "network": {"id": "2c2340dc-7ea1-4f63-8819-47844b2a536e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1423531895", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "60c18371fa6246888a742164afd60242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71d82cc1-68", "ovs_interfaceid": "71d82cc1-6895-4d52-b066-0a01a61b329b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b3fe8f9e-5b75-440e-b1c1-f888a4e91e9e", "address": "fa:16:3e:0e:2e:4c", "network": {"id": "2c2340dc-7ea1-4f63-8819-47844b2a536e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1423531895", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "60c18371fa6246888a742164afd60242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3fe8f9e-5b", "ovs_interfaceid": "b3fe8f9e-5b75-440e-b1c1-f888a4e91e9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f9c9fca3-8f9c-4ea9-8ceb-ed19cb265786", "address": "fa:16:3e:a2:22:da", "network": {"id": "2c2340dc-7ea1-4f63-8819-47844b2a536e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1423531895", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "60c18371fa6246888a742164afd60242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9c9fca3-8f", "ovs_interfaceid": "f9c9fca3-8f9c-4ea9-8ceb-ed19cb265786", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6888cb29-a1bc-42b0-bec3-57667e1b0350", "address": "fa:16:3e:6e:07:1b", "network": {"id": "2c2340dc-7ea1-4f63-8819-47844b2a536e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1423531895", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "60c18371fa6246888a742164afd60242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6888cb29-a1", "ovs_interfaceid": "6888cb29-a1bc-42b0-bec3-57667e1b0350", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d85896ce-110a-41d6-a20e-6beaecb36b97", "address": "fa:16:3e:e3:51:d1", "network": {"id": "8244e7f5-12cf-4ab5-baa2-956f148fc51f", "bridge": "br-int", "label": "tempest-device-tagging-net2-163620727", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "60c18371fa6246888a742164afd60242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd85896ce-11", "ovs_interfaceid": "d85896ce-110a-41d6-a20e-6beaecb36b97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "671f57db-57f1-4ba3-9e49-ebe4816404f6", "address": "fa:16:3e:04:1d:3e", "network": {"id": "8244e7f5-12cf-4ab5-baa2-956f148fc51f", "bridge": "br-int", "label": "tempest-device-tagging-net2-163620727", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "60c18371fa6246888a742164afd60242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap671f57db-57", "ovs_interfaceid": "671f57db-57f1-4ba3-9e49-ebe4816404f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73449) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 11:41:46 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-fc6efa76-7519-4bc7-958c-e25dbdd45683 req-ec2f96ff-a3b0-44fc-81ca-8eb7e9ed7640 service nova] Acquired lock "refresh_cache-b8e1def1-8303-4257-b9b5-0050f05cf2d0" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:41:46 user nova-compute[73449]: DEBUG nova.network.neutron [req-fc6efa76-7519-4bc7-958c-e25dbdd45683 req-ec2f96ff-a3b0-44fc-81ca-8eb7e9ed7640 service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Refreshing network info cache for port d85896ce-110a-41d6-a20e-6beaecb36b97 {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 11:41:46 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:41:46 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:41:46 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:41:46 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73449) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 11:41:46 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:41:46 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:41:46 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:41:46 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:41:46 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=73449) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 11:41:47 user nova-compute[73449]: DEBUG nova.network.neutron [None req-613ecfa9-c56a-433d-afad-5bbc4eba3320 tempest-VolumesNegativeTest-353487240 tempest-VolumesNegativeTest-353487240-project-member] [instance: e3a9252c-0e0a-4c5c-a46f-eaa004479bd2] Updating instance_info_cache with network_info: [{"id": "fec2c3eb-3fd7-4804-8474-6105b30373aa", "address": "fa:16:3e:df:e2:8a", "network": {"id": "b66f5009-c462-42fe-99b0-47bee2d60605", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "7a77880136a54ef195c82e018e1939db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfec2c3eb-3f", "ovs_interfaceid": "fec2c3eb-3fd7-4804-8474-6105b30373aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:41:47 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-613ecfa9-c56a-433d-afad-5bbc4eba3320 tempest-VolumesNegativeTest-353487240 tempest-VolumesNegativeTest-353487240-project-member] Releasing lock "refresh_cache-e3a9252c-0e0a-4c5c-a46f-eaa004479bd2" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:41:47 user nova-compute[73449]: DEBUG nova.compute.manager [None req-613ecfa9-c56a-433d-afad-5bbc4eba3320 tempest-VolumesNegativeTest-353487240 tempest-VolumesNegativeTest-353487240-project-member] [instance: e3a9252c-0e0a-4c5c-a46f-eaa004479bd2] Instance network_info: |[{"id": "fec2c3eb-3fd7-4804-8474-6105b30373aa", "address": "fa:16:3e:df:e2:8a", "network": {"id": "b66f5009-c462-42fe-99b0-47bee2d60605", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "7a77880136a54ef195c82e018e1939db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfec2c3eb-3f", "ovs_interfaceid": "fec2c3eb-3fd7-4804-8474-6105b30373aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73449) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 11:41:47 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-2ea62d71-758c-4a15-962b-f8c4f3d7c0d0 req-838eb354-0c7b-4c3d-bb91-a7ed921fe01e service nova] Acquired lock "refresh_cache-e3a9252c-0e0a-4c5c-a46f-eaa004479bd2" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:41:47 user nova-compute[73449]: DEBUG nova.network.neutron [req-2ea62d71-758c-4a15-962b-f8c4f3d7c0d0 req-838eb354-0c7b-4c3d-bb91-a7ed921fe01e service nova] [instance: e3a9252c-0e0a-4c5c-a46f-eaa004479bd2] Refreshing network info cache for port fec2c3eb-3fd7-4804-8474-6105b30373aa {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 11:41:47 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-613ecfa9-c56a-433d-afad-5bbc4eba3320 tempest-VolumesNegativeTest-353487240 tempest-VolumesNegativeTest-353487240-project-member] [instance: e3a9252c-0e0a-4c5c-a46f-eaa004479bd2] Start _get_guest_xml network_info=[{"id": "fec2c3eb-3fd7-4804-8474-6105b30373aa", "address": "fa:16:3e:df:e2:8a", "network": {"id": "b66f5009-c462-42fe-99b0-47bee2d60605", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "7a77880136a54ef195c82e018e1939db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfec2c3eb-3f", "ovs_interfaceid": "fec2c3eb-3fd7-4804-8474-6105b30373aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T11:36:11Z,direct_url=<?>,disk_format='qcow2',id=0a2904ae-083d-41c8-83db-343132b36148,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7a77880136a54ef195c82e018e1939db',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T11:36:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': '0a2904ae-083d-41c8-83db-343132b36148'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 11:41:47 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-613ecfa9-c56a-433d-afad-5bbc4eba3320 tempest-VolumesNegativeTest-353487240 tempest-VolumesNegativeTest-353487240-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:41:47 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-613ecfa9-c56a-433d-afad-5bbc4eba3320 tempest-VolumesNegativeTest-353487240 tempest-VolumesNegativeTest-353487240-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:41:47 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-613ecfa9-c56a-433d-afad-5bbc4eba3320 tempest-VolumesNegativeTest-353487240 tempest-VolumesNegativeTest-353487240-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 11:41:47 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-613ecfa9-c56a-433d-afad-5bbc4eba3320 tempest-VolumesNegativeTest-353487240 tempest-VolumesNegativeTest-353487240-project-member] CPU controller missing on host. {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 11:41:47 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-613ecfa9-c56a-433d-afad-5bbc4eba3320 tempest-VolumesNegativeTest-353487240 tempest-VolumesNegativeTest-353487240-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 11:41:47 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-613ecfa9-c56a-433d-afad-5bbc4eba3320 tempest-VolumesNegativeTest-353487240 tempest-VolumesNegativeTest-353487240-project-member] CPU controller found on host. {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 11:41:47 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-613ecfa9-c56a-433d-afad-5bbc4eba3320 tempest-VolumesNegativeTest-353487240 tempest-VolumesNegativeTest-353487240-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73449) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 11:41:47 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-613ecfa9-c56a-433d-afad-5bbc4eba3320 tempest-VolumesNegativeTest-353487240 tempest-VolumesNegativeTest-353487240-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T11:35:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T11:36:11Z,direct_url=<?>,disk_format='qcow2',id=0a2904ae-083d-41c8-83db-343132b36148,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7a77880136a54ef195c82e018e1939db',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T11:36:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 11:41:47 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-613ecfa9-c56a-433d-afad-5bbc4eba3320 tempest-VolumesNegativeTest-353487240 tempest-VolumesNegativeTest-353487240-project-member] Flavor limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 11:41:47 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-613ecfa9-c56a-433d-afad-5bbc4eba3320 tempest-VolumesNegativeTest-353487240 tempest-VolumesNegativeTest-353487240-project-member] Image limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 11:41:47 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-613ecfa9-c56a-433d-afad-5bbc4eba3320 tempest-VolumesNegativeTest-353487240 tempest-VolumesNegativeTest-353487240-project-member] Flavor pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 11:41:47 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-613ecfa9-c56a-433d-afad-5bbc4eba3320 tempest-VolumesNegativeTest-353487240 tempest-VolumesNegativeTest-353487240-project-member] Image pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 11:41:47 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-613ecfa9-c56a-433d-afad-5bbc4eba3320 tempest-VolumesNegativeTest-353487240 tempest-VolumesNegativeTest-353487240-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 11:41:47 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-613ecfa9-c56a-433d-afad-5bbc4eba3320 tempest-VolumesNegativeTest-353487240 tempest-VolumesNegativeTest-353487240-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 11:41:47 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-613ecfa9-c56a-433d-afad-5bbc4eba3320 tempest-VolumesNegativeTest-353487240 tempest-VolumesNegativeTest-353487240-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 11:41:47 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-613ecfa9-c56a-433d-afad-5bbc4eba3320 tempest-VolumesNegativeTest-353487240 tempest-VolumesNegativeTest-353487240-project-member] Got 1 possible topologies {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 11:41:47 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-613ecfa9-c56a-433d-afad-5bbc4eba3320 tempest-VolumesNegativeTest-353487240 tempest-VolumesNegativeTest-353487240-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 11:41:47 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-613ecfa9-c56a-433d-afad-5bbc4eba3320 tempest-VolumesNegativeTest-353487240 tempest-VolumesNegativeTest-353487240-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 11:41:47 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-613ecfa9-c56a-433d-afad-5bbc4eba3320 tempest-VolumesNegativeTest-353487240 tempest-VolumesNegativeTest-353487240-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:41:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-402518887',display_name='tempest-VolumesNegativeTest-instance-402518887',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-402518887',id=10,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4cc04aafe1594cb5b33594577bc2c2f6',ramdisk_id='',reservation_id='r-x4naommf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-353487240',owner_user_name='tempest-VolumesNegativeTest-353487240-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T11:41:45Z,user_data=None,user_id='aae80a28db1d4999937d418adf6e5f85',uuid=e3a9252c-0e0a-4c5c-a46f-eaa004479bd2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fec2c3eb-3fd7-4804-8474-6105b30373aa", "address": "fa:16:3e:df:e2:8a", "network": {"id": "b66f5009-c462-42fe-99b0-47bee2d60605", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "7a77880136a54ef195c82e018e1939db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfec2c3eb-3f", "ovs_interfaceid": "fec2c3eb-3fd7-4804-8474-6105b30373aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73449) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 11:41:47 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-613ecfa9-c56a-433d-afad-5bbc4eba3320 tempest-VolumesNegativeTest-353487240 tempest-VolumesNegativeTest-353487240-project-member] Converting VIF {"id": "fec2c3eb-3fd7-4804-8474-6105b30373aa", "address": "fa:16:3e:df:e2:8a", "network": {"id": "b66f5009-c462-42fe-99b0-47bee2d60605", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "7a77880136a54ef195c82e018e1939db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfec2c3eb-3f", "ovs_interfaceid": "fec2c3eb-3fd7-4804-8474-6105b30373aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:41:47 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-613ecfa9-c56a-433d-afad-5bbc4eba3320 tempest-VolumesNegativeTest-353487240 tempest-VolumesNegativeTest-353487240-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:e2:8a,bridge_name='br-int',has_traffic_filtering=True,id=fec2c3eb-3fd7-4804-8474-6105b30373aa,network=Network(b66f5009-c462-42fe-99b0-47bee2d60605),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfec2c3eb-3f') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:41:47 user nova-compute[73449]: DEBUG nova.objects.instance [None req-613ecfa9-c56a-433d-afad-5bbc4eba3320 tempest-VolumesNegativeTest-353487240 tempest-VolumesNegativeTest-353487240-project-member] Lazy-loading 'pci_devices' on Instance uuid e3a9252c-0e0a-4c5c-a46f-eaa004479bd2 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:41:47 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-613ecfa9-c56a-433d-afad-5bbc4eba3320 tempest-VolumesNegativeTest-353487240 tempest-VolumesNegativeTest-353487240-project-member] [instance: e3a9252c-0e0a-4c5c-a46f-eaa004479bd2] End _get_guest_xml xml=<domain type="kvm">
Aug 17 11:41:47 user nova-compute[73449]:   <uuid>e3a9252c-0e0a-4c5c-a46f-eaa004479bd2</uuid>
Aug 17 11:41:47 user nova-compute[73449]:   <name>instance-0000000a</name>
Aug 17 11:41:47 user nova-compute[73449]:   <memory>524288</memory>
Aug 17 11:41:47 user nova-compute[73449]:   <vcpu>1</vcpu>
Aug 17 11:41:47 user nova-compute[73449]:   <metadata>
Aug 17 11:41:47 user nova-compute[73449]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 11:41:47 user nova-compute[73449]:       <nova:package version="0.0.0"/>
Aug 17 11:41:47 user nova-compute[73449]:       <nova:name>tempest-VolumesNegativeTest-instance-402518887</nova:name>
Aug 17 11:41:47 user nova-compute[73449]:       <nova:creationTime>2023-08-17 11:41:47</nova:creationTime>
Aug 17 11:41:47 user nova-compute[73449]:       <nova:flavor name="m1.tiny">
Aug 17 11:41:47 user nova-compute[73449]:         <nova:memory>512</nova:memory>
Aug 17 11:41:47 user nova-compute[73449]:         <nova:disk>1</nova:disk>
Aug 17 11:41:47 user nova-compute[73449]:         <nova:swap>0</nova:swap>
Aug 17 11:41:47 user nova-compute[73449]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 11:41:47 user nova-compute[73449]:         <nova:vcpus>1</nova:vcpus>
Aug 17 11:41:47 user nova-compute[73449]:       </nova:flavor>
Aug 17 11:41:47 user nova-compute[73449]:       <nova:owner>
Aug 17 11:41:47 user nova-compute[73449]:         <nova:user uuid="aae80a28db1d4999937d418adf6e5f85">tempest-VolumesNegativeTest-353487240-project-member</nova:user>
Aug 17 11:41:47 user nova-compute[73449]:         <nova:project uuid="4cc04aafe1594cb5b33594577bc2c2f6">tempest-VolumesNegativeTest-353487240</nova:project>
Aug 17 11:41:47 user nova-compute[73449]:       </nova:owner>
Aug 17 11:41:47 user nova-compute[73449]:       <nova:root type="image" uuid="0a2904ae-083d-41c8-83db-343132b36148"/>
Aug 17 11:41:47 user nova-compute[73449]:       <nova:ports>
Aug 17 11:41:47 user nova-compute[73449]:         <nova:port uuid="fec2c3eb-3fd7-4804-8474-6105b30373aa">
Aug 17 11:41:47 user nova-compute[73449]:           <nova:ip type="fixed" address="192.168.233.226" ipVersion="4"/>
Aug 17 11:41:47 user nova-compute[73449]:         </nova:port>
Aug 17 11:41:47 user nova-compute[73449]:       </nova:ports>
Aug 17 11:41:47 user nova-compute[73449]:     </nova:instance>
Aug 17 11:41:47 user nova-compute[73449]:   </metadata>
Aug 17 11:41:47 user nova-compute[73449]:   <sysinfo type="smbios">
Aug 17 11:41:47 user nova-compute[73449]:     <system>
Aug 17 11:41:47 user nova-compute[73449]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 11:41:47 user nova-compute[73449]:       <entry name="product">OpenStack Nova</entry>
Aug 17 11:41:47 user nova-compute[73449]:       <entry name="version">0.0.0</entry>
Aug 17 11:41:47 user nova-compute[73449]:       <entry name="serial">e3a9252c-0e0a-4c5c-a46f-eaa004479bd2</entry>
Aug 17 11:41:47 user nova-compute[73449]:       <entry name="uuid">e3a9252c-0e0a-4c5c-a46f-eaa004479bd2</entry>
Aug 17 11:41:47 user nova-compute[73449]:       <entry name="family">Virtual Machine</entry>
Aug 17 11:41:47 user nova-compute[73449]:     </system>
Aug 17 11:41:47 user nova-compute[73449]:   </sysinfo>
Aug 17 11:41:47 user nova-compute[73449]:   <os>
Aug 17 11:41:47 user nova-compute[73449]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 11:41:47 user nova-compute[73449]:     <boot dev="hd"/>
Aug 17 11:41:47 user nova-compute[73449]:     <smbios mode="sysinfo"/>
Aug 17 11:41:47 user nova-compute[73449]:   </os>
Aug 17 11:41:47 user nova-compute[73449]:   <features>
Aug 17 11:41:47 user nova-compute[73449]:     <acpi/>
Aug 17 11:41:47 user nova-compute[73449]:     <apic/>
Aug 17 11:41:47 user nova-compute[73449]:     <vmcoreinfo/>
Aug 17 11:41:47 user nova-compute[73449]:   </features>
Aug 17 11:41:47 user nova-compute[73449]:   <clock offset="utc">
Aug 17 11:41:47 user nova-compute[73449]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 11:41:47 user nova-compute[73449]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 11:41:47 user nova-compute[73449]:     <timer name="hpet" present="no"/>
Aug 17 11:41:47 user nova-compute[73449]:   </clock>
Aug 17 11:41:47 user nova-compute[73449]:   <cpu mode="custom" match="exact">
Aug 17 11:41:47 user nova-compute[73449]:     <model>Nehalem</model>
Aug 17 11:41:47 user nova-compute[73449]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 11:41:47 user nova-compute[73449]:   </cpu>
Aug 17 11:41:47 user nova-compute[73449]:   <devices>
Aug 17 11:41:47 user nova-compute[73449]:     <disk type="file" device="disk">
Aug 17 11:41:47 user nova-compute[73449]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 11:41:47 user nova-compute[73449]:       <source file="/opt/stack/data/nova/instances/e3a9252c-0e0a-4c5c-a46f-eaa004479bd2/disk"/>
Aug 17 11:41:47 user nova-compute[73449]:       <target dev="vda" bus="virtio"/>
Aug 17 11:41:47 user nova-compute[73449]:     </disk>
Aug 17 11:41:47 user nova-compute[73449]:     <interface type="ethernet">
Aug 17 11:41:47 user nova-compute[73449]:       <mac address="fa:16:3e:df:e2:8a"/>
Aug 17 11:41:47 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 11:41:47 user nova-compute[73449]:       <mtu size="1442"/>
Aug 17 11:41:47 user nova-compute[73449]:       <target dev="tapfec2c3eb-3f"/>
Aug 17 11:41:47 user nova-compute[73449]:     </interface>
Aug 17 11:41:47 user nova-compute[73449]:     <serial type="pty">
Aug 17 11:41:47 user nova-compute[73449]:       <log file="/opt/stack/data/nova/instances/e3a9252c-0e0a-4c5c-a46f-eaa004479bd2/console.log" append="off"/>
Aug 17 11:41:47 user nova-compute[73449]:     </serial>
Aug 17 11:41:47 user nova-compute[73449]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 11:41:47 user nova-compute[73449]:     <video>
Aug 17 11:41:47 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 11:41:47 user nova-compute[73449]:     </video>
Aug 17 11:41:47 user nova-compute[73449]:     <rng model="virtio">
Aug 17 11:41:47 user nova-compute[73449]:       <backend model="random">/dev/urandom</backend>
Aug 17 11:41:47 user nova-compute[73449]:     </rng>
Aug 17 11:41:47 user nova-compute[73449]:     <controller type="usb" index="0" model="none"/>
Aug 17 11:41:47 user nova-compute[73449]:     <memballoon model="virtio">
Aug 17 11:41:47 user nova-compute[73449]:       <stats period="10"/>
Aug 17 11:41:47 user nova-compute[73449]:     </memballoon>
Aug 17 11:41:47 user nova-compute[73449]:   </devices>
Aug 17 11:41:47 user nova-compute[73449]: </domain>
Aug 17 11:41:47 user nova-compute[73449]:  {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 11:41:47 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-613ecfa9-c56a-433d-afad-5bbc4eba3320 tempest-VolumesNegativeTest-353487240 tempest-VolumesNegativeTest-353487240-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:41:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-402518887',display_name='tempest-VolumesNegativeTest-instance-402518887',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-402518887',id=10,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4cc04aafe1594cb5b33594577bc2c2f6',ramdisk_id='',reservation_id='r-x4naommf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-353487240',owner_user_name='tempest-VolumesNegativeTest-353487240-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T11:41:45Z,user_data=None,user_id='aae80a28db1d4999937d418adf6e5f85',uuid=e3a9252c-0e0a-4c5c-a46f-eaa004479bd2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fec2c3eb-3fd7-4804-8474-6105b30373aa", "address": "fa:16:3e:df:e2:8a", "network": {"id": "b66f5009-c462-42fe-99b0-47bee2d60605", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "7a77880136a54ef195c82e018e1939db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfec2c3eb-3f", "ovs_interfaceid": "fec2c3eb-3fd7-4804-8474-6105b30373aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 11:41:47 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-613ecfa9-c56a-433d-afad-5bbc4eba3320 tempest-VolumesNegativeTest-353487240 tempest-VolumesNegativeTest-353487240-project-member] Converting VIF {"id": "fec2c3eb-3fd7-4804-8474-6105b30373aa", "address": "fa:16:3e:df:e2:8a", "network": {"id": "b66f5009-c462-42fe-99b0-47bee2d60605", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "7a77880136a54ef195c82e018e1939db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfec2c3eb-3f", "ovs_interfaceid": "fec2c3eb-3fd7-4804-8474-6105b30373aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:41:47 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-613ecfa9-c56a-433d-afad-5bbc4eba3320 tempest-VolumesNegativeTest-353487240 tempest-VolumesNegativeTest-353487240-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:e2:8a,bridge_name='br-int',has_traffic_filtering=True,id=fec2c3eb-3fd7-4804-8474-6105b30373aa,network=Network(b66f5009-c462-42fe-99b0-47bee2d60605),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfec2c3eb-3f') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:41:47 user nova-compute[73449]: DEBUG os_vif [None req-613ecfa9-c56a-433d-afad-5bbc4eba3320 tempest-VolumesNegativeTest-353487240 tempest-VolumesNegativeTest-353487240-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:e2:8a,bridge_name='br-int',has_traffic_filtering=True,id=fec2c3eb-3fd7-4804-8474-6105b30373aa,network=Network(b66f5009-c462-42fe-99b0-47bee2d60605),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfec2c3eb-3f') {{(pid=73449) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 11:41:47 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:41:47 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:41:47 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 11:41:47 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:41:47 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfec2c3eb-3f, may_exist=True, interface_attrs={}) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:41:47 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfec2c3eb-3f, col_values=(('external_ids', {'iface-id': 'fec2c3eb-3fd7-4804-8474-6105b30373aa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:df:e2:8a', 'vm-uuid': 'e3a9252c-0e0a-4c5c-a46f-eaa004479bd2'}),), if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:41:47 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:41:47 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3523d22-7165-46ad-be10-5e6ae374f91d/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:41:47 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:41:47 user nova-compute[73449]: INFO os_vif [None req-613ecfa9-c56a-433d-afad-5bbc4eba3320 tempest-VolumesNegativeTest-353487240 tempest-VolumesNegativeTest-353487240-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:e2:8a,bridge_name='br-int',has_traffic_filtering=True,id=fec2c3eb-3fd7-4804-8474-6105b30373aa,network=Network(b66f5009-c462-42fe-99b0-47bee2d60605),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfec2c3eb-3f')
Aug 17 11:41:47 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-613ecfa9-c56a-433d-afad-5bbc4eba3320 tempest-VolumesNegativeTest-353487240 tempest-VolumesNegativeTest-353487240-project-member] No BDM found with device name vda, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 11:41:47 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-613ecfa9-c56a-433d-afad-5bbc4eba3320 tempest-VolumesNegativeTest-353487240 tempest-VolumesNegativeTest-353487240-project-member] No VIF found with MAC fa:16:3e:df:e2:8a, not building metadata {{(pid=73449) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 11:41:47 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3523d22-7165-46ad-be10-5e6ae374f91d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:41:47 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3523d22-7165-46ad-be10-5e6ae374f91d/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:41:47 user nova-compute[73449]: DEBUG nova.network.neutron [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Successfully updated port: c69d3b48-1443-4999-8369-8c5f61b35697 {{(pid=73449) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 11:41:47 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3523d22-7165-46ad-be10-5e6ae374f91d/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:41:47 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:41:47 user nova-compute[73449]: DEBUG nova.network.neutron [req-fc6efa76-7519-4bc7-958c-e25dbdd45683 req-ec2f96ff-a3b0-44fc-81ca-8eb7e9ed7640 service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Updated VIF entry in instance network info cache for port d85896ce-110a-41d6-a20e-6beaecb36b97. {{(pid=73449) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 11:41:47 user nova-compute[73449]: DEBUG nova.network.neutron [req-fc6efa76-7519-4bc7-958c-e25dbdd45683 req-ec2f96ff-a3b0-44fc-81ca-8eb7e9ed7640 service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Updating instance_info_cache with network_info: [{"id": "c877b9e9-f45c-4199-960c-2b9926518803", "address": "fa:16:3e:0d:7d:90", "network": {"id": "1596a923-35e5-45a5-85c8-5bae45f011b7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1809575924-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60c18371fa6246888a742164afd60242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc877b9e9-f4", "ovs_interfaceid": "c877b9e9-f45c-4199-960c-2b9926518803", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "71d82cc1-6895-4d52-b066-0a01a61b329b", "address": "fa:16:3e:48:bc:7c", "network": {"id": "2c2340dc-7ea1-4f63-8819-47844b2a536e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1423531895", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "60c18371fa6246888a742164afd60242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71d82cc1-68", "ovs_interfaceid": "71d82cc1-6895-4d52-b066-0a01a61b329b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b3fe8f9e-5b75-440e-b1c1-f888a4e91e9e", "address": "fa:16:3e:0e:2e:4c", "network": {"id": "2c2340dc-7ea1-4f63-8819-47844b2a536e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1423531895", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "60c18371fa6246888a742164afd60242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3fe8f9e-5b", "ovs_interfaceid": "b3fe8f9e-5b75-440e-b1c1-f888a4e91e9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f9c9fca3-8f9c-4ea9-8ceb-ed19cb265786", "address": "fa:16:3e:a2:22:da", "network": {"id": "2c2340dc-7ea1-4f63-8819-47844b2a536e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1423531895", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "60c18371fa6246888a742164afd60242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9c9fca3-8f", "ovs_interfaceid": "f9c9fca3-8f9c-4ea9-8ceb-ed19cb265786", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6888cb29-a1bc-42b0-bec3-57667e1b0350", "address": "fa:16:3e:6e:07:1b", "network": {"id": "2c2340dc-7ea1-4f63-8819-47844b2a536e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1423531895", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "60c18371fa6246888a742164afd60242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6888cb29-a1", "ovs_interfaceid": "6888cb29-a1bc-42b0-bec3-57667e1b0350", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d85896ce-110a-41d6-a20e-6beaecb36b97", "address": "fa:16:3e:e3:51:d1", "network": {"id": "8244e7f5-12cf-4ab5-baa2-956f148fc51f", "bridge": "br-int", "label": "tempest-device-tagging-net2-163620727", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "60c18371fa6246888a742164afd60242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd85896ce-11", "ovs_interfaceid": "d85896ce-110a-41d6-a20e-6beaecb36b97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "671f57db-57f1-4ba3-9e49-ebe4816404f6", "address": "fa:16:3e:04:1d:3e", "network": {"id": "8244e7f5-12cf-4ab5-baa2-956f148fc51f", "bridge": "br-int", "label": "tempest-device-tagging-net2-163620727", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "60c18371fa6246888a742164afd60242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap671f57db-57", "ovs_interfaceid": "671f57db-57f1-4ba3-9e49-ebe4816404f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:41:47 user nova-compute[73449]: DEBUG nova.network.neutron [req-2ea62d71-758c-4a15-962b-f8c4f3d7c0d0 req-838eb354-0c7b-4c3d-bb91-a7ed921fe01e service nova] [instance: e3a9252c-0e0a-4c5c-a46f-eaa004479bd2] Updated VIF entry in instance network info cache for port fec2c3eb-3fd7-4804-8474-6105b30373aa. {{(pid=73449) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 11:41:47 user nova-compute[73449]: DEBUG nova.network.neutron [req-2ea62d71-758c-4a15-962b-f8c4f3d7c0d0 req-838eb354-0c7b-4c3d-bb91-a7ed921fe01e service nova] [instance: e3a9252c-0e0a-4c5c-a46f-eaa004479bd2] Updating instance_info_cache with network_info: [{"id": "fec2c3eb-3fd7-4804-8474-6105b30373aa", "address": "fa:16:3e:df:e2:8a", "network": {"id": "b66f5009-c462-42fe-99b0-47bee2d60605", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "7a77880136a54ef195c82e018e1939db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfec2c3eb-3f", "ovs_interfaceid": "fec2c3eb-3fd7-4804-8474-6105b30373aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:41:47 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Acquiring lock "refresh_cache-f33a7013-82d0-477c-aa5e-b27e63f2b98d" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:41:47 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Acquired lock "refresh_cache-f33a7013-82d0-477c-aa5e-b27e63f2b98d" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:41:47 user nova-compute[73449]: DEBUG nova.network.neutron [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Building network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 11:41:47 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-fc6efa76-7519-4bc7-958c-e25dbdd45683 req-ec2f96ff-a3b0-44fc-81ca-8eb7e9ed7640 service nova] Releasing lock "refresh_cache-b8e1def1-8303-4257-b9b5-0050f05cf2d0" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:41:47 user nova-compute[73449]: DEBUG nova.compute.manager [req-fc6efa76-7519-4bc7-958c-e25dbdd45683 req-ec2f96ff-a3b0-44fc-81ca-8eb7e9ed7640 service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Received event network-changed-6fbc9ad6-da42-4492-8603-9efc7294dbab {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:41:47 user nova-compute[73449]: DEBUG nova.compute.manager [req-fc6efa76-7519-4bc7-958c-e25dbdd45683 req-ec2f96ff-a3b0-44fc-81ca-8eb7e9ed7640 service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Refreshing instance network info cache due to event network-changed-6fbc9ad6-da42-4492-8603-9efc7294dbab. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 11:41:47 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-fc6efa76-7519-4bc7-958c-e25dbdd45683 req-ec2f96ff-a3b0-44fc-81ca-8eb7e9ed7640 service nova] Acquiring lock "refresh_cache-f33a7013-82d0-477c-aa5e-b27e63f2b98d" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:41:47 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-2ea62d71-758c-4a15-962b-f8c4f3d7c0d0 req-838eb354-0c7b-4c3d-bb91-a7ed921fe01e service nova] Releasing lock "refresh_cache-e3a9252c-0e0a-4c5c-a46f-eaa004479bd2" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:41:47 user nova-compute[73449]: DEBUG nova.network.neutron [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Instance cache missing network info. {{(pid=73449) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 11:41:47 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:41:47 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:41:47 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:41:47 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd8d4549-db8f-4c74-8706-8ac21f049c2e/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:41:48 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd8d4549-db8f-4c74-8706-8ac21f049c2e/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:41:48 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd8d4549-db8f-4c74-8706-8ac21f049c2e/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:41:48 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-931f74cb-c789-45d4-bd03-27a1f0ade67c tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] Acquiring lock "a40e1f85-a7e6-46da-8f98-df7a278aaade" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:41:48 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-931f74cb-c789-45d4-bd03-27a1f0ade67c tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] Lock "a40e1f85-a7e6-46da-8f98-df7a278aaade" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:41:48 user nova-compute[73449]: DEBUG nova.objects.instance [None req-931f74cb-c789-45d4-bd03-27a1f0ade67c tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] Lazy-loading 'flavor' on Instance uuid a40e1f85-a7e6-46da-8f98-df7a278aaade {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:41:48 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd8d4549-db8f-4c74-8706-8ac21f049c2e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:41:48 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a9e8ad2-19db-4975-87e4-2efce603a7d7/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:41:48 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-931f74cb-c789-45d4-bd03-27a1f0ade67c tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] Lock "a40e1f85-a7e6-46da-8f98-df7a278aaade" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.113s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:41:48 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a9e8ad2-19db-4975-87e4-2efce603a7d7/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:41:48 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a9e8ad2-19db-4975-87e4-2efce603a7d7/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:41:48 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-931f74cb-c789-45d4-bd03-27a1f0ade67c tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] Acquiring lock "a40e1f85-a7e6-46da-8f98-df7a278aaade" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:41:48 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-931f74cb-c789-45d4-bd03-27a1f0ade67c tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] Lock "a40e1f85-a7e6-46da-8f98-df7a278aaade" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.003s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:41:48 user nova-compute[73449]: INFO nova.compute.manager [None req-931f74cb-c789-45d4-bd03-27a1f0ade67c tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] [instance: a40e1f85-a7e6-46da-8f98-df7a278aaade] Attaching volume b5a94173-47ef-42e4-b403-aa9ac6cadc85 to /dev/vdb
Aug 17 11:41:48 user nova-compute[73449]: DEBUG nova.compute.manager [req-33e64d20-f45c-4a4b-96f9-b0411038291f req-f505e2e5-7532-40e2-9f9e-98176ec4c788 service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Received event network-changed-c69d3b48-1443-4999-8369-8c5f61b35697 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:41:48 user nova-compute[73449]: DEBUG nova.compute.manager [req-33e64d20-f45c-4a4b-96f9-b0411038291f req-f505e2e5-7532-40e2-9f9e-98176ec4c788 service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Refreshing instance network info cache due to event network-changed-c69d3b48-1443-4999-8369-8c5f61b35697. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 11:41:48 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-33e64d20-f45c-4a4b-96f9-b0411038291f req-f505e2e5-7532-40e2-9f9e-98176ec4c788 service nova] Acquiring lock "refresh_cache-f33a7013-82d0-477c-aa5e-b27e63f2b98d" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:41:48 user nova-compute[73449]: DEBUG os_brick.utils [None req-931f74cb-c789-45d4-bd03-27a1f0ade67c tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 11:41:48 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:41:48 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:41:48 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b3d2512-3529-4d1e-9b85-83a98bc563cd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4d3924302012\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:41:48 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:41:48 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:41:48 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.027s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:41:48 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a9e8ad2-19db-4975-87e4-2efce603a7d7/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:41:48 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[2068fdd3-1bd9-435a-92a1-1ee36e7caa51]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:41:48 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:41:48 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a40e1f85-a7e6-46da-8f98-df7a278aaade/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:41:48 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:41:48 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d86189b-a99e-4799-98e3-8839a1253d63]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:41:48 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[4083acf5-5e86-4436-8ce0-362fc3ee2ecc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:41:48 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-931f74cb-c789-45d4-bd03-27a1f0ade67c tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] Running cmd (subprocess): nvme version {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:41:48 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-931f74cb-c789-45d4-bd03-27a1f0ade67c tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] 'nvme version' failed. Not Retrying. {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 11:41:48 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:41:48 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.nvmeof [None req-931f74cb-c789-45d4-bd03-27a1f0ade67c tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] nvme not present on system {{(pid=73449) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 11:41:48 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:41:48 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 11:41:48 user nova-compute[73449]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 11:41:48 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[77f17c03-1641-44f1-a0a4-d811198fb8ef]: (4, '') {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:41:48 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-931f74cb-c789-45d4-bd03-27a1f0ade67c tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73449) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 11:41:48 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-931f74cb-c789-45d4-bd03-27a1f0ade67c tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73449) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 11:41:48 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-931f74cb-c789-45d4-bd03-27a1f0ade67c tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] LIGHTOS: no hostnqn found. {{(pid=73449) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 11:41:48 user nova-compute[73449]: DEBUG os_brick.utils [None req-931f74cb-c789-45d4-bd03-27a1f0ade67c tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] <== get_connector_properties: return (202ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4d3924302012', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 11:41:48 user nova-compute[73449]: DEBUG nova.virt.block_device [None req-931f74cb-c789-45d4-bd03-27a1f0ade67c tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] [instance: a40e1f85-a7e6-46da-8f98-df7a278aaade] Updating existing volume attachment record: f40f2bb8-f184-4242-b93c-02ec50abd4b4 {{(pid=73449) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 11:41:49 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a40e1f85-a7e6-46da-8f98-df7a278aaade/disk --force-share --output=json" returned: 0 in 0.293s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:41:49 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a40e1f85-a7e6-46da-8f98-df7a278aaade/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:41:49 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a40e1f85-a7e6-46da-8f98-df7a278aaade/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:41:49 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7ef11da-09ce-47a1-ba56-02af6a77206c/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:41:49 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7ef11da-09ce-47a1-ba56-02af6a77206c/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:41:49 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7ef11da-09ce-47a1-ba56-02af6a77206c/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:41:49 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:41:49 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:41:49 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7ef11da-09ce-47a1-ba56-02af6a77206c/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:41:49 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d3e07fa-4823-48e9-a959-e7bac0e0b25b/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:41:49 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d3e07fa-4823-48e9-a959-e7bac0e0b25b/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:41:49 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d3e07fa-4823-48e9-a959-e7bac0e0b25b/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:41:50 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d3e07fa-4823-48e9-a959-e7bac0e0b25b/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:41:51 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692272511.1065838, e3a9252c-0e0a-4c5c-a46f-eaa004479bd2 => Resumed> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:41:51 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: e3a9252c-0e0a-4c5c-a46f-eaa004479bd2] VM Resumed (Lifecycle Event)
Aug 17 11:41:51 user nova-compute[73449]: DEBUG nova.compute.manager [req-5a888d93-e8b6-47dd-8f0c-8b8073a6d2f0 req-2886c944-e117-45cf-a28e-36979d1c76b2 service nova] [instance: e3a9252c-0e0a-4c5c-a46f-eaa004479bd2] Received event network-vif-plugged-fec2c3eb-3fd7-4804-8474-6105b30373aa {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:41:51 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-5a888d93-e8b6-47dd-8f0c-8b8073a6d2f0 req-2886c944-e117-45cf-a28e-36979d1c76b2 service nova] Acquiring lock "e3a9252c-0e0a-4c5c-a46f-eaa004479bd2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:41:51 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-5a888d93-e8b6-47dd-8f0c-8b8073a6d2f0 req-2886c944-e117-45cf-a28e-36979d1c76b2 service nova] Lock "e3a9252c-0e0a-4c5c-a46f-eaa004479bd2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:41:51 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-5a888d93-e8b6-47dd-8f0c-8b8073a6d2f0 req-2886c944-e117-45cf-a28e-36979d1c76b2 service nova] Lock "e3a9252c-0e0a-4c5c-a46f-eaa004479bd2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:41:51 user nova-compute[73449]: DEBUG nova.compute.manager [req-5a888d93-e8b6-47dd-8f0c-8b8073a6d2f0 req-2886c944-e117-45cf-a28e-36979d1c76b2 service nova] [instance: e3a9252c-0e0a-4c5c-a46f-eaa004479bd2] No waiting events found dispatching network-vif-plugged-fec2c3eb-3fd7-4804-8474-6105b30373aa {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:41:51 user nova-compute[73449]: WARNING nova.compute.manager [req-5a888d93-e8b6-47dd-8f0c-8b8073a6d2f0 req-2886c944-e117-45cf-a28e-36979d1c76b2 service nova] [instance: e3a9252c-0e0a-4c5c-a46f-eaa004479bd2] Received unexpected event network-vif-plugged-fec2c3eb-3fd7-4804-8474-6105b30373aa for instance with vm_state building and task_state spawning.
Aug 17 11:41:51 user nova-compute[73449]: DEBUG nova.compute.manager [req-5a888d93-e8b6-47dd-8f0c-8b8073a6d2f0 req-2886c944-e117-45cf-a28e-36979d1c76b2 service nova] [instance: e3a9252c-0e0a-4c5c-a46f-eaa004479bd2] Received event network-vif-plugged-fec2c3eb-3fd7-4804-8474-6105b30373aa {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:41:51 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-5a888d93-e8b6-47dd-8f0c-8b8073a6d2f0 req-2886c944-e117-45cf-a28e-36979d1c76b2 service nova] Acquiring lock "e3a9252c-0e0a-4c5c-a46f-eaa004479bd2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:41:51 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-5a888d93-e8b6-47dd-8f0c-8b8073a6d2f0 req-2886c944-e117-45cf-a28e-36979d1c76b2 service nova] Lock "e3a9252c-0e0a-4c5c-a46f-eaa004479bd2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:41:51 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-5a888d93-e8b6-47dd-8f0c-8b8073a6d2f0 req-2886c944-e117-45cf-a28e-36979d1c76b2 service nova] Lock "e3a9252c-0e0a-4c5c-a46f-eaa004479bd2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:41:51 user nova-compute[73449]: DEBUG nova.compute.manager [req-5a888d93-e8b6-47dd-8f0c-8b8073a6d2f0 req-2886c944-e117-45cf-a28e-36979d1c76b2 service nova] [instance: e3a9252c-0e0a-4c5c-a46f-eaa004479bd2] No waiting events found dispatching network-vif-plugged-fec2c3eb-3fd7-4804-8474-6105b30373aa {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:41:51 user nova-compute[73449]: WARNING nova.compute.manager [req-5a888d93-e8b6-47dd-8f0c-8b8073a6d2f0 req-2886c944-e117-45cf-a28e-36979d1c76b2 service nova] [instance: e3a9252c-0e0a-4c5c-a46f-eaa004479bd2] Received unexpected event network-vif-plugged-fec2c3eb-3fd7-4804-8474-6105b30373aa for instance with vm_state building and task_state spawning.
Aug 17 11:41:51 user nova-compute[73449]: DEBUG nova.compute.manager [None req-613ecfa9-c56a-433d-afad-5bbc4eba3320 tempest-VolumesNegativeTest-353487240 tempest-VolumesNegativeTest-353487240-project-member] [instance: e3a9252c-0e0a-4c5c-a46f-eaa004479bd2] Instance event wait completed in 0 seconds for  {{(pid=73449) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 11:41:51 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-613ecfa9-c56a-433d-afad-5bbc4eba3320 tempest-VolumesNegativeTest-353487240 tempest-VolumesNegativeTest-353487240-project-member] [instance: e3a9252c-0e0a-4c5c-a46f-eaa004479bd2] Guest created on hypervisor {{(pid=73449) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 11:41:51 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: e3a9252c-0e0a-4c5c-a46f-eaa004479bd2] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:41:51 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: e3a9252c-0e0a-4c5c-a46f-eaa004479bd2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 11:41:51 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:41:51 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:41:51 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Hypervisor/Node resource view: name=user free_ram=7384MB free_disk=25.647846221923828GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73449) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 11:41:51 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:41:51 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:41:51 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: e3a9252c-0e0a-4c5c-a46f-eaa004479bd2] Instance spawned successfully.
Aug 17 11:41:51 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-613ecfa9-c56a-433d-afad-5bbc4eba3320 tempest-VolumesNegativeTest-353487240 tempest-VolumesNegativeTest-353487240-project-member] [instance: e3a9252c-0e0a-4c5c-a46f-eaa004479bd2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 11:41:51 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: e3a9252c-0e0a-4c5c-a46f-eaa004479bd2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 11:41:51 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692272511.1069636, e3a9252c-0e0a-4c5c-a46f-eaa004479bd2 => Started> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:41:51 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: e3a9252c-0e0a-4c5c-a46f-eaa004479bd2] VM Started (Lifecycle Event)
Aug 17 11:41:51 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-613ecfa9-c56a-433d-afad-5bbc4eba3320 tempest-VolumesNegativeTest-353487240 tempest-VolumesNegativeTest-353487240-project-member] [instance: e3a9252c-0e0a-4c5c-a46f-eaa004479bd2] Found default for hw_cdrom_bus of ide {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:41:51 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-613ecfa9-c56a-433d-afad-5bbc4eba3320 tempest-VolumesNegativeTest-353487240 tempest-VolumesNegativeTest-353487240-project-member] [instance: e3a9252c-0e0a-4c5c-a46f-eaa004479bd2] Found default for hw_disk_bus of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:41:51 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-613ecfa9-c56a-433d-afad-5bbc4eba3320 tempest-VolumesNegativeTest-353487240 tempest-VolumesNegativeTest-353487240-project-member] [instance: e3a9252c-0e0a-4c5c-a46f-eaa004479bd2] Found default for hw_input_bus of None {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:41:51 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-613ecfa9-c56a-433d-afad-5bbc4eba3320 tempest-VolumesNegativeTest-353487240 tempest-VolumesNegativeTest-353487240-project-member] [instance: e3a9252c-0e0a-4c5c-a46f-eaa004479bd2] Found default for hw_pointer_model of None {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:41:51 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-613ecfa9-c56a-433d-afad-5bbc4eba3320 tempest-VolumesNegativeTest-353487240 tempest-VolumesNegativeTest-353487240-project-member] [instance: e3a9252c-0e0a-4c5c-a46f-eaa004479bd2] Found default for hw_video_model of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:41:51 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-613ecfa9-c56a-433d-afad-5bbc4eba3320 tempest-VolumesNegativeTest-353487240 tempest-VolumesNegativeTest-353487240-project-member] [instance: e3a9252c-0e0a-4c5c-a46f-eaa004479bd2] Found default for hw_vif_model of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:41:51 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: e3a9252c-0e0a-4c5c-a46f-eaa004479bd2] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:41:51 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: e3a9252c-0e0a-4c5c-a46f-eaa004479bd2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 11:41:51 user nova-compute[73449]: INFO nova.compute.manager [None req-613ecfa9-c56a-433d-afad-5bbc4eba3320 tempest-VolumesNegativeTest-353487240 tempest-VolumesNegativeTest-353487240-project-member] [instance: e3a9252c-0e0a-4c5c-a46f-eaa004479bd2] Took 6.64 seconds to spawn the instance on the hypervisor.
Aug 17 11:41:51 user nova-compute[73449]: DEBUG nova.compute.manager [None req-613ecfa9-c56a-433d-afad-5bbc4eba3320 tempest-VolumesNegativeTest-353487240 tempest-VolumesNegativeTest-353487240-project-member] [instance: e3a9252c-0e0a-4c5c-a46f-eaa004479bd2] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:41:51 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: e3a9252c-0e0a-4c5c-a46f-eaa004479bd2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 11:41:51 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance a40e1f85-a7e6-46da-8f98-df7a278aaade actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:41:51 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 4a9e8ad2-19db-4975-87e4-2efce603a7d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:41:51 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance a3523d22-7165-46ad-be10-5e6ae374f91d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:41:51 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance fd8d4549-db8f-4c74-8706-8ac21f049c2e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:41:51 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:41:51 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 7d3e07fa-4823-48e9-a959-e7bac0e0b25b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:41:51 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance c7ef11da-09ce-47a1-ba56-02af6a77206c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:41:51 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance b8e1def1-8303-4257-b9b5-0050f05cf2d0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:41:51 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance f33a7013-82d0-477c-aa5e-b27e63f2b98d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:41:51 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance e3a9252c-0e0a-4c5c-a46f-eaa004479bd2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:41:51 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73449) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 11:41:51 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73449) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 11:41:51 user nova-compute[73449]: INFO nova.compute.manager [None req-613ecfa9-c56a-433d-afad-5bbc4eba3320 tempest-VolumesNegativeTest-353487240 tempest-VolumesNegativeTest-353487240-project-member] [instance: e3a9252c-0e0a-4c5c-a46f-eaa004479bd2] Took 7.63 seconds to build instance.
Aug 17 11:41:51 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-613ecfa9-c56a-433d-afad-5bbc4eba3320 tempest-VolumesNegativeTest-353487240 tempest-VolumesNegativeTest-353487240-project-member] Lock "e3a9252c-0e0a-4c5c-a46f-eaa004479bd2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.732s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:41:51 user nova-compute[73449]: DEBUG nova.network.neutron [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Updating instance_info_cache with network_info: [{"id": "d2d51361-0f1a-41aa-89e2-c2211bbd0b42", "address": "fa:16:3e:03:4e:88", "network": {"id": "0ff7c7f6-9609-4a35-8bb0-e8b83254f7f4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-803526263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92e6d918a4554cd89d9f40cee2a55d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2d51361-0f", "ovs_interfaceid": "d2d51361-0f1a-41aa-89e2-c2211bbd0b42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b14f4f1d-d140-4bb9-a4f2-abbaa8c98a2d", "address": "fa:16:3e:32:bc:69", "network": {"id": "8de6c01b-e132-4efb-be00-df0968c06a81", "bridge": "br-int", "label": "tempest-device-tagging-net1-1740133735", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "92e6d918a4554cd89d9f40cee2a55d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb14f4f1d-d1", "ovs_interfaceid": "b14f4f1d-d140-4bb9-a4f2-abbaa8c98a2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d8233c69-cc4f-4ae8-93ee-7f41234f72ec", "address": "fa:16:3e:14:e4:e9", "network": {"id": "8de6c01b-e132-4efb-be00-df0968c06a81", "bridge": "br-int", "label": "tempest-device-tagging-net1-1740133735", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "92e6d918a4554cd89d9f40cee2a55d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8233c69-cc", "ovs_interfaceid": "d8233c69-cc4f-4ae8-93ee-7f41234f72ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6fbc9ad6-da42-4492-8603-9efc7294dbab", "address": "fa:16:3e:a7:14:03", "network": {"id": "8de6c01b-e132-4efb-be00-df0968c06a81", "bridge": "br-int", "label": "tempest-device-tagging-net1-1740133735", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "92e6d918a4554cd89d9f40cee2a55d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fbc9ad6-da", "ovs_interfaceid": "6fbc9ad6-da42-4492-8603-9efc7294dbab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "854609a6-03f0-416c-8bbf-b5f85d13c688", "address": "fa:16:3e:09:0d:df", "network": {"id": "8de6c01b-e132-4efb-be00-df0968c06a81", "bridge": "br-int", "label": "tempest-device-tagging-net1-1740133735", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "92e6d918a4554cd89d9f40cee2a55d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap854609a6-03", "ovs_interfaceid": "854609a6-03f0-416c-8bbf-b5f85d13c688", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f04e7eb7-1170-4981-b342-44c664ef4c84", "address": "fa:16:3e:89:ce:7a", "network": {"id": "468865fb-36d1-436e-8fea-5f633edff84a", "bridge": "br-int", "label": "tempest-device-tagging-net2-251570535", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "92e6d918a4554cd89d9f40cee2a55d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf04e7eb7-11", "ovs_interfaceid": "f04e7eb7-1170-4981-b342-44c664ef4c84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c69d3b48-1443-4999-8369-8c5f61b35697", "address": "fa:16:3e:ec:95:94", "network": {"id": "468865fb-36d1-436e-8fea-5f633edff84a", "bridge": "br-int", "label": "tempest-device-tagging-net2-251570535", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "92e6d918a4554cd89d9f40cee2a55d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc69d3b48-14", "ovs_interfaceid": "c69d3b48-1443-4999-8369-8c5f61b35697", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:41:51 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Releasing lock "refresh_cache-f33a7013-82d0-477c-aa5e-b27e63f2b98d" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:41:51 user nova-compute[73449]: DEBUG nova.compute.manager [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Instance network_info: |[{"id": "d2d51361-0f1a-41aa-89e2-c2211bbd0b42", "address": "fa:16:3e:03:4e:88", "network": {"id": "0ff7c7f6-9609-4a35-8bb0-e8b83254f7f4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-803526263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92e6d918a4554cd89d9f40cee2a55d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2d51361-0f", "ovs_interfaceid": "d2d51361-0f1a-41aa-89e2-c2211bbd0b42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b14f4f1d-d140-4bb9-a4f2-abbaa8c98a2d", "address": "fa:16:3e:32:bc:69", "network": {"id": "8de6c01b-e132-4efb-be00-df0968c06a81", "bridge": "br-int", "label": "tempest-device-tagging-net1-1740133735", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "92e6d918a4554cd89d9f40cee2a55d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb14f4f1d-d1", "ovs_interfaceid": "b14f4f1d-d140-4bb9-a4f2-abbaa8c98a2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d8233c69-cc4f-4ae8-93ee-7f41234f72ec", "address": "fa:16:3e:14:e4:e9", "network": {"id": "8de6c01b-e132-4efb-be00-df0968c06a81", "bridge": "br-int", "label": "tempest-device-tagging-net1-1740133735", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "92e6d918a4554cd89d9f40cee2a55d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8233c69-cc", "ovs_interfaceid": "d8233c69-cc4f-4ae8-93ee-7f41234f72ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6fbc9ad6-da42-4492-8603-9efc7294dbab", "address": "fa:16:3e:a7:14:03", "network": {"id": "8de6c01b-e132-4efb-be00-df0968c06a81", "bridge": "br-int", "label": "tempest-device-tagging-net1-1740133735", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "92e6d918a4554cd89d9f40cee2a55d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fbc9ad6-da", "ovs_interfaceid": "6fbc9ad6-da42-4492-8603-9efc7294dbab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "854609a6-03f0-416c-8bbf-b5f85d13c688", "address": "fa:16:3e:09:0d:df", "network": {"id": "8de6c01b-e132-4efb-be00-df0968c06a81", "bridge": "br-int", "label": "tempest-device-tagging-net1-1740133735", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "92e6d918a4554cd89d9f40cee2a55d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap854609a6-03", "ovs_interfaceid": "854609a6-03f0-416c-8bbf-b5f85d13c688", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f04e7eb7-1170-4981-b342-44c664ef4c84", "address": "fa:16:3e:89:ce:7a", "network": {"id": "468865fb-36d1-436e-8fea-5f633edff84a", "bridge": "br-int", "label": "tempest-device-tagging-net2-251570535", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "92e6d918a4554cd89d9f40cee2a55d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf04e7eb7-11", "ovs_interfaceid": "f04e7eb7-1170-4981-b342-44c664ef4c84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c69d3b48-1443-4999-8369-8c5f61b35697", "address": "fa:16:3e:ec:95:94", "network": {"id": "468865fb-36d1-436e-8fea-5f633edff84a", "bridge": "br-int", "label": "tempest-device-tagging-net2-251570535", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "92e6d918a4554cd89d9f40cee2a55d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc69d3b48-14", "ovs_interfaceid": "c69d3b48-1443-4999-8369-8c5f61b35697", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73449) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 11:41:51 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-fc6efa76-7519-4bc7-958c-e25dbdd45683 req-ec2f96ff-a3b0-44fc-81ca-8eb7e9ed7640 service nova] Acquired lock "refresh_cache-f33a7013-82d0-477c-aa5e-b27e63f2b98d" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:41:51 user nova-compute[73449]: DEBUG nova.network.neutron [req-fc6efa76-7519-4bc7-958c-e25dbdd45683 req-ec2f96ff-a3b0-44fc-81ca-8eb7e9ed7640 service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Refreshing network info cache for port 6fbc9ad6-da42-4492-8603-9efc7294dbab {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 11:41:51 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 11:41:51 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 11:41:51 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:41:51 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Compute_service record updated for user:user {{(pid=73449) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 11:41:51 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.606s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:41:52 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:41:52 user nova-compute[73449]: DEBUG nova.network.neutron [req-fc6efa76-7519-4bc7-958c-e25dbdd45683 req-ec2f96ff-a3b0-44fc-81ca-8eb7e9ed7640 service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Updated VIF entry in instance network info cache for port 6fbc9ad6-da42-4492-8603-9efc7294dbab. {{(pid=73449) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 11:41:52 user nova-compute[73449]: DEBUG nova.network.neutron [req-fc6efa76-7519-4bc7-958c-e25dbdd45683 req-ec2f96ff-a3b0-44fc-81ca-8eb7e9ed7640 service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Updating instance_info_cache with network_info: [{"id": "d2d51361-0f1a-41aa-89e2-c2211bbd0b42", "address": "fa:16:3e:03:4e:88", "network": {"id": "0ff7c7f6-9609-4a35-8bb0-e8b83254f7f4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-803526263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92e6d918a4554cd89d9f40cee2a55d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2d51361-0f", "ovs_interfaceid": "d2d51361-0f1a-41aa-89e2-c2211bbd0b42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b14f4f1d-d140-4bb9-a4f2-abbaa8c98a2d", "address": "fa:16:3e:32:bc:69", "network": {"id": "8de6c01b-e132-4efb-be00-df0968c06a81", "bridge": "br-int", "label": "tempest-device-tagging-net1-1740133735", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "92e6d918a4554cd89d9f40cee2a55d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb14f4f1d-d1", "ovs_interfaceid": "b14f4f1d-d140-4bb9-a4f2-abbaa8c98a2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d8233c69-cc4f-4ae8-93ee-7f41234f72ec", "address": "fa:16:3e:14:e4:e9", "network": {"id": "8de6c01b-e132-4efb-be00-df0968c06a81", "bridge": "br-int", "label": "tempest-device-tagging-net1-1740133735", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "92e6d918a4554cd89d9f40cee2a55d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8233c69-cc", "ovs_interfaceid": "d8233c69-cc4f-4ae8-93ee-7f41234f72ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6fbc9ad6-da42-4492-8603-9efc7294dbab", "address": "fa:16:3e:a7:14:03", "network": {"id": "8de6c01b-e132-4efb-be00-df0968c06a81", "bridge": "br-int", "label": "tempest-device-tagging-net1-1740133735", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "92e6d918a4554cd89d9f40cee2a55d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fbc9ad6-da", "ovs_interfaceid": "6fbc9ad6-da42-4492-8603-9efc7294dbab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "854609a6-03f0-416c-8bbf-b5f85d13c688", "address": "fa:16:3e:09:0d:df", "network": {"id": "8de6c01b-e132-4efb-be00-df0968c06a81", "bridge": "br-int", "label": "tempest-device-tagging-net1-1740133735", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "92e6d918a4554cd89d9f40cee2a55d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap854609a6-03", "ovs_interfaceid": "854609a6-03f0-416c-8bbf-b5f85d13c688", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f04e7eb7-1170-4981-b342-44c664ef4c84", "address": "fa:16:3e:89:ce:7a", "network": {"id": "468865fb-36d1-436e-8fea-5f633edff84a", "bridge": "br-int", "label": "tempest-device-tagging-net2-251570535", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "92e6d918a4554cd89d9f40cee2a55d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf04e7eb7-11", "ovs_interfaceid": "f04e7eb7-1170-4981-b342-44c664ef4c84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c69d3b48-1443-4999-8369-8c5f61b35697", "address": "fa:16:3e:ec:95:94", "network": {"id": "468865fb-36d1-436e-8fea-5f633edff84a", "bridge": "br-int", "label": "tempest-device-tagging-net2-251570535", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "92e6d918a4554cd89d9f40cee2a55d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc69d3b48-14", "ovs_interfaceid": "c69d3b48-1443-4999-8369-8c5f61b35697", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:41:52 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-fc6efa76-7519-4bc7-958c-e25dbdd45683 req-ec2f96ff-a3b0-44fc-81ca-8eb7e9ed7640 service nova] Releasing lock "refresh_cache-f33a7013-82d0-477c-aa5e-b27e63f2b98d" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:41:52 user nova-compute[73449]: DEBUG nova.compute.manager [req-fc6efa76-7519-4bc7-958c-e25dbdd45683 req-ec2f96ff-a3b0-44fc-81ca-8eb7e9ed7640 service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Received event network-changed-671f57db-57f1-4ba3-9e49-ebe4816404f6 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:41:52 user nova-compute[73449]: DEBUG nova.compute.manager [req-fc6efa76-7519-4bc7-958c-e25dbdd45683 req-ec2f96ff-a3b0-44fc-81ca-8eb7e9ed7640 service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Refreshing instance network info cache due to event network-changed-671f57db-57f1-4ba3-9e49-ebe4816404f6. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 11:41:52 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-fc6efa76-7519-4bc7-958c-e25dbdd45683 req-ec2f96ff-a3b0-44fc-81ca-8eb7e9ed7640 service nova] Acquiring lock "refresh_cache-b8e1def1-8303-4257-b9b5-0050f05cf2d0" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:41:52 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-fc6efa76-7519-4bc7-958c-e25dbdd45683 req-ec2f96ff-a3b0-44fc-81ca-8eb7e9ed7640 service nova] Acquired lock "refresh_cache-b8e1def1-8303-4257-b9b5-0050f05cf2d0" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:41:52 user nova-compute[73449]: DEBUG nova.network.neutron [req-fc6efa76-7519-4bc7-958c-e25dbdd45683 req-ec2f96ff-a3b0-44fc-81ca-8eb7e9ed7640 service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Refreshing network info cache for port 671f57db-57f1-4ba3-9e49-ebe4816404f6 {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 11:41:52 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-33e64d20-f45c-4a4b-96f9-b0411038291f req-f505e2e5-7532-40e2-9f9e-98176ec4c788 service nova] Acquired lock "refresh_cache-f33a7013-82d0-477c-aa5e-b27e63f2b98d" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:41:52 user nova-compute[73449]: DEBUG nova.network.neutron [req-33e64d20-f45c-4a4b-96f9-b0411038291f req-f505e2e5-7532-40e2-9f9e-98176ec4c788 service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Refreshing network info cache for port c69d3b48-1443-4999-8369-8c5f61b35697 {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 11:41:52 user nova-compute[73449]: DEBUG nova.network.neutron [req-33e64d20-f45c-4a4b-96f9-b0411038291f req-f505e2e5-7532-40e2-9f9e-98176ec4c788 service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Updated VIF entry in instance network info cache for port c69d3b48-1443-4999-8369-8c5f61b35697. {{(pid=73449) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 11:41:52 user nova-compute[73449]: DEBUG nova.network.neutron [req-33e64d20-f45c-4a4b-96f9-b0411038291f req-f505e2e5-7532-40e2-9f9e-98176ec4c788 service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Updating instance_info_cache with network_info: [{"id": "d2d51361-0f1a-41aa-89e2-c2211bbd0b42", "address": "fa:16:3e:03:4e:88", "network": {"id": "0ff7c7f6-9609-4a35-8bb0-e8b83254f7f4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-803526263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92e6d918a4554cd89d9f40cee2a55d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2d51361-0f", "ovs_interfaceid": "d2d51361-0f1a-41aa-89e2-c2211bbd0b42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b14f4f1d-d140-4bb9-a4f2-abbaa8c98a2d", "address": "fa:16:3e:32:bc:69", "network": {"id": "8de6c01b-e132-4efb-be00-df0968c06a81", "bridge": "br-int", "label": "tempest-device-tagging-net1-1740133735", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "92e6d918a4554cd89d9f40cee2a55d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb14f4f1d-d1", "ovs_interfaceid": "b14f4f1d-d140-4bb9-a4f2-abbaa8c98a2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d8233c69-cc4f-4ae8-93ee-7f41234f72ec", "address": "fa:16:3e:14:e4:e9", "network": {"id": "8de6c01b-e132-4efb-be00-df0968c06a81", "bridge": "br-int", "label": "tempest-device-tagging-net1-1740133735", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "92e6d918a4554cd89d9f40cee2a55d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8233c69-cc", "ovs_interfaceid": "d8233c69-cc4f-4ae8-93ee-7f41234f72ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6fbc9ad6-da42-4492-8603-9efc7294dbab", "address": "fa:16:3e:a7:14:03", "network": {"id": "8de6c01b-e132-4efb-be00-df0968c06a81", "bridge": "br-int", "label": "tempest-device-tagging-net1-1740133735", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "92e6d918a4554cd89d9f40cee2a55d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fbc9ad6-da", "ovs_interfaceid": "6fbc9ad6-da42-4492-8603-9efc7294dbab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "854609a6-03f0-416c-8bbf-b5f85d13c688", "address": "fa:16:3e:09:0d:df", "network": {"id": "8de6c01b-e132-4efb-be00-df0968c06a81", "bridge": "br-int", "label": "tempest-device-tagging-net1-1740133735", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "92e6d918a4554cd89d9f40cee2a55d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap854609a6-03", "ovs_interfaceid": "854609a6-03f0-416c-8bbf-b5f85d13c688", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f04e7eb7-1170-4981-b342-44c664ef4c84", "address": "fa:16:3e:89:ce:7a", "network": {"id": "468865fb-36d1-436e-8fea-5f633edff84a", "bridge": "br-int", "label": "tempest-device-tagging-net2-251570535", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "92e6d918a4554cd89d9f40cee2a55d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf04e7eb7-11", "ovs_interfaceid": "f04e7eb7-1170-4981-b342-44c664ef4c84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c69d3b48-1443-4999-8369-8c5f61b35697", "address": "fa:16:3e:ec:95:94", "network": {"id": "468865fb-36d1-436e-8fea-5f633edff84a", "bridge": "br-int", "label": "tempest-device-tagging-net2-251570535", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "92e6d918a4554cd89d9f40cee2a55d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc69d3b48-14", "ovs_interfaceid": "c69d3b48-1443-4999-8369-8c5f61b35697", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:41:52 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-33e64d20-f45c-4a4b-96f9-b0411038291f req-f505e2e5-7532-40e2-9f9e-98176ec4c788 service nova] Releasing lock "refresh_cache-f33a7013-82d0-477c-aa5e-b27e63f2b98d" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:41:52 user nova-compute[73449]: DEBUG nova.network.neutron [req-fc6efa76-7519-4bc7-958c-e25dbdd45683 req-ec2f96ff-a3b0-44fc-81ca-8eb7e9ed7640 service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Updated VIF entry in instance network info cache for port 671f57db-57f1-4ba3-9e49-ebe4816404f6. {{(pid=73449) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 11:41:52 user nova-compute[73449]: DEBUG nova.network.neutron [req-fc6efa76-7519-4bc7-958c-e25dbdd45683 req-ec2f96ff-a3b0-44fc-81ca-8eb7e9ed7640 service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Updating instance_info_cache with network_info: [{"id": "c877b9e9-f45c-4199-960c-2b9926518803", "address": "fa:16:3e:0d:7d:90", "network": {"id": "1596a923-35e5-45a5-85c8-5bae45f011b7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1809575924-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60c18371fa6246888a742164afd60242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc877b9e9-f4", "ovs_interfaceid": "c877b9e9-f45c-4199-960c-2b9926518803", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "71d82cc1-6895-4d52-b066-0a01a61b329b", "address": "fa:16:3e:48:bc:7c", "network": {"id": "2c2340dc-7ea1-4f63-8819-47844b2a536e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1423531895", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "60c18371fa6246888a742164afd60242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71d82cc1-68", "ovs_interfaceid": "71d82cc1-6895-4d52-b066-0a01a61b329b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b3fe8f9e-5b75-440e-b1c1-f888a4e91e9e", "address": "fa:16:3e:0e:2e:4c", "network": {"id": "2c2340dc-7ea1-4f63-8819-47844b2a536e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1423531895", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "60c18371fa6246888a742164afd60242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3fe8f9e-5b", "ovs_interfaceid": "b3fe8f9e-5b75-440e-b1c1-f888a4e91e9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f9c9fca3-8f9c-4ea9-8ceb-ed19cb265786", "address": "fa:16:3e:a2:22:da", "network": {"id": "2c2340dc-7ea1-4f63-8819-47844b2a536e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1423531895", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "60c18371fa6246888a742164afd60242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9c9fca3-8f", "ovs_interfaceid": "f9c9fca3-8f9c-4ea9-8ceb-ed19cb265786", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6888cb29-a1bc-42b0-bec3-57667e1b0350", "address": "fa:16:3e:6e:07:1b", "network": {"id": "2c2340dc-7ea1-4f63-8819-47844b2a536e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1423531895", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "60c18371fa6246888a742164afd60242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6888cb29-a1", "ovs_interfaceid": "6888cb29-a1bc-42b0-bec3-57667e1b0350", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d85896ce-110a-41d6-a20e-6beaecb36b97", "address": "fa:16:3e:e3:51:d1", "network": {"id": "8244e7f5-12cf-4ab5-baa2-956f148fc51f", "bridge": "br-int", "label": "tempest-device-tagging-net2-163620727", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "60c18371fa6246888a742164afd60242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd85896ce-11", "ovs_interfaceid": "d85896ce-110a-41d6-a20e-6beaecb36b97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "671f57db-57f1-4ba3-9e49-ebe4816404f6", "address": "fa:16:3e:04:1d:3e", "network": {"id": "8244e7f5-12cf-4ab5-baa2-956f148fc51f", "bridge": "br-int", "label": "tempest-device-tagging-net2-163620727", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "60c18371fa6246888a742164afd60242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap671f57db-57", "ovs_interfaceid": "671f57db-57f1-4ba3-9e49-ebe4816404f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:41:52 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-fc6efa76-7519-4bc7-958c-e25dbdd45683 req-ec2f96ff-a3b0-44fc-81ca-8eb7e9ed7640 service nova] Releasing lock "refresh_cache-b8e1def1-8303-4257-b9b5-0050f05cf2d0" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:41:53 user nova-compute[73449]: INFO nova.virt.block_device [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Booting with volume 69858581-d156-4fd4-a145-74ef3c8a93dd at /dev/vdc
Aug 17 11:41:53 user nova-compute[73449]: INFO nova.virt.block_device [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Booting with volume f96b2915-ca56-4599-9eda-0f258404c9ff at /dev/vdc
Aug 17 11:41:53 user nova-compute[73449]: DEBUG os_brick.utils [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 11:41:53 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:41:53 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:41:53 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d6c0656-5c48-4a7d-9d6c-c22dce2c007f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4d3924302012\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:41:53 user nova-compute[73449]: DEBUG os_brick.utils [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 11:41:53 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:41:53 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:41:53 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:41:53 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe10742e-b8e7-465c-a3bb-084ee2322364]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:41:53 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:41:53 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.024s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:41:53 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[8544faad-9604-4caf-aa9f-daa24e558942]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4d3924302012\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:41:53 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:41:53 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:41:53 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[bea70ec5-7c59-45f2-b869-a2ffc7df3e1d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:41:53 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0cb0721-c285-42f2-a271-08234d30f41c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:41:53 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Running cmd (subprocess): nvme version {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:41:53 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] 'nvme version' failed. Not Retrying. {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 11:41:53 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:41:53 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[260480a7-34ed-4eee-b238-efa60c526574]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:41:53 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] nvme not present on system {{(pid=73449) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 11:41:53 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:41:53 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:41:53 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 11:41:53 user nova-compute[73449]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 11:41:53 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb07b373-0f7c-45ed-9a2d-0346b371c25a]: (4, '') {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:41:53 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73449) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 11:41:53 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73449) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 11:41:53 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] LIGHTOS: no hostnqn found. {{(pid=73449) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 11:41:53 user nova-compute[73449]: DEBUG os_brick.utils [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] <== get_connector_properties: return (162ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4d3924302012', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 11:41:53 user nova-compute[73449]: DEBUG nova.virt.block_device [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Updating existing volume attachment record: 8c359882-9a2f-4b61-86a6-9e32e5abb9c7 {{(pid=73449) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 11:41:53 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:41:53 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[55661759-635e-4dfa-ab56-84771dec96ec]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:41:53 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[410058a1-7081-4f13-8b4e-c616a3f65a9d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:41:53 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Running cmd (subprocess): nvme version {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:41:53 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:41:53 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] 'nvme version' failed. Not Retrying. {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 11:41:53 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] nvme not present on system {{(pid=73449) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 11:41:53 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:41:54 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 11:41:54 user nova-compute[73449]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 11:41:54 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[83d7e654-9aed-49f5-ac10-4c37fa7565f6]: (4, '') {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:41:54 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73449) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 11:41:54 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73449) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 11:41:54 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] LIGHTOS: no hostnqn found. {{(pid=73449) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 11:41:54 user nova-compute[73449]: DEBUG os_brick.utils [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] <== get_connector_properties: return (233ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4d3924302012', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 11:41:54 user nova-compute[73449]: DEBUG nova.virt.block_device [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Updating existing volume attachment record: e56c7c49-dc0d-4d5f-ad4a-8be36924e702 {{(pid=73449) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 11:41:54 user nova-compute[73449]: DEBUG nova.compute.manager [req-7b15bbe9-e80c-45e7-bcdf-7955d9967da2 req-3ea86572-9270-4fdf-8798-6a5d14a7fc77 service nova] [instance: 4a9e8ad2-19db-4975-87e4-2efce603a7d7] Received event network-changed-3c5f8e97-0654-42f0-9575-eab6d833283a {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:41:54 user nova-compute[73449]: DEBUG nova.compute.manager [req-7b15bbe9-e80c-45e7-bcdf-7955d9967da2 req-3ea86572-9270-4fdf-8798-6a5d14a7fc77 service nova] [instance: 4a9e8ad2-19db-4975-87e4-2efce603a7d7] Refreshing instance network info cache due to event network-changed-3c5f8e97-0654-42f0-9575-eab6d833283a. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 11:41:54 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-7b15bbe9-e80c-45e7-bcdf-7955d9967da2 req-3ea86572-9270-4fdf-8798-6a5d14a7fc77 service nova] Acquiring lock "refresh_cache-4a9e8ad2-19db-4975-87e4-2efce603a7d7" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:41:54 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-7b15bbe9-e80c-45e7-bcdf-7955d9967da2 req-3ea86572-9270-4fdf-8798-6a5d14a7fc77 service nova] Acquired lock "refresh_cache-4a9e8ad2-19db-4975-87e4-2efce603a7d7" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:41:54 user nova-compute[73449]: DEBUG nova.network.neutron [req-7b15bbe9-e80c-45e7-bcdf-7955d9967da2 req-3ea86572-9270-4fdf-8798-6a5d14a7fc77 service nova] [instance: 4a9e8ad2-19db-4975-87e4-2efce603a7d7] Refreshing network info cache for port 3c5f8e97-0654-42f0-9575-eab6d833283a {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 11:41:55 user nova-compute[73449]: DEBUG nova.network.neutron [req-7b15bbe9-e80c-45e7-bcdf-7955d9967da2 req-3ea86572-9270-4fdf-8798-6a5d14a7fc77 service nova] [instance: 4a9e8ad2-19db-4975-87e4-2efce603a7d7] Updated VIF entry in instance network info cache for port 3c5f8e97-0654-42f0-9575-eab6d833283a. {{(pid=73449) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 11:41:55 user nova-compute[73449]: DEBUG nova.network.neutron [req-7b15bbe9-e80c-45e7-bcdf-7955d9967da2 req-3ea86572-9270-4fdf-8798-6a5d14a7fc77 service nova] [instance: 4a9e8ad2-19db-4975-87e4-2efce603a7d7] Updating instance_info_cache with network_info: [{"id": "3c5f8e97-0654-42f0-9575-eab6d833283a", "address": "fa:16:3e:c8:b7:51", "network": {"id": "72c50a42-688f-4868-8e19-c40b103a49cd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1792423641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "068c5270255744a18208a0ad9b35f168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c5f8e97-06", "ovs_interfaceid": "3c5f8e97-0654-42f0-9575-eab6d833283a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:41:55 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-7b15bbe9-e80c-45e7-bcdf-7955d9967da2 req-3ea86572-9270-4fdf-8798-6a5d14a7fc77 service nova] Releasing lock "refresh_cache-4a9e8ad2-19db-4975-87e4-2efce603a7d7" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:41:56 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:41:57 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:41:57 user nova-compute[73449]: DEBUG nova.compute.manager [req-9e1f7363-e21b-4116-8b2f-ff7b82dc8b94 req-6ad4d9d5-0600-4dd2-a0de-80338fdc743d service nova] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Received event network-changed-2a0eb61f-9398-4db6-9ae0-f142ad2e60c4 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:41:57 user nova-compute[73449]: DEBUG nova.compute.manager [req-9e1f7363-e21b-4116-8b2f-ff7b82dc8b94 req-6ad4d9d5-0600-4dd2-a0de-80338fdc743d service nova] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Refreshing instance network info cache due to event network-changed-2a0eb61f-9398-4db6-9ae0-f142ad2e60c4. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 11:41:57 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-9e1f7363-e21b-4116-8b2f-ff7b82dc8b94 req-6ad4d9d5-0600-4dd2-a0de-80338fdc743d service nova] Acquiring lock "refresh_cache-a3523d22-7165-46ad-be10-5e6ae374f91d" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:41:57 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-9e1f7363-e21b-4116-8b2f-ff7b82dc8b94 req-6ad4d9d5-0600-4dd2-a0de-80338fdc743d service nova] Acquired lock "refresh_cache-a3523d22-7165-46ad-be10-5e6ae374f91d" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:41:57 user nova-compute[73449]: DEBUG nova.network.neutron [req-9e1f7363-e21b-4116-8b2f-ff7b82dc8b94 req-6ad4d9d5-0600-4dd2-a0de-80338fdc743d service nova] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Refreshing network info cache for port 2a0eb61f-9398-4db6-9ae0-f142ad2e60c4 {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 11:41:57 user nova-compute[73449]: DEBUG nova.network.neutron [req-9e1f7363-e21b-4116-8b2f-ff7b82dc8b94 req-6ad4d9d5-0600-4dd2-a0de-80338fdc743d service nova] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Updated VIF entry in instance network info cache for port 2a0eb61f-9398-4db6-9ae0-f142ad2e60c4. {{(pid=73449) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 11:41:57 user nova-compute[73449]: DEBUG nova.network.neutron [req-9e1f7363-e21b-4116-8b2f-ff7b82dc8b94 req-6ad4d9d5-0600-4dd2-a0de-80338fdc743d service nova] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Updating instance_info_cache with network_info: [{"id": "2a0eb61f-9398-4db6-9ae0-f142ad2e60c4", "address": "fa:16:3e:15:cd:09", "network": {"id": "d54a402f-1fa9-43d8-b68e-0aa7ae6f0e73", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1441085328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eed9899860d4e7ca8a4500bbda4be13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a0eb61f-93", "ovs_interfaceid": "2a0eb61f-9398-4db6-9ae0-f142ad2e60c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:41:57 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-9e1f7363-e21b-4116-8b2f-ff7b82dc8b94 req-6ad4d9d5-0600-4dd2-a0de-80338fdc743d service nova] Releasing lock "refresh_cache-a3523d22-7165-46ad-be10-5e6ae374f91d" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:41:58 user nova-compute[73449]: DEBUG nova.compute.manager [None req-23ec5dac-adb0-4af8-96df-7501cb19c480 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:41:58 user nova-compute[73449]: INFO nova.compute.manager [None req-23ec5dac-adb0-4af8-96df-7501cb19c480 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] instance snapshotting
Aug 17 11:41:58 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-23ec5dac-adb0-4af8-96df-7501cb19c480 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Beginning live snapshot process
Aug 17 11:41:59 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-23ec5dac-adb0-4af8-96df-7501cb19c480 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3523d22-7165-46ad-be10-5e6ae374f91d/disk --force-share --output=json -f qcow2 {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:41:59 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-23ec5dac-adb0-4af8-96df-7501cb19c480 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3523d22-7165-46ad-be10-5e6ae374f91d/disk --force-share --output=json -f qcow2" returned: 0 in 0.181s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:41:59 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-23ec5dac-adb0-4af8-96df-7501cb19c480 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3523d22-7165-46ad-be10-5e6ae374f91d/disk --force-share --output=json -f qcow2 {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:41:59 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-23ec5dac-adb0-4af8-96df-7501cb19c480 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3523d22-7165-46ad-be10-5e6ae374f91d/disk --force-share --output=json -f qcow2" returned: 0 in 0.212s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:41:59 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-23ec5dac-adb0-4af8-96df-7501cb19c480 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:41:59 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-23ec5dac-adb0-4af8-96df-7501cb19c480 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json" returned: 0 in 0.216s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:41:59 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-23ec5dac-adb0-4af8-96df-7501cb19c480 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpkrs2mxpb/80f74dd69c294973b82ef3f8a73e79de.delta 1073741824 {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:41:59 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-23ec5dac-adb0-4af8-96df-7501cb19c480 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpkrs2mxpb/80f74dd69c294973b82ef3f8a73e79de.delta 1073741824" returned: 0 in 0.057s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:41:59 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-23ec5dac-adb0-4af8-96df-7501cb19c480 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 17 11:41:59 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-23ec5dac-adb0-4af8-96df-7501cb19c480 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Checking UEFI support for host arch (x86_64) {{(pid=73449) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Aug 17 11:41:59 user nova-compute[73449]: INFO nova.virt.libvirt.host [None req-23ec5dac-adb0-4af8-96df-7501cb19c480 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] UEFI support detected
Aug 17 11:42:00 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-23ec5dac-adb0-4af8-96df-7501cb19c480 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=73449) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 11:42:01 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-23ec5dac-adb0-4af8-96df-7501cb19c480 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=73449) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 11:42:01 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-23ec5dac-adb0-4af8-96df-7501cb19c480 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 17 11:42:01 user nova-compute[73449]: DEBUG nova.privsep.utils [None req-23ec5dac-adb0-4af8-96df-7501cb19c480 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73449) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 11:42:01 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-23ec5dac-adb0-4af8-96df-7501cb19c480 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpkrs2mxpb/80f74dd69c294973b82ef3f8a73e79de.delta /opt/stack/data/nova/instances/snapshots/tmpkrs2mxpb/80f74dd69c294973b82ef3f8a73e79de {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:01 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-23ec5dac-adb0-4af8-96df-7501cb19c480 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpkrs2mxpb/80f74dd69c294973b82ef3f8a73e79de.delta /opt/stack/data/nova/instances/snapshots/tmpkrs2mxpb/80f74dd69c294973b82ef3f8a73e79de" returned: 0 in 0.344s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:01 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-23ec5dac-adb0-4af8-96df-7501cb19c480 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Snapshot extracted, beginning image upload
Aug 17 11:42:01 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-931f74cb-c789-45d4-bd03-27a1f0ade67c tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:42:01 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-931f74cb-c789-45d4-bd03-27a1f0ade67c tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:42:01 user nova-compute[73449]: DEBUG os_brick.initiator.connector [None req-931f74cb-c789-45d4-bd03-27a1f0ade67c tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] Factory for ISCSI on None {{(pid=73449) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Aug 17 11:42:01 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-931f74cb-c789-45d4-bd03-27a1f0ade67c tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.006s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:42:01 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-931f74cb-c789-45d4-bd03-27a1f0ade67c tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] [instance: a40e1f85-a7e6-46da-8f98-df7a278aaade] Calling os-brick to attach iSCSI Volume {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 11:42:01 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-931f74cb-c789-45d4-bd03-27a1f0ade67c tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b5a94173-47ef-42e4-b403-aa9ac6cadc85'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vWyqbBDx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 11:42:01 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-931f74cb-c789-45d4-bd03-27a1f0ade67c tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 11:42:01 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-931f74cb-c789-45d4-bd03-27a1f0ade67c tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:42:01 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-931f74cb-c789-45d4-bd03-27a1f0ade67c tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:42:01 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-931f74cb-c789-45d4-bd03-27a1f0ade67c tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 11:42:01 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-931f74cb-c789-45d4-bd03-27a1f0ade67c tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5a94173-47ef-42e4-b403-aa9ac6cadc85" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:42:01 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-931f74cb-c789-45d4-bd03-27a1f0ade67c tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5a94173-47ef-42e4-b403-aa9ac6cadc85" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:42:01 user nova-compute[73449]: INFO os_brick.initiator.connectors.iscsi [None req-931f74cb-c789-45d4-bd03-27a1f0ade67c tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 11:42:01 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5a94173-47ef-42e4-b403-aa9ac6cadc85 -p 172.16.0.220:3260 {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:01 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5a94173-47ef-42e4-b403-aa9ac6cadc85 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:01 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebcf6e19-e382-4a43-8271-d19b4fa55e82]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:01 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-931f74cb-c789-45d4-bd03-27a1f0ade67c tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 11:42:01 user nova-compute[73449]:  {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:42:01 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5a94173-47ef-42e4-b403-aa9ac6cadc85 -p 172.16.0.220:3260 --interface default --op new {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:01 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5a94173-47ef-42e4-b403-aa9ac6cadc85 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:01 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[9710d9ff-eb69-4204-bdc8-161c371ed012]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b5a94173-47ef-42e4-b403-aa9ac6cadc85] added\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:01 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-931f74cb-c789-45d4-bd03-27a1f0ade67c tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b5a94173-47ef-42e4-b403-aa9ac6cadc85] added
Aug 17 11:42:01 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:42:01 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5a94173-47ef-42e4-b403-aa9ac6cadc85 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:01 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5a94173-47ef-42e4-b403-aa9ac6cadc85 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:01 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[92f692a8-911f-4350-a495-0d54b148c9fd]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:01 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-931f74cb-c789-45d4-bd03-27a1f0ade67c tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:42:01 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5a94173-47ef-42e4-b403-aa9ac6cadc85 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:01 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5a94173-47ef-42e4-b403-aa9ac6cadc85 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:01 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb6d7d87-f469-4e94-82b3-10031a6e05fb]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:01 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-931f74cb-c789-45d4-bd03-27a1f0ade67c tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:42:01 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5a94173-47ef-42e4-b403-aa9ac6cadc85 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vWyqbBDx {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:01 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5a94173-47ef-42e4-b403-aa9ac6cadc85 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vWyqbBDx" returned: 0 in 0.022s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:01 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[4345ee18-8978-496b-9b1d-adfae78af40b]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:01 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-931f74cb-c789-45d4-bd03-27a1f0ade67c tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vWyqbBDx'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:42:01 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5a94173-47ef-42e4-b403-aa9ac6cadc85 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:01 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5a94173-47ef-42e4-b403-aa9ac6cadc85 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:01 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fc05dce-bbef-4e36-94db-ad710dbc51d4]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:01 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-931f74cb-c789-45d4-bd03-27a1f0ade67c tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:42:01 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:01 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.022s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:01 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ba73e49-9fbe-467f-9a37-5a31463383c6]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:01 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-931f74cb-c789-45d4-bd03-27a1f0ade67c tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 17 11:42:01 user nova-compute[73449]:  {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:42:01 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-931f74cb-c789-45d4-bd03-27a1f0ade67c tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 17 11:42:01 user nova-compute[73449]:  {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:42:01 user nova-compute[73449]: WARNING os_brick.initiator.connectors.iscsi [None req-931f74cb-c789-45d4-bd03-27a1f0ade67c tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 17 11:42:01 user nova-compute[73449]: 
Aug 17 11:42:01 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5a94173-47ef-42e4-b403-aa9ac6cadc85 -p 172.16.0.220:3260 --login {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:01 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5a94173-47ef-42e4-b403-aa9ac6cadc85 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:01 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[752f1af8-03ec-4941-bf65-1ec80db58212]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b5a94173-47ef-42e4-b403-aa9ac6cadc85, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b5a94173-47ef-42e4-b403-aa9ac6cadc85, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:01 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-931f74cb-c789-45d4-bd03-27a1f0ade67c tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b5a94173-47ef-42e4-b403-aa9ac6cadc85, portal: 172.16.0.220,3260]
Aug 17 11:42:01 user nova-compute[73449]: Login to [iface: default, target: iqn.2010-10.org.openstack:b5a94173-47ef-42e4-b403-aa9ac6cadc85, portal: 172.16.0.220,3260] successful.
Aug 17 11:42:01 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:42:01 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5a94173-47ef-42e4-b403-aa9ac6cadc85 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:01 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5a94173-47ef-42e4-b403-aa9ac6cadc85 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:01 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5abd49a-f92d-4500-83c3-469093e450e2]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:01 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-931f74cb-c789-45d4-bd03-27a1f0ade67c tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:42:01 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:01 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:01 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[49d3f9bd-f7e1-4d2c-8496-c9597402393f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5a94173-47ef-42e4-b403-aa9ac6cadc85 (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:01 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-931f74cb-c789-45d4-bd03-27a1f0ade67c tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5a94173-47ef-42e4-b403-aa9ac6cadc85 (non-flash)
Aug 17 11:42:01 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:42:01 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-931f74cb-c789-45d4-bd03-27a1f0ade67c tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5a94173-47ef-42e4-b403-aa9ac6cadc85 (non-flash)
Aug 17 11:42:01 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:42:01 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-931f74cb-c789-45d4-bd03-27a1f0ade67c tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5a94173-47ef-42e4-b403-aa9ac6cadc85" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.312s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:42:01 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-931f74cb-c789-45d4-bd03-27a1f0ade67c tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] Connected to 172.16.0.220:3260 {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 11:42:01 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-931f74cb-c789-45d4-bd03-27a1f0ade67c tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=73449) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 11:42:01 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-931f74cb-c789-45d4-bd03-27a1f0ade67c tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73449) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 11:42:01 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:01 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:02 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.048s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:02 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2dc489c-ae34-426f-b95e-14ac7e05b0a3]: (4, ('- - 0', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:02 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-931f74cb-c789-45d4-bd03-27a1f0ade67c tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73449) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 11:42:02 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-931f74cb-c789-45d4-bd03-27a1f0ade67c tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vWyqbBDx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 11:42:02 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:03 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-931f74cb-c789-45d4-bd03-27a1f0ade67c tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.385s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:42:03 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-931f74cb-c789-45d4-bd03-27a1f0ade67c tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] <== connect_volume: return (1388ms) {'type': 'block', 'scsi_wwn': '23764366537353263', 'path': '/dev/sdb'} {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 11:42:03 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-931f74cb-c789-45d4-bd03-27a1f0ade67c tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] [instance: a40e1f85-a7e6-46da-8f98-df7a278aaade] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23764366537353263', 'path': '/dev/sdb'} {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 11:42:03 user nova-compute[73449]: DEBUG nova.objects.instance [None req-931f74cb-c789-45d4-bd03-27a1f0ade67c tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] Lazy-loading 'flavor' on Instance uuid a40e1f85-a7e6-46da-8f98-df7a278aaade {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:42:03 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-931f74cb-c789-45d4-bd03-27a1f0ade67c tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 11:42:03 user nova-compute[73449]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 11:42:03 user nova-compute[73449]:   <source dev="/dev/sdb"/>
Aug 17 11:42:03 user nova-compute[73449]:   <target dev="vdb" bus="virtio"/>
Aug 17 11:42:03 user nova-compute[73449]:   <serial>b5a94173-47ef-42e4-b403-aa9ac6cadc85</serial>
Aug 17 11:42:03 user nova-compute[73449]: </disk>
Aug 17 11:42:03 user nova-compute[73449]:  {{(pid=73449) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 11:42:03 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-931f74cb-c789-45d4-bd03-27a1f0ade67c tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] No BDM found with device name vda, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 11:42:03 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-931f74cb-c789-45d4-bd03-27a1f0ade67c tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 11:42:03 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-931f74cb-c789-45d4-bd03-27a1f0ade67c tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] No VIF found with MAC fa:16:3e:e4:b6:ea, not building metadata {{(pid=73449) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 11:42:03 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-931f74cb-c789-45d4-bd03-27a1f0ade67c tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] Lock "a40e1f85-a7e6-46da-8f98-df7a278aaade" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.278s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:42:04 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-7336886e-1774-46e3-b3e9-51a90c43ccc2 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] Acquiring lock "a40e1f85-a7e6-46da-8f98-df7a278aaade" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:42:04 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-7336886e-1774-46e3-b3e9-51a90c43ccc2 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] Lock "a40e1f85-a7e6-46da-8f98-df7a278aaade" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:42:04 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-7336886e-1774-46e3-b3e9-51a90c43ccc2 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] Acquiring lock "a40e1f85-a7e6-46da-8f98-df7a278aaade-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:42:04 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-7336886e-1774-46e3-b3e9-51a90c43ccc2 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] Lock "a40e1f85-a7e6-46da-8f98-df7a278aaade-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:42:04 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-7336886e-1774-46e3-b3e9-51a90c43ccc2 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] Lock "a40e1f85-a7e6-46da-8f98-df7a278aaade-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:42:04 user nova-compute[73449]: INFO nova.compute.manager [None req-7336886e-1774-46e3-b3e9-51a90c43ccc2 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] [instance: a40e1f85-a7e6-46da-8f98-df7a278aaade] Terminating instance
Aug 17 11:42:04 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-23ec5dac-adb0-4af8-96df-7501cb19c480 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Snapshot image upload complete
Aug 17 11:42:04 user nova-compute[73449]: INFO nova.compute.manager [None req-23ec5dac-adb0-4af8-96df-7501cb19c480 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Took 5.42 seconds to snapshot the instance on the hypervisor.
Aug 17 11:42:04 user nova-compute[73449]: DEBUG nova.compute.manager [None req-7336886e-1774-46e3-b3e9-51a90c43ccc2 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] [instance: a40e1f85-a7e6-46da-8f98-df7a278aaade] Start destroying the instance on the hypervisor. {{(pid=73449) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 11:42:04 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:04 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:04 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:04 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:04 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:04 user nova-compute[73449]: DEBUG nova.compute.manager [req-379c180d-5190-49ca-bfda-6486d5e3d963 req-303bbd10-e7ad-41f0-82a1-b9648bc84b15 service nova] [instance: a40e1f85-a7e6-46da-8f98-df7a278aaade] Received event network-vif-unplugged-6f565f5b-de2a-4190-86fd-0d2606a9c5e9 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:42:04 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-379c180d-5190-49ca-bfda-6486d5e3d963 req-303bbd10-e7ad-41f0-82a1-b9648bc84b15 service nova] Acquiring lock "a40e1f85-a7e6-46da-8f98-df7a278aaade-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:42:04 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-379c180d-5190-49ca-bfda-6486d5e3d963 req-303bbd10-e7ad-41f0-82a1-b9648bc84b15 service nova] Lock "a40e1f85-a7e6-46da-8f98-df7a278aaade-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:42:04 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-379c180d-5190-49ca-bfda-6486d5e3d963 req-303bbd10-e7ad-41f0-82a1-b9648bc84b15 service nova] Lock "a40e1f85-a7e6-46da-8f98-df7a278aaade-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:42:04 user nova-compute[73449]: DEBUG nova.compute.manager [req-379c180d-5190-49ca-bfda-6486d5e3d963 req-303bbd10-e7ad-41f0-82a1-b9648bc84b15 service nova] [instance: a40e1f85-a7e6-46da-8f98-df7a278aaade] No waiting events found dispatching network-vif-unplugged-6f565f5b-de2a-4190-86fd-0d2606a9c5e9 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:42:04 user nova-compute[73449]: DEBUG nova.compute.manager [req-379c180d-5190-49ca-bfda-6486d5e3d963 req-303bbd10-e7ad-41f0-82a1-b9648bc84b15 service nova] [instance: a40e1f85-a7e6-46da-8f98-df7a278aaade] Received event network-vif-unplugged-6f565f5b-de2a-4190-86fd-0d2606a9c5e9 for instance with task_state deleting. {{(pid=73449) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 11:42:05 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:05 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:05 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:05 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: a40e1f85-a7e6-46da-8f98-df7a278aaade] Instance destroyed successfully.
Aug 17 11:42:05 user nova-compute[73449]: DEBUG nova.objects.instance [None req-7336886e-1774-46e3-b3e9-51a90c43ccc2 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] Lazy-loading 'resources' on Instance uuid a40e1f85-a7e6-46da-8f98-df7a278aaade {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:42:05 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-7336886e-1774-46e3-b3e9-51a90c43ccc2 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:39:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-726436740',display_name='tempest-DeleteServersTestJSON-server-726436740',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-726436740',id=1,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T11:40:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3dd321fccefc4bb6b89c59b1cc70df0b',ramdisk_id='',reservation_id='r-nlwr3lhn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-417173257',owner_user_name='tempest-DeleteServersTestJSON-417173257-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T11:40:10Z,user_data=None,user_id='31cdb313169e49709185780d4cfbfcd1',uuid=a40e1f85-a7e6-46da-8f98-df7a278aaade,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6f565f5b-de2a-4190-86fd-0d2606a9c5e9", "address": "fa:16:3e:e4:b6:ea", "network": {"id": "4275d6ae-c74d-4900-93d9-65ec567b5abe", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1540860684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dd321fccefc4bb6b89c59b1cc70df0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f565f5b-de", "ovs_interfaceid": "6f565f5b-de2a-4190-86fd-0d2606a9c5e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 11:42:05 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-7336886e-1774-46e3-b3e9-51a90c43ccc2 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] Converting VIF {"id": "6f565f5b-de2a-4190-86fd-0d2606a9c5e9", "address": "fa:16:3e:e4:b6:ea", "network": {"id": "4275d6ae-c74d-4900-93d9-65ec567b5abe", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1540860684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dd321fccefc4bb6b89c59b1cc70df0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f565f5b-de", "ovs_interfaceid": "6f565f5b-de2a-4190-86fd-0d2606a9c5e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:42:05 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-7336886e-1774-46e3-b3e9-51a90c43ccc2 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e4:b6:ea,bridge_name='br-int',has_traffic_filtering=True,id=6f565f5b-de2a-4190-86fd-0d2606a9c5e9,network=Network(4275d6ae-c74d-4900-93d9-65ec567b5abe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f565f5b-de') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:42:05 user nova-compute[73449]: DEBUG os_vif [None req-7336886e-1774-46e3-b3e9-51a90c43ccc2 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:b6:ea,bridge_name='br-int',has_traffic_filtering=True,id=6f565f5b-de2a-4190-86fd-0d2606a9c5e9,network=Network(4275d6ae-c74d-4900-93d9-65ec567b5abe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f565f5b-de') {{(pid=73449) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 11:42:05 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:05 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6f565f5b-de, bridge=br-int, if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:42:05 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:05 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:42:05 user nova-compute[73449]: INFO os_vif [None req-7336886e-1774-46e3-b3e9-51a90c43ccc2 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:b6:ea,bridge_name='br-int',has_traffic_filtering=True,id=6f565f5b-de2a-4190-86fd-0d2606a9c5e9,network=Network(4275d6ae-c74d-4900-93d9-65ec567b5abe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f565f5b-de')
Aug 17 11:42:05 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7336886e-1774-46e3-b3e9-51a90c43ccc2 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] [instance: a40e1f85-a7e6-46da-8f98-df7a278aaade] calling os-brick to detach iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 11:42:05 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-7336886e-1774-46e3-b3e9-51a90c43ccc2 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, {'target_iqns': ['iqn.2010-10.org.openstack:b5a94173-47ef-42e4-b403-aa9ac6cadc85'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vWyqbBDx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 11:42:05 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-7336886e-1774-46e3-b3e9-51a90c43ccc2 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 11:42:05 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-7336886e-1774-46e3-b3e9-51a90c43ccc2 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:42:05 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-7336886e-1774-46e3-b3e9-51a90c43ccc2 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:42:05 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-7336886e-1774-46e3-b3e9-51a90c43ccc2 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5a94173-47ef-42e4-b403-aa9ac6cadc85', 0)] {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 11:42:05 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:05 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:05 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaa5fdc8-ebfd-4ac1-ae60-140e23b43692]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5a94173-47ef-42e4-b403-aa9ac6cadc85\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:05 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:05 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:05 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5416918-4795-45a2-8f89-167f1fd6be9e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5a94173-47ef-42e4-b403-aa9ac6cadc85 (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:05 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-7336886e-1774-46e3-b3e9-51a90c43ccc2 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5a94173-47ef-42e4-b403-aa9ac6cadc85 (non-flash)
Aug 17 11:42:05 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:42:05 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-7336886e-1774-46e3-b3e9-51a90c43ccc2 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5a94173-47ef-42e4-b403-aa9ac6cadc85 (non-flash)
Aug 17 11:42:05 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:42:05 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-7336886e-1774-46e3-b3e9-51a90c43ccc2 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe7587bcd30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5a94173-47ef-42e4-b403-aa9ac6cadc85'): ({'sdb'}, set())}) {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 11:42:05 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-7336886e-1774-46e3-b3e9-51a90c43ccc2 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] Removing single pathed devices sdb {{(pid=73449) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 11:42:05 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:05 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:05 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[70bf972d-20cb-4412-9c01-dd2027ad87a3]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:05 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:05 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:05 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[75a7f190-7f78-4c37-a163-0524d01ab837]: (4, ('ok\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:05 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-7336886e-1774-46e3-b3e9-51a90c43ccc2 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] Flushing IO for device /dev/sdb {{(pid=73449) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 11:42:05 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:05 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:05 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[00785c4d-8d05-4fe2-b1c0-e4afb084db0f]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:05 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-7336886e-1774-46e3-b3e9-51a90c43ccc2 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73449) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 11:42:05 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:05 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:05 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[7baaa3c1-b23e-47d6-a7ac-36ceeee5db40]: (4, ('1', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:05 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-7336886e-1774-46e3-b3e9-51a90c43ccc2 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73449) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 11:42:05 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-7336886e-1774-46e3-b3e9-51a90c43ccc2 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] SCSI volumes sdb have been removed. {{(pid=73449) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 11:42:05 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-7336886e-1774-46e3-b3e9-51a90c43ccc2 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5a94173-47ef-42e4-b403-aa9ac6cadc85')] {{(pid=73449) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 11:42:05 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5a94173-47ef-42e4-b403-aa9ac6cadc85 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:05 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5a94173-47ef-42e4-b403-aa9ac6cadc85 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:05 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[27d185c2-31df-4fc4-9d60-f70d44afc9d3]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:05 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-7336886e-1774-46e3-b3e9-51a90c43ccc2 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:42:05 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5a94173-47ef-42e4-b403-aa9ac6cadc85 -p 172.16.0.220:3260 --logout {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:05 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5a94173-47ef-42e4-b403-aa9ac6cadc85 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:05 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[4904e4be-fae3-4cc5-abea-534e3fceec8a]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:b5a94173-47ef-42e4-b403-aa9ac6cadc85, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:b5a94173-47ef-42e4-b403-aa9ac6cadc85, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:05 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-7336886e-1774-46e3-b3e9-51a90c43ccc2 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:b5a94173-47ef-42e4-b403-aa9ac6cadc85, portal: 172.16.0.220,3260]
Aug 17 11:42:05 user nova-compute[73449]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:b5a94173-47ef-42e4-b403-aa9ac6cadc85, portal: 172.16.0.220,3260] successful.
Aug 17 11:42:05 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:42:05 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5a94173-47ef-42e4-b403-aa9ac6cadc85 -p 172.16.0.220:3260 --op delete {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:05 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5a94173-47ef-42e4-b403-aa9ac6cadc85 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:05 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[67a02eee-186c-4f62-945d-707add588f16]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:05 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-7336886e-1774-46e3-b3e9-51a90c43ccc2 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:42:05 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-7336886e-1774-46e3-b3e9-51a90c43ccc2 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:42:05 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-7336886e-1774-46e3-b3e9-51a90c43ccc2 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] <== disconnect_volume: return (297ms) None {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 11:42:05 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7336886e-1774-46e3-b3e9-51a90c43ccc2 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] [instance: a40e1f85-a7e6-46da-8f98-df7a278aaade] Disconnected iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 11:42:05 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-7336886e-1774-46e3-b3e9-51a90c43ccc2 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] [instance: a40e1f85-a7e6-46da-8f98-df7a278aaade] Deleting instance files /opt/stack/data/nova/instances/a40e1f85-a7e6-46da-8f98-df7a278aaade_del
Aug 17 11:42:05 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-7336886e-1774-46e3-b3e9-51a90c43ccc2 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] [instance: a40e1f85-a7e6-46da-8f98-df7a278aaade] Deletion of /opt/stack/data/nova/instances/a40e1f85-a7e6-46da-8f98-df7a278aaade_del complete
Aug 17 11:42:05 user nova-compute[73449]: INFO nova.compute.manager [None req-7336886e-1774-46e3-b3e9-51a90c43ccc2 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] [instance: a40e1f85-a7e6-46da-8f98-df7a278aaade] Took 1.34 seconds to destroy the instance on the hypervisor.
Aug 17 11:42:05 user nova-compute[73449]: DEBUG oslo.service.loopingcall [None req-7336886e-1774-46e3-b3e9-51a90c43ccc2 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73449) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 11:42:05 user nova-compute[73449]: DEBUG nova.compute.manager [-] [instance: a40e1f85-a7e6-46da-8f98-df7a278aaade] Deallocating network for instance {{(pid=73449) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 11:42:05 user nova-compute[73449]: DEBUG nova.network.neutron [-] [instance: a40e1f85-a7e6-46da-8f98-df7a278aaade] deallocate_for_instance() {{(pid=73449) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 11:42:06 user nova-compute[73449]: DEBUG nova.network.neutron [-] [instance: a40e1f85-a7e6-46da-8f98-df7a278aaade] Updating instance_info_cache with network_info: [] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:42:06 user nova-compute[73449]: INFO nova.compute.manager [-] [instance: a40e1f85-a7e6-46da-8f98-df7a278aaade] Took 0.88 seconds to deallocate network for instance.
Aug 17 11:42:06 user nova-compute[73449]: DEBUG nova.compute.manager [req-333ff993-f274-4bd0-8563-88f21d61b5b3 req-236f029f-9da5-4d37-b05a-1fa195b687fa service nova] [instance: a40e1f85-a7e6-46da-8f98-df7a278aaade] Received event network-vif-deleted-6f565f5b-de2a-4190-86fd-0d2606a9c5e9 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:42:06 user nova-compute[73449]: DEBUG nova.compute.manager [req-55cd7a0b-f099-4429-b824-a0a81e8680b9 req-ffb8a75b-77f1-470f-b57e-ac3ee4c68a5a service nova] [instance: a40e1f85-a7e6-46da-8f98-df7a278aaade] Received event network-vif-plugged-6f565f5b-de2a-4190-86fd-0d2606a9c5e9 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:42:06 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-55cd7a0b-f099-4429-b824-a0a81e8680b9 req-ffb8a75b-77f1-470f-b57e-ac3ee4c68a5a service nova] Acquiring lock "a40e1f85-a7e6-46da-8f98-df7a278aaade-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:42:06 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-55cd7a0b-f099-4429-b824-a0a81e8680b9 req-ffb8a75b-77f1-470f-b57e-ac3ee4c68a5a service nova] Lock "a40e1f85-a7e6-46da-8f98-df7a278aaade-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:42:06 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-55cd7a0b-f099-4429-b824-a0a81e8680b9 req-ffb8a75b-77f1-470f-b57e-ac3ee4c68a5a service nova] Lock "a40e1f85-a7e6-46da-8f98-df7a278aaade-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:42:06 user nova-compute[73449]: DEBUG nova.compute.manager [req-55cd7a0b-f099-4429-b824-a0a81e8680b9 req-ffb8a75b-77f1-470f-b57e-ac3ee4c68a5a service nova] [instance: a40e1f85-a7e6-46da-8f98-df7a278aaade] No waiting events found dispatching network-vif-plugged-6f565f5b-de2a-4190-86fd-0d2606a9c5e9 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:42:06 user nova-compute[73449]: WARNING nova.compute.manager [req-55cd7a0b-f099-4429-b824-a0a81e8680b9 req-ffb8a75b-77f1-470f-b57e-ac3ee4c68a5a service nova] [instance: a40e1f85-a7e6-46da-8f98-df7a278aaade] Received unexpected event network-vif-plugged-6f565f5b-de2a-4190-86fd-0d2606a9c5e9 for instance with vm_state active and task_state deleting.
Aug 17 11:42:06 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:07 user nova-compute[73449]: DEBUG nova.compute.manager [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Start spawning the instance on the hypervisor. {{(pid=73449) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 11:42:07 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Creating instance directory {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 11:42:07 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Creating image(s)
Aug 17 11:42:07 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Did not create local disks {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 11:42:07 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Ensure instance console log exists: /opt/stack/data/nova/instances/f33a7013-82d0-477c-aa5e-b27e63f2b98d/console.log {{(pid=73449) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 11:42:07 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:42:07 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:42:07 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:42:07 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Start _get_guest_xml network_info=[{"id": "d2d51361-0f1a-41aa-89e2-c2211bbd0b42", "address": "fa:16:3e:03:4e:88", "network": {"id": "0ff7c7f6-9609-4a35-8bb0-e8b83254f7f4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-803526263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92e6d918a4554cd89d9f40cee2a55d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2d51361-0f", "ovs_interfaceid": "d2d51361-0f1a-41aa-89e2-c2211bbd0b42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b14f4f1d-d140-4bb9-a4f2-abbaa8c98a2d", "address": "fa:16:3e:32:bc:69", "network": {"id": "8de6c01b-e132-4efb-be00-df0968c06a81", "bridge": "br-int", "label": "tempest-device-tagging-net1-1740133735", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "92e6d918a4554cd89d9f40cee2a55d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb14f4f1d-d1", "ovs_interfaceid": "b14f4f1d-d140-4bb9-a4f2-abbaa8c98a2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d8233c69-cc4f-4ae8-93ee-7f41234f72ec", "address": "fa:16:3e:14:e4:e9", "network": {"id": "8de6c01b-e132-4efb-be00-df0968c06a81", "bridge": "br-int", "label": "tempest-device-tagging-net1-1740133735", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "92e6d918a4554cd89d9f40cee2a55d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8233c69-cc", "ovs_interfaceid": "d8233c69-cc4f-4ae8-93ee-7f41234f72ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6fbc9ad6-da42-4492-8603-9efc7294dbab", "address": "fa:16:3e:a7:14:03", "network": {"id": "8de6c01b-e132-4efb-be00-df0968c06a81", "bridge": "br-int", "label": "tempest-device-tagging-net1-1740133735", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "92e6d918a4554cd89d9f40cee2a55d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fbc9ad6-da", "ovs_interfaceid": "6fbc9ad6-da42-4492-8603-9efc7294dbab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "854609a6-03f0-416c-8bbf-b5f85d13c688", "address": "fa:16:3e:09:0d:df", "network": {"id": "8de6c01b-e132-4efb-be00-df0968c06a81", "bridge": "br-int", "label": "tempest-device-tagging-net1-1740133735", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "92e6d918a4554cd89d9f40cee2a55d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap854609a6-03", "ovs_interfaceid": "854609a6-03f0-416c-8bbf-b5f85d13c688", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f04e7eb7-1170-4981-b342-44c664ef4c84", "address": "fa:16:3e:89:ce:7a", "network": {"id": "468865fb-36d1-436e-8fea-5f633edff84a", "bridge": "br-int", "label": "tempest-device-tagging-net2-251570535", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "92e6d918a4554cd89d9f40cee2a55d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf04e7eb7-11", "ovs_interfaceid": "f04e7eb7-1170-4981-b342-44c664ef4c84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c69d3b48-1443-4999-8369-8c5f61b35697", "address": "fa:16:3e:ec:95:94", "network": {"id": "468865fb-36d1-436e-8fea-5f633edff84a", "bridge": "br-int", "label": "tempest-device-tagging-net2-251570535", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "92e6d918a4554cd89d9f40cee2a55d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc69d3b48-14", "ovs_interfaceid": "c69d3b48-1443-4999-8369-8c5f61b35697", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T11:36:11Z,direct_url=<?>,disk_format='qcow2',id=0a2904ae-083d-41c8-83db-343132b36148,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7a77880136a54ef195c82e018e1939db',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T11:36:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'attachment_id': 'a3c1c596-857d-4d35-bc3c-222facc8ab34', 'boot_index': 0, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YBieRTgW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f33a7013-82d0-477c-aa5e-b27e63f2b98d', 'attached_at': '', 'detached_at': '', 'volume_id': 'a6721389-fe15-4237-a595-2aa18e8ca919', 'serial': 'a6721389-fe15-4237-a595-2aa18e8ca919'}, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'volume_type': None}, {'guest_format': None, 'attachment_id': '4ec283cb-805b-416d-a840-23ac9d0a7247', 'boot_index': 1, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EhTwKDmQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f33a7013-82d0-477c-aa5e-b27e63f2b98d', 'attached_at': '', 'detached_at': '', 'volume_id': 'f7b8c3fd-4a28-4cfb-80b4-f11212488bda', 'serial': 'f7b8c3fd-4a28-4cfb-80b4-f11212488bda'}, 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'volume_type': None}, {'guest_format': None, 'attachment_id': 'e56c7c49-dc0d-4d5f-ad4a-8be36924e702', 'boot_index': 2, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QjXIUbEn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f33a7013-82d0-477c-aa5e-b27e63f2b98d', 'attached_at': '', 'detached_at': '', 'volume_id': 'f96b2915-ca56-4599-9eda-0f258404c9ff', 'serial': 'f96b2915-ca56-4599-9eda-0f258404c9ff'}, 'delete_on_termination': False, 'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 11:42:07 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:42:07 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:42:07 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 11:42:07 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] CPU controller missing on host. {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 11:42:07 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 11:42:07 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] CPU controller found on host. {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 11:42:07 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73449) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 11:42:07 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T11:35:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T11:36:11Z,direct_url=<?>,disk_format='qcow2',id=0a2904ae-083d-41c8-83db-343132b36148,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7a77880136a54ef195c82e018e1939db',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T11:36:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 11:42:07 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Flavor limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 11:42:07 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Image limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 11:42:07 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Flavor pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 11:42:07 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Image pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 11:42:07 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 11:42:07 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 11:42:07 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 11:42:07 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Got 1 possible topologies {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 11:42:07 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 11:42:07 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 11:42:07 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Calling os-brick to attach iSCSI Volume {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 11:42:07 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YBieRTgW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 11:42:07 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 11:42:07 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:42:07 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:42:07 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 11:42:07 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:42:07 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:42:07 user nova-compute[73449]: INFO os_brick.initiator.connectors.iscsi [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 11:42:07 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919 -p 172.16.0.220:3260 {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:07 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:07 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[52c12e44-ecd3-47f2-a222-b6357193c6f7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:07 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 11:42:07 user nova-compute[73449]:  {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:42:07 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919 -p 172.16.0.220:3260 --interface default --op new {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:07 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:07 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[75634afa-6a62-41e7-ae01-134aab107a7d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919] added\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:07 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919] added
Aug 17 11:42:07 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:42:07 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:07 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:07 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b64d5b4-3525-4d88-862d-b7600249ed2b]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:07 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:42:07 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:07 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:07 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fa0afb7-8e34-4364-9bd9-d41abb864ebd]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:07 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:42:07 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YBieRTgW {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:07 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YBieRTgW" returned: 0 in 0.017s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:07 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fff5a20-b7f4-46fd-bffd-73f06d3a9b49]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:07 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YBieRTgW'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:42:07 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:07 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:07 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f969fe3-c339-44dc-9dce-7593a0d6a928]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:07 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:42:07 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:07 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:07 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[17b4d30f-66fb-475f-9cdd-bae99a4a78e5]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:07 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 17 11:42:07 user nova-compute[73449]:  {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:42:07 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 17 11:42:07 user nova-compute[73449]:  {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:42:07 user nova-compute[73449]: WARNING os_brick.initiator.connectors.iscsi [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 17 11:42:07 user nova-compute[73449]: 
Aug 17 11:42:07 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919 -p 172.16.0.220:3260 --login {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:07 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Start spawning the instance on the hypervisor. {{(pid=73449) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 11:42:07 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Creating instance directory {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 11:42:07 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Creating image(s)
Aug 17 11:42:07 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Did not create local disks {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 11:42:07 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Ensure instance console log exists: /opt/stack/data/nova/instances/b8e1def1-8303-4257-b9b5-0050f05cf2d0/console.log {{(pid=73449) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 11:42:07 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:42:07 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:42:07 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:42:07 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Start _get_guest_xml network_info=[{"id": "c877b9e9-f45c-4199-960c-2b9926518803", "address": "fa:16:3e:0d:7d:90", "network": {"id": "1596a923-35e5-45a5-85c8-5bae45f011b7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1809575924-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60c18371fa6246888a742164afd60242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc877b9e9-f4", "ovs_interfaceid": "c877b9e9-f45c-4199-960c-2b9926518803", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "71d82cc1-6895-4d52-b066-0a01a61b329b", "address": "fa:16:3e:48:bc:7c", "network": {"id": "2c2340dc-7ea1-4f63-8819-47844b2a536e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1423531895", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "60c18371fa6246888a742164afd60242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71d82cc1-68", "ovs_interfaceid": "71d82cc1-6895-4d52-b066-0a01a61b329b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b3fe8f9e-5b75-440e-b1c1-f888a4e91e9e", "address": "fa:16:3e:0e:2e:4c", "network": {"id": "2c2340dc-7ea1-4f63-8819-47844b2a536e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1423531895", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "60c18371fa6246888a742164afd60242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3fe8f9e-5b", "ovs_interfaceid": "b3fe8f9e-5b75-440e-b1c1-f888a4e91e9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f9c9fca3-8f9c-4ea9-8ceb-ed19cb265786", "address": "fa:16:3e:a2:22:da", "network": {"id": "2c2340dc-7ea1-4f63-8819-47844b2a536e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1423531895", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "60c18371fa6246888a742164afd60242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9c9fca3-8f", "ovs_interfaceid": "f9c9fca3-8f9c-4ea9-8ceb-ed19cb265786", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6888cb29-a1bc-42b0-bec3-57667e1b0350", "address": "fa:16:3e:6e:07:1b", "network": {"id": "2c2340dc-7ea1-4f63-8819-47844b2a536e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1423531895", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "60c18371fa6246888a742164afd60242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6888cb29-a1", "ovs_interfaceid": "6888cb29-a1bc-42b0-bec3-57667e1b0350", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d85896ce-110a-41d6-a20e-6beaecb36b97", "address": "fa:16:3e:e3:51:d1", "network": {"id": "8244e7f5-12cf-4ab5-baa2-956f148fc51f", "bridge": "br-int", "label": "tempest-device-tagging-net2-163620727", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "60c18371fa6246888a742164afd60242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd85896ce-11", "ovs_interfaceid": "d85896ce-110a-41d6-a20e-6beaecb36b97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "671f57db-57f1-4ba3-9e49-ebe4816404f6", "address": "fa:16:3e:04:1d:3e", "network": {"id": "8244e7f5-12cf-4ab5-baa2-956f148fc51f", "bridge": "br-int", "label": "tempest-device-tagging-net2-163620727", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "60c18371fa6246888a742164afd60242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap671f57db-57", "ovs_interfaceid": "671f57db-57f1-4ba3-9e49-ebe4816404f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T11:36:11Z,direct_url=<?>,disk_format='qcow2',id=0a2904ae-083d-41c8-83db-343132b36148,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7a77880136a54ef195c82e018e1939db',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T11:36:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'attachment_id': 'af64f943-ece3-4a5b-a05f-e61901452800', 'boot_index': 0, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MXdwVrvZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b8e1def1-8303-4257-b9b5-0050f05cf2d0', 'attached_at': '', 'detached_at': '', 'volume_id': '40bc2deb-5334-44c4-ae15-1c30e668ae47', 'serial': '40bc2deb-5334-44c4-ae15-1c30e668ae47'}, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'volume_type': None}, {'guest_format': None, 'attachment_id': '11c7e87a-bd7d-4019-87aa-57a912bf5fb1', 'boot_index': 1, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MTGsOnUj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b8e1def1-8303-4257-b9b5-0050f05cf2d0', 'attached_at': '', 'detached_at': '', 'volume_id': '8d09e821-98f2-459f-a7b2-3a77e57f1b4e', 'serial': '8d09e821-98f2-459f-a7b2-3a77e57f1b4e'}, 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'volume_type': None}, {'guest_format': None, 'attachment_id': '8c359882-9a2f-4b61-86a6-9e32e5abb9c7', 'boot_index': 2, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cmZCwVDW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b8e1def1-8303-4257-b9b5-0050f05cf2d0', 'attached_at': '', 'detached_at': '', 'volume_id': '69858581-d156-4fd4-a145-74ef3c8a93dd', 'serial': '69858581-d156-4fd4-a145-74ef3c8a93dd'}, 'delete_on_termination': False, 'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 11:42:07 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:42:07 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:42:07 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 11:42:07 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] CPU controller missing on host. {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 11:42:07 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 11:42:07 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] CPU controller found on host. {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 11:42:07 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73449) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 11:42:07 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T11:35:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T11:36:11Z,direct_url=<?>,disk_format='qcow2',id=0a2904ae-083d-41c8-83db-343132b36148,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7a77880136a54ef195c82e018e1939db',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T11:36:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 11:42:07 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Flavor limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 11:42:07 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Image limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 11:42:07 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Flavor pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 11:42:07 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Image pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 11:42:07 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 11:42:07 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 11:42:07 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 11:42:07 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Got 1 possible topologies {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 11:42:07 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 11:42:07 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 11:42:07 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Calling os-brick to attach iSCSI Volume {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 11:42:07 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MXdwVrvZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 11:42:07 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 11:42:07 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:42:07 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:07 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[00ba2dcf-9aaf-420a-bfde-e524b3f52a62]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:07 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919, portal: 172.16.0.220,3260]
Aug 17 11:42:07 user nova-compute[73449]: Login to [iface: default, target: iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919, portal: 172.16.0.220,3260] successful.
Aug 17 11:42:07 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:42:07 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:07 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:07 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[47656b93-cfad-4fbf-ad7c-f13c23280a53]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:07 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:42:07 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:07 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:07 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cc2f04e-e4b0-4a92-96f8-1892e3a22d92]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919 (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:07 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919 (non-flash)
Aug 17 11:42:07 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:42:07 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919 (non-flash)
Aug 17 11:42:07 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:42:07 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:42:07 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Connected to 172.16.0.220:3260 {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 11:42:07 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] HCTL ('33', '-', '-', 0) found on session 3 with lun 0 {{(pid=73449) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 11:42:07 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73449) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 11:42:07 user nova-compute[73449]: INFO nova.compute.manager [None req-7336886e-1774-46e3-b3e9-51a90c43ccc2 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] [instance: a40e1f85-a7e6-46da-8f98-df7a278aaade] Took 0.89 seconds to detach 1 volumes for instance.
Aug 17 11:42:07 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:07 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:07 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[aca83c0a-5a65-4c44-990e-dac5cd2efa3a]: (4, ('- - 0', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:07 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Searching for a device in session 3 and hctl ['33', '*', '*', 0] yield: None {{(pid=73449) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 11:42:07 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-7336886e-1774-46e3-b3e9-51a90c43ccc2 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:42:07 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-7336886e-1774-46e3-b3e9-51a90c43ccc2 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:42:07 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-7336886e-1774-46e3-b3e9-51a90c43ccc2 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 11:42:07 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-7336886e-1774-46e3-b3e9-51a90c43ccc2 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 11:42:07 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-7336886e-1774-46e3-b3e9-51a90c43ccc2 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.384s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:42:07 user nova-compute[73449]: INFO nova.scheduler.client.report [None req-7336886e-1774-46e3-b3e9-51a90c43ccc2 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] Deleted allocations for instance a40e1f85-a7e6-46da-8f98-df7a278aaade
Aug 17 11:42:07 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-7336886e-1774-46e3-b3e9-51a90c43ccc2 tempest-DeleteServersTestJSON-417173257 tempest-DeleteServersTestJSON-417173257-project-member] Lock "a40e1f85-a7e6-46da-8f98-df7a278aaade" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.757s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:42:08 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Searching for a device in session 3 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73449) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 11:42:08 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YBieRTgW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 11:42:08 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:42:08 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] <== connect_volume: return (1324ms) {'type': 'block', 'scsi_wwn': '26433383833376235', 'path': '/dev/sdb'} {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 11:42:08 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26433383833376235', 'path': '/dev/sdb'} {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 11:42:08 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.086s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:42:08 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 11:42:08 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:42:08 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:42:08 user nova-compute[73449]: INFO os_brick.initiator.connectors.iscsi [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 11:42:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47 -p 172.16.0.220:3260 {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:08 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[9314c75f-bcf0-48d6-a82d-e76827c6fcf7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:08 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 11:42:08 user nova-compute[73449]:  {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:42:08 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Calling os-brick to attach iSCSI Volume {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 11:42:08 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EhTwKDmQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 11:42:08 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 11:42:08 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:42:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47 -p 172.16.0.220:3260 --interface default --op new {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:08 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d7d034c-f8f5-4156-bfae-a7fbd06f5675]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47] added\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:08 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47] added
Aug 17 11:42:08 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:42:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:08 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[47f28381-b9a9-45d4-ae75-966d8dd79a10]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:08 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:42:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:08 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad8320eb-d86a-4856-a9a7-26bf859c6904]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:08 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:42:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MXdwVrvZ {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MXdwVrvZ" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:08 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[adf43141-46d4-4d23-bfe9-5769934cb29f]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:08 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MXdwVrvZ'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:42:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:08 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb6ec7fc-201a-4760-b746-62e06bdba070]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:08 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:42:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:08 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[a558916a-714d-47e6-92cf-103dcc450984]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919 (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:08 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919 (non-flash)
Aug 17 11:42:08 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:42:08 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919 (non-flash)
Aug 17 11:42:08 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:42:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47 -p 172.16.0.220:3260 --login {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:08 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[3577051e-d4c2-470e-9db7-fb79b078b720]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:08 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47, portal: 172.16.0.220,3260]
Aug 17 11:42:08 user nova-compute[73449]: Login to [iface: default, target: iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47, portal: 172.16.0.220,3260] successful.
Aug 17 11:42:08 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:42:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:08 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6137809-f8ba-4515-a795-14ab8e7ae5b7]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:08 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:42:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:08 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[c671c59e-5512-4a7d-8f33-e9199e428284]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47 (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:08 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919 (non-flash)
Aug 17 11:42:08 user nova-compute[73449]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47 (non-flash)
Aug 17 11:42:08 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:42:08 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919 (non-flash)
Aug 17 11:42:08 user nova-compute[73449]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47 (non-flash)
Aug 17 11:42:08 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:42:08 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.260s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:42:08 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Connected to 172.16.0.220:3260 {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 11:42:08 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] HCTL ('34', '-', '-', 0) found on session 4 with lun 0 {{(pid=73449) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 11:42:08 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73449) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 11:42:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:08 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[e20b28a1-cb06-4f99-a610-71c7af3e0b14]: (4, ('- - 0', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:08 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Searching for a device in session 4 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73449) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 11:42:08 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MXdwVrvZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 11:42:09 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.289s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:42:09 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] <== connect_volume: return (2375ms) {'type': 'block', 'scsi_wwn': '26464333666303433', 'path': '/dev/sdc'} {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 11:42:09 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26464333666303433', 'path': '/dev/sdc'} {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 11:42:09 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.263s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:42:09 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 11:42:09 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:42:09 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:42:09 user nova-compute[73449]: INFO os_brick.initiator.connectors.iscsi [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 11:42:09 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda -p 172.16.0.220:3260 {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:09 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:09 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Calling os-brick to attach iSCSI Volume {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 11:42:09 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MTGsOnUj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 11:42:09 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 11:42:09 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:42:09 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[49435395-5215-4cf3-908e-140b06ae006a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:09 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 11:42:09 user nova-compute[73449]:  {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:42:09 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda -p 172.16.0.220:3260 --interface default --op new {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:09 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:09 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[2965c0b0-956e-445d-8c78-cb321595b550]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda] added\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:09 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda] added
Aug 17 11:42:09 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:42:09 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:09 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.158s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:09 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b3427e6-3905-465d-8155-e32c0e3600d1]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:09 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:42:09 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:10 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.103s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:10 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[d88e678c-ef53-4b4e-b567-5ce326bf8234]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:10 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:42:10 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EhTwKDmQ {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:10 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EhTwKDmQ" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:10 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eadaa57-6ad3-415a-9771-d17077455183]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:10 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EhTwKDmQ'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:42:10 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:10 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:10 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[aac9758d-e7bb-4330-b58a-17cdf8f6ef97]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:10 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:42:10 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:10 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:10 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[82d22575-9a5b-4ef8-b77b-6d7ecf29cfb3]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47 (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:10 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919 (non-flash)
Aug 17 11:42:10 user nova-compute[73449]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47 (non-flash)
Aug 17 11:42:10 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:42:10 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919 (non-flash)
Aug 17 11:42:10 user nova-compute[73449]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47 (non-flash)
Aug 17 11:42:10 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:42:10 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda -p 172.16.0.220:3260 --login {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:10 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:10 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2ffcf55-9cb3-4906-9120-ed799a40e125]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:10 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda, portal: 172.16.0.220,3260]
Aug 17 11:42:10 user nova-compute[73449]: Login to [iface: default, target: iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda, portal: 172.16.0.220,3260] successful.
Aug 17 11:42:10 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:42:10 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:10 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:10 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[5909b14f-6272-4476-91fa-014e277f715f]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:10 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:10 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:42:10 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:10 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:10 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9753c95-fe74-41c6-a289-ee3ab8423bc6]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:10 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919 (non-flash)
Aug 17 11:42:10 user nova-compute[73449]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47 (non-flash)
Aug 17 11:42:10 user nova-compute[73449]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda (non-flash)
Aug 17 11:42:10 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:42:10 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919 (non-flash)
Aug 17 11:42:10 user nova-compute[73449]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47 (non-flash)
Aug 17 11:42:10 user nova-compute[73449]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda (non-flash)
Aug 17 11:42:10 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:42:10 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.585s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:42:10 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Connected to 172.16.0.220:3260 {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 11:42:10 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] HCTL ('35', '-', '-', 0) found on session 5 with lun 0 {{(pid=73449) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 11:42:10 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73449) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 11:42:10 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:10 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:10 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[58614851-b2f6-4c88-aac9-517484d03edc]: (4, ('- - 0', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:10 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Searching for a device in session 5 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73449) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 11:42:10 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EhTwKDmQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 11:42:11 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.616s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:42:11 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] <== connect_volume: return (2880ms) {'type': 'block', 'scsi_wwn': '26363653336343036', 'path': '/dev/sdd'} {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 11:42:11 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26363653336343036', 'path': '/dev/sdd'} {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 11:42:11 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.590s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:42:11 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 11:42:11 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:42:11 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:42:11 user nova-compute[73449]: INFO os_brick.initiator.connectors.iscsi [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 11:42:11 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e -p 172.16.0.220:3260 {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:11 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:11 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[29478171-3a0e-49bd-96ba-a0a81ae03660]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:11 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 11:42:11 user nova-compute[73449]:  {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:42:11 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e -p 172.16.0.220:3260 --interface default --op new {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:11 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Calling os-brick to attach iSCSI Volume {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 11:42:11 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QjXIUbEn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 11:42:11 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 11:42:11 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:42:11 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:11 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c31e11c-6bd4-41f7-90dd-93088b043a43]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e] added\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:11 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e] added
Aug 17 11:42:11 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:42:11 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:11 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:11 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d352948-be1c-4334-b2a2-f3bc52963065]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:11 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:42:11 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:11 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:11 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a487d51-d294-4cbe-8a93-d8ddd6e2a8e8]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:11 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:42:11 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MTGsOnUj {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:11 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MTGsOnUj" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:11 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[7193e9b1-5ce5-49b3-9ec0-7310babbd6df]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:11 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MTGsOnUj'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:42:11 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:11 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:11 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f45431f-99f2-4e0a-be02-c251bb6b0e7d]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:11 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:42:11 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:11 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:11 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2c05336-7fce-4c55-8b16-a6617dd45247]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:11 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919 (non-flash)
Aug 17 11:42:11 user nova-compute[73449]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47 (non-flash)
Aug 17 11:42:11 user nova-compute[73449]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda (non-flash)
Aug 17 11:42:11 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:42:11 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919 (non-flash)
Aug 17 11:42:11 user nova-compute[73449]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47 (non-flash)
Aug 17 11:42:11 user nova-compute[73449]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda (non-flash)
Aug 17 11:42:11 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:42:11 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e -p 172.16.0.220:3260 --login {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:11 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:11 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aff7c54-86f3-4a61-9b58-a0f6ced101f7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:11 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e, portal: 172.16.0.220,3260]
Aug 17 11:42:11 user nova-compute[73449]: Login to [iface: default, target: iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e, portal: 172.16.0.220,3260] successful.
Aug 17 11:42:11 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:42:11 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:11 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:11 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca1f9160-c828-4e4f-91e1-4621769ae387]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:11 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:42:11 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:11 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:11 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[69c30f42-28a8-43a1-b38c-9612468cf3c5]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:11 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919 (non-flash)
Aug 17 11:42:11 user nova-compute[73449]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47 (non-flash)
Aug 17 11:42:11 user nova-compute[73449]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda (non-flash)
Aug 17 11:42:11 user nova-compute[73449]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e (non-flash)
Aug 17 11:42:11 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:42:11 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919 (non-flash)
Aug 17 11:42:11 user nova-compute[73449]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47 (non-flash)
Aug 17 11:42:11 user nova-compute[73449]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda (non-flash)
Aug 17 11:42:11 user nova-compute[73449]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e (non-flash)
Aug 17 11:42:11 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:42:11 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:42:11 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Connected to 172.16.0.220:3260 {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 11:42:11 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] HCTL ('36', '-', '-', 0) found on session 6 with lun 0 {{(pid=73449) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 11:42:11 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73449) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 11:42:11 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:11 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:11 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc6e67ba-0919-46df-a39e-4e6b5cd38aa0]: (4, ('- - 0', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:11 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Searching for a device in session 6 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73449) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 11:42:11 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MTGsOnUj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 11:42:11 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:12 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:42:12 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] <== connect_volume: return (2912ms) {'type': 'block', 'scsi_wwn': '26130396466363838', 'path': '/dev/sde'} {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 11:42:12 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26130396466363838', 'path': '/dev/sde'} {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 11:42:12 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.284s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:42:12 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 11:42:12 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:42:12 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:42:12 user nova-compute[73449]: INFO os_brick.initiator.connectors.iscsi [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 11:42:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff -p 172.16.0.220:3260 {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:12 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Calling os-brick to attach iSCSI Volume {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 11:42:12 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cmZCwVDW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 11:42:12 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 11:42:12 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:42:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:12 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[585ee64e-ca53-4aba-a6d6-4cefd24c0398]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:12 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 11:42:12 user nova-compute[73449]:  {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:42:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff -p 172.16.0.220:3260 --interface default --op new {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:12 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[17c961ca-f9b5-4b85-94bd-d72b61213111]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff] added\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:12 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff] added
Aug 17 11:42:12 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:42:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:12 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[43bfdfeb-166d-4db5-b83a-aee0ab609a77]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:12 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:42:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:12 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[98971baf-867b-475d-aa70-051528f6daa1]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:12 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:42:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QjXIUbEn {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QjXIUbEn" returned: 0 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:12 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[c21895b1-0a7d-43c7-abcb-53638553c131]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:12 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QjXIUbEn'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:42:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:12 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[985eca64-6e5c-4a91-b883-b9843d011c69]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:12 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:42:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:12 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[a889252c-78c1-4ca5-90d5-96f1e18cc109]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:12 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919 (non-flash)
Aug 17 11:42:12 user nova-compute[73449]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47 (non-flash)
Aug 17 11:42:12 user nova-compute[73449]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda (non-flash)
Aug 17 11:42:12 user nova-compute[73449]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e (non-flash)
Aug 17 11:42:12 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:42:12 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919 (non-flash)
Aug 17 11:42:12 user nova-compute[73449]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47 (non-flash)
Aug 17 11:42:12 user nova-compute[73449]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda (non-flash)
Aug 17 11:42:12 user nova-compute[73449]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e (non-flash)
Aug 17 11:42:12 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:42:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff -p 172.16.0.220:3260 --login {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:12 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[c369e2f2-a4d7-4573-896d-7ae04f116785]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:12 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff, portal: 172.16.0.220,3260]
Aug 17 11:42:12 user nova-compute[73449]: Login to [iface: default, target: iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff, portal: 172.16.0.220,3260] successful.
Aug 17 11:42:12 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:42:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:12 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[98349842-745e-46e5-ae47-bb05fab923e5]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:12 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:42:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:12 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[52d2076c-d18b-40a0-8665-23c37c981e72]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:12 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919 (non-flash)
Aug 17 11:42:12 user nova-compute[73449]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47 (non-flash)
Aug 17 11:42:12 user nova-compute[73449]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda (non-flash)
Aug 17 11:42:12 user nova-compute[73449]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e (non-flash)
Aug 17 11:42:12 user nova-compute[73449]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff (non-flash)
Aug 17 11:42:12 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:42:12 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919 (non-flash)
Aug 17 11:42:12 user nova-compute[73449]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47 (non-flash)
Aug 17 11:42:12 user nova-compute[73449]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda (non-flash)
Aug 17 11:42:12 user nova-compute[73449]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e (non-flash)
Aug 17 11:42:12 user nova-compute[73449]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff (non-flash)
Aug 17 11:42:12 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:42:12 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:42:12 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Connected to 172.16.0.220:3260 {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 11:42:12 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] HCTL ('37', '-', '-', 0) found on session 7 with lun 0 {{(pid=73449) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 11:42:12 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73449) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 11:42:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:13 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.024s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:13 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f2f63d1-9c17-48c4-9d52-8efa9afb73b8]: (4, ('- - 0', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:13 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73449) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 11:42:13 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QjXIUbEn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 11:42:13 user nova-compute[73449]: DEBUG nova.compute.manager [req-f9d76b24-c580-4345-bc2b-2a80e0fd3cee req-dcb9c30e-6622-46c8-b2db-11dd0c3b52d2 service nova] [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e] Received event network-changed-98c22823-114c-45bf-bc36-876f2f587b55 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:42:13 user nova-compute[73449]: DEBUG nova.compute.manager [req-f9d76b24-c580-4345-bc2b-2a80e0fd3cee req-dcb9c30e-6622-46c8-b2db-11dd0c3b52d2 service nova] [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e] Refreshing instance network info cache due to event network-changed-98c22823-114c-45bf-bc36-876f2f587b55. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 11:42:13 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-f9d76b24-c580-4345-bc2b-2a80e0fd3cee req-dcb9c30e-6622-46c8-b2db-11dd0c3b52d2 service nova] Acquiring lock "refresh_cache-fd8d4549-db8f-4c74-8706-8ac21f049c2e" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:42:13 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-f9d76b24-c580-4345-bc2b-2a80e0fd3cee req-dcb9c30e-6622-46c8-b2db-11dd0c3b52d2 service nova] Acquired lock "refresh_cache-fd8d4549-db8f-4c74-8706-8ac21f049c2e" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:42:13 user nova-compute[73449]: DEBUG nova.network.neutron [req-f9d76b24-c580-4345-bc2b-2a80e0fd3cee req-dcb9c30e-6622-46c8-b2db-11dd0c3b52d2 service nova] [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e] Refreshing network info cache for port 98c22823-114c-45bf-bc36-876f2f587b55 {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 11:42:13 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-994a32c0-638d-4bac-a17c-cbc9740fbb8e tempest-VolumesAssistedSnapshotsTest-2081262095 tempest-VolumesAssistedSnapshotsTest-2081262095-project-admin] Acquiring lock "fd8d4549-db8f-4c74-8706-8ac21f049c2e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:42:13 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-994a32c0-638d-4bac-a17c-cbc9740fbb8e tempest-VolumesAssistedSnapshotsTest-2081262095 tempest-VolumesAssistedSnapshotsTest-2081262095-project-admin] Lock "fd8d4549-db8f-4c74-8706-8ac21f049c2e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:42:13 user nova-compute[73449]: DEBUG nova.objects.instance [None req-994a32c0-638d-4bac-a17c-cbc9740fbb8e tempest-VolumesAssistedSnapshotsTest-2081262095 tempest-VolumesAssistedSnapshotsTest-2081262095-project-admin] Lazy-loading 'flavor' on Instance uuid fd8d4549-db8f-4c74-8706-8ac21f049c2e {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:42:13 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-994a32c0-638d-4bac-a17c-cbc9740fbb8e tempest-VolumesAssistedSnapshotsTest-2081262095 tempest-VolumesAssistedSnapshotsTest-2081262095-project-admin] Lock "fd8d4549-db8f-4c74-8706-8ac21f049c2e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.085s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:42:13 user nova-compute[73449]: DEBUG nova.network.neutron [req-f9d76b24-c580-4345-bc2b-2a80e0fd3cee req-dcb9c30e-6622-46c8-b2db-11dd0c3b52d2 service nova] [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e] Updated VIF entry in instance network info cache for port 98c22823-114c-45bf-bc36-876f2f587b55. {{(pid=73449) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 11:42:13 user nova-compute[73449]: DEBUG nova.network.neutron [req-f9d76b24-c580-4345-bc2b-2a80e0fd3cee req-dcb9c30e-6622-46c8-b2db-11dd0c3b52d2 service nova] [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e] Updating instance_info_cache with network_info: [{"id": "98c22823-114c-45bf-bc36-876f2f587b55", "address": "fa:16:3e:e2:ef:b0", "network": {"id": "c4a2b8cb-821d-4dd9-a737-ee2e5b474491", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1403649220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93aebc1246f34b81a883a70dd6e6e7f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98c22823-11", "ovs_interfaceid": "98c22823-114c-45bf-bc36-876f2f587b55", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:42:13 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-f9d76b24-c580-4345-bc2b-2a80e0fd3cee req-dcb9c30e-6622-46c8-b2db-11dd0c3b52d2 service nova] Releasing lock "refresh_cache-fd8d4549-db8f-4c74-8706-8ac21f049c2e" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:42:13 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-994a32c0-638d-4bac-a17c-cbc9740fbb8e tempest-VolumesAssistedSnapshotsTest-2081262095 tempest-VolumesAssistedSnapshotsTest-2081262095-project-admin] Acquiring lock "fd8d4549-db8f-4c74-8706-8ac21f049c2e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:42:13 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-994a32c0-638d-4bac-a17c-cbc9740fbb8e tempest-VolumesAssistedSnapshotsTest-2081262095 tempest-VolumesAssistedSnapshotsTest-2081262095-project-admin] Lock "fd8d4549-db8f-4c74-8706-8ac21f049c2e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:42:13 user nova-compute[73449]: INFO nova.compute.manager [None req-994a32c0-638d-4bac-a17c-cbc9740fbb8e tempest-VolumesAssistedSnapshotsTest-2081262095 tempest-VolumesAssistedSnapshotsTest-2081262095-project-admin] [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e] Attaching volume 3394c5c3-2ff2-4a87-8470-614418b70b21 to /dev/vdb
Aug 17 11:42:13 user nova-compute[73449]: DEBUG os_brick.utils [None req-994a32c0-638d-4bac-a17c-cbc9740fbb8e tempest-VolumesAssistedSnapshotsTest-2081262095 tempest-VolumesAssistedSnapshotsTest-2081262095-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 11:42:13 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:13 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:13 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4ec31a1-2e41-4a19-9a2a-3b313c911286]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4d3924302012\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:13 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:13 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:13 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe709749-56e6-4997-8a3f-21e41bd76656]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:13 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:13 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:13 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[3386d43a-ea66-41ac-b589-87cb7af7baf3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:13 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e269802-3c69-4c32-ba5b-8be6d1c24734]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:13 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-994a32c0-638d-4bac-a17c-cbc9740fbb8e tempest-VolumesAssistedSnapshotsTest-2081262095 tempest-VolumesAssistedSnapshotsTest-2081262095-project-admin] Running cmd (subprocess): nvme version {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:13 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-994a32c0-638d-4bac-a17c-cbc9740fbb8e tempest-VolumesAssistedSnapshotsTest-2081262095 tempest-VolumesAssistedSnapshotsTest-2081262095-project-admin] 'nvme version' failed. Not Retrying. {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.nvmeof [None req-994a32c0-638d-4bac-a17c-cbc9740fbb8e tempest-VolumesAssistedSnapshotsTest-2081262095 tempest-VolumesAssistedSnapshotsTest-2081262095-project-admin] nvme not present on system {{(pid=73449) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.352s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] <== connect_volume: return (2635ms) {'type': 'block', 'scsi_wwn': '23563633833323261', 'path': '/dev/sdf'} {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23563633833323261', 'path': '/dev/sdf'} {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.329s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:42:14 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 11:42:14 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:42:14 user nova-compute[73449]: INFO os_brick.initiator.connectors.iscsi [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 11:42:14 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd -p 172.16.0.220:3260 {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 11:42:14 user nova-compute[73449]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 11:42:14 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[e79d36e9-4d39-4991-ac8e-74d51fdd1db8]: (4, '') {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-994a32c0-638d-4bac-a17c-cbc9740fbb8e tempest-VolumesAssistedSnapshotsTest-2081262095 tempest-VolumesAssistedSnapshotsTest-2081262095-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73449) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-994a32c0-638d-4bac-a17c-cbc9740fbb8e tempest-VolumesAssistedSnapshotsTest-2081262095 tempest-VolumesAssistedSnapshotsTest-2081262095-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73449) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-994a32c0-638d-4bac-a17c-cbc9740fbb8e tempest-VolumesAssistedSnapshotsTest-2081262095 tempest-VolumesAssistedSnapshotsTest-2081262095-project-admin] LIGHTOS: no hostnqn found. {{(pid=73449) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG os_brick.utils [None req-994a32c0-638d-4bac-a17c-cbc9740fbb8e tempest-VolumesAssistedSnapshotsTest-2081262095 tempest-VolumesAssistedSnapshotsTest-2081262095-project-admin] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4d3924302012', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG nova.virt.block_device [None req-994a32c0-638d-4bac-a17c-cbc9740fbb8e tempest-VolumesAssistedSnapshotsTest-2081262095 tempest-VolumesAssistedSnapshotsTest-2081262095-project-admin] [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e] Updating existing volume attachment record: 28174425-fd58-4fa8-b262-6c7279e9d07c {{(pid=73449) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd41923f-72da-4b80-94ca-711f2984c62b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 11:42:14 user nova-compute[73449]:  {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd -p 172.16.0.220:3260 --interface default --op new {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T11:41:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-110737481',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-110737481',id=9,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNiTiGg59OTgWkM5c+8CMzfP1ubX2Ownt/RavGxpnipJdk5xZaefQbANZlemlnOzyDtOU2+/dlg6n/ZAQFwnxRSMECIIHSWFvmwLpLx7JDo4al95DLmQs09DB/PAPUAS7A==',key_name='tempest-keypair-824062427',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='92e6d918a4554cd89d9f40cee2a55d00',ramdisk_id='',reservation_id='r-g5j20f0h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1794254085',owner_user_name='tempest-TaggedBootDevicesTest-1794254085-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T11:41:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='092033fd15e74b859f9dc209f70841db',uuid=f33a7013-82d0-477c-aa5e-b27e63f2b98d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d2d51361-0f1a-41aa-89e2-c2211bbd0b42", "address": "fa:16:3e:03:4e:88", "network": {"id": "0ff7c7f6-9609-4a35-8bb0-e8b83254f7f4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-803526263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92e6d918a4554cd89d9f40cee2a55d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2d51361-0f", "ovs_interfaceid": "d2d51361-0f1a-41aa-89e2-c2211bbd0b42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73449) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Converting VIF {"id": "d2d51361-0f1a-41aa-89e2-c2211bbd0b42", "address": "fa:16:3e:03:4e:88", "network": {"id": "0ff7c7f6-9609-4a35-8bb0-e8b83254f7f4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-803526263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92e6d918a4554cd89d9f40cee2a55d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2d51361-0f", "ovs_interfaceid": "d2d51361-0f1a-41aa-89e2-c2211bbd0b42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:4e:88,bridge_name='br-int',has_traffic_filtering=True,id=d2d51361-0f1a-41aa-89e2-c2211bbd0b42,network=Network(0ff7c7f6-9609-4a35-8bb0-e8b83254f7f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2d51361-0f') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T11:41:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-110737481',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-110737481',id=9,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNiTiGg59OTgWkM5c+8CMzfP1ubX2Ownt/RavGxpnipJdk5xZaefQbANZlemlnOzyDtOU2+/dlg6n/ZAQFwnxRSMECIIHSWFvmwLpLx7JDo4al95DLmQs09DB/PAPUAS7A==',key_name='tempest-keypair-824062427',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='92e6d918a4554cd89d9f40cee2a55d00',ramdisk_id='',reservation_id='r-g5j20f0h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1794254085',owner_user_name='tempest-TaggedBootDevicesTest-1794254085-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T11:41:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='092033fd15e74b859f9dc209f70841db',uuid=f33a7013-82d0-477c-aa5e-b27e63f2b98d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b14f4f1d-d140-4bb9-a4f2-abbaa8c98a2d", "address": "fa:16:3e:32:bc:69", "network": {"id": "8de6c01b-e132-4efb-be00-df0968c06a81", "bridge": "br-int", "label": "tempest-device-tagging-net1-1740133735", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "92e6d918a4554cd89d9f40cee2a55d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb14f4f1d-d1", "ovs_interfaceid": "b14f4f1d-d140-4bb9-a4f2-abbaa8c98a2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73449) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Converting VIF {"id": "b14f4f1d-d140-4bb9-a4f2-abbaa8c98a2d", "address": "fa:16:3e:32:bc:69", "network": {"id": "8de6c01b-e132-4efb-be00-df0968c06a81", "bridge": "br-int", "label": "tempest-device-tagging-net1-1740133735", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "92e6d918a4554cd89d9f40cee2a55d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb14f4f1d-d1", "ovs_interfaceid": "b14f4f1d-d140-4bb9-a4f2-abbaa8c98a2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:bc:69,bridge_name='br-int',has_traffic_filtering=True,id=b14f4f1d-d140-4bb9-a4f2-abbaa8c98a2d,network=Network(8de6c01b-e132-4efb-be00-df0968c06a81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb14f4f1d-d1') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T11:41:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-110737481',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-110737481',id=9,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNiTiGg59OTgWkM5c+8CMzfP1ubX2Ownt/RavGxpnipJdk5xZaefQbANZlemlnOzyDtOU2+/dlg6n/ZAQFwnxRSMECIIHSWFvmwLpLx7JDo4al95DLmQs09DB/PAPUAS7A==',key_name='tempest-keypair-824062427',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='92e6d918a4554cd89d9f40cee2a55d00',ramdisk_id='',reservation_id='r-g5j20f0h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1794254085',owner_user_name='tempest-TaggedBootDevicesTest-1794254085-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T11:41:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='092033fd15e74b859f9dc209f70841db',uuid=f33a7013-82d0-477c-aa5e-b27e63f2b98d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d8233c69-cc4f-4ae8-93ee-7f41234f72ec", "address": "fa:16:3e:14:e4:e9", "network": {"id": "8de6c01b-e132-4efb-be00-df0968c06a81", "bridge": "br-int", "label": "tempest-device-tagging-net1-1740133735", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "92e6d918a4554cd89d9f40cee2a55d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8233c69-cc", "ovs_interfaceid": "d8233c69-cc4f-4ae8-93ee-7f41234f72ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73449) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Converting VIF {"id": "d8233c69-cc4f-4ae8-93ee-7f41234f72ec", "address": "fa:16:3e:14:e4:e9", "network": {"id": "8de6c01b-e132-4efb-be00-df0968c06a81", "bridge": "br-int", "label": "tempest-device-tagging-net1-1740133735", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "92e6d918a4554cd89d9f40cee2a55d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8233c69-cc", "ovs_interfaceid": "d8233c69-cc4f-4ae8-93ee-7f41234f72ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:e4:e9,bridge_name='br-int',has_traffic_filtering=True,id=d8233c69-cc4f-4ae8-93ee-7f41234f72ec,network=Network(8de6c01b-e132-4efb-be00-df0968c06a81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd8233c69-cc') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T11:41:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-110737481',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-110737481',id=9,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNiTiGg59OTgWkM5c+8CMzfP1ubX2Ownt/RavGxpnipJdk5xZaefQbANZlemlnOzyDtOU2+/dlg6n/ZAQFwnxRSMECIIHSWFvmwLpLx7JDo4al95DLmQs09DB/PAPUAS7A==',key_name='tempest-keypair-824062427',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='92e6d918a4554cd89d9f40cee2a55d00',ramdisk_id='',reservation_id='r-g5j20f0h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1794254085',owner_user_name='tempest-TaggedBootDevicesTest-1794254085-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T11:41:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='092033fd15e74b859f9dc209f70841db',uuid=f33a7013-82d0-477c-aa5e-b27e63f2b98d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6fbc9ad6-da42-4492-8603-9efc7294dbab", "address": "fa:16:3e:a7:14:03", "network": {"id": "8de6c01b-e132-4efb-be00-df0968c06a81", "bridge": "br-int", "label": "tempest-device-tagging-net1-1740133735", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "92e6d918a4554cd89d9f40cee2a55d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fbc9ad6-da", "ovs_interfaceid": "6fbc9ad6-da42-4492-8603-9efc7294dbab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73449) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Converting VIF {"id": "6fbc9ad6-da42-4492-8603-9efc7294dbab", "address": "fa:16:3e:a7:14:03", "network": {"id": "8de6c01b-e132-4efb-be00-df0968c06a81", "bridge": "br-int", "label": "tempest-device-tagging-net1-1740133735", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "92e6d918a4554cd89d9f40cee2a55d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fbc9ad6-da", "ovs_interfaceid": "6fbc9ad6-da42-4492-8603-9efc7294dbab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:14:03,bridge_name='br-int',has_traffic_filtering=True,id=6fbc9ad6-da42-4492-8603-9efc7294dbab,network=Network(8de6c01b-e132-4efb-be00-df0968c06a81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fbc9ad6-da') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T11:41:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-110737481',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-110737481',id=9,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNiTiGg59OTgWkM5c+8CMzfP1ubX2Ownt/RavGxpnipJdk5xZaefQbANZlemlnOzyDtOU2+/dlg6n/ZAQFwnxRSMECIIHSWFvmwLpLx7JDo4al95DLmQs09DB/PAPUAS7A==',key_name='tempest-keypair-824062427',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='92e6d918a4554cd89d9f40cee2a55d00',ramdisk_id='',reservation_id='r-g5j20f0h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1794254085',owner_user_name='tempest-TaggedBootDevicesTest-1794254085-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T11:41:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='092033fd15e74b859f9dc209f70841db',uuid=f33a7013-82d0-477c-aa5e-b27e63f2b98d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "854609a6-03f0-416c-8bbf-b5f85d13c688", "address": "fa:16:3e:09:0d:df", "network": {"id": "8de6c01b-e132-4efb-be00-df0968c06a81", "bridge": "br-int", "label": "tempest-device-tagging-net1-1740133735", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "92e6d918a4554cd89d9f40cee2a55d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap854609a6-03", "ovs_interfaceid": "854609a6-03f0-416c-8bbf-b5f85d13c688", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73449) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Converting VIF {"id": "854609a6-03f0-416c-8bbf-b5f85d13c688", "address": "fa:16:3e:09:0d:df", "network": {"id": "8de6c01b-e132-4efb-be00-df0968c06a81", "bridge": "br-int", "label": "tempest-device-tagging-net1-1740133735", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "92e6d918a4554cd89d9f40cee2a55d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap854609a6-03", "ovs_interfaceid": "854609a6-03f0-416c-8bbf-b5f85d13c688", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:0d:df,bridge_name='br-int',has_traffic_filtering=True,id=854609a6-03f0-416c-8bbf-b5f85d13c688,network=Network(8de6c01b-e132-4efb-be00-df0968c06a81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap854609a6-03') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T11:41:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-110737481',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-110737481',id=9,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNiTiGg59OTgWkM5c+8CMzfP1ubX2Ownt/RavGxpnipJdk5xZaefQbANZlemlnOzyDtOU2+/dlg6n/ZAQFwnxRSMECIIHSWFvmwLpLx7JDo4al95DLmQs09DB/PAPUAS7A==',key_name='tempest-keypair-824062427',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='92e6d918a4554cd89d9f40cee2a55d00',ramdisk_id='',reservation_id='r-g5j20f0h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1794254085',owner_user_name='tempest-TaggedBootDevicesTest-1794254085-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T11:41:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='092033fd15e74b859f9dc209f70841db',uuid=f33a7013-82d0-477c-aa5e-b27e63f2b98d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f04e7eb7-1170-4981-b342-44c664ef4c84", "address": "fa:16:3e:89:ce:7a", "network": {"id": "468865fb-36d1-436e-8fea-5f633edff84a", "bridge": "br-int", "label": "tempest-device-tagging-net2-251570535", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "92e6d918a4554cd89d9f40cee2a55d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf04e7eb7-11", "ovs_interfaceid": "f04e7eb7-1170-4981-b342-44c664ef4c84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73449) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Converting VIF {"id": "f04e7eb7-1170-4981-b342-44c664ef4c84", "address": "fa:16:3e:89:ce:7a", "network": {"id": "468865fb-36d1-436e-8fea-5f633edff84a", "bridge": "br-int", "label": "tempest-device-tagging-net2-251570535", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "92e6d918a4554cd89d9f40cee2a55d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf04e7eb7-11", "ovs_interfaceid": "f04e7eb7-1170-4981-b342-44c664ef4c84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:ce:7a,bridge_name='br-int',has_traffic_filtering=True,id=f04e7eb7-1170-4981-b342-44c664ef4c84,network=Network(468865fb-36d1-436e-8fea-5f633edff84a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf04e7eb7-11') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T11:41:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-110737481',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-110737481',id=9,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNiTiGg59OTgWkM5c+8CMzfP1ubX2Ownt/RavGxpnipJdk5xZaefQbANZlemlnOzyDtOU2+/dlg6n/ZAQFwnxRSMECIIHSWFvmwLpLx7JDo4al95DLmQs09DB/PAPUAS7A==',key_name='tempest-keypair-824062427',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='92e6d918a4554cd89d9f40cee2a55d00',ramdisk_id='',reservation_id='r-g5j20f0h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1794254085',owner_user_name='tempest-TaggedBootDevicesTest-1794254085-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T11:41:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='092033fd15e74b859f9dc209f70841db',uuid=f33a7013-82d0-477c-aa5e-b27e63f2b98d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c69d3b48-1443-4999-8369-8c5f61b35697", "address": "fa:16:3e:ec:95:94", "network": {"id": "468865fb-36d1-436e-8fea-5f633edff84a", "bridge": "br-int", "label": "tempest-device-tagging-net2-251570535", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "92e6d918a4554cd89d9f40cee2a55d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc69d3b48-14", "ovs_interfaceid": "c69d3b48-1443-4999-8369-8c5f61b35697", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73449) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Converting VIF {"id": "c69d3b48-1443-4999-8369-8c5f61b35697", "address": "fa:16:3e:ec:95:94", "network": {"id": "468865fb-36d1-436e-8fea-5f633edff84a", "bridge": "br-int", "label": "tempest-device-tagging-net2-251570535", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "92e6d918a4554cd89d9f40cee2a55d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc69d3b48-14", "ovs_interfaceid": "c69d3b48-1443-4999-8369-8c5f61b35697", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:95:94,bridge_name='br-int',has_traffic_filtering=True,id=c69d3b48-1443-4999-8369-8c5f61b35697,network=Network(468865fb-36d1-436e-8fea-5f633edff84a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc69d3b48-14') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG nova.objects.instance [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Lazy-loading 'pci_devices' on Instance uuid f33a7013-82d0-477c-aa5e-b27e63f2b98d {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[e22c50e2-9918-4912-923e-351795c04cc6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd] added\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd] added
Aug 17 11:42:14 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] End _get_guest_xml xml=<domain type="kvm">
Aug 17 11:42:14 user nova-compute[73449]:   <uuid>f33a7013-82d0-477c-aa5e-b27e63f2b98d</uuid>
Aug 17 11:42:14 user nova-compute[73449]:   <name>instance-00000009</name>
Aug 17 11:42:14 user nova-compute[73449]:   <memory>524288</memory>
Aug 17 11:42:14 user nova-compute[73449]:   <vcpu>1</vcpu>
Aug 17 11:42:14 user nova-compute[73449]:   <metadata>
Aug 17 11:42:14 user nova-compute[73449]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 11:42:14 user nova-compute[73449]:       <nova:package version="0.0.0"/>
Aug 17 11:42:14 user nova-compute[73449]:       <nova:name>tempest-device-tagging-server-110737481</nova:name>
Aug 17 11:42:14 user nova-compute[73449]:       <nova:creationTime>2023-08-17 11:42:07</nova:creationTime>
Aug 17 11:42:14 user nova-compute[73449]:       <nova:flavor name="m1.tiny">
Aug 17 11:42:14 user nova-compute[73449]:         <nova:memory>512</nova:memory>
Aug 17 11:42:14 user nova-compute[73449]:         <nova:disk>1</nova:disk>
Aug 17 11:42:14 user nova-compute[73449]:         <nova:swap>0</nova:swap>
Aug 17 11:42:14 user nova-compute[73449]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 11:42:14 user nova-compute[73449]:         <nova:vcpus>1</nova:vcpus>
Aug 17 11:42:14 user nova-compute[73449]:       </nova:flavor>
Aug 17 11:42:14 user nova-compute[73449]:       <nova:owner>
Aug 17 11:42:14 user nova-compute[73449]:         <nova:user uuid="092033fd15e74b859f9dc209f70841db">tempest-TaggedBootDevicesTest-1794254085-project-member</nova:user>
Aug 17 11:42:14 user nova-compute[73449]:         <nova:project uuid="92e6d918a4554cd89d9f40cee2a55d00">tempest-TaggedBootDevicesTest-1794254085</nova:project>
Aug 17 11:42:14 user nova-compute[73449]:       </nova:owner>
Aug 17 11:42:14 user nova-compute[73449]:       <nova:root type="image" uuid="0a2904ae-083d-41c8-83db-343132b36148"/>
Aug 17 11:42:14 user nova-compute[73449]:       <nova:ports>
Aug 17 11:42:14 user nova-compute[73449]:         <nova:port uuid="d2d51361-0f1a-41aa-89e2-c2211bbd0b42">
Aug 17 11:42:14 user nova-compute[73449]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 17 11:42:14 user nova-compute[73449]:         </nova:port>
Aug 17 11:42:14 user nova-compute[73449]:         <nova:port uuid="b14f4f1d-d140-4bb9-a4f2-abbaa8c98a2d">
Aug 17 11:42:14 user nova-compute[73449]:           <nova:ip type="fixed" address="10.1.1.228" ipVersion="4"/>
Aug 17 11:42:14 user nova-compute[73449]:         </nova:port>
Aug 17 11:42:14 user nova-compute[73449]:         <nova:port uuid="d8233c69-cc4f-4ae8-93ee-7f41234f72ec">
Aug 17 11:42:14 user nova-compute[73449]:           <nova:ip type="fixed" address="10.1.1.89" ipVersion="4"/>
Aug 17 11:42:14 user nova-compute[73449]:         </nova:port>
Aug 17 11:42:14 user nova-compute[73449]:         <nova:port uuid="6fbc9ad6-da42-4492-8603-9efc7294dbab">
Aug 17 11:42:14 user nova-compute[73449]:           <nova:ip type="fixed" address="10.1.1.69" ipVersion="4"/>
Aug 17 11:42:14 user nova-compute[73449]:         </nova:port>
Aug 17 11:42:14 user nova-compute[73449]:         <nova:port uuid="854609a6-03f0-416c-8bbf-b5f85d13c688">
Aug 17 11:42:14 user nova-compute[73449]:           <nova:ip type="fixed" address="10.1.1.141" ipVersion="4"/>
Aug 17 11:42:14 user nova-compute[73449]:         </nova:port>
Aug 17 11:42:14 user nova-compute[73449]:         <nova:port uuid="f04e7eb7-1170-4981-b342-44c664ef4c84">
Aug 17 11:42:14 user nova-compute[73449]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 17 11:42:14 user nova-compute[73449]:         </nova:port>
Aug 17 11:42:14 user nova-compute[73449]:         <nova:port uuid="c69d3b48-1443-4999-8369-8c5f61b35697">
Aug 17 11:42:14 user nova-compute[73449]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 17 11:42:14 user nova-compute[73449]:         </nova:port>
Aug 17 11:42:14 user nova-compute[73449]:       </nova:ports>
Aug 17 11:42:14 user nova-compute[73449]:     </nova:instance>
Aug 17 11:42:14 user nova-compute[73449]:   </metadata>
Aug 17 11:42:14 user nova-compute[73449]:   <sysinfo type="smbios">
Aug 17 11:42:14 user nova-compute[73449]:     <system>
Aug 17 11:42:14 user nova-compute[73449]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 11:42:14 user nova-compute[73449]:       <entry name="product">OpenStack Nova</entry>
Aug 17 11:42:14 user nova-compute[73449]:       <entry name="version">0.0.0</entry>
Aug 17 11:42:14 user nova-compute[73449]:       <entry name="serial">f33a7013-82d0-477c-aa5e-b27e63f2b98d</entry>
Aug 17 11:42:14 user nova-compute[73449]:       <entry name="uuid">f33a7013-82d0-477c-aa5e-b27e63f2b98d</entry>
Aug 17 11:42:14 user nova-compute[73449]:       <entry name="family">Virtual Machine</entry>
Aug 17 11:42:14 user nova-compute[73449]:     </system>
Aug 17 11:42:14 user nova-compute[73449]:   </sysinfo>
Aug 17 11:42:14 user nova-compute[73449]:   <os>
Aug 17 11:42:14 user nova-compute[73449]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 11:42:14 user nova-compute[73449]:     <boot dev="hd"/>
Aug 17 11:42:14 user nova-compute[73449]:     <smbios mode="sysinfo"/>
Aug 17 11:42:14 user nova-compute[73449]:   </os>
Aug 17 11:42:14 user nova-compute[73449]:   <features>
Aug 17 11:42:14 user nova-compute[73449]:     <acpi/>
Aug 17 11:42:14 user nova-compute[73449]:     <apic/>
Aug 17 11:42:14 user nova-compute[73449]:     <vmcoreinfo/>
Aug 17 11:42:14 user nova-compute[73449]:   </features>
Aug 17 11:42:14 user nova-compute[73449]:   <clock offset="utc">
Aug 17 11:42:14 user nova-compute[73449]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 11:42:14 user nova-compute[73449]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 11:42:14 user nova-compute[73449]:     <timer name="hpet" present="no"/>
Aug 17 11:42:14 user nova-compute[73449]:   </clock>
Aug 17 11:42:14 user nova-compute[73449]:   <cpu mode="custom" match="exact">
Aug 17 11:42:14 user nova-compute[73449]:     <model>Nehalem</model>
Aug 17 11:42:14 user nova-compute[73449]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 11:42:14 user nova-compute[73449]:   </cpu>
Aug 17 11:42:14 user nova-compute[73449]:   <devices>
Aug 17 11:42:14 user nova-compute[73449]:     <disk type="file" device="cdrom">
Aug 17 11:42:14 user nova-compute[73449]:       <driver name="qemu" type="raw" cache="none"/>
Aug 17 11:42:14 user nova-compute[73449]:       <source file="/opt/stack/data/nova/instances/f33a7013-82d0-477c-aa5e-b27e63f2b98d/disk.config"/>
Aug 17 11:42:14 user nova-compute[73449]:       <target dev="hda" bus="ide"/>
Aug 17 11:42:14 user nova-compute[73449]:     </disk>
Aug 17 11:42:14 user nova-compute[73449]:     <disk type="block" device="disk">
Aug 17 11:42:14 user nova-compute[73449]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 11:42:14 user nova-compute[73449]:       <source dev="/dev/sdb"/>
Aug 17 11:42:14 user nova-compute[73449]:       <target dev="vda" bus="virtio"/>
Aug 17 11:42:14 user nova-compute[73449]:       <serial>a6721389-fe15-4237-a595-2aa18e8ca919</serial>
Aug 17 11:42:14 user nova-compute[73449]:     </disk>
Aug 17 11:42:14 user nova-compute[73449]:     <disk type="block" device="disk">
Aug 17 11:42:14 user nova-compute[73449]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 11:42:14 user nova-compute[73449]:       <source dev="/dev/sdd"/>
Aug 17 11:42:14 user nova-compute[73449]:       <target dev="vdb" bus="virtio"/>
Aug 17 11:42:14 user nova-compute[73449]:       <serial>f7b8c3fd-4a28-4cfb-80b4-f11212488bda</serial>
Aug 17 11:42:14 user nova-compute[73449]:     </disk>
Aug 17 11:42:14 user nova-compute[73449]:     <disk type="block" device="disk">
Aug 17 11:42:14 user nova-compute[73449]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 11:42:14 user nova-compute[73449]:       <source dev="/dev/sdf"/>
Aug 17 11:42:14 user nova-compute[73449]:       <target dev="vdc" bus="virtio"/>
Aug 17 11:42:14 user nova-compute[73449]:       <serial>f96b2915-ca56-4599-9eda-0f258404c9ff</serial>
Aug 17 11:42:14 user nova-compute[73449]:     </disk>
Aug 17 11:42:14 user nova-compute[73449]:     <interface type="ethernet">
Aug 17 11:42:14 user nova-compute[73449]:       <mac address="fa:16:3e:03:4e:88"/>
Aug 17 11:42:14 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 11:42:14 user nova-compute[73449]:       <mtu size="1442"/>
Aug 17 11:42:14 user nova-compute[73449]:       <target dev="tapd2d51361-0f"/>
Aug 17 11:42:14 user nova-compute[73449]:     </interface>
Aug 17 11:42:14 user nova-compute[73449]:     <interface type="ethernet">
Aug 17 11:42:14 user nova-compute[73449]:       <mac address="fa:16:3e:32:bc:69"/>
Aug 17 11:42:14 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 11:42:14 user nova-compute[73449]:       <mtu size="1442"/>
Aug 17 11:42:14 user nova-compute[73449]:       <target dev="tapb14f4f1d-d1"/>
Aug 17 11:42:14 user nova-compute[73449]:     </interface>
Aug 17 11:42:14 user nova-compute[73449]:     <interface type="ethernet">
Aug 17 11:42:14 user nova-compute[73449]:       <mac address="fa:16:3e:14:e4:e9"/>
Aug 17 11:42:14 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 11:42:14 user nova-compute[73449]:       <mtu size="1442"/>
Aug 17 11:42:14 user nova-compute[73449]:       <target dev="tapd8233c69-cc"/>
Aug 17 11:42:14 user nova-compute[73449]:     </interface>
Aug 17 11:42:14 user nova-compute[73449]:     <interface type="ethernet">
Aug 17 11:42:14 user nova-compute[73449]:       <mac address="fa:16:3e:a7:14:03"/>
Aug 17 11:42:14 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 11:42:14 user nova-compute[73449]:       <mtu size="1442"/>
Aug 17 11:42:14 user nova-compute[73449]:       <target dev="tap6fbc9ad6-da"/>
Aug 17 11:42:14 user nova-compute[73449]:     </interface>
Aug 17 11:42:14 user nova-compute[73449]:     <interface type="ethernet">
Aug 17 11:42:14 user nova-compute[73449]:       <mac address="fa:16:3e:09:0d:df"/>
Aug 17 11:42:14 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 11:42:14 user nova-compute[73449]:       <mtu size="1442"/>
Aug 17 11:42:14 user nova-compute[73449]:       <target dev="tap854609a6-03"/>
Aug 17 11:42:14 user nova-compute[73449]:     </interface>
Aug 17 11:42:14 user nova-compute[73449]:     <interface type="ethernet">
Aug 17 11:42:14 user nova-compute[73449]:       <mac address="fa:16:3e:89:ce:7a"/>
Aug 17 11:42:14 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 11:42:14 user nova-compute[73449]:       <mtu size="1442"/>
Aug 17 11:42:14 user nova-compute[73449]:       <target dev="tapf04e7eb7-11"/>
Aug 17 11:42:14 user nova-compute[73449]:     </interface>
Aug 17 11:42:14 user nova-compute[73449]:     <interface type="ethernet">
Aug 17 11:42:14 user nova-compute[73449]:       <mac address="fa:16:3e:ec:95:94"/>
Aug 17 11:42:14 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 11:42:14 user nova-compute[73449]:       <mtu size="1442"/>
Aug 17 11:42:14 user nova-compute[73449]:       <target dev="tapc69d3b48-14"/>
Aug 17 11:42:14 user nova-compute[73449]:     </interface>
Aug 17 11:42:14 user nova-compute[73449]:     <serial type="pty">
Aug 17 11:42:14 user nova-compute[73449]:       <log file="/opt/stack/data/nova/instances/f33a7013-82d0-477c-aa5e-b27e63f2b98d/console.log" append="off"/>
Aug 17 11:42:14 user nova-compute[73449]:     </serial>
Aug 17 11:42:14 user nova-compute[73449]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 11:42:14 user nova-compute[73449]:     <video>
Aug 17 11:42:14 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 11:42:14 user nova-compute[73449]:     </video>
Aug 17 11:42:14 user nova-compute[73449]:     <rng model="virtio">
Aug 17 11:42:14 user nova-compute[73449]:       <backend model="random">/dev/urandom</backend>
Aug 17 11:42:14 user nova-compute[73449]:     </rng>
Aug 17 11:42:14 user nova-compute[73449]:     <controller type="usb" index="0" model="none"/>
Aug 17 11:42:14 user nova-compute[73449]:     <memballoon model="virtio">
Aug 17 11:42:14 user nova-compute[73449]:       <stats period="10"/>
Aug 17 11:42:14 user nova-compute[73449]:     </memballoon>
Aug 17 11:42:14 user nova-compute[73449]:   </devices>
Aug 17 11:42:14 user nova-compute[73449]: </domain>
Aug 17 11:42:14 user nova-compute[73449]:  {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T11:41:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-110737481',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-110737481',id=9,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNiTiGg59OTgWkM5c+8CMzfP1ubX2Ownt/RavGxpnipJdk5xZaefQbANZlemlnOzyDtOU2+/dlg6n/ZAQFwnxRSMECIIHSWFvmwLpLx7JDo4al95DLmQs09DB/PAPUAS7A==',key_name='tempest-keypair-824062427',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='92e6d918a4554cd89d9f40cee2a55d00',ramdisk_id='',reservation_id='r-g5j20f0h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1794254085',owner_user_name='tempest-TaggedBootDevicesTest-1794254085-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T11:41:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='092033fd15e74b859f9dc209f70841db',uuid=f33a7013-82d0-477c-aa5e-b27e63f2b98d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d2d51361-0f1a-41aa-89e2-c2211bbd0b42", "address": "fa:16:3e:03:4e:88", "network": {"id": "0ff7c7f6-9609-4a35-8bb0-e8b83254f7f4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-803526263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92e6d918a4554cd89d9f40cee2a55d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2d51361-0f", "ovs_interfaceid": "d2d51361-0f1a-41aa-89e2-c2211bbd0b42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Converting VIF {"id": "d2d51361-0f1a-41aa-89e2-c2211bbd0b42", "address": "fa:16:3e:03:4e:88", "network": {"id": "0ff7c7f6-9609-4a35-8bb0-e8b83254f7f4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-803526263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92e6d918a4554cd89d9f40cee2a55d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2d51361-0f", "ovs_interfaceid": "d2d51361-0f1a-41aa-89e2-c2211bbd0b42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:4e:88,bridge_name='br-int',has_traffic_filtering=True,id=d2d51361-0f1a-41aa-89e2-c2211bbd0b42,network=Network(0ff7c7f6-9609-4a35-8bb0-e8b83254f7f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2d51361-0f') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG os_vif [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:4e:88,bridge_name='br-int',has_traffic_filtering=True,id=d2d51361-0f1a-41aa-89e2-c2211bbd0b42,network=Network(0ff7c7f6-9609-4a35-8bb0-e8b83254f7f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2d51361-0f') {{(pid=73449) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[4424f004-8fa5-431b-abaf-c656d07656e0]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd2d51361-0f, may_exist=True, interface_attrs={}) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd2d51361-0f, col_values=(('external_ids', {'iface-id': 'd2d51361-0f1a-41aa-89e2-c2211bbd0b42', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:03:4e:88', 'vm-uuid': 'f33a7013-82d0-477c-aa5e-b27e63f2b98d'}),), if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:14 user nova-compute[73449]: INFO os_vif [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:4e:88,bridge_name='br-int',has_traffic_filtering=True,id=d2d51361-0f1a-41aa-89e2-c2211bbd0b42,network=Network(0ff7c7f6-9609-4a35-8bb0-e8b83254f7f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2d51361-0f')
Aug 17 11:42:14 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T11:41:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-110737481',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-110737481',id=9,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNiTiGg59OTgWkM5c+8CMzfP1ubX2Ownt/RavGxpnipJdk5xZaefQbANZlemlnOzyDtOU2+/dlg6n/ZAQFwnxRSMECIIHSWFvmwLpLx7JDo4al95DLmQs09DB/PAPUAS7A==',key_name='tempest-keypair-824062427',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='92e6d918a4554cd89d9f40cee2a55d00',ramdisk_id='',reservation_id='r-g5j20f0h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1794254085',owner_user_name='tempest-TaggedBootDevicesTest-1794254085-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T11:41:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='092033fd15e74b859f9dc209f70841db',uuid=f33a7013-82d0-477c-aa5e-b27e63f2b98d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b14f4f1d-d140-4bb9-a4f2-abbaa8c98a2d", "address": "fa:16:3e:32:bc:69", "network": {"id": "8de6c01b-e132-4efb-be00-df0968c06a81", "bridge": "br-int", "label": "tempest-device-tagging-net1-1740133735", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "92e6d918a4554cd89d9f40cee2a55d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb14f4f1d-d1", "ovs_interfaceid": "b14f4f1d-d140-4bb9-a4f2-abbaa8c98a2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73449) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Converting VIF {"id": "b14f4f1d-d140-4bb9-a4f2-abbaa8c98a2d", "address": "fa:16:3e:32:bc:69", "network": {"id": "8de6c01b-e132-4efb-be00-df0968c06a81", "bridge": "br-int", "label": "tempest-device-tagging-net1-1740133735", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "92e6d918a4554cd89d9f40cee2a55d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb14f4f1d-d1", "ovs_interfaceid": "b14f4f1d-d140-4bb9-a4f2-abbaa8c98a2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:bc:69,bridge_name='br-int',has_traffic_filtering=True,id=b14f4f1d-d140-4bb9-a4f2-abbaa8c98a2d,network=Network(8de6c01b-e132-4efb-be00-df0968c06a81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb14f4f1d-d1') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG os_vif [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:bc:69,bridge_name='br-int',has_traffic_filtering=True,id=b14f4f1d-d140-4bb9-a4f2-abbaa8c98a2d,network=Network(8de6c01b-e132-4efb-be00-df0968c06a81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb14f4f1d-d1') {{(pid=73449) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[b539a9fd-255d-4f7f-a00e-6648ab0ecd95]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb14f4f1d-d1, may_exist=True, interface_attrs={}) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb14f4f1d-d1, col_values=(('external_ids', {'iface-id': 'b14f4f1d-d140-4bb9-a4f2-abbaa8c98a2d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:32:bc:69', 'vm-uuid': 'f33a7013-82d0-477c-aa5e-b27e63f2b98d'}),), if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cmZCwVDW {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cmZCwVDW" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[166ea688-fd8c-4d28-9ff3-cb3ccc1b1625]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cmZCwVDW'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:14 user nova-compute[73449]: INFO os_vif [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:bc:69,bridge_name='br-int',has_traffic_filtering=True,id=b14f4f1d-d140-4bb9-a4f2-abbaa8c98a2d,network=Network(8de6c01b-e132-4efb-be00-df0968c06a81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb14f4f1d-d1')
Aug 17 11:42:14 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T11:41:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-110737481',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-110737481',id=9,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNiTiGg59OTgWkM5c+8CMzfP1ubX2Ownt/RavGxpnipJdk5xZaefQbANZlemlnOzyDtOU2+/dlg6n/ZAQFwnxRSMECIIHSWFvmwLpLx7JDo4al95DLmQs09DB/PAPUAS7A==',key_name='tempest-keypair-824062427',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='92e6d918a4554cd89d9f40cee2a55d00',ramdisk_id='',reservation_id='r-g5j20f0h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1794254085',owner_user_name='tempest-TaggedBootDevicesTest-1794254085-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T11:41:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='092033fd15e74b859f9dc209f70841db',uuid=f33a7013-82d0-477c-aa5e-b27e63f2b98d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d8233c69-cc4f-4ae8-93ee-7f41234f72ec", "address": "fa:16:3e:14:e4:e9", "network": {"id": "8de6c01b-e132-4efb-be00-df0968c06a81", "bridge": "br-int", "label": "tempest-device-tagging-net1-1740133735", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "92e6d918a4554cd89d9f40cee2a55d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8233c69-cc", "ovs_interfaceid": "d8233c69-cc4f-4ae8-93ee-7f41234f72ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73449) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Converting VIF {"id": "d8233c69-cc4f-4ae8-93ee-7f41234f72ec", "address": "fa:16:3e:14:e4:e9", "network": {"id": "8de6c01b-e132-4efb-be00-df0968c06a81", "bridge": "br-int", "label": "tempest-device-tagging-net1-1740133735", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "92e6d918a4554cd89d9f40cee2a55d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8233c69-cc", "ovs_interfaceid": "d8233c69-cc4f-4ae8-93ee-7f41234f72ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:e4:e9,bridge_name='br-int',has_traffic_filtering=True,id=d8233c69-cc4f-4ae8-93ee-7f41234f72ec,network=Network(8de6c01b-e132-4efb-be00-df0968c06a81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd8233c69-cc') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG os_vif [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:e4:e9,bridge_name='br-int',has_traffic_filtering=True,id=d8233c69-cc4f-4ae8-93ee-7f41234f72ec,network=Network(8de6c01b-e132-4efb-be00-df0968c06a81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd8233c69-cc') {{(pid=73449) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd8233c69-cc, may_exist=True, interface_attrs={}) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd8233c69-cc, col_values=(('external_ids', {'iface-id': 'd8233c69-cc4f-4ae8-93ee-7f41234f72ec', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:14:e4:e9', 'vm-uuid': 'f33a7013-82d0-477c-aa5e-b27e63f2b98d'}),), if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.033s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[af0a1433-a648-4275-b57e-feb4bd24bc4f]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b91c264-0bda-446a-b2eb-b787285ebb48]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919 (non-flash)
Aug 17 11:42:14 user nova-compute[73449]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47 (non-flash)
Aug 17 11:42:14 user nova-compute[73449]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda (non-flash)
Aug 17 11:42:14 user nova-compute[73449]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e (non-flash)
Aug 17 11:42:14 user nova-compute[73449]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff (non-flash)
Aug 17 11:42:14 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919 (non-flash)
Aug 17 11:42:14 user nova-compute[73449]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47 (non-flash)
Aug 17 11:42:14 user nova-compute[73449]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda (non-flash)
Aug 17 11:42:14 user nova-compute[73449]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e (non-flash)
Aug 17 11:42:14 user nova-compute[73449]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff (non-flash)
Aug 17 11:42:14 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:14 user nova-compute[73449]: INFO os_vif [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:e4:e9,bridge_name='br-int',has_traffic_filtering=True,id=d8233c69-cc4f-4ae8-93ee-7f41234f72ec,network=Network(8de6c01b-e132-4efb-be00-df0968c06a81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd8233c69-cc')
Aug 17 11:42:14 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T11:41:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-110737481',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-110737481',id=9,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNiTiGg59OTgWkM5c+8CMzfP1ubX2Ownt/RavGxpnipJdk5xZaefQbANZlemlnOzyDtOU2+/dlg6n/ZAQFwnxRSMECIIHSWFvmwLpLx7JDo4al95DLmQs09DB/PAPUAS7A==',key_name='tempest-keypair-824062427',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='92e6d918a4554cd89d9f40cee2a55d00',ramdisk_id='',reservation_id='r-g5j20f0h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1794254085',owner_user_name='tempest-TaggedBootDevicesTest-1794254085-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T11:41:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='092033fd15e74b859f9dc209f70841db',uuid=f33a7013-82d0-477c-aa5e-b27e63f2b98d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6fbc9ad6-da42-4492-8603-9efc7294dbab", "address": "fa:16:3e:a7:14:03", "network": {"id": "8de6c01b-e132-4efb-be00-df0968c06a81", "bridge": "br-int", "label": "tempest-device-tagging-net1-1740133735", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "92e6d918a4554cd89d9f40cee2a55d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fbc9ad6-da", "ovs_interfaceid": "6fbc9ad6-da42-4492-8603-9efc7294dbab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Converting VIF {"id": "6fbc9ad6-da42-4492-8603-9efc7294dbab", "address": "fa:16:3e:a7:14:03", "network": {"id": "8de6c01b-e132-4efb-be00-df0968c06a81", "bridge": "br-int", "label": "tempest-device-tagging-net1-1740133735", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "92e6d918a4554cd89d9f40cee2a55d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fbc9ad6-da", "ovs_interfaceid": "6fbc9ad6-da42-4492-8603-9efc7294dbab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:14:03,bridge_name='br-int',has_traffic_filtering=True,id=6fbc9ad6-da42-4492-8603-9efc7294dbab,network=Network(8de6c01b-e132-4efb-be00-df0968c06a81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fbc9ad6-da') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG os_vif [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:14:03,bridge_name='br-int',has_traffic_filtering=True,id=6fbc9ad6-da42-4492-8603-9efc7294dbab,network=Network(8de6c01b-e132-4efb-be00-df0968c06a81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fbc9ad6-da') {{(pid=73449) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd -p 172.16.0.220:3260 --login {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6fbc9ad6-da, may_exist=True, interface_attrs={}) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6fbc9ad6-da, col_values=(('external_ids', {'iface-id': '6fbc9ad6-da42-4492-8603-9efc7294dbab', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a7:14:03', 'vm-uuid': 'f33a7013-82d0-477c-aa5e-b27e63f2b98d'}),), if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:14 user nova-compute[73449]: INFO os_vif [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:14:03,bridge_name='br-int',has_traffic_filtering=True,id=6fbc9ad6-da42-4492-8603-9efc7294dbab,network=Network(8de6c01b-e132-4efb-be00-df0968c06a81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fbc9ad6-da')
Aug 17 11:42:14 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T11:41:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-110737481',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-110737481',id=9,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNiTiGg59OTgWkM5c+8CMzfP1ubX2Ownt/RavGxpnipJdk5xZaefQbANZlemlnOzyDtOU2+/dlg6n/ZAQFwnxRSMECIIHSWFvmwLpLx7JDo4al95DLmQs09DB/PAPUAS7A==',key_name='tempest-keypair-824062427',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='92e6d918a4554cd89d9f40cee2a55d00',ramdisk_id='',reservation_id='r-g5j20f0h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1794254085',owner_user_name='tempest-TaggedBootDevicesTest-1794254085-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T11:41:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='092033fd15e74b859f9dc209f70841db',uuid=f33a7013-82d0-477c-aa5e-b27e63f2b98d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "854609a6-03f0-416c-8bbf-b5f85d13c688", "address": "fa:16:3e:09:0d:df", "network": {"id": "8de6c01b-e132-4efb-be00-df0968c06a81", "bridge": "br-int", "label": "tempest-device-tagging-net1-1740133735", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "92e6d918a4554cd89d9f40cee2a55d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap854609a6-03", "ovs_interfaceid": "854609a6-03f0-416c-8bbf-b5f85d13c688", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Converting VIF {"id": "854609a6-03f0-416c-8bbf-b5f85d13c688", "address": "fa:16:3e:09:0d:df", "network": {"id": "8de6c01b-e132-4efb-be00-df0968c06a81", "bridge": "br-int", "label": "tempest-device-tagging-net1-1740133735", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "92e6d918a4554cd89d9f40cee2a55d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap854609a6-03", "ovs_interfaceid": "854609a6-03f0-416c-8bbf-b5f85d13c688", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:0d:df,bridge_name='br-int',has_traffic_filtering=True,id=854609a6-03f0-416c-8bbf-b5f85d13c688,network=Network(8de6c01b-e132-4efb-be00-df0968c06a81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap854609a6-03') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG os_vif [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:0d:df,bridge_name='br-int',has_traffic_filtering=True,id=854609a6-03f0-416c-8bbf-b5f85d13c688,network=Network(8de6c01b-e132-4efb-be00-df0968c06a81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap854609a6-03') {{(pid=73449) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap854609a6-03, may_exist=True, interface_attrs={}) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap854609a6-03, col_values=(('external_ids', {'iface-id': '854609a6-03f0-416c-8bbf-b5f85d13c688', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:09:0d:df', 'vm-uuid': 'f33a7013-82d0-477c-aa5e-b27e63f2b98d'}),), if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab30cf71-655e-4737-8a39-0ad806f12293]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd, portal: 172.16.0.220,3260]
Aug 17 11:42:14 user nova-compute[73449]: Login to [iface: default, target: iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd, portal: 172.16.0.220,3260] successful.
Aug 17 11:42:14 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aafe95b-571d-4cbf-8899-7314e602e345]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:14 user nova-compute[73449]: INFO os_vif [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:0d:df,bridge_name='br-int',has_traffic_filtering=True,id=854609a6-03f0-416c-8bbf-b5f85d13c688,network=Network(8de6c01b-e132-4efb-be00-df0968c06a81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap854609a6-03')
Aug 17 11:42:14 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T11:41:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-110737481',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-110737481',id=9,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNiTiGg59OTgWkM5c+8CMzfP1ubX2Ownt/RavGxpnipJdk5xZaefQbANZlemlnOzyDtOU2+/dlg6n/ZAQFwnxRSMECIIHSWFvmwLpLx7JDo4al95DLmQs09DB/PAPUAS7A==',key_name='tempest-keypair-824062427',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='92e6d918a4554cd89d9f40cee2a55d00',ramdisk_id='',reservation_id='r-g5j20f0h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1794254085',owner_user_name='tempest-TaggedBootDevicesTest-1794254085-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T11:41:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='092033fd15e74b859f9dc209f70841db',uuid=f33a7013-82d0-477c-aa5e-b27e63f2b98d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f04e7eb7-1170-4981-b342-44c664ef4c84", "address": "fa:16:3e:89:ce:7a", "network": {"id": "468865fb-36d1-436e-8fea-5f633edff84a", "bridge": "br-int", "label": "tempest-device-tagging-net2-251570535", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "92e6d918a4554cd89d9f40cee2a55d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf04e7eb7-11", "ovs_interfaceid": "f04e7eb7-1170-4981-b342-44c664ef4c84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Converting VIF {"id": "f04e7eb7-1170-4981-b342-44c664ef4c84", "address": "fa:16:3e:89:ce:7a", "network": {"id": "468865fb-36d1-436e-8fea-5f633edff84a", "bridge": "br-int", "label": "tempest-device-tagging-net2-251570535", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "92e6d918a4554cd89d9f40cee2a55d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf04e7eb7-11", "ovs_interfaceid": "f04e7eb7-1170-4981-b342-44c664ef4c84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:ce:7a,bridge_name='br-int',has_traffic_filtering=True,id=f04e7eb7-1170-4981-b342-44c664ef4c84,network=Network(468865fb-36d1-436e-8fea-5f633edff84a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf04e7eb7-11') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG os_vif [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:ce:7a,bridge_name='br-int',has_traffic_filtering=True,id=f04e7eb7-1170-4981-b342-44c664ef4c84,network=Network(468865fb-36d1-436e-8fea-5f633edff84a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf04e7eb7-11') {{(pid=73449) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf04e7eb7-11, may_exist=True, interface_attrs={}) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf04e7eb7-11, col_values=(('external_ids', {'iface-id': 'f04e7eb7-1170-4981-b342-44c664ef4c84', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:89:ce:7a', 'vm-uuid': 'f33a7013-82d0-477c-aa5e-b27e63f2b98d'}),), if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dca314b-c3d3-4353-88c5-9171c0a65de6]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919 (non-flash)
Aug 17 11:42:14 user nova-compute[73449]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47 (non-flash)
Aug 17 11:42:14 user nova-compute[73449]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda (non-flash)
Aug 17 11:42:14 user nova-compute[73449]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e (non-flash)
Aug 17 11:42:14 user nova-compute[73449]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff (non-flash)
Aug 17 11:42:14 user nova-compute[73449]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd (non-flash)
Aug 17 11:42:14 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919 (non-flash)
Aug 17 11:42:14 user nova-compute[73449]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47 (non-flash)
Aug 17 11:42:14 user nova-compute[73449]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda (non-flash)
Aug 17 11:42:14 user nova-compute[73449]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e (non-flash)
Aug 17 11:42:14 user nova-compute[73449]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff (non-flash)
Aug 17 11:42:14 user nova-compute[73449]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd (non-flash)
Aug 17 11:42:14 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.378s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Connected to 172.16.0.220:3260 {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] HCTL ('38', '-', '-', 0) found on session 8 with lun 0 {{(pid=73449) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=73449) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[02823dc6-94e4-40a6-8919-e6e3b056db62]: (4, ('- - 0', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Searching for a device in session 8 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=73449) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cmZCwVDW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:14 user nova-compute[73449]: INFO os_vif [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:ce:7a,bridge_name='br-int',has_traffic_filtering=True,id=f04e7eb7-1170-4981-b342-44c664ef4c84,network=Network(468865fb-36d1-436e-8fea-5f633edff84a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf04e7eb7-11')
Aug 17 11:42:14 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T11:41:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-110737481',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-110737481',id=9,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNiTiGg59OTgWkM5c+8CMzfP1ubX2Ownt/RavGxpnipJdk5xZaefQbANZlemlnOzyDtOU2+/dlg6n/ZAQFwnxRSMECIIHSWFvmwLpLx7JDo4al95DLmQs09DB/PAPUAS7A==',key_name='tempest-keypair-824062427',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='92e6d918a4554cd89d9f40cee2a55d00',ramdisk_id='',reservation_id='r-g5j20f0h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1794254085',owner_user_name='tempest-TaggedBootDevicesTest-1794254085-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T11:41:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='092033fd15e74b859f9dc209f70841db',uuid=f33a7013-82d0-477c-aa5e-b27e63f2b98d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c69d3b48-1443-4999-8369-8c5f61b35697", "address": "fa:16:3e:ec:95:94", "network": {"id": "468865fb-36d1-436e-8fea-5f633edff84a", "bridge": "br-int", "label": "tempest-device-tagging-net2-251570535", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "92e6d918a4554cd89d9f40cee2a55d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc69d3b48-14", "ovs_interfaceid": "c69d3b48-1443-4999-8369-8c5f61b35697", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Converting VIF {"id": "c69d3b48-1443-4999-8369-8c5f61b35697", "address": "fa:16:3e:ec:95:94", "network": {"id": "468865fb-36d1-436e-8fea-5f633edff84a", "bridge": "br-int", "label": "tempest-device-tagging-net2-251570535", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "92e6d918a4554cd89d9f40cee2a55d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc69d3b48-14", "ovs_interfaceid": "c69d3b48-1443-4999-8369-8c5f61b35697", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:95:94,bridge_name='br-int',has_traffic_filtering=True,id=c69d3b48-1443-4999-8369-8c5f61b35697,network=Network(468865fb-36d1-436e-8fea-5f633edff84a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc69d3b48-14') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG os_vif [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:95:94,bridge_name='br-int',has_traffic_filtering=True,id=c69d3b48-1443-4999-8369-8c5f61b35697,network=Network(468865fb-36d1-436e-8fea-5f633edff84a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc69d3b48-14') {{(pid=73449) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc69d3b48-14, may_exist=True, interface_attrs={}) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc69d3b48-14, col_values=(('external_ids', {'iface-id': 'c69d3b48-1443-4999-8369-8c5f61b35697', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ec:95:94', 'vm-uuid': 'f33a7013-82d0-477c-aa5e-b27e63f2b98d'}),), if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:14 user nova-compute[73449]: INFO os_vif [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:95:94,bridge_name='br-int',has_traffic_filtering=True,id=c69d3b48-1443-4999-8369-8c5f61b35697,network=Network(468865fb-36d1-436e-8fea-5f633edff84a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc69d3b48-14')
Aug 17 11:42:14 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] No BDM found with device name hda, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] No VIF found with MAC fa:16:3e:03:4e:88, not building metadata {{(pid=73449) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] No VIF found with MAC fa:16:3e:09:0d:df, not building metadata {{(pid=73449) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 11:42:14 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Using config drive
Aug 17 11:42:14 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Creating config drive at /opt/stack/data/nova/instances/f33a7013-82d0-477c-aa5e-b27e63f2b98d/disk.config
Aug 17 11:42:14 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f33a7013-82d0-477c-aa5e-b27e63f2b98d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpwbe_dedn {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:14 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f33a7013-82d0-477c-aa5e-b27e63f2b98d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpwbe_dedn" returned: 0 in 0.064s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:15 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.430s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:42:15 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] <== connect_volume: return (2760ms) {'type': 'block', 'scsi_wwn': '23965376164643231', 'path': '/dev/sdg'} {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 11:42:15 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23965376164643231', 'path': '/dev/sdg'} {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 11:42:15 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T11:41:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-375365820',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-375365820',id=8,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHuba1mc2rOtc1T9WyI8UwVbFUk1snTGZJbkskNqT1zruYVVlxdFqERjQoYnu+0Qwd0eX0YLAQOOpgDiCdfkrFXcxYrXXtDiLKU4WfeVli9xGspdS972Ve+XMTjbUEI+Ww==',key_name='tempest-keypair-1629878963',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='60c18371fa6246888a742164afd60242',ramdisk_id='',reservation_id='r-2n30xjvl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1289726527',owner_user_name='tempest-TaggedBootDevicesTest_v242-1289726527-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T11:41:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be158f2bab204b3f874727a655b4bbd6',uuid=b8e1def1-8303-4257-b9b5-0050f05cf2d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c877b9e9-f45c-4199-960c-2b9926518803", "address": "fa:16:3e:0d:7d:90", "network": {"id": "1596a923-35e5-45a5-85c8-5bae45f011b7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1809575924-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60c18371fa6246888a742164afd60242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc877b9e9-f4", "ovs_interfaceid": "c877b9e9-f45c-4199-960c-2b9926518803", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73449) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 11:42:15 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Converting VIF {"id": "c877b9e9-f45c-4199-960c-2b9926518803", "address": "fa:16:3e:0d:7d:90", "network": {"id": "1596a923-35e5-45a5-85c8-5bae45f011b7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1809575924-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60c18371fa6246888a742164afd60242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc877b9e9-f4", "ovs_interfaceid": "c877b9e9-f45c-4199-960c-2b9926518803", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:42:15 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:7d:90,bridge_name='br-int',has_traffic_filtering=True,id=c877b9e9-f45c-4199-960c-2b9926518803,network=Network(1596a923-35e5-45a5-85c8-5bae45f011b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc877b9e9-f4') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:42:15 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T11:41:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-375365820',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-375365820',id=8,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHuba1mc2rOtc1T9WyI8UwVbFUk1snTGZJbkskNqT1zruYVVlxdFqERjQoYnu+0Qwd0eX0YLAQOOpgDiCdfkrFXcxYrXXtDiLKU4WfeVli9xGspdS972Ve+XMTjbUEI+Ww==',key_name='tempest-keypair-1629878963',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='60c18371fa6246888a742164afd60242',ramdisk_id='',reservation_id='r-2n30xjvl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1289726527',owner_user_name='tempest-TaggedBootDevicesTest_v242-1289726527-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T11:41:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be158f2bab204b3f874727a655b4bbd6',uuid=b8e1def1-8303-4257-b9b5-0050f05cf2d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "71d82cc1-6895-4d52-b066-0a01a61b329b", "address": "fa:16:3e:48:bc:7c", "network": {"id": "2c2340dc-7ea1-4f63-8819-47844b2a536e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1423531895", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "60c18371fa6246888a742164afd60242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71d82cc1-68", "ovs_interfaceid": "71d82cc1-6895-4d52-b066-0a01a61b329b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73449) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 11:42:15 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Converting VIF {"id": "71d82cc1-6895-4d52-b066-0a01a61b329b", "address": "fa:16:3e:48:bc:7c", "network": {"id": "2c2340dc-7ea1-4f63-8819-47844b2a536e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1423531895", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "60c18371fa6246888a742164afd60242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71d82cc1-68", "ovs_interfaceid": "71d82cc1-6895-4d52-b066-0a01a61b329b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:42:15 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:bc:7c,bridge_name='br-int',has_traffic_filtering=True,id=71d82cc1-6895-4d52-b066-0a01a61b329b,network=Network(2c2340dc-7ea1-4f63-8819-47844b2a536e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap71d82cc1-68') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:42:15 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T11:41:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-375365820',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-375365820',id=8,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHuba1mc2rOtc1T9WyI8UwVbFUk1snTGZJbkskNqT1zruYVVlxdFqERjQoYnu+0Qwd0eX0YLAQOOpgDiCdfkrFXcxYrXXtDiLKU4WfeVli9xGspdS972Ve+XMTjbUEI+Ww==',key_name='tempest-keypair-1629878963',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='60c18371fa6246888a742164afd60242',ramdisk_id='',reservation_id='r-2n30xjvl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1289726527',owner_user_name='tempest-TaggedBootDevicesTest_v242-1289726527-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T11:41:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be158f2bab204b3f874727a655b4bbd6',uuid=b8e1def1-8303-4257-b9b5-0050f05cf2d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b3fe8f9e-5b75-440e-b1c1-f888a4e91e9e", "address": "fa:16:3e:0e:2e:4c", "network": {"id": "2c2340dc-7ea1-4f63-8819-47844b2a536e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1423531895", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "60c18371fa6246888a742164afd60242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3fe8f9e-5b", "ovs_interfaceid": "b3fe8f9e-5b75-440e-b1c1-f888a4e91e9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73449) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 11:42:15 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Converting VIF {"id": "b3fe8f9e-5b75-440e-b1c1-f888a4e91e9e", "address": "fa:16:3e:0e:2e:4c", "network": {"id": "2c2340dc-7ea1-4f63-8819-47844b2a536e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1423531895", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "60c18371fa6246888a742164afd60242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3fe8f9e-5b", "ovs_interfaceid": "b3fe8f9e-5b75-440e-b1c1-f888a4e91e9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:42:15 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:2e:4c,bridge_name='br-int',has_traffic_filtering=True,id=b3fe8f9e-5b75-440e-b1c1-f888a4e91e9e,network=Network(2c2340dc-7ea1-4f63-8819-47844b2a536e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb3fe8f9e-5b') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:42:15 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T11:41:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-375365820',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-375365820',id=8,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHuba1mc2rOtc1T9WyI8UwVbFUk1snTGZJbkskNqT1zruYVVlxdFqERjQoYnu+0Qwd0eX0YLAQOOpgDiCdfkrFXcxYrXXtDiLKU4WfeVli9xGspdS972Ve+XMTjbUEI+Ww==',key_name='tempest-keypair-1629878963',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='60c18371fa6246888a742164afd60242',ramdisk_id='',reservation_id='r-2n30xjvl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1289726527',owner_user_name='tempest-TaggedBootDevicesTest_v242-1289726527-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T11:41:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be158f2bab204b3f874727a655b4bbd6',uuid=b8e1def1-8303-4257-b9b5-0050f05cf2d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f9c9fca3-8f9c-4ea9-8ceb-ed19cb265786", "address": "fa:16:3e:a2:22:da", "network": {"id": "2c2340dc-7ea1-4f63-8819-47844b2a536e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1423531895", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "60c18371fa6246888a742164afd60242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9c9fca3-8f", "ovs_interfaceid": "f9c9fca3-8f9c-4ea9-8ceb-ed19cb265786", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73449) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 11:42:15 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Converting VIF {"id": "f9c9fca3-8f9c-4ea9-8ceb-ed19cb265786", "address": "fa:16:3e:a2:22:da", "network": {"id": "2c2340dc-7ea1-4f63-8819-47844b2a536e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1423531895", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "60c18371fa6246888a742164afd60242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9c9fca3-8f", "ovs_interfaceid": "f9c9fca3-8f9c-4ea9-8ceb-ed19cb265786", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:42:15 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:22:da,bridge_name='br-int',has_traffic_filtering=True,id=f9c9fca3-8f9c-4ea9-8ceb-ed19cb265786,network=Network(2c2340dc-7ea1-4f63-8819-47844b2a536e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9c9fca3-8f') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:42:15 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T11:41:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-375365820',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-375365820',id=8,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHuba1mc2rOtc1T9WyI8UwVbFUk1snTGZJbkskNqT1zruYVVlxdFqERjQoYnu+0Qwd0eX0YLAQOOpgDiCdfkrFXcxYrXXtDiLKU4WfeVli9xGspdS972Ve+XMTjbUEI+Ww==',key_name='tempest-keypair-1629878963',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='60c18371fa6246888a742164afd60242',ramdisk_id='',reservation_id='r-2n30xjvl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1289726527',owner_user_name='tempest-TaggedBootDevicesTest_v242-1289726527-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T11:41:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be158f2bab204b3f874727a655b4bbd6',uuid=b8e1def1-8303-4257-b9b5-0050f05cf2d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6888cb29-a1bc-42b0-bec3-57667e1b0350", "address": "fa:16:3e:6e:07:1b", "network": {"id": "2c2340dc-7ea1-4f63-8819-47844b2a536e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1423531895", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "60c18371fa6246888a742164afd60242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6888cb29-a1", "ovs_interfaceid": "6888cb29-a1bc-42b0-bec3-57667e1b0350", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73449) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 11:42:15 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Converting VIF {"id": "6888cb29-a1bc-42b0-bec3-57667e1b0350", "address": "fa:16:3e:6e:07:1b", "network": {"id": "2c2340dc-7ea1-4f63-8819-47844b2a536e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1423531895", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "60c18371fa6246888a742164afd60242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6888cb29-a1", "ovs_interfaceid": "6888cb29-a1bc-42b0-bec3-57667e1b0350", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:42:15 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:07:1b,bridge_name='br-int',has_traffic_filtering=True,id=6888cb29-a1bc-42b0-bec3-57667e1b0350,network=Network(2c2340dc-7ea1-4f63-8819-47844b2a536e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6888cb29-a1') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:42:15 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T11:41:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-375365820',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-375365820',id=8,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHuba1mc2rOtc1T9WyI8UwVbFUk1snTGZJbkskNqT1zruYVVlxdFqERjQoYnu+0Qwd0eX0YLAQOOpgDiCdfkrFXcxYrXXtDiLKU4WfeVli9xGspdS972Ve+XMTjbUEI+Ww==',key_name='tempest-keypair-1629878963',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='60c18371fa6246888a742164afd60242',ramdisk_id='',reservation_id='r-2n30xjvl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1289726527',owner_user_name='tempest-TaggedBootDevicesTest_v242-1289726527-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T11:41:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be158f2bab204b3f874727a655b4bbd6',uuid=b8e1def1-8303-4257-b9b5-0050f05cf2d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d85896ce-110a-41d6-a20e-6beaecb36b97", "address": "fa:16:3e:e3:51:d1", "network": {"id": "8244e7f5-12cf-4ab5-baa2-956f148fc51f", "bridge": "br-int", "label": "tempest-device-tagging-net2-163620727", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "60c18371fa6246888a742164afd60242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd85896ce-11", "ovs_interfaceid": "d85896ce-110a-41d6-a20e-6beaecb36b97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73449) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 11:42:15 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Converting VIF {"id": "d85896ce-110a-41d6-a20e-6beaecb36b97", "address": "fa:16:3e:e3:51:d1", "network": {"id": "8244e7f5-12cf-4ab5-baa2-956f148fc51f", "bridge": "br-int", "label": "tempest-device-tagging-net2-163620727", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "60c18371fa6246888a742164afd60242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd85896ce-11", "ovs_interfaceid": "d85896ce-110a-41d6-a20e-6beaecb36b97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:42:15 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:51:d1,bridge_name='br-int',has_traffic_filtering=True,id=d85896ce-110a-41d6-a20e-6beaecb36b97,network=Network(8244e7f5-12cf-4ab5-baa2-956f148fc51f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd85896ce-11') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:42:15 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T11:41:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-375365820',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-375365820',id=8,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHuba1mc2rOtc1T9WyI8UwVbFUk1snTGZJbkskNqT1zruYVVlxdFqERjQoYnu+0Qwd0eX0YLAQOOpgDiCdfkrFXcxYrXXtDiLKU4WfeVli9xGspdS972Ve+XMTjbUEI+Ww==',key_name='tempest-keypair-1629878963',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='60c18371fa6246888a742164afd60242',ramdisk_id='',reservation_id='r-2n30xjvl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1289726527',owner_user_name='tempest-TaggedBootDevicesTest_v242-1289726527-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T11:41:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be158f2bab204b3f874727a655b4bbd6',uuid=b8e1def1-8303-4257-b9b5-0050f05cf2d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "671f57db-57f1-4ba3-9e49-ebe4816404f6", "address": "fa:16:3e:04:1d:3e", "network": {"id": "8244e7f5-12cf-4ab5-baa2-956f148fc51f", "bridge": "br-int", "label": "tempest-device-tagging-net2-163620727", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "60c18371fa6246888a742164afd60242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap671f57db-57", "ovs_interfaceid": "671f57db-57f1-4ba3-9e49-ebe4816404f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73449) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 11:42:15 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Converting VIF {"id": "671f57db-57f1-4ba3-9e49-ebe4816404f6", "address": "fa:16:3e:04:1d:3e", "network": {"id": "8244e7f5-12cf-4ab5-baa2-956f148fc51f", "bridge": "br-int", "label": "tempest-device-tagging-net2-163620727", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "60c18371fa6246888a742164afd60242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap671f57db-57", "ovs_interfaceid": "671f57db-57f1-4ba3-9e49-ebe4816404f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:42:15 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:1d:3e,bridge_name='br-int',has_traffic_filtering=True,id=671f57db-57f1-4ba3-9e49-ebe4816404f6,network=Network(8244e7f5-12cf-4ab5-baa2-956f148fc51f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap671f57db-57') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:42:15 user nova-compute[73449]: DEBUG nova.objects.instance [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Lazy-loading 'pci_devices' on Instance uuid b8e1def1-8303-4257-b9b5-0050f05cf2d0 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:42:15 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] End _get_guest_xml xml=<domain type="kvm">
Aug 17 11:42:15 user nova-compute[73449]:   <uuid>b8e1def1-8303-4257-b9b5-0050f05cf2d0</uuid>
Aug 17 11:42:15 user nova-compute[73449]:   <name>instance-00000008</name>
Aug 17 11:42:15 user nova-compute[73449]:   <memory>524288</memory>
Aug 17 11:42:15 user nova-compute[73449]:   <vcpu>1</vcpu>
Aug 17 11:42:15 user nova-compute[73449]:   <metadata>
Aug 17 11:42:15 user nova-compute[73449]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 11:42:15 user nova-compute[73449]:       <nova:package version="0.0.0"/>
Aug 17 11:42:15 user nova-compute[73449]:       <nova:name>tempest-device-tagging-server-375365820</nova:name>
Aug 17 11:42:15 user nova-compute[73449]:       <nova:creationTime>2023-08-17 11:42:07</nova:creationTime>
Aug 17 11:42:15 user nova-compute[73449]:       <nova:flavor name="m1.tiny">
Aug 17 11:42:15 user nova-compute[73449]:         <nova:memory>512</nova:memory>
Aug 17 11:42:15 user nova-compute[73449]:         <nova:disk>1</nova:disk>
Aug 17 11:42:15 user nova-compute[73449]:         <nova:swap>0</nova:swap>
Aug 17 11:42:15 user nova-compute[73449]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 11:42:15 user nova-compute[73449]:         <nova:vcpus>1</nova:vcpus>
Aug 17 11:42:15 user nova-compute[73449]:       </nova:flavor>
Aug 17 11:42:15 user nova-compute[73449]:       <nova:owner>
Aug 17 11:42:15 user nova-compute[73449]:         <nova:user uuid="be158f2bab204b3f874727a655b4bbd6">tempest-TaggedBootDevicesTest_v242-1289726527-project-member</nova:user>
Aug 17 11:42:15 user nova-compute[73449]:         <nova:project uuid="60c18371fa6246888a742164afd60242">tempest-TaggedBootDevicesTest_v242-1289726527</nova:project>
Aug 17 11:42:15 user nova-compute[73449]:       </nova:owner>
Aug 17 11:42:15 user nova-compute[73449]:       <nova:root type="image" uuid="0a2904ae-083d-41c8-83db-343132b36148"/>
Aug 17 11:42:15 user nova-compute[73449]:       <nova:ports>
Aug 17 11:42:15 user nova-compute[73449]:         <nova:port uuid="c877b9e9-f45c-4199-960c-2b9926518803">
Aug 17 11:42:15 user nova-compute[73449]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 17 11:42:15 user nova-compute[73449]:         </nova:port>
Aug 17 11:42:15 user nova-compute[73449]:         <nova:port uuid="71d82cc1-6895-4d52-b066-0a01a61b329b">
Aug 17 11:42:15 user nova-compute[73449]:           <nova:ip type="fixed" address="10.1.1.178" ipVersion="4"/>
Aug 17 11:42:15 user nova-compute[73449]:         </nova:port>
Aug 17 11:42:15 user nova-compute[73449]:         <nova:port uuid="b3fe8f9e-5b75-440e-b1c1-f888a4e91e9e">
Aug 17 11:42:15 user nova-compute[73449]:           <nova:ip type="fixed" address="10.1.1.210" ipVersion="4"/>
Aug 17 11:42:15 user nova-compute[73449]:         </nova:port>
Aug 17 11:42:15 user nova-compute[73449]:         <nova:port uuid="f9c9fca3-8f9c-4ea9-8ceb-ed19cb265786">
Aug 17 11:42:15 user nova-compute[73449]:           <nova:ip type="fixed" address="10.1.1.52" ipVersion="4"/>
Aug 17 11:42:15 user nova-compute[73449]:         </nova:port>
Aug 17 11:42:15 user nova-compute[73449]:         <nova:port uuid="6888cb29-a1bc-42b0-bec3-57667e1b0350">
Aug 17 11:42:15 user nova-compute[73449]:           <nova:ip type="fixed" address="10.1.1.107" ipVersion="4"/>
Aug 17 11:42:15 user nova-compute[73449]:         </nova:port>
Aug 17 11:42:15 user nova-compute[73449]:         <nova:port uuid="d85896ce-110a-41d6-a20e-6beaecb36b97">
Aug 17 11:42:15 user nova-compute[73449]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 17 11:42:15 user nova-compute[73449]:         </nova:port>
Aug 17 11:42:15 user nova-compute[73449]:         <nova:port uuid="671f57db-57f1-4ba3-9e49-ebe4816404f6">
Aug 17 11:42:15 user nova-compute[73449]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 17 11:42:15 user nova-compute[73449]:         </nova:port>
Aug 17 11:42:15 user nova-compute[73449]:       </nova:ports>
Aug 17 11:42:15 user nova-compute[73449]:     </nova:instance>
Aug 17 11:42:15 user nova-compute[73449]:   </metadata>
Aug 17 11:42:15 user nova-compute[73449]:   <sysinfo type="smbios">
Aug 17 11:42:15 user nova-compute[73449]:     <system>
Aug 17 11:42:15 user nova-compute[73449]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 11:42:15 user nova-compute[73449]:       <entry name="product">OpenStack Nova</entry>
Aug 17 11:42:15 user nova-compute[73449]:       <entry name="version">0.0.0</entry>
Aug 17 11:42:15 user nova-compute[73449]:       <entry name="serial">b8e1def1-8303-4257-b9b5-0050f05cf2d0</entry>
Aug 17 11:42:15 user nova-compute[73449]:       <entry name="uuid">b8e1def1-8303-4257-b9b5-0050f05cf2d0</entry>
Aug 17 11:42:15 user nova-compute[73449]:       <entry name="family">Virtual Machine</entry>
Aug 17 11:42:15 user nova-compute[73449]:     </system>
Aug 17 11:42:15 user nova-compute[73449]:   </sysinfo>
Aug 17 11:42:15 user nova-compute[73449]:   <os>
Aug 17 11:42:15 user nova-compute[73449]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 11:42:15 user nova-compute[73449]:     <boot dev="hd"/>
Aug 17 11:42:15 user nova-compute[73449]:     <smbios mode="sysinfo"/>
Aug 17 11:42:15 user nova-compute[73449]:   </os>
Aug 17 11:42:15 user nova-compute[73449]:   <features>
Aug 17 11:42:15 user nova-compute[73449]:     <acpi/>
Aug 17 11:42:15 user nova-compute[73449]:     <apic/>
Aug 17 11:42:15 user nova-compute[73449]:     <vmcoreinfo/>
Aug 17 11:42:15 user nova-compute[73449]:   </features>
Aug 17 11:42:15 user nova-compute[73449]:   <clock offset="utc">
Aug 17 11:42:15 user nova-compute[73449]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 11:42:15 user nova-compute[73449]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 11:42:15 user nova-compute[73449]:     <timer name="hpet" present="no"/>
Aug 17 11:42:15 user nova-compute[73449]:   </clock>
Aug 17 11:42:15 user nova-compute[73449]:   <cpu mode="custom" match="exact">
Aug 17 11:42:15 user nova-compute[73449]:     <model>Nehalem</model>
Aug 17 11:42:15 user nova-compute[73449]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 11:42:15 user nova-compute[73449]:   </cpu>
Aug 17 11:42:15 user nova-compute[73449]:   <devices>
Aug 17 11:42:15 user nova-compute[73449]:     <disk type="file" device="cdrom">
Aug 17 11:42:15 user nova-compute[73449]:       <driver name="qemu" type="raw" cache="none"/>
Aug 17 11:42:15 user nova-compute[73449]:       <source file="/opt/stack/data/nova/instances/b8e1def1-8303-4257-b9b5-0050f05cf2d0/disk.config"/>
Aug 17 11:42:15 user nova-compute[73449]:       <target dev="hda" bus="ide"/>
Aug 17 11:42:15 user nova-compute[73449]:     </disk>
Aug 17 11:42:15 user nova-compute[73449]:     <disk type="block" device="disk">
Aug 17 11:42:15 user nova-compute[73449]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 11:42:15 user nova-compute[73449]:       <source dev="/dev/sdc"/>
Aug 17 11:42:15 user nova-compute[73449]:       <target dev="vda" bus="virtio"/>
Aug 17 11:42:15 user nova-compute[73449]:       <serial>40bc2deb-5334-44c4-ae15-1c30e668ae47</serial>
Aug 17 11:42:15 user nova-compute[73449]:     </disk>
Aug 17 11:42:15 user nova-compute[73449]:     <disk type="block" device="disk">
Aug 17 11:42:15 user nova-compute[73449]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 11:42:15 user nova-compute[73449]:       <source dev="/dev/sde"/>
Aug 17 11:42:15 user nova-compute[73449]:       <target dev="vdb" bus="virtio"/>
Aug 17 11:42:15 user nova-compute[73449]:       <serial>8d09e821-98f2-459f-a7b2-3a77e57f1b4e</serial>
Aug 17 11:42:15 user nova-compute[73449]:     </disk>
Aug 17 11:42:15 user nova-compute[73449]:     <disk type="block" device="disk">
Aug 17 11:42:15 user nova-compute[73449]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 11:42:15 user nova-compute[73449]:       <source dev="/dev/sdg"/>
Aug 17 11:42:15 user nova-compute[73449]:       <target dev="vdc" bus="virtio"/>
Aug 17 11:42:15 user nova-compute[73449]:       <serial>69858581-d156-4fd4-a145-74ef3c8a93dd</serial>
Aug 17 11:42:15 user nova-compute[73449]:     </disk>
Aug 17 11:42:15 user nova-compute[73449]:     <interface type="ethernet">
Aug 17 11:42:15 user nova-compute[73449]:       <mac address="fa:16:3e:0d:7d:90"/>
Aug 17 11:42:15 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 11:42:15 user nova-compute[73449]:       <mtu size="1442"/>
Aug 17 11:42:15 user nova-compute[73449]:       <target dev="tapc877b9e9-f4"/>
Aug 17 11:42:15 user nova-compute[73449]:     </interface>
Aug 17 11:42:15 user nova-compute[73449]:     <interface type="ethernet">
Aug 17 11:42:15 user nova-compute[73449]:       <mac address="fa:16:3e:48:bc:7c"/>
Aug 17 11:42:15 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 11:42:15 user nova-compute[73449]:       <mtu size="1442"/>
Aug 17 11:42:15 user nova-compute[73449]:       <target dev="tap71d82cc1-68"/>
Aug 17 11:42:15 user nova-compute[73449]:     </interface>
Aug 17 11:42:15 user nova-compute[73449]:     <interface type="ethernet">
Aug 17 11:42:15 user nova-compute[73449]:       <mac address="fa:16:3e:0e:2e:4c"/>
Aug 17 11:42:15 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 11:42:15 user nova-compute[73449]:       <mtu size="1442"/>
Aug 17 11:42:15 user nova-compute[73449]:       <target dev="tapb3fe8f9e-5b"/>
Aug 17 11:42:15 user nova-compute[73449]:     </interface>
Aug 17 11:42:15 user nova-compute[73449]:     <interface type="ethernet">
Aug 17 11:42:15 user nova-compute[73449]:       <mac address="fa:16:3e:a2:22:da"/>
Aug 17 11:42:15 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 11:42:15 user nova-compute[73449]:       <mtu size="1442"/>
Aug 17 11:42:15 user nova-compute[73449]:       <target dev="tapf9c9fca3-8f"/>
Aug 17 11:42:15 user nova-compute[73449]:     </interface>
Aug 17 11:42:15 user nova-compute[73449]:     <interface type="ethernet">
Aug 17 11:42:15 user nova-compute[73449]:       <mac address="fa:16:3e:6e:07:1b"/>
Aug 17 11:42:15 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 11:42:15 user nova-compute[73449]:       <mtu size="1442"/>
Aug 17 11:42:15 user nova-compute[73449]:       <target dev="tap6888cb29-a1"/>
Aug 17 11:42:15 user nova-compute[73449]:     </interface>
Aug 17 11:42:15 user nova-compute[73449]:     <interface type="ethernet">
Aug 17 11:42:15 user nova-compute[73449]:       <mac address="fa:16:3e:e3:51:d1"/>
Aug 17 11:42:15 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 11:42:15 user nova-compute[73449]:       <mtu size="1442"/>
Aug 17 11:42:15 user nova-compute[73449]:       <target dev="tapd85896ce-11"/>
Aug 17 11:42:15 user nova-compute[73449]:     </interface>
Aug 17 11:42:15 user nova-compute[73449]:     <interface type="ethernet">
Aug 17 11:42:15 user nova-compute[73449]:       <mac address="fa:16:3e:04:1d:3e"/>
Aug 17 11:42:15 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 11:42:15 user nova-compute[73449]:       <mtu size="1442"/>
Aug 17 11:42:15 user nova-compute[73449]:       <target dev="tap671f57db-57"/>
Aug 17 11:42:15 user nova-compute[73449]:     </interface>
Aug 17 11:42:15 user nova-compute[73449]:     <serial type="pty">
Aug 17 11:42:15 user nova-compute[73449]:       <log file="/opt/stack/data/nova/instances/b8e1def1-8303-4257-b9b5-0050f05cf2d0/console.log" append="off"/>
Aug 17 11:42:15 user nova-compute[73449]:     </serial>
Aug 17 11:42:15 user nova-compute[73449]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 11:42:15 user nova-compute[73449]:     <video>
Aug 17 11:42:15 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 11:42:15 user nova-compute[73449]:     </video>
Aug 17 11:42:15 user nova-compute[73449]:     <rng model="virtio">
Aug 17 11:42:15 user nova-compute[73449]:       <backend model="random">/dev/urandom</backend>
Aug 17 11:42:15 user nova-compute[73449]:     </rng>
Aug 17 11:42:15 user nova-compute[73449]:     <controller type="usb" index="0" model="none"/>
Aug 17 11:42:15 user nova-compute[73449]:     <memballoon model="virtio">
Aug 17 11:42:15 user nova-compute[73449]:       <stats period="10"/>
Aug 17 11:42:15 user nova-compute[73449]:     </memballoon>
Aug 17 11:42:15 user nova-compute[73449]:   </devices>
Aug 17 11:42:15 user nova-compute[73449]: </domain>
Aug 17 11:42:15 user nova-compute[73449]:  {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 11:42:15 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T11:41:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-375365820',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-375365820',id=8,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHuba1mc2rOtc1T9WyI8UwVbFUk1snTGZJbkskNqT1zruYVVlxdFqERjQoYnu+0Qwd0eX0YLAQOOpgDiCdfkrFXcxYrXXtDiLKU4WfeVli9xGspdS972Ve+XMTjbUEI+Ww==',key_name='tempest-keypair-1629878963',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='60c18371fa6246888a742164afd60242',ramdisk_id='',reservation_id='r-2n30xjvl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1289726527',owner_user_name='tempest-TaggedBootDevicesTest_v242-1289726527-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T11:41:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be158f2bab204b3f874727a655b4bbd6',uuid=b8e1def1-8303-4257-b9b5-0050f05cf2d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c877b9e9-f45c-4199-960c-2b9926518803", "address": "fa:16:3e:0d:7d:90", "network": {"id": "1596a923-35e5-45a5-85c8-5bae45f011b7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1809575924-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60c18371fa6246888a742164afd60242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc877b9e9-f4", "ovs_interfaceid": "c877b9e9-f45c-4199-960c-2b9926518803", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 11:42:15 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Converting VIF {"id": "c877b9e9-f45c-4199-960c-2b9926518803", "address": "fa:16:3e:0d:7d:90", "network": {"id": "1596a923-35e5-45a5-85c8-5bae45f011b7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1809575924-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60c18371fa6246888a742164afd60242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc877b9e9-f4", "ovs_interfaceid": "c877b9e9-f45c-4199-960c-2b9926518803", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:42:15 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:7d:90,bridge_name='br-int',has_traffic_filtering=True,id=c877b9e9-f45c-4199-960c-2b9926518803,network=Network(1596a923-35e5-45a5-85c8-5bae45f011b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc877b9e9-f4') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:42:15 user nova-compute[73449]: DEBUG os_vif [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:7d:90,bridge_name='br-int',has_traffic_filtering=True,id=c877b9e9-f45c-4199-960c-2b9926518803,network=Network(1596a923-35e5-45a5-85c8-5bae45f011b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc877b9e9-f4') {{(pid=73449) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 11:42:15 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:15 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:42:15 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 11:42:15 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:15 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc877b9e9-f4, may_exist=True, interface_attrs={}) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:42:15 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc877b9e9-f4, col_values=(('external_ids', {'iface-id': 'c877b9e9-f45c-4199-960c-2b9926518803', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0d:7d:90', 'vm-uuid': 'b8e1def1-8303-4257-b9b5-0050f05cf2d0'}),), if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:42:15 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:15 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:42:15 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:15 user nova-compute[73449]: INFO os_vif [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:7d:90,bridge_name='br-int',has_traffic_filtering=True,id=c877b9e9-f45c-4199-960c-2b9926518803,network=Network(1596a923-35e5-45a5-85c8-5bae45f011b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc877b9e9-f4')
Aug 17 11:42:15 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T11:41:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-375365820',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-375365820',id=8,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHuba1mc2rOtc1T9WyI8UwVbFUk1snTGZJbkskNqT1zruYVVlxdFqERjQoYnu+0Qwd0eX0YLAQOOpgDiCdfkrFXcxYrXXtDiLKU4WfeVli9xGspdS972Ve+XMTjbUEI+Ww==',key_name='tempest-keypair-1629878963',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='60c18371fa6246888a742164afd60242',ramdisk_id='',reservation_id='r-2n30xjvl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1289726527',owner_user_name='tempest-TaggedBootDevicesTest_v242-1289726527-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T11:41:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be158f2bab204b3f874727a655b4bbd6',uuid=b8e1def1-8303-4257-b9b5-0050f05cf2d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "71d82cc1-6895-4d52-b066-0a01a61b329b", "address": "fa:16:3e:48:bc:7c", "network": {"id": "2c2340dc-7ea1-4f63-8819-47844b2a536e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1423531895", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "60c18371fa6246888a742164afd60242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71d82cc1-68", "ovs_interfaceid": "71d82cc1-6895-4d52-b066-0a01a61b329b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73449) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 11:42:15 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Converting VIF {"id": "71d82cc1-6895-4d52-b066-0a01a61b329b", "address": "fa:16:3e:48:bc:7c", "network": {"id": "2c2340dc-7ea1-4f63-8819-47844b2a536e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1423531895", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "60c18371fa6246888a742164afd60242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71d82cc1-68", "ovs_interfaceid": "71d82cc1-6895-4d52-b066-0a01a61b329b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:42:15 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:bc:7c,bridge_name='br-int',has_traffic_filtering=True,id=71d82cc1-6895-4d52-b066-0a01a61b329b,network=Network(2c2340dc-7ea1-4f63-8819-47844b2a536e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap71d82cc1-68') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:42:15 user nova-compute[73449]: DEBUG os_vif [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:bc:7c,bridge_name='br-int',has_traffic_filtering=True,id=71d82cc1-6895-4d52-b066-0a01a61b329b,network=Network(2c2340dc-7ea1-4f63-8819-47844b2a536e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap71d82cc1-68') {{(pid=73449) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 11:42:15 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:15 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:42:15 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 11:42:15 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:15 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap71d82cc1-68, may_exist=True, interface_attrs={}) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:42:15 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap71d82cc1-68, col_values=(('external_ids', {'iface-id': '71d82cc1-6895-4d52-b066-0a01a61b329b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:48:bc:7c', 'vm-uuid': 'b8e1def1-8303-4257-b9b5-0050f05cf2d0'}),), if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:42:15 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:42:15 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:15 user nova-compute[73449]: INFO os_vif [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:bc:7c,bridge_name='br-int',has_traffic_filtering=True,id=71d82cc1-6895-4d52-b066-0a01a61b329b,network=Network(2c2340dc-7ea1-4f63-8819-47844b2a536e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap71d82cc1-68')
Aug 17 11:42:15 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T11:41:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-375365820',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-375365820',id=8,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHuba1mc2rOtc1T9WyI8UwVbFUk1snTGZJbkskNqT1zruYVVlxdFqERjQoYnu+0Qwd0eX0YLAQOOpgDiCdfkrFXcxYrXXtDiLKU4WfeVli9xGspdS972Ve+XMTjbUEI+Ww==',key_name='tempest-keypair-1629878963',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='60c18371fa6246888a742164afd60242',ramdisk_id='',reservation_id='r-2n30xjvl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1289726527',owner_user_name='tempest-TaggedBootDevicesTest_v242-1289726527-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T11:41:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be158f2bab204b3f874727a655b4bbd6',uuid=b8e1def1-8303-4257-b9b5-0050f05cf2d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b3fe8f9e-5b75-440e-b1c1-f888a4e91e9e", "address": "fa:16:3e:0e:2e:4c", "network": {"id": "2c2340dc-7ea1-4f63-8819-47844b2a536e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1423531895", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "60c18371fa6246888a742164afd60242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3fe8f9e-5b", "ovs_interfaceid": "b3fe8f9e-5b75-440e-b1c1-f888a4e91e9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73449) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 11:42:15 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Converting VIF {"id": "b3fe8f9e-5b75-440e-b1c1-f888a4e91e9e", "address": "fa:16:3e:0e:2e:4c", "network": {"id": "2c2340dc-7ea1-4f63-8819-47844b2a536e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1423531895", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "60c18371fa6246888a742164afd60242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3fe8f9e-5b", "ovs_interfaceid": "b3fe8f9e-5b75-440e-b1c1-f888a4e91e9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:42:15 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:2e:4c,bridge_name='br-int',has_traffic_filtering=True,id=b3fe8f9e-5b75-440e-b1c1-f888a4e91e9e,network=Network(2c2340dc-7ea1-4f63-8819-47844b2a536e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb3fe8f9e-5b') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:42:15 user nova-compute[73449]: DEBUG os_vif [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:2e:4c,bridge_name='br-int',has_traffic_filtering=True,id=b3fe8f9e-5b75-440e-b1c1-f888a4e91e9e,network=Network(2c2340dc-7ea1-4f63-8819-47844b2a536e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb3fe8f9e-5b') {{(pid=73449) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 11:42:15 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:15 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:42:15 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 11:42:15 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:15 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb3fe8f9e-5b, may_exist=True, interface_attrs={}) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:42:15 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb3fe8f9e-5b, col_values=(('external_ids', {'iface-id': 'b3fe8f9e-5b75-440e-b1c1-f888a4e91e9e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0e:2e:4c', 'vm-uuid': 'b8e1def1-8303-4257-b9b5-0050f05cf2d0'}),), if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:42:15 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:42:15 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:15 user nova-compute[73449]: INFO os_vif [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:2e:4c,bridge_name='br-int',has_traffic_filtering=True,id=b3fe8f9e-5b75-440e-b1c1-f888a4e91e9e,network=Network(2c2340dc-7ea1-4f63-8819-47844b2a536e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb3fe8f9e-5b')
Aug 17 11:42:15 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T11:41:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-375365820',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-375365820',id=8,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHuba1mc2rOtc1T9WyI8UwVbFUk1snTGZJbkskNqT1zruYVVlxdFqERjQoYnu+0Qwd0eX0YLAQOOpgDiCdfkrFXcxYrXXtDiLKU4WfeVli9xGspdS972Ve+XMTjbUEI+Ww==',key_name='tempest-keypair-1629878963',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='60c18371fa6246888a742164afd60242',ramdisk_id='',reservation_id='r-2n30xjvl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1289726527',owner_user_name='tempest-TaggedBootDevicesTest_v242-1289726527-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T11:41:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be158f2bab204b3f874727a655b4bbd6',uuid=b8e1def1-8303-4257-b9b5-0050f05cf2d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f9c9fca3-8f9c-4ea9-8ceb-ed19cb265786", "address": "fa:16:3e:a2:22:da", "network": {"id": "2c2340dc-7ea1-4f63-8819-47844b2a536e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1423531895", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "60c18371fa6246888a742164afd60242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9c9fca3-8f", "ovs_interfaceid": "f9c9fca3-8f9c-4ea9-8ceb-ed19cb265786", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 11:42:15 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Converting VIF {"id": "f9c9fca3-8f9c-4ea9-8ceb-ed19cb265786", "address": "fa:16:3e:a2:22:da", "network": {"id": "2c2340dc-7ea1-4f63-8819-47844b2a536e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1423531895", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "60c18371fa6246888a742164afd60242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9c9fca3-8f", "ovs_interfaceid": "f9c9fca3-8f9c-4ea9-8ceb-ed19cb265786", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:42:15 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:22:da,bridge_name='br-int',has_traffic_filtering=True,id=f9c9fca3-8f9c-4ea9-8ceb-ed19cb265786,network=Network(2c2340dc-7ea1-4f63-8819-47844b2a536e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9c9fca3-8f') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:42:15 user nova-compute[73449]: DEBUG os_vif [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:22:da,bridge_name='br-int',has_traffic_filtering=True,id=f9c9fca3-8f9c-4ea9-8ceb-ed19cb265786,network=Network(2c2340dc-7ea1-4f63-8819-47844b2a536e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9c9fca3-8f') {{(pid=73449) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 11:42:15 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:15 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:42:15 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 11:42:15 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:15 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf9c9fca3-8f, may_exist=True, interface_attrs={}) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:42:15 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf9c9fca3-8f, col_values=(('external_ids', {'iface-id': 'f9c9fca3-8f9c-4ea9-8ceb-ed19cb265786', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a2:22:da', 'vm-uuid': 'b8e1def1-8303-4257-b9b5-0050f05cf2d0'}),), if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:42:15 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:15 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:42:15 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:15 user nova-compute[73449]: INFO os_vif [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:22:da,bridge_name='br-int',has_traffic_filtering=True,id=f9c9fca3-8f9c-4ea9-8ceb-ed19cb265786,network=Network(2c2340dc-7ea1-4f63-8819-47844b2a536e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9c9fca3-8f')
Aug 17 11:42:15 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T11:41:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-375365820',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-375365820',id=8,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHuba1mc2rOtc1T9WyI8UwVbFUk1snTGZJbkskNqT1zruYVVlxdFqERjQoYnu+0Qwd0eX0YLAQOOpgDiCdfkrFXcxYrXXtDiLKU4WfeVli9xGspdS972Ve+XMTjbUEI+Ww==',key_name='tempest-keypair-1629878963',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='60c18371fa6246888a742164afd60242',ramdisk_id='',reservation_id='r-2n30xjvl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1289726527',owner_user_name='tempest-TaggedBootDevicesTest_v242-1289726527-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T11:41:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be158f2bab204b3f874727a655b4bbd6',uuid=b8e1def1-8303-4257-b9b5-0050f05cf2d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6888cb29-a1bc-42b0-bec3-57667e1b0350", "address": "fa:16:3e:6e:07:1b", "network": {"id": "2c2340dc-7ea1-4f63-8819-47844b2a536e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1423531895", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "60c18371fa6246888a742164afd60242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6888cb29-a1", "ovs_interfaceid": "6888cb29-a1bc-42b0-bec3-57667e1b0350", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 11:42:15 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Converting VIF {"id": "6888cb29-a1bc-42b0-bec3-57667e1b0350", "address": "fa:16:3e:6e:07:1b", "network": {"id": "2c2340dc-7ea1-4f63-8819-47844b2a536e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1423531895", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "60c18371fa6246888a742164afd60242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6888cb29-a1", "ovs_interfaceid": "6888cb29-a1bc-42b0-bec3-57667e1b0350", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:42:15 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:07:1b,bridge_name='br-int',has_traffic_filtering=True,id=6888cb29-a1bc-42b0-bec3-57667e1b0350,network=Network(2c2340dc-7ea1-4f63-8819-47844b2a536e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6888cb29-a1') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:42:15 user nova-compute[73449]: DEBUG os_vif [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:07:1b,bridge_name='br-int',has_traffic_filtering=True,id=6888cb29-a1bc-42b0-bec3-57667e1b0350,network=Network(2c2340dc-7ea1-4f63-8819-47844b2a536e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6888cb29-a1') {{(pid=73449) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 11:42:15 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:15 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:42:15 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 11:42:15 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:15 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6888cb29-a1, may_exist=True, interface_attrs={}) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:42:15 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6888cb29-a1, col_values=(('external_ids', {'iface-id': '6888cb29-a1bc-42b0-bec3-57667e1b0350', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6e:07:1b', 'vm-uuid': 'b8e1def1-8303-4257-b9b5-0050f05cf2d0'}),), if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:42:15 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:15 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:42:16 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:16 user nova-compute[73449]: INFO os_vif [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:07:1b,bridge_name='br-int',has_traffic_filtering=True,id=6888cb29-a1bc-42b0-bec3-57667e1b0350,network=Network(2c2340dc-7ea1-4f63-8819-47844b2a536e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6888cb29-a1')
Aug 17 11:42:16 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T11:41:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-375365820',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-375365820',id=8,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHuba1mc2rOtc1T9WyI8UwVbFUk1snTGZJbkskNqT1zruYVVlxdFqERjQoYnu+0Qwd0eX0YLAQOOpgDiCdfkrFXcxYrXXtDiLKU4WfeVli9xGspdS972Ve+XMTjbUEI+Ww==',key_name='tempest-keypair-1629878963',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='60c18371fa6246888a742164afd60242',ramdisk_id='',reservation_id='r-2n30xjvl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1289726527',owner_user_name='tempest-TaggedBootDevicesTest_v242-1289726527-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T11:41:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be158f2bab204b3f874727a655b4bbd6',uuid=b8e1def1-8303-4257-b9b5-0050f05cf2d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d85896ce-110a-41d6-a20e-6beaecb36b97", "address": "fa:16:3e:e3:51:d1", "network": {"id": "8244e7f5-12cf-4ab5-baa2-956f148fc51f", "bridge": "br-int", "label": "tempest-device-tagging-net2-163620727", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "60c18371fa6246888a742164afd60242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd85896ce-11", "ovs_interfaceid": "d85896ce-110a-41d6-a20e-6beaecb36b97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 11:42:16 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Converting VIF {"id": "d85896ce-110a-41d6-a20e-6beaecb36b97", "address": "fa:16:3e:e3:51:d1", "network": {"id": "8244e7f5-12cf-4ab5-baa2-956f148fc51f", "bridge": "br-int", "label": "tempest-device-tagging-net2-163620727", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "60c18371fa6246888a742164afd60242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd85896ce-11", "ovs_interfaceid": "d85896ce-110a-41d6-a20e-6beaecb36b97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:42:16 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:51:d1,bridge_name='br-int',has_traffic_filtering=True,id=d85896ce-110a-41d6-a20e-6beaecb36b97,network=Network(8244e7f5-12cf-4ab5-baa2-956f148fc51f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd85896ce-11') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:42:16 user nova-compute[73449]: DEBUG os_vif [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:51:d1,bridge_name='br-int',has_traffic_filtering=True,id=d85896ce-110a-41d6-a20e-6beaecb36b97,network=Network(8244e7f5-12cf-4ab5-baa2-956f148fc51f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd85896ce-11') {{(pid=73449) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 11:42:16 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:16 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:42:16 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 11:42:16 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:16 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd85896ce-11, may_exist=True, interface_attrs={}) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:42:16 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd85896ce-11, col_values=(('external_ids', {'iface-id': 'd85896ce-110a-41d6-a20e-6beaecb36b97', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e3:51:d1', 'vm-uuid': 'b8e1def1-8303-4257-b9b5-0050f05cf2d0'}),), if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:42:16 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:42:16 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:16 user nova-compute[73449]: INFO os_vif [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:51:d1,bridge_name='br-int',has_traffic_filtering=True,id=d85896ce-110a-41d6-a20e-6beaecb36b97,network=Network(8244e7f5-12cf-4ab5-baa2-956f148fc51f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd85896ce-11')
Aug 17 11:42:16 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T11:41:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-375365820',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-375365820',id=8,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHuba1mc2rOtc1T9WyI8UwVbFUk1snTGZJbkskNqT1zruYVVlxdFqERjQoYnu+0Qwd0eX0YLAQOOpgDiCdfkrFXcxYrXXtDiLKU4WfeVli9xGspdS972Ve+XMTjbUEI+Ww==',key_name='tempest-keypair-1629878963',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='60c18371fa6246888a742164afd60242',ramdisk_id='',reservation_id='r-2n30xjvl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1289726527',owner_user_name='tempest-TaggedBootDevicesTest_v242-1289726527-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T11:41:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be158f2bab204b3f874727a655b4bbd6',uuid=b8e1def1-8303-4257-b9b5-0050f05cf2d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "671f57db-57f1-4ba3-9e49-ebe4816404f6", "address": "fa:16:3e:04:1d:3e", "network": {"id": "8244e7f5-12cf-4ab5-baa2-956f148fc51f", "bridge": "br-int", "label": "tempest-device-tagging-net2-163620727", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "60c18371fa6246888a742164afd60242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap671f57db-57", "ovs_interfaceid": "671f57db-57f1-4ba3-9e49-ebe4816404f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 11:42:16 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Converting VIF {"id": "671f57db-57f1-4ba3-9e49-ebe4816404f6", "address": "fa:16:3e:04:1d:3e", "network": {"id": "8244e7f5-12cf-4ab5-baa2-956f148fc51f", "bridge": "br-int", "label": "tempest-device-tagging-net2-163620727", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "60c18371fa6246888a742164afd60242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap671f57db-57", "ovs_interfaceid": "671f57db-57f1-4ba3-9e49-ebe4816404f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:42:16 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:1d:3e,bridge_name='br-int',has_traffic_filtering=True,id=671f57db-57f1-4ba3-9e49-ebe4816404f6,network=Network(8244e7f5-12cf-4ab5-baa2-956f148fc51f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap671f57db-57') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:42:16 user nova-compute[73449]: DEBUG os_vif [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:1d:3e,bridge_name='br-int',has_traffic_filtering=True,id=671f57db-57f1-4ba3-9e49-ebe4816404f6,network=Network(8244e7f5-12cf-4ab5-baa2-956f148fc51f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap671f57db-57') {{(pid=73449) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 11:42:16 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:16 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:42:16 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 11:42:16 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:16 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap671f57db-57, may_exist=True, interface_attrs={}) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:42:16 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap671f57db-57, col_values=(('external_ids', {'iface-id': '671f57db-57f1-4ba3-9e49-ebe4816404f6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:04:1d:3e', 'vm-uuid': 'b8e1def1-8303-4257-b9b5-0050f05cf2d0'}),), if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:42:16 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:16 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:42:16 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:16 user nova-compute[73449]: INFO os_vif [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:1d:3e,bridge_name='br-int',has_traffic_filtering=True,id=671f57db-57f1-4ba3-9e49-ebe4816404f6,network=Network(8244e7f5-12cf-4ab5-baa2-956f148fc51f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap671f57db-57')
Aug 17 11:42:16 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:16 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] No BDM found with device name hda, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 11:42:16 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 11:42:16 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] No VIF found with MAC fa:16:3e:0d:7d:90, not building metadata {{(pid=73449) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 11:42:16 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] No VIF found with MAC fa:16:3e:6e:07:1b, not building metadata {{(pid=73449) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 11:42:16 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Using config drive
Aug 17 11:42:16 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:16 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:16 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Creating config drive at /opt/stack/data/nova/instances/b8e1def1-8303-4257-b9b5-0050f05cf2d0/disk.config
Aug 17 11:42:16 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/b8e1def1-8303-4257-b9b5-0050f05cf2d0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpusmrznst {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:16 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/b8e1def1-8303-4257-b9b5-0050f05cf2d0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpusmrznst" returned: 0 in 0.059s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:16 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:16 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:17 user nova-compute[73449]: DEBUG nova.compute.manager [req-bb966db8-eb6e-4182-bcf2-c2350d87ef8b req-3bac4e58-c834-4d99-87f7-b2581a0924cd service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Received event network-vif-plugged-d2d51361-0f1a-41aa-89e2-c2211bbd0b42 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:42:17 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-bb966db8-eb6e-4182-bcf2-c2350d87ef8b req-3bac4e58-c834-4d99-87f7-b2581a0924cd service nova] Acquiring lock "f33a7013-82d0-477c-aa5e-b27e63f2b98d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:42:17 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-bb966db8-eb6e-4182-bcf2-c2350d87ef8b req-3bac4e58-c834-4d99-87f7-b2581a0924cd service nova] Lock "f33a7013-82d0-477c-aa5e-b27e63f2b98d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:42:17 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-bb966db8-eb6e-4182-bcf2-c2350d87ef8b req-3bac4e58-c834-4d99-87f7-b2581a0924cd service nova] Lock "f33a7013-82d0-477c-aa5e-b27e63f2b98d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:42:17 user nova-compute[73449]: DEBUG nova.compute.manager [req-bb966db8-eb6e-4182-bcf2-c2350d87ef8b req-3bac4e58-c834-4d99-87f7-b2581a0924cd service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] No waiting events found dispatching network-vif-plugged-d2d51361-0f1a-41aa-89e2-c2211bbd0b42 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:42:17 user nova-compute[73449]: WARNING nova.compute.manager [req-bb966db8-eb6e-4182-bcf2-c2350d87ef8b req-3bac4e58-c834-4d99-87f7-b2581a0924cd service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Received unexpected event network-vif-plugged-d2d51361-0f1a-41aa-89e2-c2211bbd0b42 for instance with vm_state building and task_state spawning.
Aug 17 11:42:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:17 user nova-compute[73449]: DEBUG nova.compute.manager [req-74d75cbc-dd6d-43b8-b281-72991673a463 req-ff6d14fa-12ad-44d1-81af-6a50061f2e76 service nova] [instance: fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2] Received event network-changed-850d3d8f-2b5b-4e82-9c33-83f440f2a428 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:42:17 user nova-compute[73449]: DEBUG nova.compute.manager [req-74d75cbc-dd6d-43b8-b281-72991673a463 req-ff6d14fa-12ad-44d1-81af-6a50061f2e76 service nova] [instance: fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2] Refreshing instance network info cache due to event network-changed-850d3d8f-2b5b-4e82-9c33-83f440f2a428. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 11:42:17 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-74d75cbc-dd6d-43b8-b281-72991673a463 req-ff6d14fa-12ad-44d1-81af-6a50061f2e76 service nova] Acquiring lock "refresh_cache-fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:42:17 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-74d75cbc-dd6d-43b8-b281-72991673a463 req-ff6d14fa-12ad-44d1-81af-6a50061f2e76 service nova] Acquired lock "refresh_cache-fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:42:17 user nova-compute[73449]: DEBUG nova.network.neutron [req-74d75cbc-dd6d-43b8-b281-72991673a463 req-ff6d14fa-12ad-44d1-81af-6a50061f2e76 service nova] [instance: fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2] Refreshing network info cache for port 850d3d8f-2b5b-4e82-9c33-83f440f2a428 {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 11:42:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:18 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:18 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:18 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:18 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:18 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:18 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:19 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:19 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:19 user nova-compute[73449]: DEBUG nova.compute.manager [req-3ee0e296-6c08-487a-895b-04f447903fba req-d30e662f-870d-44f5-8be5-c9140ce8b941 service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Received event network-vif-plugged-d2d51361-0f1a-41aa-89e2-c2211bbd0b42 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:42:19 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-3ee0e296-6c08-487a-895b-04f447903fba req-d30e662f-870d-44f5-8be5-c9140ce8b941 service nova] Acquiring lock "f33a7013-82d0-477c-aa5e-b27e63f2b98d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:42:19 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-3ee0e296-6c08-487a-895b-04f447903fba req-d30e662f-870d-44f5-8be5-c9140ce8b941 service nova] Lock "f33a7013-82d0-477c-aa5e-b27e63f2b98d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:42:19 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-3ee0e296-6c08-487a-895b-04f447903fba req-d30e662f-870d-44f5-8be5-c9140ce8b941 service nova] Lock "f33a7013-82d0-477c-aa5e-b27e63f2b98d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:42:19 user nova-compute[73449]: DEBUG nova.compute.manager [req-3ee0e296-6c08-487a-895b-04f447903fba req-d30e662f-870d-44f5-8be5-c9140ce8b941 service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] No waiting events found dispatching network-vif-plugged-d2d51361-0f1a-41aa-89e2-c2211bbd0b42 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:42:19 user nova-compute[73449]: WARNING nova.compute.manager [req-3ee0e296-6c08-487a-895b-04f447903fba req-d30e662f-870d-44f5-8be5-c9140ce8b941 service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Received unexpected event network-vif-plugged-d2d51361-0f1a-41aa-89e2-c2211bbd0b42 for instance with vm_state building and task_state spawning.
Aug 17 11:42:19 user nova-compute[73449]: DEBUG nova.compute.manager [req-3ee0e296-6c08-487a-895b-04f447903fba req-d30e662f-870d-44f5-8be5-c9140ce8b941 service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Received event network-vif-plugged-b14f4f1d-d140-4bb9-a4f2-abbaa8c98a2d {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:42:19 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-3ee0e296-6c08-487a-895b-04f447903fba req-d30e662f-870d-44f5-8be5-c9140ce8b941 service nova] Acquiring lock "f33a7013-82d0-477c-aa5e-b27e63f2b98d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:42:19 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-3ee0e296-6c08-487a-895b-04f447903fba req-d30e662f-870d-44f5-8be5-c9140ce8b941 service nova] Lock "f33a7013-82d0-477c-aa5e-b27e63f2b98d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:42:19 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-3ee0e296-6c08-487a-895b-04f447903fba req-d30e662f-870d-44f5-8be5-c9140ce8b941 service nova] Lock "f33a7013-82d0-477c-aa5e-b27e63f2b98d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:42:19 user nova-compute[73449]: DEBUG nova.compute.manager [req-3ee0e296-6c08-487a-895b-04f447903fba req-d30e662f-870d-44f5-8be5-c9140ce8b941 service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] No waiting events found dispatching network-vif-plugged-b14f4f1d-d140-4bb9-a4f2-abbaa8c98a2d {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:42:19 user nova-compute[73449]: WARNING nova.compute.manager [req-3ee0e296-6c08-487a-895b-04f447903fba req-d30e662f-870d-44f5-8be5-c9140ce8b941 service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Received unexpected event network-vif-plugged-b14f4f1d-d140-4bb9-a4f2-abbaa8c98a2d for instance with vm_state building and task_state spawning.
Aug 17 11:42:19 user nova-compute[73449]: DEBUG nova.compute.manager [req-3ee0e296-6c08-487a-895b-04f447903fba req-d30e662f-870d-44f5-8be5-c9140ce8b941 service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Received event network-vif-plugged-b14f4f1d-d140-4bb9-a4f2-abbaa8c98a2d {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:42:19 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-3ee0e296-6c08-487a-895b-04f447903fba req-d30e662f-870d-44f5-8be5-c9140ce8b941 service nova] Acquiring lock "f33a7013-82d0-477c-aa5e-b27e63f2b98d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:42:19 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-3ee0e296-6c08-487a-895b-04f447903fba req-d30e662f-870d-44f5-8be5-c9140ce8b941 service nova] Lock "f33a7013-82d0-477c-aa5e-b27e63f2b98d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:42:19 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-3ee0e296-6c08-487a-895b-04f447903fba req-d30e662f-870d-44f5-8be5-c9140ce8b941 service nova] Lock "f33a7013-82d0-477c-aa5e-b27e63f2b98d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:42:19 user nova-compute[73449]: DEBUG nova.compute.manager [req-3ee0e296-6c08-487a-895b-04f447903fba req-d30e662f-870d-44f5-8be5-c9140ce8b941 service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] No waiting events found dispatching network-vif-plugged-b14f4f1d-d140-4bb9-a4f2-abbaa8c98a2d {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:42:19 user nova-compute[73449]: WARNING nova.compute.manager [req-3ee0e296-6c08-487a-895b-04f447903fba req-d30e662f-870d-44f5-8be5-c9140ce8b941 service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Received unexpected event network-vif-plugged-b14f4f1d-d140-4bb9-a4f2-abbaa8c98a2d for instance with vm_state building and task_state spawning.
Aug 17 11:42:19 user nova-compute[73449]: DEBUG nova.compute.manager [req-3ee0e296-6c08-487a-895b-04f447903fba req-d30e662f-870d-44f5-8be5-c9140ce8b941 service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Received event network-vif-plugged-d8233c69-cc4f-4ae8-93ee-7f41234f72ec {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:42:19 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-3ee0e296-6c08-487a-895b-04f447903fba req-d30e662f-870d-44f5-8be5-c9140ce8b941 service nova] Acquiring lock "f33a7013-82d0-477c-aa5e-b27e63f2b98d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:42:19 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-3ee0e296-6c08-487a-895b-04f447903fba req-d30e662f-870d-44f5-8be5-c9140ce8b941 service nova] Lock "f33a7013-82d0-477c-aa5e-b27e63f2b98d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:42:19 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-3ee0e296-6c08-487a-895b-04f447903fba req-d30e662f-870d-44f5-8be5-c9140ce8b941 service nova] Lock "f33a7013-82d0-477c-aa5e-b27e63f2b98d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:42:19 user nova-compute[73449]: DEBUG nova.compute.manager [req-3ee0e296-6c08-487a-895b-04f447903fba req-d30e662f-870d-44f5-8be5-c9140ce8b941 service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] No waiting events found dispatching network-vif-plugged-d8233c69-cc4f-4ae8-93ee-7f41234f72ec {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:42:19 user nova-compute[73449]: WARNING nova.compute.manager [req-3ee0e296-6c08-487a-895b-04f447903fba req-d30e662f-870d-44f5-8be5-c9140ce8b941 service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Received unexpected event network-vif-plugged-d8233c69-cc4f-4ae8-93ee-7f41234f72ec for instance with vm_state building and task_state spawning.
Aug 17 11:42:19 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:19 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:19 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:19 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:19 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:19 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:19 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:19 user nova-compute[73449]: DEBUG nova.network.neutron [req-74d75cbc-dd6d-43b8-b281-72991673a463 req-ff6d14fa-12ad-44d1-81af-6a50061f2e76 service nova] [instance: fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2] Updated VIF entry in instance network info cache for port 850d3d8f-2b5b-4e82-9c33-83f440f2a428. {{(pid=73449) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 11:42:19 user nova-compute[73449]: DEBUG nova.network.neutron [req-74d75cbc-dd6d-43b8-b281-72991673a463 req-ff6d14fa-12ad-44d1-81af-6a50061f2e76 service nova] [instance: fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2] Updating instance_info_cache with network_info: [{"id": "850d3d8f-2b5b-4e82-9c33-83f440f2a428", "address": "fa:16:3e:de:a4:f4", "network": {"id": "ef0c44c4-ef68-433d-bfbc-71272ed64948", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-24887935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2513ad48149f45e2a2bd4b404ebc13b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap850d3d8f-2b", "ovs_interfaceid": "850d3d8f-2b5b-4e82-9c33-83f440f2a428", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:42:19 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-74d75cbc-dd6d-43b8-b281-72991673a463 req-ff6d14fa-12ad-44d1-81af-6a50061f2e76 service nova] Releasing lock "refresh_cache-fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:42:20 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:20 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:20 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:20 user nova-compute[73449]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692272525.1792328, a40e1f85-a7e6-46da-8f98-df7a278aaade => Stopped> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:42:20 user nova-compute[73449]: INFO nova.compute.manager [-] [instance: a40e1f85-a7e6-46da-8f98-df7a278aaade] VM Stopped (Lifecycle Event)
Aug 17 11:42:20 user nova-compute[73449]: DEBUG nova.compute.manager [None req-4bcaf542-1823-4538-a3e3-02ddb01b0a82 None None] [instance: a40e1f85-a7e6-46da-8f98-df7a278aaade] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:42:20 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:20 user nova-compute[73449]: DEBUG nova.compute.manager [req-377ecedb-2ebd-4638-aef4-0f1a8810f710 req-0b0b0ac9-3548-4bd5-892d-72029be701a9 service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Received event network-vif-plugged-71d82cc1-6895-4d52-b066-0a01a61b329b {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:42:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-377ecedb-2ebd-4638-aef4-0f1a8810f710 req-0b0b0ac9-3548-4bd5-892d-72029be701a9 service nova] Acquiring lock "b8e1def1-8303-4257-b9b5-0050f05cf2d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:42:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-377ecedb-2ebd-4638-aef4-0f1a8810f710 req-0b0b0ac9-3548-4bd5-892d-72029be701a9 service nova] Lock "b8e1def1-8303-4257-b9b5-0050f05cf2d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:42:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-377ecedb-2ebd-4638-aef4-0f1a8810f710 req-0b0b0ac9-3548-4bd5-892d-72029be701a9 service nova] Lock "b8e1def1-8303-4257-b9b5-0050f05cf2d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:42:20 user nova-compute[73449]: DEBUG nova.compute.manager [req-377ecedb-2ebd-4638-aef4-0f1a8810f710 req-0b0b0ac9-3548-4bd5-892d-72029be701a9 service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] No waiting events found dispatching network-vif-plugged-71d82cc1-6895-4d52-b066-0a01a61b329b {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:42:20 user nova-compute[73449]: WARNING nova.compute.manager [req-377ecedb-2ebd-4638-aef4-0f1a8810f710 req-0b0b0ac9-3548-4bd5-892d-72029be701a9 service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Received unexpected event network-vif-plugged-71d82cc1-6895-4d52-b066-0a01a61b329b for instance with vm_state building and task_state spawning.
Aug 17 11:42:20 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:20 user nova-compute[73449]: DEBUG nova.compute.manager [req-af70292c-1d2d-4664-8a1a-acd642cdd42d req-74a86232-27b2-4931-828f-d494dbc14498 service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Received event network-vif-plugged-854609a6-03f0-416c-8bbf-b5f85d13c688 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:42:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-af70292c-1d2d-4664-8a1a-acd642cdd42d req-74a86232-27b2-4931-828f-d494dbc14498 service nova] Acquiring lock "f33a7013-82d0-477c-aa5e-b27e63f2b98d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:42:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-af70292c-1d2d-4664-8a1a-acd642cdd42d req-74a86232-27b2-4931-828f-d494dbc14498 service nova] Lock "f33a7013-82d0-477c-aa5e-b27e63f2b98d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:42:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-af70292c-1d2d-4664-8a1a-acd642cdd42d req-74a86232-27b2-4931-828f-d494dbc14498 service nova] Lock "f33a7013-82d0-477c-aa5e-b27e63f2b98d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:42:20 user nova-compute[73449]: DEBUG nova.compute.manager [req-af70292c-1d2d-4664-8a1a-acd642cdd42d req-74a86232-27b2-4931-828f-d494dbc14498 service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] No waiting events found dispatching network-vif-plugged-854609a6-03f0-416c-8bbf-b5f85d13c688 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:42:20 user nova-compute[73449]: WARNING nova.compute.manager [req-af70292c-1d2d-4664-8a1a-acd642cdd42d req-74a86232-27b2-4931-828f-d494dbc14498 service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Received unexpected event network-vif-plugged-854609a6-03f0-416c-8bbf-b5f85d13c688 for instance with vm_state building and task_state spawning.
Aug 17 11:42:20 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:20 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:21 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:21 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:21 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:21 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:21 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:21 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:21 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:21 user nova-compute[73449]: DEBUG nova.compute.manager [req-3a170b66-b6c4-4507-8622-758aba855907 req-8edf03f7-78b5-4884-97b4-b436ed5c212b service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Received event network-vif-plugged-d8233c69-cc4f-4ae8-93ee-7f41234f72ec {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:42:21 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-3a170b66-b6c4-4507-8622-758aba855907 req-8edf03f7-78b5-4884-97b4-b436ed5c212b service nova] Acquiring lock "f33a7013-82d0-477c-aa5e-b27e63f2b98d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:42:21 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-3a170b66-b6c4-4507-8622-758aba855907 req-8edf03f7-78b5-4884-97b4-b436ed5c212b service nova] Lock "f33a7013-82d0-477c-aa5e-b27e63f2b98d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:42:21 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-3a170b66-b6c4-4507-8622-758aba855907 req-8edf03f7-78b5-4884-97b4-b436ed5c212b service nova] Lock "f33a7013-82d0-477c-aa5e-b27e63f2b98d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:42:21 user nova-compute[73449]: DEBUG nova.compute.manager [req-3a170b66-b6c4-4507-8622-758aba855907 req-8edf03f7-78b5-4884-97b4-b436ed5c212b service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] No waiting events found dispatching network-vif-plugged-d8233c69-cc4f-4ae8-93ee-7f41234f72ec {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:42:21 user nova-compute[73449]: WARNING nova.compute.manager [req-3a170b66-b6c4-4507-8622-758aba855907 req-8edf03f7-78b5-4884-97b4-b436ed5c212b service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Received unexpected event network-vif-plugged-d8233c69-cc4f-4ae8-93ee-7f41234f72ec for instance with vm_state building and task_state spawning.
Aug 17 11:42:21 user nova-compute[73449]: DEBUG nova.compute.manager [req-3a170b66-b6c4-4507-8622-758aba855907 req-8edf03f7-78b5-4884-97b4-b436ed5c212b service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Received event network-vif-plugged-6fbc9ad6-da42-4492-8603-9efc7294dbab {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:42:21 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-3a170b66-b6c4-4507-8622-758aba855907 req-8edf03f7-78b5-4884-97b4-b436ed5c212b service nova] Acquiring lock "f33a7013-82d0-477c-aa5e-b27e63f2b98d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:42:21 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-3a170b66-b6c4-4507-8622-758aba855907 req-8edf03f7-78b5-4884-97b4-b436ed5c212b service nova] Lock "f33a7013-82d0-477c-aa5e-b27e63f2b98d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:42:21 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-3a170b66-b6c4-4507-8622-758aba855907 req-8edf03f7-78b5-4884-97b4-b436ed5c212b service nova] Lock "f33a7013-82d0-477c-aa5e-b27e63f2b98d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:42:21 user nova-compute[73449]: DEBUG nova.compute.manager [req-3a170b66-b6c4-4507-8622-758aba855907 req-8edf03f7-78b5-4884-97b4-b436ed5c212b service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] No waiting events found dispatching network-vif-plugged-6fbc9ad6-da42-4492-8603-9efc7294dbab {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:42:21 user nova-compute[73449]: WARNING nova.compute.manager [req-3a170b66-b6c4-4507-8622-758aba855907 req-8edf03f7-78b5-4884-97b4-b436ed5c212b service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Received unexpected event network-vif-plugged-6fbc9ad6-da42-4492-8603-9efc7294dbab for instance with vm_state building and task_state spawning.
Aug 17 11:42:21 user nova-compute[73449]: DEBUG nova.compute.manager [req-3a170b66-b6c4-4507-8622-758aba855907 req-8edf03f7-78b5-4884-97b4-b436ed5c212b service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Received event network-vif-plugged-6fbc9ad6-da42-4492-8603-9efc7294dbab {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:42:21 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-3a170b66-b6c4-4507-8622-758aba855907 req-8edf03f7-78b5-4884-97b4-b436ed5c212b service nova] Acquiring lock "f33a7013-82d0-477c-aa5e-b27e63f2b98d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:42:21 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-3a170b66-b6c4-4507-8622-758aba855907 req-8edf03f7-78b5-4884-97b4-b436ed5c212b service nova] Lock "f33a7013-82d0-477c-aa5e-b27e63f2b98d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:42:21 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-3a170b66-b6c4-4507-8622-758aba855907 req-8edf03f7-78b5-4884-97b4-b436ed5c212b service nova] Lock "f33a7013-82d0-477c-aa5e-b27e63f2b98d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:42:21 user nova-compute[73449]: DEBUG nova.compute.manager [req-3a170b66-b6c4-4507-8622-758aba855907 req-8edf03f7-78b5-4884-97b4-b436ed5c212b service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] No waiting events found dispatching network-vif-plugged-6fbc9ad6-da42-4492-8603-9efc7294dbab {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:42:21 user nova-compute[73449]: WARNING nova.compute.manager [req-3a170b66-b6c4-4507-8622-758aba855907 req-8edf03f7-78b5-4884-97b4-b436ed5c212b service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Received unexpected event network-vif-plugged-6fbc9ad6-da42-4492-8603-9efc7294dbab for instance with vm_state building and task_state spawning.
Aug 17 11:42:21 user nova-compute[73449]: DEBUG nova.compute.manager [req-3a170b66-b6c4-4507-8622-758aba855907 req-8edf03f7-78b5-4884-97b4-b436ed5c212b service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Received event network-vif-plugged-c877b9e9-f45c-4199-960c-2b9926518803 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:42:21 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-3a170b66-b6c4-4507-8622-758aba855907 req-8edf03f7-78b5-4884-97b4-b436ed5c212b service nova] Acquiring lock "b8e1def1-8303-4257-b9b5-0050f05cf2d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:42:21 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-3a170b66-b6c4-4507-8622-758aba855907 req-8edf03f7-78b5-4884-97b4-b436ed5c212b service nova] Lock "b8e1def1-8303-4257-b9b5-0050f05cf2d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:42:21 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-3a170b66-b6c4-4507-8622-758aba855907 req-8edf03f7-78b5-4884-97b4-b436ed5c212b service nova] Lock "b8e1def1-8303-4257-b9b5-0050f05cf2d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:42:21 user nova-compute[73449]: DEBUG nova.compute.manager [req-3a170b66-b6c4-4507-8622-758aba855907 req-8edf03f7-78b5-4884-97b4-b436ed5c212b service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] No waiting events found dispatching network-vif-plugged-c877b9e9-f45c-4199-960c-2b9926518803 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:42:21 user nova-compute[73449]: WARNING nova.compute.manager [req-3a170b66-b6c4-4507-8622-758aba855907 req-8edf03f7-78b5-4884-97b4-b436ed5c212b service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Received unexpected event network-vif-plugged-c877b9e9-f45c-4199-960c-2b9926518803 for instance with vm_state building and task_state spawning.
Aug 17 11:42:21 user nova-compute[73449]: DEBUG nova.compute.manager [req-3a170b66-b6c4-4507-8622-758aba855907 req-8edf03f7-78b5-4884-97b4-b436ed5c212b service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Received event network-vif-plugged-c877b9e9-f45c-4199-960c-2b9926518803 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:42:21 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-3a170b66-b6c4-4507-8622-758aba855907 req-8edf03f7-78b5-4884-97b4-b436ed5c212b service nova] Acquiring lock "b8e1def1-8303-4257-b9b5-0050f05cf2d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:42:21 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-3a170b66-b6c4-4507-8622-758aba855907 req-8edf03f7-78b5-4884-97b4-b436ed5c212b service nova] Lock "b8e1def1-8303-4257-b9b5-0050f05cf2d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:42:21 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-3a170b66-b6c4-4507-8622-758aba855907 req-8edf03f7-78b5-4884-97b4-b436ed5c212b service nova] Lock "b8e1def1-8303-4257-b9b5-0050f05cf2d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:42:21 user nova-compute[73449]: DEBUG nova.compute.manager [req-3a170b66-b6c4-4507-8622-758aba855907 req-8edf03f7-78b5-4884-97b4-b436ed5c212b service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] No waiting events found dispatching network-vif-plugged-c877b9e9-f45c-4199-960c-2b9926518803 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:42:21 user nova-compute[73449]: WARNING nova.compute.manager [req-3a170b66-b6c4-4507-8622-758aba855907 req-8edf03f7-78b5-4884-97b4-b436ed5c212b service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Received unexpected event network-vif-plugged-c877b9e9-f45c-4199-960c-2b9926518803 for instance with vm_state building and task_state spawning.
Aug 17 11:42:21 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:21 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:21 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:21 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:21 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:21 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:21 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:22 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-7234e92c-5c6d-4e33-a372-2aef3bc73d16 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Acquiring lock "interface-7d3e07fa-4823-48e9-a959-e7bac0e0b25b-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:42:22 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-7234e92c-5c6d-4e33-a372-2aef3bc73d16 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Lock "interface-7d3e07fa-4823-48e9-a959-e7bac0e0b25b-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:42:22 user nova-compute[73449]: DEBUG nova.objects.instance [None req-7234e92c-5c6d-4e33-a372-2aef3bc73d16 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Lazy-loading 'flavor' on Instance uuid 7d3e07fa-4823-48e9-a959-e7bac0e0b25b {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:42:22 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:22 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:22 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:22 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:22 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:22 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:22 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:22 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:22 user nova-compute[73449]: DEBUG nova.compute.manager [req-93db74c1-04b3-41d6-95f4-30e8827e2129 req-66804a09-52b1-4d94-aae9-8a629ba53e26 service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Received event network-vif-plugged-71d82cc1-6895-4d52-b066-0a01a61b329b {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:42:22 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-93db74c1-04b3-41d6-95f4-30e8827e2129 req-66804a09-52b1-4d94-aae9-8a629ba53e26 service nova] Acquiring lock "b8e1def1-8303-4257-b9b5-0050f05cf2d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:42:22 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-93db74c1-04b3-41d6-95f4-30e8827e2129 req-66804a09-52b1-4d94-aae9-8a629ba53e26 service nova] Lock "b8e1def1-8303-4257-b9b5-0050f05cf2d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:42:22 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-93db74c1-04b3-41d6-95f4-30e8827e2129 req-66804a09-52b1-4d94-aae9-8a629ba53e26 service nova] Lock "b8e1def1-8303-4257-b9b5-0050f05cf2d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:42:22 user nova-compute[73449]: DEBUG nova.compute.manager [req-93db74c1-04b3-41d6-95f4-30e8827e2129 req-66804a09-52b1-4d94-aae9-8a629ba53e26 service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] No waiting events found dispatching network-vif-plugged-71d82cc1-6895-4d52-b066-0a01a61b329b {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:42:22 user nova-compute[73449]: WARNING nova.compute.manager [req-93db74c1-04b3-41d6-95f4-30e8827e2129 req-66804a09-52b1-4d94-aae9-8a629ba53e26 service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Received unexpected event network-vif-plugged-71d82cc1-6895-4d52-b066-0a01a61b329b for instance with vm_state building and task_state spawning.
Aug 17 11:42:22 user nova-compute[73449]: DEBUG nova.compute.manager [req-93db74c1-04b3-41d6-95f4-30e8827e2129 req-66804a09-52b1-4d94-aae9-8a629ba53e26 service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Received event network-vif-plugged-b3fe8f9e-5b75-440e-b1c1-f888a4e91e9e {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:42:22 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-93db74c1-04b3-41d6-95f4-30e8827e2129 req-66804a09-52b1-4d94-aae9-8a629ba53e26 service nova] Acquiring lock "b8e1def1-8303-4257-b9b5-0050f05cf2d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:42:22 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-93db74c1-04b3-41d6-95f4-30e8827e2129 req-66804a09-52b1-4d94-aae9-8a629ba53e26 service nova] Lock "b8e1def1-8303-4257-b9b5-0050f05cf2d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:42:22 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-93db74c1-04b3-41d6-95f4-30e8827e2129 req-66804a09-52b1-4d94-aae9-8a629ba53e26 service nova] Lock "b8e1def1-8303-4257-b9b5-0050f05cf2d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:42:22 user nova-compute[73449]: DEBUG nova.compute.manager [req-93db74c1-04b3-41d6-95f4-30e8827e2129 req-66804a09-52b1-4d94-aae9-8a629ba53e26 service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] No waiting events found dispatching network-vif-plugged-b3fe8f9e-5b75-440e-b1c1-f888a4e91e9e {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:42:22 user nova-compute[73449]: WARNING nova.compute.manager [req-93db74c1-04b3-41d6-95f4-30e8827e2129 req-66804a09-52b1-4d94-aae9-8a629ba53e26 service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Received unexpected event network-vif-plugged-b3fe8f9e-5b75-440e-b1c1-f888a4e91e9e for instance with vm_state building and task_state spawning.
Aug 17 11:42:22 user nova-compute[73449]: DEBUG nova.compute.manager [req-93db74c1-04b3-41d6-95f4-30e8827e2129 req-66804a09-52b1-4d94-aae9-8a629ba53e26 service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Received event network-vif-plugged-b3fe8f9e-5b75-440e-b1c1-f888a4e91e9e {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:42:22 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-93db74c1-04b3-41d6-95f4-30e8827e2129 req-66804a09-52b1-4d94-aae9-8a629ba53e26 service nova] Acquiring lock "b8e1def1-8303-4257-b9b5-0050f05cf2d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:42:22 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-93db74c1-04b3-41d6-95f4-30e8827e2129 req-66804a09-52b1-4d94-aae9-8a629ba53e26 service nova] Lock "b8e1def1-8303-4257-b9b5-0050f05cf2d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:42:22 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-93db74c1-04b3-41d6-95f4-30e8827e2129 req-66804a09-52b1-4d94-aae9-8a629ba53e26 service nova] Lock "b8e1def1-8303-4257-b9b5-0050f05cf2d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:42:22 user nova-compute[73449]: DEBUG nova.compute.manager [req-93db74c1-04b3-41d6-95f4-30e8827e2129 req-66804a09-52b1-4d94-aae9-8a629ba53e26 service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] No waiting events found dispatching network-vif-plugged-b3fe8f9e-5b75-440e-b1c1-f888a4e91e9e {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:42:22 user nova-compute[73449]: WARNING nova.compute.manager [req-93db74c1-04b3-41d6-95f4-30e8827e2129 req-66804a09-52b1-4d94-aae9-8a629ba53e26 service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Received unexpected event network-vif-plugged-b3fe8f9e-5b75-440e-b1c1-f888a4e91e9e for instance with vm_state building and task_state spawning.
Aug 17 11:42:22 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:22 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:22 user nova-compute[73449]: DEBUG nova.compute.manager [req-70f6ac2a-759f-42cb-8610-f8309b186425 req-557dd95a-0462-4dc3-aa45-f946f060af4c service nova] [instance: 7d3e07fa-4823-48e9-a959-e7bac0e0b25b] Received event network-changed-60dadb1a-7680-434e-975f-8ef1ec1b4088 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:42:22 user nova-compute[73449]: DEBUG nova.compute.manager [req-70f6ac2a-759f-42cb-8610-f8309b186425 req-557dd95a-0462-4dc3-aa45-f946f060af4c service nova] [instance: 7d3e07fa-4823-48e9-a959-e7bac0e0b25b] Refreshing instance network info cache due to event network-changed-60dadb1a-7680-434e-975f-8ef1ec1b4088. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 11:42:22 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-70f6ac2a-759f-42cb-8610-f8309b186425 req-557dd95a-0462-4dc3-aa45-f946f060af4c service nova] Acquiring lock "refresh_cache-7d3e07fa-4823-48e9-a959-e7bac0e0b25b" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:42:22 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-70f6ac2a-759f-42cb-8610-f8309b186425 req-557dd95a-0462-4dc3-aa45-f946f060af4c service nova] Acquired lock "refresh_cache-7d3e07fa-4823-48e9-a959-e7bac0e0b25b" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:42:22 user nova-compute[73449]: DEBUG nova.network.neutron [req-70f6ac2a-759f-42cb-8610-f8309b186425 req-557dd95a-0462-4dc3-aa45-f946f060af4c service nova] [instance: 7d3e07fa-4823-48e9-a959-e7bac0e0b25b] Refreshing network info cache for port 60dadb1a-7680-434e-975f-8ef1ec1b4088 {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 11:42:22 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:22 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:22 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:22 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:22 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:23 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:23 user nova-compute[73449]: DEBUG nova.objects.instance [None req-7234e92c-5c6d-4e33-a372-2aef3bc73d16 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Lazy-loading 'pci_requests' on Instance uuid 7d3e07fa-4823-48e9-a959-e7bac0e0b25b {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:42:23 user nova-compute[73449]: DEBUG nova.network.neutron [None req-7234e92c-5c6d-4e33-a372-2aef3bc73d16 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] [instance: 7d3e07fa-4823-48e9-a959-e7bac0e0b25b] allocate_for_instance() {{(pid=73449) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 11:42:23 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:23 user nova-compute[73449]: DEBUG nova.policy [None req-7234e92c-5c6d-4e33-a372-2aef3bc73d16 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9df670f3f7da4815bdcb9915a4999380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c75ffb297b94222a4502db0e0814538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73449) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 11:42:23 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:23 user nova-compute[73449]: DEBUG nova.compute.manager [req-47b5cfc6-a4a6-42db-8c46-4ab195326925 req-1baec1b5-4143-4b7a-a52b-c82c91ce391b service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Received event network-vif-plugged-f9c9fca3-8f9c-4ea9-8ceb-ed19cb265786 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:42:23 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-47b5cfc6-a4a6-42db-8c46-4ab195326925 req-1baec1b5-4143-4b7a-a52b-c82c91ce391b service nova] Acquiring lock "b8e1def1-8303-4257-b9b5-0050f05cf2d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:42:23 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-47b5cfc6-a4a6-42db-8c46-4ab195326925 req-1baec1b5-4143-4b7a-a52b-c82c91ce391b service nova] Lock "b8e1def1-8303-4257-b9b5-0050f05cf2d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:42:23 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-47b5cfc6-a4a6-42db-8c46-4ab195326925 req-1baec1b5-4143-4b7a-a52b-c82c91ce391b service nova] Lock "b8e1def1-8303-4257-b9b5-0050f05cf2d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:42:23 user nova-compute[73449]: DEBUG nova.compute.manager [req-47b5cfc6-a4a6-42db-8c46-4ab195326925 req-1baec1b5-4143-4b7a-a52b-c82c91ce391b service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] No waiting events found dispatching network-vif-plugged-f9c9fca3-8f9c-4ea9-8ceb-ed19cb265786 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:42:23 user nova-compute[73449]: WARNING nova.compute.manager [req-47b5cfc6-a4a6-42db-8c46-4ab195326925 req-1baec1b5-4143-4b7a-a52b-c82c91ce391b service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Received unexpected event network-vif-plugged-f9c9fca3-8f9c-4ea9-8ceb-ed19cb265786 for instance with vm_state building and task_state spawning.
Aug 17 11:42:23 user nova-compute[73449]: DEBUG nova.compute.manager [req-47b5cfc6-a4a6-42db-8c46-4ab195326925 req-1baec1b5-4143-4b7a-a52b-c82c91ce391b service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Received event network-vif-plugged-f9c9fca3-8f9c-4ea9-8ceb-ed19cb265786 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:42:23 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-47b5cfc6-a4a6-42db-8c46-4ab195326925 req-1baec1b5-4143-4b7a-a52b-c82c91ce391b service nova] Acquiring lock "b8e1def1-8303-4257-b9b5-0050f05cf2d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:42:23 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-47b5cfc6-a4a6-42db-8c46-4ab195326925 req-1baec1b5-4143-4b7a-a52b-c82c91ce391b service nova] Lock "b8e1def1-8303-4257-b9b5-0050f05cf2d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:42:23 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-47b5cfc6-a4a6-42db-8c46-4ab195326925 req-1baec1b5-4143-4b7a-a52b-c82c91ce391b service nova] Lock "b8e1def1-8303-4257-b9b5-0050f05cf2d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:42:23 user nova-compute[73449]: DEBUG nova.compute.manager [req-47b5cfc6-a4a6-42db-8c46-4ab195326925 req-1baec1b5-4143-4b7a-a52b-c82c91ce391b service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] No waiting events found dispatching network-vif-plugged-f9c9fca3-8f9c-4ea9-8ceb-ed19cb265786 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:42:23 user nova-compute[73449]: WARNING nova.compute.manager [req-47b5cfc6-a4a6-42db-8c46-4ab195326925 req-1baec1b5-4143-4b7a-a52b-c82c91ce391b service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Received unexpected event network-vif-plugged-f9c9fca3-8f9c-4ea9-8ceb-ed19cb265786 for instance with vm_state building and task_state spawning.
Aug 17 11:42:23 user nova-compute[73449]: DEBUG nova.compute.manager [req-47b5cfc6-a4a6-42db-8c46-4ab195326925 req-1baec1b5-4143-4b7a-a52b-c82c91ce391b service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Received event network-vif-plugged-6888cb29-a1bc-42b0-bec3-57667e1b0350 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:42:23 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-47b5cfc6-a4a6-42db-8c46-4ab195326925 req-1baec1b5-4143-4b7a-a52b-c82c91ce391b service nova] Acquiring lock "b8e1def1-8303-4257-b9b5-0050f05cf2d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:42:23 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-47b5cfc6-a4a6-42db-8c46-4ab195326925 req-1baec1b5-4143-4b7a-a52b-c82c91ce391b service nova] Lock "b8e1def1-8303-4257-b9b5-0050f05cf2d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:42:23 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-47b5cfc6-a4a6-42db-8c46-4ab195326925 req-1baec1b5-4143-4b7a-a52b-c82c91ce391b service nova] Lock "b8e1def1-8303-4257-b9b5-0050f05cf2d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:42:23 user nova-compute[73449]: DEBUG nova.compute.manager [req-47b5cfc6-a4a6-42db-8c46-4ab195326925 req-1baec1b5-4143-4b7a-a52b-c82c91ce391b service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] No waiting events found dispatching network-vif-plugged-6888cb29-a1bc-42b0-bec3-57667e1b0350 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:42:23 user nova-compute[73449]: WARNING nova.compute.manager [req-47b5cfc6-a4a6-42db-8c46-4ab195326925 req-1baec1b5-4143-4b7a-a52b-c82c91ce391b service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Received unexpected event network-vif-plugged-6888cb29-a1bc-42b0-bec3-57667e1b0350 for instance with vm_state building and task_state spawning.
Aug 17 11:42:23 user nova-compute[73449]: DEBUG nova.compute.manager [req-47b5cfc6-a4a6-42db-8c46-4ab195326925 req-1baec1b5-4143-4b7a-a52b-c82c91ce391b service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Received event network-vif-plugged-6888cb29-a1bc-42b0-bec3-57667e1b0350 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:42:23 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-47b5cfc6-a4a6-42db-8c46-4ab195326925 req-1baec1b5-4143-4b7a-a52b-c82c91ce391b service nova] Acquiring lock "b8e1def1-8303-4257-b9b5-0050f05cf2d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:42:23 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-47b5cfc6-a4a6-42db-8c46-4ab195326925 req-1baec1b5-4143-4b7a-a52b-c82c91ce391b service nova] Lock "b8e1def1-8303-4257-b9b5-0050f05cf2d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:42:23 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-47b5cfc6-a4a6-42db-8c46-4ab195326925 req-1baec1b5-4143-4b7a-a52b-c82c91ce391b service nova] Lock "b8e1def1-8303-4257-b9b5-0050f05cf2d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:42:23 user nova-compute[73449]: DEBUG nova.compute.manager [req-47b5cfc6-a4a6-42db-8c46-4ab195326925 req-1baec1b5-4143-4b7a-a52b-c82c91ce391b service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] No waiting events found dispatching network-vif-plugged-6888cb29-a1bc-42b0-bec3-57667e1b0350 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:42:23 user nova-compute[73449]: WARNING nova.compute.manager [req-47b5cfc6-a4a6-42db-8c46-4ab195326925 req-1baec1b5-4143-4b7a-a52b-c82c91ce391b service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Received unexpected event network-vif-plugged-6888cb29-a1bc-42b0-bec3-57667e1b0350 for instance with vm_state building and task_state spawning.
Aug 17 11:42:23 user nova-compute[73449]: DEBUG nova.network.neutron [req-70f6ac2a-759f-42cb-8610-f8309b186425 req-557dd95a-0462-4dc3-aa45-f946f060af4c service nova] [instance: 7d3e07fa-4823-48e9-a959-e7bac0e0b25b] Updated VIF entry in instance network info cache for port 60dadb1a-7680-434e-975f-8ef1ec1b4088. {{(pid=73449) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 11:42:23 user nova-compute[73449]: DEBUG nova.network.neutron [req-70f6ac2a-759f-42cb-8610-f8309b186425 req-557dd95a-0462-4dc3-aa45-f946f060af4c service nova] [instance: 7d3e07fa-4823-48e9-a959-e7bac0e0b25b] Updating instance_info_cache with network_info: [{"id": "60dadb1a-7680-434e-975f-8ef1ec1b4088", "address": "fa:16:3e:fd:e7:b1", "network": {"id": "2461f7a5-f076-40da-b7dc-c21b8cd64e55", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-146967442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c75ffb297b94222a4502db0e0814538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60dadb1a-76", "ovs_interfaceid": "60dadb1a-7680-434e-975f-8ef1ec1b4088", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:42:23 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-70f6ac2a-759f-42cb-8610-f8309b186425 req-557dd95a-0462-4dc3-aa45-f946f060af4c service nova] Releasing lock "refresh_cache-7d3e07fa-4823-48e9-a959-e7bac0e0b25b" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:42:23 user nova-compute[73449]: DEBUG nova.compute.manager [req-70f6ac2a-759f-42cb-8610-f8309b186425 req-557dd95a-0462-4dc3-aa45-f946f060af4c service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Received event network-vif-plugged-854609a6-03f0-416c-8bbf-b5f85d13c688 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:42:23 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-70f6ac2a-759f-42cb-8610-f8309b186425 req-557dd95a-0462-4dc3-aa45-f946f060af4c service nova] Acquiring lock "f33a7013-82d0-477c-aa5e-b27e63f2b98d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:42:23 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-70f6ac2a-759f-42cb-8610-f8309b186425 req-557dd95a-0462-4dc3-aa45-f946f060af4c service nova] Lock "f33a7013-82d0-477c-aa5e-b27e63f2b98d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:42:23 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-70f6ac2a-759f-42cb-8610-f8309b186425 req-557dd95a-0462-4dc3-aa45-f946f060af4c service nova] Lock "f33a7013-82d0-477c-aa5e-b27e63f2b98d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:42:23 user nova-compute[73449]: DEBUG nova.compute.manager [req-70f6ac2a-759f-42cb-8610-f8309b186425 req-557dd95a-0462-4dc3-aa45-f946f060af4c service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] No waiting events found dispatching network-vif-plugged-854609a6-03f0-416c-8bbf-b5f85d13c688 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:42:23 user nova-compute[73449]: WARNING nova.compute.manager [req-70f6ac2a-759f-42cb-8610-f8309b186425 req-557dd95a-0462-4dc3-aa45-f946f060af4c service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Received unexpected event network-vif-plugged-854609a6-03f0-416c-8bbf-b5f85d13c688 for instance with vm_state building and task_state spawning.
Aug 17 11:42:23 user nova-compute[73449]: DEBUG nova.compute.manager [req-70f6ac2a-759f-42cb-8610-f8309b186425 req-557dd95a-0462-4dc3-aa45-f946f060af4c service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Received event network-vif-plugged-f04e7eb7-1170-4981-b342-44c664ef4c84 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:42:23 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-70f6ac2a-759f-42cb-8610-f8309b186425 req-557dd95a-0462-4dc3-aa45-f946f060af4c service nova] Acquiring lock "f33a7013-82d0-477c-aa5e-b27e63f2b98d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:42:23 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-70f6ac2a-759f-42cb-8610-f8309b186425 req-557dd95a-0462-4dc3-aa45-f946f060af4c service nova] Lock "f33a7013-82d0-477c-aa5e-b27e63f2b98d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:42:23 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-70f6ac2a-759f-42cb-8610-f8309b186425 req-557dd95a-0462-4dc3-aa45-f946f060af4c service nova] Lock "f33a7013-82d0-477c-aa5e-b27e63f2b98d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:42:23 user nova-compute[73449]: DEBUG nova.compute.manager [req-70f6ac2a-759f-42cb-8610-f8309b186425 req-557dd95a-0462-4dc3-aa45-f946f060af4c service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] No waiting events found dispatching network-vif-plugged-f04e7eb7-1170-4981-b342-44c664ef4c84 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:42:23 user nova-compute[73449]: WARNING nova.compute.manager [req-70f6ac2a-759f-42cb-8610-f8309b186425 req-557dd95a-0462-4dc3-aa45-f946f060af4c service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Received unexpected event network-vif-plugged-f04e7eb7-1170-4981-b342-44c664ef4c84 for instance with vm_state building and task_state spawning.
Aug 17 11:42:23 user nova-compute[73449]: DEBUG nova.compute.manager [req-70f6ac2a-759f-42cb-8610-f8309b186425 req-557dd95a-0462-4dc3-aa45-f946f060af4c service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Received event network-vif-plugged-f04e7eb7-1170-4981-b342-44c664ef4c84 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:42:23 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-70f6ac2a-759f-42cb-8610-f8309b186425 req-557dd95a-0462-4dc3-aa45-f946f060af4c service nova] Acquiring lock "f33a7013-82d0-477c-aa5e-b27e63f2b98d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:42:23 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-70f6ac2a-759f-42cb-8610-f8309b186425 req-557dd95a-0462-4dc3-aa45-f946f060af4c service nova] Lock "f33a7013-82d0-477c-aa5e-b27e63f2b98d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:42:23 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-70f6ac2a-759f-42cb-8610-f8309b186425 req-557dd95a-0462-4dc3-aa45-f946f060af4c service nova] Lock "f33a7013-82d0-477c-aa5e-b27e63f2b98d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:42:23 user nova-compute[73449]: DEBUG nova.compute.manager [req-70f6ac2a-759f-42cb-8610-f8309b186425 req-557dd95a-0462-4dc3-aa45-f946f060af4c service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] No waiting events found dispatching network-vif-plugged-f04e7eb7-1170-4981-b342-44c664ef4c84 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:42:23 user nova-compute[73449]: WARNING nova.compute.manager [req-70f6ac2a-759f-42cb-8610-f8309b186425 req-557dd95a-0462-4dc3-aa45-f946f060af4c service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Received unexpected event network-vif-plugged-f04e7eb7-1170-4981-b342-44c664ef4c84 for instance with vm_state building and task_state spawning.
Aug 17 11:42:23 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:23 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:23 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-50636221-6eed-4a0c-8934-87e4f120b315 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] Acquiring lock "c7ef11da-09ce-47a1-ba56-02af6a77206c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:42:23 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-50636221-6eed-4a0c-8934-87e4f120b315 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] Lock "c7ef11da-09ce-47a1-ba56-02af6a77206c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:42:23 user nova-compute[73449]: DEBUG nova.objects.instance [None req-50636221-6eed-4a0c-8934-87e4f120b315 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] Lazy-loading 'flavor' on Instance uuid c7ef11da-09ce-47a1-ba56-02af6a77206c {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:42:23 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-50636221-6eed-4a0c-8934-87e4f120b315 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] Lock "c7ef11da-09ce-47a1-ba56-02af6a77206c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:42:24 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-06f175d5-d22c-4c1a-8778-d57faf5fd856 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Acquiring lock "fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:42:24 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-06f175d5-d22c-4c1a-8778-d57faf5fd856 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Lock "fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:42:24 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:24 user nova-compute[73449]: DEBUG nova.objects.instance [None req-06f175d5-d22c-4c1a-8778-d57faf5fd856 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Lazy-loading 'flavor' on Instance uuid fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:42:24 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-50636221-6eed-4a0c-8934-87e4f120b315 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] Acquiring lock "c7ef11da-09ce-47a1-ba56-02af6a77206c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:42:24 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-50636221-6eed-4a0c-8934-87e4f120b315 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] Lock "c7ef11da-09ce-47a1-ba56-02af6a77206c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:42:24 user nova-compute[73449]: INFO nova.compute.manager [None req-50636221-6eed-4a0c-8934-87e4f120b315 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] [instance: c7ef11da-09ce-47a1-ba56-02af6a77206c] Attaching volume 8a554c8d-34fa-4557-a6e0-2dfdc32a161c to /dev/vdb
Aug 17 11:42:24 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-06f175d5-d22c-4c1a-8778-d57faf5fd856 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Lock "fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.114s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:42:24 user nova-compute[73449]: DEBUG os_brick.utils [None req-50636221-6eed-4a0c-8934-87e4f120b315 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 11:42:24 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:24 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:24 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[8054ef34-437d-4622-992f-f5eda7c4ecd4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4d3924302012\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:24 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:24 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:24 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[a506348a-9551-48d0-af5d-5eb82b1eedae]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:24 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:24 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:24 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[5687af23-3fd3-4d89-9c84-fb2471acd179]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:24 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[8da7fdff-9f5f-45be-8c3d-5269c75e0940]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:24 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-50636221-6eed-4a0c-8934-87e4f120b315 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] Running cmd (subprocess): nvme version {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:24 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-50636221-6eed-4a0c-8934-87e4f120b315 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] 'nvme version' failed. Not Retrying. {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 11:42:24 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.nvmeof [None req-50636221-6eed-4a0c-8934-87e4f120b315 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] nvme not present on system {{(pid=73449) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 11:42:24 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:24 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:24 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 11:42:24 user nova-compute[73449]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 11:42:24 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d7a89ff-4e7b-4c03-be35-c3377f8f9c09]: (4, '') {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:24 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-50636221-6eed-4a0c-8934-87e4f120b315 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73449) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 11:42:24 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-50636221-6eed-4a0c-8934-87e4f120b315 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73449) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 11:42:24 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-50636221-6eed-4a0c-8934-87e4f120b315 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] LIGHTOS: no hostnqn found. {{(pid=73449) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 11:42:24 user nova-compute[73449]: DEBUG os_brick.utils [None req-50636221-6eed-4a0c-8934-87e4f120b315 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] <== get_connector_properties: return (194ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4d3924302012', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 11:42:24 user nova-compute[73449]: DEBUG nova.virt.block_device [None req-50636221-6eed-4a0c-8934-87e4f120b315 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] [instance: c7ef11da-09ce-47a1-ba56-02af6a77206c] Updating existing volume attachment record: e2bfca63-cf04-4953-9269-95d98583a0e4 {{(pid=73449) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 11:42:24 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-06f175d5-d22c-4c1a-8778-d57faf5fd856 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Acquiring lock "fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:42:24 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-06f175d5-d22c-4c1a-8778-d57faf5fd856 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Lock "fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:42:24 user nova-compute[73449]: INFO nova.compute.manager [None req-06f175d5-d22c-4c1a-8778-d57faf5fd856 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] [instance: fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2] Attaching volume 76db2114-4742-4d02-91c7-676fcc3c838c to /dev/vdb
Aug 17 11:42:24 user nova-compute[73449]: DEBUG nova.compute.manager [req-919d2218-a9c3-406d-8f87-260f5b3f5c68 req-e3de7dc7-ebba-4918-a92a-e9adf7029dea service nova] [instance: c7ef11da-09ce-47a1-ba56-02af6a77206c] Received event network-changed-2f53f520-423a-4791-b98b-6be90f9d5f55 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:42:24 user nova-compute[73449]: DEBUG nova.compute.manager [req-919d2218-a9c3-406d-8f87-260f5b3f5c68 req-e3de7dc7-ebba-4918-a92a-e9adf7029dea service nova] [instance: c7ef11da-09ce-47a1-ba56-02af6a77206c] Refreshing instance network info cache due to event network-changed-2f53f520-423a-4791-b98b-6be90f9d5f55. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 11:42:24 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-919d2218-a9c3-406d-8f87-260f5b3f5c68 req-e3de7dc7-ebba-4918-a92a-e9adf7029dea service nova] Acquiring lock "refresh_cache-c7ef11da-09ce-47a1-ba56-02af6a77206c" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:42:24 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-919d2218-a9c3-406d-8f87-260f5b3f5c68 req-e3de7dc7-ebba-4918-a92a-e9adf7029dea service nova] Acquired lock "refresh_cache-c7ef11da-09ce-47a1-ba56-02af6a77206c" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:42:24 user nova-compute[73449]: DEBUG nova.network.neutron [req-919d2218-a9c3-406d-8f87-260f5b3f5c68 req-e3de7dc7-ebba-4918-a92a-e9adf7029dea service nova] [instance: c7ef11da-09ce-47a1-ba56-02af6a77206c] Refreshing network info cache for port 2f53f520-423a-4791-b98b-6be90f9d5f55 {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 11:42:24 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:24 user nova-compute[73449]: DEBUG nova.network.neutron [None req-7234e92c-5c6d-4e33-a372-2aef3bc73d16 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] [instance: 7d3e07fa-4823-48e9-a959-e7bac0e0b25b] Successfully created port: 80c33dff-82f7-4faa-ab3c-23691d6ff089 {{(pid=73449) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 11:42:24 user nova-compute[73449]: DEBUG os_brick.utils [None req-06f175d5-d22c-4c1a-8778-d57faf5fd856 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 11:42:24 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:24 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:24 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[87836c0d-b5bc-4318-880b-e5c4a5bf0e6b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4d3924302012\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:24 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:24 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.030s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:24 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[057a23ca-6229-4122-812a-a523495a1343]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:24 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:25 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:25 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[423f26f1-defc-428a-bf97-ae1e7cff9500]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:25 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf1089ce-665e-4826-a176-9c8be12d5880]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:25 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-06f175d5-d22c-4c1a-8778-d57faf5fd856 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Running cmd (subprocess): nvme version {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:25 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-06f175d5-d22c-4c1a-8778-d57faf5fd856 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] 'nvme version' failed. Not Retrying. {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 11:42:25 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.nvmeof [None req-06f175d5-d22c-4c1a-8778-d57faf5fd856 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] nvme not present on system {{(pid=73449) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 11:42:25 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:25 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 11:42:25 user nova-compute[73449]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 11:42:25 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[71f30cec-d36e-4290-ae32-b11c9f3dceae]: (4, '') {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:25 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-06f175d5-d22c-4c1a-8778-d57faf5fd856 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73449) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 11:42:25 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-06f175d5-d22c-4c1a-8778-d57faf5fd856 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73449) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 11:42:25 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-06f175d5-d22c-4c1a-8778-d57faf5fd856 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] LIGHTOS: no hostnqn found. {{(pid=73449) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 11:42:25 user nova-compute[73449]: DEBUG os_brick.utils [None req-06f175d5-d22c-4c1a-8778-d57faf5fd856 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] <== get_connector_properties: return (159ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4d3924302012', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 11:42:25 user nova-compute[73449]: DEBUG nova.virt.block_device [None req-06f175d5-d22c-4c1a-8778-d57faf5fd856 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] [instance: fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2] Updating existing volume attachment record: 5bde530d-3bbd-4a30-b90b-390ac9abd931 {{(pid=73449) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 11:42:25 user nova-compute[73449]: DEBUG nova.compute.manager [req-266c6403-b0db-44d1-9ce4-1623f019b6a3 req-f8fb599e-e2f7-4658-a844-dbae15f4bd57 service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Received event network-vif-plugged-c69d3b48-1443-4999-8369-8c5f61b35697 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:42:25 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-266c6403-b0db-44d1-9ce4-1623f019b6a3 req-f8fb599e-e2f7-4658-a844-dbae15f4bd57 service nova] Acquiring lock "f33a7013-82d0-477c-aa5e-b27e63f2b98d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:42:25 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-266c6403-b0db-44d1-9ce4-1623f019b6a3 req-f8fb599e-e2f7-4658-a844-dbae15f4bd57 service nova] Lock "f33a7013-82d0-477c-aa5e-b27e63f2b98d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:42:25 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-266c6403-b0db-44d1-9ce4-1623f019b6a3 req-f8fb599e-e2f7-4658-a844-dbae15f4bd57 service nova] Lock "f33a7013-82d0-477c-aa5e-b27e63f2b98d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:42:25 user nova-compute[73449]: DEBUG nova.compute.manager [req-266c6403-b0db-44d1-9ce4-1623f019b6a3 req-f8fb599e-e2f7-4658-a844-dbae15f4bd57 service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] No waiting events found dispatching network-vif-plugged-c69d3b48-1443-4999-8369-8c5f61b35697 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:42:25 user nova-compute[73449]: WARNING nova.compute.manager [req-266c6403-b0db-44d1-9ce4-1623f019b6a3 req-f8fb599e-e2f7-4658-a844-dbae15f4bd57 service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Received unexpected event network-vif-plugged-c69d3b48-1443-4999-8369-8c5f61b35697 for instance with vm_state building and task_state spawning.
Aug 17 11:42:25 user nova-compute[73449]: DEBUG nova.compute.manager [req-266c6403-b0db-44d1-9ce4-1623f019b6a3 req-f8fb599e-e2f7-4658-a844-dbae15f4bd57 service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Received event network-vif-plugged-c69d3b48-1443-4999-8369-8c5f61b35697 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:42:25 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-266c6403-b0db-44d1-9ce4-1623f019b6a3 req-f8fb599e-e2f7-4658-a844-dbae15f4bd57 service nova] Acquiring lock "f33a7013-82d0-477c-aa5e-b27e63f2b98d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:42:25 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-266c6403-b0db-44d1-9ce4-1623f019b6a3 req-f8fb599e-e2f7-4658-a844-dbae15f4bd57 service nova] Lock "f33a7013-82d0-477c-aa5e-b27e63f2b98d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:42:25 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-266c6403-b0db-44d1-9ce4-1623f019b6a3 req-f8fb599e-e2f7-4658-a844-dbae15f4bd57 service nova] Lock "f33a7013-82d0-477c-aa5e-b27e63f2b98d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:42:25 user nova-compute[73449]: DEBUG nova.compute.manager [req-266c6403-b0db-44d1-9ce4-1623f019b6a3 req-f8fb599e-e2f7-4658-a844-dbae15f4bd57 service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] No waiting events found dispatching network-vif-plugged-c69d3b48-1443-4999-8369-8c5f61b35697 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:42:25 user nova-compute[73449]: WARNING nova.compute.manager [req-266c6403-b0db-44d1-9ce4-1623f019b6a3 req-f8fb599e-e2f7-4658-a844-dbae15f4bd57 service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Received unexpected event network-vif-plugged-c69d3b48-1443-4999-8369-8c5f61b35697 for instance with vm_state building and task_state spawning.
Aug 17 11:42:25 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692272545.1774695, f33a7013-82d0-477c-aa5e-b27e63f2b98d => Resumed> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:42:25 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] VM Resumed (Lifecycle Event)
Aug 17 11:42:25 user nova-compute[73449]: DEBUG nova.compute.manager [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Instance event wait completed in 0 seconds for  {{(pid=73449) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 11:42:25 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Guest created on hypervisor {{(pid=73449) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 11:42:25 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:42:25 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Instance spawned successfully.
Aug 17 11:42:25 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 11:42:25 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 11:42:25 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Found default for hw_cdrom_bus of ide {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:42:25 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Found default for hw_disk_bus of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:42:25 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Found default for hw_input_bus of None {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:42:25 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Found default for hw_pointer_model of None {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:42:25 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Found default for hw_video_model of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:42:25 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Found default for hw_vif_model of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:42:25 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 11:42:25 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692272545.2026362, f33a7013-82d0-477c-aa5e-b27e63f2b98d => Started> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:42:25 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] VM Started (Lifecycle Event)
Aug 17 11:42:25 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:42:25 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 11:42:25 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 11:42:25 user nova-compute[73449]: DEBUG nova.network.neutron [req-919d2218-a9c3-406d-8f87-260f5b3f5c68 req-e3de7dc7-ebba-4918-a92a-e9adf7029dea service nova] [instance: c7ef11da-09ce-47a1-ba56-02af6a77206c] Updated VIF entry in instance network info cache for port 2f53f520-423a-4791-b98b-6be90f9d5f55. {{(pid=73449) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 11:42:25 user nova-compute[73449]: DEBUG nova.network.neutron [req-919d2218-a9c3-406d-8f87-260f5b3f5c68 req-e3de7dc7-ebba-4918-a92a-e9adf7029dea service nova] [instance: c7ef11da-09ce-47a1-ba56-02af6a77206c] Updating instance_info_cache with network_info: [{"id": "2f53f520-423a-4791-b98b-6be90f9d5f55", "address": "fa:16:3e:3b:b6:03", "network": {"id": "e41fb10a-8d95-4907-9bc9-8bf33868fb1f", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1297880435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1ad62fc00f644808abbfc3712321ccf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f53f520-42", "ovs_interfaceid": "2f53f520-423a-4791-b98b-6be90f9d5f55", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:42:25 user nova-compute[73449]: DEBUG nova.compute.manager [req-aeefb748-84b8-4a94-b272-75bcbd8fd07b req-33906952-4878-4e47-99a8-bd2c1d49535b service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Received event network-vif-plugged-d85896ce-110a-41d6-a20e-6beaecb36b97 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:42:25 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-aeefb748-84b8-4a94-b272-75bcbd8fd07b req-33906952-4878-4e47-99a8-bd2c1d49535b service nova] Acquiring lock "b8e1def1-8303-4257-b9b5-0050f05cf2d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:42:25 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-aeefb748-84b8-4a94-b272-75bcbd8fd07b req-33906952-4878-4e47-99a8-bd2c1d49535b service nova] Lock "b8e1def1-8303-4257-b9b5-0050f05cf2d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:42:25 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-aeefb748-84b8-4a94-b272-75bcbd8fd07b req-33906952-4878-4e47-99a8-bd2c1d49535b service nova] Lock "b8e1def1-8303-4257-b9b5-0050f05cf2d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:42:25 user nova-compute[73449]: DEBUG nova.compute.manager [req-aeefb748-84b8-4a94-b272-75bcbd8fd07b req-33906952-4878-4e47-99a8-bd2c1d49535b service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] No waiting events found dispatching network-vif-plugged-d85896ce-110a-41d6-a20e-6beaecb36b97 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:42:25 user nova-compute[73449]: WARNING nova.compute.manager [req-aeefb748-84b8-4a94-b272-75bcbd8fd07b req-33906952-4878-4e47-99a8-bd2c1d49535b service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Received unexpected event network-vif-plugged-d85896ce-110a-41d6-a20e-6beaecb36b97 for instance with vm_state building and task_state spawning.
Aug 17 11:42:25 user nova-compute[73449]: DEBUG nova.compute.manager [req-aeefb748-84b8-4a94-b272-75bcbd8fd07b req-33906952-4878-4e47-99a8-bd2c1d49535b service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Received event network-vif-plugged-d85896ce-110a-41d6-a20e-6beaecb36b97 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:42:25 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-aeefb748-84b8-4a94-b272-75bcbd8fd07b req-33906952-4878-4e47-99a8-bd2c1d49535b service nova] Acquiring lock "b8e1def1-8303-4257-b9b5-0050f05cf2d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:42:25 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-aeefb748-84b8-4a94-b272-75bcbd8fd07b req-33906952-4878-4e47-99a8-bd2c1d49535b service nova] Lock "b8e1def1-8303-4257-b9b5-0050f05cf2d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:42:25 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-aeefb748-84b8-4a94-b272-75bcbd8fd07b req-33906952-4878-4e47-99a8-bd2c1d49535b service nova] Lock "b8e1def1-8303-4257-b9b5-0050f05cf2d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:42:25 user nova-compute[73449]: DEBUG nova.compute.manager [req-aeefb748-84b8-4a94-b272-75bcbd8fd07b req-33906952-4878-4e47-99a8-bd2c1d49535b service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] No waiting events found dispatching network-vif-plugged-d85896ce-110a-41d6-a20e-6beaecb36b97 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:42:25 user nova-compute[73449]: WARNING nova.compute.manager [req-aeefb748-84b8-4a94-b272-75bcbd8fd07b req-33906952-4878-4e47-99a8-bd2c1d49535b service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Received unexpected event network-vif-plugged-d85896ce-110a-41d6-a20e-6beaecb36b97 for instance with vm_state building and task_state spawning.
Aug 17 11:42:25 user nova-compute[73449]: DEBUG nova.compute.manager [req-aeefb748-84b8-4a94-b272-75bcbd8fd07b req-33906952-4878-4e47-99a8-bd2c1d49535b service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Received event network-vif-plugged-671f57db-57f1-4ba3-9e49-ebe4816404f6 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:42:25 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-aeefb748-84b8-4a94-b272-75bcbd8fd07b req-33906952-4878-4e47-99a8-bd2c1d49535b service nova] Acquiring lock "b8e1def1-8303-4257-b9b5-0050f05cf2d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:42:25 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-aeefb748-84b8-4a94-b272-75bcbd8fd07b req-33906952-4878-4e47-99a8-bd2c1d49535b service nova] Lock "b8e1def1-8303-4257-b9b5-0050f05cf2d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:42:25 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-aeefb748-84b8-4a94-b272-75bcbd8fd07b req-33906952-4878-4e47-99a8-bd2c1d49535b service nova] Lock "b8e1def1-8303-4257-b9b5-0050f05cf2d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:42:25 user nova-compute[73449]: DEBUG nova.compute.manager [req-aeefb748-84b8-4a94-b272-75bcbd8fd07b req-33906952-4878-4e47-99a8-bd2c1d49535b service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] No waiting events found dispatching network-vif-plugged-671f57db-57f1-4ba3-9e49-ebe4816404f6 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:42:25 user nova-compute[73449]: WARNING nova.compute.manager [req-aeefb748-84b8-4a94-b272-75bcbd8fd07b req-33906952-4878-4e47-99a8-bd2c1d49535b service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Received unexpected event network-vif-plugged-671f57db-57f1-4ba3-9e49-ebe4816404f6 for instance with vm_state building and task_state spawning.
Aug 17 11:42:25 user nova-compute[73449]: DEBUG nova.compute.manager [req-aeefb748-84b8-4a94-b272-75bcbd8fd07b req-33906952-4878-4e47-99a8-bd2c1d49535b service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Received event network-vif-plugged-671f57db-57f1-4ba3-9e49-ebe4816404f6 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:42:25 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-aeefb748-84b8-4a94-b272-75bcbd8fd07b req-33906952-4878-4e47-99a8-bd2c1d49535b service nova] Acquiring lock "b8e1def1-8303-4257-b9b5-0050f05cf2d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:42:25 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-aeefb748-84b8-4a94-b272-75bcbd8fd07b req-33906952-4878-4e47-99a8-bd2c1d49535b service nova] Lock "b8e1def1-8303-4257-b9b5-0050f05cf2d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:42:25 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-aeefb748-84b8-4a94-b272-75bcbd8fd07b req-33906952-4878-4e47-99a8-bd2c1d49535b service nova] Lock "b8e1def1-8303-4257-b9b5-0050f05cf2d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:42:25 user nova-compute[73449]: DEBUG nova.compute.manager [req-aeefb748-84b8-4a94-b272-75bcbd8fd07b req-33906952-4878-4e47-99a8-bd2c1d49535b service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] No waiting events found dispatching network-vif-plugged-671f57db-57f1-4ba3-9e49-ebe4816404f6 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:42:25 user nova-compute[73449]: WARNING nova.compute.manager [req-aeefb748-84b8-4a94-b272-75bcbd8fd07b req-33906952-4878-4e47-99a8-bd2c1d49535b service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Received unexpected event network-vif-plugged-671f57db-57f1-4ba3-9e49-ebe4816404f6 for instance with vm_state building and task_state spawning.
Aug 17 11:42:25 user nova-compute[73449]: INFO nova.compute.manager [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Took 18.52 seconds to spawn the instance on the hypervisor.
Aug 17 11:42:25 user nova-compute[73449]: DEBUG nova.compute.manager [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:42:25 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:25 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-919d2218-a9c3-406d-8f87-260f5b3f5c68 req-e3de7dc7-ebba-4918-a92a-e9adf7029dea service nova] Releasing lock "refresh_cache-c7ef11da-09ce-47a1-ba56-02af6a77206c" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:42:25 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:25 user nova-compute[73449]: INFO nova.compute.manager [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Took 57.75 seconds to build instance.
Aug 17 11:42:25 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a4ba81cb-5532-4a2f-9f93-a8b31e5b406b tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Lock "f33a7013-82d0-477c-aa5e-b27e63f2b98d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 57.868s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:42:25 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692272545.8061614, b8e1def1-8303-4257-b9b5-0050f05cf2d0 => Resumed> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:42:25 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] VM Resumed (Lifecycle Event)
Aug 17 11:42:25 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Instance event wait completed in 0 seconds for  {{(pid=73449) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 11:42:25 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Guest created on hypervisor {{(pid=73449) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 11:42:25 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Instance spawned successfully.
Aug 17 11:42:25 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 11:42:25 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:42:25 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 11:42:25 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Found default for hw_cdrom_bus of ide {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:42:25 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Found default for hw_disk_bus of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:42:25 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Found default for hw_input_bus of None {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:42:25 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Found default for hw_pointer_model of None {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:42:25 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Found default for hw_video_model of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:42:25 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Found default for hw_vif_model of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:42:25 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 11:42:25 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692272545.8102553, b8e1def1-8303-4257-b9b5-0050f05cf2d0 => Started> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:42:25 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] VM Started (Lifecycle Event)
Aug 17 11:42:25 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:42:25 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 11:42:25 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 11:42:25 user nova-compute[73449]: INFO nova.compute.manager [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Took 18.71 seconds to spawn the instance on the hypervisor.
Aug 17 11:42:25 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:42:26 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:26 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:26 user nova-compute[73449]: INFO nova.compute.manager [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Took 61.01 seconds to build instance.
Aug 17 11:42:26 user nova-compute[73449]: DEBUG nova.network.neutron [None req-7234e92c-5c6d-4e33-a372-2aef3bc73d16 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] [instance: 7d3e07fa-4823-48e9-a959-e7bac0e0b25b] Successfully updated port: 80c33dff-82f7-4faa-ab3c-23691d6ff089 {{(pid=73449) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 11:42:26 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b39b68c6-4ffe-4ed1-b7e7-0d6856f27d23 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Lock "b8e1def1-8303-4257-b9b5-0050f05cf2d0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 61.135s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:42:26 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-7234e92c-5c6d-4e33-a372-2aef3bc73d16 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Acquiring lock "refresh_cache-7d3e07fa-4823-48e9-a959-e7bac0e0b25b" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:42:26 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-7234e92c-5c6d-4e33-a372-2aef3bc73d16 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Acquired lock "refresh_cache-7d3e07fa-4823-48e9-a959-e7bac0e0b25b" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:42:26 user nova-compute[73449]: DEBUG nova.network.neutron [None req-7234e92c-5c6d-4e33-a372-2aef3bc73d16 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] [instance: 7d3e07fa-4823-48e9-a959-e7bac0e0b25b] Building network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 11:42:26 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:26 user nova-compute[73449]: DEBUG nova.network.neutron [None req-7234e92c-5c6d-4e33-a372-2aef3bc73d16 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] [instance: 7d3e07fa-4823-48e9-a959-e7bac0e0b25b] Updating instance_info_cache with network_info: [{"id": "60dadb1a-7680-434e-975f-8ef1ec1b4088", "address": "fa:16:3e:fd:e7:b1", "network": {"id": "2461f7a5-f076-40da-b7dc-c21b8cd64e55", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-146967442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c75ffb297b94222a4502db0e0814538", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60dadb1a-76", "ovs_interfaceid": "60dadb1a-7680-434e-975f-8ef1ec1b4088", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "80c33dff-82f7-4faa-ab3c-23691d6ff089", "address": "fa:16:3e:3b:bb:72", "network": {"id": "b3413879-f603-4b1d-b023-0110910a8800", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-768654625", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3c75ffb297b94222a4502db0e0814538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80c33dff-82", "ovs_interfaceid": "80c33dff-82f7-4faa-ab3c-23691d6ff089", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:42:26 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-7234e92c-5c6d-4e33-a372-2aef3bc73d16 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Releasing lock "refresh_cache-7d3e07fa-4823-48e9-a959-e7bac0e0b25b" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:42:26 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-7234e92c-5c6d-4e33-a372-2aef3bc73d16 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T11:40:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2017749474',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2017749474',id=6,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKDfVSRbJOSL96IIDH0v0XJrsx/+BlroyuWS03V0CQU7P0dyi56boP0N4YVepj2zGZdJ92Q/eiUfqBiWlxOzCQZKWvHOldZF0ArsphTeKIZc5KRdUwh+L9qgCVMp15KALw==',key_name='tempest-keypair-1953925692',keypairs=<?>,launch_index=0,launched_at=2023-08-17T11:40:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3c75ffb297b94222a4502db0e0814538',ramdisk_id='',reservation_id='r-35nrqkzd',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1681245717',owner_user_name='tempest-TaggedAttachmentsTest-1681245717-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T11:40:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9df670f3f7da4815bdcb9915a4999380',uuid=7d3e07fa-4823-48e9-a959-e7bac0e0b25b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "80c33dff-82f7-4faa-ab3c-23691d6ff089", "address": "fa:16:3e:3b:bb:72", "network": {"id": "b3413879-f603-4b1d-b023-0110910a8800", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-768654625", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3c75ffb297b94222a4502db0e0814538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80c33dff-82", "ovs_interfaceid": "80c33dff-82f7-4faa-ab3c-23691d6ff089", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 11:42:26 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-7234e92c-5c6d-4e33-a372-2aef3bc73d16 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Converting VIF {"id": "80c33dff-82f7-4faa-ab3c-23691d6ff089", "address": "fa:16:3e:3b:bb:72", "network": {"id": "b3413879-f603-4b1d-b023-0110910a8800", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-768654625", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3c75ffb297b94222a4502db0e0814538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80c33dff-82", "ovs_interfaceid": "80c33dff-82f7-4faa-ab3c-23691d6ff089", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:42:26 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-7234e92c-5c6d-4e33-a372-2aef3bc73d16 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:bb:72,bridge_name='br-int',has_traffic_filtering=True,id=80c33dff-82f7-4faa-ab3c-23691d6ff089,network=Network(b3413879-f603-4b1d-b023-0110910a8800),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80c33dff-82') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:42:26 user nova-compute[73449]: DEBUG os_vif [None req-7234e92c-5c6d-4e33-a372-2aef3bc73d16 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:bb:72,bridge_name='br-int',has_traffic_filtering=True,id=80c33dff-82f7-4faa-ab3c-23691d6ff089,network=Network(b3413879-f603-4b1d-b023-0110910a8800),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80c33dff-82') {{(pid=73449) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 11:42:26 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:26 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:42:26 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 11:42:26 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:26 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap80c33dff-82, may_exist=True, interface_attrs={}) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:42:26 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap80c33dff-82, col_values=(('external_ids', {'iface-id': '80c33dff-82f7-4faa-ab3c-23691d6ff089', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3b:bb:72', 'vm-uuid': '7d3e07fa-4823-48e9-a959-e7bac0e0b25b'}),), if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:42:26 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:26 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:42:26 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:26 user nova-compute[73449]: INFO os_vif [None req-7234e92c-5c6d-4e33-a372-2aef3bc73d16 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:bb:72,bridge_name='br-int',has_traffic_filtering=True,id=80c33dff-82f7-4faa-ab3c-23691d6ff089,network=Network(b3413879-f603-4b1d-b023-0110910a8800),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80c33dff-82')
Aug 17 11:42:26 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-7234e92c-5c6d-4e33-a372-2aef3bc73d16 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T11:40:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2017749474',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2017749474',id=6,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKDfVSRbJOSL96IIDH0v0XJrsx/+BlroyuWS03V0CQU7P0dyi56boP0N4YVepj2zGZdJ92Q/eiUfqBiWlxOzCQZKWvHOldZF0ArsphTeKIZc5KRdUwh+L9qgCVMp15KALw==',key_name='tempest-keypair-1953925692',keypairs=<?>,launch_index=0,launched_at=2023-08-17T11:40:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3c75ffb297b94222a4502db0e0814538',ramdisk_id='',reservation_id='r-35nrqkzd',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1681245717',owner_user_name='tempest-TaggedAttachmentsTest-1681245717-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T11:40:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9df670f3f7da4815bdcb9915a4999380',uuid=7d3e07fa-4823-48e9-a959-e7bac0e0b25b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "80c33dff-82f7-4faa-ab3c-23691d6ff089", "address": "fa:16:3e:3b:bb:72", "network": {"id": "b3413879-f603-4b1d-b023-0110910a8800", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-768654625", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3c75ffb297b94222a4502db0e0814538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80c33dff-82", "ovs_interfaceid": "80c33dff-82f7-4faa-ab3c-23691d6ff089", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73449) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 11:42:26 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-7234e92c-5c6d-4e33-a372-2aef3bc73d16 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Converting VIF {"id": "80c33dff-82f7-4faa-ab3c-23691d6ff089", "address": "fa:16:3e:3b:bb:72", "network": {"id": "b3413879-f603-4b1d-b023-0110910a8800", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-768654625", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3c75ffb297b94222a4502db0e0814538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80c33dff-82", "ovs_interfaceid": "80c33dff-82f7-4faa-ab3c-23691d6ff089", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:42:26 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-7234e92c-5c6d-4e33-a372-2aef3bc73d16 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:bb:72,bridge_name='br-int',has_traffic_filtering=True,id=80c33dff-82f7-4faa-ab3c-23691d6ff089,network=Network(b3413879-f603-4b1d-b023-0110910a8800),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80c33dff-82') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:42:26 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-7234e92c-5c6d-4e33-a372-2aef3bc73d16 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] attach device xml: <interface type="ethernet">
Aug 17 11:42:26 user nova-compute[73449]:   <mac address="fa:16:3e:3b:bb:72"/>
Aug 17 11:42:26 user nova-compute[73449]:   <model type="virtio"/>
Aug 17 11:42:26 user nova-compute[73449]:   <mtu size="1442"/>
Aug 17 11:42:26 user nova-compute[73449]:   <target dev="tap80c33dff-82"/>
Aug 17 11:42:26 user nova-compute[73449]: </interface>
Aug 17 11:42:26 user nova-compute[73449]:  {{(pid=73449) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 11:42:26 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:27 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:27 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:27 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:27 user nova-compute[73449]: DEBUG nova.compute.manager [req-36280603-4c32-4c23-be19-ad112c2a84c1 req-985e88dc-5dce-4dfb-a046-5c79794c078c service nova] [instance: 7d3e07fa-4823-48e9-a959-e7bac0e0b25b] Received event network-changed-80c33dff-82f7-4faa-ab3c-23691d6ff089 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:42:27 user nova-compute[73449]: DEBUG nova.compute.manager [req-36280603-4c32-4c23-be19-ad112c2a84c1 req-985e88dc-5dce-4dfb-a046-5c79794c078c service nova] [instance: 7d3e07fa-4823-48e9-a959-e7bac0e0b25b] Refreshing instance network info cache due to event network-changed-80c33dff-82f7-4faa-ab3c-23691d6ff089. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 11:42:27 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-36280603-4c32-4c23-be19-ad112c2a84c1 req-985e88dc-5dce-4dfb-a046-5c79794c078c service nova] Acquiring lock "refresh_cache-7d3e07fa-4823-48e9-a959-e7bac0e0b25b" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:42:27 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-36280603-4c32-4c23-be19-ad112c2a84c1 req-985e88dc-5dce-4dfb-a046-5c79794c078c service nova] Acquired lock "refresh_cache-7d3e07fa-4823-48e9-a959-e7bac0e0b25b" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:42:27 user nova-compute[73449]: DEBUG nova.network.neutron [req-36280603-4c32-4c23-be19-ad112c2a84c1 req-985e88dc-5dce-4dfb-a046-5c79794c078c service nova] [instance: 7d3e07fa-4823-48e9-a959-e7bac0e0b25b] Refreshing network info cache for port 80c33dff-82f7-4faa-ab3c-23691d6ff089 {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 11:42:27 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:27 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-7234e92c-5c6d-4e33-a372-2aef3bc73d16 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] No BDM found with device name vda, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 11:42:27 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-7234e92c-5c6d-4e33-a372-2aef3bc73d16 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] No BDM found with device name hda, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 11:42:27 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-7234e92c-5c6d-4e33-a372-2aef3bc73d16 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] No VIF found with MAC fa:16:3e:fd:e7:b1, not building metadata {{(pid=73449) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 11:42:27 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-7234e92c-5c6d-4e33-a372-2aef3bc73d16 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 11:42:27 user nova-compute[73449]:   <nova:package version="0.0.0"/>
Aug 17 11:42:27 user nova-compute[73449]:   <nova:name>tempest-device-tagging-server-2017749474</nova:name>
Aug 17 11:42:27 user nova-compute[73449]:   <nova:creationTime>2023-08-17 11:42:27</nova:creationTime>
Aug 17 11:42:27 user nova-compute[73449]:   <nova:flavor name="m1.tiny">
Aug 17 11:42:27 user nova-compute[73449]:     <nova:memory>512</nova:memory>
Aug 17 11:42:27 user nova-compute[73449]:     <nova:disk>1</nova:disk>
Aug 17 11:42:27 user nova-compute[73449]:     <nova:swap>0</nova:swap>
Aug 17 11:42:27 user nova-compute[73449]:     <nova:ephemeral>0</nova:ephemeral>
Aug 17 11:42:27 user nova-compute[73449]:     <nova:vcpus>1</nova:vcpus>
Aug 17 11:42:27 user nova-compute[73449]:   </nova:flavor>
Aug 17 11:42:27 user nova-compute[73449]:   <nova:owner>
Aug 17 11:42:27 user nova-compute[73449]:     <nova:user uuid="9df670f3f7da4815bdcb9915a4999380">tempest-TaggedAttachmentsTest-1681245717-project-member</nova:user>
Aug 17 11:42:27 user nova-compute[73449]:     <nova:project uuid="3c75ffb297b94222a4502db0e0814538">tempest-TaggedAttachmentsTest-1681245717</nova:project>
Aug 17 11:42:27 user nova-compute[73449]:   </nova:owner>
Aug 17 11:42:27 user nova-compute[73449]:   <nova:root type="image" uuid="0a2904ae-083d-41c8-83db-343132b36148"/>
Aug 17 11:42:27 user nova-compute[73449]:   <nova:ports>
Aug 17 11:42:27 user nova-compute[73449]:     <nova:port uuid="60dadb1a-7680-434e-975f-8ef1ec1b4088">
Aug 17 11:42:27 user nova-compute[73449]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 17 11:42:27 user nova-compute[73449]:     </nova:port>
Aug 17 11:42:27 user nova-compute[73449]:     <nova:port uuid="80c33dff-82f7-4faa-ab3c-23691d6ff089">
Aug 17 11:42:27 user nova-compute[73449]:       <nova:ip type="fixed" address="10.10.10.167" ipVersion="4"/>
Aug 17 11:42:27 user nova-compute[73449]:     </nova:port>
Aug 17 11:42:27 user nova-compute[73449]:   </nova:ports>
Aug 17 11:42:27 user nova-compute[73449]: </nova:instance>
Aug 17 11:42:27 user nova-compute[73449]:  {{(pid=73449) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 17 11:42:27 user nova-compute[73449]: DEBUG nova.compute.manager [req-8089aa84-f263-4ec4-ac28-d78ff7c30c52 req-14bf9110-8513-4db8-8bd6-4dad65ad7747 service nova] [instance: 7d3e07fa-4823-48e9-a959-e7bac0e0b25b] Received event network-vif-plugged-80c33dff-82f7-4faa-ab3c-23691d6ff089 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:42:27 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-8089aa84-f263-4ec4-ac28-d78ff7c30c52 req-14bf9110-8513-4db8-8bd6-4dad65ad7747 service nova] Acquiring lock "7d3e07fa-4823-48e9-a959-e7bac0e0b25b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:42:27 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-8089aa84-f263-4ec4-ac28-d78ff7c30c52 req-14bf9110-8513-4db8-8bd6-4dad65ad7747 service nova] Lock "7d3e07fa-4823-48e9-a959-e7bac0e0b25b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:42:27 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-8089aa84-f263-4ec4-ac28-d78ff7c30c52 req-14bf9110-8513-4db8-8bd6-4dad65ad7747 service nova] Lock "7d3e07fa-4823-48e9-a959-e7bac0e0b25b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:42:27 user nova-compute[73449]: DEBUG nova.compute.manager [req-8089aa84-f263-4ec4-ac28-d78ff7c30c52 req-14bf9110-8513-4db8-8bd6-4dad65ad7747 service nova] [instance: 7d3e07fa-4823-48e9-a959-e7bac0e0b25b] No waiting events found dispatching network-vif-plugged-80c33dff-82f7-4faa-ab3c-23691d6ff089 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:42:27 user nova-compute[73449]: WARNING nova.compute.manager [req-8089aa84-f263-4ec4-ac28-d78ff7c30c52 req-14bf9110-8513-4db8-8bd6-4dad65ad7747 service nova] [instance: 7d3e07fa-4823-48e9-a959-e7bac0e0b25b] Received unexpected event network-vif-plugged-80c33dff-82f7-4faa-ab3c-23691d6ff089 for instance with vm_state active and task_state None.
Aug 17 11:42:27 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-7234e92c-5c6d-4e33-a372-2aef3bc73d16 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Lock "interface-7d3e07fa-4823-48e9-a959-e7bac0e0b25b-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 5.430s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:42:27 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:27 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:27 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:27 user nova-compute[73449]: DEBUG nova.network.neutron [req-36280603-4c32-4c23-be19-ad112c2a84c1 req-985e88dc-5dce-4dfb-a046-5c79794c078c service nova] [instance: 7d3e07fa-4823-48e9-a959-e7bac0e0b25b] Updated VIF entry in instance network info cache for port 80c33dff-82f7-4faa-ab3c-23691d6ff089. {{(pid=73449) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 11:42:27 user nova-compute[73449]: DEBUG nova.network.neutron [req-36280603-4c32-4c23-be19-ad112c2a84c1 req-985e88dc-5dce-4dfb-a046-5c79794c078c service nova] [instance: 7d3e07fa-4823-48e9-a959-e7bac0e0b25b] Updating instance_info_cache with network_info: [{"id": "60dadb1a-7680-434e-975f-8ef1ec1b4088", "address": "fa:16:3e:fd:e7:b1", "network": {"id": "2461f7a5-f076-40da-b7dc-c21b8cd64e55", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-146967442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c75ffb297b94222a4502db0e0814538", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60dadb1a-76", "ovs_interfaceid": "60dadb1a-7680-434e-975f-8ef1ec1b4088", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "80c33dff-82f7-4faa-ab3c-23691d6ff089", "address": "fa:16:3e:3b:bb:72", "network": {"id": "b3413879-f603-4b1d-b023-0110910a8800", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-768654625", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3c75ffb297b94222a4502db0e0814538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80c33dff-82", "ovs_interfaceid": "80c33dff-82f7-4faa-ab3c-23691d6ff089", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:42:27 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-36280603-4c32-4c23-be19-ad112c2a84c1 req-985e88dc-5dce-4dfb-a046-5c79794c078c service nova] Releasing lock "refresh_cache-7d3e07fa-4823-48e9-a959-e7bac0e0b25b" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:42:29 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-994a32c0-638d-4bac-a17c-cbc9740fbb8e tempest-VolumesAssistedSnapshotsTest-2081262095 tempest-VolumesAssistedSnapshotsTest-2081262095-project-admin] [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e] Calling os-brick to attach iSCSI Volume {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 11:42:29 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-994a32c0-638d-4bac-a17c-cbc9740fbb8e tempest-VolumesAssistedSnapshotsTest-2081262095 tempest-VolumesAssistedSnapshotsTest-2081262095-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3394c5c3-2ff2-4a87-8470-614418b70b21'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qWSHUaoe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 11:42:29 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-994a32c0-638d-4bac-a17c-cbc9740fbb8e tempest-VolumesAssistedSnapshotsTest-2081262095 tempest-VolumesAssistedSnapshotsTest-2081262095-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 11:42:29 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-994a32c0-638d-4bac-a17c-cbc9740fbb8e tempest-VolumesAssistedSnapshotsTest-2081262095 tempest-VolumesAssistedSnapshotsTest-2081262095-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:42:29 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-994a32c0-638d-4bac-a17c-cbc9740fbb8e tempest-VolumesAssistedSnapshotsTest-2081262095 tempest-VolumesAssistedSnapshotsTest-2081262095-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:42:29 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-994a32c0-638d-4bac-a17c-cbc9740fbb8e tempest-VolumesAssistedSnapshotsTest-2081262095 tempest-VolumesAssistedSnapshotsTest-2081262095-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 11:42:29 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-994a32c0-638d-4bac-a17c-cbc9740fbb8e tempest-VolumesAssistedSnapshotsTest-2081262095 tempest-VolumesAssistedSnapshotsTest-2081262095-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3394c5c3-2ff2-4a87-8470-614418b70b21" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:42:29 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-994a32c0-638d-4bac-a17c-cbc9740fbb8e tempest-VolumesAssistedSnapshotsTest-2081262095 tempest-VolumesAssistedSnapshotsTest-2081262095-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3394c5c3-2ff2-4a87-8470-614418b70b21" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:42:29 user nova-compute[73449]: INFO os_brick.initiator.connectors.iscsi [None req-994a32c0-638d-4bac-a17c-cbc9740fbb8e tempest-VolumesAssistedSnapshotsTest-2081262095 tempest-VolumesAssistedSnapshotsTest-2081262095-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 11:42:29 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3394c5c3-2ff2-4a87-8470-614418b70b21 -p 172.16.0.220:3260 {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:29 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3394c5c3-2ff2-4a87-8470-614418b70b21 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:29 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[56c58465-dc48-4845-9d82-1dbb7e4f0739]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:29 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-994a32c0-638d-4bac-a17c-cbc9740fbb8e tempest-VolumesAssistedSnapshotsTest-2081262095 tempest-VolumesAssistedSnapshotsTest-2081262095-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 11:42:29 user nova-compute[73449]:  {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:42:29 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3394c5c3-2ff2-4a87-8470-614418b70b21 -p 172.16.0.220:3260 --interface default --op new {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:29 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3394c5c3-2ff2-4a87-8470-614418b70b21 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:29 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bea92c9-ab25-4d60-b7d6-10d0d830cdb2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3394c5c3-2ff2-4a87-8470-614418b70b21] added\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:29 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-994a32c0-638d-4bac-a17c-cbc9740fbb8e tempest-VolumesAssistedSnapshotsTest-2081262095 tempest-VolumesAssistedSnapshotsTest-2081262095-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3394c5c3-2ff2-4a87-8470-614418b70b21] added
Aug 17 11:42:29 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:42:29 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3394c5c3-2ff2-4a87-8470-614418b70b21 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:29 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3394c5c3-2ff2-4a87-8470-614418b70b21 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:29 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbe4aed8-0e58-49c9-93f0-2618e706eeb7]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:29 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-994a32c0-638d-4bac-a17c-cbc9740fbb8e tempest-VolumesAssistedSnapshotsTest-2081262095 tempest-VolumesAssistedSnapshotsTest-2081262095-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:42:29 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3394c5c3-2ff2-4a87-8470-614418b70b21 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:29 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3394c5c3-2ff2-4a87-8470-614418b70b21 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:29 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0257910-66f3-450e-8394-152313a02db4]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:29 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-994a32c0-638d-4bac-a17c-cbc9740fbb8e tempest-VolumesAssistedSnapshotsTest-2081262095 tempest-VolumesAssistedSnapshotsTest-2081262095-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:42:29 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3394c5c3-2ff2-4a87-8470-614418b70b21 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qWSHUaoe {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:29 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3394c5c3-2ff2-4a87-8470-614418b70b21 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qWSHUaoe" returned: 0 in 0.025s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:29 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[42491fe2-f677-4d00-9b69-f5580dbe10b0]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:29 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-994a32c0-638d-4bac-a17c-cbc9740fbb8e tempest-VolumesAssistedSnapshotsTest-2081262095 tempest-VolumesAssistedSnapshotsTest-2081262095-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qWSHUaoe'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:42:29 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3394c5c3-2ff2-4a87-8470-614418b70b21 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:29 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3394c5c3-2ff2-4a87-8470-614418b70b21 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:29 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ce468d9-a748-4d3b-82c5-8ee87a9e20d5]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:29 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-994a32c0-638d-4bac-a17c-cbc9740fbb8e tempest-VolumesAssistedSnapshotsTest-2081262095 tempest-VolumesAssistedSnapshotsTest-2081262095-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:42:29 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:29 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:29 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[4840e477-847a-42cb-a819-0a0ce5af5319]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:29 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-994a32c0-638d-4bac-a17c-cbc9740fbb8e tempest-VolumesAssistedSnapshotsTest-2081262095 tempest-VolumesAssistedSnapshotsTest-2081262095-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919 (non-flash)
Aug 17 11:42:29 user nova-compute[73449]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47 (non-flash)
Aug 17 11:42:29 user nova-compute[73449]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda (non-flash)
Aug 17 11:42:29 user nova-compute[73449]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e (non-flash)
Aug 17 11:42:29 user nova-compute[73449]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff (non-flash)
Aug 17 11:42:29 user nova-compute[73449]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd (non-flash)
Aug 17 11:42:29 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:42:29 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-994a32c0-638d-4bac-a17c-cbc9740fbb8e tempest-VolumesAssistedSnapshotsTest-2081262095 tempest-VolumesAssistedSnapshotsTest-2081262095-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919 (non-flash)
Aug 17 11:42:29 user nova-compute[73449]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47 (non-flash)
Aug 17 11:42:29 user nova-compute[73449]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda (non-flash)
Aug 17 11:42:29 user nova-compute[73449]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e (non-flash)
Aug 17 11:42:29 user nova-compute[73449]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff (non-flash)
Aug 17 11:42:29 user nova-compute[73449]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd (non-flash)
Aug 17 11:42:29 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:42:29 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3394c5c3-2ff2-4a87-8470-614418b70b21 -p 172.16.0.220:3260 --login {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:29 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-f904909b-2f51-4e5a-9cd4-06f7a15e7f63 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Acquiring lock "7d3e07fa-4823-48e9-a959-e7bac0e0b25b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:42:29 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-f904909b-2f51-4e5a-9cd4-06f7a15e7f63 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Lock "7d3e07fa-4823-48e9-a959-e7bac0e0b25b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:42:29 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3394c5c3-2ff2-4a87-8470-614418b70b21 -p 172.16.0.220:3260 --login" returned: 0 in 0.100s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:29 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[53ef3f81-ba48-426d-9f42-76810728a6a7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3394c5c3-2ff2-4a87-8470-614418b70b21, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3394c5c3-2ff2-4a87-8470-614418b70b21, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:29 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-994a32c0-638d-4bac-a17c-cbc9740fbb8e tempest-VolumesAssistedSnapshotsTest-2081262095 tempest-VolumesAssistedSnapshotsTest-2081262095-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3394c5c3-2ff2-4a87-8470-614418b70b21, portal: 172.16.0.220,3260]
Aug 17 11:42:29 user nova-compute[73449]: Login to [iface: default, target: iqn.2010-10.org.openstack:3394c5c3-2ff2-4a87-8470-614418b70b21, portal: 172.16.0.220,3260] successful.
Aug 17 11:42:29 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:42:29 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3394c5c3-2ff2-4a87-8470-614418b70b21 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:29 user nova-compute[73449]: DEBUG nova.objects.instance [None req-f904909b-2f51-4e5a-9cd4-06f7a15e7f63 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Lazy-loading 'flavor' on Instance uuid 7d3e07fa-4823-48e9-a959-e7bac0e0b25b {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:42:29 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3394c5c3-2ff2-4a87-8470-614418b70b21 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:29 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ae25d81-97e4-42c4-921f-e8c73dd0e4e9]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:29 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-994a32c0-638d-4bac-a17c-cbc9740fbb8e tempest-VolumesAssistedSnapshotsTest-2081262095 tempest-VolumesAssistedSnapshotsTest-2081262095-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:42:29 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:29 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:29 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[76190d28-9708-4cc9-ab12-52c419e28975]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3394c5c3-2ff2-4a87-8470-614418b70b21 (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:29 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-994a32c0-638d-4bac-a17c-cbc9740fbb8e tempest-VolumesAssistedSnapshotsTest-2081262095 tempest-VolumesAssistedSnapshotsTest-2081262095-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919 (non-flash)
Aug 17 11:42:29 user nova-compute[73449]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47 (non-flash)
Aug 17 11:42:29 user nova-compute[73449]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda (non-flash)
Aug 17 11:42:29 user nova-compute[73449]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e (non-flash)
Aug 17 11:42:29 user nova-compute[73449]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff (non-flash)
Aug 17 11:42:29 user nova-compute[73449]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd (non-flash)
Aug 17 11:42:29 user nova-compute[73449]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3394c5c3-2ff2-4a87-8470-614418b70b21 (non-flash)
Aug 17 11:42:29 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:42:29 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-994a32c0-638d-4bac-a17c-cbc9740fbb8e tempest-VolumesAssistedSnapshotsTest-2081262095 tempest-VolumesAssistedSnapshotsTest-2081262095-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919 (non-flash)
Aug 17 11:42:29 user nova-compute[73449]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47 (non-flash)
Aug 17 11:42:29 user nova-compute[73449]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda (non-flash)
Aug 17 11:42:29 user nova-compute[73449]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e (non-flash)
Aug 17 11:42:29 user nova-compute[73449]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff (non-flash)
Aug 17 11:42:29 user nova-compute[73449]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd (non-flash)
Aug 17 11:42:29 user nova-compute[73449]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3394c5c3-2ff2-4a87-8470-614418b70b21 (non-flash)
Aug 17 11:42:29 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:42:29 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-994a32c0-638d-4bac-a17c-cbc9740fbb8e tempest-VolumesAssistedSnapshotsTest-2081262095 tempest-VolumesAssistedSnapshotsTest-2081262095-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3394c5c3-2ff2-4a87-8470-614418b70b21" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.389s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:42:29 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-994a32c0-638d-4bac-a17c-cbc9740fbb8e tempest-VolumesAssistedSnapshotsTest-2081262095 tempest-VolumesAssistedSnapshotsTest-2081262095-project-admin] Connected to 172.16.0.220:3260 {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 11:42:29 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-994a32c0-638d-4bac-a17c-cbc9740fbb8e tempest-VolumesAssistedSnapshotsTest-2081262095 tempest-VolumesAssistedSnapshotsTest-2081262095-project-admin] HCTL ('39', '-', '-', 0) found on session 9 with lun 0 {{(pid=73449) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 11:42:29 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-994a32c0-638d-4bac-a17c-cbc9740fbb8e tempest-VolumesAssistedSnapshotsTest-2081262095 tempest-VolumesAssistedSnapshotsTest-2081262095-project-admin] Scanning host 39 c: -, t: -, l: 0) {{(pid=73449) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 11:42:29 user nova-compute[73449]: DEBUG nova.compute.manager [req-6ddcf747-8625-474f-a7ea-147e25580135 req-fc32efda-b676-4fb8-ad7b-555c0ac6a668 service nova] [instance: 7d3e07fa-4823-48e9-a959-e7bac0e0b25b] Received event network-vif-plugged-80c33dff-82f7-4faa-ab3c-23691d6ff089 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:42:29 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-6ddcf747-8625-474f-a7ea-147e25580135 req-fc32efda-b676-4fb8-ad7b-555c0ac6a668 service nova] Acquiring lock "7d3e07fa-4823-48e9-a959-e7bac0e0b25b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:42:29 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-6ddcf747-8625-474f-a7ea-147e25580135 req-fc32efda-b676-4fb8-ad7b-555c0ac6a668 service nova] Lock "7d3e07fa-4823-48e9-a959-e7bac0e0b25b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:42:29 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-6ddcf747-8625-474f-a7ea-147e25580135 req-fc32efda-b676-4fb8-ad7b-555c0ac6a668 service nova] Lock "7d3e07fa-4823-48e9-a959-e7bac0e0b25b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:42:29 user nova-compute[73449]: DEBUG nova.compute.manager [req-6ddcf747-8625-474f-a7ea-147e25580135 req-fc32efda-b676-4fb8-ad7b-555c0ac6a668 service nova] [instance: 7d3e07fa-4823-48e9-a959-e7bac0e0b25b] No waiting events found dispatching network-vif-plugged-80c33dff-82f7-4faa-ab3c-23691d6ff089 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:42:29 user nova-compute[73449]: WARNING nova.compute.manager [req-6ddcf747-8625-474f-a7ea-147e25580135 req-fc32efda-b676-4fb8-ad7b-555c0ac6a668 service nova] [instance: 7d3e07fa-4823-48e9-a959-e7bac0e0b25b] Received unexpected event network-vif-plugged-80c33dff-82f7-4faa-ab3c-23691d6ff089 for instance with vm_state active and task_state None.
Aug 17 11:42:29 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:29 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-f904909b-2f51-4e5a-9cd4-06f7a15e7f63 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Lock "7d3e07fa-4823-48e9-a959-e7bac0e0b25b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.116s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:42:29 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.033s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:29 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[df8ed33f-1ae3-4caa-ba6d-a95a67054bcd]: (4, ('- - 0', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:29 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-994a32c0-638d-4bac-a17c-cbc9740fbb8e tempest-VolumesAssistedSnapshotsTest-2081262095 tempest-VolumesAssistedSnapshotsTest-2081262095-project-admin] Searching for a device in session 9 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=73449) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 11:42:29 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-994a32c0-638d-4bac-a17c-cbc9740fbb8e tempest-VolumesAssistedSnapshotsTest-2081262095 tempest-VolumesAssistedSnapshotsTest-2081262095-project-admin] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qWSHUaoe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 11:42:29 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-f904909b-2f51-4e5a-9cd4-06f7a15e7f63 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Acquiring lock "7d3e07fa-4823-48e9-a959-e7bac0e0b25b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:42:29 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-f904909b-2f51-4e5a-9cd4-06f7a15e7f63 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Lock "7d3e07fa-4823-48e9-a959-e7bac0e0b25b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:42:29 user nova-compute[73449]: INFO nova.compute.manager [None req-f904909b-2f51-4e5a-9cd4-06f7a15e7f63 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] [instance: 7d3e07fa-4823-48e9-a959-e7bac0e0b25b] Attaching volume 70aee407-774e-4938-9128-27f568d7486d to /dev/vdb
Aug 17 11:42:29 user nova-compute[73449]: DEBUG os_brick.utils [None req-f904909b-2f51-4e5a-9cd4-06f7a15e7f63 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 11:42:29 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:30 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:30 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[25a591d4-4cf1-416d-89b1-608a27f408be]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4d3924302012\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:30 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:30 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:30 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1d366c9-4bc4-428e-82b2-53027b49dcd8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:30 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:30 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:30 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6410e91-d804-4c61-b851-ec044d05c8dc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:30 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3c0f4e0-8779-4870-b289-08bb693d062f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:30 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-f904909b-2f51-4e5a-9cd4-06f7a15e7f63 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Running cmd (subprocess): nvme version {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:30 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-f904909b-2f51-4e5a-9cd4-06f7a15e7f63 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] 'nvme version' failed. Not Retrying. {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 11:42:30 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f904909b-2f51-4e5a-9cd4-06f7a15e7f63 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] nvme not present on system {{(pid=73449) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 11:42:30 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:30 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 11:42:30 user nova-compute[73449]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 11:42:30 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9940cf5-8381-4aca-9df2-d29e5a19a26a]: (4, '') {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:30 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-f904909b-2f51-4e5a-9cd4-06f7a15e7f63 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73449) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 11:42:30 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-f904909b-2f51-4e5a-9cd4-06f7a15e7f63 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73449) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 11:42:30 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-f904909b-2f51-4e5a-9cd4-06f7a15e7f63 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] LIGHTOS: no hostnqn found. {{(pid=73449) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 11:42:30 user nova-compute[73449]: DEBUG os_brick.utils [None req-f904909b-2f51-4e5a-9cd4-06f7a15e7f63 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4d3924302012', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 11:42:30 user nova-compute[73449]: DEBUG nova.virt.block_device [None req-f904909b-2f51-4e5a-9cd4-06f7a15e7f63 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] [instance: 7d3e07fa-4823-48e9-a959-e7bac0e0b25b] Updating existing volume attachment record: b93c8232-5e77-472c-9b27-1a1b05103a26 {{(pid=73449) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 11:42:30 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-994a32c0-638d-4bac-a17c-cbc9740fbb8e tempest-VolumesAssistedSnapshotsTest-2081262095 tempest-VolumesAssistedSnapshotsTest-2081262095-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.449s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:42:30 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-994a32c0-638d-4bac-a17c-cbc9740fbb8e tempest-VolumesAssistedSnapshotsTest-2081262095 tempest-VolumesAssistedSnapshotsTest-2081262095-project-admin] <== connect_volume: return (1450ms) {'type': 'block', 'scsi_wwn': '26235323232626662', 'path': '/dev/sdh'} {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 11:42:30 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-994a32c0-638d-4bac-a17c-cbc9740fbb8e tempest-VolumesAssistedSnapshotsTest-2081262095 tempest-VolumesAssistedSnapshotsTest-2081262095-project-admin] [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26235323232626662', 'path': '/dev/sdh'} {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 11:42:30 user nova-compute[73449]: DEBUG nova.objects.instance [None req-994a32c0-638d-4bac-a17c-cbc9740fbb8e tempest-VolumesAssistedSnapshotsTest-2081262095 tempest-VolumesAssistedSnapshotsTest-2081262095-project-admin] Lazy-loading 'flavor' on Instance uuid fd8d4549-db8f-4c74-8706-8ac21f049c2e {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:42:30 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-994a32c0-638d-4bac-a17c-cbc9740fbb8e tempest-VolumesAssistedSnapshotsTest-2081262095 tempest-VolumesAssistedSnapshotsTest-2081262095-project-admin] attach device xml: <disk type="block" device="disk">
Aug 17 11:42:30 user nova-compute[73449]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 11:42:30 user nova-compute[73449]:   <source dev="/dev/sdh"/>
Aug 17 11:42:30 user nova-compute[73449]:   <target dev="vdb" bus="virtio"/>
Aug 17 11:42:30 user nova-compute[73449]:   <serial>3394c5c3-2ff2-4a87-8470-614418b70b21</serial>
Aug 17 11:42:30 user nova-compute[73449]: </disk>
Aug 17 11:42:30 user nova-compute[73449]:  {{(pid=73449) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 11:42:31 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-994a32c0-638d-4bac-a17c-cbc9740fbb8e tempest-VolumesAssistedSnapshotsTest-2081262095 tempest-VolumesAssistedSnapshotsTest-2081262095-project-admin] No BDM found with device name vda, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 11:42:31 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-994a32c0-638d-4bac-a17c-cbc9740fbb8e tempest-VolumesAssistedSnapshotsTest-2081262095 tempest-VolumesAssistedSnapshotsTest-2081262095-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 11:42:31 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-994a32c0-638d-4bac-a17c-cbc9740fbb8e tempest-VolumesAssistedSnapshotsTest-2081262095 tempest-VolumesAssistedSnapshotsTest-2081262095-project-admin] No VIF found with MAC fa:16:3e:e2:ef:b0, not building metadata {{(pid=73449) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 11:42:31 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:32 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:36 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:37 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:38 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-06f175d5-d22c-4c1a-8778-d57faf5fd856 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] [instance: fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2] Calling os-brick to attach iSCSI Volume {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 11:42:38 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-06f175d5-d22c-4c1a-8778-d57faf5fd856 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:76db2114-4742-4d02-91c7-676fcc3c838c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GuFnpiKc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 11:42:38 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-06f175d5-d22c-4c1a-8778-d57faf5fd856 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 11:42:38 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-06f175d5-d22c-4c1a-8778-d57faf5fd856 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:42:38 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-06f175d5-d22c-4c1a-8778-d57faf5fd856 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:42:38 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-06f175d5-d22c-4c1a-8778-d57faf5fd856 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 11:42:38 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-06f175d5-d22c-4c1a-8778-d57faf5fd856 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:76db2114-4742-4d02-91c7-676fcc3c838c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:42:38 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-06f175d5-d22c-4c1a-8778-d57faf5fd856 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:76db2114-4742-4d02-91c7-676fcc3c838c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:42:38 user nova-compute[73449]: INFO os_brick.initiator.connectors.iscsi [None req-06f175d5-d22c-4c1a-8778-d57faf5fd856 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 11:42:38 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76db2114-4742-4d02-91c7-676fcc3c838c -p 172.16.0.220:3260 {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:38 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76db2114-4742-4d02-91c7-676fcc3c838c -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:38 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf9e18c7-1bf8-40c0-b066-63bb11cf1ca3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:38 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-06f175d5-d22c-4c1a-8778-d57faf5fd856 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 11:42:38 user nova-compute[73449]:  {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:42:38 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76db2114-4742-4d02-91c7-676fcc3c838c -p 172.16.0.220:3260 --interface default --op new {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:38 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76db2114-4742-4d02-91c7-676fcc3c838c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:38 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[c94a1187-ce83-415d-b69f-2948f1d1b935]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:76db2114-4742-4d02-91c7-676fcc3c838c] added\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:38 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-06f175d5-d22c-4c1a-8778-d57faf5fd856 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:76db2114-4742-4d02-91c7-676fcc3c838c] added
Aug 17 11:42:38 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:42:38 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76db2114-4742-4d02-91c7-676fcc3c838c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:38 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76db2114-4742-4d02-91c7-676fcc3c838c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:38 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[48dd2dfd-b359-4582-b47d-eb773797b1be]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:38 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-06f175d5-d22c-4c1a-8778-d57faf5fd856 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:42:38 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76db2114-4742-4d02-91c7-676fcc3c838c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:38 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76db2114-4742-4d02-91c7-676fcc3c838c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:38 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[557ed4e3-3294-4dba-96da-fcccee304657]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:38 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-06f175d5-d22c-4c1a-8778-d57faf5fd856 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:42:38 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76db2114-4742-4d02-91c7-676fcc3c838c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GuFnpiKc {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:38 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50636221-6eed-4a0c-8934-87e4f120b315 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] [instance: c7ef11da-09ce-47a1-ba56-02af6a77206c] Calling os-brick to attach iSCSI Volume {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 11:42:38 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-50636221-6eed-4a0c-8934-87e4f120b315 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WroVHtXa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 11:42:38 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-50636221-6eed-4a0c-8934-87e4f120b315 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 11:42:38 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-50636221-6eed-4a0c-8934-87e4f120b315 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:42:38 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76db2114-4742-4d02-91c7-676fcc3c838c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GuFnpiKc" returned: 0 in 0.043s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:38 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceff8b93-f133-4449-bb29-8407147c8bf1]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:38 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-06f175d5-d22c-4c1a-8778-d57faf5fd856 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GuFnpiKc'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:42:38 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76db2114-4742-4d02-91c7-676fcc3c838c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:38 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76db2114-4742-4d02-91c7-676fcc3c838c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:38 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[88689454-42ec-4696-ac0d-676d16c65280]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:38 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-06f175d5-d22c-4c1a-8778-d57faf5fd856 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:42:38 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:38 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.043s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:38 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[4333da48-fbb1-4d63-9697-36cf371204c2]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3394c5c3-2ff2-4a87-8470-614418b70b21 (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:38 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-06f175d5-d22c-4c1a-8778-d57faf5fd856 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919 (non-flash)
Aug 17 11:42:38 user nova-compute[73449]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47 (non-flash)
Aug 17 11:42:38 user nova-compute[73449]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda (non-flash)
Aug 17 11:42:38 user nova-compute[73449]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e (non-flash)
Aug 17 11:42:38 user nova-compute[73449]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff (non-flash)
Aug 17 11:42:38 user nova-compute[73449]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd (non-flash)
Aug 17 11:42:38 user nova-compute[73449]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3394c5c3-2ff2-4a87-8470-614418b70b21 (non-flash)
Aug 17 11:42:38 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:42:38 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-06f175d5-d22c-4c1a-8778-d57faf5fd856 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919 (non-flash)
Aug 17 11:42:38 user nova-compute[73449]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47 (non-flash)
Aug 17 11:42:38 user nova-compute[73449]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda (non-flash)
Aug 17 11:42:38 user nova-compute[73449]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e (non-flash)
Aug 17 11:42:38 user nova-compute[73449]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff (non-flash)
Aug 17 11:42:38 user nova-compute[73449]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd (non-flash)
Aug 17 11:42:38 user nova-compute[73449]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3394c5c3-2ff2-4a87-8470-614418b70b21 (non-flash)
Aug 17 11:42:38 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:42:38 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76db2114-4742-4d02-91c7-676fcc3c838c -p 172.16.0.220:3260 --login {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:39 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-994a32c0-638d-4bac-a17c-cbc9740fbb8e tempest-VolumesAssistedSnapshotsTest-2081262095 tempest-VolumesAssistedSnapshotsTest-2081262095-project-admin] Lock "fd8d4549-db8f-4c74-8706-8ac21f049c2e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.170s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:42:39 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76db2114-4742-4d02-91c7-676fcc3c838c -p 172.16.0.220:3260 --login" returned: 0 in 0.105s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:39 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[44044fb6-17a9-4208-9e4b-97916ba2fe75]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:76db2114-4742-4d02-91c7-676fcc3c838c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:76db2114-4742-4d02-91c7-676fcc3c838c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:39 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-06f175d5-d22c-4c1a-8778-d57faf5fd856 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:76db2114-4742-4d02-91c7-676fcc3c838c, portal: 172.16.0.220,3260]
Aug 17 11:42:39 user nova-compute[73449]: Login to [iface: default, target: iqn.2010-10.org.openstack:76db2114-4742-4d02-91c7-676fcc3c838c, portal: 172.16.0.220,3260] successful.
Aug 17 11:42:39 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:42:39 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76db2114-4742-4d02-91c7-676fcc3c838c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:39 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76db2114-4742-4d02-91c7-676fcc3c838c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:39 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[58a9a65f-09af-418e-95fe-858fb7993d59]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:39 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-06f175d5-d22c-4c1a-8778-d57faf5fd856 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:42:39 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:39 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.043s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:39 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a158bb8-81ab-4d76-adfb-7cafc98ef937]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76db2114-4742-4d02-91c7-676fcc3c838c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3394c5c3-2ff2-4a87-8470-614418b70b21 (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:39 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-06f175d5-d22c-4c1a-8778-d57faf5fd856 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76db2114-4742-4d02-91c7-676fcc3c838c (non-flash)
Aug 17 11:42:39 user nova-compute[73449]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919 (non-flash)
Aug 17 11:42:39 user nova-compute[73449]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47 (non-flash)
Aug 17 11:42:39 user nova-compute[73449]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda (non-flash)
Aug 17 11:42:39 user nova-compute[73449]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e (non-flash)
Aug 17 11:42:39 user nova-compute[73449]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff (non-flash)
Aug 17 11:42:39 user nova-compute[73449]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd (non-flash)
Aug 17 11:42:39 user nova-compute[73449]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3394c5c3-2ff2-4a87-8470-614418b70b21 (non-flash)
Aug 17 11:42:39 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:42:39 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-06f175d5-d22c-4c1a-8778-d57faf5fd856 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76db2114-4742-4d02-91c7-676fcc3c838c (non-flash)
Aug 17 11:42:39 user nova-compute[73449]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919 (non-flash)
Aug 17 11:42:39 user nova-compute[73449]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47 (non-flash)
Aug 17 11:42:39 user nova-compute[73449]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda (non-flash)
Aug 17 11:42:39 user nova-compute[73449]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e (non-flash)
Aug 17 11:42:39 user nova-compute[73449]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff (non-flash)
Aug 17 11:42:39 user nova-compute[73449]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd (non-flash)
Aug 17 11:42:39 user nova-compute[73449]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3394c5c3-2ff2-4a87-8470-614418b70b21 (non-flash)
Aug 17 11:42:39 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:42:39 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-06f175d5-d22c-4c1a-8778-d57faf5fd856 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:76db2114-4742-4d02-91c7-676fcc3c838c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.416s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:42:39 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-06f175d5-d22c-4c1a-8778-d57faf5fd856 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Connected to 172.16.0.220:3260 {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 11:42:39 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-06f175d5-d22c-4c1a-8778-d57faf5fd856 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] HCTL ('40', '-', '-', 0) found on session 10 with lun 0 {{(pid=73449) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 11:42:39 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-06f175d5-d22c-4c1a-8778-d57faf5fd856 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=73449) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 11:42:39 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:39 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:39 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[d15288ab-20d7-4c85-9fe9-25b82418a789]: (4, ('- - 0', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:39 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-06f175d5-d22c-4c1a-8778-d57faf5fd856 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Searching for a device in session 10 and hctl ['40', '*', '*', 0] yield: None {{(pid=73449) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 11:42:40 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-bed2438d-754d-412a-bb0c-f00ddb953f27 tempest-VolumesAssistedSnapshotsTest-2081262095 tempest-VolumesAssistedSnapshotsTest-2081262095-project-admin] [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e] volume_snapshot_create: create_info: {'snapshot_id': '91a551b6-8688-4bb9-a45d-a913a0794964', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=73449) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3566}}
Aug 17 11:42:40 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-bed2438d-754d-412a-bb0c-f00ddb953f27 tempest-VolumesAssistedSnapshotsTest-2081262095 tempest-VolumesAssistedSnapshotsTest-2081262095-project-admin] [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e] snap xml: <domainsnapshot>
Aug 17 11:42:40 user nova-compute[73449]:   <disks>
Aug 17 11:42:40 user nova-compute[73449]:     <disk name="/dev/sdh" snapshot="external" type="file">
Aug 17 11:42:40 user nova-compute[73449]:       <source file="/dev/new_file"/>
Aug 17 11:42:40 user nova-compute[73449]:     </disk>
Aug 17 11:42:40 user nova-compute[73449]:     <disk name="vda" snapshot="no"/>
Aug 17 11:42:40 user nova-compute[73449]:   </disks>
Aug 17 11:42:40 user nova-compute[73449]: </domainsnapshot>
Aug 17 11:42:40 user nova-compute[73449]:  {{(pid=73449) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3507}}
Aug 17 11:42:40 user nova-compute[73449]: DEBUG nova.objects.instance [None req-bed2438d-754d-412a-bb0c-f00ddb953f27 tempest-VolumesAssistedSnapshotsTest-2081262095 tempest-VolumesAssistedSnapshotsTest-2081262095-project-admin] Lazy-loading 'system_metadata' on Instance uuid fd8d4549-db8f-4c74-8706-8ac21f049c2e {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:42:40 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-06f175d5-d22c-4c1a-8778-d57faf5fd856 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Searching for a device in session 10 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=73449) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 11:42:40 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-06f175d5-d22c-4c1a-8778-d57faf5fd856 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Connected to sdi using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GuFnpiKc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 11:42:40 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-06f175d5-d22c-4c1a-8778-d57faf5fd856 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.459s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:42:40 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-06f175d5-d22c-4c1a-8778-d57faf5fd856 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] <== connect_volume: return (1461ms) {'type': 'block', 'scsi_wwn': '26363356563333833', 'path': '/dev/sdi'} {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 11:42:40 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-06f175d5-d22c-4c1a-8778-d57faf5fd856 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] [instance: fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26363356563333833', 'path': '/dev/sdi'} {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 11:42:40 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-50636221-6eed-4a0c-8934-87e4f120b315 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.322s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:42:40 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-50636221-6eed-4a0c-8934-87e4f120b315 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 11:42:40 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-50636221-6eed-4a0c-8934-87e4f120b315 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:42:40 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-50636221-6eed-4a0c-8934-87e4f120b315 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:42:40 user nova-compute[73449]: INFO os_brick.initiator.connectors.iscsi [None req-50636221-6eed-4a0c-8934-87e4f120b315 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 11:42:40 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c -p 172.16.0.220:3260 {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:40 user nova-compute[73449]: DEBUG nova.objects.instance [None req-06f175d5-d22c-4c1a-8778-d57faf5fd856 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Lazy-loading 'flavor' on Instance uuid fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:42:40 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:40 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[36fe2a14-0777-4a23-b498-f932440cf3ea]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:40 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-50636221-6eed-4a0c-8934-87e4f120b315 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 11:42:40 user nova-compute[73449]:  {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:42:40 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c -p 172.16.0.220:3260 --interface default --op new {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:40 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-bed2438d-754d-412a-bb0c-f00ddb953f27 tempest-VolumesAssistedSnapshotsTest-2081262095 tempest-VolumesAssistedSnapshotsTest-2081262095-project-admin] [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 17 11:42:40 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-06f175d5-d22c-4c1a-8778-d57faf5fd856 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 11:42:40 user nova-compute[73449]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 11:42:40 user nova-compute[73449]:   <source dev="/dev/sdi"/>
Aug 17 11:42:40 user nova-compute[73449]:   <target dev="vdb" bus="virtio"/>
Aug 17 11:42:40 user nova-compute[73449]:   <serial>76db2114-4742-4d02-91c7-676fcc3c838c</serial>
Aug 17 11:42:40 user nova-compute[73449]: </disk>
Aug 17 11:42:40 user nova-compute[73449]:  {{(pid=73449) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver [None req-bed2438d-754d-412a-bb0c-f00ddb953f27 tempest-VolumesAssistedSnapshotsTest-2081262095 tempest-VolumesAssistedSnapshotsTest-2081262095-project-admin] [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e] Traceback (most recent call last):
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e]     rv = execute(f, *args, **kwargs)
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e]     six.reraise(c, e, tb)
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e]     raise value
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e]     rv = meth(*args, **kwargs)
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e] 
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver [None req-bed2438d-754d-412a-bb0c-f00ddb953f27 tempest-VolumesAssistedSnapshotsTest-2081262095 tempest-VolumesAssistedSnapshotsTest-2081262095-project-admin] [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e] Traceback (most recent call last):
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e]     self._volume_snapshot_create(context, instance, guest,
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e]     rv = execute(f, *args, **kwargs)
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e]     six.reraise(c, e, tb)
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e]     raise value
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e]     rv = meth(*args, **kwargs)
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e] 
Aug 17 11:42:40 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:40 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea23124a-3855-476c-a970-2cd73ddd4689]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c] added\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:40 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-50636221-6eed-4a0c-8934-87e4f120b315 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c] added
Aug 17 11:42:40 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:42:40 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:40 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-01f3cdef-e3fc-47e3-90f4-3bbc6ae29002 tempest-VolumesAssistedSnapshotsTest-2081262095 tempest-VolumesAssistedSnapshotsTest-2081262095-project-admin] [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e] volume_snapshot_delete: delete_info: {'volume_id': '3394c5c3-2ff2-4a87-8470-614418b70b21'} {{(pid=73449) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3667}}
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver [None req-01f3cdef-e3fc-47e3-90f4-3bbc6ae29002 tempest-VolumesAssistedSnapshotsTest-2081262095 tempest-VolumesAssistedSnapshotsTest-2081262095-project-admin] [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e] Traceback (most recent call last):
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e]     self._volume_snapshot_delete(context, instance, volume_id,
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e]     if delete_info['type'] != 'qcow2':
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e] KeyError: 'type'
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e] 
Aug 17 11:42:40 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:40 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a54878a-e211-4d12-997d-27db19632393]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:40 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-50636221-6eed-4a0c-8934-87e4f120b315 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:42:40 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:40 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:40 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[f945539f-53f7-4062-9843-c62822fe872c]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:40 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-50636221-6eed-4a0c-8934-87e4f120b315 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:42:40 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WroVHtXa {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver [None req-bed2438d-754d-412a-bb0c-f00ddb953f27 tempest-VolumesAssistedSnapshotsTest-2081262095 tempest-VolumesAssistedSnapshotsTest-2081262095-project-admin] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 91a551b6-8688-4bb9-a45d-a913a0794964 could not be found.
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver     raise value
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver 
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver 
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 91a551b6-8688-4bb9-a45d-a913a0794964 could not be found. (HTTP 404) (Request-ID: req-028cfaf8-e151-4038-9957-6e6d6e8107bd)
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver 
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver 
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 91a551b6-8688-4bb9-a45d-a913a0794964 could not be found.
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver 
Aug 17 11:42:40 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WroVHtXa" returned: 0 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:40 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d7ab195-9a50-43f9-81e0-f693f8f75177]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:40 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-50636221-6eed-4a0c-8934-87e4f120b315 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WroVHtXa'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:42:40 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:40 user nova-compute[73449]: ERROR oslo_messaging.rpc.server [None req-bed2438d-754d-412a-bb0c-f00ddb953f27 tempest-VolumesAssistedSnapshotsTest-2081262095 tempest-VolumesAssistedSnapshotsTest-2081262095-project-admin] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 17 11:42:40 user nova-compute[73449]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 17 11:42:40 user nova-compute[73449]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 17 11:42:40 user nova-compute[73449]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 17 11:42:40 user nova-compute[73449]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 17 11:42:40 user nova-compute[73449]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 17 11:42:40 user nova-compute[73449]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 17 11:42:40 user nova-compute[73449]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 17 11:42:40 user nova-compute[73449]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 17 11:42:40 user nova-compute[73449]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 17 11:42:40 user nova-compute[73449]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 17 11:42:40 user nova-compute[73449]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 17 11:42:40 user nova-compute[73449]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 17 11:42:40 user nova-compute[73449]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 17 11:42:40 user nova-compute[73449]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 17 11:42:40 user nova-compute[73449]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 17 11:42:40 user nova-compute[73449]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 17 11:42:40 user nova-compute[73449]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 17 11:42:40 user nova-compute[73449]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4425, in volume_snapshot_create
Aug 17 11:42:40 user nova-compute[73449]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Aug 17 11:42:40 user nova-compute[73449]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3587, in volume_snapshot_create
Aug 17 11:42:40 user nova-compute[73449]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 17 11:42:40 user nova-compute[73449]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 17 11:42:40 user nova-compute[73449]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 17 11:42:40 user nova-compute[73449]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 17 11:42:40 user nova-compute[73449]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 17 11:42:40 user nova-compute[73449]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 17 11:42:40 user nova-compute[73449]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Aug 17 11:42:40 user nova-compute[73449]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 17 11:42:40 user nova-compute[73449]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 17 11:42:40 user nova-compute[73449]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 17 11:42:40 user nova-compute[73449]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 17 11:42:40 user nova-compute[73449]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 17 11:42:40 user nova-compute[73449]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 17 11:42:40 user nova-compute[73449]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 17 11:42:40 user nova-compute[73449]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Aug 17 11:42:40 user nova-compute[73449]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 17 11:42:40 user nova-compute[73449]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Aug 17 11:42:40 user nova-compute[73449]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 17 11:42:40 user nova-compute[73449]: ERROR oslo_messaging.rpc.server     raise value
Aug 17 11:42:40 user nova-compute[73449]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 17 11:42:40 user nova-compute[73449]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Aug 17 11:42:40 user nova-compute[73449]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 17 11:42:40 user nova-compute[73449]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 17 11:42:40 user nova-compute[73449]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 17 11:42:40 user nova-compute[73449]: ERROR oslo_messaging.rpc.server 
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver [None req-01f3cdef-e3fc-47e3-90f4-3bbc6ae29002 tempest-VolumesAssistedSnapshotsTest-2081262095 tempest-VolumesAssistedSnapshotsTest-2081262095-project-admin] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver 
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver 
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-0a6edf78-2b9e-480c-a792-5bb18a5061ef)
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver 
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver 
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 17 11:42:40 user nova-compute[73449]: ERROR nova.virt.libvirt.driver 
Aug 17 11:42:40 user nova-compute[73449]: ERROR oslo_messaging.rpc.server [None req-01f3cdef-e3fc-47e3-90f4-3bbc6ae29002 tempest-VolumesAssistedSnapshotsTest-2081262095 tempest-VolumesAssistedSnapshotsTest-2081262095-project-admin] Exception during message handling: KeyError: 'type'
Aug 17 11:42:40 user nova-compute[73449]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 17 11:42:40 user nova-compute[73449]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 17 11:42:40 user nova-compute[73449]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 17 11:42:40 user nova-compute[73449]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 17 11:42:40 user nova-compute[73449]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 17 11:42:40 user nova-compute[73449]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 17 11:42:40 user nova-compute[73449]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 17 11:42:40 user nova-compute[73449]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 17 11:42:40 user nova-compute[73449]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 17 11:42:40 user nova-compute[73449]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 17 11:42:40 user nova-compute[73449]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 17 11:42:40 user nova-compute[73449]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 17 11:42:40 user nova-compute[73449]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 17 11:42:40 user nova-compute[73449]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 17 11:42:40 user nova-compute[73449]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 17 11:42:40 user nova-compute[73449]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 17 11:42:40 user nova-compute[73449]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 17 11:42:40 user nova-compute[73449]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4437, in volume_snapshot_delete
Aug 17 11:42:40 user nova-compute[73449]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Aug 17 11:42:40 user nova-compute[73449]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3843, in volume_snapshot_delete
Aug 17 11:42:40 user nova-compute[73449]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 17 11:42:40 user nova-compute[73449]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 17 11:42:40 user nova-compute[73449]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 17 11:42:40 user nova-compute[73449]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 17 11:42:40 user nova-compute[73449]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 17 11:42:40 user nova-compute[73449]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 17 11:42:40 user nova-compute[73449]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Aug 17 11:42:40 user nova-compute[73449]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 17 11:42:40 user nova-compute[73449]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Aug 17 11:42:40 user nova-compute[73449]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Aug 17 11:42:40 user nova-compute[73449]: ERROR oslo_messaging.rpc.server 
Aug 17 11:42:40 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.031s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:40 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f386b36-b85d-4d19-8beb-88f9d64b4592]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:40 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-50636221-6eed-4a0c-8934-87e4f120b315 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:42:40 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:40 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:40 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed8f9882-4b20-405f-83df-02ca31d7de3a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76db2114-4742-4d02-91c7-676fcc3c838c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3394c5c3-2ff2-4a87-8470-614418b70b21 (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:40 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-50636221-6eed-4a0c-8934-87e4f120b315 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76db2114-4742-4d02-91c7-676fcc3c838c (non-flash)
Aug 17 11:42:40 user nova-compute[73449]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919 (non-flash)
Aug 17 11:42:40 user nova-compute[73449]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47 (non-flash)
Aug 17 11:42:40 user nova-compute[73449]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda (non-flash)
Aug 17 11:42:40 user nova-compute[73449]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e (non-flash)
Aug 17 11:42:40 user nova-compute[73449]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff (non-flash)
Aug 17 11:42:40 user nova-compute[73449]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd (non-flash)
Aug 17 11:42:40 user nova-compute[73449]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3394c5c3-2ff2-4a87-8470-614418b70b21 (non-flash)
Aug 17 11:42:40 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:42:40 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-50636221-6eed-4a0c-8934-87e4f120b315 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76db2114-4742-4d02-91c7-676fcc3c838c (non-flash)
Aug 17 11:42:40 user nova-compute[73449]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919 (non-flash)
Aug 17 11:42:40 user nova-compute[73449]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47 (non-flash)
Aug 17 11:42:40 user nova-compute[73449]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda (non-flash)
Aug 17 11:42:40 user nova-compute[73449]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e (non-flash)
Aug 17 11:42:40 user nova-compute[73449]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff (non-flash)
Aug 17 11:42:40 user nova-compute[73449]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd (non-flash)
Aug 17 11:42:40 user nova-compute[73449]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3394c5c3-2ff2-4a87-8470-614418b70b21 (non-flash)
Aug 17 11:42:40 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:42:40 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c -p 172.16.0.220:3260 --login {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:40 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c -p 172.16.0.220:3260 --login" returned: 0 in 0.102s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:40 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fb278d2-b266-4462-b62e-e7e55dd23337]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:40 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-50636221-6eed-4a0c-8934-87e4f120b315 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c, portal: 172.16.0.220,3260]
Aug 17 11:42:40 user nova-compute[73449]: Login to [iface: default, target: iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c, portal: 172.16.0.220,3260] successful.
Aug 17 11:42:40 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:42:40 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:40 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.031s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:40 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c3db880-30d6-4f93-a5d6-c0ac7bc203ab]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:40 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-50636221-6eed-4a0c-8934-87e4f120b315 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:42:40 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:40 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:40 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d82921a-b420-4415-b083-3c65d76e3f28]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76db2114-4742-4d02-91c7-676fcc3c838c (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3394c5c3-2ff2-4a87-8470-614418b70b21 (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:40 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-50636221-6eed-4a0c-8934-87e4f120b315 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76db2114-4742-4d02-91c7-676fcc3c838c (non-flash)
Aug 17 11:42:40 user nova-compute[73449]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c (non-flash)
Aug 17 11:42:40 user nova-compute[73449]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919 (non-flash)
Aug 17 11:42:40 user nova-compute[73449]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47 (non-flash)
Aug 17 11:42:40 user nova-compute[73449]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda (non-flash)
Aug 17 11:42:40 user nova-compute[73449]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e (non-flash)
Aug 17 11:42:40 user nova-compute[73449]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff (non-flash)
Aug 17 11:42:40 user nova-compute[73449]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd (non-flash)
Aug 17 11:42:40 user nova-compute[73449]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3394c5c3-2ff2-4a87-8470-614418b70b21 (non-flash)
Aug 17 11:42:40 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:42:40 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-50636221-6eed-4a0c-8934-87e4f120b315 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76db2114-4742-4d02-91c7-676fcc3c838c (non-flash)
Aug 17 11:42:40 user nova-compute[73449]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c (non-flash)
Aug 17 11:42:40 user nova-compute[73449]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919 (non-flash)
Aug 17 11:42:40 user nova-compute[73449]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47 (non-flash)
Aug 17 11:42:40 user nova-compute[73449]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda (non-flash)
Aug 17 11:42:40 user nova-compute[73449]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e (non-flash)
Aug 17 11:42:40 user nova-compute[73449]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff (non-flash)
Aug 17 11:42:40 user nova-compute[73449]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd (non-flash)
Aug 17 11:42:40 user nova-compute[73449]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3394c5c3-2ff2-4a87-8470-614418b70b21 (non-flash)
Aug 17 11:42:40 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:42:40 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-50636221-6eed-4a0c-8934-87e4f120b315 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.445s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:42:40 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-50636221-6eed-4a0c-8934-87e4f120b315 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] Connected to 172.16.0.220:3260 {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 11:42:40 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-50636221-6eed-4a0c-8934-87e4f120b315 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] HCTL ('41', '-', '-', 0) found on session 11 with lun 0 {{(pid=73449) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 11:42:40 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-50636221-6eed-4a0c-8934-87e4f120b315 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=73449) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 11:42:40 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:40 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.036s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:40 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a92efee-f315-4777-85d4-f244d6ff035d]: (4, ('- - 0', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:40 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-50636221-6eed-4a0c-8934-87e4f120b315 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] Searching for a device in session 11 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=73449) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 11:42:40 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-50636221-6eed-4a0c-8934-87e4f120b315 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] Connected to sdj using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WroVHtXa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 11:42:40 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-06f175d5-d22c-4c1a-8778-d57faf5fd856 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] No BDM found with device name vda, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 11:42:40 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-06f175d5-d22c-4c1a-8778-d57faf5fd856 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 11:42:40 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-06f175d5-d22c-4c1a-8778-d57faf5fd856 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] No VIF found with MAC fa:16:3e:de:a4:f4, not building metadata {{(pid=73449) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 11:42:40 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b8d30d51-46c0-4285-ad1d-d4ad4c736293 tempest-VolumesAssistedSnapshotsTest-2081262095 tempest-VolumesAssistedSnapshotsTest-2081262095-project-admin] Acquiring lock "fd8d4549-db8f-4c74-8706-8ac21f049c2e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:42:40 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b8d30d51-46c0-4285-ad1d-d4ad4c736293 tempest-VolumesAssistedSnapshotsTest-2081262095 tempest-VolumesAssistedSnapshotsTest-2081262095-project-admin] Lock "fd8d4549-db8f-4c74-8706-8ac21f049c2e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:42:40 user nova-compute[73449]: INFO nova.compute.manager [None req-b8d30d51-46c0-4285-ad1d-d4ad4c736293 tempest-VolumesAssistedSnapshotsTest-2081262095 tempest-VolumesAssistedSnapshotsTest-2081262095-project-admin] [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e] Detaching volume 3394c5c3-2ff2-4a87-8470-614418b70b21
Aug 17 11:42:40 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-06f175d5-d22c-4c1a-8778-d57faf5fd856 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Lock "fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.467s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:42:41 user nova-compute[73449]: INFO nova.virt.block_device [None req-b8d30d51-46c0-4285-ad1d-d4ad4c736293 tempest-VolumesAssistedSnapshotsTest-2081262095 tempest-VolumesAssistedSnapshotsTest-2081262095-project-admin] [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e] Attempting to driver detach volume 3394c5c3-2ff2-4a87-8470-614418b70b21 from mountpoint /dev/vdb
Aug 17 11:42:41 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b8d30d51-46c0-4285-ad1d-d4ad4c736293 tempest-VolumesAssistedSnapshotsTest-2081262095 tempest-VolumesAssistedSnapshotsTest-2081262095-project-admin] Attempting to detach device vdb from instance fd8d4549-db8f-4c74-8706-8ac21f049c2e from the persistent domain config. {{(pid=73449) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 11:42:41 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-b8d30d51-46c0-4285-ad1d-d4ad4c736293 tempest-VolumesAssistedSnapshotsTest-2081262095 tempest-VolumesAssistedSnapshotsTest-2081262095-project-admin] detach device xml: <disk type="block" device="disk">
Aug 17 11:42:41 user nova-compute[73449]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 11:42:41 user nova-compute[73449]:   <source dev="/dev/sdh"/>
Aug 17 11:42:41 user nova-compute[73449]:   <target dev="vdb" bus="virtio"/>
Aug 17 11:42:41 user nova-compute[73449]:   <serial>3394c5c3-2ff2-4a87-8470-614418b70b21</serial>
Aug 17 11:42:41 user nova-compute[73449]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 11:42:41 user nova-compute[73449]: </disk>
Aug 17 11:42:41 user nova-compute[73449]:  {{(pid=73449) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 11:42:41 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-b8d30d51-46c0-4285-ad1d-d4ad4c736293 tempest-VolumesAssistedSnapshotsTest-2081262095 tempest-VolumesAssistedSnapshotsTest-2081262095-project-admin] Successfully detached device vdb from instance fd8d4549-db8f-4c74-8706-8ac21f049c2e from the persistent domain config.
Aug 17 11:42:41 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b8d30d51-46c0-4285-ad1d-d4ad4c736293 tempest-VolumesAssistedSnapshotsTest-2081262095 tempest-VolumesAssistedSnapshotsTest-2081262095-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fd8d4549-db8f-4c74-8706-8ac21f049c2e from the live domain config. {{(pid=73449) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 11:42:41 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-b8d30d51-46c0-4285-ad1d-d4ad4c736293 tempest-VolumesAssistedSnapshotsTest-2081262095 tempest-VolumesAssistedSnapshotsTest-2081262095-project-admin] detach device xml: <disk type="block" device="disk">
Aug 17 11:42:41 user nova-compute[73449]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 11:42:41 user nova-compute[73449]:   <source dev="/dev/sdh"/>
Aug 17 11:42:41 user nova-compute[73449]:   <target dev="vdb" bus="virtio"/>
Aug 17 11:42:41 user nova-compute[73449]:   <serial>3394c5c3-2ff2-4a87-8470-614418b70b21</serial>
Aug 17 11:42:41 user nova-compute[73449]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 11:42:41 user nova-compute[73449]: </disk>
Aug 17 11:42:41 user nova-compute[73449]:  {{(pid=73449) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 11:42:41 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Received event <DeviceRemovedEvent: 1692272561.5608962, fd8d4549-db8f-4c74-8706-8ac21f049c2e => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73449) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 11:42:41 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b8d30d51-46c0-4285-ad1d-d4ad4c736293 tempest-VolumesAssistedSnapshotsTest-2081262095 tempest-VolumesAssistedSnapshotsTest-2081262095-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fd8d4549-db8f-4c74-8706-8ac21f049c2e {{(pid=73449) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 11:42:41 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-b8d30d51-46c0-4285-ad1d-d4ad4c736293 tempest-VolumesAssistedSnapshotsTest-2081262095 tempest-VolumesAssistedSnapshotsTest-2081262095-project-admin] Successfully detached device vdb from instance fd8d4549-db8f-4c74-8706-8ac21f049c2e from the live domain config.
Aug 17 11:42:41 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8d30d51-46c0-4285-ad1d-d4ad4c736293 tempest-VolumesAssistedSnapshotsTest-2081262095 tempest-VolumesAssistedSnapshotsTest-2081262095-project-admin] [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e] calling os-brick to detach iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 11:42:41 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8d30d51-46c0-4285-ad1d-d4ad4c736293 tempest-VolumesAssistedSnapshotsTest-2081262095 tempest-VolumesAssistedSnapshotsTest-2081262095-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, {'target_iqns': ['iqn.2010-10.org.openstack:3394c5c3-2ff2-4a87-8470-614418b70b21'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qWSHUaoe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 11:42:41 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-b8d30d51-46c0-4285-ad1d-d4ad4c736293 tempest-VolumesAssistedSnapshotsTest-2081262095 tempest-VolumesAssistedSnapshotsTest-2081262095-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 11:42:41 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-b8d30d51-46c0-4285-ad1d-d4ad4c736293 tempest-VolumesAssistedSnapshotsTest-2081262095 tempest-VolumesAssistedSnapshotsTest-2081262095-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:42:41 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-50636221-6eed-4a0c-8934-87e4f120b315 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.503s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:42:41 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-50636221-6eed-4a0c-8934-87e4f120b315 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] <== connect_volume: return (2824ms) {'type': 'block', 'scsi_wwn': '26235393365333831', 'path': '/dev/sdj'} {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 11:42:41 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50636221-6eed-4a0c-8934-87e4f120b315 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] [instance: c7ef11da-09ce-47a1-ba56-02af6a77206c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26235393365333831', 'path': '/dev/sdj'} {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 11:42:41 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-b8d30d51-46c0-4285-ad1d-d4ad4c736293 tempest-VolumesAssistedSnapshotsTest-2081262095 tempest-VolumesAssistedSnapshotsTest-2081262095-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.108s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:42:41 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8d30d51-46c0-4285-ad1d-d4ad4c736293 tempest-VolumesAssistedSnapshotsTest-2081262095 tempest-VolumesAssistedSnapshotsTest-2081262095-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3394c5c3-2ff2-4a87-8470-614418b70b21', 0)] {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 11:42:41 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:41 user nova-compute[73449]: DEBUG nova.objects.instance [None req-50636221-6eed-4a0c-8934-87e4f120b315 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] Lazy-loading 'flavor' on Instance uuid c7ef11da-09ce-47a1-ba56-02af6a77206c {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:42:41 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:41 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[78cb07de-e4db-43e5-be20-3fd38467df54]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3394c5c3-2ff2-4a87-8470-614418b70b21\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:76db2114-4742-4d02-91c7-676fcc3c838c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:41 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:41 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-50636221-6eed-4a0c-8934-87e4f120b315 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 11:42:41 user nova-compute[73449]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 11:42:41 user nova-compute[73449]:   <source dev="/dev/sdj"/>
Aug 17 11:42:41 user nova-compute[73449]:   <target dev="vdb" bus="virtio"/>
Aug 17 11:42:41 user nova-compute[73449]:   <serial>8a554c8d-34fa-4557-a6e0-2dfdc32a161c</serial>
Aug 17 11:42:41 user nova-compute[73449]: </disk>
Aug 17 11:42:41 user nova-compute[73449]:  {{(pid=73449) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 11:42:41 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:41 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d4f9b65-d26c-4087-a295-724b96384df4]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76db2114-4742-4d02-91c7-676fcc3c838c (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3394c5c3-2ff2-4a87-8470-614418b70b21 (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:41 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8d30d51-46c0-4285-ad1d-d4ad4c736293 tempest-VolumesAssistedSnapshotsTest-2081262095 tempest-VolumesAssistedSnapshotsTest-2081262095-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76db2114-4742-4d02-91c7-676fcc3c838c (non-flash)
Aug 17 11:42:41 user nova-compute[73449]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c (non-flash)
Aug 17 11:42:41 user nova-compute[73449]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919 (non-flash)
Aug 17 11:42:41 user nova-compute[73449]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47 (non-flash)
Aug 17 11:42:41 user nova-compute[73449]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda (non-flash)
Aug 17 11:42:41 user nova-compute[73449]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e (non-flash)
Aug 17 11:42:41 user nova-compute[73449]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff (non-flash)
Aug 17 11:42:41 user nova-compute[73449]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd (non-flash)
Aug 17 11:42:41 user nova-compute[73449]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3394c5c3-2ff2-4a87-8470-614418b70b21 (non-flash)
Aug 17 11:42:41 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:42:41 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8d30d51-46c0-4285-ad1d-d4ad4c736293 tempest-VolumesAssistedSnapshotsTest-2081262095 tempest-VolumesAssistedSnapshotsTest-2081262095-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76db2114-4742-4d02-91c7-676fcc3c838c (non-flash)
Aug 17 11:42:41 user nova-compute[73449]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c (non-flash)
Aug 17 11:42:41 user nova-compute[73449]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919 (non-flash)
Aug 17 11:42:41 user nova-compute[73449]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47 (non-flash)
Aug 17 11:42:41 user nova-compute[73449]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda (non-flash)
Aug 17 11:42:41 user nova-compute[73449]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e (non-flash)
Aug 17 11:42:41 user nova-compute[73449]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff (non-flash)
Aug 17 11:42:41 user nova-compute[73449]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd (non-flash)
Aug 17 11:42:41 user nova-compute[73449]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3394c5c3-2ff2-4a87-8470-614418b70b21 (non-flash)
Aug 17 11:42:41 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:42:41 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8d30d51-46c0-4285-ad1d-d4ad4c736293 tempest-VolumesAssistedSnapshotsTest-2081262095 tempest-VolumesAssistedSnapshotsTest-2081262095-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe7586a8310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3394c5c3-2ff2-4a87-8470-614418b70b21'): ({'sdh'}, set())}) {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 11:42:41 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-b8d30d51-46c0-4285-ad1d-d4ad4c736293 tempest-VolumesAssistedSnapshotsTest-2081262095 tempest-VolumesAssistedSnapshotsTest-2081262095-project-admin] Removing single pathed devices sdh {{(pid=73449) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 11:42:41 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:41 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:41 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e39824e-4a94-47c9-a72a-b751222bde93]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:41 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:41 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:41 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[108115bc-8177-4f0d-b9e3-1533677f2eb5]: (4, ('ok\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:41 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-b8d30d51-46c0-4285-ad1d-d4ad4c736293 tempest-VolumesAssistedSnapshotsTest-2081262095 tempest-VolumesAssistedSnapshotsTest-2081262095-project-admin] Flushing IO for device /dev/sdh {{(pid=73449) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 11:42:41 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:41 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.014s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:41 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[83b0800f-d2d4-4719-837c-e7dfd604bae9]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:41 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-b8d30d51-46c0-4285-ad1d-d4ad4c736293 tempest-VolumesAssistedSnapshotsTest-2081262095 tempest-VolumesAssistedSnapshotsTest-2081262095-project-admin] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=73449) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 11:42:41 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:41 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.048s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:41 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[0320d2aa-e8d9-43a0-b334-35d75deb62c1]: (4, ('1', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:41 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-b8d30d51-46c0-4285-ad1d-d4ad4c736293 tempest-VolumesAssistedSnapshotsTest-2081262095 tempest-VolumesAssistedSnapshotsTest-2081262095-project-admin] Checking to see if SCSI volumes sdh have been removed. {{(pid=73449) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 11:42:41 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-b8d30d51-46c0-4285-ad1d-d4ad4c736293 tempest-VolumesAssistedSnapshotsTest-2081262095 tempest-VolumesAssistedSnapshotsTest-2081262095-project-admin] SCSI volumes sdh have been removed. {{(pid=73449) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 11:42:41 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8d30d51-46c0-4285-ad1d-d4ad4c736293 tempest-VolumesAssistedSnapshotsTest-2081262095 tempest-VolumesAssistedSnapshotsTest-2081262095-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3394c5c3-2ff2-4a87-8470-614418b70b21')] {{(pid=73449) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 11:42:41 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3394c5c3-2ff2-4a87-8470-614418b70b21 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:41 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3394c5c3-2ff2-4a87-8470-614418b70b21 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:41 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[95f72004-bc05-447e-864e-169ff79f3bd5]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:41 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8d30d51-46c0-4285-ad1d-d4ad4c736293 tempest-VolumesAssistedSnapshotsTest-2081262095 tempest-VolumesAssistedSnapshotsTest-2081262095-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:42:41 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3394c5c3-2ff2-4a87-8470-614418b70b21 -p 172.16.0.220:3260 --logout {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:41 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:41 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-e2374ba7-4680-49ac-a12a-5d3bfa4bdd59 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Acquiring lock "fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:42:41 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-e2374ba7-4680-49ac-a12a-5d3bfa4bdd59 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Lock "fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:42:41 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:42:41 user nova-compute[73449]: INFO nova.compute.manager [None req-e2374ba7-4680-49ac-a12a-5d3bfa4bdd59 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] [instance: fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2] Detaching volume 76db2114-4742-4d02-91c7-676fcc3c838c
Aug 17 11:42:42 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3394c5c3-2ff2-4a87-8470-614418b70b21 -p 172.16.0.220:3260 --logout" returned: 0 in 0.097s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:42 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[48ababef-a634-4f6c-8fcb-620b504c6f54]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:3394c5c3-2ff2-4a87-8470-614418b70b21, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:3394c5c3-2ff2-4a87-8470-614418b70b21, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:42 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8d30d51-46c0-4285-ad1d-d4ad4c736293 tempest-VolumesAssistedSnapshotsTest-2081262095 tempest-VolumesAssistedSnapshotsTest-2081262095-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:3394c5c3-2ff2-4a87-8470-614418b70b21, portal: 172.16.0.220,3260]
Aug 17 11:42:42 user nova-compute[73449]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:3394c5c3-2ff2-4a87-8470-614418b70b21, portal: 172.16.0.220,3260] successful.
Aug 17 11:42:42 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:42:42 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3394c5c3-2ff2-4a87-8470-614418b70b21 -p 172.16.0.220:3260 --op delete {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:42 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3394c5c3-2ff2-4a87-8470-614418b70b21 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.041s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:42 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e448d38-87e1-408e-8e5c-5fa80c317a37]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:42 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8d30d51-46c0-4285-ad1d-d4ad4c736293 tempest-VolumesAssistedSnapshotsTest-2081262095 tempest-VolumesAssistedSnapshotsTest-2081262095-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:42:42 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-b8d30d51-46c0-4285-ad1d-d4ad4c736293 tempest-VolumesAssistedSnapshotsTest-2081262095 tempest-VolumesAssistedSnapshotsTest-2081262095-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.376s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:42:42 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8d30d51-46c0-4285-ad1d-d4ad4c736293 tempest-VolumesAssistedSnapshotsTest-2081262095 tempest-VolumesAssistedSnapshotsTest-2081262095-project-admin] <== disconnect_volume: return (484ms) None {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 11:42:42 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8d30d51-46c0-4285-ad1d-d4ad4c736293 tempest-VolumesAssistedSnapshotsTest-2081262095 tempest-VolumesAssistedSnapshotsTest-2081262095-project-admin] [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e] Disconnected iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 11:42:42 user nova-compute[73449]: INFO nova.virt.block_device [None req-e2374ba7-4680-49ac-a12a-5d3bfa4bdd59 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] [instance: fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2] Attempting to driver detach volume 76db2114-4742-4d02-91c7-676fcc3c838c from mountpoint /dev/vdb
Aug 17 11:42:42 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-e2374ba7-4680-49ac-a12a-5d3bfa4bdd59 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Attempting to detach device vdb from instance fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2 from the persistent domain config. {{(pid=73449) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 11:42:42 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-e2374ba7-4680-49ac-a12a-5d3bfa4bdd59 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 11:42:42 user nova-compute[73449]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 11:42:42 user nova-compute[73449]:   <source dev="/dev/sdi"/>
Aug 17 11:42:42 user nova-compute[73449]:   <target dev="vdb" bus="virtio"/>
Aug 17 11:42:42 user nova-compute[73449]:   <serial>76db2114-4742-4d02-91c7-676fcc3c838c</serial>
Aug 17 11:42:42 user nova-compute[73449]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 11:42:42 user nova-compute[73449]: </disk>
Aug 17 11:42:42 user nova-compute[73449]:  {{(pid=73449) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 11:42:42 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-e2374ba7-4680-49ac-a12a-5d3bfa4bdd59 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Successfully detached device vdb from instance fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2 from the persistent domain config.
Aug 17 11:42:42 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-e2374ba7-4680-49ac-a12a-5d3bfa4bdd59 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2 from the live domain config. {{(pid=73449) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 11:42:42 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-e2374ba7-4680-49ac-a12a-5d3bfa4bdd59 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 11:42:42 user nova-compute[73449]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 11:42:42 user nova-compute[73449]:   <source dev="/dev/sdi"/>
Aug 17 11:42:42 user nova-compute[73449]:   <target dev="vdb" bus="virtio"/>
Aug 17 11:42:42 user nova-compute[73449]:   <serial>76db2114-4742-4d02-91c7-676fcc3c838c</serial>
Aug 17 11:42:42 user nova-compute[73449]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 11:42:42 user nova-compute[73449]: </disk>
Aug 17 11:42:42 user nova-compute[73449]:  {{(pid=73449) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 11:42:42 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-50636221-6eed-4a0c-8934-87e4f120b315 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] No BDM found with device name vda, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 11:42:42 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-50636221-6eed-4a0c-8934-87e4f120b315 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 11:42:42 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-50636221-6eed-4a0c-8934-87e4f120b315 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] No VIF found with MAC fa:16:3e:3b:b6:03, not building metadata {{(pid=73449) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 11:42:42 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:42 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-50636221-6eed-4a0c-8934-87e4f120b315 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] Lock "c7ef11da-09ce-47a1-ba56-02af6a77206c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.254s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:42:42 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Received event <DeviceRemovedEvent: 1692272562.6074324, fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73449) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 11:42:42 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-e2374ba7-4680-49ac-a12a-5d3bfa4bdd59 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2 {{(pid=73449) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 11:42:42 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-e2374ba7-4680-49ac-a12a-5d3bfa4bdd59 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Successfully detached device vdb from instance fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2 from the live domain config.
Aug 17 11:42:42 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2374ba7-4680-49ac-a12a-5d3bfa4bdd59 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] [instance: fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2] calling os-brick to detach iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 11:42:42 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2374ba7-4680-49ac-a12a-5d3bfa4bdd59 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, {'target_iqns': ['iqn.2010-10.org.openstack:76db2114-4742-4d02-91c7-676fcc3c838c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GuFnpiKc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 11:42:42 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-e2374ba7-4680-49ac-a12a-5d3bfa4bdd59 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 11:42:42 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-e2374ba7-4680-49ac-a12a-5d3bfa4bdd59 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:42:42 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-e2374ba7-4680-49ac-a12a-5d3bfa4bdd59 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:42:42 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2374ba7-4680-49ac-a12a-5d3bfa4bdd59 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:76db2114-4742-4d02-91c7-676fcc3c838c', 0)] {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 11:42:42 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:42 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:42 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[17a587d1-168b-455c-a752-1cb91bcf8895]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:76db2114-4742-4d02-91c7-676fcc3c838c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:42 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:42 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:42 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[71d466f0-7013-473f-9b1e-56c45429fd1b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76db2114-4742-4d02-91c7-676fcc3c838c (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:42 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2374ba7-4680-49ac-a12a-5d3bfa4bdd59 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76db2114-4742-4d02-91c7-676fcc3c838c (non-flash)
Aug 17 11:42:42 user nova-compute[73449]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c (non-flash)
Aug 17 11:42:42 user nova-compute[73449]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919 (non-flash)
Aug 17 11:42:42 user nova-compute[73449]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47 (non-flash)
Aug 17 11:42:42 user nova-compute[73449]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda (non-flash)
Aug 17 11:42:42 user nova-compute[73449]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e (non-flash)
Aug 17 11:42:42 user nova-compute[73449]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff (non-flash)
Aug 17 11:42:42 user nova-compute[73449]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd (non-flash)
Aug 17 11:42:42 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:42:42 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2374ba7-4680-49ac-a12a-5d3bfa4bdd59 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76db2114-4742-4d02-91c7-676fcc3c838c (non-flash)
Aug 17 11:42:42 user nova-compute[73449]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c (non-flash)
Aug 17 11:42:42 user nova-compute[73449]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919 (non-flash)
Aug 17 11:42:42 user nova-compute[73449]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47 (non-flash)
Aug 17 11:42:42 user nova-compute[73449]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda (non-flash)
Aug 17 11:42:42 user nova-compute[73449]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e (non-flash)
Aug 17 11:42:42 user nova-compute[73449]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff (non-flash)
Aug 17 11:42:42 user nova-compute[73449]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd (non-flash)
Aug 17 11:42:42 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:42:42 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2374ba7-4680-49ac-a12a-5d3bfa4bdd59 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe7582b5c60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:76db2114-4742-4d02-91c7-676fcc3c838c'): ({'sdi'}, set())}) {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 11:42:42 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-e2374ba7-4680-49ac-a12a-5d3bfa4bdd59 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Removing single pathed devices sdi {{(pid=73449) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 11:42:42 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:42 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:42 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[48e9e781-8c05-40a7-841e-8497110b3f3a]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:42 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:42 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.021s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:42 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cf53161-d950-4f95-9e35-171d2ef42b03]: (4, ('ok\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:42 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-e2374ba7-4680-49ac-a12a-5d3bfa4bdd59 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Flushing IO for device /dev/sdi {{(pid=73449) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 11:42:42 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:42 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.016s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:42 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0a124fe-dc2c-4cc0-ba7c-6f95f162bb6e]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:42 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-e2374ba7-4680-49ac-a12a-5d3bfa4bdd59 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=73449) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 11:42:42 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:42 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.055s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:42 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba1fc06f-3e05-46b3-b7bb-52d989fc6d0d]: (4, ('1', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:42 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-e2374ba7-4680-49ac-a12a-5d3bfa4bdd59 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=73449) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 11:42:42 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-e2374ba7-4680-49ac-a12a-5d3bfa4bdd59 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] SCSI volumes sdi have been removed. {{(pid=73449) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 11:42:42 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2374ba7-4680-49ac-a12a-5d3bfa4bdd59 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:76db2114-4742-4d02-91c7-676fcc3c838c')] {{(pid=73449) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 11:42:42 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76db2114-4742-4d02-91c7-676fcc3c838c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:42 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76db2114-4742-4d02-91c7-676fcc3c838c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.084s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:42 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a1701ba-eb8b-429b-9cdf-7de035e0b0e7]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:42 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2374ba7-4680-49ac-a12a-5d3bfa4bdd59 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:42:42 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76db2114-4742-4d02-91c7-676fcc3c838c -p 172.16.0.220:3260 --logout {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:43 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76db2114-4742-4d02-91c7-676fcc3c838c -p 172.16.0.220:3260 --logout" returned: 0 in 0.120s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:43 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[e72aa7c7-843e-4317-b501-83323ca8804f]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:76db2114-4742-4d02-91c7-676fcc3c838c, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:76db2114-4742-4d02-91c7-676fcc3c838c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:43 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2374ba7-4680-49ac-a12a-5d3bfa4bdd59 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:76db2114-4742-4d02-91c7-676fcc3c838c, portal: 172.16.0.220,3260]
Aug 17 11:42:43 user nova-compute[73449]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:76db2114-4742-4d02-91c7-676fcc3c838c, portal: 172.16.0.220,3260] successful.
Aug 17 11:42:43 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:42:43 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76db2114-4742-4d02-91c7-676fcc3c838c -p 172.16.0.220:3260 --op delete {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:43 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76db2114-4742-4d02-91c7-676fcc3c838c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.041s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:43 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[276d3e9b-eec8-48b5-8af7-8e01bf0bf208]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:43 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2374ba7-4680-49ac-a12a-5d3bfa4bdd59 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:42:43 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-e2374ba7-4680-49ac-a12a-5d3bfa4bdd59 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.457s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:42:43 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2374ba7-4680-49ac-a12a-5d3bfa4bdd59 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] <== disconnect_volume: return (459ms) None {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 11:42:43 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2374ba7-4680-49ac-a12a-5d3bfa4bdd59 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] [instance: fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2] Disconnected iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 11:42:43 user nova-compute[73449]: DEBUG nova.objects.instance [None req-b8d30d51-46c0-4285-ad1d-d4ad4c736293 tempest-VolumesAssistedSnapshotsTest-2081262095 tempest-VolumesAssistedSnapshotsTest-2081262095-project-admin] Lazy-loading 'flavor' on Instance uuid fd8d4549-db8f-4c74-8706-8ac21f049c2e {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:42:43 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b8d30d51-46c0-4285-ad1d-d4ad4c736293 tempest-VolumesAssistedSnapshotsTest-2081262095 tempest-VolumesAssistedSnapshotsTest-2081262095-project-admin] Lock "fd8d4549-db8f-4c74-8706-8ac21f049c2e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.572s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:42:44 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-ca93d778-ed2b-4c2e-aacd-21f40f95e4da tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] Acquiring lock "c7ef11da-09ce-47a1-ba56-02af6a77206c" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:42:44 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-ca93d778-ed2b-4c2e-aacd-21f40f95e4da tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] Lock "c7ef11da-09ce-47a1-ba56-02af6a77206c" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:42:44 user nova-compute[73449]: DEBUG os_brick.utils [None req-ca93d778-ed2b-4c2e-aacd-21f40f95e4da tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 11:42:44 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:44 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f904909b-2f51-4e5a-9cd4-06f7a15e7f63 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] [instance: 7d3e07fa-4823-48e9-a959-e7bac0e0b25b] Calling os-brick to attach iSCSI Volume {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 11:42:44 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-f904909b-2f51-4e5a-9cd4-06f7a15e7f63 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:70aee407-774e-4938-9128-27f568d7486d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JKkbidEQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 11:42:44 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-f904909b-2f51-4e5a-9cd4-06f7a15e7f63 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 11:42:44 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-f904909b-2f51-4e5a-9cd4-06f7a15e7f63 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:42:44 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-f904909b-2f51-4e5a-9cd4-06f7a15e7f63 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:42:44 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-f904909b-2f51-4e5a-9cd4-06f7a15e7f63 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 11:42:44 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-f904909b-2f51-4e5a-9cd4-06f7a15e7f63 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:70aee407-774e-4938-9128-27f568d7486d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:42:44 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-f904909b-2f51-4e5a-9cd4-06f7a15e7f63 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:70aee407-774e-4938-9128-27f568d7486d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:42:44 user nova-compute[73449]: INFO os_brick.initiator.connectors.iscsi [None req-f904909b-2f51-4e5a-9cd4-06f7a15e7f63 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 11:42:44 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:44 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4703414-5022-44a3-90f8-504bd957de5e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4d3924302012\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:44 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70aee407-774e-4938-9128-27f568d7486d -p 172.16.0.220:3260 {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:44 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:44 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70aee407-774e-4938-9128-27f568d7486d -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:44 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb82679d-5ff8-4a1f-aace-e8514608d956]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:44 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-f904909b-2f51-4e5a-9cd4-06f7a15e7f63 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 11:42:44 user nova-compute[73449]:  {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:42:44 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70aee407-774e-4938-9128-27f568d7486d -p 172.16.0.220:3260 --interface default --op new {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:44 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.025s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:44 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fc2e357-5ad8-4c13-805f-10c36f34e1cc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:44 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:44 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70aee407-774e-4938-9128-27f568d7486d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:44 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[23befed5-bcdf-4e5c-8e19-55581cec934c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:70aee407-774e-4938-9128-27f568d7486d] added\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:44 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-f904909b-2f51-4e5a-9cd4-06f7a15e7f63 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:70aee407-774e-4938-9128-27f568d7486d] added
Aug 17 11:42:44 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:42:44 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:44 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6122b13-c8b8-4b68-9ea3-4e72aa1f2e7a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:44 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70aee407-774e-4938-9128-27f568d7486d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:44 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b7c6450-e4de-4e2d-ae7a-a50056bf783a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:44 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-ca93d778-ed2b-4c2e-aacd-21f40f95e4da tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] Running cmd (subprocess): nvme version {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:44 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-ca93d778-ed2b-4c2e-aacd-21f40f95e4da tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] 'nvme version' failed. Not Retrying. {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 11:42:44 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70aee407-774e-4938-9128-27f568d7486d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:44 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[66b6a2b8-88a1-47c5-a0d0-59bd7e113e6e]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:44 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ca93d778-ed2b-4c2e-aacd-21f40f95e4da tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] nvme not present on system {{(pid=73449) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 11:42:44 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-f904909b-2f51-4e5a-9cd4-06f7a15e7f63 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:42:44 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:44 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70aee407-774e-4938-9128-27f568d7486d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:44 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 11:42:44 user nova-compute[73449]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 11:42:44 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b02240d-81d1-443f-a75e-3e3d2a972f8d]: (4, '') {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:44 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-ca93d778-ed2b-4c2e-aacd-21f40f95e4da tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73449) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 11:42:44 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-ca93d778-ed2b-4c2e-aacd-21f40f95e4da tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73449) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 11:42:44 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-ca93d778-ed2b-4c2e-aacd-21f40f95e4da tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] LIGHTOS: no hostnqn found. {{(pid=73449) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 11:42:44 user nova-compute[73449]: DEBUG os_brick.utils [None req-ca93d778-ed2b-4c2e-aacd-21f40f95e4da tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] <== get_connector_properties: return (188ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4d3924302012', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 11:42:44 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70aee407-774e-4938-9128-27f568d7486d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.087s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:44 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[e83cb57e-9823-4c19-8033-0888420b06e1]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:44 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-f904909b-2f51-4e5a-9cd4-06f7a15e7f63 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:42:44 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70aee407-774e-4938-9128-27f568d7486d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JKkbidEQ {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:44 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70aee407-774e-4938-9128-27f568d7486d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JKkbidEQ" returned: 0 in 0.024s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:44 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[99a5af9e-1d6f-4a1a-bb28-c572a80e12ae]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:44 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-f904909b-2f51-4e5a-9cd4-06f7a15e7f63 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JKkbidEQ'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:42:44 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70aee407-774e-4938-9128-27f568d7486d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:44 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70aee407-774e-4938-9128-27f568d7486d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:44 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5436069-f2e8-4984-947f-29087b9d4073]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:44 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-f904909b-2f51-4e5a-9cd4-06f7a15e7f63 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:42:44 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:44 user nova-compute[73449]: INFO nova.compute.manager [None req-ca93d778-ed2b-4c2e-aacd-21f40f95e4da tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] [instance: c7ef11da-09ce-47a1-ba56-02af6a77206c] Swapping volume 8a554c8d-34fa-4557-a6e0-2dfdc32a161c for 0d5ae737-c3e9-4e70-8e3d-4ec06a4ec43b
Aug 17 11:42:44 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:44 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[810016ab-39d9-4cda-8dc0-2c76b7c35fab]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:44 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-f904909b-2f51-4e5a-9cd4-06f7a15e7f63 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c (non-flash)
Aug 17 11:42:44 user nova-compute[73449]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919 (non-flash)
Aug 17 11:42:44 user nova-compute[73449]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47 (non-flash)
Aug 17 11:42:44 user nova-compute[73449]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda (non-flash)
Aug 17 11:42:44 user nova-compute[73449]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e (non-flash)
Aug 17 11:42:44 user nova-compute[73449]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff (non-flash)
Aug 17 11:42:44 user nova-compute[73449]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd (non-flash)
Aug 17 11:42:44 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:42:44 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-f904909b-2f51-4e5a-9cd4-06f7a15e7f63 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c (non-flash)
Aug 17 11:42:44 user nova-compute[73449]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919 (non-flash)
Aug 17 11:42:44 user nova-compute[73449]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47 (non-flash)
Aug 17 11:42:44 user nova-compute[73449]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda (non-flash)
Aug 17 11:42:44 user nova-compute[73449]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e (non-flash)
Aug 17 11:42:44 user nova-compute[73449]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff (non-flash)
Aug 17 11:42:44 user nova-compute[73449]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd (non-flash)
Aug 17 11:42:44 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:42:44 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70aee407-774e-4938-9128-27f568d7486d -p 172.16.0.220:3260 --login {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:44 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70aee407-774e-4938-9128-27f568d7486d -p 172.16.0.220:3260 --login" returned: 0 in 0.105s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:44 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[b24d671f-313e-4a3a-9e67-8ee891fe4caa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:70aee407-774e-4938-9128-27f568d7486d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:70aee407-774e-4938-9128-27f568d7486d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:44 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-f904909b-2f51-4e5a-9cd4-06f7a15e7f63 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:70aee407-774e-4938-9128-27f568d7486d, portal: 172.16.0.220,3260]
Aug 17 11:42:44 user nova-compute[73449]: Login to [iface: default, target: iqn.2010-10.org.openstack:70aee407-774e-4938-9128-27f568d7486d, portal: 172.16.0.220,3260] successful.
Aug 17 11:42:44 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:42:44 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70aee407-774e-4938-9128-27f568d7486d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:44 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70aee407-774e-4938-9128-27f568d7486d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.034s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:44 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[35b6b9f8-c375-4964-b2a7-ade68b514439]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:44 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-f904909b-2f51-4e5a-9cd4-06f7a15e7f63 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:42:44 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:44 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.043s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:44 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfd59ac9-9017-4938-9b6c-2d81a86d4e74]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70aee407-774e-4938-9128-27f568d7486d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:44 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-f904909b-2f51-4e5a-9cd4-06f7a15e7f63 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c (non-flash)
Aug 17 11:42:44 user nova-compute[73449]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70aee407-774e-4938-9128-27f568d7486d (non-flash)
Aug 17 11:42:44 user nova-compute[73449]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919 (non-flash)
Aug 17 11:42:44 user nova-compute[73449]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47 (non-flash)
Aug 17 11:42:44 user nova-compute[73449]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda (non-flash)
Aug 17 11:42:44 user nova-compute[73449]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e (non-flash)
Aug 17 11:42:44 user nova-compute[73449]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff (non-flash)
Aug 17 11:42:44 user nova-compute[73449]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd (non-flash)
Aug 17 11:42:44 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:42:44 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-f904909b-2f51-4e5a-9cd4-06f7a15e7f63 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c (non-flash)
Aug 17 11:42:44 user nova-compute[73449]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70aee407-774e-4938-9128-27f568d7486d (non-flash)
Aug 17 11:42:44 user nova-compute[73449]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919 (non-flash)
Aug 17 11:42:44 user nova-compute[73449]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47 (non-flash)
Aug 17 11:42:44 user nova-compute[73449]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda (non-flash)
Aug 17 11:42:44 user nova-compute[73449]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e (non-flash)
Aug 17 11:42:44 user nova-compute[73449]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff (non-flash)
Aug 17 11:42:44 user nova-compute[73449]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd (non-flash)
Aug 17 11:42:44 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:42:44 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-f904909b-2f51-4e5a-9cd4-06f7a15e7f63 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:70aee407-774e-4938-9128-27f568d7486d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.515s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:42:44 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-f904909b-2f51-4e5a-9cd4-06f7a15e7f63 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Connected to 172.16.0.220:3260 {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 11:42:44 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-f904909b-2f51-4e5a-9cd4-06f7a15e7f63 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] HCTL ('39', '-', '-', 0) found on session 12 with lun 0 {{(pid=73449) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 11:42:44 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-f904909b-2f51-4e5a-9cd4-06f7a15e7f63 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=73449) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 11:42:44 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:44 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:44 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e9ef6ef-377b-4c2c-95bf-40153c2a62eb]: (4, ('- - 0', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:44 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-f904909b-2f51-4e5a-9cd4-06f7a15e7f63 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Searching for a device in session 12 and hctl ['39', '*', '*', 0] yield: None {{(pid=73449) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 11:42:44 user nova-compute[73449]: DEBUG nova.objects.instance [None req-e2374ba7-4680-49ac-a12a-5d3bfa4bdd59 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Lazy-loading 'flavor' on Instance uuid fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:42:44 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-e2374ba7-4680-49ac-a12a-5d3bfa4bdd59 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Lock "fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.989s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:42:44 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:42:44 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:42:45 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-f904909b-2f51-4e5a-9cd4-06f7a15e7f63 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Searching for a device in session 12 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=73449) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 11:42:45 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-f904909b-2f51-4e5a-9cd4-06f7a15e7f63 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JKkbidEQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 11:42:45 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-f904909b-2f51-4e5a-9cd4-06f7a15e7f63 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.551s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:42:45 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-f904909b-2f51-4e5a-9cd4-06f7a15e7f63 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] <== connect_volume: return (1553ms) {'type': 'block', 'scsi_wwn': '23461346238383931', 'path': '/dev/sdh'} {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 11:42:45 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f904909b-2f51-4e5a-9cd4-06f7a15e7f63 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] [instance: 7d3e07fa-4823-48e9-a959-e7bac0e0b25b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23461346238383931', 'path': '/dev/sdh'} {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 11:42:45 user nova-compute[73449]: DEBUG nova.objects.instance [None req-f904909b-2f51-4e5a-9cd4-06f7a15e7f63 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Lazy-loading 'flavor' on Instance uuid 7d3e07fa-4823-48e9-a959-e7bac0e0b25b {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:42:45 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-f904909b-2f51-4e5a-9cd4-06f7a15e7f63 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 11:42:45 user nova-compute[73449]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 11:42:45 user nova-compute[73449]:   <source dev="/dev/sdh"/>
Aug 17 11:42:45 user nova-compute[73449]:   <target dev="vdb" bus="virtio"/>
Aug 17 11:42:45 user nova-compute[73449]:   <serial>70aee407-774e-4938-9128-27f568d7486d</serial>
Aug 17 11:42:45 user nova-compute[73449]: </disk>
Aug 17 11:42:45 user nova-compute[73449]:  {{(pid=73449) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 11:42:46 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-f904909b-2f51-4e5a-9cd4-06f7a15e7f63 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] No BDM found with device name vda, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 11:42:46 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-f904909b-2f51-4e5a-9cd4-06f7a15e7f63 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] No BDM found with device name hda, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 11:42:46 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-f904909b-2f51-4e5a-9cd4-06f7a15e7f63 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] No VIF found with MAC fa:16:3e:fd:e7:b1, not building metadata {{(pid=73449) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 11:42:46 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-f904909b-2f51-4e5a-9cd4-06f7a15e7f63 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Lock "7d3e07fa-4823-48e9-a959-e7bac0e0b25b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.702s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:42:46 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:46 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:42:46 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Starting heal instance info cache {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 11:42:47 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "refresh_cache-a3523d22-7165-46ad-be10-5e6ae374f91d" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:42:47 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquired lock "refresh_cache-a3523d22-7165-46ad-be10-5e6ae374f91d" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:42:47 user nova-compute[73449]: DEBUG nova.network.neutron [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Forcefully refreshing network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 11:42:47 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:47 user nova-compute[73449]: DEBUG nova.network.neutron [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Updating instance_info_cache with network_info: [{"id": "2a0eb61f-9398-4db6-9ae0-f142ad2e60c4", "address": "fa:16:3e:15:cd:09", "network": {"id": "d54a402f-1fa9-43d8-b68e-0aa7ae6f0e73", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1441085328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eed9899860d4e7ca8a4500bbda4be13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a0eb61f-93", "ovs_interfaceid": "2a0eb61f-9398-4db6-9ae0-f142ad2e60c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:42:47 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Releasing lock "refresh_cache-a3523d22-7165-46ad-be10-5e6ae374f91d" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:42:47 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Updated the network info_cache for instance {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 11:42:47 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:42:47 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:42:47 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73449) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 11:42:47 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-2aa64692-3f76-451e-9955-71fbfb5c7c1f tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Acquiring lock "7d3e07fa-4823-48e9-a959-e7bac0e0b25b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:42:47 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-2aa64692-3f76-451e-9955-71fbfb5c7c1f tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Lock "7d3e07fa-4823-48e9-a959-e7bac0e0b25b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:42:47 user nova-compute[73449]: INFO nova.compute.manager [None req-2aa64692-3f76-451e-9955-71fbfb5c7c1f tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] [instance: 7d3e07fa-4823-48e9-a959-e7bac0e0b25b] Detaching volume 70aee407-774e-4938-9128-27f568d7486d
Aug 17 11:42:47 user nova-compute[73449]: INFO nova.virt.block_device [None req-2aa64692-3f76-451e-9955-71fbfb5c7c1f tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] [instance: 7d3e07fa-4823-48e9-a959-e7bac0e0b25b] Attempting to driver detach volume 70aee407-774e-4938-9128-27f568d7486d from mountpoint /dev/vdb
Aug 17 11:42:47 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:42:47 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-2aa64692-3f76-451e-9955-71fbfb5c7c1f tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Attempting to detach device vdb from instance 7d3e07fa-4823-48e9-a959-e7bac0e0b25b from the persistent domain config. {{(pid=73449) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 11:42:47 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-2aa64692-3f76-451e-9955-71fbfb5c7c1f tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 11:42:47 user nova-compute[73449]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 11:42:47 user nova-compute[73449]:   <source dev="/dev/sdh"/>
Aug 17 11:42:47 user nova-compute[73449]:   <target dev="vdb" bus="virtio"/>
Aug 17 11:42:47 user nova-compute[73449]:   <serial>70aee407-774e-4938-9128-27f568d7486d</serial>
Aug 17 11:42:47 user nova-compute[73449]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 17 11:42:47 user nova-compute[73449]: </disk>
Aug 17 11:42:47 user nova-compute[73449]:  {{(pid=73449) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 11:42:47 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-2aa64692-3f76-451e-9955-71fbfb5c7c1f tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Successfully detached device vdb from instance 7d3e07fa-4823-48e9-a959-e7bac0e0b25b from the persistent domain config.
Aug 17 11:42:47 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-2aa64692-3f76-451e-9955-71fbfb5c7c1f tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7d3e07fa-4823-48e9-a959-e7bac0e0b25b from the live domain config. {{(pid=73449) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 11:42:47 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-2aa64692-3f76-451e-9955-71fbfb5c7c1f tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 11:42:47 user nova-compute[73449]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 11:42:47 user nova-compute[73449]:   <source dev="/dev/sdh"/>
Aug 17 11:42:47 user nova-compute[73449]:   <target dev="vdb" bus="virtio"/>
Aug 17 11:42:47 user nova-compute[73449]:   <serial>70aee407-774e-4938-9128-27f568d7486d</serial>
Aug 17 11:42:47 user nova-compute[73449]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 17 11:42:47 user nova-compute[73449]: </disk>
Aug 17 11:42:47 user nova-compute[73449]:  {{(pid=73449) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 11:42:47 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:42:47 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:42:47 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:42:47 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=73449) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 11:42:48 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a9e8ad2-19db-4975-87e4-2efce603a7d7/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:48 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a9e8ad2-19db-4975-87e4-2efce603a7d7/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:48 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a9e8ad2-19db-4975-87e4-2efce603a7d7/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:48 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Received event <DeviceRemovedEvent: 1692272568.4550154, 7d3e07fa-4823-48e9-a959-e7bac0e0b25b => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73449) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 11:42:48 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-2aa64692-3f76-451e-9955-71fbfb5c7c1f tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7d3e07fa-4823-48e9-a959-e7bac0e0b25b {{(pid=73449) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 11:42:48 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-2aa64692-3f76-451e-9955-71fbfb5c7c1f tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Successfully detached device vdb from instance 7d3e07fa-4823-48e9-a959-e7bac0e0b25b from the live domain config.
Aug 17 11:42:48 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2aa64692-3f76-451e-9955-71fbfb5c7c1f tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] [instance: 7d3e07fa-4823-48e9-a959-e7bac0e0b25b] calling os-brick to detach iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 11:42:48 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aa64692-3f76-451e-9955-71fbfb5c7c1f tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, {'target_iqns': ['iqn.2010-10.org.openstack:70aee407-774e-4938-9128-27f568d7486d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JKkbidEQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 11:42:48 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-2aa64692-3f76-451e-9955-71fbfb5c7c1f tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 11:42:48 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-2aa64692-3f76-451e-9955-71fbfb5c7c1f tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:42:48 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-2aa64692-3f76-451e-9955-71fbfb5c7c1f tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:42:48 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aa64692-3f76-451e-9955-71fbfb5c7c1f tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:70aee407-774e-4938-9128-27f568d7486d', 0)] {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 11:42:48 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:48 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:48 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[069961c8-fd37-4eb5-82ec-06b3ebdb7715]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:70aee407-774e-4938-9128-27f568d7486d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:48 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:48 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:48 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bd8d0da-9609-4308-ab72-e140b6718a41]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70aee407-774e-4938-9128-27f568d7486d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:48 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aa64692-3f76-451e-9955-71fbfb5c7c1f tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c (non-flash)
Aug 17 11:42:48 user nova-compute[73449]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70aee407-774e-4938-9128-27f568d7486d (non-flash)
Aug 17 11:42:48 user nova-compute[73449]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919 (non-flash)
Aug 17 11:42:48 user nova-compute[73449]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47 (non-flash)
Aug 17 11:42:48 user nova-compute[73449]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda (non-flash)
Aug 17 11:42:48 user nova-compute[73449]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e (non-flash)
Aug 17 11:42:48 user nova-compute[73449]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff (non-flash)
Aug 17 11:42:48 user nova-compute[73449]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd (non-flash)
Aug 17 11:42:48 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:42:48 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aa64692-3f76-451e-9955-71fbfb5c7c1f tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c (non-flash)
Aug 17 11:42:48 user nova-compute[73449]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70aee407-774e-4938-9128-27f568d7486d (non-flash)
Aug 17 11:42:48 user nova-compute[73449]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919 (non-flash)
Aug 17 11:42:48 user nova-compute[73449]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47 (non-flash)
Aug 17 11:42:48 user nova-compute[73449]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda (non-flash)
Aug 17 11:42:48 user nova-compute[73449]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e (non-flash)
Aug 17 11:42:48 user nova-compute[73449]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff (non-flash)
Aug 17 11:42:48 user nova-compute[73449]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd (non-flash)
Aug 17 11:42:48 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:42:48 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aa64692-3f76-451e-9955-71fbfb5c7c1f tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe787667490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:70aee407-774e-4938-9128-27f568d7486d'): ({'sdh'}, set())}) {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 11:42:48 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-2aa64692-3f76-451e-9955-71fbfb5c7c1f tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Removing single pathed devices sdh {{(pid=73449) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 11:42:48 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:48 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:48 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[67f14dbf-4ae6-41e3-94dc-96b1a26bd6a8]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:48 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:48 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:48 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[469f9f47-0fc3-4e84-a49d-c52c863862af]: (4, ('ok\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:48 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-2aa64692-3f76-451e-9955-71fbfb5c7c1f tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Flushing IO for device /dev/sdh {{(pid=73449) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 11:42:48 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:48 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.013s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:48 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[e155dd12-ad43-409c-ac04-afbf312d093c]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:48 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-2aa64692-3f76-451e-9955-71fbfb5c7c1f tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=73449) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 11:42:48 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:48 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.034s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:48 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe66f977-d405-40d8-bf97-02471aadc6a7]: (4, ('1', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:48 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-2aa64692-3f76-451e-9955-71fbfb5c7c1f tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=73449) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 11:42:48 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-2aa64692-3f76-451e-9955-71fbfb5c7c1f tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] SCSI volumes sdh have been removed. {{(pid=73449) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 11:42:48 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aa64692-3f76-451e-9955-71fbfb5c7c1f tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:70aee407-774e-4938-9128-27f568d7486d')] {{(pid=73449) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 11:42:48 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70aee407-774e-4938-9128-27f568d7486d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:48 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70aee407-774e-4938-9128-27f568d7486d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:48 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[89e20d36-8a6a-413a-acb4-72610531c0de]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:48 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aa64692-3f76-451e-9955-71fbfb5c7c1f tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:42:48 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70aee407-774e-4938-9128-27f568d7486d -p 172.16.0.220:3260 --logout {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:48 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a9e8ad2-19db-4975-87e4-2efce603a7d7/disk --force-share --output=json" returned: 0 in 0.287s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:48 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3a9252c-0e0a-4c5c-a46f-eaa004479bd2/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:48 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70aee407-774e-4938-9128-27f568d7486d -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:48 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2b1c112-98ad-4c4c-b1fd-300ff8106b38]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:70aee407-774e-4938-9128-27f568d7486d, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:70aee407-774e-4938-9128-27f568d7486d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:48 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aa64692-3f76-451e-9955-71fbfb5c7c1f tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:70aee407-774e-4938-9128-27f568d7486d, portal: 172.16.0.220,3260]
Aug 17 11:42:48 user nova-compute[73449]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:70aee407-774e-4938-9128-27f568d7486d, portal: 172.16.0.220,3260] successful.
Aug 17 11:42:48 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:42:48 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70aee407-774e-4938-9128-27f568d7486d -p 172.16.0.220:3260 --op delete {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:48 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70aee407-774e-4938-9128-27f568d7486d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.049s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:48 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf9a7480-8bdd-4d10-a012-7afbda0260a7]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:48 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aa64692-3f76-451e-9955-71fbfb5c7c1f tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:42:48 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-2aa64692-3f76-451e-9955-71fbfb5c7c1f tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:42:48 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aa64692-3f76-451e-9955-71fbfb5c7c1f tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] <== disconnect_volume: return (334ms) None {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 11:42:48 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2aa64692-3f76-451e-9955-71fbfb5c7c1f tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] [instance: 7d3e07fa-4823-48e9-a959-e7bac0e0b25b] Disconnected iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 11:42:48 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3a9252c-0e0a-4c5c-a46f-eaa004479bd2/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:48 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3a9252c-0e0a-4c5c-a46f-eaa004479bd2/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:49 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3a9252c-0e0a-4c5c-a46f-eaa004479bd2/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:49 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73449) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 11:42:49 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73449) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 11:42:49 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=73449) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 11:42:49 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73449) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 11:42:49 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73449) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 11:42:49 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=73449) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 11:42:49 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd8d4549-db8f-4c74-8706-8ac21f049c2e/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:49 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd8d4549-db8f-4c74-8706-8ac21f049c2e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:49 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd8d4549-db8f-4c74-8706-8ac21f049c2e/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:49 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd8d4549-db8f-4c74-8706-8ac21f049c2e/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:49 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3523d22-7165-46ad-be10-5e6ae374f91d/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:49 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3523d22-7165-46ad-be10-5e6ae374f91d/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:49 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3523d22-7165-46ad-be10-5e6ae374f91d/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:49 user nova-compute[73449]: DEBUG nova.objects.instance [None req-2aa64692-3f76-451e-9955-71fbfb5c7c1f tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Lazy-loading 'flavor' on Instance uuid 7d3e07fa-4823-48e9-a959-e7bac0e0b25b {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:42:49 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-2aa64692-3f76-451e-9955-71fbfb5c7c1f tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Lock "7d3e07fa-4823-48e9-a959-e7bac0e0b25b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.983s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:42:49 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3523d22-7165-46ad-be10-5e6ae374f91d/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:49 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:50 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:50 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:50 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-466f4fdb-bcdb-48ce-99ea-de2e6f1c5d46 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Acquiring lock "interface-7d3e07fa-4823-48e9-a959-e7bac0e0b25b-80c33dff-82f7-4faa-ab3c-23691d6ff089" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:42:50 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-466f4fdb-bcdb-48ce-99ea-de2e6f1c5d46 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Lock "interface-7d3e07fa-4823-48e9-a959-e7bac0e0b25b-80c33dff-82f7-4faa-ab3c-23691d6ff089" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:42:50 user nova-compute[73449]: DEBUG nova.objects.instance [None req-466f4fdb-bcdb-48ce-99ea-de2e6f1c5d46 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Lazy-loading 'flavor' on Instance uuid 7d3e07fa-4823-48e9-a959-e7bac0e0b25b {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:42:50 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-466f4fdb-bcdb-48ce-99ea-de2e6f1c5d46 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T11:40:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2017749474',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2017749474',id=6,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKDfVSRbJOSL96IIDH0v0XJrsx/+BlroyuWS03V0CQU7P0dyi56boP0N4YVepj2zGZdJ92Q/eiUfqBiWlxOzCQZKWvHOldZF0ArsphTeKIZc5KRdUwh+L9qgCVMp15KALw==',key_name='tempest-keypair-1953925692',keypairs=<?>,launch_index=0,launched_at=2023-08-17T11:40:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3c75ffb297b94222a4502db0e0814538',ramdisk_id='',reservation_id='r-35nrqkzd',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1681245717',owner_user_name='tempest-TaggedAttachmentsTest-1681245717-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T11:40:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9df670f3f7da4815bdcb9915a4999380',uuid=7d3e07fa-4823-48e9-a959-e7bac0e0b25b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "80c33dff-82f7-4faa-ab3c-23691d6ff089", "address": "fa:16:3e:3b:bb:72", "network": {"id": "b3413879-f603-4b1d-b023-0110910a8800", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-768654625", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3c75ffb297b94222a4502db0e0814538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80c33dff-82", "ovs_interfaceid": "80c33dff-82f7-4faa-ab3c-23691d6ff089", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73449) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 11:42:50 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-466f4fdb-bcdb-48ce-99ea-de2e6f1c5d46 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Converting VIF {"id": "80c33dff-82f7-4faa-ab3c-23691d6ff089", "address": "fa:16:3e:3b:bb:72", "network": {"id": "b3413879-f603-4b1d-b023-0110910a8800", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-768654625", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3c75ffb297b94222a4502db0e0814538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80c33dff-82", "ovs_interfaceid": "80c33dff-82f7-4faa-ab3c-23691d6ff089", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:42:50 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-466f4fdb-bcdb-48ce-99ea-de2e6f1c5d46 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:bb:72,bridge_name='br-int',has_traffic_filtering=True,id=80c33dff-82f7-4faa-ab3c-23691d6ff089,network=Network(b3413879-f603-4b1d-b023-0110910a8800),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80c33dff-82') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:42:50 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:50 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-466f4fdb-bcdb-48ce-99ea-de2e6f1c5d46 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:3b:bb:72"/><model type="virtio"/><mtu size="1442"/><target dev="tap80c33dff-82"/></interface> {{(pid=73449) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 17 11:42:50 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-466f4fdb-bcdb-48ce-99ea-de2e6f1c5d46 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:3b:bb:72"/><model type="virtio"/><mtu size="1442"/><target dev="tap80c33dff-82"/></interface> {{(pid=73449) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 17 11:42:50 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7ef11da-09ce-47a1-ba56-02af6a77206c/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:50 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-466f4fdb-bcdb-48ce-99ea-de2e6f1c5d46 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Attempting to detach device tap80c33dff-82 from instance 7d3e07fa-4823-48e9-a959-e7bac0e0b25b from the persistent domain config. {{(pid=73449) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 11:42:50 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-466f4fdb-bcdb-48ce-99ea-de2e6f1c5d46 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] detach device xml: <interface type="ethernet">
Aug 17 11:42:50 user nova-compute[73449]:   <mac address="fa:16:3e:3b:bb:72"/>
Aug 17 11:42:50 user nova-compute[73449]:   <model type="virtio"/>
Aug 17 11:42:50 user nova-compute[73449]:   <mtu size="1442"/>
Aug 17 11:42:50 user nova-compute[73449]:   <target dev="tap80c33dff-82"/>
Aug 17 11:42:50 user nova-compute[73449]: </interface>
Aug 17 11:42:50 user nova-compute[73449]:  {{(pid=73449) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 11:42:50 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-466f4fdb-bcdb-48ce-99ea-de2e6f1c5d46 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:3b:bb:72"/><model type="virtio"/><mtu size="1442"/><target dev="tap80c33dff-82"/></interface> {{(pid=73449) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 17 11:42:50 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-466f4fdb-bcdb-48ce-99ea-de2e6f1c5d46 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:3b:bb:72"/><model type="virtio"/><mtu size="1442"/><target dev="tap80c33dff-82"/></interface>not found in domain: <domain type='kvm' id='6'>
Aug 17 11:42:50 user nova-compute[73449]:   <name>instance-00000006</name>
Aug 17 11:42:50 user nova-compute[73449]:   <uuid>7d3e07fa-4823-48e9-a959-e7bac0e0b25b</uuid>
Aug 17 11:42:50 user nova-compute[73449]:   <metadata>
Aug 17 11:42:50 user nova-compute[73449]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 11:42:50 user nova-compute[73449]:   <nova:package version="0.0.0"/>
Aug 17 11:42:50 user nova-compute[73449]:   <nova:name>tempest-device-tagging-server-2017749474</nova:name>
Aug 17 11:42:50 user nova-compute[73449]:   <nova:creationTime>2023-08-17 11:42:27</nova:creationTime>
Aug 17 11:42:50 user nova-compute[73449]:   <nova:flavor name="m1.tiny">
Aug 17 11:42:50 user nova-compute[73449]:     <nova:memory>512</nova:memory>
Aug 17 11:42:50 user nova-compute[73449]:     <nova:disk>1</nova:disk>
Aug 17 11:42:50 user nova-compute[73449]:     <nova:swap>0</nova:swap>
Aug 17 11:42:50 user nova-compute[73449]:     <nova:ephemeral>0</nova:ephemeral>
Aug 17 11:42:50 user nova-compute[73449]:     <nova:vcpus>1</nova:vcpus>
Aug 17 11:42:50 user nova-compute[73449]:   </nova:flavor>
Aug 17 11:42:50 user nova-compute[73449]:   <nova:owner>
Aug 17 11:42:50 user nova-compute[73449]:     <nova:user uuid="9df670f3f7da4815bdcb9915a4999380">tempest-TaggedAttachmentsTest-1681245717-project-member</nova:user>
Aug 17 11:42:50 user nova-compute[73449]:     <nova:project uuid="3c75ffb297b94222a4502db0e0814538">tempest-TaggedAttachmentsTest-1681245717</nova:project>
Aug 17 11:42:50 user nova-compute[73449]:   </nova:owner>
Aug 17 11:42:50 user nova-compute[73449]:   <nova:root type="image" uuid="0a2904ae-083d-41c8-83db-343132b36148"/>
Aug 17 11:42:50 user nova-compute[73449]:   <nova:ports>
Aug 17 11:42:50 user nova-compute[73449]:     <nova:port uuid="60dadb1a-7680-434e-975f-8ef1ec1b4088">
Aug 17 11:42:50 user nova-compute[73449]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 17 11:42:50 user nova-compute[73449]:     </nova:port>
Aug 17 11:42:50 user nova-compute[73449]:     <nova:port uuid="80c33dff-82f7-4faa-ab3c-23691d6ff089">
Aug 17 11:42:50 user nova-compute[73449]:       <nova:ip type="fixed" address="10.10.10.167" ipVersion="4"/>
Aug 17 11:42:50 user nova-compute[73449]:     </nova:port>
Aug 17 11:42:50 user nova-compute[73449]:   </nova:ports>
Aug 17 11:42:50 user nova-compute[73449]: </nova:instance>
Aug 17 11:42:50 user nova-compute[73449]:   </metadata>
Aug 17 11:42:50 user nova-compute[73449]:   <memory unit='KiB'>524288</memory>
Aug 17 11:42:50 user nova-compute[73449]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 17 11:42:50 user nova-compute[73449]:   <vcpu placement='static'>1</vcpu>
Aug 17 11:42:50 user nova-compute[73449]:   <resource>
Aug 17 11:42:50 user nova-compute[73449]:     <partition>/machine</partition>
Aug 17 11:42:50 user nova-compute[73449]:   </resource>
Aug 17 11:42:50 user nova-compute[73449]:   <sysinfo type='smbios'>
Aug 17 11:42:50 user nova-compute[73449]:     <system>
Aug 17 11:42:50 user nova-compute[73449]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 17 11:42:50 user nova-compute[73449]:       <entry name='product'>OpenStack Nova</entry>
Aug 17 11:42:50 user nova-compute[73449]:       <entry name='version'>0.0.0</entry>
Aug 17 11:42:50 user nova-compute[73449]:       <entry name='serial'>7d3e07fa-4823-48e9-a959-e7bac0e0b25b</entry>
Aug 17 11:42:50 user nova-compute[73449]:       <entry name='uuid'>7d3e07fa-4823-48e9-a959-e7bac0e0b25b</entry>
Aug 17 11:42:50 user nova-compute[73449]:       <entry name='family'>Virtual Machine</entry>
Aug 17 11:42:50 user nova-compute[73449]:     </system>
Aug 17 11:42:50 user nova-compute[73449]:   </sysinfo>
Aug 17 11:42:50 user nova-compute[73449]:   <os>
Aug 17 11:42:50 user nova-compute[73449]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 17 11:42:50 user nova-compute[73449]:     <boot dev='hd'/>
Aug 17 11:42:50 user nova-compute[73449]:     <smbios mode='sysinfo'/>
Aug 17 11:42:50 user nova-compute[73449]:   </os>
Aug 17 11:42:50 user nova-compute[73449]:   <features>
Aug 17 11:42:50 user nova-compute[73449]:     <acpi/>
Aug 17 11:42:50 user nova-compute[73449]:     <apic/>
Aug 17 11:42:50 user nova-compute[73449]:     <vmcoreinfo state='on'/>
Aug 17 11:42:50 user nova-compute[73449]:   </features>
Aug 17 11:42:50 user nova-compute[73449]:   <cpu mode='custom' match='exact' check='full'>
Aug 17 11:42:50 user nova-compute[73449]:     <model fallback='forbid'>Nehalem</model>
Aug 17 11:42:50 user nova-compute[73449]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 17 11:42:50 user nova-compute[73449]:     <feature policy='require' name='vme'/>
Aug 17 11:42:50 user nova-compute[73449]:     <feature policy='require' name='x2apic'/>
Aug 17 11:42:50 user nova-compute[73449]:     <feature policy='require' name='hypervisor'/>
Aug 17 11:42:50 user nova-compute[73449]:   </cpu>
Aug 17 11:42:50 user nova-compute[73449]:   <clock offset='utc'>
Aug 17 11:42:50 user nova-compute[73449]:     <timer name='pit' tickpolicy='delay'/>
Aug 17 11:42:50 user nova-compute[73449]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 17 11:42:50 user nova-compute[73449]:     <timer name='hpet' present='no'/>
Aug 17 11:42:50 user nova-compute[73449]:   </clock>
Aug 17 11:42:50 user nova-compute[73449]:   <on_poweroff>destroy</on_poweroff>
Aug 17 11:42:50 user nova-compute[73449]:   <on_reboot>restart</on_reboot>
Aug 17 11:42:50 user nova-compute[73449]:   <on_crash>destroy</on_crash>
Aug 17 11:42:50 user nova-compute[73449]:   <devices>
Aug 17 11:42:50 user nova-compute[73449]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 17 11:42:50 user nova-compute[73449]:     <disk type='file' device='disk'>
Aug 17 11:42:50 user nova-compute[73449]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 17 11:42:50 user nova-compute[73449]:       <source file='/opt/stack/data/nova/instances/7d3e07fa-4823-48e9-a959-e7bac0e0b25b/disk' index='2'/>
Aug 17 11:42:50 user nova-compute[73449]:       <backingStore type='file' index='3'>
Aug 17 11:42:50 user nova-compute[73449]:         <format type='raw'/>
Aug 17 11:42:50 user nova-compute[73449]:         <source file='/opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3'/>
Aug 17 11:42:50 user nova-compute[73449]:         <backingStore/>
Aug 17 11:42:50 user nova-compute[73449]:       </backingStore>
Aug 17 11:42:50 user nova-compute[73449]:       <target dev='vda' bus='virtio'/>
Aug 17 11:42:50 user nova-compute[73449]:       <alias name='virtio-disk0'/>
Aug 17 11:42:50 user nova-compute[73449]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 17 11:42:50 user nova-compute[73449]:     </disk>
Aug 17 11:42:50 user nova-compute[73449]:     <disk type='file' device='cdrom'>
Aug 17 11:42:50 user nova-compute[73449]:       <driver name='qemu' type='raw' cache='none'/>
Aug 17 11:42:50 user nova-compute[73449]:       <source file='/opt/stack/data/nova/instances/7d3e07fa-4823-48e9-a959-e7bac0e0b25b/disk.config' index='1'/>
Aug 17 11:42:50 user nova-compute[73449]:       <backingStore/>
Aug 17 11:42:50 user nova-compute[73449]:       <target dev='hda' bus='ide'/>
Aug 17 11:42:50 user nova-compute[73449]:       <readonly/>
Aug 17 11:42:50 user nova-compute[73449]:       <alias name='ide0-0-0'/>
Aug 17 11:42:50 user nova-compute[73449]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 17 11:42:50 user nova-compute[73449]:     </disk>
Aug 17 11:42:50 user nova-compute[73449]:     <controller type='usb' index='0' model='none'>
Aug 17 11:42:50 user nova-compute[73449]:       <alias name='usb'/>
Aug 17 11:42:50 user nova-compute[73449]:     </controller>
Aug 17 11:42:50 user nova-compute[73449]:     <controller type='pci' index='0' model='pci-root'>
Aug 17 11:42:50 user nova-compute[73449]:       <alias name='pci.0'/>
Aug 17 11:42:50 user nova-compute[73449]:     </controller>
Aug 17 11:42:50 user nova-compute[73449]:     <controller type='ide' index='0'>
Aug 17 11:42:50 user nova-compute[73449]:       <alias name='ide'/>
Aug 17 11:42:50 user nova-compute[73449]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 17 11:42:50 user nova-compute[73449]:     </controller>
Aug 17 11:42:50 user nova-compute[73449]:     <interface type='ethernet'>
Aug 17 11:42:50 user nova-compute[73449]:       <mac address='fa:16:3e:fd:e7:b1'/>
Aug 17 11:42:50 user nova-compute[73449]:       <target dev='tap60dadb1a-76'/>
Aug 17 11:42:50 user nova-compute[73449]:       <model type='virtio'/>
Aug 17 11:42:50 user nova-compute[73449]:       <mtu size='1442'/>
Aug 17 11:42:50 user nova-compute[73449]:       <alias name='net0'/>
Aug 17 11:42:50 user nova-compute[73449]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 17 11:42:50 user nova-compute[73449]:     </interface>
Aug 17 11:42:50 user nova-compute[73449]:     <interface type='ethernet'>
Aug 17 11:42:50 user nova-compute[73449]:       <mac address='fa:16:3e:3b:bb:72'/>
Aug 17 11:42:50 user nova-compute[73449]:       <target dev='tap80c33dff-82'/>
Aug 17 11:42:50 user nova-compute[73449]:       <model type='virtio'/>
Aug 17 11:42:50 user nova-compute[73449]:       <mtu size='1442'/>
Aug 17 11:42:50 user nova-compute[73449]:       <alias name='net1'/>
Aug 17 11:42:50 user nova-compute[73449]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Aug 17 11:42:50 user nova-compute[73449]:     </interface>
Aug 17 11:42:50 user nova-compute[73449]:     <serial type='pty'>
Aug 17 11:42:50 user nova-compute[73449]:       <source path='/dev/pts/5'/>
Aug 17 11:42:50 user nova-compute[73449]:       <log file='/opt/stack/data/nova/instances/7d3e07fa-4823-48e9-a959-e7bac0e0b25b/console.log' append='off'/>
Aug 17 11:42:50 user nova-compute[73449]:       <target type='isa-serial' port='0'>
Aug 17 11:42:50 user nova-compute[73449]:         <model name='isa-serial'/>
Aug 17 11:42:50 user nova-compute[73449]:       </target>
Aug 17 11:42:50 user nova-compute[73449]:       <alias name='serial0'/>
Aug 17 11:42:50 user nova-compute[73449]:     </serial>
Aug 17 11:42:50 user nova-compute[73449]:     <console type='pty' tty='/dev/pts/5'>
Aug 17 11:42:50 user nova-compute[73449]:       <source path='/dev/pts/5'/>
Aug 17 11:42:50 user nova-compute[73449]:       <log file='/opt/stack/data/nova/instances/7d3e07fa-4823-48e9-a959-e7bac0e0b25b/console.log' append='off'/>
Aug 17 11:42:50 user nova-compute[73449]:       <target type='serial' port='0'/>
Aug 17 11:42:50 user nova-compute[73449]:       <alias name='serial0'/>
Aug 17 11:42:50 user nova-compute[73449]:     </console>
Aug 17 11:42:50 user nova-compute[73449]:     <input type='mouse' bus='ps2'>
Aug 17 11:42:50 user nova-compute[73449]:       <alias name='input0'/>
Aug 17 11:42:50 user nova-compute[73449]:     </input>
Aug 17 11:42:50 user nova-compute[73449]:     <input type='keyboard' bus='ps2'>
Aug 17 11:42:50 user nova-compute[73449]:       <alias name='input1'/>
Aug 17 11:42:50 user nova-compute[73449]:     </input>
Aug 17 11:42:50 user nova-compute[73449]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Aug 17 11:42:50 user nova-compute[73449]:       <listen type='address' address='0.0.0.0'/>
Aug 17 11:42:50 user nova-compute[73449]:     </graphics>
Aug 17 11:42:50 user nova-compute[73449]:     <audio id='1' type='none'/>
Aug 17 11:42:50 user nova-compute[73449]:     <video>
Aug 17 11:42:50 user nova-compute[73449]:       <model type='virtio' heads='1' primary='yes'/>
Aug 17 11:42:50 user nova-compute[73449]:       <alias name='video0'/>
Aug 17 11:42:50 user nova-compute[73449]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 17 11:42:50 user nova-compute[73449]:     </video>
Aug 17 11:42:50 user nova-compute[73449]:     <memballoon model='virtio'>
Aug 17 11:42:50 user nova-compute[73449]:       <stats period='10'/>
Aug 17 11:42:50 user nova-compute[73449]:       <alias name='balloon0'/>
Aug 17 11:42:50 user nova-compute[73449]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 17 11:42:50 user nova-compute[73449]:     </memballoon>
Aug 17 11:42:50 user nova-compute[73449]:     <rng model='virtio'>
Aug 17 11:42:50 user nova-compute[73449]:       <backend model='random'>/dev/urandom</backend>
Aug 17 11:42:50 user nova-compute[73449]:       <alias name='rng0'/>
Aug 17 11:42:50 user nova-compute[73449]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 17 11:42:50 user nova-compute[73449]:     </rng>
Aug 17 11:42:50 user nova-compute[73449]:   </devices>
Aug 17 11:42:50 user nova-compute[73449]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 17 11:42:50 user nova-compute[73449]:     <label>libvirt-7d3e07fa-4823-48e9-a959-e7bac0e0b25b</label>
Aug 17 11:42:50 user nova-compute[73449]:     <imagelabel>libvirt-7d3e07fa-4823-48e9-a959-e7bac0e0b25b</imagelabel>
Aug 17 11:42:50 user nova-compute[73449]:   </seclabel>
Aug 17 11:42:50 user nova-compute[73449]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 17 11:42:50 user nova-compute[73449]:     <label>+64055:+108</label>
Aug 17 11:42:50 user nova-compute[73449]:     <imagelabel>+64055:+108</imagelabel>
Aug 17 11:42:50 user nova-compute[73449]:   </seclabel>
Aug 17 11:42:50 user nova-compute[73449]: </domain>
Aug 17 11:42:50 user nova-compute[73449]:  {{(pid=73449) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 17 11:42:50 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-466f4fdb-bcdb-48ce-99ea-de2e6f1c5d46 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Successfully detached device tap80c33dff-82 from instance 7d3e07fa-4823-48e9-a959-e7bac0e0b25b from the persistent domain config.
Aug 17 11:42:50 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-466f4fdb-bcdb-48ce-99ea-de2e6f1c5d46 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] (1/8): Attempting to detach device tap80c33dff-82 with device alias net1 from instance 7d3e07fa-4823-48e9-a959-e7bac0e0b25b from the live domain config. {{(pid=73449) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 11:42:50 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-466f4fdb-bcdb-48ce-99ea-de2e6f1c5d46 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] detach device xml: <interface type="ethernet">
Aug 17 11:42:50 user nova-compute[73449]:   <mac address="fa:16:3e:3b:bb:72"/>
Aug 17 11:42:50 user nova-compute[73449]:   <model type="virtio"/>
Aug 17 11:42:50 user nova-compute[73449]:   <mtu size="1442"/>
Aug 17 11:42:50 user nova-compute[73449]:   <target dev="tap80c33dff-82"/>
Aug 17 11:42:50 user nova-compute[73449]: </interface>
Aug 17 11:42:50 user nova-compute[73449]:  {{(pid=73449) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 11:42:50 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7ef11da-09ce-47a1-ba56-02af6a77206c/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:50 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7ef11da-09ce-47a1-ba56-02af6a77206c/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:50 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:50 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7ef11da-09ce-47a1-ba56-02af6a77206c/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:50 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] skipping disk /dev/sdj (vdb) as it is a volume {{(pid=73449) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 11:42:50 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d3e07fa-4823-48e9-a959-e7bac0e0b25b/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:50 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Received event <DeviceRemovedEvent: 1692272570.7500765, 7d3e07fa-4823-48e9-a959-e7bac0e0b25b => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73449) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 11:42:50 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:50 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-466f4fdb-bcdb-48ce-99ea-de2e6f1c5d46 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Start waiting for the detach event from libvirt for device tap80c33dff-82 with device alias net1 for instance 7d3e07fa-4823-48e9-a959-e7bac0e0b25b {{(pid=73449) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 11:42:50 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-466f4fdb-bcdb-48ce-99ea-de2e6f1c5d46 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:3b:bb:72"/><model type="virtio"/><mtu size="1442"/><target dev="tap80c33dff-82"/></interface> {{(pid=73449) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 17 11:42:50 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-466f4fdb-bcdb-48ce-99ea-de2e6f1c5d46 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:3b:bb:72"/><model type="virtio"/><mtu size="1442"/><target dev="tap80c33dff-82"/></interface>not found in domain: <domain type='kvm' id='6'>
Aug 17 11:42:50 user nova-compute[73449]:   <name>instance-00000006</name>
Aug 17 11:42:50 user nova-compute[73449]:   <uuid>7d3e07fa-4823-48e9-a959-e7bac0e0b25b</uuid>
Aug 17 11:42:50 user nova-compute[73449]:   <metadata>
Aug 17 11:42:50 user nova-compute[73449]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 11:42:50 user nova-compute[73449]:   <nova:package version="0.0.0"/>
Aug 17 11:42:50 user nova-compute[73449]:   <nova:name>tempest-device-tagging-server-2017749474</nova:name>
Aug 17 11:42:50 user nova-compute[73449]:   <nova:creationTime>2023-08-17 11:42:27</nova:creationTime>
Aug 17 11:42:50 user nova-compute[73449]:   <nova:flavor name="m1.tiny">
Aug 17 11:42:50 user nova-compute[73449]:     <nova:memory>512</nova:memory>
Aug 17 11:42:50 user nova-compute[73449]:     <nova:disk>1</nova:disk>
Aug 17 11:42:50 user nova-compute[73449]:     <nova:swap>0</nova:swap>
Aug 17 11:42:50 user nova-compute[73449]:     <nova:ephemeral>0</nova:ephemeral>
Aug 17 11:42:50 user nova-compute[73449]:     <nova:vcpus>1</nova:vcpus>
Aug 17 11:42:50 user nova-compute[73449]:   </nova:flavor>
Aug 17 11:42:50 user nova-compute[73449]:   <nova:owner>
Aug 17 11:42:50 user nova-compute[73449]:     <nova:user uuid="9df670f3f7da4815bdcb9915a4999380">tempest-TaggedAttachmentsTest-1681245717-project-member</nova:user>
Aug 17 11:42:50 user nova-compute[73449]:     <nova:project uuid="3c75ffb297b94222a4502db0e0814538">tempest-TaggedAttachmentsTest-1681245717</nova:project>
Aug 17 11:42:50 user nova-compute[73449]:   </nova:owner>
Aug 17 11:42:50 user nova-compute[73449]:   <nova:root type="image" uuid="0a2904ae-083d-41c8-83db-343132b36148"/>
Aug 17 11:42:50 user nova-compute[73449]:   <nova:ports>
Aug 17 11:42:50 user nova-compute[73449]:     <nova:port uuid="60dadb1a-7680-434e-975f-8ef1ec1b4088">
Aug 17 11:42:50 user nova-compute[73449]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 17 11:42:50 user nova-compute[73449]:     </nova:port>
Aug 17 11:42:50 user nova-compute[73449]:     <nova:port uuid="80c33dff-82f7-4faa-ab3c-23691d6ff089">
Aug 17 11:42:50 user nova-compute[73449]:       <nova:ip type="fixed" address="10.10.10.167" ipVersion="4"/>
Aug 17 11:42:50 user nova-compute[73449]:     </nova:port>
Aug 17 11:42:50 user nova-compute[73449]:   </nova:ports>
Aug 17 11:42:50 user nova-compute[73449]: </nova:instance>
Aug 17 11:42:50 user nova-compute[73449]:   </metadata>
Aug 17 11:42:50 user nova-compute[73449]:   <memory unit='KiB'>524288</memory>
Aug 17 11:42:50 user nova-compute[73449]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 17 11:42:50 user nova-compute[73449]:   <vcpu placement='static'>1</vcpu>
Aug 17 11:42:50 user nova-compute[73449]:   <resource>
Aug 17 11:42:50 user nova-compute[73449]:     <partition>/machine</partition>
Aug 17 11:42:50 user nova-compute[73449]:   </resource>
Aug 17 11:42:50 user nova-compute[73449]:   <sysinfo type='smbios'>
Aug 17 11:42:50 user nova-compute[73449]:     <system>
Aug 17 11:42:50 user nova-compute[73449]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 17 11:42:50 user nova-compute[73449]:       <entry name='product'>OpenStack Nova</entry>
Aug 17 11:42:50 user nova-compute[73449]:       <entry name='version'>0.0.0</entry>
Aug 17 11:42:50 user nova-compute[73449]:       <entry name='serial'>7d3e07fa-4823-48e9-a959-e7bac0e0b25b</entry>
Aug 17 11:42:50 user nova-compute[73449]:       <entry name='uuid'>7d3e07fa-4823-48e9-a959-e7bac0e0b25b</entry>
Aug 17 11:42:50 user nova-compute[73449]:       <entry name='family'>Virtual Machine</entry>
Aug 17 11:42:50 user nova-compute[73449]:     </system>
Aug 17 11:42:50 user nova-compute[73449]:   </sysinfo>
Aug 17 11:42:50 user nova-compute[73449]:   <os>
Aug 17 11:42:50 user nova-compute[73449]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 17 11:42:50 user nova-compute[73449]:     <boot dev='hd'/>
Aug 17 11:42:50 user nova-compute[73449]:     <smbios mode='sysinfo'/>
Aug 17 11:42:50 user nova-compute[73449]:   </os>
Aug 17 11:42:50 user nova-compute[73449]:   <features>
Aug 17 11:42:50 user nova-compute[73449]:     <acpi/>
Aug 17 11:42:50 user nova-compute[73449]:     <apic/>
Aug 17 11:42:50 user nova-compute[73449]:     <vmcoreinfo state='on'/>
Aug 17 11:42:50 user nova-compute[73449]:   </features>
Aug 17 11:42:50 user nova-compute[73449]:   <cpu mode='custom' match='exact' check='full'>
Aug 17 11:42:50 user nova-compute[73449]:     <model fallback='forbid'>Nehalem</model>
Aug 17 11:42:50 user nova-compute[73449]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 17 11:42:50 user nova-compute[73449]:     <feature policy='require' name='vme'/>
Aug 17 11:42:50 user nova-compute[73449]:     <feature policy='require' name='x2apic'/>
Aug 17 11:42:50 user nova-compute[73449]:     <feature policy='require' name='hypervisor'/>
Aug 17 11:42:50 user nova-compute[73449]:   </cpu>
Aug 17 11:42:50 user nova-compute[73449]:   <clock offset='utc'>
Aug 17 11:42:50 user nova-compute[73449]:     <timer name='pit' tickpolicy='delay'/>
Aug 17 11:42:50 user nova-compute[73449]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 17 11:42:50 user nova-compute[73449]:     <timer name='hpet' present='no'/>
Aug 17 11:42:50 user nova-compute[73449]:   </clock>
Aug 17 11:42:50 user nova-compute[73449]:   <on_poweroff>destroy</on_poweroff>
Aug 17 11:42:50 user nova-compute[73449]:   <on_reboot>restart</on_reboot>
Aug 17 11:42:50 user nova-compute[73449]:   <on_crash>destroy</on_crash>
Aug 17 11:42:50 user nova-compute[73449]:   <devices>
Aug 17 11:42:50 user nova-compute[73449]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 17 11:42:50 user nova-compute[73449]:     <disk type='file' device='disk'>
Aug 17 11:42:50 user nova-compute[73449]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 17 11:42:50 user nova-compute[73449]:       <source file='/opt/stack/data/nova/instances/7d3e07fa-4823-48e9-a959-e7bac0e0b25b/disk' index='2'/>
Aug 17 11:42:50 user nova-compute[73449]:       <backingStore type='file' index='3'>
Aug 17 11:42:50 user nova-compute[73449]:         <format type='raw'/>
Aug 17 11:42:50 user nova-compute[73449]:         <source file='/opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3'/>
Aug 17 11:42:50 user nova-compute[73449]:         <backingStore/>
Aug 17 11:42:50 user nova-compute[73449]:       </backingStore>
Aug 17 11:42:50 user nova-compute[73449]:       <target dev='vda' bus='virtio'/>
Aug 17 11:42:50 user nova-compute[73449]:       <alias name='virtio-disk0'/>
Aug 17 11:42:50 user nova-compute[73449]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 17 11:42:50 user nova-compute[73449]:     </disk>
Aug 17 11:42:50 user nova-compute[73449]:     <disk type='file' device='cdrom'>
Aug 17 11:42:50 user nova-compute[73449]:       <driver name='qemu' type='raw' cache='none'/>
Aug 17 11:42:50 user nova-compute[73449]:       <source file='/opt/stack/data/nova/instances/7d3e07fa-4823-48e9-a959-e7bac0e0b25b/disk.config' index='1'/>
Aug 17 11:42:50 user nova-compute[73449]:       <backingStore/>
Aug 17 11:42:50 user nova-compute[73449]:       <target dev='hda' bus='ide'/>
Aug 17 11:42:50 user nova-compute[73449]:       <readonly/>
Aug 17 11:42:50 user nova-compute[73449]:       <alias name='ide0-0-0'/>
Aug 17 11:42:50 user nova-compute[73449]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 17 11:42:50 user nova-compute[73449]:     </disk>
Aug 17 11:42:50 user nova-compute[73449]:     <controller type='usb' index='0' model='none'>
Aug 17 11:42:50 user nova-compute[73449]:       <alias name='usb'/>
Aug 17 11:42:50 user nova-compute[73449]:     </controller>
Aug 17 11:42:50 user nova-compute[73449]:     <controller type='pci' index='0' model='pci-root'>
Aug 17 11:42:50 user nova-compute[73449]:       <alias name='pci.0'/>
Aug 17 11:42:50 user nova-compute[73449]:     </controller>
Aug 17 11:42:50 user nova-compute[73449]:     <controller type='ide' index='0'>
Aug 17 11:42:50 user nova-compute[73449]:       <alias name='ide'/>
Aug 17 11:42:50 user nova-compute[73449]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 17 11:42:50 user nova-compute[73449]:     </controller>
Aug 17 11:42:50 user nova-compute[73449]:     <interface type='ethernet'>
Aug 17 11:42:50 user nova-compute[73449]:       <mac address='fa:16:3e:fd:e7:b1'/>
Aug 17 11:42:50 user nova-compute[73449]:       <target dev='tap60dadb1a-76'/>
Aug 17 11:42:50 user nova-compute[73449]:       <model type='virtio'/>
Aug 17 11:42:50 user nova-compute[73449]:       <mtu size='1442'/>
Aug 17 11:42:50 user nova-compute[73449]:       <alias name='net0'/>
Aug 17 11:42:50 user nova-compute[73449]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 17 11:42:50 user nova-compute[73449]:     </interface>
Aug 17 11:42:50 user nova-compute[73449]:     <serial type='pty'>
Aug 17 11:42:50 user nova-compute[73449]:       <source path='/dev/pts/5'/>
Aug 17 11:42:50 user nova-compute[73449]:       <log file='/opt/stack/data/nova/instances/7d3e07fa-4823-48e9-a959-e7bac0e0b25b/console.log' append='off'/>
Aug 17 11:42:50 user nova-compute[73449]:       <target type='isa-serial' port='0'>
Aug 17 11:42:50 user nova-compute[73449]:         <model name='isa-serial'/>
Aug 17 11:42:50 user nova-compute[73449]:       </target>
Aug 17 11:42:50 user nova-compute[73449]:       <alias name='serial0'/>
Aug 17 11:42:50 user nova-compute[73449]:     </serial>
Aug 17 11:42:50 user nova-compute[73449]:     <console type='pty' tty='/dev/pts/5'>
Aug 17 11:42:50 user nova-compute[73449]:       <source path='/dev/pts/5'/>
Aug 17 11:42:50 user nova-compute[73449]:       <log file='/opt/stack/data/nova/instances/7d3e07fa-4823-48e9-a959-e7bac0e0b25b/console.log' append='off'/>
Aug 17 11:42:50 user nova-compute[73449]:       <target type='serial' port='0'/>
Aug 17 11:42:50 user nova-compute[73449]:       <alias name='serial0'/>
Aug 17 11:42:50 user nova-compute[73449]:     </console>
Aug 17 11:42:50 user nova-compute[73449]:     <input type='mouse' bus='ps2'>
Aug 17 11:42:50 user nova-compute[73449]:       <alias name='input0'/>
Aug 17 11:42:50 user nova-compute[73449]:     </input>
Aug 17 11:42:50 user nova-compute[73449]:     <input type='keyboard' bus='ps2'>
Aug 17 11:42:50 user nova-compute[73449]:       <alias name='input1'/>
Aug 17 11:42:50 user nova-compute[73449]:     </input>
Aug 17 11:42:50 user nova-compute[73449]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Aug 17 11:42:50 user nova-compute[73449]:       <listen type='address' address='0.0.0.0'/>
Aug 17 11:42:50 user nova-compute[73449]:     </graphics>
Aug 17 11:42:50 user nova-compute[73449]:     <audio id='1' type='none'/>
Aug 17 11:42:50 user nova-compute[73449]:     <video>
Aug 17 11:42:50 user nova-compute[73449]:       <model type='virtio' heads='1' primary='yes'/>
Aug 17 11:42:50 user nova-compute[73449]:       <alias name='video0'/>
Aug 17 11:42:50 user nova-compute[73449]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 17 11:42:50 user nova-compute[73449]:     </video>
Aug 17 11:42:50 user nova-compute[73449]:     <memballoon model='virtio'>
Aug 17 11:42:50 user nova-compute[73449]:       <stats period='10'/>
Aug 17 11:42:50 user nova-compute[73449]:       <alias name='balloon0'/>
Aug 17 11:42:50 user nova-compute[73449]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 17 11:42:50 user nova-compute[73449]:     </memballoon>
Aug 17 11:42:50 user nova-compute[73449]:     <rng model='virtio'>
Aug 17 11:42:50 user nova-compute[73449]:       <backend model='random'>/dev/urandom</backend>
Aug 17 11:42:50 user nova-compute[73449]:       <alias name='rng0'/>
Aug 17 11:42:50 user nova-compute[73449]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 17 11:42:50 user nova-compute[73449]:     </rng>
Aug 17 11:42:50 user nova-compute[73449]:   </devices>
Aug 17 11:42:50 user nova-compute[73449]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 17 11:42:50 user nova-compute[73449]:     <label>libvirt-7d3e07fa-4823-48e9-a959-e7bac0e0b25b</label>
Aug 17 11:42:50 user nova-compute[73449]:     <imagelabel>libvirt-7d3e07fa-4823-48e9-a959-e7bac0e0b25b</imagelabel>
Aug 17 11:42:50 user nova-compute[73449]:   </seclabel>
Aug 17 11:42:50 user nova-compute[73449]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 17 11:42:50 user nova-compute[73449]:     <label>+64055:+108</label>
Aug 17 11:42:50 user nova-compute[73449]:     <imagelabel>+64055:+108</imagelabel>
Aug 17 11:42:50 user nova-compute[73449]:   </seclabel>
Aug 17 11:42:50 user nova-compute[73449]: </domain>
Aug 17 11:42:50 user nova-compute[73449]:  {{(pid=73449) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 17 11:42:50 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-466f4fdb-bcdb-48ce-99ea-de2e6f1c5d46 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Successfully detached device tap80c33dff-82 from instance 7d3e07fa-4823-48e9-a959-e7bac0e0b25b from the live domain config.
Aug 17 11:42:50 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-466f4fdb-bcdb-48ce-99ea-de2e6f1c5d46 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T11:40:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2017749474',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2017749474',id=6,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKDfVSRbJOSL96IIDH0v0XJrsx/+BlroyuWS03V0CQU7P0dyi56boP0N4YVepj2zGZdJ92Q/eiUfqBiWlxOzCQZKWvHOldZF0ArsphTeKIZc5KRdUwh+L9qgCVMp15KALw==',key_name='tempest-keypair-1953925692',keypairs=<?>,launch_index=0,launched_at=2023-08-17T11:40:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3c75ffb297b94222a4502db0e0814538',ramdisk_id='',reservation_id='r-35nrqkzd',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1681245717',owner_user_name='tempest-TaggedAttachmentsTest-1681245717-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T11:40:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9df670f3f7da4815bdcb9915a4999380',uuid=7d3e07fa-4823-48e9-a959-e7bac0e0b25b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "80c33dff-82f7-4faa-ab3c-23691d6ff089", "address": "fa:16:3e:3b:bb:72", "network": {"id": "b3413879-f603-4b1d-b023-0110910a8800", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-768654625", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3c75ffb297b94222a4502db0e0814538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80c33dff-82", "ovs_interfaceid": "80c33dff-82f7-4faa-ab3c-23691d6ff089", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 11:42:50 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-466f4fdb-bcdb-48ce-99ea-de2e6f1c5d46 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Converting VIF {"id": "80c33dff-82f7-4faa-ab3c-23691d6ff089", "address": "fa:16:3e:3b:bb:72", "network": {"id": "b3413879-f603-4b1d-b023-0110910a8800", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-768654625", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3c75ffb297b94222a4502db0e0814538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80c33dff-82", "ovs_interfaceid": "80c33dff-82f7-4faa-ab3c-23691d6ff089", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:42:50 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-466f4fdb-bcdb-48ce-99ea-de2e6f1c5d46 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:bb:72,bridge_name='br-int',has_traffic_filtering=True,id=80c33dff-82f7-4faa-ab3c-23691d6ff089,network=Network(b3413879-f603-4b1d-b023-0110910a8800),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80c33dff-82') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:42:50 user nova-compute[73449]: DEBUG os_vif [None req-466f4fdb-bcdb-48ce-99ea-de2e6f1c5d46 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:bb:72,bridge_name='br-int',has_traffic_filtering=True,id=80c33dff-82f7-4faa-ab3c-23691d6ff089,network=Network(b3413879-f603-4b1d-b023-0110910a8800),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80c33dff-82') {{(pid=73449) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 11:42:50 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:50 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap80c33dff-82, bridge=br-int, if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:42:50 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:50 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:42:50 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:50 user nova-compute[73449]: INFO os_vif [None req-466f4fdb-bcdb-48ce-99ea-de2e6f1c5d46 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:bb:72,bridge_name='br-int',has_traffic_filtering=True,id=80c33dff-82f7-4faa-ab3c-23691d6ff089,network=Network(b3413879-f603-4b1d-b023-0110910a8800),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80c33dff-82')
Aug 17 11:42:50 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-466f4fdb-bcdb-48ce-99ea-de2e6f1c5d46 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 11:42:50 user nova-compute[73449]:   <nova:package version="0.0.0"/>
Aug 17 11:42:50 user nova-compute[73449]:   <nova:name>tempest-device-tagging-server-2017749474</nova:name>
Aug 17 11:42:50 user nova-compute[73449]:   <nova:creationTime>2023-08-17 11:42:50</nova:creationTime>
Aug 17 11:42:50 user nova-compute[73449]:   <nova:flavor name="m1.tiny">
Aug 17 11:42:50 user nova-compute[73449]:     <nova:memory>512</nova:memory>
Aug 17 11:42:50 user nova-compute[73449]:     <nova:disk>1</nova:disk>
Aug 17 11:42:50 user nova-compute[73449]:     <nova:swap>0</nova:swap>
Aug 17 11:42:50 user nova-compute[73449]:     <nova:ephemeral>0</nova:ephemeral>
Aug 17 11:42:50 user nova-compute[73449]:     <nova:vcpus>1</nova:vcpus>
Aug 17 11:42:50 user nova-compute[73449]:   </nova:flavor>
Aug 17 11:42:50 user nova-compute[73449]:   <nova:owner>
Aug 17 11:42:50 user nova-compute[73449]:     <nova:user uuid="9df670f3f7da4815bdcb9915a4999380">tempest-TaggedAttachmentsTest-1681245717-project-member</nova:user>
Aug 17 11:42:50 user nova-compute[73449]:     <nova:project uuid="3c75ffb297b94222a4502db0e0814538">tempest-TaggedAttachmentsTest-1681245717</nova:project>
Aug 17 11:42:50 user nova-compute[73449]:   </nova:owner>
Aug 17 11:42:50 user nova-compute[73449]:   <nova:root type="image" uuid="0a2904ae-083d-41c8-83db-343132b36148"/>
Aug 17 11:42:50 user nova-compute[73449]:   <nova:ports>
Aug 17 11:42:50 user nova-compute[73449]:     <nova:port uuid="60dadb1a-7680-434e-975f-8ef1ec1b4088">
Aug 17 11:42:50 user nova-compute[73449]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 17 11:42:50 user nova-compute[73449]:     </nova:port>
Aug 17 11:42:50 user nova-compute[73449]:   </nova:ports>
Aug 17 11:42:50 user nova-compute[73449]: </nova:instance>
Aug 17 11:42:50 user nova-compute[73449]:  {{(pid=73449) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 17 11:42:50 user nova-compute[73449]: DEBUG nova.compute.manager [req-cab4b164-e17b-4f77-a0eb-b9466cdf8c65 req-6f711b3c-3340-469d-b0de-94ce384a5360 service nova] [instance: 7d3e07fa-4823-48e9-a959-e7bac0e0b25b] Received event network-vif-unplugged-80c33dff-82f7-4faa-ab3c-23691d6ff089 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:42:50 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-cab4b164-e17b-4f77-a0eb-b9466cdf8c65 req-6f711b3c-3340-469d-b0de-94ce384a5360 service nova] Acquiring lock "7d3e07fa-4823-48e9-a959-e7bac0e0b25b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:42:50 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-cab4b164-e17b-4f77-a0eb-b9466cdf8c65 req-6f711b3c-3340-469d-b0de-94ce384a5360 service nova] Lock "7d3e07fa-4823-48e9-a959-e7bac0e0b25b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:42:50 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-cab4b164-e17b-4f77-a0eb-b9466cdf8c65 req-6f711b3c-3340-469d-b0de-94ce384a5360 service nova] Lock "7d3e07fa-4823-48e9-a959-e7bac0e0b25b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:42:50 user nova-compute[73449]: DEBUG nova.compute.manager [req-cab4b164-e17b-4f77-a0eb-b9466cdf8c65 req-6f711b3c-3340-469d-b0de-94ce384a5360 service nova] [instance: 7d3e07fa-4823-48e9-a959-e7bac0e0b25b] No waiting events found dispatching network-vif-unplugged-80c33dff-82f7-4faa-ab3c-23691d6ff089 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:42:50 user nova-compute[73449]: WARNING nova.compute.manager [req-cab4b164-e17b-4f77-a0eb-b9466cdf8c65 req-6f711b3c-3340-469d-b0de-94ce384a5360 service nova] [instance: 7d3e07fa-4823-48e9-a959-e7bac0e0b25b] Received unexpected event network-vif-unplugged-80c33dff-82f7-4faa-ab3c-23691d6ff089 for instance with vm_state active and task_state None.
Aug 17 11:42:50 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d3e07fa-4823-48e9-a959-e7bac0e0b25b/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:50 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d3e07fa-4823-48e9-a959-e7bac0e0b25b/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d3e07fa-4823-48e9-a959-e7bac0e0b25b/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:51 user nova-compute[73449]: DEBUG nova.compute.manager [req-4fb393d7-d6d3-4838-b61b-f98218d3477a req-8fd16533-435f-4dd3-8f41-f73530387380 service nova] [instance: 7d3e07fa-4823-48e9-a959-e7bac0e0b25b] Received event network-vif-deleted-80c33dff-82f7-4faa-ab3c-23691d6ff089 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:42:51 user nova-compute[73449]: INFO nova.compute.manager [req-4fb393d7-d6d3-4838-b61b-f98218d3477a req-8fd16533-435f-4dd3-8f41-f73530387380 service nova] [instance: 7d3e07fa-4823-48e9-a959-e7bac0e0b25b] Neutron deleted interface 80c33dff-82f7-4faa-ab3c-23691d6ff089; detaching it from the instance and deleting it from the info cache
Aug 17 11:42:51 user nova-compute[73449]: DEBUG nova.network.neutron [req-4fb393d7-d6d3-4838-b61b-f98218d3477a req-8fd16533-435f-4dd3-8f41-f73530387380 service nova] [instance: 7d3e07fa-4823-48e9-a959-e7bac0e0b25b] Updating instance_info_cache with network_info: [{"id": "60dadb1a-7680-434e-975f-8ef1ec1b4088", "address": "fa:16:3e:fd:e7:b1", "network": {"id": "2461f7a5-f076-40da-b7dc-c21b8cd64e55", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-146967442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c75ffb297b94222a4502db0e0814538", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60dadb1a-76", "ovs_interfaceid": "60dadb1a-7680-434e-975f-8ef1ec1b4088", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:42:51 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:42:51 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:42:51 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Hypervisor/Node resource view: name=user free_ram=7232MB free_disk=25.574371337890625GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73449) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 11:42:51 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:42:51 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:42:51 user nova-compute[73449]: DEBUG nova.objects.instance [req-4fb393d7-d6d3-4838-b61b-f98218d3477a req-8fd16533-435f-4dd3-8f41-f73530387380 service nova] Lazy-loading 'system_metadata' on Instance uuid 7d3e07fa-4823-48e9-a959-e7bac0e0b25b {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:42:51 user nova-compute[73449]: DEBUG nova.objects.instance [req-4fb393d7-d6d3-4838-b61b-f98218d3477a req-8fd16533-435f-4dd3-8f41-f73530387380 service nova] Lazy-loading 'flavor' on Instance uuid 7d3e07fa-4823-48e9-a959-e7bac0e0b25b {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:42:51 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-466f4fdb-bcdb-48ce-99ea-de2e6f1c5d46 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Acquiring lock "refresh_cache-7d3e07fa-4823-48e9-a959-e7bac0e0b25b" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:42:51 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-466f4fdb-bcdb-48ce-99ea-de2e6f1c5d46 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Acquired lock "refresh_cache-7d3e07fa-4823-48e9-a959-e7bac0e0b25b" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:42:51 user nova-compute[73449]: DEBUG nova.network.neutron [None req-466f4fdb-bcdb-48ce-99ea-de2e6f1c5d46 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] [instance: 7d3e07fa-4823-48e9-a959-e7bac0e0b25b] Building network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 11:42:51 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [req-4fb393d7-d6d3-4838-b61b-f98218d3477a req-8fd16533-435f-4dd3-8f41-f73530387380 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T11:40:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2017749474',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2017749474',id=6,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKDfVSRbJOSL96IIDH0v0XJrsx/+BlroyuWS03V0CQU7P0dyi56boP0N4YVepj2zGZdJ92Q/eiUfqBiWlxOzCQZKWvHOldZF0ArsphTeKIZc5KRdUwh+L9qgCVMp15KALw==',key_name='tempest-keypair-1953925692',keypairs=<?>,launch_index=0,launched_at=2023-08-17T11:40:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3c75ffb297b94222a4502db0e0814538',ramdisk_id='',reservation_id='r-35nrqkzd',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1681245717',owner_user_name='tempest-TaggedAttachmentsTest-1681245717-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T11:40:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9df670f3f7da4815bdcb9915a4999380',uuid=7d3e07fa-4823-48e9-a959-e7bac0e0b25b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "80c33dff-82f7-4faa-ab3c-23691d6ff089", "address": "fa:16:3e:3b:bb:72", "network": {"id": "b3413879-f603-4b1d-b023-0110910a8800", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-768654625", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3c75ffb297b94222a4502db0e0814538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80c33dff-82", "ovs_interfaceid": "80c33dff-82f7-4faa-ab3c-23691d6ff089", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73449) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 11:42:51 user nova-compute[73449]: DEBUG nova.network.os_vif_util [req-4fb393d7-d6d3-4838-b61b-f98218d3477a req-8fd16533-435f-4dd3-8f41-f73530387380 service nova] Converting VIF {"id": "80c33dff-82f7-4faa-ab3c-23691d6ff089", "address": "fa:16:3e:3b:bb:72", "network": {"id": "b3413879-f603-4b1d-b023-0110910a8800", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-768654625", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3c75ffb297b94222a4502db0e0814538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80c33dff-82", "ovs_interfaceid": "80c33dff-82f7-4faa-ab3c-23691d6ff089", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:42:51 user nova-compute[73449]: DEBUG nova.network.os_vif_util [req-4fb393d7-d6d3-4838-b61b-f98218d3477a req-8fd16533-435f-4dd3-8f41-f73530387380 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:bb:72,bridge_name='br-int',has_traffic_filtering=True,id=80c33dff-82f7-4faa-ab3c-23691d6ff089,network=Network(b3413879-f603-4b1d-b023-0110910a8800),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80c33dff-82') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:42:51 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [req-4fb393d7-d6d3-4838-b61b-f98218d3477a req-8fd16533-435f-4dd3-8f41-f73530387380 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:3b:bb:72"/><model type="virtio"/><mtu size="1442"/><target dev="tap80c33dff-82"/></interface> {{(pid=73449) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 17 11:42:51 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [req-4fb393d7-d6d3-4838-b61b-f98218d3477a req-8fd16533-435f-4dd3-8f41-f73530387380 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:3b:bb:72"/><model type="virtio"/><mtu size="1442"/><target dev="tap80c33dff-82"/></interface>not found in domain: <domain type='kvm' id='6'>
Aug 17 11:42:51 user nova-compute[73449]:   <name>instance-00000006</name>
Aug 17 11:42:51 user nova-compute[73449]:   <uuid>7d3e07fa-4823-48e9-a959-e7bac0e0b25b</uuid>
Aug 17 11:42:51 user nova-compute[73449]:   <metadata>
Aug 17 11:42:51 user nova-compute[73449]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 11:42:51 user nova-compute[73449]:   <nova:package version="0.0.0"/>
Aug 17 11:42:51 user nova-compute[73449]:   <nova:name>tempest-device-tagging-server-2017749474</nova:name>
Aug 17 11:42:51 user nova-compute[73449]:   <nova:creationTime>2023-08-17 11:42:50</nova:creationTime>
Aug 17 11:42:51 user nova-compute[73449]:   <nova:flavor name="m1.tiny">
Aug 17 11:42:51 user nova-compute[73449]:     <nova:memory>512</nova:memory>
Aug 17 11:42:51 user nova-compute[73449]:     <nova:disk>1</nova:disk>
Aug 17 11:42:51 user nova-compute[73449]:     <nova:swap>0</nova:swap>
Aug 17 11:42:51 user nova-compute[73449]:     <nova:ephemeral>0</nova:ephemeral>
Aug 17 11:42:51 user nova-compute[73449]:     <nova:vcpus>1</nova:vcpus>
Aug 17 11:42:51 user nova-compute[73449]:   </nova:flavor>
Aug 17 11:42:51 user nova-compute[73449]:   <nova:owner>
Aug 17 11:42:51 user nova-compute[73449]:     <nova:user uuid="9df670f3f7da4815bdcb9915a4999380">tempest-TaggedAttachmentsTest-1681245717-project-member</nova:user>
Aug 17 11:42:51 user nova-compute[73449]:     <nova:project uuid="3c75ffb297b94222a4502db0e0814538">tempest-TaggedAttachmentsTest-1681245717</nova:project>
Aug 17 11:42:51 user nova-compute[73449]:   </nova:owner>
Aug 17 11:42:51 user nova-compute[73449]:   <nova:root type="image" uuid="0a2904ae-083d-41c8-83db-343132b36148"/>
Aug 17 11:42:51 user nova-compute[73449]:   <nova:ports>
Aug 17 11:42:51 user nova-compute[73449]:     <nova:port uuid="60dadb1a-7680-434e-975f-8ef1ec1b4088">
Aug 17 11:42:51 user nova-compute[73449]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 17 11:42:51 user nova-compute[73449]:     </nova:port>
Aug 17 11:42:51 user nova-compute[73449]:   </nova:ports>
Aug 17 11:42:51 user nova-compute[73449]: </nova:instance>
Aug 17 11:42:51 user nova-compute[73449]:   </metadata>
Aug 17 11:42:51 user nova-compute[73449]:   <memory unit='KiB'>524288</memory>
Aug 17 11:42:51 user nova-compute[73449]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 17 11:42:51 user nova-compute[73449]:   <vcpu placement='static'>1</vcpu>
Aug 17 11:42:51 user nova-compute[73449]:   <resource>
Aug 17 11:42:51 user nova-compute[73449]:     <partition>/machine</partition>
Aug 17 11:42:51 user nova-compute[73449]:   </resource>
Aug 17 11:42:51 user nova-compute[73449]:   <sysinfo type='smbios'>
Aug 17 11:42:51 user nova-compute[73449]:     <system>
Aug 17 11:42:51 user nova-compute[73449]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 17 11:42:51 user nova-compute[73449]:       <entry name='product'>OpenStack Nova</entry>
Aug 17 11:42:51 user nova-compute[73449]:       <entry name='version'>0.0.0</entry>
Aug 17 11:42:51 user nova-compute[73449]:       <entry name='serial'>7d3e07fa-4823-48e9-a959-e7bac0e0b25b</entry>
Aug 17 11:42:51 user nova-compute[73449]:       <entry name='uuid'>7d3e07fa-4823-48e9-a959-e7bac0e0b25b</entry>
Aug 17 11:42:51 user nova-compute[73449]:       <entry name='family'>Virtual Machine</entry>
Aug 17 11:42:51 user nova-compute[73449]:     </system>
Aug 17 11:42:51 user nova-compute[73449]:   </sysinfo>
Aug 17 11:42:51 user nova-compute[73449]:   <os>
Aug 17 11:42:51 user nova-compute[73449]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 17 11:42:51 user nova-compute[73449]:     <boot dev='hd'/>
Aug 17 11:42:51 user nova-compute[73449]:     <smbios mode='sysinfo'/>
Aug 17 11:42:51 user nova-compute[73449]:   </os>
Aug 17 11:42:51 user nova-compute[73449]:   <features>
Aug 17 11:42:51 user nova-compute[73449]:     <acpi/>
Aug 17 11:42:51 user nova-compute[73449]:     <apic/>
Aug 17 11:42:51 user nova-compute[73449]:     <vmcoreinfo state='on'/>
Aug 17 11:42:51 user nova-compute[73449]:   </features>
Aug 17 11:42:51 user nova-compute[73449]:   <cpu mode='custom' match='exact' check='full'>
Aug 17 11:42:51 user nova-compute[73449]:     <model fallback='forbid'>Nehalem</model>
Aug 17 11:42:51 user nova-compute[73449]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 17 11:42:51 user nova-compute[73449]:     <feature policy='require' name='vme'/>
Aug 17 11:42:51 user nova-compute[73449]:     <feature policy='require' name='x2apic'/>
Aug 17 11:42:51 user nova-compute[73449]:     <feature policy='require' name='hypervisor'/>
Aug 17 11:42:51 user nova-compute[73449]:   </cpu>
Aug 17 11:42:51 user nova-compute[73449]:   <clock offset='utc'>
Aug 17 11:42:51 user nova-compute[73449]:     <timer name='pit' tickpolicy='delay'/>
Aug 17 11:42:51 user nova-compute[73449]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 17 11:42:51 user nova-compute[73449]:     <timer name='hpet' present='no'/>
Aug 17 11:42:51 user nova-compute[73449]:   </clock>
Aug 17 11:42:51 user nova-compute[73449]:   <on_poweroff>destroy</on_poweroff>
Aug 17 11:42:51 user nova-compute[73449]:   <on_reboot>restart</on_reboot>
Aug 17 11:42:51 user nova-compute[73449]:   <on_crash>destroy</on_crash>
Aug 17 11:42:51 user nova-compute[73449]:   <devices>
Aug 17 11:42:51 user nova-compute[73449]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 17 11:42:51 user nova-compute[73449]:     <disk type='file' device='disk'>
Aug 17 11:42:51 user nova-compute[73449]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 17 11:42:51 user nova-compute[73449]:       <source file='/opt/stack/data/nova/instances/7d3e07fa-4823-48e9-a959-e7bac0e0b25b/disk' index='2'/>
Aug 17 11:42:51 user nova-compute[73449]:       <backingStore type='file' index='3'>
Aug 17 11:42:51 user nova-compute[73449]:         <format type='raw'/>
Aug 17 11:42:51 user nova-compute[73449]:         <source file='/opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3'/>
Aug 17 11:42:51 user nova-compute[73449]:         <backingStore/>
Aug 17 11:42:51 user nova-compute[73449]:       </backingStore>
Aug 17 11:42:51 user nova-compute[73449]:       <target dev='vda' bus='virtio'/>
Aug 17 11:42:51 user nova-compute[73449]:       <alias name='virtio-disk0'/>
Aug 17 11:42:51 user nova-compute[73449]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 17 11:42:51 user nova-compute[73449]:     </disk>
Aug 17 11:42:51 user nova-compute[73449]:     <disk type='file' device='cdrom'>
Aug 17 11:42:51 user nova-compute[73449]:       <driver name='qemu' type='raw' cache='none'/>
Aug 17 11:42:51 user nova-compute[73449]:       <source file='/opt/stack/data/nova/instances/7d3e07fa-4823-48e9-a959-e7bac0e0b25b/disk.config' index='1'/>
Aug 17 11:42:51 user nova-compute[73449]:       <backingStore/>
Aug 17 11:42:51 user nova-compute[73449]:       <target dev='hda' bus='ide'/>
Aug 17 11:42:51 user nova-compute[73449]:       <readonly/>
Aug 17 11:42:51 user nova-compute[73449]:       <alias name='ide0-0-0'/>
Aug 17 11:42:51 user nova-compute[73449]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 17 11:42:51 user nova-compute[73449]:     </disk>
Aug 17 11:42:51 user nova-compute[73449]:     <controller type='usb' index='0' model='none'>
Aug 17 11:42:51 user nova-compute[73449]:       <alias name='usb'/>
Aug 17 11:42:51 user nova-compute[73449]:     </controller>
Aug 17 11:42:51 user nova-compute[73449]:     <controller type='pci' index='0' model='pci-root'>
Aug 17 11:42:51 user nova-compute[73449]:       <alias name='pci.0'/>
Aug 17 11:42:51 user nova-compute[73449]:     </controller>
Aug 17 11:42:51 user nova-compute[73449]:     <controller type='ide' index='0'>
Aug 17 11:42:51 user nova-compute[73449]:       <alias name='ide'/>
Aug 17 11:42:51 user nova-compute[73449]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 17 11:42:51 user nova-compute[73449]:     </controller>
Aug 17 11:42:51 user nova-compute[73449]:     <interface type='ethernet'>
Aug 17 11:42:51 user nova-compute[73449]:       <mac address='fa:16:3e:fd:e7:b1'/>
Aug 17 11:42:51 user nova-compute[73449]:       <target dev='tap60dadb1a-76'/>
Aug 17 11:42:51 user nova-compute[73449]:       <model type='virtio'/>
Aug 17 11:42:51 user nova-compute[73449]:       <mtu size='1442'/>
Aug 17 11:42:51 user nova-compute[73449]:       <alias name='net0'/>
Aug 17 11:42:51 user nova-compute[73449]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 17 11:42:51 user nova-compute[73449]:     </interface>
Aug 17 11:42:51 user nova-compute[73449]:     <serial type='pty'>
Aug 17 11:42:51 user nova-compute[73449]:       <source path='/dev/pts/5'/>
Aug 17 11:42:51 user nova-compute[73449]:       <log file='/opt/stack/data/nova/instances/7d3e07fa-4823-48e9-a959-e7bac0e0b25b/console.log' append='off'/>
Aug 17 11:42:51 user nova-compute[73449]:       <target type='isa-serial' port='0'>
Aug 17 11:42:51 user nova-compute[73449]:         <model name='isa-serial'/>
Aug 17 11:42:51 user nova-compute[73449]:       </target>
Aug 17 11:42:51 user nova-compute[73449]:       <alias name='serial0'/>
Aug 17 11:42:51 user nova-compute[73449]:     </serial>
Aug 17 11:42:51 user nova-compute[73449]:     <console type='pty' tty='/dev/pts/5'>
Aug 17 11:42:51 user nova-compute[73449]:       <source path='/dev/pts/5'/>
Aug 17 11:42:51 user nova-compute[73449]:       <log file='/opt/stack/data/nova/instances/7d3e07fa-4823-48e9-a959-e7bac0e0b25b/console.log' append='off'/>
Aug 17 11:42:51 user nova-compute[73449]:       <target type='serial' port='0'/>
Aug 17 11:42:51 user nova-compute[73449]:       <alias name='serial0'/>
Aug 17 11:42:51 user nova-compute[73449]:     </console>
Aug 17 11:42:51 user nova-compute[73449]:     <input type='mouse' bus='ps2'>
Aug 17 11:42:51 user nova-compute[73449]:       <alias name='input0'/>
Aug 17 11:42:51 user nova-compute[73449]:     </input>
Aug 17 11:42:51 user nova-compute[73449]:     <input type='keyboard' bus='ps2'>
Aug 17 11:42:51 user nova-compute[73449]:       <alias name='input1'/>
Aug 17 11:42:51 user nova-compute[73449]:     </input>
Aug 17 11:42:51 user nova-compute[73449]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Aug 17 11:42:51 user nova-compute[73449]:       <listen type='address' address='0.0.0.0'/>
Aug 17 11:42:51 user nova-compute[73449]:     </graphics>
Aug 17 11:42:51 user nova-compute[73449]:     <audio id='1' type='none'/>
Aug 17 11:42:51 user nova-compute[73449]:     <video>
Aug 17 11:42:51 user nova-compute[73449]:       <model type='virtio' heads='1' primary='yes'/>
Aug 17 11:42:51 user nova-compute[73449]:       <alias name='video0'/>
Aug 17 11:42:51 user nova-compute[73449]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 17 11:42:51 user nova-compute[73449]:     </video>
Aug 17 11:42:51 user nova-compute[73449]:     <memballoon model='virtio'>
Aug 17 11:42:51 user nova-compute[73449]:       <stats period='10'/>
Aug 17 11:42:51 user nova-compute[73449]:       <alias name='balloon0'/>
Aug 17 11:42:51 user nova-compute[73449]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 17 11:42:51 user nova-compute[73449]:     </memballoon>
Aug 17 11:42:51 user nova-compute[73449]:     <rng model='virtio'>
Aug 17 11:42:51 user nova-compute[73449]:       <backend model='random'>/dev/urandom</backend>
Aug 17 11:42:51 user nova-compute[73449]:       <alias name='rng0'/>
Aug 17 11:42:51 user nova-compute[73449]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 17 11:42:51 user nova-compute[73449]:     </rng>
Aug 17 11:42:51 user nova-compute[73449]:   </devices>
Aug 17 11:42:51 user nova-compute[73449]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 17 11:42:51 user nova-compute[73449]:     <label>libvirt-7d3e07fa-4823-48e9-a959-e7bac0e0b25b</label>
Aug 17 11:42:51 user nova-compute[73449]:     <imagelabel>libvirt-7d3e07fa-4823-48e9-a959-e7bac0e0b25b</imagelabel>
Aug 17 11:42:51 user nova-compute[73449]:   </seclabel>
Aug 17 11:42:51 user nova-compute[73449]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 17 11:42:51 user nova-compute[73449]:     <label>+64055:+108</label>
Aug 17 11:42:51 user nova-compute[73449]:     <imagelabel>+64055:+108</imagelabel>
Aug 17 11:42:51 user nova-compute[73449]:   </seclabel>
Aug 17 11:42:51 user nova-compute[73449]: </domain>
Aug 17 11:42:51 user nova-compute[73449]:  {{(pid=73449) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 17 11:42:51 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [req-4fb393d7-d6d3-4838-b61b-f98218d3477a req-8fd16533-435f-4dd3-8f41-f73530387380 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:3b:bb:72"/><model type="virtio"/><mtu size="1442"/><target dev="tap80c33dff-82"/></interface> {{(pid=73449) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 17 11:42:51 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [req-4fb393d7-d6d3-4838-b61b-f98218d3477a req-8fd16533-435f-4dd3-8f41-f73530387380 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:3b:bb:72"/><model type="virtio"/><mtu size="1442"/><target dev="tap80c33dff-82"/></interface>not found in domain: <domain type='kvm' id='6'>
Aug 17 11:42:51 user nova-compute[73449]:   <name>instance-00000006</name>
Aug 17 11:42:51 user nova-compute[73449]:   <uuid>7d3e07fa-4823-48e9-a959-e7bac0e0b25b</uuid>
Aug 17 11:42:51 user nova-compute[73449]:   <metadata>
Aug 17 11:42:51 user nova-compute[73449]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 11:42:51 user nova-compute[73449]:   <nova:package version="0.0.0"/>
Aug 17 11:42:51 user nova-compute[73449]:   <nova:name>tempest-device-tagging-server-2017749474</nova:name>
Aug 17 11:42:51 user nova-compute[73449]:   <nova:creationTime>2023-08-17 11:42:50</nova:creationTime>
Aug 17 11:42:51 user nova-compute[73449]:   <nova:flavor name="m1.tiny">
Aug 17 11:42:51 user nova-compute[73449]:     <nova:memory>512</nova:memory>
Aug 17 11:42:51 user nova-compute[73449]:     <nova:disk>1</nova:disk>
Aug 17 11:42:51 user nova-compute[73449]:     <nova:swap>0</nova:swap>
Aug 17 11:42:51 user nova-compute[73449]:     <nova:ephemeral>0</nova:ephemeral>
Aug 17 11:42:51 user nova-compute[73449]:     <nova:vcpus>1</nova:vcpus>
Aug 17 11:42:51 user nova-compute[73449]:   </nova:flavor>
Aug 17 11:42:51 user nova-compute[73449]:   <nova:owner>
Aug 17 11:42:51 user nova-compute[73449]:     <nova:user uuid="9df670f3f7da4815bdcb9915a4999380">tempest-TaggedAttachmentsTest-1681245717-project-member</nova:user>
Aug 17 11:42:51 user nova-compute[73449]:     <nova:project uuid="3c75ffb297b94222a4502db0e0814538">tempest-TaggedAttachmentsTest-1681245717</nova:project>
Aug 17 11:42:51 user nova-compute[73449]:   </nova:owner>
Aug 17 11:42:51 user nova-compute[73449]:   <nova:root type="image" uuid="0a2904ae-083d-41c8-83db-343132b36148"/>
Aug 17 11:42:51 user nova-compute[73449]:   <nova:ports>
Aug 17 11:42:51 user nova-compute[73449]:     <nova:port uuid="60dadb1a-7680-434e-975f-8ef1ec1b4088">
Aug 17 11:42:51 user nova-compute[73449]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 17 11:42:51 user nova-compute[73449]:     </nova:port>
Aug 17 11:42:51 user nova-compute[73449]:   </nova:ports>
Aug 17 11:42:51 user nova-compute[73449]: </nova:instance>
Aug 17 11:42:51 user nova-compute[73449]:   </metadata>
Aug 17 11:42:51 user nova-compute[73449]:   <memory unit='KiB'>524288</memory>
Aug 17 11:42:51 user nova-compute[73449]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 17 11:42:51 user nova-compute[73449]:   <vcpu placement='static'>1</vcpu>
Aug 17 11:42:51 user nova-compute[73449]:   <resource>
Aug 17 11:42:51 user nova-compute[73449]:     <partition>/machine</partition>
Aug 17 11:42:51 user nova-compute[73449]:   </resource>
Aug 17 11:42:51 user nova-compute[73449]:   <sysinfo type='smbios'>
Aug 17 11:42:51 user nova-compute[73449]:     <system>
Aug 17 11:42:51 user nova-compute[73449]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 17 11:42:51 user nova-compute[73449]:       <entry name='product'>OpenStack Nova</entry>
Aug 17 11:42:51 user nova-compute[73449]:       <entry name='version'>0.0.0</entry>
Aug 17 11:42:51 user nova-compute[73449]:       <entry name='serial'>7d3e07fa-4823-48e9-a959-e7bac0e0b25b</entry>
Aug 17 11:42:51 user nova-compute[73449]:       <entry name='uuid'>7d3e07fa-4823-48e9-a959-e7bac0e0b25b</entry>
Aug 17 11:42:51 user nova-compute[73449]:       <entry name='family'>Virtual Machine</entry>
Aug 17 11:42:51 user nova-compute[73449]:     </system>
Aug 17 11:42:51 user nova-compute[73449]:   </sysinfo>
Aug 17 11:42:51 user nova-compute[73449]:   <os>
Aug 17 11:42:51 user nova-compute[73449]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 17 11:42:51 user nova-compute[73449]:     <boot dev='hd'/>
Aug 17 11:42:51 user nova-compute[73449]:     <smbios mode='sysinfo'/>
Aug 17 11:42:51 user nova-compute[73449]:   </os>
Aug 17 11:42:51 user nova-compute[73449]:   <features>
Aug 17 11:42:51 user nova-compute[73449]:     <acpi/>
Aug 17 11:42:51 user nova-compute[73449]:     <apic/>
Aug 17 11:42:51 user nova-compute[73449]:     <vmcoreinfo state='on'/>
Aug 17 11:42:51 user nova-compute[73449]:   </features>
Aug 17 11:42:51 user nova-compute[73449]:   <cpu mode='custom' match='exact' check='full'>
Aug 17 11:42:51 user nova-compute[73449]:     <model fallback='forbid'>Nehalem</model>
Aug 17 11:42:51 user nova-compute[73449]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 17 11:42:51 user nova-compute[73449]:     <feature policy='require' name='vme'/>
Aug 17 11:42:51 user nova-compute[73449]:     <feature policy='require' name='x2apic'/>
Aug 17 11:42:51 user nova-compute[73449]:     <feature policy='require' name='hypervisor'/>
Aug 17 11:42:51 user nova-compute[73449]:   </cpu>
Aug 17 11:42:51 user nova-compute[73449]:   <clock offset='utc'>
Aug 17 11:42:51 user nova-compute[73449]:     <timer name='pit' tickpolicy='delay'/>
Aug 17 11:42:51 user nova-compute[73449]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 17 11:42:51 user nova-compute[73449]:     <timer name='hpet' present='no'/>
Aug 17 11:42:51 user nova-compute[73449]:   </clock>
Aug 17 11:42:51 user nova-compute[73449]:   <on_poweroff>destroy</on_poweroff>
Aug 17 11:42:51 user nova-compute[73449]:   <on_reboot>restart</on_reboot>
Aug 17 11:42:51 user nova-compute[73449]:   <on_crash>destroy</on_crash>
Aug 17 11:42:51 user nova-compute[73449]:   <devices>
Aug 17 11:42:51 user nova-compute[73449]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 17 11:42:51 user nova-compute[73449]:     <disk type='file' device='disk'>
Aug 17 11:42:51 user nova-compute[73449]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 17 11:42:51 user nova-compute[73449]:       <source file='/opt/stack/data/nova/instances/7d3e07fa-4823-48e9-a959-e7bac0e0b25b/disk' index='2'/>
Aug 17 11:42:51 user nova-compute[73449]:       <backingStore type='file' index='3'>
Aug 17 11:42:51 user nova-compute[73449]:         <format type='raw'/>
Aug 17 11:42:51 user nova-compute[73449]:         <source file='/opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3'/>
Aug 17 11:42:51 user nova-compute[73449]:         <backingStore/>
Aug 17 11:42:51 user nova-compute[73449]:       </backingStore>
Aug 17 11:42:51 user nova-compute[73449]:       <target dev='vda' bus='virtio'/>
Aug 17 11:42:51 user nova-compute[73449]:       <alias name='virtio-disk0'/>
Aug 17 11:42:51 user nova-compute[73449]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 17 11:42:51 user nova-compute[73449]:     </disk>
Aug 17 11:42:51 user nova-compute[73449]:     <disk type='file' device='cdrom'>
Aug 17 11:42:51 user nova-compute[73449]:       <driver name='qemu' type='raw' cache='none'/>
Aug 17 11:42:51 user nova-compute[73449]:       <source file='/opt/stack/data/nova/instances/7d3e07fa-4823-48e9-a959-e7bac0e0b25b/disk.config' index='1'/>
Aug 17 11:42:51 user nova-compute[73449]:       <backingStore/>
Aug 17 11:42:51 user nova-compute[73449]:       <target dev='hda' bus='ide'/>
Aug 17 11:42:51 user nova-compute[73449]:       <readonly/>
Aug 17 11:42:51 user nova-compute[73449]:       <alias name='ide0-0-0'/>
Aug 17 11:42:51 user nova-compute[73449]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 17 11:42:51 user nova-compute[73449]:     </disk>
Aug 17 11:42:51 user nova-compute[73449]:     <controller type='usb' index='0' model='none'>
Aug 17 11:42:51 user nova-compute[73449]:       <alias name='usb'/>
Aug 17 11:42:51 user nova-compute[73449]:     </controller>
Aug 17 11:42:51 user nova-compute[73449]:     <controller type='pci' index='0' model='pci-root'>
Aug 17 11:42:51 user nova-compute[73449]:       <alias name='pci.0'/>
Aug 17 11:42:51 user nova-compute[73449]:     </controller>
Aug 17 11:42:51 user nova-compute[73449]:     <controller type='ide' index='0'>
Aug 17 11:42:51 user nova-compute[73449]:       <alias name='ide'/>
Aug 17 11:42:51 user nova-compute[73449]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 17 11:42:51 user nova-compute[73449]:     </controller>
Aug 17 11:42:51 user nova-compute[73449]:     <interface type='ethernet'>
Aug 17 11:42:51 user nova-compute[73449]:       <mac address='fa:16:3e:fd:e7:b1'/>
Aug 17 11:42:51 user nova-compute[73449]:       <target dev='tap60dadb1a-76'/>
Aug 17 11:42:51 user nova-compute[73449]:       <model type='virtio'/>
Aug 17 11:42:51 user nova-compute[73449]:       <mtu size='1442'/>
Aug 17 11:42:51 user nova-compute[73449]:       <alias name='net0'/>
Aug 17 11:42:51 user nova-compute[73449]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 17 11:42:51 user nova-compute[73449]:     </interface>
Aug 17 11:42:51 user nova-compute[73449]:     <serial type='pty'>
Aug 17 11:42:51 user nova-compute[73449]:       <source path='/dev/pts/5'/>
Aug 17 11:42:51 user nova-compute[73449]:       <log file='/opt/stack/data/nova/instances/7d3e07fa-4823-48e9-a959-e7bac0e0b25b/console.log' append='off'/>
Aug 17 11:42:51 user nova-compute[73449]:       <target type='isa-serial' port='0'>
Aug 17 11:42:51 user nova-compute[73449]:         <model name='isa-serial'/>
Aug 17 11:42:51 user nova-compute[73449]:       </target>
Aug 17 11:42:51 user nova-compute[73449]:       <alias name='serial0'/>
Aug 17 11:42:51 user nova-compute[73449]:     </serial>
Aug 17 11:42:51 user nova-compute[73449]:     <console type='pty' tty='/dev/pts/5'>
Aug 17 11:42:51 user nova-compute[73449]:       <source path='/dev/pts/5'/>
Aug 17 11:42:51 user nova-compute[73449]:       <log file='/opt/stack/data/nova/instances/7d3e07fa-4823-48e9-a959-e7bac0e0b25b/console.log' append='off'/>
Aug 17 11:42:51 user nova-compute[73449]:       <target type='serial' port='0'/>
Aug 17 11:42:51 user nova-compute[73449]:       <alias name='serial0'/>
Aug 17 11:42:51 user nova-compute[73449]:     </console>
Aug 17 11:42:51 user nova-compute[73449]:     <input type='mouse' bus='ps2'>
Aug 17 11:42:51 user nova-compute[73449]:       <alias name='input0'/>
Aug 17 11:42:51 user nova-compute[73449]:     </input>
Aug 17 11:42:51 user nova-compute[73449]:     <input type='keyboard' bus='ps2'>
Aug 17 11:42:51 user nova-compute[73449]:       <alias name='input1'/>
Aug 17 11:42:51 user nova-compute[73449]:     </input>
Aug 17 11:42:51 user nova-compute[73449]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Aug 17 11:42:51 user nova-compute[73449]:       <listen type='address' address='0.0.0.0'/>
Aug 17 11:42:51 user nova-compute[73449]:     </graphics>
Aug 17 11:42:51 user nova-compute[73449]:     <audio id='1' type='none'/>
Aug 17 11:42:51 user nova-compute[73449]:     <video>
Aug 17 11:42:51 user nova-compute[73449]:       <model type='virtio' heads='1' primary='yes'/>
Aug 17 11:42:51 user nova-compute[73449]:       <alias name='video0'/>
Aug 17 11:42:51 user nova-compute[73449]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 17 11:42:51 user nova-compute[73449]:     </video>
Aug 17 11:42:51 user nova-compute[73449]:     <memballoon model='virtio'>
Aug 17 11:42:51 user nova-compute[73449]:       <stats period='10'/>
Aug 17 11:42:51 user nova-compute[73449]:       <alias name='balloon0'/>
Aug 17 11:42:51 user nova-compute[73449]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 17 11:42:51 user nova-compute[73449]:     </memballoon>
Aug 17 11:42:51 user nova-compute[73449]:     <rng model='virtio'>
Aug 17 11:42:51 user nova-compute[73449]:       <backend model='random'>/dev/urandom</backend>
Aug 17 11:42:51 user nova-compute[73449]:       <alias name='rng0'/>
Aug 17 11:42:51 user nova-compute[73449]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 17 11:42:51 user nova-compute[73449]:     </rng>
Aug 17 11:42:51 user nova-compute[73449]:   </devices>
Aug 17 11:42:51 user nova-compute[73449]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 17 11:42:51 user nova-compute[73449]:     <label>libvirt-7d3e07fa-4823-48e9-a959-e7bac0e0b25b</label>
Aug 17 11:42:51 user nova-compute[73449]:     <imagelabel>libvirt-7d3e07fa-4823-48e9-a959-e7bac0e0b25b</imagelabel>
Aug 17 11:42:51 user nova-compute[73449]:   </seclabel>
Aug 17 11:42:51 user nova-compute[73449]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 17 11:42:51 user nova-compute[73449]:     <label>+64055:+108</label>
Aug 17 11:42:51 user nova-compute[73449]:     <imagelabel>+64055:+108</imagelabel>
Aug 17 11:42:51 user nova-compute[73449]:   </seclabel>
Aug 17 11:42:51 user nova-compute[73449]: </domain>
Aug 17 11:42:51 user nova-compute[73449]:  {{(pid=73449) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 17 11:42:51 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [req-4fb393d7-d6d3-4838-b61b-f98218d3477a req-8fd16533-435f-4dd3-8f41-f73530387380 service nova] [instance: 7d3e07fa-4823-48e9-a959-e7bac0e0b25b] Detaching interface fa:16:3e:3b:bb:72 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap80c33dff-82' not found.
Aug 17 11:42:51 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [req-4fb393d7-d6d3-4838-b61b-f98218d3477a req-8fd16533-435f-4dd3-8f41-f73530387380 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T11:40:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2017749474',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2017749474',id=6,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKDfVSRbJOSL96IIDH0v0XJrsx/+BlroyuWS03V0CQU7P0dyi56boP0N4YVepj2zGZdJ92Q/eiUfqBiWlxOzCQZKWvHOldZF0ArsphTeKIZc5KRdUwh+L9qgCVMp15KALw==',key_name='tempest-keypair-1953925692',keypairs=<?>,launch_index=0,launched_at=2023-08-17T11:40:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3c75ffb297b94222a4502db0e0814538',ramdisk_id='',reservation_id='r-35nrqkzd',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1681245717',owner_user_name='tempest-TaggedAttachmentsTest-1681245717-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T11:40:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9df670f3f7da4815bdcb9915a4999380',uuid=7d3e07fa-4823-48e9-a959-e7bac0e0b25b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "80c33dff-82f7-4faa-ab3c-23691d6ff089", "address": "fa:16:3e:3b:bb:72", "network": {"id": "b3413879-f603-4b1d-b023-0110910a8800", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-768654625", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3c75ffb297b94222a4502db0e0814538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80c33dff-82", "ovs_interfaceid": "80c33dff-82f7-4faa-ab3c-23691d6ff089", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 11:42:51 user nova-compute[73449]: DEBUG nova.network.os_vif_util [req-4fb393d7-d6d3-4838-b61b-f98218d3477a req-8fd16533-435f-4dd3-8f41-f73530387380 service nova] Converting VIF {"id": "80c33dff-82f7-4faa-ab3c-23691d6ff089", "address": "fa:16:3e:3b:bb:72", "network": {"id": "b3413879-f603-4b1d-b023-0110910a8800", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-768654625", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3c75ffb297b94222a4502db0e0814538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80c33dff-82", "ovs_interfaceid": "80c33dff-82f7-4faa-ab3c-23691d6ff089", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:42:51 user nova-compute[73449]: DEBUG nova.network.os_vif_util [req-4fb393d7-d6d3-4838-b61b-f98218d3477a req-8fd16533-435f-4dd3-8f41-f73530387380 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:bb:72,bridge_name='br-int',has_traffic_filtering=True,id=80c33dff-82f7-4faa-ab3c-23691d6ff089,network=Network(b3413879-f603-4b1d-b023-0110910a8800),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80c33dff-82') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:42:51 user nova-compute[73449]: DEBUG os_vif [req-4fb393d7-d6d3-4838-b61b-f98218d3477a req-8fd16533-435f-4dd3-8f41-f73530387380 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:bb:72,bridge_name='br-int',has_traffic_filtering=True,id=80c33dff-82f7-4faa-ab3c-23691d6ff089,network=Network(b3413879-f603-4b1d-b023-0110910a8800),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80c33dff-82') {{(pid=73449) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 11:42:51 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:51 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap80c33dff-82, bridge=br-int, if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:42:51 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 11:42:51 user nova-compute[73449]: INFO os_vif [req-4fb393d7-d6d3-4838-b61b-f98218d3477a req-8fd16533-435f-4dd3-8f41-f73530387380 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:bb:72,bridge_name='br-int',has_traffic_filtering=True,id=80c33dff-82f7-4faa-ab3c-23691d6ff089,network=Network(b3413879-f603-4b1d-b023-0110910a8800),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80c33dff-82')
Aug 17 11:42:51 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [req-4fb393d7-d6d3-4838-b61b-f98218d3477a req-8fd16533-435f-4dd3-8f41-f73530387380 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 11:42:51 user nova-compute[73449]:   <nova:package version="0.0.0"/>
Aug 17 11:42:51 user nova-compute[73449]:   <nova:name>tempest-device-tagging-server-2017749474</nova:name>
Aug 17 11:42:51 user nova-compute[73449]:   <nova:creationTime>2023-08-17 11:42:51</nova:creationTime>
Aug 17 11:42:51 user nova-compute[73449]:   <nova:flavor name="m1.tiny">
Aug 17 11:42:51 user nova-compute[73449]:     <nova:memory>512</nova:memory>
Aug 17 11:42:51 user nova-compute[73449]:     <nova:disk>1</nova:disk>
Aug 17 11:42:51 user nova-compute[73449]:     <nova:swap>0</nova:swap>
Aug 17 11:42:51 user nova-compute[73449]:     <nova:ephemeral>0</nova:ephemeral>
Aug 17 11:42:51 user nova-compute[73449]:     <nova:vcpus>1</nova:vcpus>
Aug 17 11:42:51 user nova-compute[73449]:   </nova:flavor>
Aug 17 11:42:51 user nova-compute[73449]:   <nova:owner>
Aug 17 11:42:51 user nova-compute[73449]:     <nova:user uuid="9df670f3f7da4815bdcb9915a4999380">tempest-TaggedAttachmentsTest-1681245717-project-member</nova:user>
Aug 17 11:42:51 user nova-compute[73449]:     <nova:project uuid="3c75ffb297b94222a4502db0e0814538">tempest-TaggedAttachmentsTest-1681245717</nova:project>
Aug 17 11:42:51 user nova-compute[73449]:   </nova:owner>
Aug 17 11:42:51 user nova-compute[73449]:   <nova:root type="image" uuid="0a2904ae-083d-41c8-83db-343132b36148"/>
Aug 17 11:42:51 user nova-compute[73449]:   <nova:ports>
Aug 17 11:42:51 user nova-compute[73449]:     <nova:port uuid="60dadb1a-7680-434e-975f-8ef1ec1b4088">
Aug 17 11:42:51 user nova-compute[73449]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 17 11:42:51 user nova-compute[73449]:     </nova:port>
Aug 17 11:42:51 user nova-compute[73449]:   </nova:ports>
Aug 17 11:42:51 user nova-compute[73449]: </nova:instance>
Aug 17 11:42:51 user nova-compute[73449]:  {{(pid=73449) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 17 11:42:51 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 4a9e8ad2-19db-4975-87e4-2efce603a7d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:42:51 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance a3523d22-7165-46ad-be10-5e6ae374f91d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:42:51 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance fd8d4549-db8f-4c74-8706-8ac21f049c2e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:42:51 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:42:51 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 7d3e07fa-4823-48e9-a959-e7bac0e0b25b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:42:51 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance c7ef11da-09ce-47a1-ba56-02af6a77206c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:42:51 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance b8e1def1-8303-4257-b9b5-0050f05cf2d0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:42:51 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance f33a7013-82d0-477c-aa5e-b27e63f2b98d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:42:51 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance e3a9252c-0e0a-4c5c-a46f-eaa004479bd2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:42:51 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73449) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 11:42:51 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73449) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 11:42:52 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 11:42:52 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 11:42:52 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Compute_service record updated for user:user {{(pid=73449) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 11:42:52 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.454s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:42:52 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:52 user nova-compute[73449]: DEBUG nova.network.neutron [None req-466f4fdb-bcdb-48ce-99ea-de2e6f1c5d46 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] [instance: 7d3e07fa-4823-48e9-a959-e7bac0e0b25b] Updating instance_info_cache with network_info: [{"id": "60dadb1a-7680-434e-975f-8ef1ec1b4088", "address": "fa:16:3e:fd:e7:b1", "network": {"id": "2461f7a5-f076-40da-b7dc-c21b8cd64e55", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-146967442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c75ffb297b94222a4502db0e0814538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60dadb1a-76", "ovs_interfaceid": "60dadb1a-7680-434e-975f-8ef1ec1b4088", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:42:52 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-466f4fdb-bcdb-48ce-99ea-de2e6f1c5d46 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Releasing lock "refresh_cache-7d3e07fa-4823-48e9-a959-e7bac0e0b25b" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:42:52 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-466f4fdb-bcdb-48ce-99ea-de2e6f1c5d46 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Lock "interface-7d3e07fa-4823-48e9-a959-e7bac0e0b25b-80c33dff-82f7-4faa-ab3c-23691d6ff089" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 2.709s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:42:52 user nova-compute[73449]: DEBUG nova.compute.manager [req-7dcb39b8-7631-4d14-a14d-90371574a755 req-9c298675-4939-477d-af68-34d29c9e5bc8 service nova] [instance: 7d3e07fa-4823-48e9-a959-e7bac0e0b25b] Received event network-vif-plugged-80c33dff-82f7-4faa-ab3c-23691d6ff089 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:42:52 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-7dcb39b8-7631-4d14-a14d-90371574a755 req-9c298675-4939-477d-af68-34d29c9e5bc8 service nova] Acquiring lock "7d3e07fa-4823-48e9-a959-e7bac0e0b25b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:42:52 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-7dcb39b8-7631-4d14-a14d-90371574a755 req-9c298675-4939-477d-af68-34d29c9e5bc8 service nova] Lock "7d3e07fa-4823-48e9-a959-e7bac0e0b25b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:42:52 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-7dcb39b8-7631-4d14-a14d-90371574a755 req-9c298675-4939-477d-af68-34d29c9e5bc8 service nova] Lock "7d3e07fa-4823-48e9-a959-e7bac0e0b25b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:42:52 user nova-compute[73449]: DEBUG nova.compute.manager [req-7dcb39b8-7631-4d14-a14d-90371574a755 req-9c298675-4939-477d-af68-34d29c9e5bc8 service nova] [instance: 7d3e07fa-4823-48e9-a959-e7bac0e0b25b] No waiting events found dispatching network-vif-plugged-80c33dff-82f7-4faa-ab3c-23691d6ff089 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:42:52 user nova-compute[73449]: WARNING nova.compute.manager [req-7dcb39b8-7631-4d14-a14d-90371574a755 req-9c298675-4939-477d-af68-34d29c9e5bc8 service nova] [instance: 7d3e07fa-4823-48e9-a959-e7bac0e0b25b] Received unexpected event network-vif-plugged-80c33dff-82f7-4faa-ab3c-23691d6ff089 for instance with vm_state active and task_state None.
Aug 17 11:42:53 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:42:53 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:42:55 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:57 user nova-compute[73449]: DEBUG nova.compute.manager [None req-ca93d778-ed2b-4c2e-aacd-21f40f95e4da tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] [instance: c7ef11da-09ce-47a1-ba56-02af6a77206c] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:0d5ae737-c3e9-4e70-8e3d-4ec06a4ec43b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rznRTHSE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c7ef11da-09ce-47a1-ba56-02af6a77206c', 'attached_at': '', 'detached_at': '', 'volume_id': '0d5ae737-c3e9-4e70-8e3d-4ec06a4ec43b', 'serial': '0d5ae737-c3e9-4e70-8e3d-4ec06a4ec43b'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WroVHtXa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, 'status': 'reserved', 'instance': 'c7ef11da-09ce-47a1-ba56-02af6a77206c', 'attached_at': '', 'detached_at': '', 'volume_id': '8a554c8d-34fa-4557-a6e0-2dfdc32a161c', 'serial'} {{(pid=73449) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 17 11:42:57 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca93d778-ed2b-4c2e-aacd-21f40f95e4da tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] [instance: c7ef11da-09ce-47a1-ba56-02af6a77206c] Calling os-brick to attach iSCSI Volume {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 11:42:57 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca93d778-ed2b-4c2e-aacd-21f40f95e4da tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0d5ae737-c3e9-4e70-8e3d-4ec06a4ec43b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rznRTHSE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 11:42:57 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-ca93d778-ed2b-4c2e-aacd-21f40f95e4da tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 11:42:57 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-ca93d778-ed2b-4c2e-aacd-21f40f95e4da tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:42:57 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-ca93d778-ed2b-4c2e-aacd-21f40f95e4da tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:42:57 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-ca93d778-ed2b-4c2e-aacd-21f40f95e4da tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 11:42:57 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-ca93d778-ed2b-4c2e-aacd-21f40f95e4da tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0d5ae737-c3e9-4e70-8e3d-4ec06a4ec43b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:42:57 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-ca93d778-ed2b-4c2e-aacd-21f40f95e4da tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0d5ae737-c3e9-4e70-8e3d-4ec06a4ec43b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:42:57 user nova-compute[73449]: INFO os_brick.initiator.connectors.iscsi [None req-ca93d778-ed2b-4c2e-aacd-21f40f95e4da tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 11:42:57 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d5ae737-c3e9-4e70-8e3d-4ec06a4ec43b -p 172.16.0.220:3260 {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:57 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d5ae737-c3e9-4e70-8e3d-4ec06a4ec43b -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:57 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[e220d78d-4880-4c02-98fe-3bdd75497005]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:57 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca93d778-ed2b-4c2e-aacd-21f40f95e4da tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 11:42:57 user nova-compute[73449]:  {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:42:57 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d5ae737-c3e9-4e70-8e3d-4ec06a4ec43b -p 172.16.0.220:3260 --interface default --op new {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:57 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d5ae737-c3e9-4e70-8e3d-4ec06a4ec43b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:57 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[59f3e81f-febe-4540-9ce1-f20a5cabcf82]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0d5ae737-c3e9-4e70-8e3d-4ec06a4ec43b] added\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:57 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca93d778-ed2b-4c2e-aacd-21f40f95e4da tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0d5ae737-c3e9-4e70-8e3d-4ec06a4ec43b] added
Aug 17 11:42:57 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:42:57 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d5ae737-c3e9-4e70-8e3d-4ec06a4ec43b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:57 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d5ae737-c3e9-4e70-8e3d-4ec06a4ec43b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:57 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb7bd3eb-08bb-4e5b-a63b-fc962145c423]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:57 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca93d778-ed2b-4c2e-aacd-21f40f95e4da tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:42:57 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d5ae737-c3e9-4e70-8e3d-4ec06a4ec43b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:57 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d5ae737-c3e9-4e70-8e3d-4ec06a4ec43b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:57 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a41191-d1fd-49ea-adca-14df3e943918]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:57 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca93d778-ed2b-4c2e-aacd-21f40f95e4da tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:42:57 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d5ae737-c3e9-4e70-8e3d-4ec06a4ec43b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rznRTHSE {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:57 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d5ae737-c3e9-4e70-8e3d-4ec06a4ec43b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rznRTHSE" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:57 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[519e7f18-aa1d-486a-b9ae-836bbc08e4f4]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:57 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca93d778-ed2b-4c2e-aacd-21f40f95e4da tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rznRTHSE'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:42:57 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d5ae737-c3e9-4e70-8e3d-4ec06a4ec43b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:57 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d5ae737-c3e9-4e70-8e3d-4ec06a4ec43b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.077s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:57 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[358fd223-04da-4d41-96c2-da9cb18c8ff5]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:57 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca93d778-ed2b-4c2e-aacd-21f40f95e4da tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:42:57 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:57 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:57 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[612d5807-a883-40ea-8caf-b814710108d5]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:57 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca93d778-ed2b-4c2e-aacd-21f40f95e4da tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c (non-flash)
Aug 17 11:42:57 user nova-compute[73449]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919 (non-flash)
Aug 17 11:42:57 user nova-compute[73449]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47 (non-flash)
Aug 17 11:42:57 user nova-compute[73449]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda (non-flash)
Aug 17 11:42:57 user nova-compute[73449]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e (non-flash)
Aug 17 11:42:57 user nova-compute[73449]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff (non-flash)
Aug 17 11:42:57 user nova-compute[73449]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd (non-flash)
Aug 17 11:42:57 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:42:57 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca93d778-ed2b-4c2e-aacd-21f40f95e4da tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c (non-flash)
Aug 17 11:42:57 user nova-compute[73449]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919 (non-flash)
Aug 17 11:42:57 user nova-compute[73449]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47 (non-flash)
Aug 17 11:42:57 user nova-compute[73449]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda (non-flash)
Aug 17 11:42:57 user nova-compute[73449]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e (non-flash)
Aug 17 11:42:57 user nova-compute[73449]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff (non-flash)
Aug 17 11:42:57 user nova-compute[73449]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd (non-flash)
Aug 17 11:42:57 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:42:57 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d5ae737-c3e9-4e70-8e3d-4ec06a4ec43b -p 172.16.0.220:3260 --login {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:57 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:42:57 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d5ae737-c3e9-4e70-8e3d-4ec06a4ec43b -p 172.16.0.220:3260 --login" returned: 0 in 0.092s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:57 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8cd0130-43df-4dd9-b50f-4a59d28319d5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0d5ae737-c3e9-4e70-8e3d-4ec06a4ec43b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0d5ae737-c3e9-4e70-8e3d-4ec06a4ec43b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:57 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca93d778-ed2b-4c2e-aacd-21f40f95e4da tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0d5ae737-c3e9-4e70-8e3d-4ec06a4ec43b, portal: 172.16.0.220,3260]
Aug 17 11:42:57 user nova-compute[73449]: Login to [iface: default, target: iqn.2010-10.org.openstack:0d5ae737-c3e9-4e70-8e3d-4ec06a4ec43b, portal: 172.16.0.220,3260] successful.
Aug 17 11:42:57 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:42:57 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d5ae737-c3e9-4e70-8e3d-4ec06a4ec43b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:57 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d5ae737-c3e9-4e70-8e3d-4ec06a4ec43b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:57 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[3205c75c-9633-43a0-9a04-0e669868fde3]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:57 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca93d778-ed2b-4c2e-aacd-21f40f95e4da tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:42:57 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:57 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:57 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[58317be0-dd67-460d-a52f-8295115d9fed]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d5ae737-c3e9-4e70-8e3d-4ec06a4ec43b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:57 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca93d778-ed2b-4c2e-aacd-21f40f95e4da tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c (non-flash)
Aug 17 11:42:57 user nova-compute[73449]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d5ae737-c3e9-4e70-8e3d-4ec06a4ec43b (non-flash)
Aug 17 11:42:57 user nova-compute[73449]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919 (non-flash)
Aug 17 11:42:57 user nova-compute[73449]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47 (non-flash)
Aug 17 11:42:57 user nova-compute[73449]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda (non-flash)
Aug 17 11:42:57 user nova-compute[73449]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e (non-flash)
Aug 17 11:42:57 user nova-compute[73449]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff (non-flash)
Aug 17 11:42:57 user nova-compute[73449]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd (non-flash)
Aug 17 11:42:57 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:42:57 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca93d778-ed2b-4c2e-aacd-21f40f95e4da tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c (non-flash)
Aug 17 11:42:57 user nova-compute[73449]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d5ae737-c3e9-4e70-8e3d-4ec06a4ec43b (non-flash)
Aug 17 11:42:57 user nova-compute[73449]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919 (non-flash)
Aug 17 11:42:57 user nova-compute[73449]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47 (non-flash)
Aug 17 11:42:57 user nova-compute[73449]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda (non-flash)
Aug 17 11:42:57 user nova-compute[73449]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e (non-flash)
Aug 17 11:42:57 user nova-compute[73449]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff (non-flash)
Aug 17 11:42:57 user nova-compute[73449]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd (non-flash)
Aug 17 11:42:57 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:42:57 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-ca93d778-ed2b-4c2e-aacd-21f40f95e4da tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0d5ae737-c3e9-4e70-8e3d-4ec06a4ec43b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.388s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:42:57 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca93d778-ed2b-4c2e-aacd-21f40f95e4da tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] Connected to 172.16.0.220:3260 {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 11:42:57 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-ca93d778-ed2b-4c2e-aacd-21f40f95e4da tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] HCTL ('39', '-', '-', 0) found on session 13 with lun 0 {{(pid=73449) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 11:42:57 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-ca93d778-ed2b-4c2e-aacd-21f40f95e4da tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] Scanning host 39 c: -, t: -, l: 0) {{(pid=73449) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 11:42:57 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:42:57 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.017s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:42:57 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[cba9a7fc-321a-4753-b851-7a02228f04f1]: (4, ('- - 0', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:42:57 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-ca93d778-ed2b-4c2e-aacd-21f40f95e4da tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] Searching for a device in session 13 and hctl ['39', '*', '*', 0] yield: None {{(pid=73449) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 11:42:58 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-ca93d778-ed2b-4c2e-aacd-21f40f95e4da tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] Searching for a device in session 13 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=73449) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 11:42:58 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca93d778-ed2b-4c2e-aacd-21f40f95e4da tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rznRTHSE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 11:42:58 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-ca93d778-ed2b-4c2e-aacd-21f40f95e4da tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.419s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:42:58 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca93d778-ed2b-4c2e-aacd-21f40f95e4da tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] <== connect_volume: return (1420ms) {'type': 'block', 'scsi_wwn': '23563663065373061', 'path': '/dev/sdh'} {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 11:42:58 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca93d778-ed2b-4c2e-aacd-21f40f95e4da tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] [instance: c7ef11da-09ce-47a1-ba56-02af6a77206c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23563663065373061', 'path': '/dev/sdh'} {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 11:42:58 user nova-compute[73449]: DEBUG nova.objects.instance [None req-ca93d778-ed2b-4c2e-aacd-21f40f95e4da tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] Lazy-loading 'flavor' on Instance uuid c7ef11da-09ce-47a1-ba56-02af6a77206c {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:42:58 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-ca93d778-ed2b-4c2e-aacd-21f40f95e4da tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=73449) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 11:42:59 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-ca93d778-ed2b-4c2e-aacd-21f40f95e4da tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] COPY block job progress, current cursor: 164626432 final cursor: 1073741824 {{(pid=73449) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 11:42:59 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-ca93d778-ed2b-4c2e-aacd-21f40f95e4da tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] COPY block job progress, current cursor: 331350016 final cursor: 1073741824 {{(pid=73449) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 11:43:00 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-ca93d778-ed2b-4c2e-aacd-21f40f95e4da tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] COPY block job progress, current cursor: 459276288 final cursor: 1073741824 {{(pid=73449) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 11:43:00 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:43:00 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-ca93d778-ed2b-4c2e-aacd-21f40f95e4da tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] COPY block job progress, current cursor: 644874240 final cursor: 1073741824 {{(pid=73449) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 11:43:01 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-ca93d778-ed2b-4c2e-aacd-21f40f95e4da tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] COPY block job progress, current cursor: 740294656 final cursor: 1073741824 {{(pid=73449) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 11:43:01 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-ca93d778-ed2b-4c2e-aacd-21f40f95e4da tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] COPY block job progress, current cursor: 850395136 final cursor: 1073741824 {{(pid=73449) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 11:43:02 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:43:02 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-ca93d778-ed2b-4c2e-aacd-21f40f95e4da tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] COPY block job progress, current cursor: 990904320 final cursor: 1073741824 {{(pid=73449) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 11:43:02 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-ca93d778-ed2b-4c2e-aacd-21f40f95e4da tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=73449) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 11:43:03 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca93d778-ed2b-4c2e-aacd-21f40f95e4da tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] [instance: c7ef11da-09ce-47a1-ba56-02af6a77206c] calling os-brick to detach iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 11:43:03 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca93d778-ed2b-4c2e-aacd-21f40f95e4da tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, {'target_iqns': ['iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WroVHtXa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 11:43:03 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-ca93d778-ed2b-4c2e-aacd-21f40f95e4da tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 11:43:03 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-ca93d778-ed2b-4c2e-aacd-21f40f95e4da tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:43:03 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-ca93d778-ed2b-4c2e-aacd-21f40f95e4da tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:43:03 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca93d778-ed2b-4c2e-aacd-21f40f95e4da tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c', 0)] {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 11:43:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:43:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:43:03 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee953b3c-40de-41fe-872e-b2a684a56df3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d5ae737-c3e9-4e70-8e3d-4ec06a4ec43b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:43:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:43:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:43:03 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[65ba97da-cc36-4e39-96d2-284e0bef1bbf]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d5ae737-c3e9-4e70-8e3d-4ec06a4ec43b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:43:03 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca93d778-ed2b-4c2e-aacd-21f40f95e4da tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c (non-flash)
Aug 17 11:43:03 user nova-compute[73449]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d5ae737-c3e9-4e70-8e3d-4ec06a4ec43b (non-flash)
Aug 17 11:43:03 user nova-compute[73449]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919 (non-flash)
Aug 17 11:43:03 user nova-compute[73449]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47 (non-flash)
Aug 17 11:43:03 user nova-compute[73449]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda (non-flash)
Aug 17 11:43:03 user nova-compute[73449]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e (non-flash)
Aug 17 11:43:03 user nova-compute[73449]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff (non-flash)
Aug 17 11:43:03 user nova-compute[73449]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd (non-flash)
Aug 17 11:43:03 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:43:03 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca93d778-ed2b-4c2e-aacd-21f40f95e4da tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c (non-flash)
Aug 17 11:43:03 user nova-compute[73449]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d5ae737-c3e9-4e70-8e3d-4ec06a4ec43b (non-flash)
Aug 17 11:43:03 user nova-compute[73449]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919 (non-flash)
Aug 17 11:43:03 user nova-compute[73449]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47 (non-flash)
Aug 17 11:43:03 user nova-compute[73449]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda (non-flash)
Aug 17 11:43:03 user nova-compute[73449]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e (non-flash)
Aug 17 11:43:03 user nova-compute[73449]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff (non-flash)
Aug 17 11:43:03 user nova-compute[73449]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd (non-flash)
Aug 17 11:43:03 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:43:03 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca93d778-ed2b-4c2e-aacd-21f40f95e4da tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe7582b7520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c'): ({'sdj'}, set())}) {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 11:43:03 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-ca93d778-ed2b-4c2e-aacd-21f40f95e4da tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] Removing single pathed devices sdj {{(pid=73449) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 11:43:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:43:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:43:03 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[8340835f-8269-4b34-a5c3-a149bf00592b]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:43:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:43:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:43:03 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[95d0d769-e537-49fa-b981-1942e1032b8d]: (4, ('ok\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:43:03 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-ca93d778-ed2b-4c2e-aacd-21f40f95e4da tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] Flushing IO for device /dev/sdj {{(pid=73449) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 11:43:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:43:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.014s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:43:03 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5627bb8-d8ea-452a-975c-389dceff4845]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:43:03 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-ca93d778-ed2b-4c2e-aacd-21f40f95e4da tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=73449) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 11:43:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:43:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.040s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:43:03 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d150a3f-4935-4883-aca9-409138f29209]: (4, ('1', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:43:03 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-ca93d778-ed2b-4c2e-aacd-21f40f95e4da tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] Checking to see if SCSI volumes sdj have been removed. {{(pid=73449) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 11:43:03 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-ca93d778-ed2b-4c2e-aacd-21f40f95e4da tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] SCSI volumes sdj have been removed. {{(pid=73449) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 11:43:03 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca93d778-ed2b-4c2e-aacd-21f40f95e4da tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c')] {{(pid=73449) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 11:43:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:43:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:43:03 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[2264b7af-1192-4b50-9c99-508b8105accb]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:43:03 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca93d778-ed2b-4c2e-aacd-21f40f95e4da tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:43:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c -p 172.16.0.220:3260 --logout {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:43:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:43:03 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[95f8d3cd-da44-4cfe-996f-dbf63e5f3e32]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:43:03 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca93d778-ed2b-4c2e-aacd-21f40f95e4da tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c, portal: 172.16.0.220,3260]
Aug 17 11:43:03 user nova-compute[73449]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c, portal: 172.16.0.220,3260] successful.
Aug 17 11:43:03 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:43:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c -p 172.16.0.220:3260 --op delete {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:43:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:43:03 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8c007bb-abda-4eda-9aed-d41b53cb0af1]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:43:03 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca93d778-ed2b-4c2e-aacd-21f40f95e4da tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:43:03 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-ca93d778-ed2b-4c2e-aacd-21f40f95e4da tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:43:03 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca93d778-ed2b-4c2e-aacd-21f40f95e4da tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] <== disconnect_volume: return (305ms) None {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 11:43:03 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca93d778-ed2b-4c2e-aacd-21f40f95e4da tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] [instance: c7ef11da-09ce-47a1-ba56-02af6a77206c] Disconnected iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 11:43:03 user nova-compute[73449]: DEBUG nova.compute.manager [None req-ca93d778-ed2b-4c2e-aacd-21f40f95e4da tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:0d5ae737-c3e9-4e70-8e3d-4ec06a4ec43b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rznRTHSE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, 'status': 'reserved', 'instance': 'c7ef11da-09ce-47a1-ba56-02af6a77206c', 'attached_at': '', 'detached_at': '', 'volume_id': '0d5ae737-c3e9-4e70-8e3d-4ec06a4ec43b', 'serial'} {{(pid=73449) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 17 11:43:03 user nova-compute[73449]: DEBUG nova.compute.manager [None req-ca93d778-ed2b-4c2e-aacd-21f40f95e4da tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] [instance: c7ef11da-09ce-47a1-ba56-02af6a77206c] swap_volume: removing Cinder connection for volume 8a554c8d-34fa-4557-a6e0-2dfdc32a161c {{(pid=73449) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 17 11:43:04 user nova-compute[73449]: DEBUG nova.compute.manager [None req-ca93d778-ed2b-4c2e-aacd-21f40f95e4da tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] [instance: c7ef11da-09ce-47a1-ba56-02af6a77206c] swap_volume: Updating volume 8a554c8d-34fa-4557-a6e0-2dfdc32a161c BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:0d5ae737-c3e9-4e70-8e3d-4ec06a4ec43b"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "rznRTHSE", "auth_password": "SkeRIxTywdvOpV", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdh", "volume_id": "0d5ae737-c3e9-4e70-8e3d-4ec06a4ec43b"}, "status": "reserved", "instance": "c7ef11da-09ce-47a1-ba56-02af6a77206c", "attached_at": "", "detached_at": "", "volume_id": "0d5ae737-c3e9-4e70-8e3d-4ec06a4ec43b", "serial": "0d5ae737-c3e9-4e70-8e3d-4ec06a4ec43b"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '0d5ae737-c3e9-4e70-8e3d-4ec06a4ec43b', 'no_device': None, 'attachment_id': '9c5a90fa-a13f-4a61-92bc-507d1a70057e'} {{(pid=73449) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 17 11:43:04 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-ca93d778-ed2b-4c2e-aacd-21f40f95e4da tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] Lock "c7ef11da-09ce-47a1-ba56-02af6a77206c" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 20.322s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:43:05 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-9c00bf5e-d6eb-4277-997c-4f5291bda714 tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] Acquiring lock "c7ef11da-09ce-47a1-ba56-02af6a77206c" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:43:05 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-9c00bf5e-d6eb-4277-997c-4f5291bda714 tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] Lock "c7ef11da-09ce-47a1-ba56-02af6a77206c" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:43:05 user nova-compute[73449]: DEBUG os_brick.utils [None req-9c00bf5e-d6eb-4277-997c-4f5291bda714 tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 11:43:05 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:43:05 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:43:05 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd369d38-6ca5-4356-9f30-121cbe54cbfd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4d3924302012\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:43:05 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:43:05 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:43:05 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[32079407-485d-4d1a-add8-1065d881ed03]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:43:05 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:43:05 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:43:05 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[edfa88b0-c1ab-4fe0-856a-df399957dd78]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:43:05 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[d671f575-8a83-4588-a63d-5beaa7636aa7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:43:05 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-9c00bf5e-d6eb-4277-997c-4f5291bda714 tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] Running cmd (subprocess): nvme version {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:43:05 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-9c00bf5e-d6eb-4277-997c-4f5291bda714 tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] 'nvme version' failed. Not Retrying. {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 11:43:05 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9c00bf5e-d6eb-4277-997c-4f5291bda714 tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] nvme not present on system {{(pid=73449) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 11:43:05 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:43:05 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 11:43:05 user nova-compute[73449]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 11:43:05 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[e08e5ebf-b1eb-477f-b5cd-26ab227c0fc7]: (4, '') {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:43:05 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-9c00bf5e-d6eb-4277-997c-4f5291bda714 tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73449) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 11:43:05 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-9c00bf5e-d6eb-4277-997c-4f5291bda714 tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73449) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 11:43:05 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-9c00bf5e-d6eb-4277-997c-4f5291bda714 tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] LIGHTOS: no hostnqn found. {{(pid=73449) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 11:43:05 user nova-compute[73449]: DEBUG os_brick.utils [None req-9c00bf5e-d6eb-4277-997c-4f5291bda714 tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4d3924302012', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 11:43:05 user nova-compute[73449]: INFO nova.compute.manager [None req-9c00bf5e-d6eb-4277-997c-4f5291bda714 tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] [instance: c7ef11da-09ce-47a1-ba56-02af6a77206c] Swapping volume 0d5ae737-c3e9-4e70-8e3d-4ec06a4ec43b for 8a554c8d-34fa-4557-a6e0-2dfdc32a161c
Aug 17 11:43:05 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:43:10 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:43:11 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:43:14 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:43:15 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:43:17 user nova-compute[73449]: DEBUG nova.compute.manager [None req-9c00bf5e-d6eb-4277-997c-4f5291bda714 tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] [instance: c7ef11da-09ce-47a1-ba56-02af6a77206c] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WroVHtXa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c7ef11da-09ce-47a1-ba56-02af6a77206c', 'attached_at': '', 'detached_at': '', 'volume_id': '8a554c8d-34fa-4557-a6e0-2dfdc32a161c', 'serial': '8a554c8d-34fa-4557-a6e0-2dfdc32a161c'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:0d5ae737-c3e9-4e70-8e3d-4ec06a4ec43b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rznRTHSE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh', 'volume_id': '0d5ae737-c3e9-4e70-8e3d-4ec06a4ec43b'}, 'status': 'reserved', 'instance': 'c7ef11da-09ce-47a1-ba56-02af6a77206c', 'attached_at': '', 'detached_at': '', 'volume_id': '0d5ae737-c3e9-4e70-8e3d-4ec06a4ec43b', 'serial'} {{(pid=73449) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 17 11:43:17 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c00bf5e-d6eb-4277-997c-4f5291bda714 tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] [instance: c7ef11da-09ce-47a1-ba56-02af6a77206c] Calling os-brick to attach iSCSI Volume {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 11:43:17 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c00bf5e-d6eb-4277-997c-4f5291bda714 tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WroVHtXa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 11:43:17 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-9c00bf5e-d6eb-4277-997c-4f5291bda714 tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 11:43:17 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-9c00bf5e-d6eb-4277-997c-4f5291bda714 tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:43:17 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-9c00bf5e-d6eb-4277-997c-4f5291bda714 tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:43:17 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-9c00bf5e-d6eb-4277-997c-4f5291bda714 tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 11:43:17 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-9c00bf5e-d6eb-4277-997c-4f5291bda714 tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:43:17 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-9c00bf5e-d6eb-4277-997c-4f5291bda714 tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:43:17 user nova-compute[73449]: INFO os_brick.initiator.connectors.iscsi [None req-9c00bf5e-d6eb-4277-997c-4f5291bda714 tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 11:43:17 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c -p 172.16.0.220:3260 {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:43:17 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:43:17 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[abf39386-1d0e-4857-b5b5-13900fd37b3e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:43:17 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c00bf5e-d6eb-4277-997c-4f5291bda714 tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 11:43:17 user nova-compute[73449]:  {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:43:17 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c -p 172.16.0.220:3260 --interface default --op new {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:43:17 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:43:17 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[f94fb63e-c5bf-4cb4-a075-7853d3b6e0ac]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c] added\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:43:17 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c00bf5e-d6eb-4277-997c-4f5291bda714 tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c] added
Aug 17 11:43:17 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:43:17 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:43:17 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:43:17 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[97b541c6-ee14-4c15-b25a-8eba3f133e5e]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:43:17 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c00bf5e-d6eb-4277-997c-4f5291bda714 tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:43:17 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:43:17 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.034s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:43:17 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd67bc4a-1b89-4120-b2d3-7a19984c5d9a]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:43:17 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c00bf5e-d6eb-4277-997c-4f5291bda714 tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:43:17 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WroVHtXa {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:43:17 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WroVHtXa" returned: 0 in 0.023s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:43:17 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[aebdbcb1-187a-46b4-8e42-65bde21c3e97]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:43:17 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c00bf5e-d6eb-4277-997c-4f5291bda714 tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WroVHtXa'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:43:17 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:43:17 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:43:17 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[b79546ab-3e83-4739-ac10-a895d7995c56]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:43:17 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c00bf5e-d6eb-4277-997c-4f5291bda714 tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:43:17 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:43:17 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:43:17 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f8c3e70-fd55-4e46-b22e-458cffeda0e7]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d5ae737-c3e9-4e70-8e3d-4ec06a4ec43b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:43:17 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c00bf5e-d6eb-4277-997c-4f5291bda714 tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d5ae737-c3e9-4e70-8e3d-4ec06a4ec43b (non-flash)
Aug 17 11:43:17 user nova-compute[73449]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919 (non-flash)
Aug 17 11:43:17 user nova-compute[73449]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47 (non-flash)
Aug 17 11:43:17 user nova-compute[73449]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda (non-flash)
Aug 17 11:43:17 user nova-compute[73449]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e (non-flash)
Aug 17 11:43:17 user nova-compute[73449]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff (non-flash)
Aug 17 11:43:17 user nova-compute[73449]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd (non-flash)
Aug 17 11:43:17 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:43:17 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c00bf5e-d6eb-4277-997c-4f5291bda714 tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d5ae737-c3e9-4e70-8e3d-4ec06a4ec43b (non-flash)
Aug 17 11:43:17 user nova-compute[73449]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919 (non-flash)
Aug 17 11:43:17 user nova-compute[73449]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47 (non-flash)
Aug 17 11:43:17 user nova-compute[73449]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda (non-flash)
Aug 17 11:43:17 user nova-compute[73449]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e (non-flash)
Aug 17 11:43:17 user nova-compute[73449]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff (non-flash)
Aug 17 11:43:17 user nova-compute[73449]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd (non-flash)
Aug 17 11:43:17 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:43:17 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c -p 172.16.0.220:3260 --login {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:43:17 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:43:17 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[97e50ba7-3147-426c-b5fa-d3d435b5223e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:43:17 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c00bf5e-d6eb-4277-997c-4f5291bda714 tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c, portal: 172.16.0.220,3260]
Aug 17 11:43:17 user nova-compute[73449]: Login to [iface: default, target: iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c, portal: 172.16.0.220,3260] successful.
Aug 17 11:43:17 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:43:17 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:43:17 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:43:17 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb0689e6-8b4c-48ad-8950-29b837c9e0a8]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:43:17 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c00bf5e-d6eb-4277-997c-4f5291bda714 tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:43:17 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:43:17 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:43:17 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[f814f244-33ff-42cb-ae27-00cf124ad2e0]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d5ae737-c3e9-4e70-8e3d-4ec06a4ec43b (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:43:17 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c00bf5e-d6eb-4277-997c-4f5291bda714 tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d5ae737-c3e9-4e70-8e3d-4ec06a4ec43b (non-flash)
Aug 17 11:43:17 user nova-compute[73449]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c (non-flash)
Aug 17 11:43:17 user nova-compute[73449]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919 (non-flash)
Aug 17 11:43:17 user nova-compute[73449]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47 (non-flash)
Aug 17 11:43:17 user nova-compute[73449]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda (non-flash)
Aug 17 11:43:17 user nova-compute[73449]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e (non-flash)
Aug 17 11:43:17 user nova-compute[73449]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff (non-flash)
Aug 17 11:43:17 user nova-compute[73449]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd (non-flash)
Aug 17 11:43:17 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:43:17 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c00bf5e-d6eb-4277-997c-4f5291bda714 tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d5ae737-c3e9-4e70-8e3d-4ec06a4ec43b (non-flash)
Aug 17 11:43:17 user nova-compute[73449]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c (non-flash)
Aug 17 11:43:17 user nova-compute[73449]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919 (non-flash)
Aug 17 11:43:17 user nova-compute[73449]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47 (non-flash)
Aug 17 11:43:17 user nova-compute[73449]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda (non-flash)
Aug 17 11:43:17 user nova-compute[73449]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e (non-flash)
Aug 17 11:43:17 user nova-compute[73449]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff (non-flash)
Aug 17 11:43:17 user nova-compute[73449]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd (non-flash)
Aug 17 11:43:17 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:43:17 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-9c00bf5e-d6eb-4277-997c-4f5291bda714 tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.351s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:43:17 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c00bf5e-d6eb-4277-997c-4f5291bda714 tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] Connected to 172.16.0.220:3260 {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 11:43:17 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-9c00bf5e-d6eb-4277-997c-4f5291bda714 tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] HCTL ('40', '-', '-', 0) found on session 14 with lun 0 {{(pid=73449) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 11:43:17 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-9c00bf5e-d6eb-4277-997c-4f5291bda714 tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] Scanning host 40 c: -, t: -, l: 0) {{(pid=73449) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 11:43:17 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:43:17 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.016s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:43:17 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b785960-41c3-494d-a9e5-4d9337d6b369]: (4, ('- - 0', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:43:17 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-9c00bf5e-d6eb-4277-997c-4f5291bda714 tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] Searching for a device in session 14 and hctl ['40', '*', '*', 0] yield: None {{(pid=73449) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 11:43:18 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-9c00bf5e-d6eb-4277-997c-4f5291bda714 tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] Searching for a device in session 14 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=73449) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 11:43:18 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c00bf5e-d6eb-4277-997c-4f5291bda714 tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] Connected to sdi using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WroVHtXa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 11:43:18 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-9c00bf5e-d6eb-4277-997c-4f5291bda714 tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.381s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:43:18 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c00bf5e-d6eb-4277-997c-4f5291bda714 tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] <== connect_volume: return (1383ms) {'type': 'block', 'scsi_wwn': '26235393365333831', 'path': '/dev/sdi'} {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 11:43:18 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c00bf5e-d6eb-4277-997c-4f5291bda714 tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] [instance: c7ef11da-09ce-47a1-ba56-02af6a77206c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26235393365333831', 'path': '/dev/sdi'} {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 11:43:18 user nova-compute[73449]: DEBUG nova.objects.instance [None req-9c00bf5e-d6eb-4277-997c-4f5291bda714 tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] Lazy-loading 'flavor' on Instance uuid c7ef11da-09ce-47a1-ba56-02af6a77206c {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:43:18 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-9c00bf5e-d6eb-4277-997c-4f5291bda714 tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=73449) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 11:43:19 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-9c00bf5e-d6eb-4277-997c-4f5291bda714 tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] COPY block job progress, current cursor: 81788928 final cursor: 1073741824 {{(pid=73449) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 11:43:19 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-9c00bf5e-d6eb-4277-997c-4f5291bda714 tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] COPY block job progress, current cursor: 208666624 final cursor: 1073741824 {{(pid=73449) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 11:43:20 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-9c00bf5e-d6eb-4277-997c-4f5291bda714 tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] COPY block job progress, current cursor: 326107136 final cursor: 1073741824 {{(pid=73449) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 11:43:20 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:43:21 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-9c00bf5e-d6eb-4277-997c-4f5291bda714 tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] COPY block job progress, current cursor: 516947968 final cursor: 1073741824 {{(pid=73449) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 11:43:21 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-9c00bf5e-d6eb-4277-997c-4f5291bda714 tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] COPY block job progress, current cursor: 651165696 final cursor: 1073741824 {{(pid=73449) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 11:43:22 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-9c00bf5e-d6eb-4277-997c-4f5291bda714 tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] COPY block job progress, current cursor: 769654784 final cursor: 1073741824 {{(pid=73449) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 11:43:22 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-9c00bf5e-d6eb-4277-997c-4f5291bda714 tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] COPY block job progress, current cursor: 921698304 final cursor: 1073741824 {{(pid=73449) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 11:43:23 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-9c00bf5e-d6eb-4277-997c-4f5291bda714 tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] COPY block job progress, current cursor: 991952896 final cursor: 1073741824 {{(pid=73449) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 11:43:23 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-9c00bf5e-d6eb-4277-997c-4f5291bda714 tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=73449) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 11:43:23 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c00bf5e-d6eb-4277-997c-4f5291bda714 tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] [instance: c7ef11da-09ce-47a1-ba56-02af6a77206c] calling os-brick to detach iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 11:43:23 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c00bf5e-d6eb-4277-997c-4f5291bda714 tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, {'target_iqns': ['iqn.2010-10.org.openstack:0d5ae737-c3e9-4e70-8e3d-4ec06a4ec43b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rznRTHSE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh', 'volume_id': '0d5ae737-c3e9-4e70-8e3d-4ec06a4ec43b'}, None), 'kwargs': False}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 11:43:23 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-9c00bf5e-d6eb-4277-997c-4f5291bda714 tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 11:43:23 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-9c00bf5e-d6eb-4277-997c-4f5291bda714 tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:43:23 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-9c00bf5e-d6eb-4277-997c-4f5291bda714 tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:43:23 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c00bf5e-d6eb-4277-997c-4f5291bda714 tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0d5ae737-c3e9-4e70-8e3d-4ec06a4ec43b', 0)] {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 11:43:23 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:43:23 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:43:23 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[687c7afe-a88f-4c75-93ed-0adc2e422e2e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d5ae737-c3e9-4e70-8e3d-4ec06a4ec43b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:43:23 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:43:23 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:43:23 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0e2233f-90a0-4917-8edf-20eefc8e7ace]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d5ae737-c3e9-4e70-8e3d-4ec06a4ec43b (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:43:23 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c00bf5e-d6eb-4277-997c-4f5291bda714 tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d5ae737-c3e9-4e70-8e3d-4ec06a4ec43b (non-flash)
Aug 17 11:43:23 user nova-compute[73449]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c (non-flash)
Aug 17 11:43:23 user nova-compute[73449]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919 (non-flash)
Aug 17 11:43:23 user nova-compute[73449]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47 (non-flash)
Aug 17 11:43:23 user nova-compute[73449]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda (non-flash)
Aug 17 11:43:23 user nova-compute[73449]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e (non-flash)
Aug 17 11:43:23 user nova-compute[73449]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff (non-flash)
Aug 17 11:43:23 user nova-compute[73449]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd (non-flash)
Aug 17 11:43:23 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:43:23 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c00bf5e-d6eb-4277-997c-4f5291bda714 tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d5ae737-c3e9-4e70-8e3d-4ec06a4ec43b (non-flash)
Aug 17 11:43:23 user nova-compute[73449]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c (non-flash)
Aug 17 11:43:23 user nova-compute[73449]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919 (non-flash)
Aug 17 11:43:23 user nova-compute[73449]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47 (non-flash)
Aug 17 11:43:23 user nova-compute[73449]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda (non-flash)
Aug 17 11:43:23 user nova-compute[73449]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e (non-flash)
Aug 17 11:43:23 user nova-compute[73449]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff (non-flash)
Aug 17 11:43:23 user nova-compute[73449]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd (non-flash)
Aug 17 11:43:23 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:43:23 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c00bf5e-d6eb-4277-997c-4f5291bda714 tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe7582b8820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0d5ae737-c3e9-4e70-8e3d-4ec06a4ec43b'): ({'sdh'}, set())}) {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 11:43:23 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-9c00bf5e-d6eb-4277-997c-4f5291bda714 tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] Removing single pathed devices sdh {{(pid=73449) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 11:43:23 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:43:23 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:43:23 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdb22e0e-7429-4c44-96d3-7c8d50457137]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:43:23 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:43:23 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:43:23 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc52fd42-bd82-4ac3-ace3-c7122b30b403]: (4, ('ok\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:43:23 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-9c00bf5e-d6eb-4277-997c-4f5291bda714 tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] Flushing IO for device /dev/sdh {{(pid=73449) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 11:43:23 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:43:23 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.012s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:43:23 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[66fe2dc8-c7cc-4f11-99dc-7443866b0f47]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:43:23 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-9c00bf5e-d6eb-4277-997c-4f5291bda714 tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=73449) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 11:43:23 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:43:23 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.051s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:43:23 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ccf0c1d-25c0-4095-98e7-fafab1d25eec]: (4, ('1', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:43:23 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-9c00bf5e-d6eb-4277-997c-4f5291bda714 tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] Checking to see if SCSI volumes sdh have been removed. {{(pid=73449) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 11:43:23 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-9c00bf5e-d6eb-4277-997c-4f5291bda714 tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] SCSI volumes sdh have been removed. {{(pid=73449) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 11:43:23 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c00bf5e-d6eb-4277-997c-4f5291bda714 tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0d5ae737-c3e9-4e70-8e3d-4ec06a4ec43b')] {{(pid=73449) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 11:43:23 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d5ae737-c3e9-4e70-8e3d-4ec06a4ec43b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:43:23 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d5ae737-c3e9-4e70-8e3d-4ec06a4ec43b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:43:23 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[76c42e85-978d-47d7-aafe-0d38109aec8f]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:43:23 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c00bf5e-d6eb-4277-997c-4f5291bda714 tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:43:23 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d5ae737-c3e9-4e70-8e3d-4ec06a4ec43b -p 172.16.0.220:3260 --logout {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:43:23 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d5ae737-c3e9-4e70-8e3d-4ec06a4ec43b -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:43:23 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a303359-15b9-40de-96dc-412dbaa94c42]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:0d5ae737-c3e9-4e70-8e3d-4ec06a4ec43b, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:0d5ae737-c3e9-4e70-8e3d-4ec06a4ec43b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:43:23 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c00bf5e-d6eb-4277-997c-4f5291bda714 tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:0d5ae737-c3e9-4e70-8e3d-4ec06a4ec43b, portal: 172.16.0.220,3260]
Aug 17 11:43:23 user nova-compute[73449]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:0d5ae737-c3e9-4e70-8e3d-4ec06a4ec43b, portal: 172.16.0.220,3260] successful.
Aug 17 11:43:23 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:43:23 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d5ae737-c3e9-4e70-8e3d-4ec06a4ec43b -p 172.16.0.220:3260 --op delete {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:43:23 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d5ae737-c3e9-4e70-8e3d-4ec06a4ec43b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:43:23 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[728a5fc7-9979-4016-8815-809c811638b0]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:43:23 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c00bf5e-d6eb-4277-997c-4f5291bda714 tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:43:23 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-9c00bf5e-d6eb-4277-997c-4f5291bda714 tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.327s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:43:23 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c00bf5e-d6eb-4277-997c-4f5291bda714 tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] <== disconnect_volume: return (328ms) None {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 11:43:23 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c00bf5e-d6eb-4277-997c-4f5291bda714 tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] [instance: c7ef11da-09ce-47a1-ba56-02af6a77206c] Disconnected iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 11:43:24 user nova-compute[73449]: DEBUG nova.compute.manager [None req-9c00bf5e-d6eb-4277-997c-4f5291bda714 tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WroVHtXa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, 'status': 'reserved', 'instance': 'c7ef11da-09ce-47a1-ba56-02af6a77206c', 'attached_at': '', 'detached_at': '', 'volume_id': '8a554c8d-34fa-4557-a6e0-2dfdc32a161c', 'serial'} {{(pid=73449) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 17 11:43:24 user nova-compute[73449]: DEBUG nova.compute.manager [None req-9c00bf5e-d6eb-4277-997c-4f5291bda714 tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] [instance: c7ef11da-09ce-47a1-ba56-02af6a77206c] swap_volume: removing Cinder connection for volume 0d5ae737-c3e9-4e70-8e3d-4ec06a4ec43b {{(pid=73449) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 17 11:43:24 user nova-compute[73449]: DEBUG nova.compute.manager [None req-9c00bf5e-d6eb-4277-997c-4f5291bda714 tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] [instance: c7ef11da-09ce-47a1-ba56-02af6a77206c] swap_volume: Updating volume 0d5ae737-c3e9-4e70-8e3d-4ec06a4ec43b BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "WroVHtXa", "auth_password": "079Apb5eduMFZX", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdi", "volume_id": "8a554c8d-34fa-4557-a6e0-2dfdc32a161c"}, "status": "reserved", "instance": "c7ef11da-09ce-47a1-ba56-02af6a77206c", "attached_at": "", "detached_at": "", "volume_id": "8a554c8d-34fa-4557-a6e0-2dfdc32a161c", "serial": "8a554c8d-34fa-4557-a6e0-2dfdc32a161c"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '8a554c8d-34fa-4557-a6e0-2dfdc32a161c', 'no_device': None, 'attachment_id': '8578dccd-4b2b-4cbd-8bca-5995dcf9657c'} {{(pid=73449) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 17 11:43:25 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-9c00bf5e-d6eb-4277-997c-4f5291bda714 tempest-TestVolumeSwap-1540126568 tempest-TestVolumeSwap-1540126568-project-admin] Lock "c7ef11da-09ce-47a1-ba56-02af6a77206c" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 19.875s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:43:25 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:43:25 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-c1d6c467-2e2c-4288-97a3-9a67ab5c5701 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] Acquiring lock "c7ef11da-09ce-47a1-ba56-02af6a77206c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:43:25 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-c1d6c467-2e2c-4288-97a3-9a67ab5c5701 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] Lock "c7ef11da-09ce-47a1-ba56-02af6a77206c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:43:25 user nova-compute[73449]: INFO nova.compute.manager [None req-c1d6c467-2e2c-4288-97a3-9a67ab5c5701 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] [instance: c7ef11da-09ce-47a1-ba56-02af6a77206c] Detaching volume 8a554c8d-34fa-4557-a6e0-2dfdc32a161c
Aug 17 11:43:25 user nova-compute[73449]: INFO nova.virt.block_device [None req-c1d6c467-2e2c-4288-97a3-9a67ab5c5701 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] [instance: c7ef11da-09ce-47a1-ba56-02af6a77206c] Attempting to driver detach volume 8a554c8d-34fa-4557-a6e0-2dfdc32a161c from mountpoint /dev/vdb
Aug 17 11:43:25 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-c1d6c467-2e2c-4288-97a3-9a67ab5c5701 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] Attempting to detach device vdb from instance c7ef11da-09ce-47a1-ba56-02af6a77206c from the persistent domain config. {{(pid=73449) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 11:43:25 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-c1d6c467-2e2c-4288-97a3-9a67ab5c5701 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 11:43:25 user nova-compute[73449]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 11:43:25 user nova-compute[73449]:   <source dev="/dev/sdi"/>
Aug 17 11:43:25 user nova-compute[73449]:   <target dev="vdb" bus="virtio"/>
Aug 17 11:43:25 user nova-compute[73449]:   <serial>8a554c8d-34fa-4557-a6e0-2dfdc32a161c</serial>
Aug 17 11:43:25 user nova-compute[73449]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 11:43:25 user nova-compute[73449]: </disk>
Aug 17 11:43:25 user nova-compute[73449]:  {{(pid=73449) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 11:43:26 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-c1d6c467-2e2c-4288-97a3-9a67ab5c5701 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] Successfully detached device vdb from instance c7ef11da-09ce-47a1-ba56-02af6a77206c from the persistent domain config.
Aug 17 11:43:26 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-c1d6c467-2e2c-4288-97a3-9a67ab5c5701 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c7ef11da-09ce-47a1-ba56-02af6a77206c from the live domain config. {{(pid=73449) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 11:43:26 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-c1d6c467-2e2c-4288-97a3-9a67ab5c5701 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 11:43:26 user nova-compute[73449]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 11:43:26 user nova-compute[73449]:   <source dev="/dev/sdi"/>
Aug 17 11:43:26 user nova-compute[73449]:   <target dev="vdb" bus="virtio"/>
Aug 17 11:43:26 user nova-compute[73449]:   <serial>8a554c8d-34fa-4557-a6e0-2dfdc32a161c</serial>
Aug 17 11:43:26 user nova-compute[73449]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 11:43:26 user nova-compute[73449]: </disk>
Aug 17 11:43:26 user nova-compute[73449]:  {{(pid=73449) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 11:43:26 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Received event <DeviceRemovedEvent: 1692272606.454726, c7ef11da-09ce-47a1-ba56-02af6a77206c => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73449) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 11:43:26 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-c1d6c467-2e2c-4288-97a3-9a67ab5c5701 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c7ef11da-09ce-47a1-ba56-02af6a77206c {{(pid=73449) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 11:43:26 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-c1d6c467-2e2c-4288-97a3-9a67ab5c5701 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] Successfully detached device vdb from instance c7ef11da-09ce-47a1-ba56-02af6a77206c from the live domain config.
Aug 17 11:43:26 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1d6c467-2e2c-4288-97a3-9a67ab5c5701 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] [instance: c7ef11da-09ce-47a1-ba56-02af6a77206c] calling os-brick to detach iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 11:43:26 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d6c467-2e2c-4288-97a3-9a67ab5c5701 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, {'target_iqns': ['iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WroVHtXa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi', 'volume_id': '8a554c8d-34fa-4557-a6e0-2dfdc32a161c'}, None), 'kwargs': False}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 11:43:26 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-c1d6c467-2e2c-4288-97a3-9a67ab5c5701 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 11:43:26 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-c1d6c467-2e2c-4288-97a3-9a67ab5c5701 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:43:26 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-c1d6c467-2e2c-4288-97a3-9a67ab5c5701 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:43:26 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d6c467-2e2c-4288-97a3-9a67ab5c5701 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c', 0)] {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 11:43:26 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:43:26 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:43:26 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd9e3eb8-0eda-4070-a435-233ba5e61c5e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:43:26 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:43:26 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:43:26 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[19ac65f2-5a14-4499-8763-4da49943cc34]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:43:26 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d6c467-2e2c-4288-97a3-9a67ab5c5701 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c (non-flash)
Aug 17 11:43:26 user nova-compute[73449]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919 (non-flash)
Aug 17 11:43:26 user nova-compute[73449]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47 (non-flash)
Aug 17 11:43:26 user nova-compute[73449]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda (non-flash)
Aug 17 11:43:26 user nova-compute[73449]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e (non-flash)
Aug 17 11:43:26 user nova-compute[73449]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff (non-flash)
Aug 17 11:43:26 user nova-compute[73449]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd (non-flash)
Aug 17 11:43:26 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:43:26 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d6c467-2e2c-4288-97a3-9a67ab5c5701 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c (non-flash)
Aug 17 11:43:26 user nova-compute[73449]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919 (non-flash)
Aug 17 11:43:26 user nova-compute[73449]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47 (non-flash)
Aug 17 11:43:26 user nova-compute[73449]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda (non-flash)
Aug 17 11:43:26 user nova-compute[73449]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e (non-flash)
Aug 17 11:43:26 user nova-compute[73449]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff (non-flash)
Aug 17 11:43:26 user nova-compute[73449]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd (non-flash)
Aug 17 11:43:26 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:43:26 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d6c467-2e2c-4288-97a3-9a67ab5c5701 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe7582b85e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c'): ({'sdi'}, set())}) {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 11:43:26 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-c1d6c467-2e2c-4288-97a3-9a67ab5c5701 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] Removing single pathed devices sdi {{(pid=73449) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 11:43:26 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:43:26 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:43:26 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad8d2ac9-0bab-4bfb-8f2c-330c419d625b]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:43:26 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:43:26 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:43:26 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[05b8ab75-c069-4ea4-aebd-45e7fadfd6d5]: (4, ('ok\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:43:26 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-c1d6c467-2e2c-4288-97a3-9a67ab5c5701 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] Flushing IO for device /dev/sdi {{(pid=73449) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 11:43:26 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:43:26 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.014s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:43:26 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[da5115d3-87db-476d-9b65-4fbd2e4eee52]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:43:26 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-c1d6c467-2e2c-4288-97a3-9a67ab5c5701 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=73449) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 11:43:26 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:43:26 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.033s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:43:26 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e673b2a-53a7-4a79-a15b-10537368b620]: (4, ('1', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:43:26 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-c1d6c467-2e2c-4288-97a3-9a67ab5c5701 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=73449) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 11:43:26 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-c1d6c467-2e2c-4288-97a3-9a67ab5c5701 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] SCSI volumes sdi have been removed. {{(pid=73449) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 11:43:26 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d6c467-2e2c-4288-97a3-9a67ab5c5701 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c')] {{(pid=73449) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 11:43:26 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:43:26 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:43:26 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[97e49895-f3a1-4ee2-bcdb-5006f7d870db]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:43:26 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d6c467-2e2c-4288-97a3-9a67ab5c5701 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:43:26 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c -p 172.16.0.220:3260 --logout {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:43:26 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:43:26 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[9982fa06-0434-47bc-96ca-23ed37d55274]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:43:26 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d6c467-2e2c-4288-97a3-9a67ab5c5701 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c, portal: 172.16.0.220,3260]
Aug 17 11:43:26 user nova-compute[73449]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c, portal: 172.16.0.220,3260] successful.
Aug 17 11:43:26 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:43:26 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c -p 172.16.0.220:3260 --op delete {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:43:26 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a554c8d-34fa-4557-a6e0-2dfdc32a161c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:43:26 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[b99252f2-af62-4a74-9a34-0cadf18b326a]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:43:26 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d6c467-2e2c-4288-97a3-9a67ab5c5701 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:43:26 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-c1d6c467-2e2c-4288-97a3-9a67ab5c5701 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:43:26 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d6c467-2e2c-4288-97a3-9a67ab5c5701 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] <== disconnect_volume: return (289ms) None {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 11:43:26 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1d6c467-2e2c-4288-97a3-9a67ab5c5701 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] [instance: c7ef11da-09ce-47a1-ba56-02af6a77206c] Disconnected iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 11:43:27 user nova-compute[73449]: DEBUG nova.objects.instance [None req-c1d6c467-2e2c-4288-97a3-9a67ab5c5701 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] Lazy-loading 'flavor' on Instance uuid c7ef11da-09ce-47a1-ba56-02af6a77206c {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:43:27 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-c1d6c467-2e2c-4288-97a3-9a67ab5c5701 tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] Lock "c7ef11da-09ce-47a1-ba56-02af6a77206c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.726s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:43:30 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:43:33 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b68479b2-7ea3-41e2-9ae0-2b4a7303966c tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Acquiring lock "5e5229d5-65a2-4d60-8e50-c30357372a80" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:43:33 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b68479b2-7ea3-41e2-9ae0-2b4a7303966c tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Lock "5e5229d5-65a2-4d60-8e50-c30357372a80" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:43:33 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b68479b2-7ea3-41e2-9ae0-2b4a7303966c tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] [instance: 5e5229d5-65a2-4d60-8e50-c30357372a80] Starting instance... {{(pid=73449) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 11:43:33 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b68479b2-7ea3-41e2-9ae0-2b4a7303966c tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:43:33 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b68479b2-7ea3-41e2-9ae0-2b4a7303966c tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:43:33 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-b68479b2-7ea3-41e2-9ae0-2b4a7303966c tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73449) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 11:43:33 user nova-compute[73449]: INFO nova.compute.claims [None req-b68479b2-7ea3-41e2-9ae0-2b4a7303966c tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] [instance: 5e5229d5-65a2-4d60-8e50-c30357372a80] Claim successful on node user
Aug 17 11:43:34 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-b68479b2-7ea3-41e2-9ae0-2b4a7303966c tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 11:43:34 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-b68479b2-7ea3-41e2-9ae0-2b4a7303966c tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 11:43:34 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b68479b2-7ea3-41e2-9ae0-2b4a7303966c tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.436s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:43:34 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b68479b2-7ea3-41e2-9ae0-2b4a7303966c tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] [instance: 5e5229d5-65a2-4d60-8e50-c30357372a80] Start building networks asynchronously for instance. {{(pid=73449) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 11:43:34 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-5dc4de7e-a00b-4509-a201-a157700e5262 tempest-VolumesNegativeTest-353487240 tempest-VolumesNegativeTest-353487240-project-member] Acquiring lock "e3a9252c-0e0a-4c5c-a46f-eaa004479bd2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:43:34 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-5dc4de7e-a00b-4509-a201-a157700e5262 tempest-VolumesNegativeTest-353487240 tempest-VolumesNegativeTest-353487240-project-member] Lock "e3a9252c-0e0a-4c5c-a46f-eaa004479bd2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:43:34 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-5dc4de7e-a00b-4509-a201-a157700e5262 tempest-VolumesNegativeTest-353487240 tempest-VolumesNegativeTest-353487240-project-member] Acquiring lock "e3a9252c-0e0a-4c5c-a46f-eaa004479bd2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:43:34 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-5dc4de7e-a00b-4509-a201-a157700e5262 tempest-VolumesNegativeTest-353487240 tempest-VolumesNegativeTest-353487240-project-member] Lock "e3a9252c-0e0a-4c5c-a46f-eaa004479bd2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:43:34 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-5dc4de7e-a00b-4509-a201-a157700e5262 tempest-VolumesNegativeTest-353487240 tempest-VolumesNegativeTest-353487240-project-member] Lock "e3a9252c-0e0a-4c5c-a46f-eaa004479bd2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:43:34 user nova-compute[73449]: INFO nova.compute.manager [None req-5dc4de7e-a00b-4509-a201-a157700e5262 tempest-VolumesNegativeTest-353487240 tempest-VolumesNegativeTest-353487240-project-member] [instance: e3a9252c-0e0a-4c5c-a46f-eaa004479bd2] Terminating instance
Aug 17 11:43:34 user nova-compute[73449]: DEBUG nova.compute.manager [None req-5dc4de7e-a00b-4509-a201-a157700e5262 tempest-VolumesNegativeTest-353487240 tempest-VolumesNegativeTest-353487240-project-member] [instance: e3a9252c-0e0a-4c5c-a46f-eaa004479bd2] Start destroying the instance on the hypervisor. {{(pid=73449) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 11:43:34 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b68479b2-7ea3-41e2-9ae0-2b4a7303966c tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] [instance: 5e5229d5-65a2-4d60-8e50-c30357372a80] Allocating IP information in the background. {{(pid=73449) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 11:43:34 user nova-compute[73449]: DEBUG nova.network.neutron [None req-b68479b2-7ea3-41e2-9ae0-2b4a7303966c tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] [instance: 5e5229d5-65a2-4d60-8e50-c30357372a80] allocate_for_instance() {{(pid=73449) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 11:43:34 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-b68479b2-7ea3-41e2-9ae0-2b4a7303966c tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] [instance: 5e5229d5-65a2-4d60-8e50-c30357372a80] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 11:43:34 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b68479b2-7ea3-41e2-9ae0-2b4a7303966c tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] [instance: 5e5229d5-65a2-4d60-8e50-c30357372a80] Start building block device mappings for instance. {{(pid=73449) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 11:43:34 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:43:34 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:43:34 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:43:34 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:43:34 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b68479b2-7ea3-41e2-9ae0-2b4a7303966c tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] [instance: 5e5229d5-65a2-4d60-8e50-c30357372a80] Start spawning the instance on the hypervisor. {{(pid=73449) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 11:43:34 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b68479b2-7ea3-41e2-9ae0-2b4a7303966c tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] [instance: 5e5229d5-65a2-4d60-8e50-c30357372a80] Creating instance directory {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 11:43:34 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-b68479b2-7ea3-41e2-9ae0-2b4a7303966c tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] [instance: 5e5229d5-65a2-4d60-8e50-c30357372a80] Creating image(s)
Aug 17 11:43:34 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b68479b2-7ea3-41e2-9ae0-2b4a7303966c tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Acquiring lock "/opt/stack/data/nova/instances/5e5229d5-65a2-4d60-8e50-c30357372a80/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:43:34 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b68479b2-7ea3-41e2-9ae0-2b4a7303966c tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Lock "/opt/stack/data/nova/instances/5e5229d5-65a2-4d60-8e50-c30357372a80/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:43:34 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b68479b2-7ea3-41e2-9ae0-2b4a7303966c tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Lock "/opt/stack/data/nova/instances/5e5229d5-65a2-4d60-8e50-c30357372a80/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:43:34 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-b68479b2-7ea3-41e2-9ae0-2b4a7303966c tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:43:34 user nova-compute[73449]: DEBUG nova.policy [None req-b68479b2-7ea3-41e2-9ae0-2b4a7303966c tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4cfe2e3e87454eb38768c2ed81450b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2513ad48149f45e2a2bd4b404ebc13b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73449) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 11:43:34 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-b68479b2-7ea3-41e2-9ae0-2b4a7303966c tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json" returned: 0 in 0.216s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:43:34 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b68479b2-7ea3-41e2-9ae0-2b4a7303966c tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Acquiring lock "7e267a577c062ee862e95ede6b48cfd5632f3ea3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:43:34 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b68479b2-7ea3-41e2-9ae0-2b4a7303966c tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Lock "7e267a577c062ee862e95ede6b48cfd5632f3ea3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:43:34 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-b68479b2-7ea3-41e2-9ae0-2b4a7303966c tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:43:34 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-b68479b2-7ea3-41e2-9ae0-2b4a7303966c tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json" returned: 0 in 0.185s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:43:34 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-b68479b2-7ea3-41e2-9ae0-2b4a7303966c tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3,backing_fmt=raw /opt/stack/data/nova/instances/5e5229d5-65a2-4d60-8e50-c30357372a80/disk 1073741824 {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:43:34 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-b68479b2-7ea3-41e2-9ae0-2b4a7303966c tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3,backing_fmt=raw /opt/stack/data/nova/instances/5e5229d5-65a2-4d60-8e50-c30357372a80/disk 1073741824" returned: 0 in 0.047s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:43:34 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b68479b2-7ea3-41e2-9ae0-2b4a7303966c tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Lock "7e267a577c062ee862e95ede6b48cfd5632f3ea3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:43:34 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-b68479b2-7ea3-41e2-9ae0-2b4a7303966c tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:43:35 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: e3a9252c-0e0a-4c5c-a46f-eaa004479bd2] Instance destroyed successfully.
Aug 17 11:43:35 user nova-compute[73449]: DEBUG nova.objects.instance [None req-5dc4de7e-a00b-4509-a201-a157700e5262 tempest-VolumesNegativeTest-353487240 tempest-VolumesNegativeTest-353487240-project-member] Lazy-loading 'resources' on Instance uuid e3a9252c-0e0a-4c5c-a46f-eaa004479bd2 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:43:35 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-5dc4de7e-a00b-4509-a201-a157700e5262 tempest-VolumesNegativeTest-353487240 tempest-VolumesNegativeTest-353487240-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:41:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-402518887',display_name='tempest-VolumesNegativeTest-instance-402518887',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-402518887',id=10,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T11:41:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4cc04aafe1594cb5b33594577bc2c2f6',ramdisk_id='',reservation_id='r-x4naommf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-353487240',owner_user_name='tempest-VolumesNegativeTest-353487240-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T11:41:52Z,user_data=None,user_id='aae80a28db1d4999937d418adf6e5f85',uuid=e3a9252c-0e0a-4c5c-a46f-eaa004479bd2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fec2c3eb-3fd7-4804-8474-6105b30373aa", "address": "fa:16:3e:df:e2:8a", "network": {"id": "b66f5009-c462-42fe-99b0-47bee2d60605", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "7a77880136a54ef195c82e018e1939db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfec2c3eb-3f", "ovs_interfaceid": "fec2c3eb-3fd7-4804-8474-6105b30373aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 11:43:35 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-5dc4de7e-a00b-4509-a201-a157700e5262 tempest-VolumesNegativeTest-353487240 tempest-VolumesNegativeTest-353487240-project-member] Converting VIF {"id": "fec2c3eb-3fd7-4804-8474-6105b30373aa", "address": "fa:16:3e:df:e2:8a", "network": {"id": "b66f5009-c462-42fe-99b0-47bee2d60605", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "7a77880136a54ef195c82e018e1939db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfec2c3eb-3f", "ovs_interfaceid": "fec2c3eb-3fd7-4804-8474-6105b30373aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:43:35 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-5dc4de7e-a00b-4509-a201-a157700e5262 tempest-VolumesNegativeTest-353487240 tempest-VolumesNegativeTest-353487240-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:e2:8a,bridge_name='br-int',has_traffic_filtering=True,id=fec2c3eb-3fd7-4804-8474-6105b30373aa,network=Network(b66f5009-c462-42fe-99b0-47bee2d60605),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfec2c3eb-3f') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:43:35 user nova-compute[73449]: DEBUG os_vif [None req-5dc4de7e-a00b-4509-a201-a157700e5262 tempest-VolumesNegativeTest-353487240 tempest-VolumesNegativeTest-353487240-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:e2:8a,bridge_name='br-int',has_traffic_filtering=True,id=fec2c3eb-3fd7-4804-8474-6105b30373aa,network=Network(b66f5009-c462-42fe-99b0-47bee2d60605),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfec2c3eb-3f') {{(pid=73449) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 11:43:35 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:43:35 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfec2c3eb-3f, bridge=br-int, if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:43:35 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:43:35 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:43:35 user nova-compute[73449]: INFO os_vif [None req-5dc4de7e-a00b-4509-a201-a157700e5262 tempest-VolumesNegativeTest-353487240 tempest-VolumesNegativeTest-353487240-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:e2:8a,bridge_name='br-int',has_traffic_filtering=True,id=fec2c3eb-3fd7-4804-8474-6105b30373aa,network=Network(b66f5009-c462-42fe-99b0-47bee2d60605),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfec2c3eb-3f')
Aug 17 11:43:35 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-5dc4de7e-a00b-4509-a201-a157700e5262 tempest-VolumesNegativeTest-353487240 tempest-VolumesNegativeTest-353487240-project-member] [instance: e3a9252c-0e0a-4c5c-a46f-eaa004479bd2] Deleting instance files /opt/stack/data/nova/instances/e3a9252c-0e0a-4c5c-a46f-eaa004479bd2_del
Aug 17 11:43:35 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-5dc4de7e-a00b-4509-a201-a157700e5262 tempest-VolumesNegativeTest-353487240 tempest-VolumesNegativeTest-353487240-project-member] [instance: e3a9252c-0e0a-4c5c-a46f-eaa004479bd2] Deletion of /opt/stack/data/nova/instances/e3a9252c-0e0a-4c5c-a46f-eaa004479bd2_del complete
Aug 17 11:43:35 user nova-compute[73449]: DEBUG nova.compute.manager [req-62284a31-f7ec-4bcf-92d7-fcab271640eb req-3edd815c-c544-4164-b720-ef43d263dfca service nova] [instance: e3a9252c-0e0a-4c5c-a46f-eaa004479bd2] Received event network-vif-unplugged-fec2c3eb-3fd7-4804-8474-6105b30373aa {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:43:35 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-62284a31-f7ec-4bcf-92d7-fcab271640eb req-3edd815c-c544-4164-b720-ef43d263dfca service nova] Acquiring lock "e3a9252c-0e0a-4c5c-a46f-eaa004479bd2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:43:35 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-62284a31-f7ec-4bcf-92d7-fcab271640eb req-3edd815c-c544-4164-b720-ef43d263dfca service nova] Lock "e3a9252c-0e0a-4c5c-a46f-eaa004479bd2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:43:35 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-62284a31-f7ec-4bcf-92d7-fcab271640eb req-3edd815c-c544-4164-b720-ef43d263dfca service nova] Lock "e3a9252c-0e0a-4c5c-a46f-eaa004479bd2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:43:35 user nova-compute[73449]: DEBUG nova.compute.manager [req-62284a31-f7ec-4bcf-92d7-fcab271640eb req-3edd815c-c544-4164-b720-ef43d263dfca service nova] [instance: e3a9252c-0e0a-4c5c-a46f-eaa004479bd2] No waiting events found dispatching network-vif-unplugged-fec2c3eb-3fd7-4804-8474-6105b30373aa {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:43:35 user nova-compute[73449]: DEBUG nova.compute.manager [req-62284a31-f7ec-4bcf-92d7-fcab271640eb req-3edd815c-c544-4164-b720-ef43d263dfca service nova] [instance: e3a9252c-0e0a-4c5c-a46f-eaa004479bd2] Received event network-vif-unplugged-fec2c3eb-3fd7-4804-8474-6105b30373aa for instance with task_state deleting. {{(pid=73449) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 11:43:35 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-b68479b2-7ea3-41e2-9ae0-2b4a7303966c tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json" returned: 0 in 0.239s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:43:35 user nova-compute[73449]: DEBUG nova.virt.disk.api [None req-b68479b2-7ea3-41e2-9ae0-2b4a7303966c tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5e5229d5-65a2-4d60-8e50-c30357372a80/disk. size=1073741824 {{(pid=73449) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 11:43:35 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-b68479b2-7ea3-41e2-9ae0-2b4a7303966c tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e5229d5-65a2-4d60-8e50-c30357372a80/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:43:35 user nova-compute[73449]: INFO nova.compute.manager [None req-5dc4de7e-a00b-4509-a201-a157700e5262 tempest-VolumesNegativeTest-353487240 tempest-VolumesNegativeTest-353487240-project-member] [instance: e3a9252c-0e0a-4c5c-a46f-eaa004479bd2] Took 1.00 seconds to destroy the instance on the hypervisor.
Aug 17 11:43:35 user nova-compute[73449]: DEBUG oslo.service.loopingcall [None req-5dc4de7e-a00b-4509-a201-a157700e5262 tempest-VolumesNegativeTest-353487240 tempest-VolumesNegativeTest-353487240-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73449) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 11:43:35 user nova-compute[73449]: DEBUG nova.compute.manager [-] [instance: e3a9252c-0e0a-4c5c-a46f-eaa004479bd2] Deallocating network for instance {{(pid=73449) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 11:43:35 user nova-compute[73449]: DEBUG nova.network.neutron [-] [instance: e3a9252c-0e0a-4c5c-a46f-eaa004479bd2] deallocate_for_instance() {{(pid=73449) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 11:43:35 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-b68479b2-7ea3-41e2-9ae0-2b4a7303966c tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e5229d5-65a2-4d60-8e50-c30357372a80/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:43:35 user nova-compute[73449]: DEBUG nova.virt.disk.api [None req-b68479b2-7ea3-41e2-9ae0-2b4a7303966c tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Cannot resize image /opt/stack/data/nova/instances/5e5229d5-65a2-4d60-8e50-c30357372a80/disk to a smaller size. {{(pid=73449) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 11:43:35 user nova-compute[73449]: DEBUG nova.objects.instance [None req-b68479b2-7ea3-41e2-9ae0-2b4a7303966c tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Lazy-loading 'migration_context' on Instance uuid 5e5229d5-65a2-4d60-8e50-c30357372a80 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:43:35 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b68479b2-7ea3-41e2-9ae0-2b4a7303966c tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] [instance: 5e5229d5-65a2-4d60-8e50-c30357372a80] Created local disks {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 11:43:35 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b68479b2-7ea3-41e2-9ae0-2b4a7303966c tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] [instance: 5e5229d5-65a2-4d60-8e50-c30357372a80] Ensure instance console log exists: /opt/stack/data/nova/instances/5e5229d5-65a2-4d60-8e50-c30357372a80/console.log {{(pid=73449) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 11:43:35 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b68479b2-7ea3-41e2-9ae0-2b4a7303966c tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:43:35 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b68479b2-7ea3-41e2-9ae0-2b4a7303966c tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:43:35 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b68479b2-7ea3-41e2-9ae0-2b4a7303966c tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:43:35 user nova-compute[73449]: DEBUG nova.network.neutron [-] [instance: e3a9252c-0e0a-4c5c-a46f-eaa004479bd2] Updating instance_info_cache with network_info: [] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:43:35 user nova-compute[73449]: INFO nova.compute.manager [-] [instance: e3a9252c-0e0a-4c5c-a46f-eaa004479bd2] Took 0.64 seconds to deallocate network for instance.
Aug 17 11:43:35 user nova-compute[73449]: DEBUG nova.compute.manager [req-3587a7cf-05c7-4469-9410-7640f77a957e req-cc6b3236-3da7-4b17-a9f5-ed37c0352d09 service nova] [instance: e3a9252c-0e0a-4c5c-a46f-eaa004479bd2] Received event network-vif-deleted-fec2c3eb-3fd7-4804-8474-6105b30373aa {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:43:35 user nova-compute[73449]: INFO nova.compute.manager [req-3587a7cf-05c7-4469-9410-7640f77a957e req-cc6b3236-3da7-4b17-a9f5-ed37c0352d09 service nova] [instance: e3a9252c-0e0a-4c5c-a46f-eaa004479bd2] Neutron deleted interface fec2c3eb-3fd7-4804-8474-6105b30373aa; detaching it from the instance and deleting it from the info cache
Aug 17 11:43:35 user nova-compute[73449]: DEBUG nova.network.neutron [req-3587a7cf-05c7-4469-9410-7640f77a957e req-cc6b3236-3da7-4b17-a9f5-ed37c0352d09 service nova] [instance: e3a9252c-0e0a-4c5c-a46f-eaa004479bd2] Updating instance_info_cache with network_info: [] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:43:35 user nova-compute[73449]: DEBUG nova.compute.manager [req-3587a7cf-05c7-4469-9410-7640f77a957e req-cc6b3236-3da7-4b17-a9f5-ed37c0352d09 service nova] [instance: e3a9252c-0e0a-4c5c-a46f-eaa004479bd2] Detach interface failed, port_id=fec2c3eb-3fd7-4804-8474-6105b30373aa, reason: Instance e3a9252c-0e0a-4c5c-a46f-eaa004479bd2 could not be found. {{(pid=73449) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 11:43:35 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-5dc4de7e-a00b-4509-a201-a157700e5262 tempest-VolumesNegativeTest-353487240 tempest-VolumesNegativeTest-353487240-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:43:35 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-5dc4de7e-a00b-4509-a201-a157700e5262 tempest-VolumesNegativeTest-353487240 tempest-VolumesNegativeTest-353487240-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:43:36 user nova-compute[73449]: DEBUG nova.network.neutron [None req-b68479b2-7ea3-41e2-9ae0-2b4a7303966c tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] [instance: 5e5229d5-65a2-4d60-8e50-c30357372a80] Successfully created port: 01a7a900-b5c9-46c8-b5b6-1aed4bef301e {{(pid=73449) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 11:43:36 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-5dc4de7e-a00b-4509-a201-a157700e5262 tempest-VolumesNegativeTest-353487240 tempest-VolumesNegativeTest-353487240-project-member] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 11:43:36 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-5dc4de7e-a00b-4509-a201-a157700e5262 tempest-VolumesNegativeTest-353487240 tempest-VolumesNegativeTest-353487240-project-member] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 11:43:36 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-5dc4de7e-a00b-4509-a201-a157700e5262 tempest-VolumesNegativeTest-353487240 tempest-VolumesNegativeTest-353487240-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.351s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:43:36 user nova-compute[73449]: INFO nova.scheduler.client.report [None req-5dc4de7e-a00b-4509-a201-a157700e5262 tempest-VolumesNegativeTest-353487240 tempest-VolumesNegativeTest-353487240-project-member] Deleted allocations for instance e3a9252c-0e0a-4c5c-a46f-eaa004479bd2
Aug 17 11:43:36 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-5dc4de7e-a00b-4509-a201-a157700e5262 tempest-VolumesNegativeTest-353487240 tempest-VolumesNegativeTest-353487240-project-member] Lock "e3a9252c-0e0a-4c5c-a46f-eaa004479bd2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.306s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:43:37 user nova-compute[73449]: DEBUG nova.network.neutron [None req-b68479b2-7ea3-41e2-9ae0-2b4a7303966c tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] [instance: 5e5229d5-65a2-4d60-8e50-c30357372a80] Successfully updated port: 01a7a900-b5c9-46c8-b5b6-1aed4bef301e {{(pid=73449) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 11:43:37 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b68479b2-7ea3-41e2-9ae0-2b4a7303966c tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Acquiring lock "refresh_cache-5e5229d5-65a2-4d60-8e50-c30357372a80" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:43:37 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b68479b2-7ea3-41e2-9ae0-2b4a7303966c tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Acquired lock "refresh_cache-5e5229d5-65a2-4d60-8e50-c30357372a80" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:43:37 user nova-compute[73449]: DEBUG nova.network.neutron [None req-b68479b2-7ea3-41e2-9ae0-2b4a7303966c tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] [instance: 5e5229d5-65a2-4d60-8e50-c30357372a80] Building network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 11:43:37 user nova-compute[73449]: DEBUG nova.network.neutron [None req-b68479b2-7ea3-41e2-9ae0-2b4a7303966c tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] [instance: 5e5229d5-65a2-4d60-8e50-c30357372a80] Instance cache missing network info. {{(pid=73449) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 11:43:37 user nova-compute[73449]: DEBUG nova.compute.manager [req-1f6928b9-a439-4be4-8614-5a322860eeef req-2bcdfbbe-f6b7-41bc-9064-5e85dc95e3c3 service nova] [instance: e3a9252c-0e0a-4c5c-a46f-eaa004479bd2] Received event network-vif-plugged-fec2c3eb-3fd7-4804-8474-6105b30373aa {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:43:37 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-1f6928b9-a439-4be4-8614-5a322860eeef req-2bcdfbbe-f6b7-41bc-9064-5e85dc95e3c3 service nova] Acquiring lock "e3a9252c-0e0a-4c5c-a46f-eaa004479bd2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:43:37 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-1f6928b9-a439-4be4-8614-5a322860eeef req-2bcdfbbe-f6b7-41bc-9064-5e85dc95e3c3 service nova] Lock "e3a9252c-0e0a-4c5c-a46f-eaa004479bd2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:43:37 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-1f6928b9-a439-4be4-8614-5a322860eeef req-2bcdfbbe-f6b7-41bc-9064-5e85dc95e3c3 service nova] Lock "e3a9252c-0e0a-4c5c-a46f-eaa004479bd2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:43:37 user nova-compute[73449]: DEBUG nova.compute.manager [req-1f6928b9-a439-4be4-8614-5a322860eeef req-2bcdfbbe-f6b7-41bc-9064-5e85dc95e3c3 service nova] [instance: e3a9252c-0e0a-4c5c-a46f-eaa004479bd2] No waiting events found dispatching network-vif-plugged-fec2c3eb-3fd7-4804-8474-6105b30373aa {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:43:37 user nova-compute[73449]: WARNING nova.compute.manager [req-1f6928b9-a439-4be4-8614-5a322860eeef req-2bcdfbbe-f6b7-41bc-9064-5e85dc95e3c3 service nova] [instance: e3a9252c-0e0a-4c5c-a46f-eaa004479bd2] Received unexpected event network-vif-plugged-fec2c3eb-3fd7-4804-8474-6105b30373aa for instance with vm_state deleted and task_state None.
Aug 17 11:43:37 user nova-compute[73449]: DEBUG nova.compute.manager [req-1f6928b9-a439-4be4-8614-5a322860eeef req-2bcdfbbe-f6b7-41bc-9064-5e85dc95e3c3 service nova] [instance: 5e5229d5-65a2-4d60-8e50-c30357372a80] Received event network-changed-01a7a900-b5c9-46c8-b5b6-1aed4bef301e {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:43:37 user nova-compute[73449]: DEBUG nova.compute.manager [req-1f6928b9-a439-4be4-8614-5a322860eeef req-2bcdfbbe-f6b7-41bc-9064-5e85dc95e3c3 service nova] [instance: 5e5229d5-65a2-4d60-8e50-c30357372a80] Refreshing instance network info cache due to event network-changed-01a7a900-b5c9-46c8-b5b6-1aed4bef301e. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 11:43:37 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-1f6928b9-a439-4be4-8614-5a322860eeef req-2bcdfbbe-f6b7-41bc-9064-5e85dc95e3c3 service nova] Acquiring lock "refresh_cache-5e5229d5-65a2-4d60-8e50-c30357372a80" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:43:37 user nova-compute[73449]: DEBUG nova.network.neutron [None req-b68479b2-7ea3-41e2-9ae0-2b4a7303966c tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] [instance: 5e5229d5-65a2-4d60-8e50-c30357372a80] Updating instance_info_cache with network_info: [{"id": "01a7a900-b5c9-46c8-b5b6-1aed4bef301e", "address": "fa:16:3e:c4:2b:67", "network": {"id": "ef0c44c4-ef68-433d-bfbc-71272ed64948", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-24887935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2513ad48149f45e2a2bd4b404ebc13b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01a7a900-b5", "ovs_interfaceid": "01a7a900-b5c9-46c8-b5b6-1aed4bef301e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:43:37 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b68479b2-7ea3-41e2-9ae0-2b4a7303966c tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Releasing lock "refresh_cache-5e5229d5-65a2-4d60-8e50-c30357372a80" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:43:37 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b68479b2-7ea3-41e2-9ae0-2b4a7303966c tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] [instance: 5e5229d5-65a2-4d60-8e50-c30357372a80] Instance network_info: |[{"id": "01a7a900-b5c9-46c8-b5b6-1aed4bef301e", "address": "fa:16:3e:c4:2b:67", "network": {"id": "ef0c44c4-ef68-433d-bfbc-71272ed64948", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-24887935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2513ad48149f45e2a2bd4b404ebc13b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01a7a900-b5", "ovs_interfaceid": "01a7a900-b5c9-46c8-b5b6-1aed4bef301e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73449) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 11:43:37 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-1f6928b9-a439-4be4-8614-5a322860eeef req-2bcdfbbe-f6b7-41bc-9064-5e85dc95e3c3 service nova] Acquired lock "refresh_cache-5e5229d5-65a2-4d60-8e50-c30357372a80" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:43:37 user nova-compute[73449]: DEBUG nova.network.neutron [req-1f6928b9-a439-4be4-8614-5a322860eeef req-2bcdfbbe-f6b7-41bc-9064-5e85dc95e3c3 service nova] [instance: 5e5229d5-65a2-4d60-8e50-c30357372a80] Refreshing network info cache for port 01a7a900-b5c9-46c8-b5b6-1aed4bef301e {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 11:43:37 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b68479b2-7ea3-41e2-9ae0-2b4a7303966c tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] [instance: 5e5229d5-65a2-4d60-8e50-c30357372a80] Start _get_guest_xml network_info=[{"id": "01a7a900-b5c9-46c8-b5b6-1aed4bef301e", "address": "fa:16:3e:c4:2b:67", "network": {"id": "ef0c44c4-ef68-433d-bfbc-71272ed64948", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-24887935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2513ad48149f45e2a2bd4b404ebc13b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01a7a900-b5", "ovs_interfaceid": "01a7a900-b5c9-46c8-b5b6-1aed4bef301e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T11:36:11Z,direct_url=<?>,disk_format='qcow2',id=0a2904ae-083d-41c8-83db-343132b36148,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7a77880136a54ef195c82e018e1939db',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T11:36:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': '0a2904ae-083d-41c8-83db-343132b36148'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 11:43:37 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-b68479b2-7ea3-41e2-9ae0-2b4a7303966c tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:43:37 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-b68479b2-7ea3-41e2-9ae0-2b4a7303966c tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:43:37 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-b68479b2-7ea3-41e2-9ae0-2b4a7303966c tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 11:43:37 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-b68479b2-7ea3-41e2-9ae0-2b4a7303966c tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] CPU controller missing on host. {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 11:43:37 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-b68479b2-7ea3-41e2-9ae0-2b4a7303966c tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 11:43:37 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-b68479b2-7ea3-41e2-9ae0-2b4a7303966c tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] CPU controller found on host. {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 11:43:37 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b68479b2-7ea3-41e2-9ae0-2b4a7303966c tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73449) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 11:43:37 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-b68479b2-7ea3-41e2-9ae0-2b4a7303966c tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T11:35:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T11:36:11Z,direct_url=<?>,disk_format='qcow2',id=0a2904ae-083d-41c8-83db-343132b36148,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7a77880136a54ef195c82e018e1939db',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T11:36:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 11:43:37 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-b68479b2-7ea3-41e2-9ae0-2b4a7303966c tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Flavor limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 11:43:37 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-b68479b2-7ea3-41e2-9ae0-2b4a7303966c tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Image limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 11:43:37 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-b68479b2-7ea3-41e2-9ae0-2b4a7303966c tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Flavor pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 11:43:37 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-b68479b2-7ea3-41e2-9ae0-2b4a7303966c tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Image pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 11:43:37 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-b68479b2-7ea3-41e2-9ae0-2b4a7303966c tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 11:43:37 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-b68479b2-7ea3-41e2-9ae0-2b4a7303966c tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 11:43:37 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-b68479b2-7ea3-41e2-9ae0-2b4a7303966c tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 11:43:37 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-b68479b2-7ea3-41e2-9ae0-2b4a7303966c tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Got 1 possible topologies {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 11:43:37 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-b68479b2-7ea3-41e2-9ae0-2b4a7303966c tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 11:43:37 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-b68479b2-7ea3-41e2-9ae0-2b4a7303966c tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 11:43:37 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-b68479b2-7ea3-41e2-9ae0-2b4a7303966c tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:43:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-835157661',display_name='tempest-VolumesAdminNegativeTest-server-835157661',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-835157661',id=11,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2513ad48149f45e2a2bd4b404ebc13b6',ramdisk_id='',reservation_id='r-c0xvumfn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1247532735',owner_user_name='tempest-VolumesAdminNegativeTest-1247532735-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T11:43:34Z,user_data=None,user_id='4cfe2e3e87454eb38768c2ed81450b1d',uuid=5e5229d5-65a2-4d60-8e50-c30357372a80,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "01a7a900-b5c9-46c8-b5b6-1aed4bef301e", "address": "fa:16:3e:c4:2b:67", "network": {"id": "ef0c44c4-ef68-433d-bfbc-71272ed64948", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-24887935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2513ad48149f45e2a2bd4b404ebc13b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01a7a900-b5", "ovs_interfaceid": "01a7a900-b5c9-46c8-b5b6-1aed4bef301e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73449) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 11:43:37 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-b68479b2-7ea3-41e2-9ae0-2b4a7303966c tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Converting VIF {"id": "01a7a900-b5c9-46c8-b5b6-1aed4bef301e", "address": "fa:16:3e:c4:2b:67", "network": {"id": "ef0c44c4-ef68-433d-bfbc-71272ed64948", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-24887935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2513ad48149f45e2a2bd4b404ebc13b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01a7a900-b5", "ovs_interfaceid": "01a7a900-b5c9-46c8-b5b6-1aed4bef301e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:43:37 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-b68479b2-7ea3-41e2-9ae0-2b4a7303966c tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:2b:67,bridge_name='br-int',has_traffic_filtering=True,id=01a7a900-b5c9-46c8-b5b6-1aed4bef301e,network=Network(ef0c44c4-ef68-433d-bfbc-71272ed64948),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01a7a900-b5') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:43:37 user nova-compute[73449]: DEBUG nova.objects.instance [None req-b68479b2-7ea3-41e2-9ae0-2b4a7303966c tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Lazy-loading 'pci_devices' on Instance uuid 5e5229d5-65a2-4d60-8e50-c30357372a80 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:43:37 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b68479b2-7ea3-41e2-9ae0-2b4a7303966c tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] [instance: 5e5229d5-65a2-4d60-8e50-c30357372a80] End _get_guest_xml xml=<domain type="kvm">
Aug 17 11:43:37 user nova-compute[73449]:   <uuid>5e5229d5-65a2-4d60-8e50-c30357372a80</uuid>
Aug 17 11:43:37 user nova-compute[73449]:   <name>instance-0000000b</name>
Aug 17 11:43:37 user nova-compute[73449]:   <memory>524288</memory>
Aug 17 11:43:37 user nova-compute[73449]:   <vcpu>1</vcpu>
Aug 17 11:43:37 user nova-compute[73449]:   <metadata>
Aug 17 11:43:37 user nova-compute[73449]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 11:43:37 user nova-compute[73449]:       <nova:package version="0.0.0"/>
Aug 17 11:43:37 user nova-compute[73449]:       <nova:name>tempest-VolumesAdminNegativeTest-server-835157661</nova:name>
Aug 17 11:43:37 user nova-compute[73449]:       <nova:creationTime>2023-08-17 11:43:37</nova:creationTime>
Aug 17 11:43:37 user nova-compute[73449]:       <nova:flavor name="m1.tiny">
Aug 17 11:43:37 user nova-compute[73449]:         <nova:memory>512</nova:memory>
Aug 17 11:43:37 user nova-compute[73449]:         <nova:disk>1</nova:disk>
Aug 17 11:43:37 user nova-compute[73449]:         <nova:swap>0</nova:swap>
Aug 17 11:43:37 user nova-compute[73449]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 11:43:37 user nova-compute[73449]:         <nova:vcpus>1</nova:vcpus>
Aug 17 11:43:37 user nova-compute[73449]:       </nova:flavor>
Aug 17 11:43:37 user nova-compute[73449]:       <nova:owner>
Aug 17 11:43:37 user nova-compute[73449]:         <nova:user uuid="4cfe2e3e87454eb38768c2ed81450b1d">tempest-VolumesAdminNegativeTest-1247532735-project-member</nova:user>
Aug 17 11:43:37 user nova-compute[73449]:         <nova:project uuid="2513ad48149f45e2a2bd4b404ebc13b6">tempest-VolumesAdminNegativeTest-1247532735</nova:project>
Aug 17 11:43:37 user nova-compute[73449]:       </nova:owner>
Aug 17 11:43:37 user nova-compute[73449]:       <nova:root type="image" uuid="0a2904ae-083d-41c8-83db-343132b36148"/>
Aug 17 11:43:37 user nova-compute[73449]:       <nova:ports>
Aug 17 11:43:37 user nova-compute[73449]:         <nova:port uuid="01a7a900-b5c9-46c8-b5b6-1aed4bef301e">
Aug 17 11:43:37 user nova-compute[73449]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 17 11:43:37 user nova-compute[73449]:         </nova:port>
Aug 17 11:43:37 user nova-compute[73449]:       </nova:ports>
Aug 17 11:43:37 user nova-compute[73449]:     </nova:instance>
Aug 17 11:43:37 user nova-compute[73449]:   </metadata>
Aug 17 11:43:37 user nova-compute[73449]:   <sysinfo type="smbios">
Aug 17 11:43:37 user nova-compute[73449]:     <system>
Aug 17 11:43:37 user nova-compute[73449]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 11:43:37 user nova-compute[73449]:       <entry name="product">OpenStack Nova</entry>
Aug 17 11:43:37 user nova-compute[73449]:       <entry name="version">0.0.0</entry>
Aug 17 11:43:37 user nova-compute[73449]:       <entry name="serial">5e5229d5-65a2-4d60-8e50-c30357372a80</entry>
Aug 17 11:43:37 user nova-compute[73449]:       <entry name="uuid">5e5229d5-65a2-4d60-8e50-c30357372a80</entry>
Aug 17 11:43:37 user nova-compute[73449]:       <entry name="family">Virtual Machine</entry>
Aug 17 11:43:37 user nova-compute[73449]:     </system>
Aug 17 11:43:37 user nova-compute[73449]:   </sysinfo>
Aug 17 11:43:37 user nova-compute[73449]:   <os>
Aug 17 11:43:37 user nova-compute[73449]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 11:43:37 user nova-compute[73449]:     <boot dev="hd"/>
Aug 17 11:43:37 user nova-compute[73449]:     <smbios mode="sysinfo"/>
Aug 17 11:43:37 user nova-compute[73449]:   </os>
Aug 17 11:43:37 user nova-compute[73449]:   <features>
Aug 17 11:43:37 user nova-compute[73449]:     <acpi/>
Aug 17 11:43:37 user nova-compute[73449]:     <apic/>
Aug 17 11:43:37 user nova-compute[73449]:     <vmcoreinfo/>
Aug 17 11:43:37 user nova-compute[73449]:   </features>
Aug 17 11:43:37 user nova-compute[73449]:   <clock offset="utc">
Aug 17 11:43:37 user nova-compute[73449]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 11:43:37 user nova-compute[73449]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 11:43:37 user nova-compute[73449]:     <timer name="hpet" present="no"/>
Aug 17 11:43:37 user nova-compute[73449]:   </clock>
Aug 17 11:43:37 user nova-compute[73449]:   <cpu mode="custom" match="exact">
Aug 17 11:43:37 user nova-compute[73449]:     <model>Nehalem</model>
Aug 17 11:43:37 user nova-compute[73449]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 11:43:37 user nova-compute[73449]:   </cpu>
Aug 17 11:43:37 user nova-compute[73449]:   <devices>
Aug 17 11:43:37 user nova-compute[73449]:     <disk type="file" device="disk">
Aug 17 11:43:37 user nova-compute[73449]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 11:43:37 user nova-compute[73449]:       <source file="/opt/stack/data/nova/instances/5e5229d5-65a2-4d60-8e50-c30357372a80/disk"/>
Aug 17 11:43:37 user nova-compute[73449]:       <target dev="vda" bus="virtio"/>
Aug 17 11:43:37 user nova-compute[73449]:     </disk>
Aug 17 11:43:37 user nova-compute[73449]:     <interface type="ethernet">
Aug 17 11:43:37 user nova-compute[73449]:       <mac address="fa:16:3e:c4:2b:67"/>
Aug 17 11:43:37 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 11:43:37 user nova-compute[73449]:       <mtu size="1442"/>
Aug 17 11:43:37 user nova-compute[73449]:       <target dev="tap01a7a900-b5"/>
Aug 17 11:43:37 user nova-compute[73449]:     </interface>
Aug 17 11:43:37 user nova-compute[73449]:     <serial type="pty">
Aug 17 11:43:37 user nova-compute[73449]:       <log file="/opt/stack/data/nova/instances/5e5229d5-65a2-4d60-8e50-c30357372a80/console.log" append="off"/>
Aug 17 11:43:37 user nova-compute[73449]:     </serial>
Aug 17 11:43:37 user nova-compute[73449]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 11:43:37 user nova-compute[73449]:     <video>
Aug 17 11:43:37 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 11:43:37 user nova-compute[73449]:     </video>
Aug 17 11:43:37 user nova-compute[73449]:     <rng model="virtio">
Aug 17 11:43:37 user nova-compute[73449]:       <backend model="random">/dev/urandom</backend>
Aug 17 11:43:37 user nova-compute[73449]:     </rng>
Aug 17 11:43:37 user nova-compute[73449]:     <controller type="usb" index="0" model="none"/>
Aug 17 11:43:37 user nova-compute[73449]:     <memballoon model="virtio">
Aug 17 11:43:37 user nova-compute[73449]:       <stats period="10"/>
Aug 17 11:43:37 user nova-compute[73449]:     </memballoon>
Aug 17 11:43:37 user nova-compute[73449]:   </devices>
Aug 17 11:43:37 user nova-compute[73449]: </domain>
Aug 17 11:43:37 user nova-compute[73449]:  {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 11:43:37 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-b68479b2-7ea3-41e2-9ae0-2b4a7303966c tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:43:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-835157661',display_name='tempest-VolumesAdminNegativeTest-server-835157661',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-835157661',id=11,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2513ad48149f45e2a2bd4b404ebc13b6',ramdisk_id='',reservation_id='r-c0xvumfn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1247532735',owner_user_name='tempest-VolumesAdminNegativeTest-1247532735-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T11:43:34Z,user_data=None,user_id='4cfe2e3e87454eb38768c2ed81450b1d',uuid=5e5229d5-65a2-4d60-8e50-c30357372a80,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "01a7a900-b5c9-46c8-b5b6-1aed4bef301e", "address": "fa:16:3e:c4:2b:67", "network": {"id": "ef0c44c4-ef68-433d-bfbc-71272ed64948", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-24887935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2513ad48149f45e2a2bd4b404ebc13b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01a7a900-b5", "ovs_interfaceid": "01a7a900-b5c9-46c8-b5b6-1aed4bef301e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 11:43:37 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-b68479b2-7ea3-41e2-9ae0-2b4a7303966c tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Converting VIF {"id": "01a7a900-b5c9-46c8-b5b6-1aed4bef301e", "address": "fa:16:3e:c4:2b:67", "network": {"id": "ef0c44c4-ef68-433d-bfbc-71272ed64948", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-24887935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2513ad48149f45e2a2bd4b404ebc13b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01a7a900-b5", "ovs_interfaceid": "01a7a900-b5c9-46c8-b5b6-1aed4bef301e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:43:37 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-b68479b2-7ea3-41e2-9ae0-2b4a7303966c tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:2b:67,bridge_name='br-int',has_traffic_filtering=True,id=01a7a900-b5c9-46c8-b5b6-1aed4bef301e,network=Network(ef0c44c4-ef68-433d-bfbc-71272ed64948),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01a7a900-b5') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:43:37 user nova-compute[73449]: DEBUG os_vif [None req-b68479b2-7ea3-41e2-9ae0-2b4a7303966c tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:2b:67,bridge_name='br-int',has_traffic_filtering=True,id=01a7a900-b5c9-46c8-b5b6-1aed4bef301e,network=Network(ef0c44c4-ef68-433d-bfbc-71272ed64948),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01a7a900-b5') {{(pid=73449) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 11:43:37 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:43:37 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:43:37 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 11:43:37 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:43:37 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap01a7a900-b5, may_exist=True, interface_attrs={}) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:43:37 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap01a7a900-b5, col_values=(('external_ids', {'iface-id': '01a7a900-b5c9-46c8-b5b6-1aed4bef301e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c4:2b:67', 'vm-uuid': '5e5229d5-65a2-4d60-8e50-c30357372a80'}),), if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:43:37 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:43:37 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:43:37 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:43:37 user nova-compute[73449]: INFO os_vif [None req-b68479b2-7ea3-41e2-9ae0-2b4a7303966c tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:2b:67,bridge_name='br-int',has_traffic_filtering=True,id=01a7a900-b5c9-46c8-b5b6-1aed4bef301e,network=Network(ef0c44c4-ef68-433d-bfbc-71272ed64948),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01a7a900-b5')
Aug 17 11:43:37 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b68479b2-7ea3-41e2-9ae0-2b4a7303966c tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] No BDM found with device name vda, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 11:43:37 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b68479b2-7ea3-41e2-9ae0-2b4a7303966c tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] No VIF found with MAC fa:16:3e:c4:2b:67, not building metadata {{(pid=73449) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 11:43:38 user nova-compute[73449]: DEBUG nova.network.neutron [req-1f6928b9-a439-4be4-8614-5a322860eeef req-2bcdfbbe-f6b7-41bc-9064-5e85dc95e3c3 service nova] [instance: 5e5229d5-65a2-4d60-8e50-c30357372a80] Updated VIF entry in instance network info cache for port 01a7a900-b5c9-46c8-b5b6-1aed4bef301e. {{(pid=73449) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 11:43:38 user nova-compute[73449]: DEBUG nova.network.neutron [req-1f6928b9-a439-4be4-8614-5a322860eeef req-2bcdfbbe-f6b7-41bc-9064-5e85dc95e3c3 service nova] [instance: 5e5229d5-65a2-4d60-8e50-c30357372a80] Updating instance_info_cache with network_info: [{"id": "01a7a900-b5c9-46c8-b5b6-1aed4bef301e", "address": "fa:16:3e:c4:2b:67", "network": {"id": "ef0c44c4-ef68-433d-bfbc-71272ed64948", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-24887935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2513ad48149f45e2a2bd4b404ebc13b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01a7a900-b5", "ovs_interfaceid": "01a7a900-b5c9-46c8-b5b6-1aed4bef301e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:43:38 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-1f6928b9-a439-4be4-8614-5a322860eeef req-2bcdfbbe-f6b7-41bc-9064-5e85dc95e3c3 service nova] Releasing lock "refresh_cache-5e5229d5-65a2-4d60-8e50-c30357372a80" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:43:38 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-ce65bfa3-f18b-40e3-beda-648f1d47caee tempest-VolumesAssistedSnapshotsTest-410166037 tempest-VolumesAssistedSnapshotsTest-410166037-project-member] Acquiring lock "fd8d4549-db8f-4c74-8706-8ac21f049c2e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:43:38 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-ce65bfa3-f18b-40e3-beda-648f1d47caee tempest-VolumesAssistedSnapshotsTest-410166037 tempest-VolumesAssistedSnapshotsTest-410166037-project-member] Lock "fd8d4549-db8f-4c74-8706-8ac21f049c2e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:43:38 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-ce65bfa3-f18b-40e3-beda-648f1d47caee tempest-VolumesAssistedSnapshotsTest-410166037 tempest-VolumesAssistedSnapshotsTest-410166037-project-member] Acquiring lock "fd8d4549-db8f-4c74-8706-8ac21f049c2e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:43:38 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-ce65bfa3-f18b-40e3-beda-648f1d47caee tempest-VolumesAssistedSnapshotsTest-410166037 tempest-VolumesAssistedSnapshotsTest-410166037-project-member] Lock "fd8d4549-db8f-4c74-8706-8ac21f049c2e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:43:38 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-ce65bfa3-f18b-40e3-beda-648f1d47caee tempest-VolumesAssistedSnapshotsTest-410166037 tempest-VolumesAssistedSnapshotsTest-410166037-project-member] Lock "fd8d4549-db8f-4c74-8706-8ac21f049c2e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:43:38 user nova-compute[73449]: INFO nova.compute.manager [None req-ce65bfa3-f18b-40e3-beda-648f1d47caee tempest-VolumesAssistedSnapshotsTest-410166037 tempest-VolumesAssistedSnapshotsTest-410166037-project-member] [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e] Terminating instance
Aug 17 11:43:38 user nova-compute[73449]: DEBUG nova.compute.manager [None req-ce65bfa3-f18b-40e3-beda-648f1d47caee tempest-VolumesAssistedSnapshotsTest-410166037 tempest-VolumesAssistedSnapshotsTest-410166037-project-member] [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e] Start destroying the instance on the hypervisor. {{(pid=73449) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 11:43:38 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:43:39 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:43:39 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:43:39 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:43:39 user nova-compute[73449]: DEBUG nova.compute.manager [req-ec8fc25b-3119-41c8-9fa9-2a2ea597659a req-2ebf6ee4-fa24-444d-acd7-685babecc63f service nova] [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e] Received event network-vif-unplugged-98c22823-114c-45bf-bc36-876f2f587b55 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:43:39 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-ec8fc25b-3119-41c8-9fa9-2a2ea597659a req-2ebf6ee4-fa24-444d-acd7-685babecc63f service nova] Acquiring lock "fd8d4549-db8f-4c74-8706-8ac21f049c2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:43:39 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-ec8fc25b-3119-41c8-9fa9-2a2ea597659a req-2ebf6ee4-fa24-444d-acd7-685babecc63f service nova] Lock "fd8d4549-db8f-4c74-8706-8ac21f049c2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:43:39 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-ec8fc25b-3119-41c8-9fa9-2a2ea597659a req-2ebf6ee4-fa24-444d-acd7-685babecc63f service nova] Lock "fd8d4549-db8f-4c74-8706-8ac21f049c2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:43:39 user nova-compute[73449]: DEBUG nova.compute.manager [req-ec8fc25b-3119-41c8-9fa9-2a2ea597659a req-2ebf6ee4-fa24-444d-acd7-685babecc63f service nova] [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e] No waiting events found dispatching network-vif-unplugged-98c22823-114c-45bf-bc36-876f2f587b55 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:43:39 user nova-compute[73449]: DEBUG nova.compute.manager [req-ec8fc25b-3119-41c8-9fa9-2a2ea597659a req-2ebf6ee4-fa24-444d-acd7-685babecc63f service nova] [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e] Received event network-vif-unplugged-98c22823-114c-45bf-bc36-876f2f587b55 for instance with task_state deleting. {{(pid=73449) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 11:43:39 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:43:39 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:43:39 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:43:39 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:43:40 user nova-compute[73449]: DEBUG nova.compute.manager [req-55b02f2b-7a74-40e6-845c-0ed62043eda5 req-4d6b24c6-34f2-4118-9895-5e610ac4ede2 service nova] [instance: 5e5229d5-65a2-4d60-8e50-c30357372a80] Received event network-vif-plugged-01a7a900-b5c9-46c8-b5b6-1aed4bef301e {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:43:40 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-55b02f2b-7a74-40e6-845c-0ed62043eda5 req-4d6b24c6-34f2-4118-9895-5e610ac4ede2 service nova] Acquiring lock "5e5229d5-65a2-4d60-8e50-c30357372a80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:43:40 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-55b02f2b-7a74-40e6-845c-0ed62043eda5 req-4d6b24c6-34f2-4118-9895-5e610ac4ede2 service nova] Lock "5e5229d5-65a2-4d60-8e50-c30357372a80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:43:40 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-55b02f2b-7a74-40e6-845c-0ed62043eda5 req-4d6b24c6-34f2-4118-9895-5e610ac4ede2 service nova] Lock "5e5229d5-65a2-4d60-8e50-c30357372a80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:43:40 user nova-compute[73449]: DEBUG nova.compute.manager [req-55b02f2b-7a74-40e6-845c-0ed62043eda5 req-4d6b24c6-34f2-4118-9895-5e610ac4ede2 service nova] [instance: 5e5229d5-65a2-4d60-8e50-c30357372a80] No waiting events found dispatching network-vif-plugged-01a7a900-b5c9-46c8-b5b6-1aed4bef301e {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:43:40 user nova-compute[73449]: WARNING nova.compute.manager [req-55b02f2b-7a74-40e6-845c-0ed62043eda5 req-4d6b24c6-34f2-4118-9895-5e610ac4ede2 service nova] [instance: 5e5229d5-65a2-4d60-8e50-c30357372a80] Received unexpected event network-vif-plugged-01a7a900-b5c9-46c8-b5b6-1aed4bef301e for instance with vm_state building and task_state spawning.
Aug 17 11:43:40 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:43:40 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e] Instance destroyed successfully.
Aug 17 11:43:40 user nova-compute[73449]: DEBUG nova.objects.instance [None req-ce65bfa3-f18b-40e3-beda-648f1d47caee tempest-VolumesAssistedSnapshotsTest-410166037 tempest-VolumesAssistedSnapshotsTest-410166037-project-member] Lazy-loading 'resources' on Instance uuid fd8d4549-db8f-4c74-8706-8ac21f049c2e {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:43:40 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-ce65bfa3-f18b-40e3-beda-648f1d47caee tempest-VolumesAssistedSnapshotsTest-410166037 tempest-VolumesAssistedSnapshotsTest-410166037-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:40:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-863819384',display_name='tempest-VolumesAssistedSnapshotsTest-server-863819384',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-863819384',id=4,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP5cerBSEOFy0ZJynSsV8ct5TCMQkklg0oVUN8308KhbzIg0UcMuaQMZMlbsr6SbBFx8w1ukdm1/QyZ1DHs538Lga/AcZXpj3HtVOMivfnstX+kM3AmcupDu1j/Gp4lAyQ==',key_name='tempest-keypair-2100999617',keypairs=<?>,launch_index=0,launched_at=2023-08-17T11:40:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='93aebc1246f34b81a883a70dd6e6e7f3',ramdisk_id='',reservation_id='r-xzkdl4hr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-410166037',owner_user_name='tempest-VolumesAssistedSnapshotsTest-410166037-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T11:40:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='72d21423ba884ca4845bc2782f7e2e06',uuid=fd8d4549-db8f-4c74-8706-8ac21f049c2e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "98c22823-114c-45bf-bc36-876f2f587b55", "address": "fa:16:3e:e2:ef:b0", "network": {"id": "c4a2b8cb-821d-4dd9-a737-ee2e5b474491", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1403649220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93aebc1246f34b81a883a70dd6e6e7f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98c22823-11", "ovs_interfaceid": "98c22823-114c-45bf-bc36-876f2f587b55", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 11:43:40 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-ce65bfa3-f18b-40e3-beda-648f1d47caee tempest-VolumesAssistedSnapshotsTest-410166037 tempest-VolumesAssistedSnapshotsTest-410166037-project-member] Converting VIF {"id": "98c22823-114c-45bf-bc36-876f2f587b55", "address": "fa:16:3e:e2:ef:b0", "network": {"id": "c4a2b8cb-821d-4dd9-a737-ee2e5b474491", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1403649220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93aebc1246f34b81a883a70dd6e6e7f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98c22823-11", "ovs_interfaceid": "98c22823-114c-45bf-bc36-876f2f587b55", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:43:40 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-ce65bfa3-f18b-40e3-beda-648f1d47caee tempest-VolumesAssistedSnapshotsTest-410166037 tempest-VolumesAssistedSnapshotsTest-410166037-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e2:ef:b0,bridge_name='br-int',has_traffic_filtering=True,id=98c22823-114c-45bf-bc36-876f2f587b55,network=Network(c4a2b8cb-821d-4dd9-a737-ee2e5b474491),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98c22823-11') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:43:40 user nova-compute[73449]: DEBUG os_vif [None req-ce65bfa3-f18b-40e3-beda-648f1d47caee tempest-VolumesAssistedSnapshotsTest-410166037 tempest-VolumesAssistedSnapshotsTest-410166037-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e2:ef:b0,bridge_name='br-int',has_traffic_filtering=True,id=98c22823-114c-45bf-bc36-876f2f587b55,network=Network(c4a2b8cb-821d-4dd9-a737-ee2e5b474491),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98c22823-11') {{(pid=73449) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 11:43:40 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:43:40 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap98c22823-11, bridge=br-int, if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:43:40 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:43:40 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:43:40 user nova-compute[73449]: INFO os_vif [None req-ce65bfa3-f18b-40e3-beda-648f1d47caee tempest-VolumesAssistedSnapshotsTest-410166037 tempest-VolumesAssistedSnapshotsTest-410166037-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e2:ef:b0,bridge_name='br-int',has_traffic_filtering=True,id=98c22823-114c-45bf-bc36-876f2f587b55,network=Network(c4a2b8cb-821d-4dd9-a737-ee2e5b474491),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98c22823-11')
Aug 17 11:43:40 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-ce65bfa3-f18b-40e3-beda-648f1d47caee tempest-VolumesAssistedSnapshotsTest-410166037 tempest-VolumesAssistedSnapshotsTest-410166037-project-member] [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e] Deleting instance files /opt/stack/data/nova/instances/fd8d4549-db8f-4c74-8706-8ac21f049c2e_del
Aug 17 11:43:40 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-ce65bfa3-f18b-40e3-beda-648f1d47caee tempest-VolumesAssistedSnapshotsTest-410166037 tempest-VolumesAssistedSnapshotsTest-410166037-project-member] [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e] Deletion of /opt/stack/data/nova/instances/fd8d4549-db8f-4c74-8706-8ac21f049c2e_del complete
Aug 17 11:43:40 user nova-compute[73449]: INFO nova.compute.manager [None req-ce65bfa3-f18b-40e3-beda-648f1d47caee tempest-VolumesAssistedSnapshotsTest-410166037 tempest-VolumesAssistedSnapshotsTest-410166037-project-member] [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e] Took 1.30 seconds to destroy the instance on the hypervisor.
Aug 17 11:43:40 user nova-compute[73449]: DEBUG oslo.service.loopingcall [None req-ce65bfa3-f18b-40e3-beda-648f1d47caee tempest-VolumesAssistedSnapshotsTest-410166037 tempest-VolumesAssistedSnapshotsTest-410166037-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73449) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 11:43:40 user nova-compute[73449]: DEBUG nova.compute.manager [-] [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e] Deallocating network for instance {{(pid=73449) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 11:43:40 user nova-compute[73449]: DEBUG nova.network.neutron [-] [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e] deallocate_for_instance() {{(pid=73449) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 11:43:41 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-5864a98c-ef4d-4acf-b70f-3e76f96ffcb2 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Acquiring lock "7d3e07fa-4823-48e9-a959-e7bac0e0b25b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:43:41 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-5864a98c-ef4d-4acf-b70f-3e76f96ffcb2 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Lock "7d3e07fa-4823-48e9-a959-e7bac0e0b25b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:43:41 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-5864a98c-ef4d-4acf-b70f-3e76f96ffcb2 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Acquiring lock "7d3e07fa-4823-48e9-a959-e7bac0e0b25b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:43:41 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-5864a98c-ef4d-4acf-b70f-3e76f96ffcb2 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Lock "7d3e07fa-4823-48e9-a959-e7bac0e0b25b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:43:41 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-5864a98c-ef4d-4acf-b70f-3e76f96ffcb2 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Lock "7d3e07fa-4823-48e9-a959-e7bac0e0b25b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:43:41 user nova-compute[73449]: INFO nova.compute.manager [None req-5864a98c-ef4d-4acf-b70f-3e76f96ffcb2 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] [instance: 7d3e07fa-4823-48e9-a959-e7bac0e0b25b] Terminating instance
Aug 17 11:43:41 user nova-compute[73449]: DEBUG nova.compute.manager [None req-5864a98c-ef4d-4acf-b70f-3e76f96ffcb2 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] [instance: 7d3e07fa-4823-48e9-a959-e7bac0e0b25b] Start destroying the instance on the hypervisor. {{(pid=73449) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 11:43:41 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:43:41 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:43:41 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:43:41 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:43:41 user nova-compute[73449]: DEBUG nova.network.neutron [-] [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e] Updating instance_info_cache with network_info: [] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:43:41 user nova-compute[73449]: INFO nova.compute.manager [-] [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e] Took 1.30 seconds to deallocate network for instance.
Aug 17 11:43:41 user nova-compute[73449]: DEBUG nova.compute.manager [req-ee338e2c-57dd-441f-975b-bcd1f2079180 req-8a08d95c-9ae0-4482-8714-f762be7cc87d service nova] [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e] Received event network-vif-deleted-98c22823-114c-45bf-bc36-876f2f587b55 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:43:41 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-ce65bfa3-f18b-40e3-beda-648f1d47caee tempest-VolumesAssistedSnapshotsTest-410166037 tempest-VolumesAssistedSnapshotsTest-410166037-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:43:41 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-ce65bfa3-f18b-40e3-beda-648f1d47caee tempest-VolumesAssistedSnapshotsTest-410166037 tempest-VolumesAssistedSnapshotsTest-410166037-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:43:41 user nova-compute[73449]: DEBUG nova.compute.manager [req-d5892a4a-554e-4959-8d62-0209b63efffe req-a302c4fc-8bbe-49fc-83bc-a0b013337c43 service nova] [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e] Received event network-vif-plugged-98c22823-114c-45bf-bc36-876f2f587b55 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:43:41 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-d5892a4a-554e-4959-8d62-0209b63efffe req-a302c4fc-8bbe-49fc-83bc-a0b013337c43 service nova] Acquiring lock "fd8d4549-db8f-4c74-8706-8ac21f049c2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:43:41 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-d5892a4a-554e-4959-8d62-0209b63efffe req-a302c4fc-8bbe-49fc-83bc-a0b013337c43 service nova] Lock "fd8d4549-db8f-4c74-8706-8ac21f049c2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:43:41 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-d5892a4a-554e-4959-8d62-0209b63efffe req-a302c4fc-8bbe-49fc-83bc-a0b013337c43 service nova] Lock "fd8d4549-db8f-4c74-8706-8ac21f049c2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:43:41 user nova-compute[73449]: DEBUG nova.compute.manager [req-d5892a4a-554e-4959-8d62-0209b63efffe req-a302c4fc-8bbe-49fc-83bc-a0b013337c43 service nova] [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e] No waiting events found dispatching network-vif-plugged-98c22823-114c-45bf-bc36-876f2f587b55 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:43:41 user nova-compute[73449]: WARNING nova.compute.manager [req-d5892a4a-554e-4959-8d62-0209b63efffe req-a302c4fc-8bbe-49fc-83bc-a0b013337c43 service nova] [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e] Received unexpected event network-vif-plugged-98c22823-114c-45bf-bc36-876f2f587b55 for instance with vm_state deleted and task_state None.
Aug 17 11:43:41 user nova-compute[73449]: DEBUG nova.compute.manager [req-d5892a4a-554e-4959-8d62-0209b63efffe req-a302c4fc-8bbe-49fc-83bc-a0b013337c43 service nova] [instance: 7d3e07fa-4823-48e9-a959-e7bac0e0b25b] Received event network-vif-unplugged-60dadb1a-7680-434e-975f-8ef1ec1b4088 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:43:41 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-d5892a4a-554e-4959-8d62-0209b63efffe req-a302c4fc-8bbe-49fc-83bc-a0b013337c43 service nova] Acquiring lock "7d3e07fa-4823-48e9-a959-e7bac0e0b25b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:43:41 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-d5892a4a-554e-4959-8d62-0209b63efffe req-a302c4fc-8bbe-49fc-83bc-a0b013337c43 service nova] Lock "7d3e07fa-4823-48e9-a959-e7bac0e0b25b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:43:41 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-d5892a4a-554e-4959-8d62-0209b63efffe req-a302c4fc-8bbe-49fc-83bc-a0b013337c43 service nova] Lock "7d3e07fa-4823-48e9-a959-e7bac0e0b25b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:43:41 user nova-compute[73449]: DEBUG nova.compute.manager [req-d5892a4a-554e-4959-8d62-0209b63efffe req-a302c4fc-8bbe-49fc-83bc-a0b013337c43 service nova] [instance: 7d3e07fa-4823-48e9-a959-e7bac0e0b25b] No waiting events found dispatching network-vif-unplugged-60dadb1a-7680-434e-975f-8ef1ec1b4088 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:43:41 user nova-compute[73449]: DEBUG nova.compute.manager [req-d5892a4a-554e-4959-8d62-0209b63efffe req-a302c4fc-8bbe-49fc-83bc-a0b013337c43 service nova] [instance: 7d3e07fa-4823-48e9-a959-e7bac0e0b25b] Received event network-vif-unplugged-60dadb1a-7680-434e-975f-8ef1ec1b4088 for instance with task_state deleting. {{(pid=73449) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 11:43:41 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-ce65bfa3-f18b-40e3-beda-648f1d47caee tempest-VolumesAssistedSnapshotsTest-410166037 tempest-VolumesAssistedSnapshotsTest-410166037-project-member] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 11:43:41 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-ce65bfa3-f18b-40e3-beda-648f1d47caee tempest-VolumesAssistedSnapshotsTest-410166037 tempest-VolumesAssistedSnapshotsTest-410166037-project-member] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 11:43:41 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-ce65bfa3-f18b-40e3-beda-648f1d47caee tempest-VolumesAssistedSnapshotsTest-410166037 tempest-VolumesAssistedSnapshotsTest-410166037-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.374s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:43:41 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: 7d3e07fa-4823-48e9-a959-e7bac0e0b25b] Instance destroyed successfully.
Aug 17 11:43:41 user nova-compute[73449]: DEBUG nova.objects.instance [None req-5864a98c-ef4d-4acf-b70f-3e76f96ffcb2 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Lazy-loading 'resources' on Instance uuid 7d3e07fa-4823-48e9-a959-e7bac0e0b25b {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:43:41 user nova-compute[73449]: INFO nova.scheduler.client.report [None req-ce65bfa3-f18b-40e3-beda-648f1d47caee tempest-VolumesAssistedSnapshotsTest-410166037 tempest-VolumesAssistedSnapshotsTest-410166037-project-member] Deleted allocations for instance fd8d4549-db8f-4c74-8706-8ac21f049c2e
Aug 17 11:43:41 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-5864a98c-ef4d-4acf-b70f-3e76f96ffcb2 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T11:40:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2017749474',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2017749474',id=6,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKDfVSRbJOSL96IIDH0v0XJrsx/+BlroyuWS03V0CQU7P0dyi56boP0N4YVepj2zGZdJ92Q/eiUfqBiWlxOzCQZKWvHOldZF0ArsphTeKIZc5KRdUwh+L9qgCVMp15KALw==',key_name='tempest-keypair-1953925692',keypairs=<?>,launch_index=0,launched_at=2023-08-17T11:40:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3c75ffb297b94222a4502db0e0814538',ramdisk_id='',reservation_id='r-35nrqkzd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1681245717',owner_user_name='tempest-TaggedAttachmentsTest-1681245717-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T11:40:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9df670f3f7da4815bdcb9915a4999380',uuid=7d3e07fa-4823-48e9-a959-e7bac0e0b25b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "60dadb1a-7680-434e-975f-8ef1ec1b4088", "address": "fa:16:3e:fd:e7:b1", "network": {"id": "2461f7a5-f076-40da-b7dc-c21b8cd64e55", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-146967442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c75ffb297b94222a4502db0e0814538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60dadb1a-76", "ovs_interfaceid": "60dadb1a-7680-434e-975f-8ef1ec1b4088", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 11:43:41 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-5864a98c-ef4d-4acf-b70f-3e76f96ffcb2 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Converting VIF {"id": "60dadb1a-7680-434e-975f-8ef1ec1b4088", "address": "fa:16:3e:fd:e7:b1", "network": {"id": "2461f7a5-f076-40da-b7dc-c21b8cd64e55", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-146967442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c75ffb297b94222a4502db0e0814538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60dadb1a-76", "ovs_interfaceid": "60dadb1a-7680-434e-975f-8ef1ec1b4088", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:43:41 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-5864a98c-ef4d-4acf-b70f-3e76f96ffcb2 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fd:e7:b1,bridge_name='br-int',has_traffic_filtering=True,id=60dadb1a-7680-434e-975f-8ef1ec1b4088,network=Network(2461f7a5-f076-40da-b7dc-c21b8cd64e55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60dadb1a-76') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:43:41 user nova-compute[73449]: DEBUG os_vif [None req-5864a98c-ef4d-4acf-b70f-3e76f96ffcb2 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fd:e7:b1,bridge_name='br-int',has_traffic_filtering=True,id=60dadb1a-7680-434e-975f-8ef1ec1b4088,network=Network(2461f7a5-f076-40da-b7dc-c21b8cd64e55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60dadb1a-76') {{(pid=73449) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 11:43:41 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:43:41 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap60dadb1a-76, bridge=br-int, if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:43:41 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:43:41 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:43:41 user nova-compute[73449]: INFO os_vif [None req-5864a98c-ef4d-4acf-b70f-3e76f96ffcb2 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fd:e7:b1,bridge_name='br-int',has_traffic_filtering=True,id=60dadb1a-7680-434e-975f-8ef1ec1b4088,network=Network(2461f7a5-f076-40da-b7dc-c21b8cd64e55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60dadb1a-76')
Aug 17 11:43:41 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-5864a98c-ef4d-4acf-b70f-3e76f96ffcb2 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] [instance: 7d3e07fa-4823-48e9-a959-e7bac0e0b25b] Deleting instance files /opt/stack/data/nova/instances/7d3e07fa-4823-48e9-a959-e7bac0e0b25b_del
Aug 17 11:43:41 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-5864a98c-ef4d-4acf-b70f-3e76f96ffcb2 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] [instance: 7d3e07fa-4823-48e9-a959-e7bac0e0b25b] Deletion of /opt/stack/data/nova/instances/7d3e07fa-4823-48e9-a959-e7bac0e0b25b_del complete
Aug 17 11:43:42 user nova-compute[73449]: DEBUG nova.compute.manager [req-73a6820b-4e7a-4fbd-abb4-75d61288233d req-b90d6f2c-69e4-4795-962d-6b1e3c743c2b service nova] [instance: 5e5229d5-65a2-4d60-8e50-c30357372a80] Received event network-vif-plugged-01a7a900-b5c9-46c8-b5b6-1aed4bef301e {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:43:42 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-73a6820b-4e7a-4fbd-abb4-75d61288233d req-b90d6f2c-69e4-4795-962d-6b1e3c743c2b service nova] Acquiring lock "5e5229d5-65a2-4d60-8e50-c30357372a80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:43:42 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-73a6820b-4e7a-4fbd-abb4-75d61288233d req-b90d6f2c-69e4-4795-962d-6b1e3c743c2b service nova] Lock "5e5229d5-65a2-4d60-8e50-c30357372a80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:43:42 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-73a6820b-4e7a-4fbd-abb4-75d61288233d req-b90d6f2c-69e4-4795-962d-6b1e3c743c2b service nova] Lock "5e5229d5-65a2-4d60-8e50-c30357372a80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:43:42 user nova-compute[73449]: DEBUG nova.compute.manager [req-73a6820b-4e7a-4fbd-abb4-75d61288233d req-b90d6f2c-69e4-4795-962d-6b1e3c743c2b service nova] [instance: 5e5229d5-65a2-4d60-8e50-c30357372a80] No waiting events found dispatching network-vif-plugged-01a7a900-b5c9-46c8-b5b6-1aed4bef301e {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:43:42 user nova-compute[73449]: WARNING nova.compute.manager [req-73a6820b-4e7a-4fbd-abb4-75d61288233d req-b90d6f2c-69e4-4795-962d-6b1e3c743c2b service nova] [instance: 5e5229d5-65a2-4d60-8e50-c30357372a80] Received unexpected event network-vif-plugged-01a7a900-b5c9-46c8-b5b6-1aed4bef301e for instance with vm_state building and task_state spawning.
Aug 17 11:43:42 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-ce65bfa3-f18b-40e3-beda-648f1d47caee tempest-VolumesAssistedSnapshotsTest-410166037 tempest-VolumesAssistedSnapshotsTest-410166037-project-member] Lock "fd8d4549-db8f-4c74-8706-8ac21f049c2e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.216s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:43:42 user nova-compute[73449]: INFO nova.compute.manager [None req-5864a98c-ef4d-4acf-b70f-3e76f96ffcb2 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] [instance: 7d3e07fa-4823-48e9-a959-e7bac0e0b25b] Took 0.94 seconds to destroy the instance on the hypervisor.
Aug 17 11:43:42 user nova-compute[73449]: DEBUG oslo.service.loopingcall [None req-5864a98c-ef4d-4acf-b70f-3e76f96ffcb2 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73449) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 11:43:42 user nova-compute[73449]: DEBUG nova.compute.manager [-] [instance: 7d3e07fa-4823-48e9-a959-e7bac0e0b25b] Deallocating network for instance {{(pid=73449) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 11:43:42 user nova-compute[73449]: DEBUG nova.network.neutron [-] [instance: 7d3e07fa-4823-48e9-a959-e7bac0e0b25b] deallocate_for_instance() {{(pid=73449) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 11:43:42 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692272622.1362484, 5e5229d5-65a2-4d60-8e50-c30357372a80 => Resumed> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:43:42 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 5e5229d5-65a2-4d60-8e50-c30357372a80] VM Resumed (Lifecycle Event)
Aug 17 11:43:42 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b68479b2-7ea3-41e2-9ae0-2b4a7303966c tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] [instance: 5e5229d5-65a2-4d60-8e50-c30357372a80] Instance event wait completed in 0 seconds for  {{(pid=73449) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 11:43:42 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b68479b2-7ea3-41e2-9ae0-2b4a7303966c tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] [instance: 5e5229d5-65a2-4d60-8e50-c30357372a80] Guest created on hypervisor {{(pid=73449) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 11:43:42 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: 5e5229d5-65a2-4d60-8e50-c30357372a80] Instance spawned successfully.
Aug 17 11:43:42 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b68479b2-7ea3-41e2-9ae0-2b4a7303966c tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] [instance: 5e5229d5-65a2-4d60-8e50-c30357372a80] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 11:43:42 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 5e5229d5-65a2-4d60-8e50-c30357372a80] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:43:42 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 5e5229d5-65a2-4d60-8e50-c30357372a80] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 11:43:42 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b68479b2-7ea3-41e2-9ae0-2b4a7303966c tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] [instance: 5e5229d5-65a2-4d60-8e50-c30357372a80] Found default for hw_cdrom_bus of ide {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:43:42 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b68479b2-7ea3-41e2-9ae0-2b4a7303966c tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] [instance: 5e5229d5-65a2-4d60-8e50-c30357372a80] Found default for hw_disk_bus of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:43:42 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b68479b2-7ea3-41e2-9ae0-2b4a7303966c tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] [instance: 5e5229d5-65a2-4d60-8e50-c30357372a80] Found default for hw_input_bus of None {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:43:42 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b68479b2-7ea3-41e2-9ae0-2b4a7303966c tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] [instance: 5e5229d5-65a2-4d60-8e50-c30357372a80] Found default for hw_pointer_model of None {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:43:42 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b68479b2-7ea3-41e2-9ae0-2b4a7303966c tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] [instance: 5e5229d5-65a2-4d60-8e50-c30357372a80] Found default for hw_video_model of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:43:42 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b68479b2-7ea3-41e2-9ae0-2b4a7303966c tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] [instance: 5e5229d5-65a2-4d60-8e50-c30357372a80] Found default for hw_vif_model of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:43:42 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 5e5229d5-65a2-4d60-8e50-c30357372a80] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 11:43:42 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692272622.140356, 5e5229d5-65a2-4d60-8e50-c30357372a80 => Started> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:43:42 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 5e5229d5-65a2-4d60-8e50-c30357372a80] VM Started (Lifecycle Event)
Aug 17 11:43:42 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 5e5229d5-65a2-4d60-8e50-c30357372a80] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:43:42 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 5e5229d5-65a2-4d60-8e50-c30357372a80] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 11:43:42 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 5e5229d5-65a2-4d60-8e50-c30357372a80] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 11:43:42 user nova-compute[73449]: INFO nova.compute.manager [None req-b68479b2-7ea3-41e2-9ae0-2b4a7303966c tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] [instance: 5e5229d5-65a2-4d60-8e50-c30357372a80] Took 7.77 seconds to spawn the instance on the hypervisor.
Aug 17 11:43:42 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b68479b2-7ea3-41e2-9ae0-2b4a7303966c tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] [instance: 5e5229d5-65a2-4d60-8e50-c30357372a80] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:43:42 user nova-compute[73449]: INFO nova.compute.manager [None req-b68479b2-7ea3-41e2-9ae0-2b4a7303966c tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] [instance: 5e5229d5-65a2-4d60-8e50-c30357372a80] Took 8.63 seconds to build instance.
Aug 17 11:43:42 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b68479b2-7ea3-41e2-9ae0-2b4a7303966c tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Lock "5e5229d5-65a2-4d60-8e50-c30357372a80" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.730s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:43:42 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:43:43 user nova-compute[73449]: DEBUG nova.network.neutron [-] [instance: 7d3e07fa-4823-48e9-a959-e7bac0e0b25b] Updating instance_info_cache with network_info: [] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:43:43 user nova-compute[73449]: INFO nova.compute.manager [-] [instance: 7d3e07fa-4823-48e9-a959-e7bac0e0b25b] Took 1.08 seconds to deallocate network for instance.
Aug 17 11:43:43 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-5864a98c-ef4d-4acf-b70f-3e76f96ffcb2 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:43:43 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-5864a98c-ef4d-4acf-b70f-3e76f96ffcb2 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:43:43 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-5864a98c-ef4d-4acf-b70f-3e76f96ffcb2 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 11:43:43 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-5864a98c-ef4d-4acf-b70f-3e76f96ffcb2 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 11:43:43 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-5864a98c-ef4d-4acf-b70f-3e76f96ffcb2 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.300s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:43:43 user nova-compute[73449]: DEBUG nova.compute.manager [req-131c06cf-6479-476d-b7dd-811f9861815e req-4de9053d-49ce-46b2-9829-78196ee4ded8 service nova] [instance: 7d3e07fa-4823-48e9-a959-e7bac0e0b25b] Received event network-vif-deleted-60dadb1a-7680-434e-975f-8ef1ec1b4088 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:43:43 user nova-compute[73449]: INFO nova.scheduler.client.report [None req-5864a98c-ef4d-4acf-b70f-3e76f96ffcb2 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Deleted allocations for instance 7d3e07fa-4823-48e9-a959-e7bac0e0b25b
Aug 17 11:43:43 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-5864a98c-ef4d-4acf-b70f-3e76f96ffcb2 tempest-TaggedAttachmentsTest-1681245717 tempest-TaggedAttachmentsTest-1681245717-project-member] Lock "7d3e07fa-4823-48e9-a959-e7bac0e0b25b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.543s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:43:43 user nova-compute[73449]: DEBUG nova.compute.manager [req-45bfd18c-c851-4bf8-a4f8-1b706d1d7f57 req-1320d36c-c96d-4ce2-a4d5-9913d0322a9e service nova] [instance: 7d3e07fa-4823-48e9-a959-e7bac0e0b25b] Received event network-vif-plugged-60dadb1a-7680-434e-975f-8ef1ec1b4088 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:43:43 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-45bfd18c-c851-4bf8-a4f8-1b706d1d7f57 req-1320d36c-c96d-4ce2-a4d5-9913d0322a9e service nova] Acquiring lock "7d3e07fa-4823-48e9-a959-e7bac0e0b25b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:43:43 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-45bfd18c-c851-4bf8-a4f8-1b706d1d7f57 req-1320d36c-c96d-4ce2-a4d5-9913d0322a9e service nova] Lock "7d3e07fa-4823-48e9-a959-e7bac0e0b25b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:43:43 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-45bfd18c-c851-4bf8-a4f8-1b706d1d7f57 req-1320d36c-c96d-4ce2-a4d5-9913d0322a9e service nova] Lock "7d3e07fa-4823-48e9-a959-e7bac0e0b25b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:43:43 user nova-compute[73449]: DEBUG nova.compute.manager [req-45bfd18c-c851-4bf8-a4f8-1b706d1d7f57 req-1320d36c-c96d-4ce2-a4d5-9913d0322a9e service nova] [instance: 7d3e07fa-4823-48e9-a959-e7bac0e0b25b] No waiting events found dispatching network-vif-plugged-60dadb1a-7680-434e-975f-8ef1ec1b4088 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:43:43 user nova-compute[73449]: WARNING nova.compute.manager [req-45bfd18c-c851-4bf8-a4f8-1b706d1d7f57 req-1320d36c-c96d-4ce2-a4d5-9913d0322a9e service nova] [instance: 7d3e07fa-4823-48e9-a959-e7bac0e0b25b] Received unexpected event network-vif-plugged-60dadb1a-7680-434e-975f-8ef1ec1b4088 for instance with vm_state deleted and task_state None.
Aug 17 11:43:43 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:43:44 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:43:45 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:43:45 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:43:46 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:43:46 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:43:47 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:43:47 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73449) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 11:43:47 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:43:47 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:43:47 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:43:47 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:43:47 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=73449) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 11:43:48 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a9e8ad2-19db-4975-87e4-2efce603a7d7/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:43:48 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a9e8ad2-19db-4975-87e4-2efce603a7d7/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:43:48 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a9e8ad2-19db-4975-87e4-2efce603a7d7/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:43:48 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a9e8ad2-19db-4975-87e4-2efce603a7d7/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:43:48 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73449) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 11:43:48 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73449) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 11:43:48 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=73449) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 11:43:48 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73449) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 11:43:48 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73449) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 11:43:48 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=73449) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 11:43:48 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3523d22-7165-46ad-be10-5e6ae374f91d/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:43:48 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3523d22-7165-46ad-be10-5e6ae374f91d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:43:48 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3523d22-7165-46ad-be10-5e6ae374f91d/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:43:49 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3523d22-7165-46ad-be10-5e6ae374f91d/disk --force-share --output=json" returned: 0 in 0.294s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:43:49 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:43:49 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a29ae82a-e76d-445a-ad5b-ed5aa0331f0f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Acquiring lock "f35b7f2b-2f88-4b09-86ac-cb5a78a94584" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:43:49 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a29ae82a-e76d-445a-ad5b-ed5aa0331f0f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Lock "f35b7f2b-2f88-4b09-86ac-cb5a78a94584" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:43:49 user nova-compute[73449]: DEBUG nova.compute.manager [None req-a29ae82a-e76d-445a-ad5b-ed5aa0331f0f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] Starting instance... {{(pid=73449) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 11:43:49 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:43:49 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:43:49 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a29ae82a-e76d-445a-ad5b-ed5aa0331f0f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:43:49 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a29ae82a-e76d-445a-ad5b-ed5aa0331f0f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:43:49 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:43:49 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-a29ae82a-e76d-445a-ad5b-ed5aa0331f0f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73449) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 11:43:49 user nova-compute[73449]: INFO nova.compute.claims [None req-a29ae82a-e76d-445a-ad5b-ed5aa0331f0f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] Claim successful on node user
Aug 17 11:43:49 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7ef11da-09ce-47a1-ba56-02af6a77206c/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:43:49 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7ef11da-09ce-47a1-ba56-02af6a77206c/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:43:49 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7ef11da-09ce-47a1-ba56-02af6a77206c/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:43:49 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7ef11da-09ce-47a1-ba56-02af6a77206c/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:43:49 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e5229d5-65a2-4d60-8e50-c30357372a80/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:43:50 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-a29ae82a-e76d-445a-ad5b-ed5aa0331f0f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 11:43:50 user nova-compute[73449]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692272615.050338, e3a9252c-0e0a-4c5c-a46f-eaa004479bd2 => Stopped> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:43:50 user nova-compute[73449]: INFO nova.compute.manager [-] [instance: e3a9252c-0e0a-4c5c-a46f-eaa004479bd2] VM Stopped (Lifecycle Event)
Aug 17 11:43:50 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-a29ae82a-e76d-445a-ad5b-ed5aa0331f0f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 11:43:50 user nova-compute[73449]: DEBUG nova.compute.manager [None req-666bba98-e3d8-449e-8895-acb277b6eac4 None None] [instance: e3a9252c-0e0a-4c5c-a46f-eaa004479bd2] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:43:50 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a29ae82a-e76d-445a-ad5b-ed5aa0331f0f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.677s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:43:50 user nova-compute[73449]: DEBUG nova.compute.manager [None req-a29ae82a-e76d-445a-ad5b-ed5aa0331f0f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] Start building networks asynchronously for instance. {{(pid=73449) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 11:43:50 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e5229d5-65a2-4d60-8e50-c30357372a80/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:43:50 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e5229d5-65a2-4d60-8e50-c30357372a80/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:43:50 user nova-compute[73449]: DEBUG nova.compute.manager [None req-a29ae82a-e76d-445a-ad5b-ed5aa0331f0f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] Allocating IP information in the background. {{(pid=73449) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 11:43:50 user nova-compute[73449]: DEBUG nova.network.neutron [None req-a29ae82a-e76d-445a-ad5b-ed5aa0331f0f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] allocate_for_instance() {{(pid=73449) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 11:43:50 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-a29ae82a-e76d-445a-ad5b-ed5aa0331f0f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 11:43:50 user nova-compute[73449]: DEBUG nova.compute.manager [None req-a29ae82a-e76d-445a-ad5b-ed5aa0331f0f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] Start building block device mappings for instance. {{(pid=73449) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 11:43:50 user nova-compute[73449]: DEBUG nova.policy [None req-a29ae82a-e76d-445a-ad5b-ed5aa0331f0f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e44f6d8893da4d95a8ebe95180355c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '068c5270255744a18208a0ad9b35f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73449) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 11:43:50 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e5229d5-65a2-4d60-8e50-c30357372a80/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:43:50 user nova-compute[73449]: DEBUG nova.compute.manager [None req-a29ae82a-e76d-445a-ad5b-ed5aa0331f0f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] Start spawning the instance on the hypervisor. {{(pid=73449) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 11:43:50 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-a29ae82a-e76d-445a-ad5b-ed5aa0331f0f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] Creating instance directory {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 11:43:50 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-a29ae82a-e76d-445a-ad5b-ed5aa0331f0f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] Creating image(s)
Aug 17 11:43:50 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a29ae82a-e76d-445a-ad5b-ed5aa0331f0f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Acquiring lock "/opt/stack/data/nova/instances/f35b7f2b-2f88-4b09-86ac-cb5a78a94584/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:43:50 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a29ae82a-e76d-445a-ad5b-ed5aa0331f0f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Lock "/opt/stack/data/nova/instances/f35b7f2b-2f88-4b09-86ac-cb5a78a94584/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:43:50 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a29ae82a-e76d-445a-ad5b-ed5aa0331f0f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Lock "/opt/stack/data/nova/instances/f35b7f2b-2f88-4b09-86ac-cb5a78a94584/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:43:50 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-a29ae82a-e76d-445a-ad5b-ed5aa0331f0f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:43:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-a29ae82a-e76d-445a-ad5b-ed5aa0331f0f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json" returned: 0 in 0.623s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:43:51 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a29ae82a-e76d-445a-ad5b-ed5aa0331f0f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Acquiring lock "7e267a577c062ee862e95ede6b48cfd5632f3ea3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:43:51 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a29ae82a-e76d-445a-ad5b-ed5aa0331f0f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Lock "7e267a577c062ee862e95ede6b48cfd5632f3ea3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.007s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:43:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-a29ae82a-e76d-445a-ad5b-ed5aa0331f0f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:43:51 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-2541dc4e-9d3c-4aab-a9c6-e1631e809be7 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Acquiring lock "a3523d22-7165-46ad-be10-5e6ae374f91d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:43:51 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-2541dc4e-9d3c-4aab-a9c6-e1631e809be7 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Lock "a3523d22-7165-46ad-be10-5e6ae374f91d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:43:51 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:43:51 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:43:51 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Hypervisor/Node resource view: name=user free_ram=7760MB free_disk=25.64478302001953GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73449) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 11:43:51 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:43:51 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:43:51 user nova-compute[73449]: DEBUG nova.objects.instance [None req-2541dc4e-9d3c-4aab-a9c6-e1631e809be7 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Lazy-loading 'flavor' on Instance uuid a3523d22-7165-46ad-be10-5e6ae374f91d {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:43:51 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-2541dc4e-9d3c-4aab-a9c6-e1631e809be7 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Lock "a3523d22-7165-46ad-be10-5e6ae374f91d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.078s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:43:51 user nova-compute[73449]: DEBUG nova.network.neutron [None req-a29ae82a-e76d-445a-ad5b-ed5aa0331f0f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] Successfully created port: e86f2a61-e64f-49ea-83ad-386755b33e00 {{(pid=73449) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 11:43:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-a29ae82a-e76d-445a-ad5b-ed5aa0331f0f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json" returned: 0 in 0.216s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:43:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-a29ae82a-e76d-445a-ad5b-ed5aa0331f0f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3,backing_fmt=raw /opt/stack/data/nova/instances/f35b7f2b-2f88-4b09-86ac-cb5a78a94584/disk 1073741824 {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:43:51 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 4a9e8ad2-19db-4975-87e4-2efce603a7d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:43:51 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance a3523d22-7165-46ad-be10-5e6ae374f91d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:43:51 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:43:51 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance c7ef11da-09ce-47a1-ba56-02af6a77206c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:43:51 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance b8e1def1-8303-4257-b9b5-0050f05cf2d0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:43:51 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance f33a7013-82d0-477c-aa5e-b27e63f2b98d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:43:51 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 5e5229d5-65a2-4d60-8e50-c30357372a80 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:43:51 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance f35b7f2b-2f88-4b09-86ac-cb5a78a94584 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:43:51 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=73449) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 11:43:51 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=73449) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 11:43:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-a29ae82a-e76d-445a-ad5b-ed5aa0331f0f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3,backing_fmt=raw /opt/stack/data/nova/instances/f35b7f2b-2f88-4b09-86ac-cb5a78a94584/disk 1073741824" returned: 0 in 0.092s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:43:51 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a29ae82a-e76d-445a-ad5b-ed5aa0331f0f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Lock "7e267a577c062ee862e95ede6b48cfd5632f3ea3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.312s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:43:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-a29ae82a-e76d-445a-ad5b-ed5aa0331f0f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:43:51 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-2541dc4e-9d3c-4aab-a9c6-e1631e809be7 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Acquiring lock "a3523d22-7165-46ad-be10-5e6ae374f91d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:43:51 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-2541dc4e-9d3c-4aab-a9c6-e1631e809be7 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Lock "a3523d22-7165-46ad-be10-5e6ae374f91d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:43:51 user nova-compute[73449]: INFO nova.compute.manager [None req-2541dc4e-9d3c-4aab-a9c6-e1631e809be7 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Attaching volume c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe to /dev/vdb
Aug 17 11:43:51 user nova-compute[73449]: DEBUG os_brick.utils [None req-2541dc4e-9d3c-4aab-a9c6-e1631e809be7 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 11:43:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:43:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-a29ae82a-e76d-445a-ad5b-ed5aa0331f0f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json" returned: 0 in 0.220s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:43:51 user nova-compute[73449]: DEBUG nova.virt.disk.api [None req-a29ae82a-e76d-445a-ad5b-ed5aa0331f0f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f35b7f2b-2f88-4b09-86ac-cb5a78a94584/disk. size=1073741824 {{(pid=73449) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 11:43:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-a29ae82a-e76d-445a-ad5b-ed5aa0331f0f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f35b7f2b-2f88-4b09-86ac-cb5a78a94584/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:43:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:43:51 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c48a4bc-2ac8-4338-b9f9-59e5b22cac71]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4d3924302012\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:43:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:43:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:43:51 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[4449baf1-d3b4-41b5-83f4-629787812c40]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:43:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:43:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:43:51 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee999a96-6e6a-4f5f-b2db-bc7070739ad6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:43:51 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c02ce85-9c6a-40c6-85da-7d1e2c3b9ff7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:43:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-2541dc4e-9d3c-4aab-a9c6-e1631e809be7 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Running cmd (subprocess): nvme version {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:43:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-2541dc4e-9d3c-4aab-a9c6-e1631e809be7 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] 'nvme version' failed. Not Retrying. {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 11:43:51 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2541dc4e-9d3c-4aab-a9c6-e1631e809be7 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] nvme not present on system {{(pid=73449) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 11:43:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:43:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 11:43:51 user nova-compute[73449]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 11:43:51 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[81c71dc2-066f-4c26-9819-dc7a44c70577]: (4, '') {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:43:51 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-2541dc4e-9d3c-4aab-a9c6-e1631e809be7 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73449) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 11:43:51 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-2541dc4e-9d3c-4aab-a9c6-e1631e809be7 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73449) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 11:43:51 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-2541dc4e-9d3c-4aab-a9c6-e1631e809be7 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] LIGHTOS: no hostnqn found. {{(pid=73449) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 11:43:51 user nova-compute[73449]: DEBUG os_brick.utils [None req-2541dc4e-9d3c-4aab-a9c6-e1631e809be7 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] <== get_connector_properties: return (197ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4d3924302012', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 11:43:51 user nova-compute[73449]: DEBUG nova.virt.block_device [None req-2541dc4e-9d3c-4aab-a9c6-e1631e809be7 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Updating existing volume attachment record: ab88735d-5dae-430b-bf21-0af4e18f0b1f {{(pid=73449) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 11:43:51 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 11:43:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-a29ae82a-e76d-445a-ad5b-ed5aa0331f0f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f35b7f2b-2f88-4b09-86ac-cb5a78a94584/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:43:51 user nova-compute[73449]: DEBUG nova.virt.disk.api [None req-a29ae82a-e76d-445a-ad5b-ed5aa0331f0f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Cannot resize image /opt/stack/data/nova/instances/f35b7f2b-2f88-4b09-86ac-cb5a78a94584/disk to a smaller size. {{(pid=73449) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 11:43:51 user nova-compute[73449]: DEBUG nova.objects.instance [None req-a29ae82a-e76d-445a-ad5b-ed5aa0331f0f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Lazy-loading 'migration_context' on Instance uuid f35b7f2b-2f88-4b09-86ac-cb5a78a94584 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:43:51 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 11:43:51 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-a29ae82a-e76d-445a-ad5b-ed5aa0331f0f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] Created local disks {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 11:43:51 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-a29ae82a-e76d-445a-ad5b-ed5aa0331f0f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] Ensure instance console log exists: /opt/stack/data/nova/instances/f35b7f2b-2f88-4b09-86ac-cb5a78a94584/console.log {{(pid=73449) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 11:43:51 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a29ae82a-e76d-445a-ad5b-ed5aa0331f0f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:43:51 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a29ae82a-e76d-445a-ad5b-ed5aa0331f0f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.003s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:43:51 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a29ae82a-e76d-445a-ad5b-ed5aa0331f0f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:43:51 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Compute_service record updated for user:user {{(pid=73449) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 11:43:51 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.753s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:43:51 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:43:52 user nova-compute[73449]: DEBUG nova.network.neutron [None req-a29ae82a-e76d-445a-ad5b-ed5aa0331f0f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] Successfully updated port: e86f2a61-e64f-49ea-83ad-386755b33e00 {{(pid=73449) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 11:43:52 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a29ae82a-e76d-445a-ad5b-ed5aa0331f0f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Acquiring lock "refresh_cache-f35b7f2b-2f88-4b09-86ac-cb5a78a94584" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:43:52 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a29ae82a-e76d-445a-ad5b-ed5aa0331f0f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Acquired lock "refresh_cache-f35b7f2b-2f88-4b09-86ac-cb5a78a94584" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:43:52 user nova-compute[73449]: DEBUG nova.network.neutron [None req-a29ae82a-e76d-445a-ad5b-ed5aa0331f0f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] Building network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 11:43:52 user nova-compute[73449]: DEBUG nova.compute.manager [req-24ea88e5-745d-4bca-8874-1b60b0faaab6 req-2246a5f6-f744-4368-8724-17bc0d17e60d service nova] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] Received event network-changed-e86f2a61-e64f-49ea-83ad-386755b33e00 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:43:52 user nova-compute[73449]: DEBUG nova.compute.manager [req-24ea88e5-745d-4bca-8874-1b60b0faaab6 req-2246a5f6-f744-4368-8724-17bc0d17e60d service nova] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] Refreshing instance network info cache due to event network-changed-e86f2a61-e64f-49ea-83ad-386755b33e00. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 11:43:52 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-24ea88e5-745d-4bca-8874-1b60b0faaab6 req-2246a5f6-f744-4368-8724-17bc0d17e60d service nova] Acquiring lock "refresh_cache-f35b7f2b-2f88-4b09-86ac-cb5a78a94584" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:43:52 user nova-compute[73449]: DEBUG nova.network.neutron [None req-a29ae82a-e76d-445a-ad5b-ed5aa0331f0f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] Instance cache missing network info. {{(pid=73449) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 11:43:52 user nova-compute[73449]: DEBUG nova.network.neutron [None req-a29ae82a-e76d-445a-ad5b-ed5aa0331f0f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] Updating instance_info_cache with network_info: [{"id": "e86f2a61-e64f-49ea-83ad-386755b33e00", "address": "fa:16:3e:4e:54:ff", "network": {"id": "72c50a42-688f-4868-8e19-c40b103a49cd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1792423641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "068c5270255744a18208a0ad9b35f168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape86f2a61-e6", "ovs_interfaceid": "e86f2a61-e64f-49ea-83ad-386755b33e00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:43:52 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a29ae82a-e76d-445a-ad5b-ed5aa0331f0f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Releasing lock "refresh_cache-f35b7f2b-2f88-4b09-86ac-cb5a78a94584" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:43:52 user nova-compute[73449]: DEBUG nova.compute.manager [None req-a29ae82a-e76d-445a-ad5b-ed5aa0331f0f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] Instance network_info: |[{"id": "e86f2a61-e64f-49ea-83ad-386755b33e00", "address": "fa:16:3e:4e:54:ff", "network": {"id": "72c50a42-688f-4868-8e19-c40b103a49cd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1792423641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "068c5270255744a18208a0ad9b35f168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape86f2a61-e6", "ovs_interfaceid": "e86f2a61-e64f-49ea-83ad-386755b33e00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73449) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 11:43:52 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-24ea88e5-745d-4bca-8874-1b60b0faaab6 req-2246a5f6-f744-4368-8724-17bc0d17e60d service nova] Acquired lock "refresh_cache-f35b7f2b-2f88-4b09-86ac-cb5a78a94584" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:43:52 user nova-compute[73449]: DEBUG nova.network.neutron [req-24ea88e5-745d-4bca-8874-1b60b0faaab6 req-2246a5f6-f744-4368-8724-17bc0d17e60d service nova] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] Refreshing network info cache for port e86f2a61-e64f-49ea-83ad-386755b33e00 {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 11:43:52 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-a29ae82a-e76d-445a-ad5b-ed5aa0331f0f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] Start _get_guest_xml network_info=[{"id": "e86f2a61-e64f-49ea-83ad-386755b33e00", "address": "fa:16:3e:4e:54:ff", "network": {"id": "72c50a42-688f-4868-8e19-c40b103a49cd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1792423641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "068c5270255744a18208a0ad9b35f168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape86f2a61-e6", "ovs_interfaceid": "e86f2a61-e64f-49ea-83ad-386755b33e00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T11:36:11Z,direct_url=<?>,disk_format='qcow2',id=0a2904ae-083d-41c8-83db-343132b36148,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7a77880136a54ef195c82e018e1939db',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T11:36:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': '0a2904ae-083d-41c8-83db-343132b36148'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 11:43:52 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-a29ae82a-e76d-445a-ad5b-ed5aa0331f0f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:43:52 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-a29ae82a-e76d-445a-ad5b-ed5aa0331f0f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:43:52 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-a29ae82a-e76d-445a-ad5b-ed5aa0331f0f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 11:43:52 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-a29ae82a-e76d-445a-ad5b-ed5aa0331f0f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] CPU controller missing on host. {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 11:43:52 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:43:52 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-a29ae82a-e76d-445a-ad5b-ed5aa0331f0f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 11:43:52 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-a29ae82a-e76d-445a-ad5b-ed5aa0331f0f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] CPU controller found on host. {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 11:43:52 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-a29ae82a-e76d-445a-ad5b-ed5aa0331f0f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73449) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 11:43:52 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-a29ae82a-e76d-445a-ad5b-ed5aa0331f0f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T11:35:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T11:36:11Z,direct_url=<?>,disk_format='qcow2',id=0a2904ae-083d-41c8-83db-343132b36148,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7a77880136a54ef195c82e018e1939db',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T11:36:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 11:43:52 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-a29ae82a-e76d-445a-ad5b-ed5aa0331f0f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Flavor limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 11:43:52 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-a29ae82a-e76d-445a-ad5b-ed5aa0331f0f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Image limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 11:43:52 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-a29ae82a-e76d-445a-ad5b-ed5aa0331f0f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Flavor pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 11:43:52 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-a29ae82a-e76d-445a-ad5b-ed5aa0331f0f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Image pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 11:43:52 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-a29ae82a-e76d-445a-ad5b-ed5aa0331f0f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 11:43:52 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-a29ae82a-e76d-445a-ad5b-ed5aa0331f0f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 11:43:52 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-a29ae82a-e76d-445a-ad5b-ed5aa0331f0f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 11:43:52 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-a29ae82a-e76d-445a-ad5b-ed5aa0331f0f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Got 1 possible topologies {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 11:43:52 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-a29ae82a-e76d-445a-ad5b-ed5aa0331f0f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 11:43:52 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-a29ae82a-e76d-445a-ad5b-ed5aa0331f0f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 11:43:52 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-a29ae82a-e76d-445a-ad5b-ed5aa0331f0f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:43:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-2119051174',display_name='tempest-tempest.common.compute-instance-2119051174',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-2119051174',id=12,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBslNxfjqeXy15++V9lUN1dUPSj0u5ix1Nnljk5AjIrZhZF+tQog/IhoD1HSXnZkSrwagPwVC/Uewn/Q/J6AkryzpFNZdKWZ4r8749mZJ2bXrxgJUs51emgx4vTQbsCJiQ==',key_name='tempest-keypair-1878071127',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='068c5270255744a18208a0ad9b35f168',ramdisk_id='',reservation_id='r-raxmup83',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-303961666',owner_user_name='tempest-ServerActionsTestOtherA-303961666-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T11:43:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e44f6d8893da4d95a8ebe95180355c04',uuid=f35b7f2b-2f88-4b09-86ac-cb5a78a94584,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e86f2a61-e64f-49ea-83ad-386755b33e00", "address": "fa:16:3e:4e:54:ff", "network": {"id": "72c50a42-688f-4868-8e19-c40b103a49cd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1792423641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "068c5270255744a18208a0ad9b35f168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape86f2a61-e6", "ovs_interfaceid": "e86f2a61-e64f-49ea-83ad-386755b33e00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73449) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 11:43:52 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-a29ae82a-e76d-445a-ad5b-ed5aa0331f0f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Converting VIF {"id": "e86f2a61-e64f-49ea-83ad-386755b33e00", "address": "fa:16:3e:4e:54:ff", "network": {"id": "72c50a42-688f-4868-8e19-c40b103a49cd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1792423641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "068c5270255744a18208a0ad9b35f168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape86f2a61-e6", "ovs_interfaceid": "e86f2a61-e64f-49ea-83ad-386755b33e00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:43:52 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-a29ae82a-e76d-445a-ad5b-ed5aa0331f0f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:54:ff,bridge_name='br-int',has_traffic_filtering=True,id=e86f2a61-e64f-49ea-83ad-386755b33e00,network=Network(72c50a42-688f-4868-8e19-c40b103a49cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape86f2a61-e6') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:43:52 user nova-compute[73449]: DEBUG nova.objects.instance [None req-a29ae82a-e76d-445a-ad5b-ed5aa0331f0f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Lazy-loading 'pci_devices' on Instance uuid f35b7f2b-2f88-4b09-86ac-cb5a78a94584 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:43:52 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:43:52 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Starting heal instance info cache {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 11:43:52 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-a29ae82a-e76d-445a-ad5b-ed5aa0331f0f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] End _get_guest_xml xml=<domain type="kvm">
Aug 17 11:43:52 user nova-compute[73449]:   <uuid>f35b7f2b-2f88-4b09-86ac-cb5a78a94584</uuid>
Aug 17 11:43:52 user nova-compute[73449]:   <name>instance-0000000c</name>
Aug 17 11:43:52 user nova-compute[73449]:   <memory>524288</memory>
Aug 17 11:43:52 user nova-compute[73449]:   <vcpu>1</vcpu>
Aug 17 11:43:52 user nova-compute[73449]:   <metadata>
Aug 17 11:43:52 user nova-compute[73449]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 11:43:52 user nova-compute[73449]:       <nova:package version="0.0.0"/>
Aug 17 11:43:52 user nova-compute[73449]:       <nova:name>tempest-tempest.common.compute-instance-2119051174</nova:name>
Aug 17 11:43:52 user nova-compute[73449]:       <nova:creationTime>2023-08-17 11:43:52</nova:creationTime>
Aug 17 11:43:52 user nova-compute[73449]:       <nova:flavor name="m1.tiny">
Aug 17 11:43:52 user nova-compute[73449]:         <nova:memory>512</nova:memory>
Aug 17 11:43:52 user nova-compute[73449]:         <nova:disk>1</nova:disk>
Aug 17 11:43:52 user nova-compute[73449]:         <nova:swap>0</nova:swap>
Aug 17 11:43:52 user nova-compute[73449]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 11:43:52 user nova-compute[73449]:         <nova:vcpus>1</nova:vcpus>
Aug 17 11:43:52 user nova-compute[73449]:       </nova:flavor>
Aug 17 11:43:52 user nova-compute[73449]:       <nova:owner>
Aug 17 11:43:52 user nova-compute[73449]:         <nova:user uuid="e44f6d8893da4d95a8ebe95180355c04">tempest-ServerActionsTestOtherA-303961666-project-member</nova:user>
Aug 17 11:43:52 user nova-compute[73449]:         <nova:project uuid="068c5270255744a18208a0ad9b35f168">tempest-ServerActionsTestOtherA-303961666</nova:project>
Aug 17 11:43:52 user nova-compute[73449]:       </nova:owner>
Aug 17 11:43:52 user nova-compute[73449]:       <nova:root type="image" uuid="0a2904ae-083d-41c8-83db-343132b36148"/>
Aug 17 11:43:52 user nova-compute[73449]:       <nova:ports>
Aug 17 11:43:52 user nova-compute[73449]:         <nova:port uuid="e86f2a61-e64f-49ea-83ad-386755b33e00">
Aug 17 11:43:52 user nova-compute[73449]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 17 11:43:52 user nova-compute[73449]:         </nova:port>
Aug 17 11:43:52 user nova-compute[73449]:       </nova:ports>
Aug 17 11:43:52 user nova-compute[73449]:     </nova:instance>
Aug 17 11:43:52 user nova-compute[73449]:   </metadata>
Aug 17 11:43:52 user nova-compute[73449]:   <sysinfo type="smbios">
Aug 17 11:43:52 user nova-compute[73449]:     <system>
Aug 17 11:43:52 user nova-compute[73449]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 11:43:52 user nova-compute[73449]:       <entry name="product">OpenStack Nova</entry>
Aug 17 11:43:52 user nova-compute[73449]:       <entry name="version">0.0.0</entry>
Aug 17 11:43:52 user nova-compute[73449]:       <entry name="serial">f35b7f2b-2f88-4b09-86ac-cb5a78a94584</entry>
Aug 17 11:43:52 user nova-compute[73449]:       <entry name="uuid">f35b7f2b-2f88-4b09-86ac-cb5a78a94584</entry>
Aug 17 11:43:52 user nova-compute[73449]:       <entry name="family">Virtual Machine</entry>
Aug 17 11:43:52 user nova-compute[73449]:     </system>
Aug 17 11:43:52 user nova-compute[73449]:   </sysinfo>
Aug 17 11:43:52 user nova-compute[73449]:   <os>
Aug 17 11:43:52 user nova-compute[73449]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 11:43:52 user nova-compute[73449]:     <boot dev="hd"/>
Aug 17 11:43:52 user nova-compute[73449]:     <smbios mode="sysinfo"/>
Aug 17 11:43:52 user nova-compute[73449]:   </os>
Aug 17 11:43:52 user nova-compute[73449]:   <features>
Aug 17 11:43:52 user nova-compute[73449]:     <acpi/>
Aug 17 11:43:52 user nova-compute[73449]:     <apic/>
Aug 17 11:43:52 user nova-compute[73449]:     <vmcoreinfo/>
Aug 17 11:43:52 user nova-compute[73449]:   </features>
Aug 17 11:43:52 user nova-compute[73449]:   <clock offset="utc">
Aug 17 11:43:52 user nova-compute[73449]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 11:43:52 user nova-compute[73449]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 11:43:52 user nova-compute[73449]:     <timer name="hpet" present="no"/>
Aug 17 11:43:52 user nova-compute[73449]:   </clock>
Aug 17 11:43:52 user nova-compute[73449]:   <cpu mode="custom" match="exact">
Aug 17 11:43:52 user nova-compute[73449]:     <model>Nehalem</model>
Aug 17 11:43:52 user nova-compute[73449]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 11:43:52 user nova-compute[73449]:   </cpu>
Aug 17 11:43:52 user nova-compute[73449]:   <devices>
Aug 17 11:43:52 user nova-compute[73449]:     <disk type="file" device="disk">
Aug 17 11:43:52 user nova-compute[73449]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 11:43:52 user nova-compute[73449]:       <source file="/opt/stack/data/nova/instances/f35b7f2b-2f88-4b09-86ac-cb5a78a94584/disk"/>
Aug 17 11:43:52 user nova-compute[73449]:       <target dev="vda" bus="virtio"/>
Aug 17 11:43:52 user nova-compute[73449]:     </disk>
Aug 17 11:43:52 user nova-compute[73449]:     <interface type="ethernet">
Aug 17 11:43:52 user nova-compute[73449]:       <mac address="fa:16:3e:4e:54:ff"/>
Aug 17 11:43:52 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 11:43:52 user nova-compute[73449]:       <mtu size="1442"/>
Aug 17 11:43:52 user nova-compute[73449]:       <target dev="tape86f2a61-e6"/>
Aug 17 11:43:52 user nova-compute[73449]:     </interface>
Aug 17 11:43:52 user nova-compute[73449]:     <serial type="pty">
Aug 17 11:43:52 user nova-compute[73449]:       <log file="/opt/stack/data/nova/instances/f35b7f2b-2f88-4b09-86ac-cb5a78a94584/console.log" append="off"/>
Aug 17 11:43:52 user nova-compute[73449]:     </serial>
Aug 17 11:43:52 user nova-compute[73449]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 11:43:52 user nova-compute[73449]:     <video>
Aug 17 11:43:52 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 11:43:52 user nova-compute[73449]:     </video>
Aug 17 11:43:52 user nova-compute[73449]:     <rng model="virtio">
Aug 17 11:43:52 user nova-compute[73449]:       <backend model="random">/dev/urandom</backend>
Aug 17 11:43:52 user nova-compute[73449]:     </rng>
Aug 17 11:43:52 user nova-compute[73449]:     <controller type="usb" index="0" model="none"/>
Aug 17 11:43:52 user nova-compute[73449]:     <memballoon model="virtio">
Aug 17 11:43:52 user nova-compute[73449]:       <stats period="10"/>
Aug 17 11:43:52 user nova-compute[73449]:     </memballoon>
Aug 17 11:43:52 user nova-compute[73449]:   </devices>
Aug 17 11:43:52 user nova-compute[73449]: </domain>
Aug 17 11:43:52 user nova-compute[73449]:  {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 11:43:52 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-a29ae82a-e76d-445a-ad5b-ed5aa0331f0f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:43:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-2119051174',display_name='tempest-tempest.common.compute-instance-2119051174',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-2119051174',id=12,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBslNxfjqeXy15++V9lUN1dUPSj0u5ix1Nnljk5AjIrZhZF+tQog/IhoD1HSXnZkSrwagPwVC/Uewn/Q/J6AkryzpFNZdKWZ4r8749mZJ2bXrxgJUs51emgx4vTQbsCJiQ==',key_name='tempest-keypair-1878071127',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='068c5270255744a18208a0ad9b35f168',ramdisk_id='',reservation_id='r-raxmup83',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-303961666',owner_user_name='tempest-ServerActionsTestOtherA-303961666-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T11:43:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e44f6d8893da4d95a8ebe95180355c04',uuid=f35b7f2b-2f88-4b09-86ac-cb5a78a94584,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e86f2a61-e64f-49ea-83ad-386755b33e00", "address": "fa:16:3e:4e:54:ff", "network": {"id": "72c50a42-688f-4868-8e19-c40b103a49cd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1792423641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "068c5270255744a18208a0ad9b35f168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape86f2a61-e6", "ovs_interfaceid": "e86f2a61-e64f-49ea-83ad-386755b33e00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 11:43:52 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-a29ae82a-e76d-445a-ad5b-ed5aa0331f0f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Converting VIF {"id": "e86f2a61-e64f-49ea-83ad-386755b33e00", "address": "fa:16:3e:4e:54:ff", "network": {"id": "72c50a42-688f-4868-8e19-c40b103a49cd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1792423641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "068c5270255744a18208a0ad9b35f168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape86f2a61-e6", "ovs_interfaceid": "e86f2a61-e64f-49ea-83ad-386755b33e00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:43:52 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-a29ae82a-e76d-445a-ad5b-ed5aa0331f0f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:54:ff,bridge_name='br-int',has_traffic_filtering=True,id=e86f2a61-e64f-49ea-83ad-386755b33e00,network=Network(72c50a42-688f-4868-8e19-c40b103a49cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape86f2a61-e6') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:43:52 user nova-compute[73449]: DEBUG os_vif [None req-a29ae82a-e76d-445a-ad5b-ed5aa0331f0f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:54:ff,bridge_name='br-int',has_traffic_filtering=True,id=e86f2a61-e64f-49ea-83ad-386755b33e00,network=Network(72c50a42-688f-4868-8e19-c40b103a49cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape86f2a61-e6') {{(pid=73449) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 11:43:52 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:43:52 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:43:52 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 11:43:52 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:43:52 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape86f2a61-e6, may_exist=True, interface_attrs={}) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:43:52 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape86f2a61-e6, col_values=(('external_ids', {'iface-id': 'e86f2a61-e64f-49ea-83ad-386755b33e00', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4e:54:ff', 'vm-uuid': 'f35b7f2b-2f88-4b09-86ac-cb5a78a94584'}),), if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:43:52 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:43:52 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:43:52 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:43:52 user nova-compute[73449]: INFO os_vif [None req-a29ae82a-e76d-445a-ad5b-ed5aa0331f0f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:54:ff,bridge_name='br-int',has_traffic_filtering=True,id=e86f2a61-e64f-49ea-83ad-386755b33e00,network=Network(72c50a42-688f-4868-8e19-c40b103a49cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape86f2a61-e6')
Aug 17 11:43:53 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-a29ae82a-e76d-445a-ad5b-ed5aa0331f0f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] No BDM found with device name vda, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 11:43:53 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-a29ae82a-e76d-445a-ad5b-ed5aa0331f0f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] No VIF found with MAC fa:16:3e:4e:54:ff, not building metadata {{(pid=73449) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 11:43:53 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "refresh_cache-fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:43:53 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquired lock "refresh_cache-fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:43:53 user nova-compute[73449]: DEBUG nova.network.neutron [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2] Forcefully refreshing network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 11:43:53 user nova-compute[73449]: DEBUG nova.network.neutron [req-24ea88e5-745d-4bca-8874-1b60b0faaab6 req-2246a5f6-f744-4368-8724-17bc0d17e60d service nova] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] Updated VIF entry in instance network info cache for port e86f2a61-e64f-49ea-83ad-386755b33e00. {{(pid=73449) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 11:43:53 user nova-compute[73449]: DEBUG nova.network.neutron [req-24ea88e5-745d-4bca-8874-1b60b0faaab6 req-2246a5f6-f744-4368-8724-17bc0d17e60d service nova] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] Updating instance_info_cache with network_info: [{"id": "e86f2a61-e64f-49ea-83ad-386755b33e00", "address": "fa:16:3e:4e:54:ff", "network": {"id": "72c50a42-688f-4868-8e19-c40b103a49cd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1792423641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "068c5270255744a18208a0ad9b35f168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape86f2a61-e6", "ovs_interfaceid": "e86f2a61-e64f-49ea-83ad-386755b33e00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:43:53 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-24ea88e5-745d-4bca-8874-1b60b0faaab6 req-2246a5f6-f744-4368-8724-17bc0d17e60d service nova] Releasing lock "refresh_cache-f35b7f2b-2f88-4b09-86ac-cb5a78a94584" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:43:53 user nova-compute[73449]: DEBUG nova.network.neutron [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2] Updating instance_info_cache with network_info: [{"id": "850d3d8f-2b5b-4e82-9c33-83f440f2a428", "address": "fa:16:3e:de:a4:f4", "network": {"id": "ef0c44c4-ef68-433d-bfbc-71272ed64948", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-24887935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2513ad48149f45e2a2bd4b404ebc13b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap850d3d8f-2b", "ovs_interfaceid": "850d3d8f-2b5b-4e82-9c33-83f440f2a428", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:43:53 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Releasing lock "refresh_cache-fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:43:53 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2] Updated the network info_cache for instance {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 11:43:53 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:43:54 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:43:54 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:43:54 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:43:54 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:43:54 user nova-compute[73449]: DEBUG nova.compute.manager [req-531df4ab-2497-4ad7-99ad-0d5b89b2b0e2 req-c3b58ce3-17a3-488a-a63d-9bf79e6a9ea0 service nova] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] Received event network-vif-plugged-e86f2a61-e64f-49ea-83ad-386755b33e00 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:43:54 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-531df4ab-2497-4ad7-99ad-0d5b89b2b0e2 req-c3b58ce3-17a3-488a-a63d-9bf79e6a9ea0 service nova] Acquiring lock "f35b7f2b-2f88-4b09-86ac-cb5a78a94584-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:43:54 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-531df4ab-2497-4ad7-99ad-0d5b89b2b0e2 req-c3b58ce3-17a3-488a-a63d-9bf79e6a9ea0 service nova] Lock "f35b7f2b-2f88-4b09-86ac-cb5a78a94584-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:43:54 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-531df4ab-2497-4ad7-99ad-0d5b89b2b0e2 req-c3b58ce3-17a3-488a-a63d-9bf79e6a9ea0 service nova] Lock "f35b7f2b-2f88-4b09-86ac-cb5a78a94584-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:43:54 user nova-compute[73449]: DEBUG nova.compute.manager [req-531df4ab-2497-4ad7-99ad-0d5b89b2b0e2 req-c3b58ce3-17a3-488a-a63d-9bf79e6a9ea0 service nova] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] No waiting events found dispatching network-vif-plugged-e86f2a61-e64f-49ea-83ad-386755b33e00 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:43:54 user nova-compute[73449]: WARNING nova.compute.manager [req-531df4ab-2497-4ad7-99ad-0d5b89b2b0e2 req-c3b58ce3-17a3-488a-a63d-9bf79e6a9ea0 service nova] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] Received unexpected event network-vif-plugged-e86f2a61-e64f-49ea-83ad-386755b33e00 for instance with vm_state building and task_state spawning.
Aug 17 11:43:54 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:43:54 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:43:55 user nova-compute[73449]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692272620.0356379, fd8d4549-db8f-4c74-8706-8ac21f049c2e => Stopped> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:43:55 user nova-compute[73449]: INFO nova.compute.manager [-] [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e] VM Stopped (Lifecycle Event)
Aug 17 11:43:55 user nova-compute[73449]: DEBUG nova.compute.manager [None req-4cce8627-ab02-4283-a672-4717cef8f259 None None] [instance: fd8d4549-db8f-4c74-8706-8ac21f049c2e] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:43:56 user nova-compute[73449]: DEBUG nova.compute.manager [req-dca4c43a-2a78-4e32-b537-fc36f9ae2c31 req-0ea79a56-4d90-4038-9751-db3e8920863e service nova] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] Received event network-vif-plugged-e86f2a61-e64f-49ea-83ad-386755b33e00 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:43:56 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-dca4c43a-2a78-4e32-b537-fc36f9ae2c31 req-0ea79a56-4d90-4038-9751-db3e8920863e service nova] Acquiring lock "f35b7f2b-2f88-4b09-86ac-cb5a78a94584-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:43:56 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-dca4c43a-2a78-4e32-b537-fc36f9ae2c31 req-0ea79a56-4d90-4038-9751-db3e8920863e service nova] Lock "f35b7f2b-2f88-4b09-86ac-cb5a78a94584-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:43:56 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-dca4c43a-2a78-4e32-b537-fc36f9ae2c31 req-0ea79a56-4d90-4038-9751-db3e8920863e service nova] Lock "f35b7f2b-2f88-4b09-86ac-cb5a78a94584-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:43:56 user nova-compute[73449]: DEBUG nova.compute.manager [req-dca4c43a-2a78-4e32-b537-fc36f9ae2c31 req-0ea79a56-4d90-4038-9751-db3e8920863e service nova] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] No waiting events found dispatching network-vif-plugged-e86f2a61-e64f-49ea-83ad-386755b33e00 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:43:56 user nova-compute[73449]: WARNING nova.compute.manager [req-dca4c43a-2a78-4e32-b537-fc36f9ae2c31 req-0ea79a56-4d90-4038-9751-db3e8920863e service nova] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] Received unexpected event network-vif-plugged-e86f2a61-e64f-49ea-83ad-386755b33e00 for instance with vm_state building and task_state spawning.
Aug 17 11:43:56 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692272636.6764038, f35b7f2b-2f88-4b09-86ac-cb5a78a94584 => Resumed> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:43:56 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] VM Resumed (Lifecycle Event)
Aug 17 11:43:56 user nova-compute[73449]: DEBUG nova.compute.manager [None req-a29ae82a-e76d-445a-ad5b-ed5aa0331f0f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] Instance event wait completed in 0 seconds for  {{(pid=73449) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 11:43:56 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-a29ae82a-e76d-445a-ad5b-ed5aa0331f0f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] Guest created on hypervisor {{(pid=73449) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 11:43:56 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] Instance spawned successfully.
Aug 17 11:43:56 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-a29ae82a-e76d-445a-ad5b-ed5aa0331f0f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 11:43:56 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:43:56 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 11:43:56 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-a29ae82a-e76d-445a-ad5b-ed5aa0331f0f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] Found default for hw_cdrom_bus of ide {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:43:56 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-a29ae82a-e76d-445a-ad5b-ed5aa0331f0f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] Found default for hw_disk_bus of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:43:56 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-a29ae82a-e76d-445a-ad5b-ed5aa0331f0f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] Found default for hw_input_bus of None {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:43:56 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-a29ae82a-e76d-445a-ad5b-ed5aa0331f0f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] Found default for hw_pointer_model of None {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:43:56 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-a29ae82a-e76d-445a-ad5b-ed5aa0331f0f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] Found default for hw_video_model of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:43:56 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-a29ae82a-e76d-445a-ad5b-ed5aa0331f0f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] Found default for hw_vif_model of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:43:56 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 11:43:56 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692272636.6781497, f35b7f2b-2f88-4b09-86ac-cb5a78a94584 => Started> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:43:56 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] VM Started (Lifecycle Event)
Aug 17 11:43:56 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:43:56 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 11:43:56 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 11:43:56 user nova-compute[73449]: INFO nova.compute.manager [None req-a29ae82a-e76d-445a-ad5b-ed5aa0331f0f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] Took 6.47 seconds to spawn the instance on the hypervisor.
Aug 17 11:43:56 user nova-compute[73449]: DEBUG nova.compute.manager [None req-a29ae82a-e76d-445a-ad5b-ed5aa0331f0f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:43:56 user nova-compute[73449]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692272621.9252093, 7d3e07fa-4823-48e9-a959-e7bac0e0b25b => Stopped> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:43:56 user nova-compute[73449]: INFO nova.compute.manager [-] [instance: 7d3e07fa-4823-48e9-a959-e7bac0e0b25b] VM Stopped (Lifecycle Event)
Aug 17 11:43:56 user nova-compute[73449]: DEBUG nova.compute.manager [None req-1d071e04-10ba-4224-b8e8-60721ed61f3b None None] [instance: 7d3e07fa-4823-48e9-a959-e7bac0e0b25b] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:43:56 user nova-compute[73449]: INFO nova.compute.manager [None req-a29ae82a-e76d-445a-ad5b-ed5aa0331f0f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] Took 7.59 seconds to build instance.
Aug 17 11:43:57 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a29ae82a-e76d-445a-ad5b-ed5aa0331f0f tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Lock "f35b7f2b-2f88-4b09-86ac-cb5a78a94584" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.879s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:43:57 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:43:57 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:02 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:02 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:04 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2541dc4e-9d3c-4aab-a9c6-e1631e809be7 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Calling os-brick to attach iSCSI Volume {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 11:44:04 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-2541dc4e-9d3c-4aab-a9c6-e1631e809be7 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QsgWpRYJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 11:44:04 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-2541dc4e-9d3c-4aab-a9c6-e1631e809be7 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 11:44:04 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-2541dc4e-9d3c-4aab-a9c6-e1631e809be7 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:44:04 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-2541dc4e-9d3c-4aab-a9c6-e1631e809be7 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:44:04 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-2541dc4e-9d3c-4aab-a9c6-e1631e809be7 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 11:44:04 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-2541dc4e-9d3c-4aab-a9c6-e1631e809be7 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:44:04 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-2541dc4e-9d3c-4aab-a9c6-e1631e809be7 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:44:04 user nova-compute[73449]: INFO os_brick.initiator.connectors.iscsi [None req-2541dc4e-9d3c-4aab-a9c6-e1631e809be7 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 11:44:04 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe -p 172.16.0.220:3260 {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:44:04 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:44:04 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fc392a3-fb01-4ab5-a01a-3e0769c0e917]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:44:04 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-2541dc4e-9d3c-4aab-a9c6-e1631e809be7 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 11:44:04 user nova-compute[73449]:  {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:44:04 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe -p 172.16.0.220:3260 --interface default --op new {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:44:04 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:44:04 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfb56ac9-275f-4e52-bd48-bef6cb52d9b7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe] added\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:44:04 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-2541dc4e-9d3c-4aab-a9c6-e1631e809be7 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe] added
Aug 17 11:44:04 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:44:04 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:44:04 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:44:04 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[55c1f07a-b366-4b81-8429-c4d59fb71426]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:44:04 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-2541dc4e-9d3c-4aab-a9c6-e1631e809be7 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:44:04 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:44:04 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:44:04 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[74bd3ab9-f48b-4455-8a06-04716072740e]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:44:04 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-2541dc4e-9d3c-4aab-a9c6-e1631e809be7 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:44:04 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QsgWpRYJ {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:44:04 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QsgWpRYJ" returned: 0 in 0.029s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:44:04 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbc7daf3-1eb7-467b-bb30-cf793b8a1b63]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:44:04 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-2541dc4e-9d3c-4aab-a9c6-e1631e809be7 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QsgWpRYJ'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:44:04 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:44:04 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:44:04 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[99f7ebd0-6a24-4e69-9d21-7723720ab135]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:44:04 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-2541dc4e-9d3c-4aab-a9c6-e1631e809be7 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:44:04 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:44:04 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:44:04 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[d504e4ad-218a-45e2-9183-e507896c5abb]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:44:04 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-2541dc4e-9d3c-4aab-a9c6-e1631e809be7 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919 (non-flash)
Aug 17 11:44:04 user nova-compute[73449]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47 (non-flash)
Aug 17 11:44:04 user nova-compute[73449]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda (non-flash)
Aug 17 11:44:04 user nova-compute[73449]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e (non-flash)
Aug 17 11:44:04 user nova-compute[73449]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff (non-flash)
Aug 17 11:44:04 user nova-compute[73449]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd (non-flash)
Aug 17 11:44:04 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:44:04 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-2541dc4e-9d3c-4aab-a9c6-e1631e809be7 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919 (non-flash)
Aug 17 11:44:04 user nova-compute[73449]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47 (non-flash)
Aug 17 11:44:04 user nova-compute[73449]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda (non-flash)
Aug 17 11:44:04 user nova-compute[73449]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e (non-flash)
Aug 17 11:44:04 user nova-compute[73449]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff (non-flash)
Aug 17 11:44:04 user nova-compute[73449]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd (non-flash)
Aug 17 11:44:04 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:44:04 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe -p 172.16.0.220:3260 --login {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:44:04 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe -p 172.16.0.220:3260 --login" returned: 0 in 0.093s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:44:04 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e6a72a4-04e1-4d01-bc7c-af584d5b43f6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:44:04 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-2541dc4e-9d3c-4aab-a9c6-e1631e809be7 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe, portal: 172.16.0.220,3260]
Aug 17 11:44:04 user nova-compute[73449]: Login to [iface: default, target: iqn.2010-10.org.openstack:c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe, portal: 172.16.0.220,3260] successful.
Aug 17 11:44:04 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:44:04 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:44:04 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:44:04 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[61dfc725-7bf6-43ab-ba66-36d363aed995]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:44:04 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-2541dc4e-9d3c-4aab-a9c6-e1631e809be7 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:44:04 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:44:05 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.131s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:44:05 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[d68495a6-8741-4eb3-88a8-1dcc323b4035]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:44:05 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-2541dc4e-9d3c-4aab-a9c6-e1631e809be7 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe (non-flash)
Aug 17 11:44:05 user nova-compute[73449]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919 (non-flash)
Aug 17 11:44:05 user nova-compute[73449]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47 (non-flash)
Aug 17 11:44:05 user nova-compute[73449]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda (non-flash)
Aug 17 11:44:05 user nova-compute[73449]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e (non-flash)
Aug 17 11:44:05 user nova-compute[73449]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff (non-flash)
Aug 17 11:44:05 user nova-compute[73449]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd (non-flash)
Aug 17 11:44:05 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:44:05 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-2541dc4e-9d3c-4aab-a9c6-e1631e809be7 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe (non-flash)
Aug 17 11:44:05 user nova-compute[73449]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919 (non-flash)
Aug 17 11:44:05 user nova-compute[73449]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47 (non-flash)
Aug 17 11:44:05 user nova-compute[73449]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda (non-flash)
Aug 17 11:44:05 user nova-compute[73449]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e (non-flash)
Aug 17 11:44:05 user nova-compute[73449]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff (non-flash)
Aug 17 11:44:05 user nova-compute[73449]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd (non-flash)
Aug 17 11:44:05 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:44:05 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-2541dc4e-9d3c-4aab-a9c6-e1631e809be7 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.476s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:44:05 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-2541dc4e-9d3c-4aab-a9c6-e1631e809be7 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Connected to 172.16.0.220:3260 {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 11:44:05 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-2541dc4e-9d3c-4aab-a9c6-e1631e809be7 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] HCTL ('39', '-', '-', 0) found on session 15 with lun 0 {{(pid=73449) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 11:44:05 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-2541dc4e-9d3c-4aab-a9c6-e1631e809be7 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=73449) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 11:44:05 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:44:05 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.023s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:44:05 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[07e1dd0c-0e19-4412-adbf-d5c8d936f24b]: (4, ('- - 0', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:44:05 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-2541dc4e-9d3c-4aab-a9c6-e1631e809be7 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Searching for a device in session 15 and hctl ['39', '*', '*', 0] yield: None {{(pid=73449) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 11:44:06 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-2541dc4e-9d3c-4aab-a9c6-e1631e809be7 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Searching for a device in session 15 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=73449) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 11:44:06 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-2541dc4e-9d3c-4aab-a9c6-e1631e809be7 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QsgWpRYJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 11:44:06 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-2541dc4e-9d3c-4aab-a9c6-e1631e809be7 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.519s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:44:06 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-2541dc4e-9d3c-4aab-a9c6-e1631e809be7 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] <== connect_volume: return (1521ms) {'type': 'block', 'scsi_wwn': '23030353761656662', 'path': '/dev/sdh'} {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 11:44:06 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2541dc4e-9d3c-4aab-a9c6-e1631e809be7 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23030353761656662', 'path': '/dev/sdh'} {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 11:44:06 user nova-compute[73449]: DEBUG nova.objects.instance [None req-2541dc4e-9d3c-4aab-a9c6-e1631e809be7 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Lazy-loading 'flavor' on Instance uuid a3523d22-7165-46ad-be10-5e6ae374f91d {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:44:06 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-2541dc4e-9d3c-4aab-a9c6-e1631e809be7 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 11:44:06 user nova-compute[73449]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 11:44:06 user nova-compute[73449]:   <source dev="/dev/sdh"/>
Aug 17 11:44:06 user nova-compute[73449]:   <target dev="vdb" bus="virtio"/>
Aug 17 11:44:06 user nova-compute[73449]:   <serial>c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe</serial>
Aug 17 11:44:06 user nova-compute[73449]: </disk>
Aug 17 11:44:06 user nova-compute[73449]:  {{(pid=73449) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 11:44:06 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-2541dc4e-9d3c-4aab-a9c6-e1631e809be7 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] No BDM found with device name vda, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 11:44:06 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-2541dc4e-9d3c-4aab-a9c6-e1631e809be7 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 11:44:06 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-2541dc4e-9d3c-4aab-a9c6-e1631e809be7 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] No VIF found with MAC fa:16:3e:15:cd:09, not building metadata {{(pid=73449) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 11:44:06 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-2541dc4e-9d3c-4aab-a9c6-e1631e809be7 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Lock "a3523d22-7165-46ad-be10-5e6ae374f91d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.366s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:44:07 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:07 user nova-compute[73449]: DEBUG nova.compute.manager [req-597f1fcd-6a6a-44cf-9102-ed8095909390 req-f67db894-4545-4322-90a4-82f062213f43 service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Received event network-changed-c877b9e9-f45c-4199-960c-2b9926518803 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:44:07 user nova-compute[73449]: DEBUG nova.compute.manager [req-597f1fcd-6a6a-44cf-9102-ed8095909390 req-f67db894-4545-4322-90a4-82f062213f43 service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Refreshing instance network info cache due to event network-changed-c877b9e9-f45c-4199-960c-2b9926518803. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 11:44:07 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-597f1fcd-6a6a-44cf-9102-ed8095909390 req-f67db894-4545-4322-90a4-82f062213f43 service nova] Acquiring lock "refresh_cache-b8e1def1-8303-4257-b9b5-0050f05cf2d0" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:44:07 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-597f1fcd-6a6a-44cf-9102-ed8095909390 req-f67db894-4545-4322-90a4-82f062213f43 service nova] Acquired lock "refresh_cache-b8e1def1-8303-4257-b9b5-0050f05cf2d0" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:44:07 user nova-compute[73449]: DEBUG nova.network.neutron [req-597f1fcd-6a6a-44cf-9102-ed8095909390 req-f67db894-4545-4322-90a4-82f062213f43 service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Refreshing network info cache for port c877b9e9-f45c-4199-960c-2b9926518803 {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 11:44:07 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:08 user nova-compute[73449]: INFO nova.compute.manager [None req-6c0797a8-f86f-4b6b-82d3-d102d574dd63 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Rescuing
Aug 17 11:44:08 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6c0797a8-f86f-4b6b-82d3-d102d574dd63 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Acquiring lock "refresh_cache-a3523d22-7165-46ad-be10-5e6ae374f91d" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:44:08 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6c0797a8-f86f-4b6b-82d3-d102d574dd63 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Acquired lock "refresh_cache-a3523d22-7165-46ad-be10-5e6ae374f91d" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:44:08 user nova-compute[73449]: DEBUG nova.network.neutron [None req-6c0797a8-f86f-4b6b-82d3-d102d574dd63 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Building network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 11:44:08 user nova-compute[73449]: DEBUG nova.network.neutron [req-597f1fcd-6a6a-44cf-9102-ed8095909390 req-f67db894-4545-4322-90a4-82f062213f43 service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Updated VIF entry in instance network info cache for port c877b9e9-f45c-4199-960c-2b9926518803. {{(pid=73449) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 11:44:08 user nova-compute[73449]: DEBUG nova.network.neutron [req-597f1fcd-6a6a-44cf-9102-ed8095909390 req-f67db894-4545-4322-90a4-82f062213f43 service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Updating instance_info_cache with network_info: [{"id": "c877b9e9-f45c-4199-960c-2b9926518803", "address": "fa:16:3e:0d:7d:90", "network": {"id": "1596a923-35e5-45a5-85c8-5bae45f011b7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1809575924-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60c18371fa6246888a742164afd60242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc877b9e9-f4", "ovs_interfaceid": "c877b9e9-f45c-4199-960c-2b9926518803", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "71d82cc1-6895-4d52-b066-0a01a61b329b", "address": "fa:16:3e:48:bc:7c", "network": {"id": "2c2340dc-7ea1-4f63-8819-47844b2a536e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1423531895", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "60c18371fa6246888a742164afd60242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71d82cc1-68", "ovs_interfaceid": "71d82cc1-6895-4d52-b066-0a01a61b329b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b3fe8f9e-5b75-440e-b1c1-f888a4e91e9e", "address": "fa:16:3e:0e:2e:4c", "network": {"id": "2c2340dc-7ea1-4f63-8819-47844b2a536e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1423531895", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "60c18371fa6246888a742164afd60242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3fe8f9e-5b", "ovs_interfaceid": "b3fe8f9e-5b75-440e-b1c1-f888a4e91e9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f9c9fca3-8f9c-4ea9-8ceb-ed19cb265786", "address": "fa:16:3e:a2:22:da", "network": {"id": "2c2340dc-7ea1-4f63-8819-47844b2a536e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1423531895", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "60c18371fa6246888a742164afd60242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9c9fca3-8f", "ovs_interfaceid": "f9c9fca3-8f9c-4ea9-8ceb-ed19cb265786", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6888cb29-a1bc-42b0-bec3-57667e1b0350", "address": "fa:16:3e:6e:07:1b", "network": {"id": "2c2340dc-7ea1-4f63-8819-47844b2a536e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1423531895", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "60c18371fa6246888a742164afd60242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6888cb29-a1", "ovs_interfaceid": "6888cb29-a1bc-42b0-bec3-57667e1b0350", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d85896ce-110a-41d6-a20e-6beaecb36b97", "address": "fa:16:3e:e3:51:d1", "network": {"id": "8244e7f5-12cf-4ab5-baa2-956f148fc51f", "bridge": "br-int", "label": "tempest-device-tagging-net2-163620727", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "60c18371fa6246888a742164afd60242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd85896ce-11", "ovs_interfaceid": "d85896ce-110a-41d6-a20e-6beaecb36b97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "671f57db-57f1-4ba3-9e49-ebe4816404f6", "address": "fa:16:3e:04:1d:3e", "network": {"id": "8244e7f5-12cf-4ab5-baa2-956f148fc51f", "bridge": "br-int", "label": "tempest-device-tagging-net2-163620727", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "60c18371fa6246888a742164afd60242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap671f57db-57", "ovs_interfaceid": "671f57db-57f1-4ba3-9e49-ebe4816404f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:44:08 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-597f1fcd-6a6a-44cf-9102-ed8095909390 req-f67db894-4545-4322-90a4-82f062213f43 service nova] Releasing lock "refresh_cache-b8e1def1-8303-4257-b9b5-0050f05cf2d0" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:44:08 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:08 user nova-compute[73449]: DEBUG nova.network.neutron [None req-6c0797a8-f86f-4b6b-82d3-d102d574dd63 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Updating instance_info_cache with network_info: [{"id": "2a0eb61f-9398-4db6-9ae0-f142ad2e60c4", "address": "fa:16:3e:15:cd:09", "network": {"id": "d54a402f-1fa9-43d8-b68e-0aa7ae6f0e73", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1441085328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eed9899860d4e7ca8a4500bbda4be13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a0eb61f-93", "ovs_interfaceid": "2a0eb61f-9398-4db6-9ae0-f142ad2e60c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:44:08 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6c0797a8-f86f-4b6b-82d3-d102d574dd63 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Releasing lock "refresh_cache-a3523d22-7165-46ad-be10-5e6ae374f91d" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:44:09 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:09 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:09 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:09 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:09 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Instance destroyed successfully.
Aug 17 11:44:09 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-6c0797a8-f86f-4b6b-82d3-d102d574dd63 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Attempting a stable device rescue
Aug 17 11:44:10 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6c0797a8-f86f-4b6b-82d3-d102d574dd63 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=73449) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 17 11:44:10 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6c0797a8-f86f-4b6b-82d3-d102d574dd63 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Instance directory exists: not creating {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 17 11:44:10 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-6c0797a8-f86f-4b6b-82d3-d102d574dd63 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Creating image(s)
Aug 17 11:44:10 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6c0797a8-f86f-4b6b-82d3-d102d574dd63 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Acquiring lock "/opt/stack/data/nova/instances/a3523d22-7165-46ad-be10-5e6ae374f91d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:44:10 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6c0797a8-f86f-4b6b-82d3-d102d574dd63 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Lock "/opt/stack/data/nova/instances/a3523d22-7165-46ad-be10-5e6ae374f91d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.003s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:44:10 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6c0797a8-f86f-4b6b-82d3-d102d574dd63 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Lock "/opt/stack/data/nova/instances/a3523d22-7165-46ad-be10-5e6ae374f91d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:44:10 user nova-compute[73449]: DEBUG nova.objects.instance [None req-6c0797a8-f86f-4b6b-82d3-d102d574dd63 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Lazy-loading 'trusted_certs' on Instance uuid a3523d22-7165-46ad-be10-5e6ae374f91d {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:44:10 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6c0797a8-f86f-4b6b-82d3-d102d574dd63 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Acquiring lock "8745ad4a3db1ce3cd4c7565c7dd7f58f9138e816" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:44:10 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6c0797a8-f86f-4b6b-82d3-d102d574dd63 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Lock "8745ad4a3db1ce3cd4c7565c7dd7f58f9138e816" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:44:11 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6c0797a8-f86f-4b6b-82d3-d102d574dd63 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8745ad4a3db1ce3cd4c7565c7dd7f58f9138e816.part --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:44:11 user nova-compute[73449]: DEBUG nova.compute.manager [req-cccbf4be-7fdd-4266-a6d2-65fc08a74d60 req-5a37c55d-b41c-4cf1-9b4e-7ec172cbf0a2 service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Received event network-changed-d2d51361-0f1a-41aa-89e2-c2211bbd0b42 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:44:11 user nova-compute[73449]: DEBUG nova.compute.manager [req-cccbf4be-7fdd-4266-a6d2-65fc08a74d60 req-5a37c55d-b41c-4cf1-9b4e-7ec172cbf0a2 service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Refreshing instance network info cache due to event network-changed-d2d51361-0f1a-41aa-89e2-c2211bbd0b42. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 11:44:11 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-cccbf4be-7fdd-4266-a6d2-65fc08a74d60 req-5a37c55d-b41c-4cf1-9b4e-7ec172cbf0a2 service nova] Acquiring lock "refresh_cache-f33a7013-82d0-477c-aa5e-b27e63f2b98d" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:44:11 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-cccbf4be-7fdd-4266-a6d2-65fc08a74d60 req-5a37c55d-b41c-4cf1-9b4e-7ec172cbf0a2 service nova] Acquired lock "refresh_cache-f33a7013-82d0-477c-aa5e-b27e63f2b98d" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:44:11 user nova-compute[73449]: DEBUG nova.network.neutron [req-cccbf4be-7fdd-4266-a6d2-65fc08a74d60 req-5a37c55d-b41c-4cf1-9b4e-7ec172cbf0a2 service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Refreshing network info cache for port d2d51361-0f1a-41aa-89e2-c2211bbd0b42 {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 11:44:11 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-4b0ec35b-339a-4406-b9b2-e0ee3e20a645 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Acquiring lock "b8e1def1-8303-4257-b9b5-0050f05cf2d0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:44:11 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-4b0ec35b-339a-4406-b9b2-e0ee3e20a645 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Lock "b8e1def1-8303-4257-b9b5-0050f05cf2d0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:44:11 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-4b0ec35b-339a-4406-b9b2-e0ee3e20a645 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Acquiring lock "b8e1def1-8303-4257-b9b5-0050f05cf2d0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:44:11 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-4b0ec35b-339a-4406-b9b2-e0ee3e20a645 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Lock "b8e1def1-8303-4257-b9b5-0050f05cf2d0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:44:11 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-4b0ec35b-339a-4406-b9b2-e0ee3e20a645 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Lock "b8e1def1-8303-4257-b9b5-0050f05cf2d0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:44:11 user nova-compute[73449]: INFO nova.compute.manager [None req-4b0ec35b-339a-4406-b9b2-e0ee3e20a645 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Terminating instance
Aug 17 11:44:11 user nova-compute[73449]: DEBUG nova.compute.manager [None req-4b0ec35b-339a-4406-b9b2-e0ee3e20a645 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Start destroying the instance on the hypervisor. {{(pid=73449) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 11:44:11 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:11 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6c0797a8-f86f-4b6b-82d3-d102d574dd63 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8745ad4a3db1ce3cd4c7565c7dd7f58f9138e816.part --force-share --output=json" returned: 0 in 0.242s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:44:11 user nova-compute[73449]: DEBUG nova.virt.images [None req-6c0797a8-f86f-4b6b-82d3-d102d574dd63 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] 91fed265-1b60-41ac-bf73-39292d59e614 was qcow2, converting to raw {{(pid=73449) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 17 11:44:11 user nova-compute[73449]: DEBUG nova.privsep.utils [None req-6c0797a8-f86f-4b6b-82d3-d102d574dd63 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73449) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 11:44:11 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6c0797a8-f86f-4b6b-82d3-d102d574dd63 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8745ad4a3db1ce3cd4c7565c7dd7f58f9138e816.part /opt/stack/data/nova/instances/_base/8745ad4a3db1ce3cd4c7565c7dd7f58f9138e816.converted {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:44:11 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:11 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:11 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:11 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:12 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6c0797a8-f86f-4b6b-82d3-d102d574dd63 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8745ad4a3db1ce3cd4c7565c7dd7f58f9138e816.part /opt/stack/data/nova/instances/_base/8745ad4a3db1ce3cd4c7565c7dd7f58f9138e816.converted" returned: 0 in 0.334s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:44:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6c0797a8-f86f-4b6b-82d3-d102d574dd63 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8745ad4a3db1ce3cd4c7565c7dd7f58f9138e816.converted --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:44:12 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:12 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:12 user nova-compute[73449]: DEBUG nova.compute.manager [req-72da823c-b372-4c9f-a653-ca21906d8010 req-123be220-d533-4276-b35c-438cf3099028 service nova] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Received event network-vif-unplugged-2a0eb61f-9398-4db6-9ae0-f142ad2e60c4 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:44:12 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-72da823c-b372-4c9f-a653-ca21906d8010 req-123be220-d533-4276-b35c-438cf3099028 service nova] Acquiring lock "a3523d22-7165-46ad-be10-5e6ae374f91d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:44:12 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-72da823c-b372-4c9f-a653-ca21906d8010 req-123be220-d533-4276-b35c-438cf3099028 service nova] Lock "a3523d22-7165-46ad-be10-5e6ae374f91d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:44:12 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-72da823c-b372-4c9f-a653-ca21906d8010 req-123be220-d533-4276-b35c-438cf3099028 service nova] Lock "a3523d22-7165-46ad-be10-5e6ae374f91d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:44:12 user nova-compute[73449]: DEBUG nova.compute.manager [req-72da823c-b372-4c9f-a653-ca21906d8010 req-123be220-d533-4276-b35c-438cf3099028 service nova] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] No waiting events found dispatching network-vif-unplugged-2a0eb61f-9398-4db6-9ae0-f142ad2e60c4 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:44:12 user nova-compute[73449]: WARNING nova.compute.manager [req-72da823c-b372-4c9f-a653-ca21906d8010 req-123be220-d533-4276-b35c-438cf3099028 service nova] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Received unexpected event network-vif-unplugged-2a0eb61f-9398-4db6-9ae0-f142ad2e60c4 for instance with vm_state active and task_state rescuing.
Aug 17 11:44:12 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:12 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:12 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6c0797a8-f86f-4b6b-82d3-d102d574dd63 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8745ad4a3db1ce3cd4c7565c7dd7f58f9138e816.converted --force-share --output=json" returned: 0 in 0.252s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:44:12 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6c0797a8-f86f-4b6b-82d3-d102d574dd63 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Lock "8745ad4a3db1ce3cd4c7565c7dd7f58f9138e816" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.348s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:44:12 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6c0797a8-f86f-4b6b-82d3-d102d574dd63 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Acquiring lock "8745ad4a3db1ce3cd4c7565c7dd7f58f9138e816" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:44:12 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6c0797a8-f86f-4b6b-82d3-d102d574dd63 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Lock "8745ad4a3db1ce3cd4c7565c7dd7f58f9138e816" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:44:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6c0797a8-f86f-4b6b-82d3-d102d574dd63 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8745ad4a3db1ce3cd4c7565c7dd7f58f9138e816 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:44:12 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:12 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:12 user nova-compute[73449]: DEBUG nova.network.neutron [req-cccbf4be-7fdd-4266-a6d2-65fc08a74d60 req-5a37c55d-b41c-4cf1-9b4e-7ec172cbf0a2 service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Updated VIF entry in instance network info cache for port d2d51361-0f1a-41aa-89e2-c2211bbd0b42. {{(pid=73449) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 11:44:12 user nova-compute[73449]: DEBUG nova.network.neutron [req-cccbf4be-7fdd-4266-a6d2-65fc08a74d60 req-5a37c55d-b41c-4cf1-9b4e-7ec172cbf0a2 service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Updating instance_info_cache with network_info: [{"id": "d2d51361-0f1a-41aa-89e2-c2211bbd0b42", "address": "fa:16:3e:03:4e:88", "network": {"id": "0ff7c7f6-9609-4a35-8bb0-e8b83254f7f4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-803526263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92e6d918a4554cd89d9f40cee2a55d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2d51361-0f", "ovs_interfaceid": "d2d51361-0f1a-41aa-89e2-c2211bbd0b42", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b14f4f1d-d140-4bb9-a4f2-abbaa8c98a2d", "address": "fa:16:3e:32:bc:69", "network": {"id": "8de6c01b-e132-4efb-be00-df0968c06a81", "bridge": "br-int", "label": "tempest-device-tagging-net1-1740133735", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "92e6d918a4554cd89d9f40cee2a55d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb14f4f1d-d1", "ovs_interfaceid": "b14f4f1d-d140-4bb9-a4f2-abbaa8c98a2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d8233c69-cc4f-4ae8-93ee-7f41234f72ec", "address": "fa:16:3e:14:e4:e9", "network": {"id": "8de6c01b-e132-4efb-be00-df0968c06a81", "bridge": "br-int", "label": "tempest-device-tagging-net1-1740133735", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "92e6d918a4554cd89d9f40cee2a55d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8233c69-cc", "ovs_interfaceid": "d8233c69-cc4f-4ae8-93ee-7f41234f72ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6fbc9ad6-da42-4492-8603-9efc7294dbab", "address": "fa:16:3e:a7:14:03", "network": {"id": "8de6c01b-e132-4efb-be00-df0968c06a81", "bridge": "br-int", "label": "tempest-device-tagging-net1-1740133735", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "92e6d918a4554cd89d9f40cee2a55d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fbc9ad6-da", "ovs_interfaceid": "6fbc9ad6-da42-4492-8603-9efc7294dbab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "854609a6-03f0-416c-8bbf-b5f85d13c688", "address": "fa:16:3e:09:0d:df", "network": {"id": "8de6c01b-e132-4efb-be00-df0968c06a81", "bridge": "br-int", "label": "tempest-device-tagging-net1-1740133735", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "92e6d918a4554cd89d9f40cee2a55d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap854609a6-03", "ovs_interfaceid": "854609a6-03f0-416c-8bbf-b5f85d13c688", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f04e7eb7-1170-4981-b342-44c664ef4c84", "address": "fa:16:3e:89:ce:7a", "network": {"id": "468865fb-36d1-436e-8fea-5f633edff84a", "bridge": "br-int", "label": "tempest-device-tagging-net2-251570535", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "92e6d918a4554cd89d9f40cee2a55d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf04e7eb7-11", "ovs_interfaceid": "f04e7eb7-1170-4981-b342-44c664ef4c84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c69d3b48-1443-4999-8369-8c5f61b35697", "address": "fa:16:3e:ec:95:94", "network": {"id": "468865fb-36d1-436e-8fea-5f633edff84a", "bridge": "br-int", "label": "tempest-device-tagging-net2-251570535", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "92e6d918a4554cd89d9f40cee2a55d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc69d3b48-14", "ovs_interfaceid": "c69d3b48-1443-4999-8369-8c5f61b35697", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:44:12 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:12 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-cccbf4be-7fdd-4266-a6d2-65fc08a74d60 req-5a37c55d-b41c-4cf1-9b4e-7ec172cbf0a2 service nova] Releasing lock "refresh_cache-f33a7013-82d0-477c-aa5e-b27e63f2b98d" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:44:12 user nova-compute[73449]: DEBUG nova.compute.manager [req-13867b58-a1f1-4815-a4b8-053d609cb700 req-fd21fa36-79d0-4636-9d4e-029cd848904a service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Received event network-vif-unplugged-71d82cc1-6895-4d52-b066-0a01a61b329b {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:44:12 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-13867b58-a1f1-4815-a4b8-053d609cb700 req-fd21fa36-79d0-4636-9d4e-029cd848904a service nova] Acquiring lock "b8e1def1-8303-4257-b9b5-0050f05cf2d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:44:12 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-13867b58-a1f1-4815-a4b8-053d609cb700 req-fd21fa36-79d0-4636-9d4e-029cd848904a service nova] Lock "b8e1def1-8303-4257-b9b5-0050f05cf2d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:44:12 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-13867b58-a1f1-4815-a4b8-053d609cb700 req-fd21fa36-79d0-4636-9d4e-029cd848904a service nova] Lock "b8e1def1-8303-4257-b9b5-0050f05cf2d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:44:12 user nova-compute[73449]: DEBUG nova.compute.manager [req-13867b58-a1f1-4815-a4b8-053d609cb700 req-fd21fa36-79d0-4636-9d4e-029cd848904a service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] No waiting events found dispatching network-vif-unplugged-71d82cc1-6895-4d52-b066-0a01a61b329b {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:44:12 user nova-compute[73449]: DEBUG nova.compute.manager [req-13867b58-a1f1-4815-a4b8-053d609cb700 req-fd21fa36-79d0-4636-9d4e-029cd848904a service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Received event network-vif-unplugged-71d82cc1-6895-4d52-b066-0a01a61b329b for instance with task_state deleting. {{(pid=73449) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 11:44:12 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6c0797a8-f86f-4b6b-82d3-d102d574dd63 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8745ad4a3db1ce3cd4c7565c7dd7f58f9138e816 --force-share --output=json" returned: 0 in 0.215s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:44:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6c0797a8-f86f-4b6b-82d3-d102d574dd63 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8745ad4a3db1ce3cd4c7565c7dd7f58f9138e816,backing_fmt=raw /opt/stack/data/nova/instances/a3523d22-7165-46ad-be10-5e6ae374f91d/disk.rescue {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:44:12 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6c0797a8-f86f-4b6b-82d3-d102d574dd63 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8745ad4a3db1ce3cd4c7565c7dd7f58f9138e816,backing_fmt=raw /opt/stack/data/nova/instances/a3523d22-7165-46ad-be10-5e6ae374f91d/disk.rescue" returned: 0 in 0.058s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:44:12 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6c0797a8-f86f-4b6b-82d3-d102d574dd63 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Lock "8745ad4a3db1ce3cd4c7565c7dd7f58f9138e816" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.278s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:44:12 user nova-compute[73449]: DEBUG nova.objects.instance [None req-6c0797a8-f86f-4b6b-82d3-d102d574dd63 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Lazy-loading 'migration_context' on Instance uuid a3523d22-7165-46ad-be10-5e6ae374f91d {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:44:12 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6c0797a8-f86f-4b6b-82d3-d102d574dd63 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Created local disks {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 11:44:12 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6c0797a8-f86f-4b6b-82d3-d102d574dd63 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Start _get_guest_xml network_info=[{"id": "2a0eb61f-9398-4db6-9ae0-f142ad2e60c4", "address": "fa:16:3e:15:cd:09", "network": {"id": "d54a402f-1fa9-43d8-b68e-0aa7ae6f0e73", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1441085328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1441085328-network", "vif_mac": "fa:16:3e:15:cd:09"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eed9899860d4e7ca8a4500bbda4be13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a0eb61f-93", "ovs_interfaceid": "2a0eb61f-9398-4db6-9ae0-f142ad2e60c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T11:36:11Z,direct_url=<?>,disk_format='qcow2',id=0a2904ae-083d-41c8-83db-343132b36148,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7a77880136a54ef195c82e018e1939db',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T11:36:13Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '91fed265-1b60-41ac-bf73-39292d59e614', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': '0a2904ae-083d-41c8-83db-343132b36148'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'attachment_id': 'ab88735d-5dae-430b-bf21-0af4e18f0b1f', 'boot_index': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QsgWpRYJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, 'status': 'reserved', 'instance': 'a3523d22-7165-46ad-be10-5e6ae374f91d', 'attached_at': '', 'detached_at': '', 'volume_id': 'c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe', 'serial': 'c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe'}, 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 11:44:12 user nova-compute[73449]: DEBUG nova.objects.instance [None req-6c0797a8-f86f-4b6b-82d3-d102d574dd63 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Lazy-loading 'resources' on Instance uuid a3523d22-7165-46ad-be10-5e6ae374f91d {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:44:12 user nova-compute[73449]: DEBUG nova.objects.instance [None req-6c0797a8-f86f-4b6b-82d3-d102d574dd63 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Lazy-loading 'numa_topology' on Instance uuid a3523d22-7165-46ad-be10-5e6ae374f91d {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:44:12 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:12 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-6c0797a8-f86f-4b6b-82d3-d102d574dd63 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:44:12 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-6c0797a8-f86f-4b6b-82d3-d102d574dd63 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:44:12 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-6c0797a8-f86f-4b6b-82d3-d102d574dd63 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 11:44:12 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-6c0797a8-f86f-4b6b-82d3-d102d574dd63 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] CPU controller missing on host. {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 11:44:12 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-6c0797a8-f86f-4b6b-82d3-d102d574dd63 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 11:44:12 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-6c0797a8-f86f-4b6b-82d3-d102d574dd63 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] CPU controller found on host. {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 11:44:12 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6c0797a8-f86f-4b6b-82d3-d102d574dd63 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73449) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 11:44:12 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-6c0797a8-f86f-4b6b-82d3-d102d574dd63 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T11:35:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T11:36:11Z,direct_url=<?>,disk_format='qcow2',id=0a2904ae-083d-41c8-83db-343132b36148,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7a77880136a54ef195c82e018e1939db',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T11:36:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 11:44:12 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-6c0797a8-f86f-4b6b-82d3-d102d574dd63 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Flavor limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 11:44:12 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-6c0797a8-f86f-4b6b-82d3-d102d574dd63 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Image limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 11:44:12 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-6c0797a8-f86f-4b6b-82d3-d102d574dd63 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Flavor pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 11:44:12 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-6c0797a8-f86f-4b6b-82d3-d102d574dd63 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Image pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 11:44:12 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-6c0797a8-f86f-4b6b-82d3-d102d574dd63 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 11:44:12 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-6c0797a8-f86f-4b6b-82d3-d102d574dd63 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 11:44:12 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-6c0797a8-f86f-4b6b-82d3-d102d574dd63 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 11:44:12 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-6c0797a8-f86f-4b6b-82d3-d102d574dd63 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Got 1 possible topologies {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 11:44:12 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-6c0797a8-f86f-4b6b-82d3-d102d574dd63 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 11:44:12 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-6c0797a8-f86f-4b6b-82d3-d102d574dd63 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 11:44:12 user nova-compute[73449]: DEBUG nova.objects.instance [None req-6c0797a8-f86f-4b6b-82d3-d102d574dd63 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Lazy-loading 'vcpu_model' on Instance uuid a3523d22-7165-46ad-be10-5e6ae374f91d {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:44:12 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c0797a8-f86f-4b6b-82d3-d102d574dd63 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Calling os-brick to attach iSCSI Volume {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 11:44:12 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c0797a8-f86f-4b6b-82d3-d102d574dd63 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QsgWpRYJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 11:44:12 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-6c0797a8-f86f-4b6b-82d3-d102d574dd63 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 11:44:12 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-6c0797a8-f86f-4b6b-82d3-d102d574dd63 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:44:12 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-6c0797a8-f86f-4b6b-82d3-d102d574dd63 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:44:12 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-6c0797a8-f86f-4b6b-82d3-d102d574dd63 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 11:44:12 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-6c0797a8-f86f-4b6b-82d3-d102d574dd63 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:44:12 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-6c0797a8-f86f-4b6b-82d3-d102d574dd63 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:44:12 user nova-compute[73449]: INFO os_brick.initiator.connectors.iscsi [None req-6c0797a8-f86f-4b6b-82d3-d102d574dd63 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 11:44:12 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe -p 172.16.0.220:3260 {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:44:12 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe -p 172.16.0.220:3260" returned: 0 in 0.024s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:44:12 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[dffff676-80f5-4da0-8f0e-d944280f5db3]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = QsgWpRYJ\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:44:12 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c0797a8-f86f-4b6b-82d3-d102d574dd63 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 17 11:44:12 user nova-compute[73449]: node.name = iqn.2010-10.org.openstack:c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe
Aug 17 11:44:12 user nova-compute[73449]: node.tpgt = -1
Aug 17 11:44:12 user nova-compute[73449]: node.startup = automatic
Aug 17 11:44:12 user nova-compute[73449]: node.leading_login = No
Aug 17 11:44:12 user nova-compute[73449]: iface.iscsi_ifacename = default
Aug 17 11:44:12 user nova-compute[73449]: iface.net_ifacename = <empty>
Aug 17 11:44:12 user nova-compute[73449]: iface.ipaddress = <empty>
Aug 17 11:44:12 user nova-compute[73449]: iface.prefix_len = 0
Aug 17 11:44:12 user nova-compute[73449]: iface.hwaddress = <empty>
Aug 17 11:44:12 user nova-compute[73449]: iface.transport_name = tcp
Aug 17 11:44:12 user nova-compute[73449]: iface.initiatorname = <empty>
Aug 17 11:44:12 user nova-compute[73449]: iface.state = <empty>
Aug 17 11:44:12 user nova-compute[73449]: iface.vlan_id = 0
Aug 17 11:44:12 user nova-compute[73449]: iface.vlan_priority = 0
Aug 17 11:44:12 user nova-compute[73449]: iface.vlan_state = <empty>
Aug 17 11:44:12 user nova-compute[73449]: iface.iface_num = 0
Aug 17 11:44:12 user nova-compute[73449]: iface.mtu = 0
Aug 17 11:44:12 user nova-compute[73449]: iface.port = 0
Aug 17 11:44:12 user nova-compute[73449]: iface.bootproto = <empty>
Aug 17 11:44:12 user nova-compute[73449]: iface.subnet_mask = <empty>
Aug 17 11:44:12 user nova-compute[73449]: iface.gateway = <empty>
Aug 17 11:44:12 user nova-compute[73449]: iface.dhcp_alt_client_id_state = <empty>
Aug 17 11:44:12 user nova-compute[73449]: iface.dhcp_alt_client_id = <empty>
Aug 17 11:44:12 user nova-compute[73449]: iface.dhcp_dns = <empty>
Aug 17 11:44:12 user nova-compute[73449]: iface.dhcp_learn_iqn = <empty>
Aug 17 11:44:12 user nova-compute[73449]: iface.dhcp_req_vendor_id_state = <empty>
Aug 17 11:44:12 user nova-compute[73449]: iface.dhcp_vendor_id_state = <empty>
Aug 17 11:44:12 user nova-compute[73449]: iface.dhcp_vendor_id = <empty>
Aug 17 11:44:12 user nova-compute[73449]: iface.dhcp_slp_da = <empty>
Aug 17 11:44:12 user nova-compute[73449]: iface.fragmentation = <empty>
Aug 17 11:44:12 user nova-compute[73449]: iface.gratuitous_arp = <empty>
Aug 17 11:44:12 user nova-compute[73449]: iface.incoming_forwarding = <empty>
Aug 17 11:44:12 user nova-compute[73449]: iface.tos_state = <empty>
Aug 17 11:44:12 user nova-compute[73449]: iface.tos = 0
Aug 17 11:44:12 user nova-compute[73449]: iface.ttl = 0
Aug 17 11:44:12 user nova-compute[73449]: iface.delayed_ack = <empty>
Aug 17 11:44:12 user nova-compute[73449]: iface.tcp_nagle = <empty>
Aug 17 11:44:12 user nova-compute[73449]: iface.tcp_wsf_state = <empty>
Aug 17 11:44:12 user nova-compute[73449]: iface.tcp_wsf = 0
Aug 17 11:44:12 user nova-compute[73449]: iface.tcp_timer_scale = 0
Aug 17 11:44:12 user nova-compute[73449]: iface.tcp_timestamp = <empty>
Aug 17 11:44:12 user nova-compute[73449]: iface.redirect = <empty>
Aug 17 11:44:12 user nova-compute[73449]: iface.def_task_mgmt_timeout = 0
Aug 17 11:44:12 user nova-compute[73449]: iface.header_digest = <empty>
Aug 17 11:44:12 user nova-compute[73449]: iface.data_digest = <empty>
Aug 17 11:44:12 user nova-compute[73449]: iface.immediate_data = <empty>
Aug 17 11:44:12 user nova-compute[73449]: iface.initial_r2t = <empty>
Aug 17 11:44:12 user nova-compute[73449]: iface.data_seq_inorder = <empty>
Aug 17 11:44:12 user nova-compute[73449]: iface.data_pdu_inorder = <empty>
Aug 17 11:44:12 user nova-compute[73449]: iface.erl = 0
Aug 17 11:44:12 user nova-compute[73449]: iface.max_receive_data_len = 0
Aug 17 11:44:12 user nova-compute[73449]: iface.first_burst_len = 0
Aug 17 11:44:12 user nova-compute[73449]: iface.max_outstanding_r2t = 0
Aug 17 11:44:12 user nova-compute[73449]: iface.max_burst_len = 0
Aug 17 11:44:12 user nova-compute[73449]: iface.chap_auth = <empty>
Aug 17 11:44:12 user nova-compute[73449]: iface.bidi_chap = <empty>
Aug 17 11:44:12 user nova-compute[73449]: iface.strict_login_compliance = <empty>
Aug 17 11:44:12 user nova-compute[73449]: iface.discovery_auth = <empty>
Aug 17 11:44:12 user nova-compute[73449]: iface.discovery_logout = <empty>
Aug 17 11:44:12 user nova-compute[73449]: node.discovery_address = <empty>
Aug 17 11:44:12 user nova-compute[73449]: node.discovery_port = 0
Aug 17 11:44:12 user nova-compute[73449]: node.discovery_type = static
Aug 17 11:44:12 user nova-compute[73449]: node.session.initial_cmdsn = 0
Aug 17 11:44:12 user nova-compute[73449]: node.session.initial_login_retry_max = 8
Aug 17 11:44:12 user nova-compute[73449]: node.session.xmit_thread_priority = -20
Aug 17 11:44:12 user nova-compute[73449]: node.session.cmds_max = 128
Aug 17 11:44:12 user nova-compute[73449]: node.session.queue_depth = 32
Aug 17 11:44:12 user nova-compute[73449]: node.session.nr_sessions = 1
Aug 17 11:44:12 user nova-compute[73449]: node.session.auth.authmethod = CHAP
Aug 17 11:44:12 user nova-compute[73449]: node.session.auth.username = QsgWpRYJ
Aug 17 11:44:12 user nova-compute[73449]: node.session.auth.password = ***
Aug 17 11:44:12 user nova-compute[73449]: node.session.auth.username_in = <empty>
Aug 17 11:44:12 user nova-compute[73449]: node.session.auth.password_in = <empty>
Aug 17 11:44:12 user nova-compute[73449]: node.session.auth.chap_algs = MD5
Aug 17 11:44:12 user nova-compute[73449]: node.session.timeo.replacement_timeout = 120
Aug 17 11:44:12 user nova-compute[73449]: node.session.err_timeo.abort_timeout = 15
Aug 17 11:44:12 user nova-compute[73449]: node.session.err_timeo.lu_reset_timeout = 30
Aug 17 11:44:12 user nova-compute[73449]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 17 11:44:12 user nova-compute[73449]: node.session.err_timeo.host_reset_timeout = 60
Aug 17 11:44:12 user nova-compute[73449]: node.session.iscsi.FastAbort = Yes
Aug 17 11:44:12 user nova-compute[73449]: node.session.iscsi.InitialR2T = No
Aug 17 11:44:12 user nova-compute[73449]: node.session.iscsi.ImmediateData = Yes
Aug 17 11:44:12 user nova-compute[73449]: node.session.iscsi.FirstBurstLength = 262144
Aug 17 11:44:12 user nova-compute[73449]: node.session.iscsi.MaxBurstLength = 16776192
Aug 17 11:44:12 user nova-compute[73449]: node.session.iscsi.DefaultTime2Retain = 0
Aug 17 11:44:12 user nova-compute[73449]: node.session.iscsi.DefaultTime2Wait = 2
Aug 17 11:44:12 user nova-compute[73449]: node.session.iscsi.MaxConnections = 1
Aug 17 11:44:12 user nova-compute[73449]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 17 11:44:12 user nova-compute[73449]: node.session.iscsi.ERL = 0
Aug 17 11:44:12 user nova-compute[73449]: node.session.scan = manual
Aug 17 11:44:12 user nova-compute[73449]: node.session.reopen_max = 0
Aug 17 11:44:12 user nova-compute[73449]: node.conn[0].address = 172.16.0.220
Aug 17 11:44:12 user nova-compute[73449]: node.conn[0].port = 3260
Aug 17 11:44:12 user nova-compute[73449]: node.conn[0].startup = manual
Aug 17 11:44:12 user nova-compute[73449]: node.conn[0].tcp.window_size = 524288
Aug 17 11:44:12 user nova-compute[73449]: node.conn[0].tcp.type_of_service = 0
Aug 17 11:44:12 user nova-compute[73449]: node.conn[0].timeo.logout_timeout = 15
Aug 17 11:44:12 user nova-compute[73449]: node.conn[0].timeo.login_timeout = 15
Aug 17 11:44:12 user nova-compute[73449]: node.conn[0].timeo.auth_timeout = 45
Aug 17 11:44:12 user nova-compute[73449]: node.conn[0].timeo.noop_out_interval = 5
Aug 17 11:44:12 user nova-compute[73449]: node.conn[0].timeo.noop_out_timeout = 5
Aug 17 11:44:12 user nova-compute[73449]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 17 11:44:12 user nova-compute[73449]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 17 11:44:12 user nova-compute[73449]: node.conn[0].iscsi.HeaderDigest = None
Aug 17 11:44:12 user nova-compute[73449]: node.conn[0].iscsi.DataDigest = None
Aug 17 11:44:12 user nova-compute[73449]: node.conn[0].iscsi.IFMarker = No
Aug 17 11:44:12 user nova-compute[73449]: node.conn[0].iscsi.OFMarker = No
Aug 17 11:44:12 user nova-compute[73449]: # END RECORD
Aug 17 11:44:12 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:44:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:44:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:44:12 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e39e6df-343d-4147-a23b-1ad0afdafa3a]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:44:12 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c0797a8-f86f-4b6b-82d3-d102d574dd63 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:44:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:44:13 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:44:13 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[81beb290-486f-41c7-adcf-bc899c1cb115]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:44:13 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c0797a8-f86f-4b6b-82d3-d102d574dd63 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:44:13 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QsgWpRYJ {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:44:13 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QsgWpRYJ" returned: 0 in 0.025s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:44:13 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[31c757df-afaf-43af-809e-88b0b810a0e9]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:44:13 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c0797a8-f86f-4b6b-82d3-d102d574dd63 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QsgWpRYJ'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:44:13 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:44:13 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.034s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:44:13 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[55f73948-ee29-439b-80e1-6a55797f4693]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:44:13 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c0797a8-f86f-4b6b-82d3-d102d574dd63 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:44:13 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:44:13 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:13 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:44:13 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[49c10319-7c5e-4d9b-bb3d-f9c7512b9d35]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:44:13 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c0797a8-f86f-4b6b-82d3-d102d574dd63 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe (non-flash)
Aug 17 11:44:13 user nova-compute[73449]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919 (non-flash)
Aug 17 11:44:13 user nova-compute[73449]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47 (non-flash)
Aug 17 11:44:13 user nova-compute[73449]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda (non-flash)
Aug 17 11:44:13 user nova-compute[73449]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e (non-flash)
Aug 17 11:44:13 user nova-compute[73449]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff (non-flash)
Aug 17 11:44:13 user nova-compute[73449]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd (non-flash)
Aug 17 11:44:13 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:44:13 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c0797a8-f86f-4b6b-82d3-d102d574dd63 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe (non-flash)
Aug 17 11:44:13 user nova-compute[73449]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919 (non-flash)
Aug 17 11:44:13 user nova-compute[73449]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47 (non-flash)
Aug 17 11:44:13 user nova-compute[73449]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda (non-flash)
Aug 17 11:44:13 user nova-compute[73449]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e (non-flash)
Aug 17 11:44:13 user nova-compute[73449]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff (non-flash)
Aug 17 11:44:13 user nova-compute[73449]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd (non-flash)
Aug 17 11:44:13 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:44:13 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-6c0797a8-f86f-4b6b-82d3-d102d574dd63 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.224s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:44:13 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c0797a8-f86f-4b6b-82d3-d102d574dd63 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Connected to 172.16.0.220:3260 {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 11:44:13 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-6c0797a8-f86f-4b6b-82d3-d102d574dd63 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] HCTL ('39', '0', '0', 0) found on session 15 with lun 0 {{(pid=73449) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 11:44:13 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-6c0797a8-f86f-4b6b-82d3-d102d574dd63 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Scanning host 39 c: 0, t: 0, l: 0) {{(pid=73449) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 11:44:13 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:13 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:44:13 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.021s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:44:13 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[18b03be7-5856-4388-ab89-0647ba3530f3]: (4, ('0 0 0', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:44:13 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-6c0797a8-f86f-4b6b-82d3-d102d574dd63 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Searching for a device in session 15 and hctl ('39', '0', '0', 0) yield: sdh {{(pid=73449) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 11:44:13 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c0797a8-f86f-4b6b-82d3-d102d574dd63 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QsgWpRYJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 11:44:13 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-6c0797a8-f86f-4b6b-82d3-d102d574dd63 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.262s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:44:13 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c0797a8-f86f-4b6b-82d3-d102d574dd63 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] <== connect_volume: return (264ms) {'type': 'block', 'scsi_wwn': '23030353761656662', 'path': '/dev/sdh'} {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 11:44:13 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c0797a8-f86f-4b6b-82d3-d102d574dd63 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23030353761656662', 'path': '/dev/sdh'} {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 11:44:13 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-6c0797a8-f86f-4b6b-82d3-d102d574dd63 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:40:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1694310922',display_name='tempest-ServerStableDeviceRescueTest-server-1694310922',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1694310922',id=3,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHtRTrQb6UH8zrb1TbmYhNcUUKT9x8E5WNd+hiFJcSJTxxGQa8gp0XBdyZFjt5NbH6w45uBC2lCrVZUblWmjSKUPuTRaSHQWpvcVWlL40C4ztfmmZssisFEp6QhzuuUl/g==',key_name='tempest-keypair-75432170',keypairs=<?>,launch_index=0,launched_at=2023-08-17T11:40:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9eed9899860d4e7ca8a4500bbda4be13',ramdisk_id='',reservation_id='r-rl7fxx5l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-2093936836',owner_user_name='tempest-ServerStableDeviceRescueTest-2093936836-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T11:42:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d01f62699d2648cfa940fd73d9a82dbe',uuid=a3523d22-7165-46ad-be10-5e6ae374f91d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2a0eb61f-9398-4db6-9ae0-f142ad2e60c4", "address": "fa:16:3e:15:cd:09", "network": {"id": "d54a402f-1fa9-43d8-b68e-0aa7ae6f0e73", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1441085328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1441085328-network", "vif_mac": "fa:16:3e:15:cd:09"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eed9899860d4e7ca8a4500bbda4be13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a0eb61f-93", "ovs_interfaceid": "2a0eb61f-9398-4db6-9ae0-f142ad2e60c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73449) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 11:44:13 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-6c0797a8-f86f-4b6b-82d3-d102d574dd63 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Converting VIF {"id": "2a0eb61f-9398-4db6-9ae0-f142ad2e60c4", "address": "fa:16:3e:15:cd:09", "network": {"id": "d54a402f-1fa9-43d8-b68e-0aa7ae6f0e73", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1441085328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1441085328-network", "vif_mac": "fa:16:3e:15:cd:09"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eed9899860d4e7ca8a4500bbda4be13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a0eb61f-93", "ovs_interfaceid": "2a0eb61f-9398-4db6-9ae0-f142ad2e60c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:44:13 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-6c0797a8-f86f-4b6b-82d3-d102d574dd63 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:15:cd:09,bridge_name='br-int',has_traffic_filtering=True,id=2a0eb61f-9398-4db6-9ae0-f142ad2e60c4,network=Network(d54a402f-1fa9-43d8-b68e-0aa7ae6f0e73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a0eb61f-93') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:44:13 user nova-compute[73449]: DEBUG nova.objects.instance [None req-6c0797a8-f86f-4b6b-82d3-d102d574dd63 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Lazy-loading 'pci_devices' on Instance uuid a3523d22-7165-46ad-be10-5e6ae374f91d {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:44:13 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:13 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6c0797a8-f86f-4b6b-82d3-d102d574dd63 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] End _get_guest_xml xml=<domain type="kvm">
Aug 17 11:44:13 user nova-compute[73449]:   <uuid>a3523d22-7165-46ad-be10-5e6ae374f91d</uuid>
Aug 17 11:44:13 user nova-compute[73449]:   <name>instance-00000003</name>
Aug 17 11:44:13 user nova-compute[73449]:   <memory>524288</memory>
Aug 17 11:44:13 user nova-compute[73449]:   <vcpu>1</vcpu>
Aug 17 11:44:13 user nova-compute[73449]:   <metadata>
Aug 17 11:44:13 user nova-compute[73449]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 11:44:13 user nova-compute[73449]:       <nova:package version="0.0.0"/>
Aug 17 11:44:13 user nova-compute[73449]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1694310922</nova:name>
Aug 17 11:44:13 user nova-compute[73449]:       <nova:creationTime>2023-08-17 11:44:12</nova:creationTime>
Aug 17 11:44:13 user nova-compute[73449]:       <nova:flavor name="m1.tiny">
Aug 17 11:44:13 user nova-compute[73449]:         <nova:memory>512</nova:memory>
Aug 17 11:44:13 user nova-compute[73449]:         <nova:disk>1</nova:disk>
Aug 17 11:44:13 user nova-compute[73449]:         <nova:swap>0</nova:swap>
Aug 17 11:44:13 user nova-compute[73449]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 11:44:13 user nova-compute[73449]:         <nova:vcpus>1</nova:vcpus>
Aug 17 11:44:13 user nova-compute[73449]:       </nova:flavor>
Aug 17 11:44:13 user nova-compute[73449]:       <nova:owner>
Aug 17 11:44:13 user nova-compute[73449]:         <nova:user uuid="d01f62699d2648cfa940fd73d9a82dbe">tempest-ServerStableDeviceRescueTest-2093936836-project-member</nova:user>
Aug 17 11:44:13 user nova-compute[73449]:         <nova:project uuid="9eed9899860d4e7ca8a4500bbda4be13">tempest-ServerStableDeviceRescueTest-2093936836</nova:project>
Aug 17 11:44:13 user nova-compute[73449]:       </nova:owner>
Aug 17 11:44:13 user nova-compute[73449]:       <nova:root type="image" uuid="0a2904ae-083d-41c8-83db-343132b36148"/>
Aug 17 11:44:13 user nova-compute[73449]:       <nova:ports>
Aug 17 11:44:13 user nova-compute[73449]:         <nova:port uuid="2a0eb61f-9398-4db6-9ae0-f142ad2e60c4">
Aug 17 11:44:13 user nova-compute[73449]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 17 11:44:13 user nova-compute[73449]:         </nova:port>
Aug 17 11:44:13 user nova-compute[73449]:       </nova:ports>
Aug 17 11:44:13 user nova-compute[73449]:     </nova:instance>
Aug 17 11:44:13 user nova-compute[73449]:   </metadata>
Aug 17 11:44:13 user nova-compute[73449]:   <sysinfo type="smbios">
Aug 17 11:44:13 user nova-compute[73449]:     <system>
Aug 17 11:44:13 user nova-compute[73449]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 11:44:13 user nova-compute[73449]:       <entry name="product">OpenStack Nova</entry>
Aug 17 11:44:13 user nova-compute[73449]:       <entry name="version">0.0.0</entry>
Aug 17 11:44:13 user nova-compute[73449]:       <entry name="serial">a3523d22-7165-46ad-be10-5e6ae374f91d</entry>
Aug 17 11:44:13 user nova-compute[73449]:       <entry name="uuid">a3523d22-7165-46ad-be10-5e6ae374f91d</entry>
Aug 17 11:44:13 user nova-compute[73449]:       <entry name="family">Virtual Machine</entry>
Aug 17 11:44:13 user nova-compute[73449]:     </system>
Aug 17 11:44:13 user nova-compute[73449]:   </sysinfo>
Aug 17 11:44:13 user nova-compute[73449]:   <os>
Aug 17 11:44:13 user nova-compute[73449]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 11:44:13 user nova-compute[73449]:     <smbios mode="sysinfo"/>
Aug 17 11:44:13 user nova-compute[73449]:   </os>
Aug 17 11:44:13 user nova-compute[73449]:   <features>
Aug 17 11:44:13 user nova-compute[73449]:     <acpi/>
Aug 17 11:44:13 user nova-compute[73449]:     <apic/>
Aug 17 11:44:13 user nova-compute[73449]:     <vmcoreinfo/>
Aug 17 11:44:13 user nova-compute[73449]:   </features>
Aug 17 11:44:13 user nova-compute[73449]:   <clock offset="utc">
Aug 17 11:44:13 user nova-compute[73449]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 11:44:13 user nova-compute[73449]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 11:44:13 user nova-compute[73449]:     <timer name="hpet" present="no"/>
Aug 17 11:44:13 user nova-compute[73449]:   </clock>
Aug 17 11:44:13 user nova-compute[73449]:   <cpu mode="custom" match="exact">
Aug 17 11:44:13 user nova-compute[73449]:     <model>Nehalem</model>
Aug 17 11:44:13 user nova-compute[73449]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 11:44:13 user nova-compute[73449]:   </cpu>
Aug 17 11:44:13 user nova-compute[73449]:   <devices>
Aug 17 11:44:13 user nova-compute[73449]:     <disk type="file" device="disk">
Aug 17 11:44:13 user nova-compute[73449]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 11:44:13 user nova-compute[73449]:       <source file="/opt/stack/data/nova/instances/a3523d22-7165-46ad-be10-5e6ae374f91d/disk"/>
Aug 17 11:44:13 user nova-compute[73449]:       <target dev="vda" bus="virtio"/>
Aug 17 11:44:13 user nova-compute[73449]:     </disk>
Aug 17 11:44:13 user nova-compute[73449]:     <disk type="block" device="disk">
Aug 17 11:44:13 user nova-compute[73449]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 11:44:13 user nova-compute[73449]:       <source dev="/dev/sdh"/>
Aug 17 11:44:13 user nova-compute[73449]:       <target dev="vdb" bus="virtio"/>
Aug 17 11:44:13 user nova-compute[73449]:       <serial>c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe</serial>
Aug 17 11:44:13 user nova-compute[73449]:     </disk>
Aug 17 11:44:13 user nova-compute[73449]:     <disk type="file" device="disk">
Aug 17 11:44:13 user nova-compute[73449]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 11:44:13 user nova-compute[73449]:       <source file="/opt/stack/data/nova/instances/a3523d22-7165-46ad-be10-5e6ae374f91d/disk.rescue"/>
Aug 17 11:44:13 user nova-compute[73449]:       <target dev="vdc" bus="virtio"/>
Aug 17 11:44:13 user nova-compute[73449]:       <boot order="1"/>
Aug 17 11:44:13 user nova-compute[73449]:     </disk>
Aug 17 11:44:13 user nova-compute[73449]:     <interface type="ethernet">
Aug 17 11:44:13 user nova-compute[73449]:       <mac address="fa:16:3e:15:cd:09"/>
Aug 17 11:44:13 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 11:44:13 user nova-compute[73449]:       <mtu size="1442"/>
Aug 17 11:44:13 user nova-compute[73449]:       <target dev="tap2a0eb61f-93"/>
Aug 17 11:44:13 user nova-compute[73449]:     </interface>
Aug 17 11:44:13 user nova-compute[73449]:     <serial type="pty">
Aug 17 11:44:13 user nova-compute[73449]:       <log file="/opt/stack/data/nova/instances/a3523d22-7165-46ad-be10-5e6ae374f91d/console.log" append="off"/>
Aug 17 11:44:13 user nova-compute[73449]:     </serial>
Aug 17 11:44:13 user nova-compute[73449]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 11:44:13 user nova-compute[73449]:     <video>
Aug 17 11:44:13 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 11:44:13 user nova-compute[73449]:     </video>
Aug 17 11:44:13 user nova-compute[73449]:     <rng model="virtio">
Aug 17 11:44:13 user nova-compute[73449]:       <backend model="random">/dev/urandom</backend>
Aug 17 11:44:13 user nova-compute[73449]:     </rng>
Aug 17 11:44:13 user nova-compute[73449]:     <controller type="usb" index="0" model="none"/>
Aug 17 11:44:13 user nova-compute[73449]:     <memballoon model="virtio">
Aug 17 11:44:13 user nova-compute[73449]:       <stats period="10"/>
Aug 17 11:44:13 user nova-compute[73449]:     </memballoon>
Aug 17 11:44:13 user nova-compute[73449]:   </devices>
Aug 17 11:44:13 user nova-compute[73449]: </domain>
Aug 17 11:44:13 user nova-compute[73449]:  {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 11:44:13 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Instance destroyed successfully.
Aug 17 11:44:13 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6c0797a8-f86f-4b6b-82d3-d102d574dd63 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] No BDM found with device name vda, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 11:44:13 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6c0797a8-f86f-4b6b-82d3-d102d574dd63 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 11:44:13 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6c0797a8-f86f-4b6b-82d3-d102d574dd63 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 11:44:13 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6c0797a8-f86f-4b6b-82d3-d102d574dd63 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] No VIF found with MAC fa:16:3e:15:cd:09, not building metadata {{(pid=73449) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 11:44:13 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:14 user nova-compute[73449]: DEBUG nova.compute.manager [req-97a2b56f-b25a-48cc-9f9b-e27f5e7ee465 req-34bfbf5d-0dad-4350-8b37-cee6e2352999 service nova] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Received event network-vif-plugged-2a0eb61f-9398-4db6-9ae0-f142ad2e60c4 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:44:14 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-97a2b56f-b25a-48cc-9f9b-e27f5e7ee465 req-34bfbf5d-0dad-4350-8b37-cee6e2352999 service nova] Acquiring lock "a3523d22-7165-46ad-be10-5e6ae374f91d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:44:14 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-97a2b56f-b25a-48cc-9f9b-e27f5e7ee465 req-34bfbf5d-0dad-4350-8b37-cee6e2352999 service nova] Lock "a3523d22-7165-46ad-be10-5e6ae374f91d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:44:14 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-97a2b56f-b25a-48cc-9f9b-e27f5e7ee465 req-34bfbf5d-0dad-4350-8b37-cee6e2352999 service nova] Lock "a3523d22-7165-46ad-be10-5e6ae374f91d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:44:14 user nova-compute[73449]: DEBUG nova.compute.manager [req-97a2b56f-b25a-48cc-9f9b-e27f5e7ee465 req-34bfbf5d-0dad-4350-8b37-cee6e2352999 service nova] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] No waiting events found dispatching network-vif-plugged-2a0eb61f-9398-4db6-9ae0-f142ad2e60c4 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:44:14 user nova-compute[73449]: WARNING nova.compute.manager [req-97a2b56f-b25a-48cc-9f9b-e27f5e7ee465 req-34bfbf5d-0dad-4350-8b37-cee6e2352999 service nova] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Received unexpected event network-vif-plugged-2a0eb61f-9398-4db6-9ae0-f142ad2e60c4 for instance with vm_state active and task_state rescuing.
Aug 17 11:44:14 user nova-compute[73449]: DEBUG nova.compute.manager [req-97a2b56f-b25a-48cc-9f9b-e27f5e7ee465 req-34bfbf5d-0dad-4350-8b37-cee6e2352999 service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Received event network-vif-unplugged-c877b9e9-f45c-4199-960c-2b9926518803 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:44:14 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-97a2b56f-b25a-48cc-9f9b-e27f5e7ee465 req-34bfbf5d-0dad-4350-8b37-cee6e2352999 service nova] Acquiring lock "b8e1def1-8303-4257-b9b5-0050f05cf2d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:44:14 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-97a2b56f-b25a-48cc-9f9b-e27f5e7ee465 req-34bfbf5d-0dad-4350-8b37-cee6e2352999 service nova] Lock "b8e1def1-8303-4257-b9b5-0050f05cf2d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:44:14 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-97a2b56f-b25a-48cc-9f9b-e27f5e7ee465 req-34bfbf5d-0dad-4350-8b37-cee6e2352999 service nova] Lock "b8e1def1-8303-4257-b9b5-0050f05cf2d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:44:14 user nova-compute[73449]: DEBUG nova.compute.manager [req-97a2b56f-b25a-48cc-9f9b-e27f5e7ee465 req-34bfbf5d-0dad-4350-8b37-cee6e2352999 service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] No waiting events found dispatching network-vif-unplugged-c877b9e9-f45c-4199-960c-2b9926518803 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:44:14 user nova-compute[73449]: DEBUG nova.compute.manager [req-97a2b56f-b25a-48cc-9f9b-e27f5e7ee465 req-34bfbf5d-0dad-4350-8b37-cee6e2352999 service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Received event network-vif-unplugged-c877b9e9-f45c-4199-960c-2b9926518803 for instance with task_state deleting. {{(pid=73449) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 11:44:14 user nova-compute[73449]: DEBUG nova.compute.manager [req-97a2b56f-b25a-48cc-9f9b-e27f5e7ee465 req-34bfbf5d-0dad-4350-8b37-cee6e2352999 service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Received event network-vif-plugged-c877b9e9-f45c-4199-960c-2b9926518803 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:44:14 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-97a2b56f-b25a-48cc-9f9b-e27f5e7ee465 req-34bfbf5d-0dad-4350-8b37-cee6e2352999 service nova] Acquiring lock "b8e1def1-8303-4257-b9b5-0050f05cf2d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:44:14 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-97a2b56f-b25a-48cc-9f9b-e27f5e7ee465 req-34bfbf5d-0dad-4350-8b37-cee6e2352999 service nova] Lock "b8e1def1-8303-4257-b9b5-0050f05cf2d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:44:14 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-97a2b56f-b25a-48cc-9f9b-e27f5e7ee465 req-34bfbf5d-0dad-4350-8b37-cee6e2352999 service nova] Lock "b8e1def1-8303-4257-b9b5-0050f05cf2d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:44:14 user nova-compute[73449]: DEBUG nova.compute.manager [req-97a2b56f-b25a-48cc-9f9b-e27f5e7ee465 req-34bfbf5d-0dad-4350-8b37-cee6e2352999 service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] No waiting events found dispatching network-vif-plugged-c877b9e9-f45c-4199-960c-2b9926518803 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:44:14 user nova-compute[73449]: WARNING nova.compute.manager [req-97a2b56f-b25a-48cc-9f9b-e27f5e7ee465 req-34bfbf5d-0dad-4350-8b37-cee6e2352999 service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Received unexpected event network-vif-plugged-c877b9e9-f45c-4199-960c-2b9926518803 for instance with vm_state active and task_state deleting.
Aug 17 11:44:14 user nova-compute[73449]: DEBUG nova.compute.manager [req-97a2b56f-b25a-48cc-9f9b-e27f5e7ee465 req-34bfbf5d-0dad-4350-8b37-cee6e2352999 service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Received event network-vif-unplugged-f9c9fca3-8f9c-4ea9-8ceb-ed19cb265786 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:44:14 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-97a2b56f-b25a-48cc-9f9b-e27f5e7ee465 req-34bfbf5d-0dad-4350-8b37-cee6e2352999 service nova] Acquiring lock "b8e1def1-8303-4257-b9b5-0050f05cf2d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:44:14 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-97a2b56f-b25a-48cc-9f9b-e27f5e7ee465 req-34bfbf5d-0dad-4350-8b37-cee6e2352999 service nova] Lock "b8e1def1-8303-4257-b9b5-0050f05cf2d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:44:14 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-97a2b56f-b25a-48cc-9f9b-e27f5e7ee465 req-34bfbf5d-0dad-4350-8b37-cee6e2352999 service nova] Lock "b8e1def1-8303-4257-b9b5-0050f05cf2d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:44:14 user nova-compute[73449]: DEBUG nova.compute.manager [req-97a2b56f-b25a-48cc-9f9b-e27f5e7ee465 req-34bfbf5d-0dad-4350-8b37-cee6e2352999 service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] No waiting events found dispatching network-vif-unplugged-f9c9fca3-8f9c-4ea9-8ceb-ed19cb265786 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:44:14 user nova-compute[73449]: DEBUG nova.compute.manager [req-97a2b56f-b25a-48cc-9f9b-e27f5e7ee465 req-34bfbf5d-0dad-4350-8b37-cee6e2352999 service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Received event network-vif-unplugged-f9c9fca3-8f9c-4ea9-8ceb-ed19cb265786 for instance with task_state deleting. {{(pid=73449) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 11:44:14 user nova-compute[73449]: DEBUG nova.compute.manager [req-97a2b56f-b25a-48cc-9f9b-e27f5e7ee465 req-34bfbf5d-0dad-4350-8b37-cee6e2352999 service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Received event network-vif-plugged-f9c9fca3-8f9c-4ea9-8ceb-ed19cb265786 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:44:14 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-97a2b56f-b25a-48cc-9f9b-e27f5e7ee465 req-34bfbf5d-0dad-4350-8b37-cee6e2352999 service nova] Acquiring lock "b8e1def1-8303-4257-b9b5-0050f05cf2d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:44:14 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-97a2b56f-b25a-48cc-9f9b-e27f5e7ee465 req-34bfbf5d-0dad-4350-8b37-cee6e2352999 service nova] Lock "b8e1def1-8303-4257-b9b5-0050f05cf2d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:44:14 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-97a2b56f-b25a-48cc-9f9b-e27f5e7ee465 req-34bfbf5d-0dad-4350-8b37-cee6e2352999 service nova] Lock "b8e1def1-8303-4257-b9b5-0050f05cf2d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:44:14 user nova-compute[73449]: DEBUG nova.compute.manager [req-97a2b56f-b25a-48cc-9f9b-e27f5e7ee465 req-34bfbf5d-0dad-4350-8b37-cee6e2352999 service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] No waiting events found dispatching network-vif-plugged-f9c9fca3-8f9c-4ea9-8ceb-ed19cb265786 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:44:14 user nova-compute[73449]: WARNING nova.compute.manager [req-97a2b56f-b25a-48cc-9f9b-e27f5e7ee465 req-34bfbf5d-0dad-4350-8b37-cee6e2352999 service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Received unexpected event network-vif-plugged-f9c9fca3-8f9c-4ea9-8ceb-ed19cb265786 for instance with vm_state active and task_state deleting.
Aug 17 11:44:14 user nova-compute[73449]: DEBUG nova.compute.manager [req-97a2b56f-b25a-48cc-9f9b-e27f5e7ee465 req-34bfbf5d-0dad-4350-8b37-cee6e2352999 service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Received event network-vif-unplugged-6888cb29-a1bc-42b0-bec3-57667e1b0350 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:44:14 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-97a2b56f-b25a-48cc-9f9b-e27f5e7ee465 req-34bfbf5d-0dad-4350-8b37-cee6e2352999 service nova] Acquiring lock "b8e1def1-8303-4257-b9b5-0050f05cf2d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:44:14 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-97a2b56f-b25a-48cc-9f9b-e27f5e7ee465 req-34bfbf5d-0dad-4350-8b37-cee6e2352999 service nova] Lock "b8e1def1-8303-4257-b9b5-0050f05cf2d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:44:14 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-97a2b56f-b25a-48cc-9f9b-e27f5e7ee465 req-34bfbf5d-0dad-4350-8b37-cee6e2352999 service nova] Lock "b8e1def1-8303-4257-b9b5-0050f05cf2d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:44:14 user nova-compute[73449]: DEBUG nova.compute.manager [req-97a2b56f-b25a-48cc-9f9b-e27f5e7ee465 req-34bfbf5d-0dad-4350-8b37-cee6e2352999 service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] No waiting events found dispatching network-vif-unplugged-6888cb29-a1bc-42b0-bec3-57667e1b0350 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:44:14 user nova-compute[73449]: DEBUG nova.compute.manager [req-97a2b56f-b25a-48cc-9f9b-e27f5e7ee465 req-34bfbf5d-0dad-4350-8b37-cee6e2352999 service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Received event network-vif-unplugged-6888cb29-a1bc-42b0-bec3-57667e1b0350 for instance with task_state deleting. {{(pid=73449) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 11:44:14 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-c76e1520-aa01-4454-afff-d65d9424aaef tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Acquiring lock "f33a7013-82d0-477c-aa5e-b27e63f2b98d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:44:14 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-c76e1520-aa01-4454-afff-d65d9424aaef tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Lock "f33a7013-82d0-477c-aa5e-b27e63f2b98d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:44:14 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-c76e1520-aa01-4454-afff-d65d9424aaef tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Acquiring lock "f33a7013-82d0-477c-aa5e-b27e63f2b98d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:44:14 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-c76e1520-aa01-4454-afff-d65d9424aaef tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Lock "f33a7013-82d0-477c-aa5e-b27e63f2b98d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.003s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:44:14 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-c76e1520-aa01-4454-afff-d65d9424aaef tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Lock "f33a7013-82d0-477c-aa5e-b27e63f2b98d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:44:14 user nova-compute[73449]: INFO nova.compute.manager [None req-c76e1520-aa01-4454-afff-d65d9424aaef tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Terminating instance
Aug 17 11:44:14 user nova-compute[73449]: DEBUG nova.compute.manager [None req-c76e1520-aa01-4454-afff-d65d9424aaef tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Start destroying the instance on the hypervisor. {{(pid=73449) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 11:44:14 user nova-compute[73449]: DEBUG nova.compute.manager [req-591f35e4-bbec-4175-86b1-6dda05f2c555 req-0dbc791f-1490-4391-84f9-503079797d13 service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Received event network-vif-plugged-71d82cc1-6895-4d52-b066-0a01a61b329b {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:44:14 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-591f35e4-bbec-4175-86b1-6dda05f2c555 req-0dbc791f-1490-4391-84f9-503079797d13 service nova] Acquiring lock "b8e1def1-8303-4257-b9b5-0050f05cf2d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:44:14 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-591f35e4-bbec-4175-86b1-6dda05f2c555 req-0dbc791f-1490-4391-84f9-503079797d13 service nova] Lock "b8e1def1-8303-4257-b9b5-0050f05cf2d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:44:14 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-591f35e4-bbec-4175-86b1-6dda05f2c555 req-0dbc791f-1490-4391-84f9-503079797d13 service nova] Lock "b8e1def1-8303-4257-b9b5-0050f05cf2d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:44:14 user nova-compute[73449]: DEBUG nova.compute.manager [req-591f35e4-bbec-4175-86b1-6dda05f2c555 req-0dbc791f-1490-4391-84f9-503079797d13 service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] No waiting events found dispatching network-vif-plugged-71d82cc1-6895-4d52-b066-0a01a61b329b {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:44:14 user nova-compute[73449]: WARNING nova.compute.manager [req-591f35e4-bbec-4175-86b1-6dda05f2c555 req-0dbc791f-1490-4391-84f9-503079797d13 service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Received unexpected event network-vif-plugged-71d82cc1-6895-4d52-b066-0a01a61b329b for instance with vm_state active and task_state deleting.
Aug 17 11:44:14 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:14 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Instance destroyed successfully.
Aug 17 11:44:14 user nova-compute[73449]: DEBUG nova.objects.instance [None req-4b0ec35b-339a-4406-b9b2-e0ee3e20a645 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Lazy-loading 'resources' on Instance uuid b8e1def1-8303-4257-b9b5-0050f05cf2d0 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:44:14 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-4b0ec35b-339a-4406-b9b2-e0ee3e20a645 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T11:41:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-375365820',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-375365820',id=8,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHuba1mc2rOtc1T9WyI8UwVbFUk1snTGZJbkskNqT1zruYVVlxdFqERjQoYnu+0Qwd0eX0YLAQOOpgDiCdfkrFXcxYrXXtDiLKU4WfeVli9xGspdS972Ve+XMTjbUEI+Ww==',key_name='tempest-keypair-1629878963',keypairs=<?>,launch_index=0,launched_at=2023-08-17T11:42:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='60c18371fa6246888a742164afd60242',ramdisk_id='',reservation_id='r-2n30xjvl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1289726527',owner_user_name='tempest-TaggedBootDevicesTest_v242-1289726527-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T11:42:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be158f2bab204b3f874727a655b4bbd6',uuid=b8e1def1-8303-4257-b9b5-0050f05cf2d0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c877b9e9-f45c-4199-960c-2b9926518803", "address": "fa:16:3e:0d:7d:90", "network": {"id": "1596a923-35e5-45a5-85c8-5bae45f011b7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1809575924-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60c18371fa6246888a742164afd60242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc877b9e9-f4", "ovs_interfaceid": "c877b9e9-f45c-4199-960c-2b9926518803", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 11:44:14 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-4b0ec35b-339a-4406-b9b2-e0ee3e20a645 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Converting VIF {"id": "c877b9e9-f45c-4199-960c-2b9926518803", "address": "fa:16:3e:0d:7d:90", "network": {"id": "1596a923-35e5-45a5-85c8-5bae45f011b7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1809575924-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60c18371fa6246888a742164afd60242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc877b9e9-f4", "ovs_interfaceid": "c877b9e9-f45c-4199-960c-2b9926518803", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:44:14 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-4b0ec35b-339a-4406-b9b2-e0ee3e20a645 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0d:7d:90,bridge_name='br-int',has_traffic_filtering=True,id=c877b9e9-f45c-4199-960c-2b9926518803,network=Network(1596a923-35e5-45a5-85c8-5bae45f011b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc877b9e9-f4') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:44:14 user nova-compute[73449]: DEBUG os_vif [None req-4b0ec35b-339a-4406-b9b2-e0ee3e20a645 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0d:7d:90,bridge_name='br-int',has_traffic_filtering=True,id=c877b9e9-f45c-4199-960c-2b9926518803,network=Network(1596a923-35e5-45a5-85c8-5bae45f011b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc877b9e9-f4') {{(pid=73449) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 11:44:14 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:14 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc877b9e9-f4, bridge=br-int, if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:44:14 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:14 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:44:14 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:14 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:14 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:15 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:15 user nova-compute[73449]: INFO os_vif [None req-4b0ec35b-339a-4406-b9b2-e0ee3e20a645 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0d:7d:90,bridge_name='br-int',has_traffic_filtering=True,id=c877b9e9-f45c-4199-960c-2b9926518803,network=Network(1596a923-35e5-45a5-85c8-5bae45f011b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc877b9e9-f4')
Aug 17 11:44:15 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-4b0ec35b-339a-4406-b9b2-e0ee3e20a645 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T11:41:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-375365820',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-375365820',id=8,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHuba1mc2rOtc1T9WyI8UwVbFUk1snTGZJbkskNqT1zruYVVlxdFqERjQoYnu+0Qwd0eX0YLAQOOpgDiCdfkrFXcxYrXXtDiLKU4WfeVli9xGspdS972Ve+XMTjbUEI+Ww==',key_name='tempest-keypair-1629878963',keypairs=<?>,launch_index=0,launched_at=2023-08-17T11:42:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='60c18371fa6246888a742164afd60242',ramdisk_id='',reservation_id='r-2n30xjvl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1289726527',owner_user_name='tempest-TaggedBootDevicesTest_v242-1289726527-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T11:42:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be158f2bab204b3f874727a655b4bbd6',uuid=b8e1def1-8303-4257-b9b5-0050f05cf2d0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "71d82cc1-6895-4d52-b066-0a01a61b329b", "address": "fa:16:3e:48:bc:7c", "network": {"id": "2c2340dc-7ea1-4f63-8819-47844b2a536e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1423531895", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "60c18371fa6246888a742164afd60242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71d82cc1-68", "ovs_interfaceid": "71d82cc1-6895-4d52-b066-0a01a61b329b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73449) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 11:44:15 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-4b0ec35b-339a-4406-b9b2-e0ee3e20a645 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Converting VIF {"id": "71d82cc1-6895-4d52-b066-0a01a61b329b", "address": "fa:16:3e:48:bc:7c", "network": {"id": "2c2340dc-7ea1-4f63-8819-47844b2a536e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1423531895", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "60c18371fa6246888a742164afd60242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71d82cc1-68", "ovs_interfaceid": "71d82cc1-6895-4d52-b066-0a01a61b329b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:44:15 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-4b0ec35b-339a-4406-b9b2-e0ee3e20a645 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:bc:7c,bridge_name='br-int',has_traffic_filtering=True,id=71d82cc1-6895-4d52-b066-0a01a61b329b,network=Network(2c2340dc-7ea1-4f63-8819-47844b2a536e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap71d82cc1-68') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:44:15 user nova-compute[73449]: DEBUG os_vif [None req-4b0ec35b-339a-4406-b9b2-e0ee3e20a645 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:bc:7c,bridge_name='br-int',has_traffic_filtering=True,id=71d82cc1-6895-4d52-b066-0a01a61b329b,network=Network(2c2340dc-7ea1-4f63-8819-47844b2a536e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap71d82cc1-68') {{(pid=73449) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 11:44:15 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:15 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap71d82cc1-68, bridge=br-int, if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:44:15 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:15 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:44:15 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:15 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:15 user nova-compute[73449]: DEBUG nova.compute.manager [req-2c5a811e-078b-46e4-89c3-e256ccc238fa req-6cd33d52-0f6c-4af0-aba5-c5228da53f2e service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Received event network-vif-unplugged-854609a6-03f0-416c-8bbf-b5f85d13c688 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:44:15 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-2c5a811e-078b-46e4-89c3-e256ccc238fa req-6cd33d52-0f6c-4af0-aba5-c5228da53f2e service nova] Acquiring lock "f33a7013-82d0-477c-aa5e-b27e63f2b98d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:44:15 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-2c5a811e-078b-46e4-89c3-e256ccc238fa req-6cd33d52-0f6c-4af0-aba5-c5228da53f2e service nova] Lock "f33a7013-82d0-477c-aa5e-b27e63f2b98d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:44:15 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-2c5a811e-078b-46e4-89c3-e256ccc238fa req-6cd33d52-0f6c-4af0-aba5-c5228da53f2e service nova] Lock "f33a7013-82d0-477c-aa5e-b27e63f2b98d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:44:15 user nova-compute[73449]: DEBUG nova.compute.manager [req-2c5a811e-078b-46e4-89c3-e256ccc238fa req-6cd33d52-0f6c-4af0-aba5-c5228da53f2e service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] No waiting events found dispatching network-vif-unplugged-854609a6-03f0-416c-8bbf-b5f85d13c688 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:44:15 user nova-compute[73449]: DEBUG nova.compute.manager [req-2c5a811e-078b-46e4-89c3-e256ccc238fa req-6cd33d52-0f6c-4af0-aba5-c5228da53f2e service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Received event network-vif-unplugged-854609a6-03f0-416c-8bbf-b5f85d13c688 for instance with task_state deleting. {{(pid=73449) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 11:44:15 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:15 user nova-compute[73449]: INFO os_vif [None req-4b0ec35b-339a-4406-b9b2-e0ee3e20a645 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:bc:7c,bridge_name='br-int',has_traffic_filtering=True,id=71d82cc1-6895-4d52-b066-0a01a61b329b,network=Network(2c2340dc-7ea1-4f63-8819-47844b2a536e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap71d82cc1-68')
Aug 17 11:44:15 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-4b0ec35b-339a-4406-b9b2-e0ee3e20a645 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T11:41:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-375365820',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-375365820',id=8,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHuba1mc2rOtc1T9WyI8UwVbFUk1snTGZJbkskNqT1zruYVVlxdFqERjQoYnu+0Qwd0eX0YLAQOOpgDiCdfkrFXcxYrXXtDiLKU4WfeVli9xGspdS972Ve+XMTjbUEI+Ww==',key_name='tempest-keypair-1629878963',keypairs=<?>,launch_index=0,launched_at=2023-08-17T11:42:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='60c18371fa6246888a742164afd60242',ramdisk_id='',reservation_id='r-2n30xjvl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1289726527',owner_user_name='tempest-TaggedBootDevicesTest_v242-1289726527-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T11:42:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be158f2bab204b3f874727a655b4bbd6',uuid=b8e1def1-8303-4257-b9b5-0050f05cf2d0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b3fe8f9e-5b75-440e-b1c1-f888a4e91e9e", "address": "fa:16:3e:0e:2e:4c", "network": {"id": "2c2340dc-7ea1-4f63-8819-47844b2a536e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1423531895", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "60c18371fa6246888a742164afd60242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3fe8f9e-5b", "ovs_interfaceid": "b3fe8f9e-5b75-440e-b1c1-f888a4e91e9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73449) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 11:44:15 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-4b0ec35b-339a-4406-b9b2-e0ee3e20a645 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Converting VIF {"id": "b3fe8f9e-5b75-440e-b1c1-f888a4e91e9e", "address": "fa:16:3e:0e:2e:4c", "network": {"id": "2c2340dc-7ea1-4f63-8819-47844b2a536e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1423531895", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "60c18371fa6246888a742164afd60242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3fe8f9e-5b", "ovs_interfaceid": "b3fe8f9e-5b75-440e-b1c1-f888a4e91e9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:44:15 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-4b0ec35b-339a-4406-b9b2-e0ee3e20a645 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:2e:4c,bridge_name='br-int',has_traffic_filtering=True,id=b3fe8f9e-5b75-440e-b1c1-f888a4e91e9e,network=Network(2c2340dc-7ea1-4f63-8819-47844b2a536e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb3fe8f9e-5b') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:44:15 user nova-compute[73449]: DEBUG os_vif [None req-4b0ec35b-339a-4406-b9b2-e0ee3e20a645 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:2e:4c,bridge_name='br-int',has_traffic_filtering=True,id=b3fe8f9e-5b75-440e-b1c1-f888a4e91e9e,network=Network(2c2340dc-7ea1-4f63-8819-47844b2a536e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb3fe8f9e-5b') {{(pid=73449) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 11:44:15 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:15 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb3fe8f9e-5b, bridge=br-int, if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:44:15 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:44:15 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:15 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:15 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:15 user nova-compute[73449]: INFO os_vif [None req-4b0ec35b-339a-4406-b9b2-e0ee3e20a645 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:2e:4c,bridge_name='br-int',has_traffic_filtering=True,id=b3fe8f9e-5b75-440e-b1c1-f888a4e91e9e,network=Network(2c2340dc-7ea1-4f63-8819-47844b2a536e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb3fe8f9e-5b')
Aug 17 11:44:15 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-4b0ec35b-339a-4406-b9b2-e0ee3e20a645 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T11:41:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-375365820',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-375365820',id=8,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHuba1mc2rOtc1T9WyI8UwVbFUk1snTGZJbkskNqT1zruYVVlxdFqERjQoYnu+0Qwd0eX0YLAQOOpgDiCdfkrFXcxYrXXtDiLKU4WfeVli9xGspdS972Ve+XMTjbUEI+Ww==',key_name='tempest-keypair-1629878963',keypairs=<?>,launch_index=0,launched_at=2023-08-17T11:42:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='60c18371fa6246888a742164afd60242',ramdisk_id='',reservation_id='r-2n30xjvl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1289726527',owner_user_name='tempest-TaggedBootDevicesTest_v242-1289726527-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T11:42:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be158f2bab204b3f874727a655b4bbd6',uuid=b8e1def1-8303-4257-b9b5-0050f05cf2d0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f9c9fca3-8f9c-4ea9-8ceb-ed19cb265786", "address": "fa:16:3e:a2:22:da", "network": {"id": "2c2340dc-7ea1-4f63-8819-47844b2a536e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1423531895", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "60c18371fa6246888a742164afd60242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9c9fca3-8f", "ovs_interfaceid": "f9c9fca3-8f9c-4ea9-8ceb-ed19cb265786", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 11:44:15 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-4b0ec35b-339a-4406-b9b2-e0ee3e20a645 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Converting VIF {"id": "f9c9fca3-8f9c-4ea9-8ceb-ed19cb265786", "address": "fa:16:3e:a2:22:da", "network": {"id": "2c2340dc-7ea1-4f63-8819-47844b2a536e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1423531895", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "60c18371fa6246888a742164afd60242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9c9fca3-8f", "ovs_interfaceid": "f9c9fca3-8f9c-4ea9-8ceb-ed19cb265786", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:44:15 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-4b0ec35b-339a-4406-b9b2-e0ee3e20a645 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:22:da,bridge_name='br-int',has_traffic_filtering=True,id=f9c9fca3-8f9c-4ea9-8ceb-ed19cb265786,network=Network(2c2340dc-7ea1-4f63-8819-47844b2a536e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9c9fca3-8f') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:44:15 user nova-compute[73449]: DEBUG os_vif [None req-4b0ec35b-339a-4406-b9b2-e0ee3e20a645 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:22:da,bridge_name='br-int',has_traffic_filtering=True,id=f9c9fca3-8f9c-4ea9-8ceb-ed19cb265786,network=Network(2c2340dc-7ea1-4f63-8819-47844b2a536e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9c9fca3-8f') {{(pid=73449) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 11:44:15 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:15 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf9c9fca3-8f, bridge=br-int, if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:44:15 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:15 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:44:16 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:16 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:16 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:16 user nova-compute[73449]: INFO os_vif [None req-4b0ec35b-339a-4406-b9b2-e0ee3e20a645 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:22:da,bridge_name='br-int',has_traffic_filtering=True,id=f9c9fca3-8f9c-4ea9-8ceb-ed19cb265786,network=Network(2c2340dc-7ea1-4f63-8819-47844b2a536e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9c9fca3-8f')
Aug 17 11:44:16 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-4b0ec35b-339a-4406-b9b2-e0ee3e20a645 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T11:41:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-375365820',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-375365820',id=8,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHuba1mc2rOtc1T9WyI8UwVbFUk1snTGZJbkskNqT1zruYVVlxdFqERjQoYnu+0Qwd0eX0YLAQOOpgDiCdfkrFXcxYrXXtDiLKU4WfeVli9xGspdS972Ve+XMTjbUEI+Ww==',key_name='tempest-keypair-1629878963',keypairs=<?>,launch_index=0,launched_at=2023-08-17T11:42:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='60c18371fa6246888a742164afd60242',ramdisk_id='',reservation_id='r-2n30xjvl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1289726527',owner_user_name='tempest-TaggedBootDevicesTest_v242-1289726527-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T11:42:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be158f2bab204b3f874727a655b4bbd6',uuid=b8e1def1-8303-4257-b9b5-0050f05cf2d0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6888cb29-a1bc-42b0-bec3-57667e1b0350", "address": "fa:16:3e:6e:07:1b", "network": {"id": "2c2340dc-7ea1-4f63-8819-47844b2a536e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1423531895", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "60c18371fa6246888a742164afd60242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6888cb29-a1", "ovs_interfaceid": "6888cb29-a1bc-42b0-bec3-57667e1b0350", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 11:44:16 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-4b0ec35b-339a-4406-b9b2-e0ee3e20a645 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Converting VIF {"id": "6888cb29-a1bc-42b0-bec3-57667e1b0350", "address": "fa:16:3e:6e:07:1b", "network": {"id": "2c2340dc-7ea1-4f63-8819-47844b2a536e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1423531895", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "60c18371fa6246888a742164afd60242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6888cb29-a1", "ovs_interfaceid": "6888cb29-a1bc-42b0-bec3-57667e1b0350", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:44:16 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-4b0ec35b-339a-4406-b9b2-e0ee3e20a645 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:07:1b,bridge_name='br-int',has_traffic_filtering=True,id=6888cb29-a1bc-42b0-bec3-57667e1b0350,network=Network(2c2340dc-7ea1-4f63-8819-47844b2a536e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6888cb29-a1') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:44:16 user nova-compute[73449]: DEBUG os_vif [None req-4b0ec35b-339a-4406-b9b2-e0ee3e20a645 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:07:1b,bridge_name='br-int',has_traffic_filtering=True,id=6888cb29-a1bc-42b0-bec3-57667e1b0350,network=Network(2c2340dc-7ea1-4f63-8819-47844b2a536e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6888cb29-a1') {{(pid=73449) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 11:44:16 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:16 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6888cb29-a1, bridge=br-int, if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:44:16 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:16 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:44:16 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:16 user nova-compute[73449]: DEBUG nova.compute.manager [req-93e9f5e9-5707-4854-ab61-e9c33b5040d3 req-8332462a-0779-4039-a330-c364a76960ce service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Received event network-vif-plugged-6888cb29-a1bc-42b0-bec3-57667e1b0350 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:44:16 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-93e9f5e9-5707-4854-ab61-e9c33b5040d3 req-8332462a-0779-4039-a330-c364a76960ce service nova] Acquiring lock "b8e1def1-8303-4257-b9b5-0050f05cf2d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:44:16 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-93e9f5e9-5707-4854-ab61-e9c33b5040d3 req-8332462a-0779-4039-a330-c364a76960ce service nova] Lock "b8e1def1-8303-4257-b9b5-0050f05cf2d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:44:16 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-93e9f5e9-5707-4854-ab61-e9c33b5040d3 req-8332462a-0779-4039-a330-c364a76960ce service nova] Lock "b8e1def1-8303-4257-b9b5-0050f05cf2d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:44:16 user nova-compute[73449]: DEBUG nova.compute.manager [req-93e9f5e9-5707-4854-ab61-e9c33b5040d3 req-8332462a-0779-4039-a330-c364a76960ce service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] No waiting events found dispatching network-vif-plugged-6888cb29-a1bc-42b0-bec3-57667e1b0350 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:44:16 user nova-compute[73449]: WARNING nova.compute.manager [req-93e9f5e9-5707-4854-ab61-e9c33b5040d3 req-8332462a-0779-4039-a330-c364a76960ce service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Received unexpected event network-vif-plugged-6888cb29-a1bc-42b0-bec3-57667e1b0350 for instance with vm_state active and task_state deleting.
Aug 17 11:44:16 user nova-compute[73449]: DEBUG nova.compute.manager [req-93e9f5e9-5707-4854-ab61-e9c33b5040d3 req-8332462a-0779-4039-a330-c364a76960ce service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Received event network-vif-unplugged-d85896ce-110a-41d6-a20e-6beaecb36b97 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:44:16 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-93e9f5e9-5707-4854-ab61-e9c33b5040d3 req-8332462a-0779-4039-a330-c364a76960ce service nova] Acquiring lock "b8e1def1-8303-4257-b9b5-0050f05cf2d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:44:16 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-93e9f5e9-5707-4854-ab61-e9c33b5040d3 req-8332462a-0779-4039-a330-c364a76960ce service nova] Lock "b8e1def1-8303-4257-b9b5-0050f05cf2d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:44:16 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-93e9f5e9-5707-4854-ab61-e9c33b5040d3 req-8332462a-0779-4039-a330-c364a76960ce service nova] Lock "b8e1def1-8303-4257-b9b5-0050f05cf2d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:44:16 user nova-compute[73449]: DEBUG nova.compute.manager [req-93e9f5e9-5707-4854-ab61-e9c33b5040d3 req-8332462a-0779-4039-a330-c364a76960ce service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] No waiting events found dispatching network-vif-unplugged-d85896ce-110a-41d6-a20e-6beaecb36b97 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:44:16 user nova-compute[73449]: DEBUG nova.compute.manager [req-93e9f5e9-5707-4854-ab61-e9c33b5040d3 req-8332462a-0779-4039-a330-c364a76960ce service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Received event network-vif-unplugged-d85896ce-110a-41d6-a20e-6beaecb36b97 for instance with task_state deleting. {{(pid=73449) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 11:44:16 user nova-compute[73449]: DEBUG nova.compute.manager [req-93e9f5e9-5707-4854-ab61-e9c33b5040d3 req-8332462a-0779-4039-a330-c364a76960ce service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Received event network-vif-plugged-d85896ce-110a-41d6-a20e-6beaecb36b97 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:44:16 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-93e9f5e9-5707-4854-ab61-e9c33b5040d3 req-8332462a-0779-4039-a330-c364a76960ce service nova] Acquiring lock "b8e1def1-8303-4257-b9b5-0050f05cf2d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:44:16 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-93e9f5e9-5707-4854-ab61-e9c33b5040d3 req-8332462a-0779-4039-a330-c364a76960ce service nova] Lock "b8e1def1-8303-4257-b9b5-0050f05cf2d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:44:16 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-93e9f5e9-5707-4854-ab61-e9c33b5040d3 req-8332462a-0779-4039-a330-c364a76960ce service nova] Lock "b8e1def1-8303-4257-b9b5-0050f05cf2d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:44:16 user nova-compute[73449]: DEBUG nova.compute.manager [req-93e9f5e9-5707-4854-ab61-e9c33b5040d3 req-8332462a-0779-4039-a330-c364a76960ce service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] No waiting events found dispatching network-vif-plugged-d85896ce-110a-41d6-a20e-6beaecb36b97 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:44:16 user nova-compute[73449]: WARNING nova.compute.manager [req-93e9f5e9-5707-4854-ab61-e9c33b5040d3 req-8332462a-0779-4039-a330-c364a76960ce service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Received unexpected event network-vif-plugged-d85896ce-110a-41d6-a20e-6beaecb36b97 for instance with vm_state active and task_state deleting.
Aug 17 11:44:16 user nova-compute[73449]: DEBUG nova.compute.manager [req-93e9f5e9-5707-4854-ab61-e9c33b5040d3 req-8332462a-0779-4039-a330-c364a76960ce service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Received event network-vif-unplugged-671f57db-57f1-4ba3-9e49-ebe4816404f6 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:44:16 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-93e9f5e9-5707-4854-ab61-e9c33b5040d3 req-8332462a-0779-4039-a330-c364a76960ce service nova] Acquiring lock "b8e1def1-8303-4257-b9b5-0050f05cf2d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:44:16 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-93e9f5e9-5707-4854-ab61-e9c33b5040d3 req-8332462a-0779-4039-a330-c364a76960ce service nova] Lock "b8e1def1-8303-4257-b9b5-0050f05cf2d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:44:16 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-93e9f5e9-5707-4854-ab61-e9c33b5040d3 req-8332462a-0779-4039-a330-c364a76960ce service nova] Lock "b8e1def1-8303-4257-b9b5-0050f05cf2d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:44:16 user nova-compute[73449]: DEBUG nova.compute.manager [req-93e9f5e9-5707-4854-ab61-e9c33b5040d3 req-8332462a-0779-4039-a330-c364a76960ce service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] No waiting events found dispatching network-vif-unplugged-671f57db-57f1-4ba3-9e49-ebe4816404f6 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:44:16 user nova-compute[73449]: DEBUG nova.compute.manager [req-93e9f5e9-5707-4854-ab61-e9c33b5040d3 req-8332462a-0779-4039-a330-c364a76960ce service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Received event network-vif-unplugged-671f57db-57f1-4ba3-9e49-ebe4816404f6 for instance with task_state deleting. {{(pid=73449) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 11:44:16 user nova-compute[73449]: DEBUG nova.compute.manager [req-93e9f5e9-5707-4854-ab61-e9c33b5040d3 req-8332462a-0779-4039-a330-c364a76960ce service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Received event network-vif-plugged-671f57db-57f1-4ba3-9e49-ebe4816404f6 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:44:16 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-93e9f5e9-5707-4854-ab61-e9c33b5040d3 req-8332462a-0779-4039-a330-c364a76960ce service nova] Acquiring lock "b8e1def1-8303-4257-b9b5-0050f05cf2d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:44:16 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-93e9f5e9-5707-4854-ab61-e9c33b5040d3 req-8332462a-0779-4039-a330-c364a76960ce service nova] Lock "b8e1def1-8303-4257-b9b5-0050f05cf2d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:44:16 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-93e9f5e9-5707-4854-ab61-e9c33b5040d3 req-8332462a-0779-4039-a330-c364a76960ce service nova] Lock "b8e1def1-8303-4257-b9b5-0050f05cf2d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:44:16 user nova-compute[73449]: DEBUG nova.compute.manager [req-93e9f5e9-5707-4854-ab61-e9c33b5040d3 req-8332462a-0779-4039-a330-c364a76960ce service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] No waiting events found dispatching network-vif-plugged-671f57db-57f1-4ba3-9e49-ebe4816404f6 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:44:16 user nova-compute[73449]: WARNING nova.compute.manager [req-93e9f5e9-5707-4854-ab61-e9c33b5040d3 req-8332462a-0779-4039-a330-c364a76960ce service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Received unexpected event network-vif-plugged-671f57db-57f1-4ba3-9e49-ebe4816404f6 for instance with vm_state active and task_state deleting.
Aug 17 11:44:16 user nova-compute[73449]: DEBUG nova.compute.manager [req-93e9f5e9-5707-4854-ab61-e9c33b5040d3 req-8332462a-0779-4039-a330-c364a76960ce service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Received event network-vif-unplugged-d2d51361-0f1a-41aa-89e2-c2211bbd0b42 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:44:16 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-93e9f5e9-5707-4854-ab61-e9c33b5040d3 req-8332462a-0779-4039-a330-c364a76960ce service nova] Acquiring lock "f33a7013-82d0-477c-aa5e-b27e63f2b98d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:44:16 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-93e9f5e9-5707-4854-ab61-e9c33b5040d3 req-8332462a-0779-4039-a330-c364a76960ce service nova] Lock "f33a7013-82d0-477c-aa5e-b27e63f2b98d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:44:16 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-93e9f5e9-5707-4854-ab61-e9c33b5040d3 req-8332462a-0779-4039-a330-c364a76960ce service nova] Lock "f33a7013-82d0-477c-aa5e-b27e63f2b98d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:44:16 user nova-compute[73449]: DEBUG nova.compute.manager [req-93e9f5e9-5707-4854-ab61-e9c33b5040d3 req-8332462a-0779-4039-a330-c364a76960ce service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] No waiting events found dispatching network-vif-unplugged-d2d51361-0f1a-41aa-89e2-c2211bbd0b42 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:44:16 user nova-compute[73449]: DEBUG nova.compute.manager [req-93e9f5e9-5707-4854-ab61-e9c33b5040d3 req-8332462a-0779-4039-a330-c364a76960ce service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Received event network-vif-unplugged-d2d51361-0f1a-41aa-89e2-c2211bbd0b42 for instance with task_state deleting. {{(pid=73449) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 11:44:16 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Instance destroyed successfully.
Aug 17 11:44:16 user nova-compute[73449]: DEBUG nova.objects.instance [None req-c76e1520-aa01-4454-afff-d65d9424aaef tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Lazy-loading 'resources' on Instance uuid f33a7013-82d0-477c-aa5e-b27e63f2b98d {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:44:16 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-c76e1520-aa01-4454-afff-d65d9424aaef tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T11:41:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-110737481',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-110737481',id=9,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNiTiGg59OTgWkM5c+8CMzfP1ubX2Ownt/RavGxpnipJdk5xZaefQbANZlemlnOzyDtOU2+/dlg6n/ZAQFwnxRSMECIIHSWFvmwLpLx7JDo4al95DLmQs09DB/PAPUAS7A==',key_name='tempest-keypair-824062427',keypairs=<?>,launch_index=0,launched_at=2023-08-17T11:42:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='92e6d918a4554cd89d9f40cee2a55d00',ramdisk_id='',reservation_id='r-g5j20f0h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1794254085',owner_user_name='tempest-TaggedBootDevicesTest-1794254085-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T11:42:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='092033fd15e74b859f9dc209f70841db',uuid=f33a7013-82d0-477c-aa5e-b27e63f2b98d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d2d51361-0f1a-41aa-89e2-c2211bbd0b42", "address": "fa:16:3e:03:4e:88", "network": {"id": "0ff7c7f6-9609-4a35-8bb0-e8b83254f7f4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-803526263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92e6d918a4554cd89d9f40cee2a55d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2d51361-0f", "ovs_interfaceid": "d2d51361-0f1a-41aa-89e2-c2211bbd0b42", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 11:44:16 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-c76e1520-aa01-4454-afff-d65d9424aaef tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Converting VIF {"id": "d2d51361-0f1a-41aa-89e2-c2211bbd0b42", "address": "fa:16:3e:03:4e:88", "network": {"id": "0ff7c7f6-9609-4a35-8bb0-e8b83254f7f4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-803526263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92e6d918a4554cd89d9f40cee2a55d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2d51361-0f", "ovs_interfaceid": "d2d51361-0f1a-41aa-89e2-c2211bbd0b42", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:44:16 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-c76e1520-aa01-4454-afff-d65d9424aaef tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:03:4e:88,bridge_name='br-int',has_traffic_filtering=True,id=d2d51361-0f1a-41aa-89e2-c2211bbd0b42,network=Network(0ff7c7f6-9609-4a35-8bb0-e8b83254f7f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2d51361-0f') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:44:16 user nova-compute[73449]: DEBUG os_vif [None req-c76e1520-aa01-4454-afff-d65d9424aaef tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:03:4e:88,bridge_name='br-int',has_traffic_filtering=True,id=d2d51361-0f1a-41aa-89e2-c2211bbd0b42,network=Network(0ff7c7f6-9609-4a35-8bb0-e8b83254f7f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2d51361-0f') {{(pid=73449) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 11:44:16 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-d6e6a8e7-b9ea-4f10-836e-b9a4d3333a8d tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] Acquiring lock "c7ef11da-09ce-47a1-ba56-02af6a77206c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:44:16 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-d6e6a8e7-b9ea-4f10-836e-b9a4d3333a8d tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] Lock "c7ef11da-09ce-47a1-ba56-02af6a77206c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:44:16 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-d6e6a8e7-b9ea-4f10-836e-b9a4d3333a8d tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] Acquiring lock "c7ef11da-09ce-47a1-ba56-02af6a77206c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:44:16 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-d6e6a8e7-b9ea-4f10-836e-b9a4d3333a8d tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] Lock "c7ef11da-09ce-47a1-ba56-02af6a77206c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:44:16 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-d6e6a8e7-b9ea-4f10-836e-b9a4d3333a8d tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] Lock "c7ef11da-09ce-47a1-ba56-02af6a77206c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:44:16 user nova-compute[73449]: INFO nova.compute.manager [None req-d6e6a8e7-b9ea-4f10-836e-b9a4d3333a8d tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] [instance: c7ef11da-09ce-47a1-ba56-02af6a77206c] Terminating instance
Aug 17 11:44:16 user nova-compute[73449]: DEBUG nova.compute.manager [None req-d6e6a8e7-b9ea-4f10-836e-b9a4d3333a8d tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] [instance: c7ef11da-09ce-47a1-ba56-02af6a77206c] Start destroying the instance on the hypervisor. {{(pid=73449) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 11:44:16 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:16 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:16 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd2d51361-0f, bridge=br-int, if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:44:16 user nova-compute[73449]: INFO os_vif [None req-4b0ec35b-339a-4406-b9b2-e0ee3e20a645 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:07:1b,bridge_name='br-int',has_traffic_filtering=True,id=6888cb29-a1bc-42b0-bec3-57667e1b0350,network=Network(2c2340dc-7ea1-4f63-8819-47844b2a536e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6888cb29-a1')
Aug 17 11:44:16 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-4b0ec35b-339a-4406-b9b2-e0ee3e20a645 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T11:41:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-375365820',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-375365820',id=8,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHuba1mc2rOtc1T9WyI8UwVbFUk1snTGZJbkskNqT1zruYVVlxdFqERjQoYnu+0Qwd0eX0YLAQOOpgDiCdfkrFXcxYrXXtDiLKU4WfeVli9xGspdS972Ve+XMTjbUEI+Ww==',key_name='tempest-keypair-1629878963',keypairs=<?>,launch_index=0,launched_at=2023-08-17T11:42:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='60c18371fa6246888a742164afd60242',ramdisk_id='',reservation_id='r-2n30xjvl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1289726527',owner_user_name='tempest-TaggedBootDevicesTest_v242-1289726527-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T11:42:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be158f2bab204b3f874727a655b4bbd6',uuid=b8e1def1-8303-4257-b9b5-0050f05cf2d0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d85896ce-110a-41d6-a20e-6beaecb36b97", "address": "fa:16:3e:e3:51:d1", "network": {"id": "8244e7f5-12cf-4ab5-baa2-956f148fc51f", "bridge": "br-int", "label": "tempest-device-tagging-net2-163620727", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "60c18371fa6246888a742164afd60242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd85896ce-11", "ovs_interfaceid": "d85896ce-110a-41d6-a20e-6beaecb36b97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 11:44:16 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-4b0ec35b-339a-4406-b9b2-e0ee3e20a645 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Converting VIF {"id": "d85896ce-110a-41d6-a20e-6beaecb36b97", "address": "fa:16:3e:e3:51:d1", "network": {"id": "8244e7f5-12cf-4ab5-baa2-956f148fc51f", "bridge": "br-int", "label": "tempest-device-tagging-net2-163620727", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "60c18371fa6246888a742164afd60242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd85896ce-11", "ovs_interfaceid": "d85896ce-110a-41d6-a20e-6beaecb36b97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:44:16 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-4b0ec35b-339a-4406-b9b2-e0ee3e20a645 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:51:d1,bridge_name='br-int',has_traffic_filtering=True,id=d85896ce-110a-41d6-a20e-6beaecb36b97,network=Network(8244e7f5-12cf-4ab5-baa2-956f148fc51f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd85896ce-11') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:44:16 user nova-compute[73449]: DEBUG os_vif [None req-4b0ec35b-339a-4406-b9b2-e0ee3e20a645 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:51:d1,bridge_name='br-int',has_traffic_filtering=True,id=d85896ce-110a-41d6-a20e-6beaecb36b97,network=Network(8244e7f5-12cf-4ab5-baa2-956f148fc51f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd85896ce-11') {{(pid=73449) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 11:44:16 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:44:16 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:16 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:16 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd85896ce-11, bridge=br-int, if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:44:16 user nova-compute[73449]: INFO os_vif [None req-c76e1520-aa01-4454-afff-d65d9424aaef tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:03:4e:88,bridge_name='br-int',has_traffic_filtering=True,id=d2d51361-0f1a-41aa-89e2-c2211bbd0b42,network=Network(0ff7c7f6-9609-4a35-8bb0-e8b83254f7f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2d51361-0f')
Aug 17 11:44:16 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-c76e1520-aa01-4454-afff-d65d9424aaef tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T11:41:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-110737481',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-110737481',id=9,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNiTiGg59OTgWkM5c+8CMzfP1ubX2Ownt/RavGxpnipJdk5xZaefQbANZlemlnOzyDtOU2+/dlg6n/ZAQFwnxRSMECIIHSWFvmwLpLx7JDo4al95DLmQs09DB/PAPUAS7A==',key_name='tempest-keypair-824062427',keypairs=<?>,launch_index=0,launched_at=2023-08-17T11:42:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='92e6d918a4554cd89d9f40cee2a55d00',ramdisk_id='',reservation_id='r-g5j20f0h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1794254085',owner_user_name='tempest-TaggedBootDevicesTest-1794254085-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T11:42:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='092033fd15e74b859f9dc209f70841db',uuid=f33a7013-82d0-477c-aa5e-b27e63f2b98d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b14f4f1d-d140-4bb9-a4f2-abbaa8c98a2d", "address": "fa:16:3e:32:bc:69", "network": {"id": "8de6c01b-e132-4efb-be00-df0968c06a81", "bridge": "br-int", "label": "tempest-device-tagging-net1-1740133735", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "92e6d918a4554cd89d9f40cee2a55d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb14f4f1d-d1", "ovs_interfaceid": "b14f4f1d-d140-4bb9-a4f2-abbaa8c98a2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73449) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 11:44:16 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-c76e1520-aa01-4454-afff-d65d9424aaef tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Converting VIF {"id": "b14f4f1d-d140-4bb9-a4f2-abbaa8c98a2d", "address": "fa:16:3e:32:bc:69", "network": {"id": "8de6c01b-e132-4efb-be00-df0968c06a81", "bridge": "br-int", "label": "tempest-device-tagging-net1-1740133735", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "92e6d918a4554cd89d9f40cee2a55d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb14f4f1d-d1", "ovs_interfaceid": "b14f4f1d-d140-4bb9-a4f2-abbaa8c98a2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:44:16 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-c76e1520-aa01-4454-afff-d65d9424aaef tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:bc:69,bridge_name='br-int',has_traffic_filtering=True,id=b14f4f1d-d140-4bb9-a4f2-abbaa8c98a2d,network=Network(8de6c01b-e132-4efb-be00-df0968c06a81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb14f4f1d-d1') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:44:16 user nova-compute[73449]: DEBUG os_vif [None req-c76e1520-aa01-4454-afff-d65d9424aaef tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:bc:69,bridge_name='br-int',has_traffic_filtering=True,id=b14f4f1d-d140-4bb9-a4f2-abbaa8c98a2d,network=Network(8de6c01b-e132-4efb-be00-df0968c06a81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb14f4f1d-d1') {{(pid=73449) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 11:44:16 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:16 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb14f4f1d-d1, bridge=br-int, if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:44:17 user nova-compute[73449]: INFO os_vif [None req-4b0ec35b-339a-4406-b9b2-e0ee3e20a645 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:51:d1,bridge_name='br-int',has_traffic_filtering=True,id=d85896ce-110a-41d6-a20e-6beaecb36b97,network=Network(8244e7f5-12cf-4ab5-baa2-956f148fc51f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd85896ce-11')
Aug 17 11:44:17 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-4b0ec35b-339a-4406-b9b2-e0ee3e20a645 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T11:41:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-375365820',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-375365820',id=8,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHuba1mc2rOtc1T9WyI8UwVbFUk1snTGZJbkskNqT1zruYVVlxdFqERjQoYnu+0Qwd0eX0YLAQOOpgDiCdfkrFXcxYrXXtDiLKU4WfeVli9xGspdS972Ve+XMTjbUEI+Ww==',key_name='tempest-keypair-1629878963',keypairs=<?>,launch_index=0,launched_at=2023-08-17T11:42:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='60c18371fa6246888a742164afd60242',ramdisk_id='',reservation_id='r-2n30xjvl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1289726527',owner_user_name='tempest-TaggedBootDevicesTest_v242-1289726527-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T11:42:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be158f2bab204b3f874727a655b4bbd6',uuid=b8e1def1-8303-4257-b9b5-0050f05cf2d0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "671f57db-57f1-4ba3-9e49-ebe4816404f6", "address": "fa:16:3e:04:1d:3e", "network": {"id": "8244e7f5-12cf-4ab5-baa2-956f148fc51f", "bridge": "br-int", "label": "tempest-device-tagging-net2-163620727", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "60c18371fa6246888a742164afd60242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap671f57db-57", "ovs_interfaceid": "671f57db-57f1-4ba3-9e49-ebe4816404f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-4b0ec35b-339a-4406-b9b2-e0ee3e20a645 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Converting VIF {"id": "671f57db-57f1-4ba3-9e49-ebe4816404f6", "address": "fa:16:3e:04:1d:3e", "network": {"id": "8244e7f5-12cf-4ab5-baa2-956f148fc51f", "bridge": "br-int", "label": "tempest-device-tagging-net2-163620727", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "60c18371fa6246888a742164afd60242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap671f57db-57", "ovs_interfaceid": "671f57db-57f1-4ba3-9e49-ebe4816404f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-4b0ec35b-339a-4406-b9b2-e0ee3e20a645 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:1d:3e,bridge_name='br-int',has_traffic_filtering=True,id=671f57db-57f1-4ba3-9e49-ebe4816404f6,network=Network(8244e7f5-12cf-4ab5-baa2-956f148fc51f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap671f57db-57') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG os_vif [None req-4b0ec35b-339a-4406-b9b2-e0ee3e20a645 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:1d:3e,bridge_name='br-int',has_traffic_filtering=True,id=671f57db-57f1-4ba3-9e49-ebe4816404f6,network=Network(8244e7f5-12cf-4ab5-baa2-956f148fc51f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap671f57db-57') {{(pid=73449) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap671f57db-57, bridge=br-int, if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:17 user nova-compute[73449]: INFO os_vif [None req-c76e1520-aa01-4454-afff-d65d9424aaef tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:bc:69,bridge_name='br-int',has_traffic_filtering=True,id=b14f4f1d-d140-4bb9-a4f2-abbaa8c98a2d,network=Network(8de6c01b-e132-4efb-be00-df0968c06a81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb14f4f1d-d1')
Aug 17 11:44:17 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-c76e1520-aa01-4454-afff-d65d9424aaef tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T11:41:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-110737481',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-110737481',id=9,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNiTiGg59OTgWkM5c+8CMzfP1ubX2Ownt/RavGxpnipJdk5xZaefQbANZlemlnOzyDtOU2+/dlg6n/ZAQFwnxRSMECIIHSWFvmwLpLx7JDo4al95DLmQs09DB/PAPUAS7A==',key_name='tempest-keypair-824062427',keypairs=<?>,launch_index=0,launched_at=2023-08-17T11:42:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='92e6d918a4554cd89d9f40cee2a55d00',ramdisk_id='',reservation_id='r-g5j20f0h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1794254085',owner_user_name='tempest-TaggedBootDevicesTest-1794254085-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T11:42:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='092033fd15e74b859f9dc209f70841db',uuid=f33a7013-82d0-477c-aa5e-b27e63f2b98d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d8233c69-cc4f-4ae8-93ee-7f41234f72ec", "address": "fa:16:3e:14:e4:e9", "network": {"id": "8de6c01b-e132-4efb-be00-df0968c06a81", "bridge": "br-int", "label": "tempest-device-tagging-net1-1740133735", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "92e6d918a4554cd89d9f40cee2a55d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8233c69-cc", "ovs_interfaceid": "d8233c69-cc4f-4ae8-93ee-7f41234f72ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73449) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-c76e1520-aa01-4454-afff-d65d9424aaef tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Converting VIF {"id": "d8233c69-cc4f-4ae8-93ee-7f41234f72ec", "address": "fa:16:3e:14:e4:e9", "network": {"id": "8de6c01b-e132-4efb-be00-df0968c06a81", "bridge": "br-int", "label": "tempest-device-tagging-net1-1740133735", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "92e6d918a4554cd89d9f40cee2a55d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8233c69-cc", "ovs_interfaceid": "d8233c69-cc4f-4ae8-93ee-7f41234f72ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-c76e1520-aa01-4454-afff-d65d9424aaef tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:e4:e9,bridge_name='br-int',has_traffic_filtering=True,id=d8233c69-cc4f-4ae8-93ee-7f41234f72ec,network=Network(8de6c01b-e132-4efb-be00-df0968c06a81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd8233c69-cc') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG os_vif [None req-c76e1520-aa01-4454-afff-d65d9424aaef tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:e4:e9,bridge_name='br-int',has_traffic_filtering=True,id=d8233c69-cc4f-4ae8-93ee-7f41234f72ec,network=Network(8de6c01b-e132-4efb-be00-df0968c06a81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd8233c69-cc') {{(pid=73449) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd8233c69-cc, bridge=br-int, if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:44:17 user nova-compute[73449]: INFO os_vif [None req-4b0ec35b-339a-4406-b9b2-e0ee3e20a645 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:1d:3e,bridge_name='br-int',has_traffic_filtering=True,id=671f57db-57f1-4ba3-9e49-ebe4816404f6,network=Network(8244e7f5-12cf-4ab5-baa2-956f148fc51f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap671f57db-57')
Aug 17 11:44:17 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b0ec35b-339a-4406-b9b2-e0ee3e20a645 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] calling os-brick to detach iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b0ec35b-339a-4406-b9b2-e0ee3e20a645 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, {'target_iqns': ['iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MXdwVrvZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 11:44:17 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-4b0ec35b-339a-4406-b9b2-e0ee3e20a645 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 11:44:17 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-4b0ec35b-339a-4406-b9b2-e0ee3e20a645 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-4b0ec35b-339a-4406-b9b2-e0ee3e20a645 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.007s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b0ec35b-339a-4406-b9b2-e0ee3e20a645 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47', 0)] {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.036s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[95464f09-c9ce-405b-866a-3d9a1b1a1b33]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:44:17 user nova-compute[73449]: INFO os_vif [None req-c76e1520-aa01-4454-afff-d65d9424aaef tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:e4:e9,bridge_name='br-int',has_traffic_filtering=True,id=d8233c69-cc4f-4ae8-93ee-7f41234f72ec,network=Network(8de6c01b-e132-4efb-be00-df0968c06a81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd8233c69-cc')
Aug 17 11:44:17 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-c76e1520-aa01-4454-afff-d65d9424aaef tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T11:41:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-110737481',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-110737481',id=9,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNiTiGg59OTgWkM5c+8CMzfP1ubX2Ownt/RavGxpnipJdk5xZaefQbANZlemlnOzyDtOU2+/dlg6n/ZAQFwnxRSMECIIHSWFvmwLpLx7JDo4al95DLmQs09DB/PAPUAS7A==',key_name='tempest-keypair-824062427',keypairs=<?>,launch_index=0,launched_at=2023-08-17T11:42:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='92e6d918a4554cd89d9f40cee2a55d00',ramdisk_id='',reservation_id='r-g5j20f0h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1794254085',owner_user_name='tempest-TaggedBootDevicesTest-1794254085-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T11:42:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='092033fd15e74b859f9dc209f70841db',uuid=f33a7013-82d0-477c-aa5e-b27e63f2b98d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6fbc9ad6-da42-4492-8603-9efc7294dbab", "address": "fa:16:3e:a7:14:03", "network": {"id": "8de6c01b-e132-4efb-be00-df0968c06a81", "bridge": "br-int", "label": "tempest-device-tagging-net1-1740133735", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "92e6d918a4554cd89d9f40cee2a55d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fbc9ad6-da", "ovs_interfaceid": "6fbc9ad6-da42-4492-8603-9efc7294dbab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-c76e1520-aa01-4454-afff-d65d9424aaef tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Converting VIF {"id": "6fbc9ad6-da42-4492-8603-9efc7294dbab", "address": "fa:16:3e:a7:14:03", "network": {"id": "8de6c01b-e132-4efb-be00-df0968c06a81", "bridge": "br-int", "label": "tempest-device-tagging-net1-1740133735", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "92e6d918a4554cd89d9f40cee2a55d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fbc9ad6-da", "ovs_interfaceid": "6fbc9ad6-da42-4492-8603-9efc7294dbab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-c76e1520-aa01-4454-afff-d65d9424aaef tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:14:03,bridge_name='br-int',has_traffic_filtering=True,id=6fbc9ad6-da42-4492-8603-9efc7294dbab,network=Network(8de6c01b-e132-4efb-be00-df0968c06a81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fbc9ad6-da') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG os_vif [None req-c76e1520-aa01-4454-afff-d65d9424aaef tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:14:03,bridge_name='br-int',has_traffic_filtering=True,id=6fbc9ad6-da42-4492-8603-9efc7294dbab,network=Network(8de6c01b-e132-4efb-be00-df0968c06a81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fbc9ad6-da') {{(pid=73449) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6fbc9ad6-da, bridge=br-int, if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:44:17 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: c7ef11da-09ce-47a1-ba56-02af6a77206c] Instance destroyed successfully.
Aug 17 11:44:17 user nova-compute[73449]: DEBUG nova.objects.instance [None req-d6e6a8e7-b9ea-4f10-836e-b9a4d3333a8d tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] Lazy-loading 'resources' on Instance uuid c7ef11da-09ce-47a1-ba56-02af6a77206c {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.046s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[b760f908-fd40-476a-a720-20bdfd685af8]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b0ec35b-339a-4406-b9b2-e0ee3e20a645 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe (non-flash)
Aug 17 11:44:17 user nova-compute[73449]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919 (non-flash)
Aug 17 11:44:17 user nova-compute[73449]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47 (non-flash)
Aug 17 11:44:17 user nova-compute[73449]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda (non-flash)
Aug 17 11:44:17 user nova-compute[73449]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e (non-flash)
Aug 17 11:44:17 user nova-compute[73449]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff (non-flash)
Aug 17 11:44:17 user nova-compute[73449]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd (non-flash)
Aug 17 11:44:17 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b0ec35b-339a-4406-b9b2-e0ee3e20a645 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe (non-flash)
Aug 17 11:44:17 user nova-compute[73449]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919 (non-flash)
Aug 17 11:44:17 user nova-compute[73449]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47 (non-flash)
Aug 17 11:44:17 user nova-compute[73449]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda (non-flash)
Aug 17 11:44:17 user nova-compute[73449]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e (non-flash)
Aug 17 11:44:17 user nova-compute[73449]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff (non-flash)
Aug 17 11:44:17 user nova-compute[73449]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd (non-flash)
Aug 17 11:44:17 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b0ec35b-339a-4406-b9b2-e0ee3e20a645 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe7582ef640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47'): ({'sdc'}, set())}) {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-4b0ec35b-339a-4406-b9b2-e0ee3e20a645 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Removing single pathed devices sdc {{(pid=73449) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-d6e6a8e7-b9ea-4f10-836e-b9a4d3333a8d tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:40:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-654997075',display_name='tempest-TestVolumeSwap-server-654997075',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-654997075',id=7,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA3g8ZwxAThFrItl+csjyxzO376w5iFWVd3QzQ/A9B99ZjZ0krZBWKoX0TgJthBhHusiXcySN62H67GVo9mvZQgUKD1YNJsHUwO5pLDJWmSPa3RKel0zx83U2CQnHTl7Iw==',key_name='tempest-keypair-939075134',keypairs=<?>,launch_index=0,launched_at=2023-08-17T11:40:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f1ad62fc00f644808abbfc3712321ccf',ramdisk_id='',reservation_id='r-t1itycv9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1403133471',owner_user_name='tempest-TestVolumeSwap-1403133471-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T11:40:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9d971ebb2873481ab6812dd8fa282961',uuid=c7ef11da-09ce-47a1-ba56-02af6a77206c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2f53f520-423a-4791-b98b-6be90f9d5f55", "address": "fa:16:3e:3b:b6:03", "network": {"id": "e41fb10a-8d95-4907-9bc9-8bf33868fb1f", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1297880435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1ad62fc00f644808abbfc3712321ccf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f53f520-42", "ovs_interfaceid": "2f53f520-423a-4791-b98b-6be90f9d5f55", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-d6e6a8e7-b9ea-4f10-836e-b9a4d3333a8d tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] Converting VIF {"id": "2f53f520-423a-4791-b98b-6be90f9d5f55", "address": "fa:16:3e:3b:b6:03", "network": {"id": "e41fb10a-8d95-4907-9bc9-8bf33868fb1f", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1297880435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1ad62fc00f644808abbfc3712321ccf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f53f520-42", "ovs_interfaceid": "2f53f520-423a-4791-b98b-6be90f9d5f55", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-d6e6a8e7-b9ea-4f10-836e-b9a4d3333a8d tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3b:b6:03,bridge_name='br-int',has_traffic_filtering=True,id=2f53f520-423a-4791-b98b-6be90f9d5f55,network=Network(e41fb10a-8d95-4907-9bc9-8bf33868fb1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f53f520-42') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG os_vif [None req-d6e6a8e7-b9ea-4f10-836e-b9a4d3333a8d tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:b6:03,bridge_name='br-int',has_traffic_filtering=True,id=2f53f520-423a-4791-b98b-6be90f9d5f55,network=Network(e41fb10a-8d95-4907-9bc9-8bf33868fb1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f53f520-42') {{(pid=73449) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[069750d3-ae72-4566-a02b-4c61e405f8bc]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2f53f520-42, bridge=br-int, if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:44:17 user nova-compute[73449]: INFO os_vif [None req-c76e1520-aa01-4454-afff-d65d9424aaef tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:14:03,bridge_name='br-int',has_traffic_filtering=True,id=6fbc9ad6-da42-4492-8603-9efc7294dbab,network=Network(8de6c01b-e132-4efb-be00-df0968c06a81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fbc9ad6-da')
Aug 17 11:44:17 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-c76e1520-aa01-4454-afff-d65d9424aaef tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T11:41:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-110737481',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-110737481',id=9,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNiTiGg59OTgWkM5c+8CMzfP1ubX2Ownt/RavGxpnipJdk5xZaefQbANZlemlnOzyDtOU2+/dlg6n/ZAQFwnxRSMECIIHSWFvmwLpLx7JDo4al95DLmQs09DB/PAPUAS7A==',key_name='tempest-keypair-824062427',keypairs=<?>,launch_index=0,launched_at=2023-08-17T11:42:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='92e6d918a4554cd89d9f40cee2a55d00',ramdisk_id='',reservation_id='r-g5j20f0h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1794254085',owner_user_name='tempest-TaggedBootDevicesTest-1794254085-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T11:42:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='092033fd15e74b859f9dc209f70841db',uuid=f33a7013-82d0-477c-aa5e-b27e63f2b98d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "854609a6-03f0-416c-8bbf-b5f85d13c688", "address": "fa:16:3e:09:0d:df", "network": {"id": "8de6c01b-e132-4efb-be00-df0968c06a81", "bridge": "br-int", "label": "tempest-device-tagging-net1-1740133735", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "92e6d918a4554cd89d9f40cee2a55d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap854609a6-03", "ovs_interfaceid": "854609a6-03f0-416c-8bbf-b5f85d13c688", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-c76e1520-aa01-4454-afff-d65d9424aaef tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Converting VIF {"id": "854609a6-03f0-416c-8bbf-b5f85d13c688", "address": "fa:16:3e:09:0d:df", "network": {"id": "8de6c01b-e132-4efb-be00-df0968c06a81", "bridge": "br-int", "label": "tempest-device-tagging-net1-1740133735", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "92e6d918a4554cd89d9f40cee2a55d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap854609a6-03", "ovs_interfaceid": "854609a6-03f0-416c-8bbf-b5f85d13c688", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-c76e1520-aa01-4454-afff-d65d9424aaef tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:0d:df,bridge_name='br-int',has_traffic_filtering=True,id=854609a6-03f0-416c-8bbf-b5f85d13c688,network=Network(8de6c01b-e132-4efb-be00-df0968c06a81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap854609a6-03') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG os_vif [None req-c76e1520-aa01-4454-afff-d65d9424aaef tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:0d:df,bridge_name='br-int',has_traffic_filtering=True,id=854609a6-03f0-416c-8bbf-b5f85d13c688,network=Network(8de6c01b-e132-4efb-be00-df0968c06a81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap854609a6-03') {{(pid=73449) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.025s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2ecfab7-6fb8-4561-8356-a2d65129b5db]: (4, ('ok\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-4b0ec35b-339a-4406-b9b2-e0ee3e20a645 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Flushing IO for device /dev/sdc {{(pid=73449) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.029s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[943d29c5-99f1-43bc-85b0-ce19634d3b51]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-4b0ec35b-339a-4406-b9b2-e0ee3e20a645 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73449) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG nova.compute.manager [req-ae92774f-6d99-43b1-9612-a111a82803ef req-0d392827-f60c-45a8-b6d3-af9b8e27536f service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Received event network-vif-plugged-854609a6-03f0-416c-8bbf-b5f85d13c688 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-ae92774f-6d99-43b1-9612-a111a82803ef req-0d392827-f60c-45a8-b6d3-af9b8e27536f service nova] Acquiring lock "f33a7013-82d0-477c-aa5e-b27e63f2b98d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-ae92774f-6d99-43b1-9612-a111a82803ef req-0d392827-f60c-45a8-b6d3-af9b8e27536f service nova] Lock "f33a7013-82d0-477c-aa5e-b27e63f2b98d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-ae92774f-6d99-43b1-9612-a111a82803ef req-0d392827-f60c-45a8-b6d3-af9b8e27536f service nova] Lock "f33a7013-82d0-477c-aa5e-b27e63f2b98d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG nova.compute.manager [req-ae92774f-6d99-43b1-9612-a111a82803ef req-0d392827-f60c-45a8-b6d3-af9b8e27536f service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] No waiting events found dispatching network-vif-plugged-854609a6-03f0-416c-8bbf-b5f85d13c688 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:44:17 user nova-compute[73449]: WARNING nova.compute.manager [req-ae92774f-6d99-43b1-9612-a111a82803ef req-0d392827-f60c-45a8-b6d3-af9b8e27536f service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Received unexpected event network-vif-plugged-854609a6-03f0-416c-8bbf-b5f85d13c688 for instance with vm_state active and task_state deleting.
Aug 17 11:44:17 user nova-compute[73449]: DEBUG nova.compute.manager [req-ae92774f-6d99-43b1-9612-a111a82803ef req-0d392827-f60c-45a8-b6d3-af9b8e27536f service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Received event network-vif-unplugged-f04e7eb7-1170-4981-b342-44c664ef4c84 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-ae92774f-6d99-43b1-9612-a111a82803ef req-0d392827-f60c-45a8-b6d3-af9b8e27536f service nova] Acquiring lock "f33a7013-82d0-477c-aa5e-b27e63f2b98d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-ae92774f-6d99-43b1-9612-a111a82803ef req-0d392827-f60c-45a8-b6d3-af9b8e27536f service nova] Lock "f33a7013-82d0-477c-aa5e-b27e63f2b98d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-ae92774f-6d99-43b1-9612-a111a82803ef req-0d392827-f60c-45a8-b6d3-af9b8e27536f service nova] Lock "f33a7013-82d0-477c-aa5e-b27e63f2b98d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG nova.compute.manager [req-ae92774f-6d99-43b1-9612-a111a82803ef req-0d392827-f60c-45a8-b6d3-af9b8e27536f service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] No waiting events found dispatching network-vif-unplugged-f04e7eb7-1170-4981-b342-44c664ef4c84 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG nova.compute.manager [req-ae92774f-6d99-43b1-9612-a111a82803ef req-0d392827-f60c-45a8-b6d3-af9b8e27536f service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Received event network-vif-unplugged-f04e7eb7-1170-4981-b342-44c664ef4c84 for instance with task_state deleting. {{(pid=73449) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG nova.compute.manager [req-ae92774f-6d99-43b1-9612-a111a82803ef req-0d392827-f60c-45a8-b6d3-af9b8e27536f service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Received event network-vif-plugged-f04e7eb7-1170-4981-b342-44c664ef4c84 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-ae92774f-6d99-43b1-9612-a111a82803ef req-0d392827-f60c-45a8-b6d3-af9b8e27536f service nova] Acquiring lock "f33a7013-82d0-477c-aa5e-b27e63f2b98d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-ae92774f-6d99-43b1-9612-a111a82803ef req-0d392827-f60c-45a8-b6d3-af9b8e27536f service nova] Lock "f33a7013-82d0-477c-aa5e-b27e63f2b98d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-ae92774f-6d99-43b1-9612-a111a82803ef req-0d392827-f60c-45a8-b6d3-af9b8e27536f service nova] Lock "f33a7013-82d0-477c-aa5e-b27e63f2b98d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG nova.compute.manager [req-ae92774f-6d99-43b1-9612-a111a82803ef req-0d392827-f60c-45a8-b6d3-af9b8e27536f service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] No waiting events found dispatching network-vif-plugged-f04e7eb7-1170-4981-b342-44c664ef4c84 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:44:17 user nova-compute[73449]: WARNING nova.compute.manager [req-ae92774f-6d99-43b1-9612-a111a82803ef req-0d392827-f60c-45a8-b6d3-af9b8e27536f service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Received unexpected event network-vif-plugged-f04e7eb7-1170-4981-b342-44c664ef4c84 for instance with vm_state active and task_state deleting.
Aug 17 11:44:17 user nova-compute[73449]: DEBUG nova.compute.manager [req-ae92774f-6d99-43b1-9612-a111a82803ef req-0d392827-f60c-45a8-b6d3-af9b8e27536f service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Received event network-vif-unplugged-c69d3b48-1443-4999-8369-8c5f61b35697 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-ae92774f-6d99-43b1-9612-a111a82803ef req-0d392827-f60c-45a8-b6d3-af9b8e27536f service nova] Acquiring lock "f33a7013-82d0-477c-aa5e-b27e63f2b98d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-ae92774f-6d99-43b1-9612-a111a82803ef req-0d392827-f60c-45a8-b6d3-af9b8e27536f service nova] Lock "f33a7013-82d0-477c-aa5e-b27e63f2b98d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-ae92774f-6d99-43b1-9612-a111a82803ef req-0d392827-f60c-45a8-b6d3-af9b8e27536f service nova] Lock "f33a7013-82d0-477c-aa5e-b27e63f2b98d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG nova.compute.manager [req-ae92774f-6d99-43b1-9612-a111a82803ef req-0d392827-f60c-45a8-b6d3-af9b8e27536f service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] No waiting events found dispatching network-vif-unplugged-c69d3b48-1443-4999-8369-8c5f61b35697 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG nova.compute.manager [req-ae92774f-6d99-43b1-9612-a111a82803ef req-0d392827-f60c-45a8-b6d3-af9b8e27536f service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Received event network-vif-unplugged-c69d3b48-1443-4999-8369-8c5f61b35697 for instance with task_state deleting. {{(pid=73449) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.072s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[0613bf1d-f677-4434-89e7-8b64d8b93e4a]: (4, ('1', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-4b0ec35b-339a-4406-b9b2-e0ee3e20a645 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73449) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-4b0ec35b-339a-4406-b9b2-e0ee3e20a645 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] SCSI volumes sdc have been removed. {{(pid=73449) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b0ec35b-339a-4406-b9b2-e0ee3e20a645 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47')] {{(pid=73449) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap854609a6-03, bridge=br-int, if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:44:17 user nova-compute[73449]: INFO os_vif [None req-d6e6a8e7-b9ea-4f10-836e-b9a4d3333a8d tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:b6:03,bridge_name='br-int',has_traffic_filtering=True,id=2f53f520-423a-4791-b98b-6be90f9d5f55,network=Network(e41fb10a-8d95-4907-9bc9-8bf33868fb1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f53f520-42')
Aug 17 11:44:17 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-d6e6a8e7-b9ea-4f10-836e-b9a4d3333a8d tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] [instance: c7ef11da-09ce-47a1-ba56-02af6a77206c] Deleting instance files /opt/stack/data/nova/instances/c7ef11da-09ce-47a1-ba56-02af6a77206c_del
Aug 17 11:44:17 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-d6e6a8e7-b9ea-4f10-836e-b9a4d3333a8d tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] [instance: c7ef11da-09ce-47a1-ba56-02af6a77206c] Deletion of /opt/stack/data/nova/instances/c7ef11da-09ce-47a1-ba56-02af6a77206c_del complete
Aug 17 11:44:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2d5f7c2-0279-457f-860c-6c9b7d126d71]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b0ec35b-339a-4406-b9b2-e0ee3e20a645 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47 -p 172.16.0.220:3260 --logout {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:17 user nova-compute[73449]: INFO os_vif [None req-c76e1520-aa01-4454-afff-d65d9424aaef tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:0d:df,bridge_name='br-int',has_traffic_filtering=True,id=854609a6-03f0-416c-8bbf-b5f85d13c688,network=Network(8de6c01b-e132-4efb-be00-df0968c06a81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap854609a6-03')
Aug 17 11:44:17 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-c76e1520-aa01-4454-afff-d65d9424aaef tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T11:41:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-110737481',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-110737481',id=9,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNiTiGg59OTgWkM5c+8CMzfP1ubX2Ownt/RavGxpnipJdk5xZaefQbANZlemlnOzyDtOU2+/dlg6n/ZAQFwnxRSMECIIHSWFvmwLpLx7JDo4al95DLmQs09DB/PAPUAS7A==',key_name='tempest-keypair-824062427',keypairs=<?>,launch_index=0,launched_at=2023-08-17T11:42:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='92e6d918a4554cd89d9f40cee2a55d00',ramdisk_id='',reservation_id='r-g5j20f0h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1794254085',owner_user_name='tempest-TaggedBootDevicesTest-1794254085-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T11:42:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='092033fd15e74b859f9dc209f70841db',uuid=f33a7013-82d0-477c-aa5e-b27e63f2b98d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f04e7eb7-1170-4981-b342-44c664ef4c84", "address": "fa:16:3e:89:ce:7a", "network": {"id": "468865fb-36d1-436e-8fea-5f633edff84a", "bridge": "br-int", "label": "tempest-device-tagging-net2-251570535", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "92e6d918a4554cd89d9f40cee2a55d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf04e7eb7-11", "ovs_interfaceid": "f04e7eb7-1170-4981-b342-44c664ef4c84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-c76e1520-aa01-4454-afff-d65d9424aaef tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Converting VIF {"id": "f04e7eb7-1170-4981-b342-44c664ef4c84", "address": "fa:16:3e:89:ce:7a", "network": {"id": "468865fb-36d1-436e-8fea-5f633edff84a", "bridge": "br-int", "label": "tempest-device-tagging-net2-251570535", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "92e6d918a4554cd89d9f40cee2a55d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf04e7eb7-11", "ovs_interfaceid": "f04e7eb7-1170-4981-b342-44c664ef4c84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-c76e1520-aa01-4454-afff-d65d9424aaef tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:ce:7a,bridge_name='br-int',has_traffic_filtering=True,id=f04e7eb7-1170-4981-b342-44c664ef4c84,network=Network(468865fb-36d1-436e-8fea-5f633edff84a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf04e7eb7-11') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG os_vif [None req-c76e1520-aa01-4454-afff-d65d9424aaef tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:ce:7a,bridge_name='br-int',has_traffic_filtering=True,id=f04e7eb7-1170-4981-b342-44c664ef4c84,network=Network(468865fb-36d1-436e-8fea-5f633edff84a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf04e7eb7-11') {{(pid=73449) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf04e7eb7-11, bridge=br-int, if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47 -p 172.16.0.220:3260 --logout" returned: 0 in 0.091s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[172b9024-cc57-46b6-bcf3-892ae520f945]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b0ec35b-339a-4406-b9b2-e0ee3e20a645 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47, portal: 172.16.0.220,3260]
Aug 17 11:44:17 user nova-compute[73449]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47, portal: 172.16.0.220,3260] successful.
Aug 17 11:44:17 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47 -p 172.16.0.220:3260 --op delete {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:44:17 user nova-compute[73449]: INFO os_vif [None req-c76e1520-aa01-4454-afff-d65d9424aaef tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:ce:7a,bridge_name='br-int',has_traffic_filtering=True,id=f04e7eb7-1170-4981-b342-44c664ef4c84,network=Network(468865fb-36d1-436e-8fea-5f633edff84a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf04e7eb7-11')
Aug 17 11:44:17 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-c76e1520-aa01-4454-afff-d65d9424aaef tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T11:41:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-110737481',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-110737481',id=9,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNiTiGg59OTgWkM5c+8CMzfP1ubX2Ownt/RavGxpnipJdk5xZaefQbANZlemlnOzyDtOU2+/dlg6n/ZAQFwnxRSMECIIHSWFvmwLpLx7JDo4al95DLmQs09DB/PAPUAS7A==',key_name='tempest-keypair-824062427',keypairs=<?>,launch_index=0,launched_at=2023-08-17T11:42:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='92e6d918a4554cd89d9f40cee2a55d00',ramdisk_id='',reservation_id='r-g5j20f0h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1794254085',owner_user_name='tempest-TaggedBootDevicesTest-1794254085-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T11:42:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='092033fd15e74b859f9dc209f70841db',uuid=f33a7013-82d0-477c-aa5e-b27e63f2b98d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c69d3b48-1443-4999-8369-8c5f61b35697", "address": "fa:16:3e:ec:95:94", "network": {"id": "468865fb-36d1-436e-8fea-5f633edff84a", "bridge": "br-int", "label": "tempest-device-tagging-net2-251570535", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "92e6d918a4554cd89d9f40cee2a55d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc69d3b48-14", "ovs_interfaceid": "c69d3b48-1443-4999-8369-8c5f61b35697", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-c76e1520-aa01-4454-afff-d65d9424aaef tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Converting VIF {"id": "c69d3b48-1443-4999-8369-8c5f61b35697", "address": "fa:16:3e:ec:95:94", "network": {"id": "468865fb-36d1-436e-8fea-5f633edff84a", "bridge": "br-int", "label": "tempest-device-tagging-net2-251570535", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "92e6d918a4554cd89d9f40cee2a55d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc69d3b48-14", "ovs_interfaceid": "c69d3b48-1443-4999-8369-8c5f61b35697", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-c76e1520-aa01-4454-afff-d65d9424aaef tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:95:94,bridge_name='br-int',has_traffic_filtering=True,id=c69d3b48-1443-4999-8369-8c5f61b35697,network=Network(468865fb-36d1-436e-8fea-5f633edff84a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc69d3b48-14') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG os_vif [None req-c76e1520-aa01-4454-afff-d65d9424aaef tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:95:94,bridge_name='br-int',has_traffic_filtering=True,id=c69d3b48-1443-4999-8369-8c5f61b35697,network=Network(468865fb-36d1-436e-8fea-5f633edff84a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc69d3b48-14') {{(pid=73449) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc69d3b48-14, bridge=br-int, if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:17 user nova-compute[73449]: INFO os_vif [None req-c76e1520-aa01-4454-afff-d65d9424aaef tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:95:94,bridge_name='br-int',has_traffic_filtering=True,id=c69d3b48-1443-4999-8369-8c5f61b35697,network=Network(468865fb-36d1-436e-8fea-5f633edff84a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc69d3b48-14')
Aug 17 11:44:17 user nova-compute[73449]: INFO nova.compute.manager [None req-d6e6a8e7-b9ea-4f10-836e-b9a4d3333a8d tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] [instance: c7ef11da-09ce-47a1-ba56-02af6a77206c] Took 1.35 seconds to destroy the instance on the hypervisor.
Aug 17 11:44:17 user nova-compute[73449]: DEBUG oslo.service.loopingcall [None req-d6e6a8e7-b9ea-4f10-836e-b9a4d3333a8d tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73449) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG nova.compute.manager [-] [instance: c7ef11da-09ce-47a1-ba56-02af6a77206c] Deallocating network for instance {{(pid=73449) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG nova.network.neutron [-] [instance: c7ef11da-09ce-47a1-ba56-02af6a77206c] deallocate_for_instance() {{(pid=73449) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c76e1520-aa01-4454-afff-d65d9424aaef tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] calling os-brick to detach iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-c76e1520-aa01-4454-afff-d65d9424aaef tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, {'target_iqns': ['iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YBieRTgW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 11:44:17 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-c76e1520-aa01-4454-afff-d65d9424aaef tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 11:44:17 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-c76e1520-aa01-4454-afff-d65d9424aaef tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40bc2deb-5334-44c4-ae15-1c30e668ae47 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.051s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[f651600f-92c9-4826-9c33-1901d2baebee]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b0ec35b-339a-4406-b9b2-e0ee3e20a645 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-4b0ec35b-339a-4406-b9b2-e0ee3e20a645 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.532s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b0ec35b-339a-4406-b9b2-e0ee3e20a645 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] <== disconnect_volume: return (539ms) None {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b0ec35b-339a-4406-b9b2-e0ee3e20a645 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Disconnected iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-c76e1520-aa01-4454-afff-d65d9424aaef tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.013s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-c76e1520-aa01-4454-afff-d65d9424aaef tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919', 0)] {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b0ec35b-339a-4406-b9b2-e0ee3e20a645 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] calling os-brick to detach iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 11:44:17 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b0ec35b-339a-4406-b9b2-e0ee3e20a645 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, {'target_iqns': ['iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MTGsOnUj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 11:44:17 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-4b0ec35b-339a-4406-b9b2-e0ee3e20a645 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 11:44:17 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-4b0ec35b-339a-4406-b9b2-e0ee3e20a645 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.032s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[71afbb5b-6548-4d2a-8a96-9add1e9c01fc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.048s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[edcd26ba-c0c4-4bb6-9687-30dd47577fc9]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-c76e1520-aa01-4454-afff-d65d9424aaef tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe (non-flash)
Aug 17 11:44:18 user nova-compute[73449]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919 (non-flash)
Aug 17 11:44:18 user nova-compute[73449]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda (non-flash)
Aug 17 11:44:18 user nova-compute[73449]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e (non-flash)
Aug 17 11:44:18 user nova-compute[73449]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff (non-flash)
Aug 17 11:44:18 user nova-compute[73449]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd (non-flash)
Aug 17 11:44:18 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-c76e1520-aa01-4454-afff-d65d9424aaef tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe (non-flash)
Aug 17 11:44:18 user nova-compute[73449]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919 (non-flash)
Aug 17 11:44:18 user nova-compute[73449]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda (non-flash)
Aug 17 11:44:18 user nova-compute[73449]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e (non-flash)
Aug 17 11:44:18 user nova-compute[73449]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff (non-flash)
Aug 17 11:44:18 user nova-compute[73449]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd (non-flash)
Aug 17 11:44:18 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-c76e1520-aa01-4454-afff-d65d9424aaef tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe7582ba950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919'): ({'sdb'}, set())}) {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-c76e1520-aa01-4454-afff-d65d9424aaef tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Removing single pathed devices sdb {{(pid=73449) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[750c7c08-7c94-4221-a25a-a16ee45b166e]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.031s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[43a7d1ca-d434-4b21-8c9e-1ba448716451]: (4, ('ok\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-c76e1520-aa01-4454-afff-d65d9424aaef tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Flushing IO for device /dev/sdb {{(pid=73449) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[78ad9e40-5265-4c35-ba8a-8209ab19f1ff]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-c76e1520-aa01-4454-afff-d65d9424aaef tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73449) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.056s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddf198ee-7bae-4cb3-9e2d-12fc960e706a]: (4, ('1', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-c76e1520-aa01-4454-afff-d65d9424aaef tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73449) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-c76e1520-aa01-4454-afff-d65d9424aaef tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] SCSI volumes sdb have been removed. {{(pid=73449) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-c76e1520-aa01-4454-afff-d65d9424aaef tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919')] {{(pid=73449) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2a960c2-9e21-43dd-a9a3-3a3446a63632]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-c76e1520-aa01-4454-afff-d65d9424aaef tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919 -p 172.16.0.220:3260 --logout {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919 -p 172.16.0.220:3260 --logout" returned: 0 in 0.085s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd63063c-fede-416e-9f6b-83b226af5902]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-c76e1520-aa01-4454-afff-d65d9424aaef tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919, portal: 172.16.0.220,3260]
Aug 17 11:44:18 user nova-compute[73449]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919, portal: 172.16.0.220,3260] successful.
Aug 17 11:44:18 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919 -p 172.16.0.220:3260 --op delete {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6721389-fe15-4237-a595-2aa18e8ca919 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[c57e7456-1c4b-415f-bcdb-3e8f66e85aeb]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-c76e1520-aa01-4454-afff-d65d9424aaef tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-c76e1520-aa01-4454-afff-d65d9424aaef tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.513s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-c76e1520-aa01-4454-afff-d65d9424aaef tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] <== disconnect_volume: return (525ms) None {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c76e1520-aa01-4454-afff-d65d9424aaef tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Disconnected iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-4b0ec35b-339a-4406-b9b2-e0ee3e20a645 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.506s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b0ec35b-339a-4406-b9b2-e0ee3e20a645 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e', 0)] {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c76e1520-aa01-4454-afff-d65d9424aaef tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] calling os-brick to detach iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-c76e1520-aa01-4454-afff-d65d9424aaef tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, {'target_iqns': ['iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EhTwKDmQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 11:44:18 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-c76e1520-aa01-4454-afff-d65d9424aaef tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 11:44:18 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-c76e1520-aa01-4454-afff-d65d9424aaef tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[c12d6b08-31a4-4133-81c8-73d75d58bd39]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[5df8ebea-3de4-4328-90ab-4ff96ab334fb]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b0ec35b-339a-4406-b9b2-e0ee3e20a645 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe (non-flash)
Aug 17 11:44:18 user nova-compute[73449]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda (non-flash)
Aug 17 11:44:18 user nova-compute[73449]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e (non-flash)
Aug 17 11:44:18 user nova-compute[73449]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff (non-flash)
Aug 17 11:44:18 user nova-compute[73449]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd (non-flash)
Aug 17 11:44:18 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b0ec35b-339a-4406-b9b2-e0ee3e20a645 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe (non-flash)
Aug 17 11:44:18 user nova-compute[73449]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda (non-flash)
Aug 17 11:44:18 user nova-compute[73449]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e (non-flash)
Aug 17 11:44:18 user nova-compute[73449]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff (non-flash)
Aug 17 11:44:18 user nova-compute[73449]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd (non-flash)
Aug 17 11:44:18 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b0ec35b-339a-4406-b9b2-e0ee3e20a645 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe787665870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e'): ({'sde'}, set())}) {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-4b0ec35b-339a-4406-b9b2-e0ee3e20a645 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Removing single pathed devices sde {{(pid=73449) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[05d89b59-f355-40ee-b012-da67e3ff813f]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG nova.compute.manager [req-d7523a8b-2882-46fa-bb56-4412de92c2a1 req-81cfa36c-ac26-41b9-aa02-eb46656b0b92 service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Received event network-vif-plugged-d2d51361-0f1a-41aa-89e2-c2211bbd0b42 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-d7523a8b-2882-46fa-bb56-4412de92c2a1 req-81cfa36c-ac26-41b9-aa02-eb46656b0b92 service nova] Acquiring lock "f33a7013-82d0-477c-aa5e-b27e63f2b98d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-d7523a8b-2882-46fa-bb56-4412de92c2a1 req-81cfa36c-ac26-41b9-aa02-eb46656b0b92 service nova] Lock "f33a7013-82d0-477c-aa5e-b27e63f2b98d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-d7523a8b-2882-46fa-bb56-4412de92c2a1 req-81cfa36c-ac26-41b9-aa02-eb46656b0b92 service nova] Lock "f33a7013-82d0-477c-aa5e-b27e63f2b98d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG nova.compute.manager [req-d7523a8b-2882-46fa-bb56-4412de92c2a1 req-81cfa36c-ac26-41b9-aa02-eb46656b0b92 service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] No waiting events found dispatching network-vif-plugged-d2d51361-0f1a-41aa-89e2-c2211bbd0b42 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:44:18 user nova-compute[73449]: WARNING nova.compute.manager [req-d7523a8b-2882-46fa-bb56-4412de92c2a1 req-81cfa36c-ac26-41b9-aa02-eb46656b0b92 service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Received unexpected event network-vif-plugged-d2d51361-0f1a-41aa-89e2-c2211bbd0b42 for instance with vm_state active and task_state deleting.
Aug 17 11:44:18 user nova-compute[73449]: DEBUG nova.compute.manager [req-d7523a8b-2882-46fa-bb56-4412de92c2a1 req-81cfa36c-ac26-41b9-aa02-eb46656b0b92 service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Received event network-vif-unplugged-b14f4f1d-d140-4bb9-a4f2-abbaa8c98a2d {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-d7523a8b-2882-46fa-bb56-4412de92c2a1 req-81cfa36c-ac26-41b9-aa02-eb46656b0b92 service nova] Acquiring lock "f33a7013-82d0-477c-aa5e-b27e63f2b98d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-d7523a8b-2882-46fa-bb56-4412de92c2a1 req-81cfa36c-ac26-41b9-aa02-eb46656b0b92 service nova] Lock "f33a7013-82d0-477c-aa5e-b27e63f2b98d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-d7523a8b-2882-46fa-bb56-4412de92c2a1 req-81cfa36c-ac26-41b9-aa02-eb46656b0b92 service nova] Lock "f33a7013-82d0-477c-aa5e-b27e63f2b98d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG nova.compute.manager [req-d7523a8b-2882-46fa-bb56-4412de92c2a1 req-81cfa36c-ac26-41b9-aa02-eb46656b0b92 service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] No waiting events found dispatching network-vif-unplugged-b14f4f1d-d140-4bb9-a4f2-abbaa8c98a2d {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG nova.compute.manager [req-d7523a8b-2882-46fa-bb56-4412de92c2a1 req-81cfa36c-ac26-41b9-aa02-eb46656b0b92 service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Received event network-vif-unplugged-b14f4f1d-d140-4bb9-a4f2-abbaa8c98a2d for instance with task_state deleting. {{(pid=73449) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG nova.compute.manager [req-d7523a8b-2882-46fa-bb56-4412de92c2a1 req-81cfa36c-ac26-41b9-aa02-eb46656b0b92 service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Received event network-vif-plugged-b14f4f1d-d140-4bb9-a4f2-abbaa8c98a2d {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-d7523a8b-2882-46fa-bb56-4412de92c2a1 req-81cfa36c-ac26-41b9-aa02-eb46656b0b92 service nova] Acquiring lock "f33a7013-82d0-477c-aa5e-b27e63f2b98d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-d7523a8b-2882-46fa-bb56-4412de92c2a1 req-81cfa36c-ac26-41b9-aa02-eb46656b0b92 service nova] Lock "f33a7013-82d0-477c-aa5e-b27e63f2b98d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-d7523a8b-2882-46fa-bb56-4412de92c2a1 req-81cfa36c-ac26-41b9-aa02-eb46656b0b92 service nova] Lock "f33a7013-82d0-477c-aa5e-b27e63f2b98d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG nova.compute.manager [req-d7523a8b-2882-46fa-bb56-4412de92c2a1 req-81cfa36c-ac26-41b9-aa02-eb46656b0b92 service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] No waiting events found dispatching network-vif-plugged-b14f4f1d-d140-4bb9-a4f2-abbaa8c98a2d {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:44:18 user nova-compute[73449]: WARNING nova.compute.manager [req-d7523a8b-2882-46fa-bb56-4412de92c2a1 req-81cfa36c-ac26-41b9-aa02-eb46656b0b92 service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Received unexpected event network-vif-plugged-b14f4f1d-d140-4bb9-a4f2-abbaa8c98a2d for instance with vm_state active and task_state deleting.
Aug 17 11:44:18 user nova-compute[73449]: DEBUG nova.compute.manager [req-d7523a8b-2882-46fa-bb56-4412de92c2a1 req-81cfa36c-ac26-41b9-aa02-eb46656b0b92 service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Received event network-vif-unplugged-d8233c69-cc4f-4ae8-93ee-7f41234f72ec {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-d7523a8b-2882-46fa-bb56-4412de92c2a1 req-81cfa36c-ac26-41b9-aa02-eb46656b0b92 service nova] Acquiring lock "f33a7013-82d0-477c-aa5e-b27e63f2b98d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-d7523a8b-2882-46fa-bb56-4412de92c2a1 req-81cfa36c-ac26-41b9-aa02-eb46656b0b92 service nova] Lock "f33a7013-82d0-477c-aa5e-b27e63f2b98d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-d7523a8b-2882-46fa-bb56-4412de92c2a1 req-81cfa36c-ac26-41b9-aa02-eb46656b0b92 service nova] Lock "f33a7013-82d0-477c-aa5e-b27e63f2b98d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG nova.compute.manager [req-d7523a8b-2882-46fa-bb56-4412de92c2a1 req-81cfa36c-ac26-41b9-aa02-eb46656b0b92 service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] No waiting events found dispatching network-vif-unplugged-d8233c69-cc4f-4ae8-93ee-7f41234f72ec {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG nova.compute.manager [req-d7523a8b-2882-46fa-bb56-4412de92c2a1 req-81cfa36c-ac26-41b9-aa02-eb46656b0b92 service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Received event network-vif-unplugged-d8233c69-cc4f-4ae8-93ee-7f41234f72ec for instance with task_state deleting. {{(pid=73449) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.045s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[d164849c-4d1f-4d27-a609-83ff2b362c2f]: (4, ('ok\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-4b0ec35b-339a-4406-b9b2-e0ee3e20a645 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Flushing IO for device /dev/sde {{(pid=73449) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[458cd735-a147-4ddf-afe9-7872aec5851e]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-4b0ec35b-339a-4406-b9b2-e0ee3e20a645 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73449) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.046s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4f6467c-c35e-4700-92c5-074d51dfbb1d]: (4, ('1', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-4b0ec35b-339a-4406-b9b2-e0ee3e20a645 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73449) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-4b0ec35b-339a-4406-b9b2-e0ee3e20a645 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] SCSI volumes sde have been removed. {{(pid=73449) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b0ec35b-339a-4406-b9b2-e0ee3e20a645 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e')] {{(pid=73449) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ed8a637-34d1-4a64-88fb-7548b1b68e05]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b0ec35b-339a-4406-b9b2-e0ee3e20a645 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e -p 172.16.0.220:3260 --logout {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dfb8d1f-8b0c-4622-ab51-0c596fc58646]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b0ec35b-339a-4406-b9b2-e0ee3e20a645 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e, portal: 172.16.0.220,3260]
Aug 17 11:44:18 user nova-compute[73449]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e, portal: 172.16.0.220,3260] successful.
Aug 17 11:44:18 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e -p 172.16.0.220:3260 --op delete {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d09e821-98f2-459f-a7b2-3a77e57f1b4e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4ce8d35-c8aa-47f0-875f-314d221966d1]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b0ec35b-339a-4406-b9b2-e0ee3e20a645 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-4b0ec35b-339a-4406-b9b2-e0ee3e20a645 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.404s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b0ec35b-339a-4406-b9b2-e0ee3e20a645 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] <== disconnect_volume: return (910ms) None {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b0ec35b-339a-4406-b9b2-e0ee3e20a645 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Disconnected iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-c76e1520-aa01-4454-afff-d65d9424aaef tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.398s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-c76e1520-aa01-4454-afff-d65d9424aaef tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda', 0)] {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b0ec35b-339a-4406-b9b2-e0ee3e20a645 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] calling os-brick to detach iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b0ec35b-339a-4406-b9b2-e0ee3e20a645 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, {'target_iqns': ['iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cmZCwVDW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 11:44:18 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-4b0ec35b-339a-4406-b9b2-e0ee3e20a645 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 11:44:18 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-4b0ec35b-339a-4406-b9b2-e0ee3e20a645 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Removed pending event for a3523d22-7165-46ad-be10-5e6ae374f91d due to event {{(pid=73449) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692272658.877561, a3523d22-7165-46ad-be10-5e6ae374f91d => Resumed> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:44:18 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] VM Resumed (Lifecycle Event)
Aug 17 11:44:18 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.033s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[1109abf9-f023-4a10-90e1-787459ad51cf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6c0797a8-f86f-4b6b-82d3-d102d574dd63 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea21fedb-a2af-420f-a19b-ac3fba006f2c]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-c76e1520-aa01-4454-afff-d65d9424aaef tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe (non-flash)
Aug 17 11:44:18 user nova-compute[73449]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda (non-flash)
Aug 17 11:44:18 user nova-compute[73449]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff (non-flash)
Aug 17 11:44:18 user nova-compute[73449]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd (non-flash)
Aug 17 11:44:18 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-c76e1520-aa01-4454-afff-d65d9424aaef tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe (non-flash)
Aug 17 11:44:18 user nova-compute[73449]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda (non-flash)
Aug 17 11:44:18 user nova-compute[73449]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff (non-flash)
Aug 17 11:44:18 user nova-compute[73449]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd (non-flash)
Aug 17 11:44:18 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-c76e1520-aa01-4454-afff-d65d9424aaef tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe7582b91b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda'): ({'sdd'}, set())}) {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-c76e1520-aa01-4454-afff-d65d9424aaef tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Removing single pathed devices sdd {{(pid=73449) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d311829-bd9b-43f1-9017-dd0dba2306ff]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:44:18 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:44:18 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 17 11:44:18 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692272658.8797898, a3523d22-7165-46ad-be10-5e6ae374f91d => Started> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:44:18 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] VM Started (Lifecycle Event)
Aug 17 11:44:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.033s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:44:19 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[8076178c-81b7-4b51-a15c-1fc0466f227a]: (4, ('ok\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:44:19 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-c76e1520-aa01-4454-afff-d65d9424aaef tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Flushing IO for device /dev/sdd {{(pid=73449) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 11:44:19 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:44:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:44:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.021s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:44:19 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[7332e1cb-7c02-4312-a2f7-2179c9c35d6c]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:44:19 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-c76e1520-aa01-4454-afff-d65d9424aaef tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73449) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 11:44:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:44:19 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 11:44:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.058s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:44:19 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6f673c4-bd3a-45d3-86f2-2b033b1e98cf]: (4, ('1', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:44:19 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-c76e1520-aa01-4454-afff-d65d9424aaef tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73449) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 11:44:19 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-c76e1520-aa01-4454-afff-d65d9424aaef tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] SCSI volumes sdd have been removed. {{(pid=73449) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 11:44:19 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-c76e1520-aa01-4454-afff-d65d9424aaef tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda')] {{(pid=73449) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 11:44:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:44:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:44:19 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[cee07455-c67d-4939-8bd5-e7dd173a100c]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:44:19 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-c76e1520-aa01-4454-afff-d65d9424aaef tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:44:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda -p 172.16.0.220:3260 --logout {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:44:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda -p 172.16.0.220:3260 --logout" returned: 0 in 0.102s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:44:19 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[85ac9f61-e949-4373-b4b9-2546c7c86add]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:44:19 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-c76e1520-aa01-4454-afff-d65d9424aaef tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda, portal: 172.16.0.220,3260]
Aug 17 11:44:19 user nova-compute[73449]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda, portal: 172.16.0.220,3260] successful.
Aug 17 11:44:19 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:44:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda -p 172.16.0.220:3260 --op delete {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:44:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7b8c3fd-4a28-4cfb-80b4-f11212488bda -p 172.16.0.220:3260 --op delete" returned: 0 in 0.041s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:44:19 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[622c59ed-ac74-40f2-8292-ccbcec0d7504]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:44:19 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-c76e1520-aa01-4454-afff-d65d9424aaef tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:44:19 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-c76e1520-aa01-4454-afff-d65d9424aaef tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.464s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:44:19 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-c76e1520-aa01-4454-afff-d65d9424aaef tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] <== disconnect_volume: return (863ms) None {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 11:44:19 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c76e1520-aa01-4454-afff-d65d9424aaef tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Disconnected iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 11:44:19 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-4b0ec35b-339a-4406-b9b2-e0ee3e20a645 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.458s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:44:19 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b0ec35b-339a-4406-b9b2-e0ee3e20a645 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd', 0)] {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 11:44:19 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c76e1520-aa01-4454-afff-d65d9424aaef tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] calling os-brick to detach iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 11:44:19 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-c76e1520-aa01-4454-afff-d65d9424aaef tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, {'target_iqns': ['iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QjXIUbEn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 11:44:19 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-c76e1520-aa01-4454-afff-d65d9424aaef tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 11:44:19 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-c76e1520-aa01-4454-afff-d65d9424aaef tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:44:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:44:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.032s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:44:19 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[111d9dbb-d1c4-4b2f-85aa-ac711b1d27c5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:44:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:44:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:44:19 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[41eaf865-c790-4a88-96df-4fbce0455885]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:44:19 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b0ec35b-339a-4406-b9b2-e0ee3e20a645 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe (non-flash)
Aug 17 11:44:19 user nova-compute[73449]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff (non-flash)
Aug 17 11:44:19 user nova-compute[73449]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd (non-flash)
Aug 17 11:44:19 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:44:19 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b0ec35b-339a-4406-b9b2-e0ee3e20a645 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe (non-flash)
Aug 17 11:44:19 user nova-compute[73449]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff (non-flash)
Aug 17 11:44:19 user nova-compute[73449]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd (non-flash)
Aug 17 11:44:19 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:44:19 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b0ec35b-339a-4406-b9b2-e0ee3e20a645 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe7582b40d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd'): ({'sdg'}, set())}) {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 11:44:19 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-4b0ec35b-339a-4406-b9b2-e0ee3e20a645 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Removing single pathed devices sdg {{(pid=73449) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 11:44:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:44:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:44:19 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[181dd522-487a-4d8c-841d-e0e1ccbe66f5]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:44:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:44:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.032s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:44:19 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4c9d58c-cbb2-4085-8685-5ece3b3f4046]: (4, ('ok\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:44:19 user nova-compute[73449]: DEBUG nova.compute.manager [req-9a6dbf30-8899-46b4-87e3-de21957c8a22 req-6f49f409-36e7-471e-984a-baee76bb2ad0 service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Received event network-vif-unplugged-b3fe8f9e-5b75-440e-b1c1-f888a4e91e9e {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:44:19 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-9a6dbf30-8899-46b4-87e3-de21957c8a22 req-6f49f409-36e7-471e-984a-baee76bb2ad0 service nova] Acquiring lock "b8e1def1-8303-4257-b9b5-0050f05cf2d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:44:19 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-9a6dbf30-8899-46b4-87e3-de21957c8a22 req-6f49f409-36e7-471e-984a-baee76bb2ad0 service nova] Lock "b8e1def1-8303-4257-b9b5-0050f05cf2d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:44:19 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-9a6dbf30-8899-46b4-87e3-de21957c8a22 req-6f49f409-36e7-471e-984a-baee76bb2ad0 service nova] Lock "b8e1def1-8303-4257-b9b5-0050f05cf2d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:44:19 user nova-compute[73449]: DEBUG nova.compute.manager [req-9a6dbf30-8899-46b4-87e3-de21957c8a22 req-6f49f409-36e7-471e-984a-baee76bb2ad0 service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] No waiting events found dispatching network-vif-unplugged-b3fe8f9e-5b75-440e-b1c1-f888a4e91e9e {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:44:19 user nova-compute[73449]: DEBUG nova.compute.manager [req-9a6dbf30-8899-46b4-87e3-de21957c8a22 req-6f49f409-36e7-471e-984a-baee76bb2ad0 service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Received event network-vif-unplugged-b3fe8f9e-5b75-440e-b1c1-f888a4e91e9e for instance with task_state deleting. {{(pid=73449) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 11:44:19 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-4b0ec35b-339a-4406-b9b2-e0ee3e20a645 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Flushing IO for device /dev/sdg {{(pid=73449) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 11:44:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:44:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.022s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:44:19 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[77ea0d42-02c7-48a2-a9e9-282803f50526]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:44:19 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-4b0ec35b-339a-4406-b9b2-e0ee3e20a645 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=73449) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 11:44:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:44:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.045s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:44:19 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[23c00529-4b74-4f86-afaa-63fd0d6bdad2]: (4, ('1', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:44:19 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-4b0ec35b-339a-4406-b9b2-e0ee3e20a645 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=73449) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 11:44:19 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-4b0ec35b-339a-4406-b9b2-e0ee3e20a645 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] SCSI volumes sdg have been removed. {{(pid=73449) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 11:44:19 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b0ec35b-339a-4406-b9b2-e0ee3e20a645 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd')] {{(pid=73449) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 11:44:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:44:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.032s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:44:19 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[83f48fa6-0787-45b7-b880-a1a8265db78b]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:44:19 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b0ec35b-339a-4406-b9b2-e0ee3e20a645 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:44:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd -p 172.16.0.220:3260 --logout {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:44:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:44:19 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce2eb01f-b1ea-41b8-a84d-21d202149ec5]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:44:19 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b0ec35b-339a-4406-b9b2-e0ee3e20a645 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd, portal: 172.16.0.220,3260]
Aug 17 11:44:19 user nova-compute[73449]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd, portal: 172.16.0.220,3260] successful.
Aug 17 11:44:19 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:44:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd -p 172.16.0.220:3260 --op delete {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:44:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69858581-d156-4fd4-a145-74ef3c8a93dd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:44:19 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0cd7c24-5f29-4d74-b83d-82be793a7ab6]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:44:19 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b0ec35b-339a-4406-b9b2-e0ee3e20a645 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:44:19 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-4b0ec35b-339a-4406-b9b2-e0ee3e20a645 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.422s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:44:19 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b0ec35b-339a-4406-b9b2-e0ee3e20a645 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] <== disconnect_volume: return (880ms) None {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 11:44:19 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b0ec35b-339a-4406-b9b2-e0ee3e20a645 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Disconnected iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 11:44:19 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-4b0ec35b-339a-4406-b9b2-e0ee3e20a645 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Deleting instance files /opt/stack/data/nova/instances/b8e1def1-8303-4257-b9b5-0050f05cf2d0_del
Aug 17 11:44:19 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-4b0ec35b-339a-4406-b9b2-e0ee3e20a645 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Deletion of /opt/stack/data/nova/instances/b8e1def1-8303-4257-b9b5-0050f05cf2d0_del complete
Aug 17 11:44:19 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-c76e1520-aa01-4454-afff-d65d9424aaef tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.434s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:44:19 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-c76e1520-aa01-4454-afff-d65d9424aaef tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff', 0)] {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 11:44:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:44:19 user nova-compute[73449]: DEBUG nova.network.neutron [-] [instance: c7ef11da-09ce-47a1-ba56-02af6a77206c] Updating instance_info_cache with network_info: [] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:44:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:44:19 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa9432f1-e84f-4db5-86b0-5261ba8147f8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:44:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:44:19 user nova-compute[73449]: DEBUG nova.compute.manager [req-12cb54ab-d6ef-45e4-a7d2-34309fe6c4c0 req-9e1edc03-1ff1-462b-b76e-65b80eec1bf7 service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Received event network-vif-plugged-c69d3b48-1443-4999-8369-8c5f61b35697 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:44:19 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-12cb54ab-d6ef-45e4-a7d2-34309fe6c4c0 req-9e1edc03-1ff1-462b-b76e-65b80eec1bf7 service nova] Acquiring lock "f33a7013-82d0-477c-aa5e-b27e63f2b98d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:44:19 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-12cb54ab-d6ef-45e4-a7d2-34309fe6c4c0 req-9e1edc03-1ff1-462b-b76e-65b80eec1bf7 service nova] Lock "f33a7013-82d0-477c-aa5e-b27e63f2b98d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:44:19 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-12cb54ab-d6ef-45e4-a7d2-34309fe6c4c0 req-9e1edc03-1ff1-462b-b76e-65b80eec1bf7 service nova] Lock "f33a7013-82d0-477c-aa5e-b27e63f2b98d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:44:19 user nova-compute[73449]: DEBUG nova.compute.manager [req-12cb54ab-d6ef-45e4-a7d2-34309fe6c4c0 req-9e1edc03-1ff1-462b-b76e-65b80eec1bf7 service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] No waiting events found dispatching network-vif-plugged-c69d3b48-1443-4999-8369-8c5f61b35697 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:44:19 user nova-compute[73449]: WARNING nova.compute.manager [req-12cb54ab-d6ef-45e4-a7d2-34309fe6c4c0 req-9e1edc03-1ff1-462b-b76e-65b80eec1bf7 service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Received unexpected event network-vif-plugged-c69d3b48-1443-4999-8369-8c5f61b35697 for instance with vm_state active and task_state deleting.
Aug 17 11:44:19 user nova-compute[73449]: INFO nova.compute.manager [-] [instance: c7ef11da-09ce-47a1-ba56-02af6a77206c] Took 1.90 seconds to deallocate network for instance.
Aug 17 11:44:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.045s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:44:19 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ce9b689-7c11-44bb-9512-c58af0e8dcb4]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:44:19 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-c76e1520-aa01-4454-afff-d65d9424aaef tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe (non-flash)
Aug 17 11:44:19 user nova-compute[73449]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff (non-flash)
Aug 17 11:44:19 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:44:19 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-c76e1520-aa01-4454-afff-d65d9424aaef tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe (non-flash)
Aug 17 11:44:19 user nova-compute[73449]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff (non-flash)
Aug 17 11:44:19 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:44:19 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-c76e1520-aa01-4454-afff-d65d9424aaef tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe7582efb50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff'): ({'sdf'}, set())}) {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 11:44:19 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-c76e1520-aa01-4454-afff-d65d9424aaef tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Removing single pathed devices sdf {{(pid=73449) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 11:44:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:44:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.032s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:44:19 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[43099d63-6aa1-4da5-a472-d428640a2d71]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:44:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:44:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.023s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:44:19 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f335fec-6b66-4352-add9-1265d97c1e44]: (4, ('ok\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:44:19 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-c76e1520-aa01-4454-afff-d65d9424aaef tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Flushing IO for device /dev/sdf {{(pid=73449) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 11:44:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:44:19 user nova-compute[73449]: INFO nova.compute.manager [None req-4b0ec35b-339a-4406-b9b2-e0ee3e20a645 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Took 8.26 seconds to destroy the instance on the hypervisor.
Aug 17 11:44:19 user nova-compute[73449]: DEBUG oslo.service.loopingcall [None req-4b0ec35b-339a-4406-b9b2-e0ee3e20a645 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73449) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 11:44:19 user nova-compute[73449]: DEBUG nova.compute.manager [-] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Deallocating network for instance {{(pid=73449) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 11:44:19 user nova-compute[73449]: DEBUG nova.network.neutron [-] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] deallocate_for_instance() {{(pid=73449) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 11:44:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.021s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:44:19 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[69a05492-645d-4a2a-bfab-f0b4fba64c62]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:44:19 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-c76e1520-aa01-4454-afff-d65d9424aaef tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73449) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 11:44:19 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-d6e6a8e7-b9ea-4f10-836e-b9a4d3333a8d tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:44:19 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-d6e6a8e7-b9ea-4f10-836e-b9a4d3333a8d tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:44:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:44:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.048s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:44:19 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ea4f60d-13e0-4995-9982-5a82eecbc885]: (4, ('1', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:44:19 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-c76e1520-aa01-4454-afff-d65d9424aaef tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73449) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 11:44:19 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-c76e1520-aa01-4454-afff-d65d9424aaef tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] SCSI volumes sdf have been removed. {{(pid=73449) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 11:44:19 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-c76e1520-aa01-4454-afff-d65d9424aaef tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff')] {{(pid=73449) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 11:44:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:44:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:44:20 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f80f4f7-f304-4480-b945-c674fee78a1f]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:44:20 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-c76e1520-aa01-4454-afff-d65d9424aaef tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:44:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff -p 172.16.0.220:3260 --logout {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:44:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:44:20 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[98cebcd1-3f75-4285-9071-8276d0436ffd]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:44:20 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-c76e1520-aa01-4454-afff-d65d9424aaef tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff, portal: 172.16.0.220,3260]
Aug 17 11:44:20 user nova-compute[73449]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff, portal: 172.16.0.220,3260] successful.
Aug 17 11:44:20 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:44:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff -p 172.16.0.220:3260 --op delete {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:44:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f96b2915-ca56-4599-9eda-0f258404c9ff -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:44:20 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9f1dc88-e526-44c5-b6c8-50bf121c1fe4]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:44:20 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-c76e1520-aa01-4454-afff-d65d9424aaef tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:44:20 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-c76e1520-aa01-4454-afff-d65d9424aaef tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.391s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:44:20 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-c76e1520-aa01-4454-afff-d65d9424aaef tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] <== disconnect_volume: return (825ms) None {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 11:44:20 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c76e1520-aa01-4454-afff-d65d9424aaef tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Disconnected iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 11:44:20 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-c76e1520-aa01-4454-afff-d65d9424aaef tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Deleting instance files /opt/stack/data/nova/instances/f33a7013-82d0-477c-aa5e-b27e63f2b98d_del
Aug 17 11:44:20 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-c76e1520-aa01-4454-afff-d65d9424aaef tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Deletion of /opt/stack/data/nova/instances/f33a7013-82d0-477c-aa5e-b27e63f2b98d_del complete
Aug 17 11:44:20 user nova-compute[73449]: INFO nova.compute.manager [None req-c76e1520-aa01-4454-afff-d65d9424aaef tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Took 5.81 seconds to destroy the instance on the hypervisor.
Aug 17 11:44:20 user nova-compute[73449]: DEBUG oslo.service.loopingcall [None req-c76e1520-aa01-4454-afff-d65d9424aaef tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73449) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 11:44:20 user nova-compute[73449]: DEBUG nova.compute.manager [-] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Deallocating network for instance {{(pid=73449) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 11:44:20 user nova-compute[73449]: DEBUG nova.network.neutron [-] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] deallocate_for_instance() {{(pid=73449) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 11:44:20 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-d6e6a8e7-b9ea-4f10-836e-b9a4d3333a8d tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 11:44:20 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-d6e6a8e7-b9ea-4f10-836e-b9a4d3333a8d tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 11:44:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-d6e6a8e7-b9ea-4f10-836e-b9a4d3333a8d tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.473s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:44:20 user nova-compute[73449]: INFO nova.scheduler.client.report [None req-d6e6a8e7-b9ea-4f10-836e-b9a4d3333a8d tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] Deleted allocations for instance c7ef11da-09ce-47a1-ba56-02af6a77206c
Aug 17 11:44:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-d6e6a8e7-b9ea-4f10-836e-b9a4d3333a8d tempest-TestVolumeSwap-1403133471 tempest-TestVolumeSwap-1403133471-project-member] Lock "c7ef11da-09ce-47a1-ba56-02af6a77206c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.072s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:44:20 user nova-compute[73449]: DEBUG nova.compute.manager [req-203fbca9-ec30-4309-9bcf-457277ceec38 req-e8093a02-401b-4a2c-aa06-b2324b8f678a service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Received event network-vif-plugged-d8233c69-cc4f-4ae8-93ee-7f41234f72ec {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:44:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-203fbca9-ec30-4309-9bcf-457277ceec38 req-e8093a02-401b-4a2c-aa06-b2324b8f678a service nova] Acquiring lock "f33a7013-82d0-477c-aa5e-b27e63f2b98d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:44:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-203fbca9-ec30-4309-9bcf-457277ceec38 req-e8093a02-401b-4a2c-aa06-b2324b8f678a service nova] Lock "f33a7013-82d0-477c-aa5e-b27e63f2b98d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:44:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-203fbca9-ec30-4309-9bcf-457277ceec38 req-e8093a02-401b-4a2c-aa06-b2324b8f678a service nova] Lock "f33a7013-82d0-477c-aa5e-b27e63f2b98d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:44:20 user nova-compute[73449]: DEBUG nova.compute.manager [req-203fbca9-ec30-4309-9bcf-457277ceec38 req-e8093a02-401b-4a2c-aa06-b2324b8f678a service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] No waiting events found dispatching network-vif-plugged-d8233c69-cc4f-4ae8-93ee-7f41234f72ec {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:44:20 user nova-compute[73449]: WARNING nova.compute.manager [req-203fbca9-ec30-4309-9bcf-457277ceec38 req-e8093a02-401b-4a2c-aa06-b2324b8f678a service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Received unexpected event network-vif-plugged-d8233c69-cc4f-4ae8-93ee-7f41234f72ec for instance with vm_state active and task_state deleting.
Aug 17 11:44:20 user nova-compute[73449]: DEBUG nova.compute.manager [req-203fbca9-ec30-4309-9bcf-457277ceec38 req-e8093a02-401b-4a2c-aa06-b2324b8f678a service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Received event network-vif-unplugged-6fbc9ad6-da42-4492-8603-9efc7294dbab {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:44:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-203fbca9-ec30-4309-9bcf-457277ceec38 req-e8093a02-401b-4a2c-aa06-b2324b8f678a service nova] Acquiring lock "f33a7013-82d0-477c-aa5e-b27e63f2b98d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:44:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-203fbca9-ec30-4309-9bcf-457277ceec38 req-e8093a02-401b-4a2c-aa06-b2324b8f678a service nova] Lock "f33a7013-82d0-477c-aa5e-b27e63f2b98d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:44:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-203fbca9-ec30-4309-9bcf-457277ceec38 req-e8093a02-401b-4a2c-aa06-b2324b8f678a service nova] Lock "f33a7013-82d0-477c-aa5e-b27e63f2b98d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:44:20 user nova-compute[73449]: DEBUG nova.compute.manager [req-203fbca9-ec30-4309-9bcf-457277ceec38 req-e8093a02-401b-4a2c-aa06-b2324b8f678a service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] No waiting events found dispatching network-vif-unplugged-6fbc9ad6-da42-4492-8603-9efc7294dbab {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:44:20 user nova-compute[73449]: DEBUG nova.compute.manager [req-203fbca9-ec30-4309-9bcf-457277ceec38 req-e8093a02-401b-4a2c-aa06-b2324b8f678a service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Received event network-vif-unplugged-6fbc9ad6-da42-4492-8603-9efc7294dbab for instance with task_state deleting. {{(pid=73449) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 11:44:20 user nova-compute[73449]: DEBUG nova.compute.manager [req-203fbca9-ec30-4309-9bcf-457277ceec38 req-e8093a02-401b-4a2c-aa06-b2324b8f678a service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Received event network-vif-plugged-6fbc9ad6-da42-4492-8603-9efc7294dbab {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:44:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-203fbca9-ec30-4309-9bcf-457277ceec38 req-e8093a02-401b-4a2c-aa06-b2324b8f678a service nova] Acquiring lock "f33a7013-82d0-477c-aa5e-b27e63f2b98d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:44:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-203fbca9-ec30-4309-9bcf-457277ceec38 req-e8093a02-401b-4a2c-aa06-b2324b8f678a service nova] Lock "f33a7013-82d0-477c-aa5e-b27e63f2b98d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:44:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-203fbca9-ec30-4309-9bcf-457277ceec38 req-e8093a02-401b-4a2c-aa06-b2324b8f678a service nova] Lock "f33a7013-82d0-477c-aa5e-b27e63f2b98d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:44:20 user nova-compute[73449]: DEBUG nova.compute.manager [req-203fbca9-ec30-4309-9bcf-457277ceec38 req-e8093a02-401b-4a2c-aa06-b2324b8f678a service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] No waiting events found dispatching network-vif-plugged-6fbc9ad6-da42-4492-8603-9efc7294dbab {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:44:20 user nova-compute[73449]: WARNING nova.compute.manager [req-203fbca9-ec30-4309-9bcf-457277ceec38 req-e8093a02-401b-4a2c-aa06-b2324b8f678a service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Received unexpected event network-vif-plugged-6fbc9ad6-da42-4492-8603-9efc7294dbab for instance with vm_state active and task_state deleting.
Aug 17 11:44:20 user nova-compute[73449]: DEBUG nova.compute.manager [req-203fbca9-ec30-4309-9bcf-457277ceec38 req-e8093a02-401b-4a2c-aa06-b2324b8f678a service nova] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Received event network-vif-plugged-2a0eb61f-9398-4db6-9ae0-f142ad2e60c4 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:44:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-203fbca9-ec30-4309-9bcf-457277ceec38 req-e8093a02-401b-4a2c-aa06-b2324b8f678a service nova] Acquiring lock "a3523d22-7165-46ad-be10-5e6ae374f91d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:44:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-203fbca9-ec30-4309-9bcf-457277ceec38 req-e8093a02-401b-4a2c-aa06-b2324b8f678a service nova] Lock "a3523d22-7165-46ad-be10-5e6ae374f91d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:44:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-203fbca9-ec30-4309-9bcf-457277ceec38 req-e8093a02-401b-4a2c-aa06-b2324b8f678a service nova] Lock "a3523d22-7165-46ad-be10-5e6ae374f91d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:44:20 user nova-compute[73449]: DEBUG nova.compute.manager [req-203fbca9-ec30-4309-9bcf-457277ceec38 req-e8093a02-401b-4a2c-aa06-b2324b8f678a service nova] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] No waiting events found dispatching network-vif-plugged-2a0eb61f-9398-4db6-9ae0-f142ad2e60c4 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:44:20 user nova-compute[73449]: WARNING nova.compute.manager [req-203fbca9-ec30-4309-9bcf-457277ceec38 req-e8093a02-401b-4a2c-aa06-b2324b8f678a service nova] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Received unexpected event network-vif-plugged-2a0eb61f-9398-4db6-9ae0-f142ad2e60c4 for instance with vm_state rescued and task_state None.
Aug 17 11:44:20 user nova-compute[73449]: DEBUG nova.compute.manager [req-203fbca9-ec30-4309-9bcf-457277ceec38 req-e8093a02-401b-4a2c-aa06-b2324b8f678a service nova] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Received event network-vif-plugged-2a0eb61f-9398-4db6-9ae0-f142ad2e60c4 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:44:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-203fbca9-ec30-4309-9bcf-457277ceec38 req-e8093a02-401b-4a2c-aa06-b2324b8f678a service nova] Acquiring lock "a3523d22-7165-46ad-be10-5e6ae374f91d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:44:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-203fbca9-ec30-4309-9bcf-457277ceec38 req-e8093a02-401b-4a2c-aa06-b2324b8f678a service nova] Lock "a3523d22-7165-46ad-be10-5e6ae374f91d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:44:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-203fbca9-ec30-4309-9bcf-457277ceec38 req-e8093a02-401b-4a2c-aa06-b2324b8f678a service nova] Lock "a3523d22-7165-46ad-be10-5e6ae374f91d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:44:20 user nova-compute[73449]: DEBUG nova.compute.manager [req-203fbca9-ec30-4309-9bcf-457277ceec38 req-e8093a02-401b-4a2c-aa06-b2324b8f678a service nova] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] No waiting events found dispatching network-vif-plugged-2a0eb61f-9398-4db6-9ae0-f142ad2e60c4 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:44:20 user nova-compute[73449]: WARNING nova.compute.manager [req-203fbca9-ec30-4309-9bcf-457277ceec38 req-e8093a02-401b-4a2c-aa06-b2324b8f678a service nova] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Received unexpected event network-vif-plugged-2a0eb61f-9398-4db6-9ae0-f142ad2e60c4 for instance with vm_state rescued and task_state None.
Aug 17 11:44:21 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-9c07dc41-52a1-4b4b-b40a-33e89a7c829b tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Acquiring lock "848599ce-8cf5-4116-b1d6-4cf9d79cfbc0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:44:21 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-9c07dc41-52a1-4b4b-b40a-33e89a7c829b tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Lock "848599ce-8cf5-4116-b1d6-4cf9d79cfbc0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:44:21 user nova-compute[73449]: DEBUG nova.compute.manager [None req-9c07dc41-52a1-4b4b-b40a-33e89a7c829b tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] [instance: 848599ce-8cf5-4116-b1d6-4cf9d79cfbc0] Starting instance... {{(pid=73449) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 11:44:21 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-9c07dc41-52a1-4b4b-b40a-33e89a7c829b tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:44:21 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-9c07dc41-52a1-4b4b-b40a-33e89a7c829b tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:44:21 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-9c07dc41-52a1-4b4b-b40a-33e89a7c829b tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73449) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 11:44:21 user nova-compute[73449]: INFO nova.compute.claims [None req-9c07dc41-52a1-4b4b-b40a-33e89a7c829b tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] [instance: 848599ce-8cf5-4116-b1d6-4cf9d79cfbc0] Claim successful on node user
Aug 17 11:44:21 user nova-compute[73449]: DEBUG nova.compute.manager [req-afbd21d5-1c9b-49c9-8256-c62bc92225c6 req-f35c2f0e-7bcb-438b-bfa8-d3c25ad5dd05 service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Received event network-vif-plugged-b3fe8f9e-5b75-440e-b1c1-f888a4e91e9e {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:44:21 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-afbd21d5-1c9b-49c9-8256-c62bc92225c6 req-f35c2f0e-7bcb-438b-bfa8-d3c25ad5dd05 service nova] Acquiring lock "b8e1def1-8303-4257-b9b5-0050f05cf2d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:44:21 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-afbd21d5-1c9b-49c9-8256-c62bc92225c6 req-f35c2f0e-7bcb-438b-bfa8-d3c25ad5dd05 service nova] Lock "b8e1def1-8303-4257-b9b5-0050f05cf2d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:44:21 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-afbd21d5-1c9b-49c9-8256-c62bc92225c6 req-f35c2f0e-7bcb-438b-bfa8-d3c25ad5dd05 service nova] Lock "b8e1def1-8303-4257-b9b5-0050f05cf2d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:44:21 user nova-compute[73449]: DEBUG nova.compute.manager [req-afbd21d5-1c9b-49c9-8256-c62bc92225c6 req-f35c2f0e-7bcb-438b-bfa8-d3c25ad5dd05 service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] No waiting events found dispatching network-vif-plugged-b3fe8f9e-5b75-440e-b1c1-f888a4e91e9e {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:44:21 user nova-compute[73449]: WARNING nova.compute.manager [req-afbd21d5-1c9b-49c9-8256-c62bc92225c6 req-f35c2f0e-7bcb-438b-bfa8-d3c25ad5dd05 service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Received unexpected event network-vif-plugged-b3fe8f9e-5b75-440e-b1c1-f888a4e91e9e for instance with vm_state active and task_state deleting.
Aug 17 11:44:21 user nova-compute[73449]: DEBUG nova.compute.manager [req-281a90b3-c09b-4da0-8f63-e241edf9ab45 req-0e3835c3-3731-4656-acdf-99e16d5ce8ad service nova] [instance: c7ef11da-09ce-47a1-ba56-02af6a77206c] Received event network-vif-deleted-2f53f520-423a-4791-b98b-6be90f9d5f55 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:44:21 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-9c07dc41-52a1-4b4b-b40a-33e89a7c829b tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 11:44:21 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-9c07dc41-52a1-4b4b-b40a-33e89a7c829b tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 11:44:21 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-9c07dc41-52a1-4b4b-b40a-33e89a7c829b tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.491s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:44:21 user nova-compute[73449]: DEBUG nova.compute.manager [None req-9c07dc41-52a1-4b4b-b40a-33e89a7c829b tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] [instance: 848599ce-8cf5-4116-b1d6-4cf9d79cfbc0] Start building networks asynchronously for instance. {{(pid=73449) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 11:44:22 user nova-compute[73449]: DEBUG nova.compute.manager [None req-9c07dc41-52a1-4b4b-b40a-33e89a7c829b tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] [instance: 848599ce-8cf5-4116-b1d6-4cf9d79cfbc0] Allocating IP information in the background. {{(pid=73449) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 11:44:22 user nova-compute[73449]: DEBUG nova.network.neutron [None req-9c07dc41-52a1-4b4b-b40a-33e89a7c829b tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] [instance: 848599ce-8cf5-4116-b1d6-4cf9d79cfbc0] allocate_for_instance() {{(pid=73449) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 11:44:22 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-9c07dc41-52a1-4b4b-b40a-33e89a7c829b tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] [instance: 848599ce-8cf5-4116-b1d6-4cf9d79cfbc0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 11:44:22 user nova-compute[73449]: DEBUG nova.compute.manager [None req-9c07dc41-52a1-4b4b-b40a-33e89a7c829b tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] [instance: 848599ce-8cf5-4116-b1d6-4cf9d79cfbc0] Start building block device mappings for instance. {{(pid=73449) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 11:44:22 user nova-compute[73449]: DEBUG nova.compute.manager [None req-9c07dc41-52a1-4b4b-b40a-33e89a7c829b tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] [instance: 848599ce-8cf5-4116-b1d6-4cf9d79cfbc0] Start spawning the instance on the hypervisor. {{(pid=73449) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 11:44:22 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-9c07dc41-52a1-4b4b-b40a-33e89a7c829b tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] [instance: 848599ce-8cf5-4116-b1d6-4cf9d79cfbc0] Creating instance directory {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 11:44:22 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-9c07dc41-52a1-4b4b-b40a-33e89a7c829b tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] [instance: 848599ce-8cf5-4116-b1d6-4cf9d79cfbc0] Creating image(s)
Aug 17 11:44:22 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-9c07dc41-52a1-4b4b-b40a-33e89a7c829b tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Acquiring lock "/opt/stack/data/nova/instances/848599ce-8cf5-4116-b1d6-4cf9d79cfbc0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:44:22 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-9c07dc41-52a1-4b4b-b40a-33e89a7c829b tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Lock "/opt/stack/data/nova/instances/848599ce-8cf5-4116-b1d6-4cf9d79cfbc0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:44:22 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-9c07dc41-52a1-4b4b-b40a-33e89a7c829b tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Lock "/opt/stack/data/nova/instances/848599ce-8cf5-4116-b1d6-4cf9d79cfbc0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:44:22 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-9c07dc41-52a1-4b4b-b40a-33e89a7c829b tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:44:22 user nova-compute[73449]: DEBUG nova.policy [None req-9c07dc41-52a1-4b4b-b40a-33e89a7c829b tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '652d1ea975dc454aa4c72d74ddd8af68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b447696c4a49e5838ae21456bc60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73449) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 11:44:22 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-9c07dc41-52a1-4b4b-b40a-33e89a7c829b tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json" returned: 0 in 0.187s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:44:22 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-9c07dc41-52a1-4b4b-b40a-33e89a7c829b tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Acquiring lock "7e267a577c062ee862e95ede6b48cfd5632f3ea3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:44:22 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-9c07dc41-52a1-4b4b-b40a-33e89a7c829b tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Lock "7e267a577c062ee862e95ede6b48cfd5632f3ea3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:44:22 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-9c07dc41-52a1-4b4b-b40a-33e89a7c829b tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:44:22 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-9c07dc41-52a1-4b4b-b40a-33e89a7c829b tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json" returned: 0 in 0.213s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:44:22 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-9c07dc41-52a1-4b4b-b40a-33e89a7c829b tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3,backing_fmt=raw /opt/stack/data/nova/instances/848599ce-8cf5-4116-b1d6-4cf9d79cfbc0/disk 1073741824 {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:44:22 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-9c07dc41-52a1-4b4b-b40a-33e89a7c829b tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3,backing_fmt=raw /opt/stack/data/nova/instances/848599ce-8cf5-4116-b1d6-4cf9d79cfbc0/disk 1073741824" returned: 0 in 0.067s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:44:22 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-9c07dc41-52a1-4b4b-b40a-33e89a7c829b tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Lock "7e267a577c062ee862e95ede6b48cfd5632f3ea3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.287s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:44:22 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-9c07dc41-52a1-4b4b-b40a-33e89a7c829b tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:44:22 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:22 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-9c07dc41-52a1-4b4b-b40a-33e89a7c829b tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json" returned: 0 in 0.183s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:44:22 user nova-compute[73449]: DEBUG nova.virt.disk.api [None req-9c07dc41-52a1-4b4b-b40a-33e89a7c829b tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Checking if we can resize image /opt/stack/data/nova/instances/848599ce-8cf5-4116-b1d6-4cf9d79cfbc0/disk. size=1073741824 {{(pid=73449) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 11:44:22 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-9c07dc41-52a1-4b4b-b40a-33e89a7c829b tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/848599ce-8cf5-4116-b1d6-4cf9d79cfbc0/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:44:22 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:22 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:44:23 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-9c07dc41-52a1-4b4b-b40a-33e89a7c829b tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/848599ce-8cf5-4116-b1d6-4cf9d79cfbc0/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:44:23 user nova-compute[73449]: DEBUG nova.virt.disk.api [None req-9c07dc41-52a1-4b4b-b40a-33e89a7c829b tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Cannot resize image /opt/stack/data/nova/instances/848599ce-8cf5-4116-b1d6-4cf9d79cfbc0/disk to a smaller size. {{(pid=73449) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 11:44:23 user nova-compute[73449]: DEBUG nova.objects.instance [None req-9c07dc41-52a1-4b4b-b40a-33e89a7c829b tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Lazy-loading 'migration_context' on Instance uuid 848599ce-8cf5-4116-b1d6-4cf9d79cfbc0 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:44:23 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-9c07dc41-52a1-4b4b-b40a-33e89a7c829b tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] [instance: 848599ce-8cf5-4116-b1d6-4cf9d79cfbc0] Created local disks {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 11:44:23 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-9c07dc41-52a1-4b4b-b40a-33e89a7c829b tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] [instance: 848599ce-8cf5-4116-b1d6-4cf9d79cfbc0] Ensure instance console log exists: /opt/stack/data/nova/instances/848599ce-8cf5-4116-b1d6-4cf9d79cfbc0/console.log {{(pid=73449) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 11:44:23 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-9c07dc41-52a1-4b4b-b40a-33e89a7c829b tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:44:23 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-9c07dc41-52a1-4b4b-b40a-33e89a7c829b tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:44:23 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-9c07dc41-52a1-4b4b-b40a-33e89a7c829b tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:44:23 user nova-compute[73449]: DEBUG nova.compute.manager [req-ba86aa4d-db4b-4cf1-a5c1-128e019914f2 req-1001f43e-df69-4264-8626-d6a19f5a139b service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Received event network-vif-deleted-f04e7eb7-1170-4981-b342-44c664ef4c84 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:44:23 user nova-compute[73449]: INFO nova.compute.manager [req-ba86aa4d-db4b-4cf1-a5c1-128e019914f2 req-1001f43e-df69-4264-8626-d6a19f5a139b service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Neutron deleted interface f04e7eb7-1170-4981-b342-44c664ef4c84; detaching it from the instance and deleting it from the info cache
Aug 17 11:44:23 user nova-compute[73449]: DEBUG nova.network.neutron [req-ba86aa4d-db4b-4cf1-a5c1-128e019914f2 req-1001f43e-df69-4264-8626-d6a19f5a139b service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Updating instance_info_cache with network_info: [{"id": "d2d51361-0f1a-41aa-89e2-c2211bbd0b42", "address": "fa:16:3e:03:4e:88", "network": {"id": "0ff7c7f6-9609-4a35-8bb0-e8b83254f7f4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-803526263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92e6d918a4554cd89d9f40cee2a55d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2d51361-0f", "ovs_interfaceid": "d2d51361-0f1a-41aa-89e2-c2211bbd0b42", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b14f4f1d-d140-4bb9-a4f2-abbaa8c98a2d", "address": "fa:16:3e:32:bc:69", "network": {"id": "8de6c01b-e132-4efb-be00-df0968c06a81", "bridge": "br-int", "label": "tempest-device-tagging-net1-1740133735", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "92e6d918a4554cd89d9f40cee2a55d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb14f4f1d-d1", "ovs_interfaceid": "b14f4f1d-d140-4bb9-a4f2-abbaa8c98a2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d8233c69-cc4f-4ae8-93ee-7f41234f72ec", "address": "fa:16:3e:14:e4:e9", "network": {"id": "8de6c01b-e132-4efb-be00-df0968c06a81", "bridge": "br-int", "label": "tempest-device-tagging-net1-1740133735", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "92e6d918a4554cd89d9f40cee2a55d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8233c69-cc", "ovs_interfaceid": "d8233c69-cc4f-4ae8-93ee-7f41234f72ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6fbc9ad6-da42-4492-8603-9efc7294dbab", "address": "fa:16:3e:a7:14:03", "network": {"id": "8de6c01b-e132-4efb-be00-df0968c06a81", "bridge": "br-int", "label": "tempest-device-tagging-net1-1740133735", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "92e6d918a4554cd89d9f40cee2a55d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fbc9ad6-da", "ovs_interfaceid": "6fbc9ad6-da42-4492-8603-9efc7294dbab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "854609a6-03f0-416c-8bbf-b5f85d13c688", "address": "fa:16:3e:09:0d:df", "network": {"id": "8de6c01b-e132-4efb-be00-df0968c06a81", "bridge": "br-int", "label": "tempest-device-tagging-net1-1740133735", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "92e6d918a4554cd89d9f40cee2a55d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap854609a6-03", "ovs_interfaceid": "854609a6-03f0-416c-8bbf-b5f85d13c688", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c69d3b48-1443-4999-8369-8c5f61b35697", "address": "fa:16:3e:ec:95:94", "network": {"id": "468865fb-36d1-436e-8fea-5f633edff84a", "bridge": "br-int", "label": "tempest-device-tagging-net2-251570535", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "92e6d918a4554cd89d9f40cee2a55d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc69d3b48-14", "ovs_interfaceid": "c69d3b48-1443-4999-8369-8c5f61b35697", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:44:23 user nova-compute[73449]: DEBUG nova.compute.manager [req-ba86aa4d-db4b-4cf1-a5c1-128e019914f2 req-1001f43e-df69-4264-8626-d6a19f5a139b service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Detach interface failed, port_id=f04e7eb7-1170-4981-b342-44c664ef4c84, reason: Instance f33a7013-82d0-477c-aa5e-b27e63f2b98d could not be found. {{(pid=73449) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 11:44:23 user nova-compute[73449]: DEBUG nova.network.neutron [None req-9c07dc41-52a1-4b4b-b40a-33e89a7c829b tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] [instance: 848599ce-8cf5-4116-b1d6-4cf9d79cfbc0] Successfully created port: c380d879-a174-4b76-bb8a-4ba6f215ce47 {{(pid=73449) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 11:44:25 user nova-compute[73449]: DEBUG nova.compute.manager [req-ee972062-6f97-4605-88c8-ea3cd452e7f5 req-877935dd-efa4-4a51-bb6f-8867d29be314 service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Received event network-vif-deleted-c877b9e9-f45c-4199-960c-2b9926518803 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:44:25 user nova-compute[73449]: INFO nova.compute.manager [req-ee972062-6f97-4605-88c8-ea3cd452e7f5 req-877935dd-efa4-4a51-bb6f-8867d29be314 service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Neutron deleted interface c877b9e9-f45c-4199-960c-2b9926518803; detaching it from the instance and deleting it from the info cache
Aug 17 11:44:25 user nova-compute[73449]: DEBUG nova.network.neutron [req-ee972062-6f97-4605-88c8-ea3cd452e7f5 req-877935dd-efa4-4a51-bb6f-8867d29be314 service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Updating instance_info_cache with network_info: [{"id": "71d82cc1-6895-4d52-b066-0a01a61b329b", "address": "fa:16:3e:48:bc:7c", "network": {"id": "2c2340dc-7ea1-4f63-8819-47844b2a536e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1423531895", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "60c18371fa6246888a742164afd60242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71d82cc1-68", "ovs_interfaceid": "71d82cc1-6895-4d52-b066-0a01a61b329b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b3fe8f9e-5b75-440e-b1c1-f888a4e91e9e", "address": "fa:16:3e:0e:2e:4c", "network": {"id": "2c2340dc-7ea1-4f63-8819-47844b2a536e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1423531895", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "60c18371fa6246888a742164afd60242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3fe8f9e-5b", "ovs_interfaceid": "b3fe8f9e-5b75-440e-b1c1-f888a4e91e9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f9c9fca3-8f9c-4ea9-8ceb-ed19cb265786", "address": "fa:16:3e:a2:22:da", "network": {"id": "2c2340dc-7ea1-4f63-8819-47844b2a536e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1423531895", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "60c18371fa6246888a742164afd60242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9c9fca3-8f", "ovs_interfaceid": "f9c9fca3-8f9c-4ea9-8ceb-ed19cb265786", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6888cb29-a1bc-42b0-bec3-57667e1b0350", "address": "fa:16:3e:6e:07:1b", "network": {"id": "2c2340dc-7ea1-4f63-8819-47844b2a536e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1423531895", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "60c18371fa6246888a742164afd60242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6888cb29-a1", "ovs_interfaceid": "6888cb29-a1bc-42b0-bec3-57667e1b0350", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d85896ce-110a-41d6-a20e-6beaecb36b97", "address": "fa:16:3e:e3:51:d1", "network": {"id": "8244e7f5-12cf-4ab5-baa2-956f148fc51f", "bridge": "br-int", "label": "tempest-device-tagging-net2-163620727", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "60c18371fa6246888a742164afd60242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd85896ce-11", "ovs_interfaceid": "d85896ce-110a-41d6-a20e-6beaecb36b97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "671f57db-57f1-4ba3-9e49-ebe4816404f6", "address": "fa:16:3e:04:1d:3e", "network": {"id": "8244e7f5-12cf-4ab5-baa2-956f148fc51f", "bridge": "br-int", "label": "tempest-device-tagging-net2-163620727", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "60c18371fa6246888a742164afd60242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap671f57db-57", "ovs_interfaceid": "671f57db-57f1-4ba3-9e49-ebe4816404f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:44:25 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:25 user nova-compute[73449]: DEBUG nova.compute.manager [req-ee972062-6f97-4605-88c8-ea3cd452e7f5 req-877935dd-efa4-4a51-bb6f-8867d29be314 service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Detach interface failed, port_id=c877b9e9-f45c-4199-960c-2b9926518803, reason: Instance b8e1def1-8303-4257-b9b5-0050f05cf2d0 could not be found. {{(pid=73449) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 11:44:25 user nova-compute[73449]: DEBUG nova.compute.manager [req-c70c5bf0-8348-4357-8fcc-63f71a2bd66d req-bc80857e-4eeb-415e-9cd4-f4da2a64854d service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Received event network-vif-deleted-854609a6-03f0-416c-8bbf-b5f85d13c688 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:44:25 user nova-compute[73449]: INFO nova.compute.manager [req-c70c5bf0-8348-4357-8fcc-63f71a2bd66d req-bc80857e-4eeb-415e-9cd4-f4da2a64854d service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Neutron deleted interface 854609a6-03f0-416c-8bbf-b5f85d13c688; detaching it from the instance and deleting it from the info cache
Aug 17 11:44:25 user nova-compute[73449]: DEBUG nova.network.neutron [req-c70c5bf0-8348-4357-8fcc-63f71a2bd66d req-bc80857e-4eeb-415e-9cd4-f4da2a64854d service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Updating instance_info_cache with network_info: [{"id": "d2d51361-0f1a-41aa-89e2-c2211bbd0b42", "address": "fa:16:3e:03:4e:88", "network": {"id": "0ff7c7f6-9609-4a35-8bb0-e8b83254f7f4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-803526263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92e6d918a4554cd89d9f40cee2a55d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2d51361-0f", "ovs_interfaceid": "d2d51361-0f1a-41aa-89e2-c2211bbd0b42", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b14f4f1d-d140-4bb9-a4f2-abbaa8c98a2d", "address": "fa:16:3e:32:bc:69", "network": {"id": "8de6c01b-e132-4efb-be00-df0968c06a81", "bridge": "br-int", "label": "tempest-device-tagging-net1-1740133735", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "92e6d918a4554cd89d9f40cee2a55d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb14f4f1d-d1", "ovs_interfaceid": "b14f4f1d-d140-4bb9-a4f2-abbaa8c98a2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d8233c69-cc4f-4ae8-93ee-7f41234f72ec", "address": "fa:16:3e:14:e4:e9", "network": {"id": "8de6c01b-e132-4efb-be00-df0968c06a81", "bridge": "br-int", "label": "tempest-device-tagging-net1-1740133735", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "92e6d918a4554cd89d9f40cee2a55d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8233c69-cc", "ovs_interfaceid": "d8233c69-cc4f-4ae8-93ee-7f41234f72ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6fbc9ad6-da42-4492-8603-9efc7294dbab", "address": "fa:16:3e:a7:14:03", "network": {"id": "8de6c01b-e132-4efb-be00-df0968c06a81", "bridge": "br-int", "label": "tempest-device-tagging-net1-1740133735", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "92e6d918a4554cd89d9f40cee2a55d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fbc9ad6-da", "ovs_interfaceid": "6fbc9ad6-da42-4492-8603-9efc7294dbab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c69d3b48-1443-4999-8369-8c5f61b35697", "address": "fa:16:3e:ec:95:94", "network": {"id": "468865fb-36d1-436e-8fea-5f633edff84a", "bridge": "br-int", "label": "tempest-device-tagging-net2-251570535", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "92e6d918a4554cd89d9f40cee2a55d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc69d3b48-14", "ovs_interfaceid": "c69d3b48-1443-4999-8369-8c5f61b35697", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:44:25 user nova-compute[73449]: DEBUG nova.compute.manager [req-c70c5bf0-8348-4357-8fcc-63f71a2bd66d req-bc80857e-4eeb-415e-9cd4-f4da2a64854d service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Detach interface failed, port_id=854609a6-03f0-416c-8bbf-b5f85d13c688, reason: Instance f33a7013-82d0-477c-aa5e-b27e63f2b98d could not be found. {{(pid=73449) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 11:44:25 user nova-compute[73449]: DEBUG nova.compute.manager [req-c70c5bf0-8348-4357-8fcc-63f71a2bd66d req-bc80857e-4eeb-415e-9cd4-f4da2a64854d service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Received event network-vif-deleted-c69d3b48-1443-4999-8369-8c5f61b35697 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:44:25 user nova-compute[73449]: INFO nova.compute.manager [req-c70c5bf0-8348-4357-8fcc-63f71a2bd66d req-bc80857e-4eeb-415e-9cd4-f4da2a64854d service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Neutron deleted interface c69d3b48-1443-4999-8369-8c5f61b35697; detaching it from the instance and deleting it from the info cache
Aug 17 11:44:25 user nova-compute[73449]: DEBUG nova.network.neutron [req-c70c5bf0-8348-4357-8fcc-63f71a2bd66d req-bc80857e-4eeb-415e-9cd4-f4da2a64854d service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Updating instance_info_cache with network_info: [{"id": "d2d51361-0f1a-41aa-89e2-c2211bbd0b42", "address": "fa:16:3e:03:4e:88", "network": {"id": "0ff7c7f6-9609-4a35-8bb0-e8b83254f7f4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-803526263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92e6d918a4554cd89d9f40cee2a55d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2d51361-0f", "ovs_interfaceid": "d2d51361-0f1a-41aa-89e2-c2211bbd0b42", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b14f4f1d-d140-4bb9-a4f2-abbaa8c98a2d", "address": "fa:16:3e:32:bc:69", "network": {"id": "8de6c01b-e132-4efb-be00-df0968c06a81", "bridge": "br-int", "label": "tempest-device-tagging-net1-1740133735", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "92e6d918a4554cd89d9f40cee2a55d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb14f4f1d-d1", "ovs_interfaceid": "b14f4f1d-d140-4bb9-a4f2-abbaa8c98a2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d8233c69-cc4f-4ae8-93ee-7f41234f72ec", "address": "fa:16:3e:14:e4:e9", "network": {"id": "8de6c01b-e132-4efb-be00-df0968c06a81", "bridge": "br-int", "label": "tempest-device-tagging-net1-1740133735", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "92e6d918a4554cd89d9f40cee2a55d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8233c69-cc", "ovs_interfaceid": "d8233c69-cc4f-4ae8-93ee-7f41234f72ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6fbc9ad6-da42-4492-8603-9efc7294dbab", "address": "fa:16:3e:a7:14:03", "network": {"id": "8de6c01b-e132-4efb-be00-df0968c06a81", "bridge": "br-int", "label": "tempest-device-tagging-net1-1740133735", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "92e6d918a4554cd89d9f40cee2a55d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fbc9ad6-da", "ovs_interfaceid": "6fbc9ad6-da42-4492-8603-9efc7294dbab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:44:25 user nova-compute[73449]: DEBUG nova.compute.manager [req-c70c5bf0-8348-4357-8fcc-63f71a2bd66d req-bc80857e-4eeb-415e-9cd4-f4da2a64854d service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Detach interface failed, port_id=c69d3b48-1443-4999-8369-8c5f61b35697, reason: Instance f33a7013-82d0-477c-aa5e-b27e63f2b98d could not be found. {{(pid=73449) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 11:44:26 user nova-compute[73449]: DEBUG nova.network.neutron [None req-9c07dc41-52a1-4b4b-b40a-33e89a7c829b tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] [instance: 848599ce-8cf5-4116-b1d6-4cf9d79cfbc0] Successfully updated port: c380d879-a174-4b76-bb8a-4ba6f215ce47 {{(pid=73449) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 11:44:26 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-9c07dc41-52a1-4b4b-b40a-33e89a7c829b tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Acquiring lock "refresh_cache-848599ce-8cf5-4116-b1d6-4cf9d79cfbc0" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:44:26 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-9c07dc41-52a1-4b4b-b40a-33e89a7c829b tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Acquired lock "refresh_cache-848599ce-8cf5-4116-b1d6-4cf9d79cfbc0" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:44:26 user nova-compute[73449]: DEBUG nova.network.neutron [None req-9c07dc41-52a1-4b4b-b40a-33e89a7c829b tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] [instance: 848599ce-8cf5-4116-b1d6-4cf9d79cfbc0] Building network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 11:44:26 user nova-compute[73449]: DEBUG nova.network.neutron [None req-9c07dc41-52a1-4b4b-b40a-33e89a7c829b tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] [instance: 848599ce-8cf5-4116-b1d6-4cf9d79cfbc0] Instance cache missing network info. {{(pid=73449) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 11:44:26 user nova-compute[73449]: DEBUG nova.network.neutron [None req-9c07dc41-52a1-4b4b-b40a-33e89a7c829b tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] [instance: 848599ce-8cf5-4116-b1d6-4cf9d79cfbc0] Updating instance_info_cache with network_info: [{"id": "c380d879-a174-4b76-bb8a-4ba6f215ce47", "address": "fa:16:3e:b0:74:52", "network": {"id": "76705db8-2e7f-449c-b512-6747bad0c324", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1601912422-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54b447696c4a49e5838ae21456bc60e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc380d879-a1", "ovs_interfaceid": "c380d879-a174-4b76-bb8a-4ba6f215ce47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:44:26 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-9c07dc41-52a1-4b4b-b40a-33e89a7c829b tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Releasing lock "refresh_cache-848599ce-8cf5-4116-b1d6-4cf9d79cfbc0" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:44:26 user nova-compute[73449]: DEBUG nova.compute.manager [None req-9c07dc41-52a1-4b4b-b40a-33e89a7c829b tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] [instance: 848599ce-8cf5-4116-b1d6-4cf9d79cfbc0] Instance network_info: |[{"id": "c380d879-a174-4b76-bb8a-4ba6f215ce47", "address": "fa:16:3e:b0:74:52", "network": {"id": "76705db8-2e7f-449c-b512-6747bad0c324", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1601912422-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54b447696c4a49e5838ae21456bc60e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc380d879-a1", "ovs_interfaceid": "c380d879-a174-4b76-bb8a-4ba6f215ce47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73449) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 11:44:26 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-9c07dc41-52a1-4b4b-b40a-33e89a7c829b tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] [instance: 848599ce-8cf5-4116-b1d6-4cf9d79cfbc0] Start _get_guest_xml network_info=[{"id": "c380d879-a174-4b76-bb8a-4ba6f215ce47", "address": "fa:16:3e:b0:74:52", "network": {"id": "76705db8-2e7f-449c-b512-6747bad0c324", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1601912422-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54b447696c4a49e5838ae21456bc60e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc380d879-a1", "ovs_interfaceid": "c380d879-a174-4b76-bb8a-4ba6f215ce47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T11:36:11Z,direct_url=<?>,disk_format='qcow2',id=0a2904ae-083d-41c8-83db-343132b36148,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7a77880136a54ef195c82e018e1939db',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T11:36:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': '0a2904ae-083d-41c8-83db-343132b36148'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 11:44:26 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-9c07dc41-52a1-4b4b-b40a-33e89a7c829b tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:44:26 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-9c07dc41-52a1-4b4b-b40a-33e89a7c829b tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:44:26 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-9c07dc41-52a1-4b4b-b40a-33e89a7c829b tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 11:44:26 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-9c07dc41-52a1-4b4b-b40a-33e89a7c829b tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] CPU controller missing on host. {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 11:44:26 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-9c07dc41-52a1-4b4b-b40a-33e89a7c829b tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 11:44:26 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-9c07dc41-52a1-4b4b-b40a-33e89a7c829b tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] CPU controller found on host. {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 11:44:26 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-9c07dc41-52a1-4b4b-b40a-33e89a7c829b tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73449) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 11:44:26 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-9c07dc41-52a1-4b4b-b40a-33e89a7c829b tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T11:35:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T11:36:11Z,direct_url=<?>,disk_format='qcow2',id=0a2904ae-083d-41c8-83db-343132b36148,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7a77880136a54ef195c82e018e1939db',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T11:36:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 11:44:26 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-9c07dc41-52a1-4b4b-b40a-33e89a7c829b tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Flavor limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 11:44:26 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-9c07dc41-52a1-4b4b-b40a-33e89a7c829b tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Image limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 11:44:26 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-9c07dc41-52a1-4b4b-b40a-33e89a7c829b tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Flavor pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 11:44:26 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-9c07dc41-52a1-4b4b-b40a-33e89a7c829b tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Image pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 11:44:26 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-9c07dc41-52a1-4b4b-b40a-33e89a7c829b tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 11:44:26 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-9c07dc41-52a1-4b4b-b40a-33e89a7c829b tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 11:44:26 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-9c07dc41-52a1-4b4b-b40a-33e89a7c829b tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 11:44:26 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-9c07dc41-52a1-4b4b-b40a-33e89a7c829b tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Got 1 possible topologies {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 11:44:26 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-9c07dc41-52a1-4b4b-b40a-33e89a7c829b tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 11:44:26 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-9c07dc41-52a1-4b4b-b40a-33e89a7c829b tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 11:44:26 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-9c07dc41-52a1-4b4b-b40a-33e89a7c829b tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:44:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-26898897',display_name='tempest-VolumesActionsTest-instance-26898897',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-26898897',id=13,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='54b447696c4a49e5838ae21456bc60e3',ramdisk_id='',reservation_id='r-yh18a1ak',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-407682915',owner_user_name='tempest-VolumesActionsTest-407682915-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T11:44:22Z,user_data=None,user_id='652d1ea975dc454aa4c72d74ddd8af68',uuid=848599ce-8cf5-4116-b1d6-4cf9d79cfbc0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c380d879-a174-4b76-bb8a-4ba6f215ce47", "address": "fa:16:3e:b0:74:52", "network": {"id": "76705db8-2e7f-449c-b512-6747bad0c324", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1601912422-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54b447696c4a49e5838ae21456bc60e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc380d879-a1", "ovs_interfaceid": "c380d879-a174-4b76-bb8a-4ba6f215ce47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73449) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 11:44:26 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-9c07dc41-52a1-4b4b-b40a-33e89a7c829b tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Converting VIF {"id": "c380d879-a174-4b76-bb8a-4ba6f215ce47", "address": "fa:16:3e:b0:74:52", "network": {"id": "76705db8-2e7f-449c-b512-6747bad0c324", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1601912422-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54b447696c4a49e5838ae21456bc60e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc380d879-a1", "ovs_interfaceid": "c380d879-a174-4b76-bb8a-4ba6f215ce47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:44:26 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-9c07dc41-52a1-4b4b-b40a-33e89a7c829b tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:74:52,bridge_name='br-int',has_traffic_filtering=True,id=c380d879-a174-4b76-bb8a-4ba6f215ce47,network=Network(76705db8-2e7f-449c-b512-6747bad0c324),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc380d879-a1') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:44:26 user nova-compute[73449]: DEBUG nova.objects.instance [None req-9c07dc41-52a1-4b4b-b40a-33e89a7c829b tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Lazy-loading 'pci_devices' on Instance uuid 848599ce-8cf5-4116-b1d6-4cf9d79cfbc0 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:44:26 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-9c07dc41-52a1-4b4b-b40a-33e89a7c829b tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] [instance: 848599ce-8cf5-4116-b1d6-4cf9d79cfbc0] End _get_guest_xml xml=<domain type="kvm">
Aug 17 11:44:26 user nova-compute[73449]:   <uuid>848599ce-8cf5-4116-b1d6-4cf9d79cfbc0</uuid>
Aug 17 11:44:26 user nova-compute[73449]:   <name>instance-0000000d</name>
Aug 17 11:44:26 user nova-compute[73449]:   <memory>524288</memory>
Aug 17 11:44:26 user nova-compute[73449]:   <vcpu>1</vcpu>
Aug 17 11:44:26 user nova-compute[73449]:   <metadata>
Aug 17 11:44:26 user nova-compute[73449]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 11:44:26 user nova-compute[73449]:       <nova:package version="0.0.0"/>
Aug 17 11:44:26 user nova-compute[73449]:       <nova:name>tempest-VolumesActionsTest-instance-26898897</nova:name>
Aug 17 11:44:26 user nova-compute[73449]:       <nova:creationTime>2023-08-17 11:44:26</nova:creationTime>
Aug 17 11:44:26 user nova-compute[73449]:       <nova:flavor name="m1.tiny">
Aug 17 11:44:26 user nova-compute[73449]:         <nova:memory>512</nova:memory>
Aug 17 11:44:26 user nova-compute[73449]:         <nova:disk>1</nova:disk>
Aug 17 11:44:26 user nova-compute[73449]:         <nova:swap>0</nova:swap>
Aug 17 11:44:26 user nova-compute[73449]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 11:44:26 user nova-compute[73449]:         <nova:vcpus>1</nova:vcpus>
Aug 17 11:44:26 user nova-compute[73449]:       </nova:flavor>
Aug 17 11:44:26 user nova-compute[73449]:       <nova:owner>
Aug 17 11:44:26 user nova-compute[73449]:         <nova:user uuid="652d1ea975dc454aa4c72d74ddd8af68">tempest-VolumesActionsTest-407682915-project-member</nova:user>
Aug 17 11:44:26 user nova-compute[73449]:         <nova:project uuid="54b447696c4a49e5838ae21456bc60e3">tempest-VolumesActionsTest-407682915</nova:project>
Aug 17 11:44:26 user nova-compute[73449]:       </nova:owner>
Aug 17 11:44:26 user nova-compute[73449]:       <nova:root type="image" uuid="0a2904ae-083d-41c8-83db-343132b36148"/>
Aug 17 11:44:26 user nova-compute[73449]:       <nova:ports>
Aug 17 11:44:26 user nova-compute[73449]:         <nova:port uuid="c380d879-a174-4b76-bb8a-4ba6f215ce47">
Aug 17 11:44:26 user nova-compute[73449]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 17 11:44:26 user nova-compute[73449]:         </nova:port>
Aug 17 11:44:26 user nova-compute[73449]:       </nova:ports>
Aug 17 11:44:26 user nova-compute[73449]:     </nova:instance>
Aug 17 11:44:26 user nova-compute[73449]:   </metadata>
Aug 17 11:44:26 user nova-compute[73449]:   <sysinfo type="smbios">
Aug 17 11:44:26 user nova-compute[73449]:     <system>
Aug 17 11:44:26 user nova-compute[73449]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 11:44:26 user nova-compute[73449]:       <entry name="product">OpenStack Nova</entry>
Aug 17 11:44:26 user nova-compute[73449]:       <entry name="version">0.0.0</entry>
Aug 17 11:44:26 user nova-compute[73449]:       <entry name="serial">848599ce-8cf5-4116-b1d6-4cf9d79cfbc0</entry>
Aug 17 11:44:26 user nova-compute[73449]:       <entry name="uuid">848599ce-8cf5-4116-b1d6-4cf9d79cfbc0</entry>
Aug 17 11:44:26 user nova-compute[73449]:       <entry name="family">Virtual Machine</entry>
Aug 17 11:44:26 user nova-compute[73449]:     </system>
Aug 17 11:44:26 user nova-compute[73449]:   </sysinfo>
Aug 17 11:44:26 user nova-compute[73449]:   <os>
Aug 17 11:44:26 user nova-compute[73449]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 11:44:26 user nova-compute[73449]:     <boot dev="hd"/>
Aug 17 11:44:26 user nova-compute[73449]:     <smbios mode="sysinfo"/>
Aug 17 11:44:26 user nova-compute[73449]:   </os>
Aug 17 11:44:26 user nova-compute[73449]:   <features>
Aug 17 11:44:26 user nova-compute[73449]:     <acpi/>
Aug 17 11:44:26 user nova-compute[73449]:     <apic/>
Aug 17 11:44:26 user nova-compute[73449]:     <vmcoreinfo/>
Aug 17 11:44:26 user nova-compute[73449]:   </features>
Aug 17 11:44:26 user nova-compute[73449]:   <clock offset="utc">
Aug 17 11:44:26 user nova-compute[73449]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 11:44:26 user nova-compute[73449]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 11:44:26 user nova-compute[73449]:     <timer name="hpet" present="no"/>
Aug 17 11:44:26 user nova-compute[73449]:   </clock>
Aug 17 11:44:26 user nova-compute[73449]:   <cpu mode="custom" match="exact">
Aug 17 11:44:26 user nova-compute[73449]:     <model>Nehalem</model>
Aug 17 11:44:26 user nova-compute[73449]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 11:44:26 user nova-compute[73449]:   </cpu>
Aug 17 11:44:26 user nova-compute[73449]:   <devices>
Aug 17 11:44:26 user nova-compute[73449]:     <disk type="file" device="disk">
Aug 17 11:44:26 user nova-compute[73449]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 11:44:26 user nova-compute[73449]:       <source file="/opt/stack/data/nova/instances/848599ce-8cf5-4116-b1d6-4cf9d79cfbc0/disk"/>
Aug 17 11:44:26 user nova-compute[73449]:       <target dev="vda" bus="virtio"/>
Aug 17 11:44:26 user nova-compute[73449]:     </disk>
Aug 17 11:44:26 user nova-compute[73449]:     <interface type="ethernet">
Aug 17 11:44:26 user nova-compute[73449]:       <mac address="fa:16:3e:b0:74:52"/>
Aug 17 11:44:26 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 11:44:26 user nova-compute[73449]:       <mtu size="1442"/>
Aug 17 11:44:26 user nova-compute[73449]:       <target dev="tapc380d879-a1"/>
Aug 17 11:44:26 user nova-compute[73449]:     </interface>
Aug 17 11:44:26 user nova-compute[73449]:     <serial type="pty">
Aug 17 11:44:26 user nova-compute[73449]:       <log file="/opt/stack/data/nova/instances/848599ce-8cf5-4116-b1d6-4cf9d79cfbc0/console.log" append="off"/>
Aug 17 11:44:26 user nova-compute[73449]:     </serial>
Aug 17 11:44:26 user nova-compute[73449]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 11:44:26 user nova-compute[73449]:     <video>
Aug 17 11:44:26 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 11:44:26 user nova-compute[73449]:     </video>
Aug 17 11:44:26 user nova-compute[73449]:     <rng model="virtio">
Aug 17 11:44:26 user nova-compute[73449]:       <backend model="random">/dev/urandom</backend>
Aug 17 11:44:26 user nova-compute[73449]:     </rng>
Aug 17 11:44:26 user nova-compute[73449]:     <controller type="usb" index="0" model="none"/>
Aug 17 11:44:26 user nova-compute[73449]:     <memballoon model="virtio">
Aug 17 11:44:26 user nova-compute[73449]:       <stats period="10"/>
Aug 17 11:44:26 user nova-compute[73449]:     </memballoon>
Aug 17 11:44:26 user nova-compute[73449]:   </devices>
Aug 17 11:44:26 user nova-compute[73449]: </domain>
Aug 17 11:44:26 user nova-compute[73449]:  {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 11:44:26 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-9c07dc41-52a1-4b4b-b40a-33e89a7c829b tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:44:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-26898897',display_name='tempest-VolumesActionsTest-instance-26898897',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-26898897',id=13,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='54b447696c4a49e5838ae21456bc60e3',ramdisk_id='',reservation_id='r-yh18a1ak',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-407682915',owner_user_name='tempest-VolumesActionsTest-407682915-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T11:44:22Z,user_data=None,user_id='652d1ea975dc454aa4c72d74ddd8af68',uuid=848599ce-8cf5-4116-b1d6-4cf9d79cfbc0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c380d879-a174-4b76-bb8a-4ba6f215ce47", "address": "fa:16:3e:b0:74:52", "network": {"id": "76705db8-2e7f-449c-b512-6747bad0c324", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1601912422-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54b447696c4a49e5838ae21456bc60e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc380d879-a1", "ovs_interfaceid": "c380d879-a174-4b76-bb8a-4ba6f215ce47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 11:44:26 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-9c07dc41-52a1-4b4b-b40a-33e89a7c829b tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Converting VIF {"id": "c380d879-a174-4b76-bb8a-4ba6f215ce47", "address": "fa:16:3e:b0:74:52", "network": {"id": "76705db8-2e7f-449c-b512-6747bad0c324", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1601912422-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54b447696c4a49e5838ae21456bc60e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc380d879-a1", "ovs_interfaceid": "c380d879-a174-4b76-bb8a-4ba6f215ce47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:44:26 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-9c07dc41-52a1-4b4b-b40a-33e89a7c829b tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:74:52,bridge_name='br-int',has_traffic_filtering=True,id=c380d879-a174-4b76-bb8a-4ba6f215ce47,network=Network(76705db8-2e7f-449c-b512-6747bad0c324),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc380d879-a1') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:44:26 user nova-compute[73449]: DEBUG os_vif [None req-9c07dc41-52a1-4b4b-b40a-33e89a7c829b tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:74:52,bridge_name='br-int',has_traffic_filtering=True,id=c380d879-a174-4b76-bb8a-4ba6f215ce47,network=Network(76705db8-2e7f-449c-b512-6747bad0c324),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc380d879-a1') {{(pid=73449) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 11:44:26 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:26 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:44:26 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 11:44:26 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:26 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc380d879-a1, may_exist=True, interface_attrs={}) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:44:26 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc380d879-a1, col_values=(('external_ids', {'iface-id': 'c380d879-a174-4b76-bb8a-4ba6f215ce47', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b0:74:52', 'vm-uuid': '848599ce-8cf5-4116-b1d6-4cf9d79cfbc0'}),), if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:44:26 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:26 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:44:26 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:26 user nova-compute[73449]: INFO os_vif [None req-9c07dc41-52a1-4b4b-b40a-33e89a7c829b tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:74:52,bridge_name='br-int',has_traffic_filtering=True,id=c380d879-a174-4b76-bb8a-4ba6f215ce47,network=Network(76705db8-2e7f-449c-b512-6747bad0c324),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc380d879-a1')
Aug 17 11:44:26 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-9c07dc41-52a1-4b4b-b40a-33e89a7c829b tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] No BDM found with device name vda, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 11:44:26 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-9c07dc41-52a1-4b4b-b40a-33e89a7c829b tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] No VIF found with MAC fa:16:3e:b0:74:52, not building metadata {{(pid=73449) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 11:44:27 user nova-compute[73449]: DEBUG nova.compute.manager [req-43e9688e-1fd0-4014-b084-04714eb00654 req-c73d2ffb-21c9-4773-9c2b-67085ba53ea6 service nova] [instance: 848599ce-8cf5-4116-b1d6-4cf9d79cfbc0] Received event network-changed-c380d879-a174-4b76-bb8a-4ba6f215ce47 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:44:27 user nova-compute[73449]: DEBUG nova.compute.manager [req-43e9688e-1fd0-4014-b084-04714eb00654 req-c73d2ffb-21c9-4773-9c2b-67085ba53ea6 service nova] [instance: 848599ce-8cf5-4116-b1d6-4cf9d79cfbc0] Refreshing instance network info cache due to event network-changed-c380d879-a174-4b76-bb8a-4ba6f215ce47. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 11:44:27 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-43e9688e-1fd0-4014-b084-04714eb00654 req-c73d2ffb-21c9-4773-9c2b-67085ba53ea6 service nova] Acquiring lock "refresh_cache-848599ce-8cf5-4116-b1d6-4cf9d79cfbc0" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:44:27 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-43e9688e-1fd0-4014-b084-04714eb00654 req-c73d2ffb-21c9-4773-9c2b-67085ba53ea6 service nova] Acquired lock "refresh_cache-848599ce-8cf5-4116-b1d6-4cf9d79cfbc0" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:44:27 user nova-compute[73449]: DEBUG nova.network.neutron [req-43e9688e-1fd0-4014-b084-04714eb00654 req-c73d2ffb-21c9-4773-9c2b-67085ba53ea6 service nova] [instance: 848599ce-8cf5-4116-b1d6-4cf9d79cfbc0] Refreshing network info cache for port c380d879-a174-4b76-bb8a-4ba6f215ce47 {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 11:44:27 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:27 user nova-compute[73449]: DEBUG nova.compute.manager [req-289c68eb-72e9-4fbc-a55c-f182d6921987 req-8c0a2aeb-71ff-416d-b914-a5558c6807cd service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Received event network-vif-deleted-d2d51361-0f1a-41aa-89e2-c2211bbd0b42 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:44:27 user nova-compute[73449]: INFO nova.compute.manager [req-289c68eb-72e9-4fbc-a55c-f182d6921987 req-8c0a2aeb-71ff-416d-b914-a5558c6807cd service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Neutron deleted interface d2d51361-0f1a-41aa-89e2-c2211bbd0b42; detaching it from the instance and deleting it from the info cache
Aug 17 11:44:27 user nova-compute[73449]: DEBUG nova.network.neutron [req-289c68eb-72e9-4fbc-a55c-f182d6921987 req-8c0a2aeb-71ff-416d-b914-a5558c6807cd service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Updating instance_info_cache with network_info: [{"id": "b14f4f1d-d140-4bb9-a4f2-abbaa8c98a2d", "address": "fa:16:3e:32:bc:69", "network": {"id": "8de6c01b-e132-4efb-be00-df0968c06a81", "bridge": "br-int", "label": "tempest-device-tagging-net1-1740133735", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "92e6d918a4554cd89d9f40cee2a55d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb14f4f1d-d1", "ovs_interfaceid": "b14f4f1d-d140-4bb9-a4f2-abbaa8c98a2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d8233c69-cc4f-4ae8-93ee-7f41234f72ec", "address": "fa:16:3e:14:e4:e9", "network": {"id": "8de6c01b-e132-4efb-be00-df0968c06a81", "bridge": "br-int", "label": "tempest-device-tagging-net1-1740133735", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "92e6d918a4554cd89d9f40cee2a55d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8233c69-cc", "ovs_interfaceid": "d8233c69-cc4f-4ae8-93ee-7f41234f72ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6fbc9ad6-da42-4492-8603-9efc7294dbab", "address": "fa:16:3e:a7:14:03", "network": {"id": "8de6c01b-e132-4efb-be00-df0968c06a81", "bridge": "br-int", "label": "tempest-device-tagging-net1-1740133735", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "92e6d918a4554cd89d9f40cee2a55d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fbc9ad6-da", "ovs_interfaceid": "6fbc9ad6-da42-4492-8603-9efc7294dbab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:44:27 user nova-compute[73449]: DEBUG nova.compute.manager [req-289c68eb-72e9-4fbc-a55c-f182d6921987 req-8c0a2aeb-71ff-416d-b914-a5558c6807cd service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Detach interface failed, port_id=d2d51361-0f1a-41aa-89e2-c2211bbd0b42, reason: Instance f33a7013-82d0-477c-aa5e-b27e63f2b98d could not be found. {{(pid=73449) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 11:44:28 user nova-compute[73449]: DEBUG nova.network.neutron [-] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Updating instance_info_cache with network_info: [] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:44:28 user nova-compute[73449]: INFO nova.compute.manager [-] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Took 8.26 seconds to deallocate network for instance.
Aug 17 11:44:28 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:28 user nova-compute[73449]: DEBUG nova.network.neutron [req-43e9688e-1fd0-4014-b084-04714eb00654 req-c73d2ffb-21c9-4773-9c2b-67085ba53ea6 service nova] [instance: 848599ce-8cf5-4116-b1d6-4cf9d79cfbc0] Updated VIF entry in instance network info cache for port c380d879-a174-4b76-bb8a-4ba6f215ce47. {{(pid=73449) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 11:44:28 user nova-compute[73449]: DEBUG nova.network.neutron [req-43e9688e-1fd0-4014-b084-04714eb00654 req-c73d2ffb-21c9-4773-9c2b-67085ba53ea6 service nova] [instance: 848599ce-8cf5-4116-b1d6-4cf9d79cfbc0] Updating instance_info_cache with network_info: [{"id": "c380d879-a174-4b76-bb8a-4ba6f215ce47", "address": "fa:16:3e:b0:74:52", "network": {"id": "76705db8-2e7f-449c-b512-6747bad0c324", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1601912422-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54b447696c4a49e5838ae21456bc60e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc380d879-a1", "ovs_interfaceid": "c380d879-a174-4b76-bb8a-4ba6f215ce47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:44:28 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:28 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-43e9688e-1fd0-4014-b084-04714eb00654 req-c73d2ffb-21c9-4773-9c2b-67085ba53ea6 service nova] Releasing lock "refresh_cache-848599ce-8cf5-4116-b1d6-4cf9d79cfbc0" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:44:28 user nova-compute[73449]: DEBUG nova.compute.manager [req-43e9688e-1fd0-4014-b084-04714eb00654 req-c73d2ffb-21c9-4773-9c2b-67085ba53ea6 service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Received event network-vif-deleted-f9c9fca3-8f9c-4ea9-8ceb-ed19cb265786 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:44:28 user nova-compute[73449]: INFO nova.compute.manager [req-43e9688e-1fd0-4014-b084-04714eb00654 req-c73d2ffb-21c9-4773-9c2b-67085ba53ea6 service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Neutron deleted interface f9c9fca3-8f9c-4ea9-8ceb-ed19cb265786; detaching it from the instance and deleting it from the info cache
Aug 17 11:44:28 user nova-compute[73449]: DEBUG nova.network.neutron [req-43e9688e-1fd0-4014-b084-04714eb00654 req-c73d2ffb-21c9-4773-9c2b-67085ba53ea6 service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Updating instance_info_cache with network_info: [{"id": "71d82cc1-6895-4d52-b066-0a01a61b329b", "address": "fa:16:3e:48:bc:7c", "network": {"id": "2c2340dc-7ea1-4f63-8819-47844b2a536e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1423531895", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "60c18371fa6246888a742164afd60242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71d82cc1-68", "ovs_interfaceid": "71d82cc1-6895-4d52-b066-0a01a61b329b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b3fe8f9e-5b75-440e-b1c1-f888a4e91e9e", "address": "fa:16:3e:0e:2e:4c", "network": {"id": "2c2340dc-7ea1-4f63-8819-47844b2a536e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1423531895", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "60c18371fa6246888a742164afd60242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3fe8f9e-5b", "ovs_interfaceid": "b3fe8f9e-5b75-440e-b1c1-f888a4e91e9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6888cb29-a1bc-42b0-bec3-57667e1b0350", "address": "fa:16:3e:6e:07:1b", "network": {"id": "2c2340dc-7ea1-4f63-8819-47844b2a536e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1423531895", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "60c18371fa6246888a742164afd60242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6888cb29-a1", "ovs_interfaceid": "6888cb29-a1bc-42b0-bec3-57667e1b0350", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d85896ce-110a-41d6-a20e-6beaecb36b97", "address": "fa:16:3e:e3:51:d1", "network": {"id": "8244e7f5-12cf-4ab5-baa2-956f148fc51f", "bridge": "br-int", "label": "tempest-device-tagging-net2-163620727", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "60c18371fa6246888a742164afd60242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd85896ce-11", "ovs_interfaceid": "d85896ce-110a-41d6-a20e-6beaecb36b97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "671f57db-57f1-4ba3-9e49-ebe4816404f6", "address": "fa:16:3e:04:1d:3e", "network": {"id": "8244e7f5-12cf-4ab5-baa2-956f148fc51f", "bridge": "br-int", "label": "tempest-device-tagging-net2-163620727", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "60c18371fa6246888a742164afd60242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap671f57db-57", "ovs_interfaceid": "671f57db-57f1-4ba3-9e49-ebe4816404f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:44:28 user nova-compute[73449]: DEBUG nova.compute.manager [req-43e9688e-1fd0-4014-b084-04714eb00654 req-c73d2ffb-21c9-4773-9c2b-67085ba53ea6 service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Detach interface failed, port_id=f9c9fca3-8f9c-4ea9-8ceb-ed19cb265786, reason: Instance b8e1def1-8303-4257-b9b5-0050f05cf2d0 could not be found. {{(pid=73449) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 11:44:28 user nova-compute[73449]: DEBUG nova.compute.manager [req-43e9688e-1fd0-4014-b084-04714eb00654 req-c73d2ffb-21c9-4773-9c2b-67085ba53ea6 service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Received event network-vif-deleted-671f57db-57f1-4ba3-9e49-ebe4816404f6 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:44:28 user nova-compute[73449]: INFO nova.compute.manager [req-43e9688e-1fd0-4014-b084-04714eb00654 req-c73d2ffb-21c9-4773-9c2b-67085ba53ea6 service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Neutron deleted interface 671f57db-57f1-4ba3-9e49-ebe4816404f6; detaching it from the instance and deleting it from the info cache
Aug 17 11:44:28 user nova-compute[73449]: DEBUG nova.network.neutron [req-43e9688e-1fd0-4014-b084-04714eb00654 req-c73d2ffb-21c9-4773-9c2b-67085ba53ea6 service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Updating instance_info_cache with network_info: [{"id": "71d82cc1-6895-4d52-b066-0a01a61b329b", "address": "fa:16:3e:48:bc:7c", "network": {"id": "2c2340dc-7ea1-4f63-8819-47844b2a536e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1423531895", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "60c18371fa6246888a742164afd60242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71d82cc1-68", "ovs_interfaceid": "71d82cc1-6895-4d52-b066-0a01a61b329b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b3fe8f9e-5b75-440e-b1c1-f888a4e91e9e", "address": "fa:16:3e:0e:2e:4c", "network": {"id": "2c2340dc-7ea1-4f63-8819-47844b2a536e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1423531895", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "60c18371fa6246888a742164afd60242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3fe8f9e-5b", "ovs_interfaceid": "b3fe8f9e-5b75-440e-b1c1-f888a4e91e9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6888cb29-a1bc-42b0-bec3-57667e1b0350", "address": "fa:16:3e:6e:07:1b", "network": {"id": "2c2340dc-7ea1-4f63-8819-47844b2a536e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1423531895", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "60c18371fa6246888a742164afd60242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6888cb29-a1", "ovs_interfaceid": "6888cb29-a1bc-42b0-bec3-57667e1b0350", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d85896ce-110a-41d6-a20e-6beaecb36b97", "address": "fa:16:3e:e3:51:d1", "network": {"id": "8244e7f5-12cf-4ab5-baa2-956f148fc51f", "bridge": "br-int", "label": "tempest-device-tagging-net2-163620727", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "60c18371fa6246888a742164afd60242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd85896ce-11", "ovs_interfaceid": "d85896ce-110a-41d6-a20e-6beaecb36b97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:44:28 user nova-compute[73449]: DEBUG nova.compute.manager [req-43e9688e-1fd0-4014-b084-04714eb00654 req-c73d2ffb-21c9-4773-9c2b-67085ba53ea6 service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Detach interface failed, port_id=671f57db-57f1-4ba3-9e49-ebe4816404f6, reason: Instance b8e1def1-8303-4257-b9b5-0050f05cf2d0 could not be found. {{(pid=73449) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 11:44:28 user nova-compute[73449]: DEBUG nova.compute.manager [req-43e9688e-1fd0-4014-b084-04714eb00654 req-c73d2ffb-21c9-4773-9c2b-67085ba53ea6 service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Received event network-vif-deleted-6888cb29-a1bc-42b0-bec3-57667e1b0350 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:44:28 user nova-compute[73449]: INFO nova.compute.manager [req-43e9688e-1fd0-4014-b084-04714eb00654 req-c73d2ffb-21c9-4773-9c2b-67085ba53ea6 service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Neutron deleted interface 6888cb29-a1bc-42b0-bec3-57667e1b0350; detaching it from the instance and deleting it from the info cache
Aug 17 11:44:28 user nova-compute[73449]: DEBUG nova.network.neutron [req-43e9688e-1fd0-4014-b084-04714eb00654 req-c73d2ffb-21c9-4773-9c2b-67085ba53ea6 service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Updating instance_info_cache with network_info: [{"id": "71d82cc1-6895-4d52-b066-0a01a61b329b", "address": "fa:16:3e:48:bc:7c", "network": {"id": "2c2340dc-7ea1-4f63-8819-47844b2a536e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1423531895", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "60c18371fa6246888a742164afd60242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71d82cc1-68", "ovs_interfaceid": "71d82cc1-6895-4d52-b066-0a01a61b329b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b3fe8f9e-5b75-440e-b1c1-f888a4e91e9e", "address": "fa:16:3e:0e:2e:4c", "network": {"id": "2c2340dc-7ea1-4f63-8819-47844b2a536e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1423531895", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "60c18371fa6246888a742164afd60242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3fe8f9e-5b", "ovs_interfaceid": "b3fe8f9e-5b75-440e-b1c1-f888a4e91e9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d85896ce-110a-41d6-a20e-6beaecb36b97", "address": "fa:16:3e:e3:51:d1", "network": {"id": "8244e7f5-12cf-4ab5-baa2-956f148fc51f", "bridge": "br-int", "label": "tempest-device-tagging-net2-163620727", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "60c18371fa6246888a742164afd60242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd85896ce-11", "ovs_interfaceid": "d85896ce-110a-41d6-a20e-6beaecb36b97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:44:28 user nova-compute[73449]: DEBUG nova.compute.manager [req-43e9688e-1fd0-4014-b084-04714eb00654 req-c73d2ffb-21c9-4773-9c2b-67085ba53ea6 service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Detach interface failed, port_id=6888cb29-a1bc-42b0-bec3-57667e1b0350, reason: Instance b8e1def1-8303-4257-b9b5-0050f05cf2d0 could not be found. {{(pid=73449) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 11:44:28 user nova-compute[73449]: DEBUG nova.network.neutron [-] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Updating instance_info_cache with network_info: [] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:44:28 user nova-compute[73449]: INFO nova.compute.manager [-] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Took 8.66 seconds to deallocate network for instance.
Aug 17 11:44:29 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:29 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:29 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:29 user nova-compute[73449]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692272654.700448, b8e1def1-8303-4257-b9b5-0050f05cf2d0 => Stopped> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:44:29 user nova-compute[73449]: INFO nova.compute.manager [-] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] VM Stopped (Lifecycle Event)
Aug 17 11:44:29 user nova-compute[73449]: DEBUG nova.compute.manager [None req-7c2efae7-1159-4a24-834a-547164914b46 None None] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:44:29 user nova-compute[73449]: DEBUG nova.compute.manager [req-e5bf00c8-ef15-4904-894d-fa164977e51b req-f204695b-fa87-49e2-af67-007f19cdf94f service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Received event network-vif-deleted-d85896ce-110a-41d6-a20e-6beaecb36b97 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:44:29 user nova-compute[73449]: INFO nova.compute.manager [req-e5bf00c8-ef15-4904-894d-fa164977e51b req-f204695b-fa87-49e2-af67-007f19cdf94f service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Neutron deleted interface d85896ce-110a-41d6-a20e-6beaecb36b97; detaching it from the instance and deleting it from the info cache
Aug 17 11:44:29 user nova-compute[73449]: DEBUG nova.network.neutron [req-e5bf00c8-ef15-4904-894d-fa164977e51b req-f204695b-fa87-49e2-af67-007f19cdf94f service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Updating instance_info_cache with network_info: [{"id": "71d82cc1-6895-4d52-b066-0a01a61b329b", "address": "fa:16:3e:48:bc:7c", "network": {"id": "2c2340dc-7ea1-4f63-8819-47844b2a536e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1423531895", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "60c18371fa6246888a742164afd60242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71d82cc1-68", "ovs_interfaceid": "71d82cc1-6895-4d52-b066-0a01a61b329b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b3fe8f9e-5b75-440e-b1c1-f888a4e91e9e", "address": "fa:16:3e:0e:2e:4c", "network": {"id": "2c2340dc-7ea1-4f63-8819-47844b2a536e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1423531895", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "60c18371fa6246888a742164afd60242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3fe8f9e-5b", "ovs_interfaceid": "b3fe8f9e-5b75-440e-b1c1-f888a4e91e9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:44:29 user nova-compute[73449]: DEBUG nova.compute.manager [req-e5bf00c8-ef15-4904-894d-fa164977e51b req-f204695b-fa87-49e2-af67-007f19cdf94f service nova] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Detach interface failed, port_id=d85896ce-110a-41d6-a20e-6beaecb36b97, reason: Instance b8e1def1-8303-4257-b9b5-0050f05cf2d0 could not be found. {{(pid=73449) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 11:44:29 user nova-compute[73449]: DEBUG nova.compute.manager [req-e5bf00c8-ef15-4904-894d-fa164977e51b req-f204695b-fa87-49e2-af67-007f19cdf94f service nova] [instance: 848599ce-8cf5-4116-b1d6-4cf9d79cfbc0] Received event network-vif-plugged-c380d879-a174-4b76-bb8a-4ba6f215ce47 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:44:29 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-e5bf00c8-ef15-4904-894d-fa164977e51b req-f204695b-fa87-49e2-af67-007f19cdf94f service nova] Acquiring lock "848599ce-8cf5-4116-b1d6-4cf9d79cfbc0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:44:29 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-e5bf00c8-ef15-4904-894d-fa164977e51b req-f204695b-fa87-49e2-af67-007f19cdf94f service nova] Lock "848599ce-8cf5-4116-b1d6-4cf9d79cfbc0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:44:29 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-e5bf00c8-ef15-4904-894d-fa164977e51b req-f204695b-fa87-49e2-af67-007f19cdf94f service nova] Lock "848599ce-8cf5-4116-b1d6-4cf9d79cfbc0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:44:29 user nova-compute[73449]: DEBUG nova.compute.manager [req-e5bf00c8-ef15-4904-894d-fa164977e51b req-f204695b-fa87-49e2-af67-007f19cdf94f service nova] [instance: 848599ce-8cf5-4116-b1d6-4cf9d79cfbc0] No waiting events found dispatching network-vif-plugged-c380d879-a174-4b76-bb8a-4ba6f215ce47 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:44:29 user nova-compute[73449]: WARNING nova.compute.manager [req-e5bf00c8-ef15-4904-894d-fa164977e51b req-f204695b-fa87-49e2-af67-007f19cdf94f service nova] [instance: 848599ce-8cf5-4116-b1d6-4cf9d79cfbc0] Received unexpected event network-vif-plugged-c380d879-a174-4b76-bb8a-4ba6f215ce47 for instance with vm_state building and task_state spawning.
Aug 17 11:44:29 user nova-compute[73449]: DEBUG nova.compute.manager [req-e5bf00c8-ef15-4904-894d-fa164977e51b req-f204695b-fa87-49e2-af67-007f19cdf94f service nova] [instance: 848599ce-8cf5-4116-b1d6-4cf9d79cfbc0] Received event network-vif-plugged-c380d879-a174-4b76-bb8a-4ba6f215ce47 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:44:29 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-e5bf00c8-ef15-4904-894d-fa164977e51b req-f204695b-fa87-49e2-af67-007f19cdf94f service nova] Acquiring lock "848599ce-8cf5-4116-b1d6-4cf9d79cfbc0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:44:29 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-e5bf00c8-ef15-4904-894d-fa164977e51b req-f204695b-fa87-49e2-af67-007f19cdf94f service nova] Lock "848599ce-8cf5-4116-b1d6-4cf9d79cfbc0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:44:29 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-e5bf00c8-ef15-4904-894d-fa164977e51b req-f204695b-fa87-49e2-af67-007f19cdf94f service nova] Lock "848599ce-8cf5-4116-b1d6-4cf9d79cfbc0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:44:29 user nova-compute[73449]: DEBUG nova.compute.manager [req-e5bf00c8-ef15-4904-894d-fa164977e51b req-f204695b-fa87-49e2-af67-007f19cdf94f service nova] [instance: 848599ce-8cf5-4116-b1d6-4cf9d79cfbc0] No waiting events found dispatching network-vif-plugged-c380d879-a174-4b76-bb8a-4ba6f215ce47 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:44:29 user nova-compute[73449]: WARNING nova.compute.manager [req-e5bf00c8-ef15-4904-894d-fa164977e51b req-f204695b-fa87-49e2-af67-007f19cdf94f service nova] [instance: 848599ce-8cf5-4116-b1d6-4cf9d79cfbc0] Received unexpected event network-vif-plugged-c380d879-a174-4b76-bb8a-4ba6f215ce47 for instance with vm_state building and task_state spawning.
Aug 17 11:44:30 user nova-compute[73449]: DEBUG nova.compute.manager [req-b4e4e192-3032-43e1-b0b5-2fad76b7d517 req-fc6a69f1-0a26-4905-bf2e-f13d42086db9 service nova] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Received event network-vif-deleted-6fbc9ad6-da42-4492-8603-9efc7294dbab {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:44:31 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692272671.1225832, 848599ce-8cf5-4116-b1d6-4cf9d79cfbc0 => Resumed> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:44:31 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 848599ce-8cf5-4116-b1d6-4cf9d79cfbc0] VM Resumed (Lifecycle Event)
Aug 17 11:44:31 user nova-compute[73449]: DEBUG nova.compute.manager [None req-9c07dc41-52a1-4b4b-b40a-33e89a7c829b tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] [instance: 848599ce-8cf5-4116-b1d6-4cf9d79cfbc0] Instance event wait completed in 0 seconds for  {{(pid=73449) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 11:44:31 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-9c07dc41-52a1-4b4b-b40a-33e89a7c829b tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] [instance: 848599ce-8cf5-4116-b1d6-4cf9d79cfbc0] Guest created on hypervisor {{(pid=73449) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 11:44:31 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: 848599ce-8cf5-4116-b1d6-4cf9d79cfbc0] Instance spawned successfully.
Aug 17 11:44:31 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-9c07dc41-52a1-4b4b-b40a-33e89a7c829b tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] [instance: 848599ce-8cf5-4116-b1d6-4cf9d79cfbc0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 11:44:31 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 848599ce-8cf5-4116-b1d6-4cf9d79cfbc0] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:44:31 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 848599ce-8cf5-4116-b1d6-4cf9d79cfbc0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 11:44:31 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 848599ce-8cf5-4116-b1d6-4cf9d79cfbc0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 11:44:31 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692272671.1241236, 848599ce-8cf5-4116-b1d6-4cf9d79cfbc0 => Started> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:44:31 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 848599ce-8cf5-4116-b1d6-4cf9d79cfbc0] VM Started (Lifecycle Event)
Aug 17 11:44:31 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-9c07dc41-52a1-4b4b-b40a-33e89a7c829b tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] [instance: 848599ce-8cf5-4116-b1d6-4cf9d79cfbc0] Found default for hw_cdrom_bus of ide {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:44:31 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-9c07dc41-52a1-4b4b-b40a-33e89a7c829b tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] [instance: 848599ce-8cf5-4116-b1d6-4cf9d79cfbc0] Found default for hw_disk_bus of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:44:31 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-9c07dc41-52a1-4b4b-b40a-33e89a7c829b tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] [instance: 848599ce-8cf5-4116-b1d6-4cf9d79cfbc0] Found default for hw_input_bus of None {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:44:31 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-9c07dc41-52a1-4b4b-b40a-33e89a7c829b tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] [instance: 848599ce-8cf5-4116-b1d6-4cf9d79cfbc0] Found default for hw_pointer_model of None {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:44:31 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-9c07dc41-52a1-4b4b-b40a-33e89a7c829b tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] [instance: 848599ce-8cf5-4116-b1d6-4cf9d79cfbc0] Found default for hw_video_model of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:44:31 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-9c07dc41-52a1-4b4b-b40a-33e89a7c829b tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] [instance: 848599ce-8cf5-4116-b1d6-4cf9d79cfbc0] Found default for hw_vif_model of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:44:31 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 848599ce-8cf5-4116-b1d6-4cf9d79cfbc0] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:44:31 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 848599ce-8cf5-4116-b1d6-4cf9d79cfbc0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 11:44:31 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 848599ce-8cf5-4116-b1d6-4cf9d79cfbc0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 11:44:31 user nova-compute[73449]: INFO nova.compute.manager [None req-9c07dc41-52a1-4b4b-b40a-33e89a7c829b tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] [instance: 848599ce-8cf5-4116-b1d6-4cf9d79cfbc0] Took 9.11 seconds to spawn the instance on the hypervisor.
Aug 17 11:44:31 user nova-compute[73449]: DEBUG nova.compute.manager [None req-9c07dc41-52a1-4b4b-b40a-33e89a7c829b tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] [instance: 848599ce-8cf5-4116-b1d6-4cf9d79cfbc0] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:44:31 user nova-compute[73449]: INFO nova.compute.manager [None req-9c07dc41-52a1-4b4b-b40a-33e89a7c829b tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] [instance: 848599ce-8cf5-4116-b1d6-4cf9d79cfbc0] Took 10.08 seconds to build instance.
Aug 17 11:44:31 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-9c07dc41-52a1-4b4b-b40a-33e89a7c829b tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Lock "848599ce-8cf5-4116-b1d6-4cf9d79cfbc0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.262s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:44:31 user nova-compute[73449]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692272656.4797492, f33a7013-82d0-477c-aa5e-b27e63f2b98d => Stopped> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:44:31 user nova-compute[73449]: INFO nova.compute.manager [-] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] VM Stopped (Lifecycle Event)
Aug 17 11:44:31 user nova-compute[73449]: DEBUG nova.compute.manager [None req-243fa4b0-f929-41d5-a519-208b87a143cb None None] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:44:31 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:32 user nova-compute[73449]: INFO nova.compute.manager [None req-c76e1520-aa01-4454-afff-d65d9424aaef tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] [instance: f33a7013-82d0-477c-aa5e-b27e63f2b98d] Took 3.20 seconds to detach 3 volumes for instance.
Aug 17 11:44:32 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-c76e1520-aa01-4454-afff-d65d9424aaef tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:44:32 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-c76e1520-aa01-4454-afff-d65d9424aaef tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:44:32 user nova-compute[73449]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692272657.453966, c7ef11da-09ce-47a1-ba56-02af6a77206c => Stopped> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:44:32 user nova-compute[73449]: INFO nova.compute.manager [-] [instance: c7ef11da-09ce-47a1-ba56-02af6a77206c] VM Stopped (Lifecycle Event)
Aug 17 11:44:32 user nova-compute[73449]: DEBUG nova.compute.manager [None req-5bbe4d32-9644-4963-823f-9585f118b5be None None] [instance: c7ef11da-09ce-47a1-ba56-02af6a77206c] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:44:32 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-c76e1520-aa01-4454-afff-d65d9424aaef tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 11:44:32 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-c76e1520-aa01-4454-afff-d65d9424aaef tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 11:44:32 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-c76e1520-aa01-4454-afff-d65d9424aaef tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.488s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:44:32 user nova-compute[73449]: INFO nova.scheduler.client.report [None req-c76e1520-aa01-4454-afff-d65d9424aaef tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Deleted allocations for instance f33a7013-82d0-477c-aa5e-b27e63f2b98d
Aug 17 11:44:32 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:32 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-c76e1520-aa01-4454-afff-d65d9424aaef tempest-TaggedBootDevicesTest-1794254085 tempest-TaggedBootDevicesTest-1794254085-project-member] Lock "f33a7013-82d0-477c-aa5e-b27e63f2b98d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 18.406s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:44:33 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:36 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:36 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:37 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:37 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:40 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:41 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:42 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:43 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:44:44 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:44:46 user nova-compute[73449]: INFO nova.compute.manager [None req-4b0ec35b-339a-4406-b9b2-e0ee3e20a645 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] [instance: b8e1def1-8303-4257-b9b5-0050f05cf2d0] Took 17.87 seconds to detach 3 volumes for instance.
Aug 17 11:44:46 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-4b0ec35b-339a-4406-b9b2-e0ee3e20a645 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:44:46 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-4b0ec35b-339a-4406-b9b2-e0ee3e20a645 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:44:46 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-4b0ec35b-339a-4406-b9b2-e0ee3e20a645 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 11:44:46 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-4b0ec35b-339a-4406-b9b2-e0ee3e20a645 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 11:44:46 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-4b0ec35b-339a-4406-b9b2-e0ee3e20a645 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.414s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:44:46 user nova-compute[73449]: INFO nova.scheduler.client.report [None req-4b0ec35b-339a-4406-b9b2-e0ee3e20a645 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Deleted allocations for instance b8e1def1-8303-4257-b9b5-0050f05cf2d0
Aug 17 11:44:46 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-4b0ec35b-339a-4406-b9b2-e0ee3e20a645 tempest-TaggedBootDevicesTest_v242-1289726527 tempest-TaggedBootDevicesTest_v242-1289726527-project-member] Lock "b8e1def1-8303-4257-b9b5-0050f05cf2d0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 35.072s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:44:46 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:46 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:44:47 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:47 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:47 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:44:47 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:44:47 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73449) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 11:44:49 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:44:49 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:44:49 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:44:49 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:44:49 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:44:49 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=73449) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 11:44:50 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:50 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a9e8ad2-19db-4975-87e4-2efce603a7d7/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:44:50 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a9e8ad2-19db-4975-87e4-2efce603a7d7/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:44:50 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a9e8ad2-19db-4975-87e4-2efce603a7d7/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:44:50 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a9e8ad2-19db-4975-87e4-2efce603a7d7/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:44:50 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3523d22-7165-46ad-be10-5e6ae374f91d/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:44:50 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3523d22-7165-46ad-be10-5e6ae374f91d/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:44:50 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3523d22-7165-46ad-be10-5e6ae374f91d/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:44:50 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3523d22-7165-46ad-be10-5e6ae374f91d/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:44:51 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=73449) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 11:44:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3523d22-7165-46ad-be10-5e6ae374f91d/disk.rescue --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:44:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3523d22-7165-46ad-be10-5e6ae374f91d/disk.rescue --force-share --output=json" returned: 0 in 0.240s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:44:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3523d22-7165-46ad-be10-5e6ae374f91d/disk.rescue --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:44:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3523d22-7165-46ad-be10-5e6ae374f91d/disk.rescue --force-share --output=json" returned: 0 in 0.230s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:44:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:44:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:44:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:44:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:44:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e5229d5-65a2-4d60-8e50-c30357372a80/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:44:51 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:52 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e5229d5-65a2-4d60-8e50-c30357372a80/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:44:52 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e5229d5-65a2-4d60-8e50-c30357372a80/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:44:52 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e5229d5-65a2-4d60-8e50-c30357372a80/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:44:52 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/848599ce-8cf5-4116-b1d6-4cf9d79cfbc0/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:44:52 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/848599ce-8cf5-4116-b1d6-4cf9d79cfbc0/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:44:52 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/848599ce-8cf5-4116-b1d6-4cf9d79cfbc0/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:44:52 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:52 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/848599ce-8cf5-4116-b1d6-4cf9d79cfbc0/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:44:52 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f35b7f2b-2f88-4b09-86ac-cb5a78a94584/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:44:53 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f35b7f2b-2f88-4b09-86ac-cb5a78a94584/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:44:53 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f35b7f2b-2f88-4b09-86ac-cb5a78a94584/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:44:53 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f35b7f2b-2f88-4b09-86ac-cb5a78a94584/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:44:53 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:53 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:44:53 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:44:53 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Hypervisor/Node resource view: name=user free_ram=7734MB free_disk=25.469409942626953GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73449) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 11:44:53 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:44:53 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:44:53 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 4a9e8ad2-19db-4975-87e4-2efce603a7d7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:44:53 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance a3523d22-7165-46ad-be10-5e6ae374f91d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:44:53 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:44:53 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 5e5229d5-65a2-4d60-8e50-c30357372a80 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:44:53 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance f35b7f2b-2f88-4b09-86ac-cb5a78a94584 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:44:53 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 848599ce-8cf5-4116-b1d6-4cf9d79cfbc0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:44:53 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=73449) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 11:44:54 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=73449) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 11:44:54 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 11:44:54 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 11:44:54 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Compute_service record updated for user:user {{(pid=73449) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 11:44:54 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.501s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:44:55 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:44:55 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:44:55 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Starting heal instance info cache {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 11:44:55 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Didn't find any instances for network info cache update. {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 11:44:56 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:56 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:57 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:58 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:58 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:44:59 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-5da3ce2d-9195-42ac-b065-5f310c535a68 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Acquiring lock "b12d9412-be17-4908-a4c2-b80c0fa38fc0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:44:59 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-5da3ce2d-9195-42ac-b065-5f310c535a68 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Lock "b12d9412-be17-4908-a4c2-b80c0fa38fc0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:44:59 user nova-compute[73449]: DEBUG nova.compute.manager [None req-5da3ce2d-9195-42ac-b065-5f310c535a68 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: b12d9412-be17-4908-a4c2-b80c0fa38fc0] Starting instance... {{(pid=73449) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 11:44:59 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-5da3ce2d-9195-42ac-b065-5f310c535a68 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:44:59 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-5da3ce2d-9195-42ac-b065-5f310c535a68 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:44:59 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-5da3ce2d-9195-42ac-b065-5f310c535a68 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73449) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 11:44:59 user nova-compute[73449]: INFO nova.compute.claims [None req-5da3ce2d-9195-42ac-b065-5f310c535a68 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: b12d9412-be17-4908-a4c2-b80c0fa38fc0] Claim successful on node user
Aug 17 11:44:59 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-5da3ce2d-9195-42ac-b065-5f310c535a68 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 11:45:00 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-5da3ce2d-9195-42ac-b065-5f310c535a68 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 11:45:00 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-5da3ce2d-9195-42ac-b065-5f310c535a68 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.468s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:45:00 user nova-compute[73449]: DEBUG nova.compute.manager [None req-5da3ce2d-9195-42ac-b065-5f310c535a68 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: b12d9412-be17-4908-a4c2-b80c0fa38fc0] Start building networks asynchronously for instance. {{(pid=73449) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 11:45:00 user nova-compute[73449]: DEBUG nova.compute.manager [None req-5da3ce2d-9195-42ac-b065-5f310c535a68 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: b12d9412-be17-4908-a4c2-b80c0fa38fc0] Allocating IP information in the background. {{(pid=73449) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 11:45:00 user nova-compute[73449]: DEBUG nova.network.neutron [None req-5da3ce2d-9195-42ac-b065-5f310c535a68 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: b12d9412-be17-4908-a4c2-b80c0fa38fc0] allocate_for_instance() {{(pid=73449) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 11:45:00 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-5da3ce2d-9195-42ac-b065-5f310c535a68 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: b12d9412-be17-4908-a4c2-b80c0fa38fc0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 11:45:00 user nova-compute[73449]: DEBUG nova.compute.manager [None req-5da3ce2d-9195-42ac-b065-5f310c535a68 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: b12d9412-be17-4908-a4c2-b80c0fa38fc0] Start building block device mappings for instance. {{(pid=73449) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 11:45:00 user nova-compute[73449]: INFO nova.virt.block_device [None req-5da3ce2d-9195-42ac-b065-5f310c535a68 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: b12d9412-be17-4908-a4c2-b80c0fa38fc0] Booting with volume snapshot f3eb00d2-13a7-4295-b985-c184f8a6206b at /dev/vda
Aug 17 11:45:00 user nova-compute[73449]: DEBUG nova.policy [None req-5da3ce2d-9195-42ac-b065-5f310c535a68 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '804ccb0440fb46a4a4c0ae65c3893296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd46cdaff7a4b40955f7c8a12c55452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73449) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 11:45:01 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:45:02 user nova-compute[73449]: DEBUG nova.network.neutron [None req-5da3ce2d-9195-42ac-b065-5f310c535a68 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: b12d9412-be17-4908-a4c2-b80c0fa38fc0] Successfully created port: be4bd89d-1a52-49a7-8241-ca24224fb018 {{(pid=73449) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 11:45:02 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:45:02 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:45:03 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:45:03 user nova-compute[73449]: DEBUG nova.network.neutron [None req-5da3ce2d-9195-42ac-b065-5f310c535a68 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: b12d9412-be17-4908-a4c2-b80c0fa38fc0] Successfully updated port: be4bd89d-1a52-49a7-8241-ca24224fb018 {{(pid=73449) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 11:45:03 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-5da3ce2d-9195-42ac-b065-5f310c535a68 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Acquiring lock "refresh_cache-b12d9412-be17-4908-a4c2-b80c0fa38fc0" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:45:03 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-5da3ce2d-9195-42ac-b065-5f310c535a68 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Acquired lock "refresh_cache-b12d9412-be17-4908-a4c2-b80c0fa38fc0" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:45:03 user nova-compute[73449]: DEBUG nova.network.neutron [None req-5da3ce2d-9195-42ac-b065-5f310c535a68 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: b12d9412-be17-4908-a4c2-b80c0fa38fc0] Building network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 11:45:03 user nova-compute[73449]: DEBUG nova.network.neutron [None req-5da3ce2d-9195-42ac-b065-5f310c535a68 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: b12d9412-be17-4908-a4c2-b80c0fa38fc0] Instance cache missing network info. {{(pid=73449) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 11:45:03 user nova-compute[73449]: DEBUG nova.compute.manager [req-3f6a923a-96d1-4d95-bd4e-09039a1b8790 req-7512c320-a1bd-4a55-b9c7-5d5a15e3a7ac service nova] [instance: b12d9412-be17-4908-a4c2-b80c0fa38fc0] Received event network-changed-be4bd89d-1a52-49a7-8241-ca24224fb018 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:45:03 user nova-compute[73449]: DEBUG nova.compute.manager [req-3f6a923a-96d1-4d95-bd4e-09039a1b8790 req-7512c320-a1bd-4a55-b9c7-5d5a15e3a7ac service nova] [instance: b12d9412-be17-4908-a4c2-b80c0fa38fc0] Refreshing instance network info cache due to event network-changed-be4bd89d-1a52-49a7-8241-ca24224fb018. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 11:45:03 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-3f6a923a-96d1-4d95-bd4e-09039a1b8790 req-7512c320-a1bd-4a55-b9c7-5d5a15e3a7ac service nova] Acquiring lock "refresh_cache-b12d9412-be17-4908-a4c2-b80c0fa38fc0" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:45:04 user nova-compute[73449]: DEBUG nova.network.neutron [None req-5da3ce2d-9195-42ac-b065-5f310c535a68 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: b12d9412-be17-4908-a4c2-b80c0fa38fc0] Updating instance_info_cache with network_info: [{"id": "be4bd89d-1a52-49a7-8241-ca24224fb018", "address": "fa:16:3e:f6:25:6f", "network": {"id": "a9e8fcd6-4152-466b-99ad-44b85db05a05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-920564935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bd46cdaff7a4b40955f7c8a12c55452", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe4bd89d-1a", "ovs_interfaceid": "be4bd89d-1a52-49a7-8241-ca24224fb018", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:45:04 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-5da3ce2d-9195-42ac-b065-5f310c535a68 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Releasing lock "refresh_cache-b12d9412-be17-4908-a4c2-b80c0fa38fc0" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:45:04 user nova-compute[73449]: DEBUG nova.compute.manager [None req-5da3ce2d-9195-42ac-b065-5f310c535a68 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: b12d9412-be17-4908-a4c2-b80c0fa38fc0] Instance network_info: |[{"id": "be4bd89d-1a52-49a7-8241-ca24224fb018", "address": "fa:16:3e:f6:25:6f", "network": {"id": "a9e8fcd6-4152-466b-99ad-44b85db05a05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-920564935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bd46cdaff7a4b40955f7c8a12c55452", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe4bd89d-1a", "ovs_interfaceid": "be4bd89d-1a52-49a7-8241-ca24224fb018", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73449) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 11:45:04 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-3f6a923a-96d1-4d95-bd4e-09039a1b8790 req-7512c320-a1bd-4a55-b9c7-5d5a15e3a7ac service nova] Acquired lock "refresh_cache-b12d9412-be17-4908-a4c2-b80c0fa38fc0" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:45:04 user nova-compute[73449]: DEBUG nova.network.neutron [req-3f6a923a-96d1-4d95-bd4e-09039a1b8790 req-7512c320-a1bd-4a55-b9c7-5d5a15e3a7ac service nova] [instance: b12d9412-be17-4908-a4c2-b80c0fa38fc0] Refreshing network info cache for port be4bd89d-1a52-49a7-8241-ca24224fb018 {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 11:45:05 user nova-compute[73449]: DEBUG nova.network.neutron [req-3f6a923a-96d1-4d95-bd4e-09039a1b8790 req-7512c320-a1bd-4a55-b9c7-5d5a15e3a7ac service nova] [instance: b12d9412-be17-4908-a4c2-b80c0fa38fc0] Updated VIF entry in instance network info cache for port be4bd89d-1a52-49a7-8241-ca24224fb018. {{(pid=73449) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 11:45:05 user nova-compute[73449]: DEBUG nova.network.neutron [req-3f6a923a-96d1-4d95-bd4e-09039a1b8790 req-7512c320-a1bd-4a55-b9c7-5d5a15e3a7ac service nova] [instance: b12d9412-be17-4908-a4c2-b80c0fa38fc0] Updating instance_info_cache with network_info: [{"id": "be4bd89d-1a52-49a7-8241-ca24224fb018", "address": "fa:16:3e:f6:25:6f", "network": {"id": "a9e8fcd6-4152-466b-99ad-44b85db05a05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-920564935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bd46cdaff7a4b40955f7c8a12c55452", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe4bd89d-1a", "ovs_interfaceid": "be4bd89d-1a52-49a7-8241-ca24224fb018", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:45:05 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-3f6a923a-96d1-4d95-bd4e-09039a1b8790 req-7512c320-a1bd-4a55-b9c7-5d5a15e3a7ac service nova] Releasing lock "refresh_cache-b12d9412-be17-4908-a4c2-b80c0fa38fc0" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:45:06 user nova-compute[73449]: DEBUG os_brick.utils [None req-5da3ce2d-9195-42ac-b065-5f310c535a68 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 11:45:06 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:45:06 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:45:06 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5fe53de-fa36-44b1-b175-b5fd5e7180e0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4d3924302012\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:45:06 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:45:06 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:45:06 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d25df45-fd70-47a7-b071-4121442ce862]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:45:06 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:45:06 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:45:06 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffa08880-e0b5-4823-b27b-08e20d732872]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:45:06 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b1eac33-d86e-4bba-b667-0610a5bfa283]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:45:06 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-5da3ce2d-9195-42ac-b065-5f310c535a68 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Running cmd (subprocess): nvme version {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:45:06 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-5da3ce2d-9195-42ac-b065-5f310c535a68 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] 'nvme version' failed. Not Retrying. {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 11:45:06 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5da3ce2d-9195-42ac-b065-5f310c535a68 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] nvme not present on system {{(pid=73449) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 11:45:06 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:45:06 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 11:45:06 user nova-compute[73449]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 11:45:06 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[b51c00dc-1c29-4171-9803-bff2900c29f5]: (4, '') {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:45:06 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-5da3ce2d-9195-42ac-b065-5f310c535a68 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73449) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 11:45:06 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-5da3ce2d-9195-42ac-b065-5f310c535a68 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73449) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 11:45:06 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-5da3ce2d-9195-42ac-b065-5f310c535a68 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] LIGHTOS: no hostnqn found. {{(pid=73449) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 11:45:06 user nova-compute[73449]: DEBUG os_brick.utils [None req-5da3ce2d-9195-42ac-b065-5f310c535a68 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4d3924302012', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 11:45:06 user nova-compute[73449]: DEBUG nova.virt.block_device [None req-5da3ce2d-9195-42ac-b065-5f310c535a68 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: b12d9412-be17-4908-a4c2-b80c0fa38fc0] Updating existing volume attachment record: 356be55a-e1c6-4594-aba4-32e5cde38e23 {{(pid=73449) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 11:45:06 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:45:07 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:45:07 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:45:08 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-3b9c4a69-bf21-4b00-8715-5655ae905b0e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Acquiring lock "de5084e1-5a5e-48d2-a3ef-7f29898d1d2d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:45:08 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-3b9c4a69-bf21-4b00-8715-5655ae905b0e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Lock "de5084e1-5a5e-48d2-a3ef-7f29898d1d2d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:45:08 user nova-compute[73449]: DEBUG nova.compute.manager [None req-3b9c4a69-bf21-4b00-8715-5655ae905b0e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] Starting instance... {{(pid=73449) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 11:45:08 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-3b9c4a69-bf21-4b00-8715-5655ae905b0e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:45:08 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-3b9c4a69-bf21-4b00-8715-5655ae905b0e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:45:08 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-3b9c4a69-bf21-4b00-8715-5655ae905b0e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73449) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 11:45:08 user nova-compute[73449]: INFO nova.compute.claims [None req-3b9c4a69-bf21-4b00-8715-5655ae905b0e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] Claim successful on node user
Aug 17 11:45:09 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-3b9c4a69-bf21-4b00-8715-5655ae905b0e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 11:45:09 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-3b9c4a69-bf21-4b00-8715-5655ae905b0e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 11:45:09 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-3b9c4a69-bf21-4b00-8715-5655ae905b0e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.527s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:45:09 user nova-compute[73449]: DEBUG nova.compute.manager [None req-3b9c4a69-bf21-4b00-8715-5655ae905b0e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] Start building networks asynchronously for instance. {{(pid=73449) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 11:45:09 user nova-compute[73449]: DEBUG nova.compute.manager [None req-3b9c4a69-bf21-4b00-8715-5655ae905b0e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] Allocating IP information in the background. {{(pid=73449) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 11:45:09 user nova-compute[73449]: DEBUG nova.network.neutron [None req-3b9c4a69-bf21-4b00-8715-5655ae905b0e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] allocate_for_instance() {{(pid=73449) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 11:45:09 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-3b9c4a69-bf21-4b00-8715-5655ae905b0e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 11:45:09 user nova-compute[73449]: DEBUG nova.compute.manager [None req-3b9c4a69-bf21-4b00-8715-5655ae905b0e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] Start building block device mappings for instance. {{(pid=73449) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 11:45:09 user nova-compute[73449]: DEBUG nova.policy [None req-3b9c4a69-bf21-4b00-8715-5655ae905b0e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a388f1f7e6254e8cace000ec1249d6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ba3ebf47bd4b999e68c74a5c0ab060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73449) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 11:45:09 user nova-compute[73449]: DEBUG nova.compute.manager [None req-3b9c4a69-bf21-4b00-8715-5655ae905b0e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] Start spawning the instance on the hypervisor. {{(pid=73449) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 11:45:09 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-3b9c4a69-bf21-4b00-8715-5655ae905b0e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] Creating instance directory {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 11:45:09 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-3b9c4a69-bf21-4b00-8715-5655ae905b0e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] Creating image(s)
Aug 17 11:45:09 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-3b9c4a69-bf21-4b00-8715-5655ae905b0e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Acquiring lock "/opt/stack/data/nova/instances/de5084e1-5a5e-48d2-a3ef-7f29898d1d2d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:45:09 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-3b9c4a69-bf21-4b00-8715-5655ae905b0e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Lock "/opt/stack/data/nova/instances/de5084e1-5a5e-48d2-a3ef-7f29898d1d2d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:45:09 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-3b9c4a69-bf21-4b00-8715-5655ae905b0e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Lock "/opt/stack/data/nova/instances/de5084e1-5a5e-48d2-a3ef-7f29898d1d2d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:45:09 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-3b9c4a69-bf21-4b00-8715-5655ae905b0e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Acquiring lock "666f7b25567510f45761a65277e1eb0e52001fde" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:45:09 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-3b9c4a69-bf21-4b00-8715-5655ae905b0e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Lock "666f7b25567510f45761a65277e1eb0e52001fde" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:45:10 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-3b9c4a69-bf21-4b00-8715-5655ae905b0e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/666f7b25567510f45761a65277e1eb0e52001fde.part --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:45:10 user nova-compute[73449]: DEBUG nova.network.neutron [None req-3b9c4a69-bf21-4b00-8715-5655ae905b0e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] Successfully created port: e2af7fce-7442-48b4-8611-da3171b0672b {{(pid=73449) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 11:45:10 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-3b9c4a69-bf21-4b00-8715-5655ae905b0e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/666f7b25567510f45761a65277e1eb0e52001fde.part --force-share --output=json" returned: 0 in 0.247s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:45:10 user nova-compute[73449]: DEBUG nova.virt.images [None req-3b9c4a69-bf21-4b00-8715-5655ae905b0e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] fb1d2645-7169-4a0c-a0b3-f384ea3ca6ee was qcow2, converting to raw {{(pid=73449) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 17 11:45:10 user nova-compute[73449]: DEBUG nova.privsep.utils [None req-3b9c4a69-bf21-4b00-8715-5655ae905b0e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73449) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 11:45:10 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-3b9c4a69-bf21-4b00-8715-5655ae905b0e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/666f7b25567510f45761a65277e1eb0e52001fde.part /opt/stack/data/nova/instances/_base/666f7b25567510f45761a65277e1eb0e52001fde.converted {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:45:10 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-3b9c4a69-bf21-4b00-8715-5655ae905b0e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/666f7b25567510f45761a65277e1eb0e52001fde.part /opt/stack/data/nova/instances/_base/666f7b25567510f45761a65277e1eb0e52001fde.converted" returned: 0 in 0.286s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:45:10 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-3b9c4a69-bf21-4b00-8715-5655ae905b0e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/666f7b25567510f45761a65277e1eb0e52001fde.converted --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:45:10 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-3b9c4a69-bf21-4b00-8715-5655ae905b0e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/666f7b25567510f45761a65277e1eb0e52001fde.converted --force-share --output=json" returned: 0 in 0.250s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:45:10 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-3b9c4a69-bf21-4b00-8715-5655ae905b0e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Lock "666f7b25567510f45761a65277e1eb0e52001fde" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.499s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:45:10 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-3b9c4a69-bf21-4b00-8715-5655ae905b0e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/666f7b25567510f45761a65277e1eb0e52001fde --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:45:11 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-3b9c4a69-bf21-4b00-8715-5655ae905b0e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/666f7b25567510f45761a65277e1eb0e52001fde --force-share --output=json" returned: 0 in 0.259s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:45:11 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-3b9c4a69-bf21-4b00-8715-5655ae905b0e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Acquiring lock "666f7b25567510f45761a65277e1eb0e52001fde" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:45:11 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-3b9c4a69-bf21-4b00-8715-5655ae905b0e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Lock "666f7b25567510f45761a65277e1eb0e52001fde" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:45:11 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-3b9c4a69-bf21-4b00-8715-5655ae905b0e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/666f7b25567510f45761a65277e1eb0e52001fde --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:45:11 user nova-compute[73449]: DEBUG nova.network.neutron [None req-3b9c4a69-bf21-4b00-8715-5655ae905b0e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] Successfully updated port: e2af7fce-7442-48b4-8611-da3171b0672b {{(pid=73449) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 11:45:11 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-3b9c4a69-bf21-4b00-8715-5655ae905b0e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Acquiring lock "refresh_cache-de5084e1-5a5e-48d2-a3ef-7f29898d1d2d" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:45:11 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-3b9c4a69-bf21-4b00-8715-5655ae905b0e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Acquired lock "refresh_cache-de5084e1-5a5e-48d2-a3ef-7f29898d1d2d" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:45:11 user nova-compute[73449]: DEBUG nova.network.neutron [None req-3b9c4a69-bf21-4b00-8715-5655ae905b0e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] Building network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 11:45:11 user nova-compute[73449]: DEBUG nova.compute.manager [req-31ae42bb-b46a-4230-95c3-2239d49dc983 req-eeab8dbf-4107-4217-9298-7ac4d4f15527 service nova] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] Received event network-changed-e2af7fce-7442-48b4-8611-da3171b0672b {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:45:11 user nova-compute[73449]: DEBUG nova.compute.manager [req-31ae42bb-b46a-4230-95c3-2239d49dc983 req-eeab8dbf-4107-4217-9298-7ac4d4f15527 service nova] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] Refreshing instance network info cache due to event network-changed-e2af7fce-7442-48b4-8611-da3171b0672b. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 11:45:11 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-31ae42bb-b46a-4230-95c3-2239d49dc983 req-eeab8dbf-4107-4217-9298-7ac4d4f15527 service nova] Acquiring lock "refresh_cache-de5084e1-5a5e-48d2-a3ef-7f29898d1d2d" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:45:11 user nova-compute[73449]: DEBUG nova.network.neutron [None req-3b9c4a69-bf21-4b00-8715-5655ae905b0e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] Instance cache missing network info. {{(pid=73449) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 11:45:11 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-3b9c4a69-bf21-4b00-8715-5655ae905b0e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/666f7b25567510f45761a65277e1eb0e52001fde --force-share --output=json" returned: 0 in 0.190s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:45:11 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-3b9c4a69-bf21-4b00-8715-5655ae905b0e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/666f7b25567510f45761a65277e1eb0e52001fde,backing_fmt=raw /opt/stack/data/nova/instances/de5084e1-5a5e-48d2-a3ef-7f29898d1d2d/disk 1073741824 {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:45:11 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-3b9c4a69-bf21-4b00-8715-5655ae905b0e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/666f7b25567510f45761a65277e1eb0e52001fde,backing_fmt=raw /opt/stack/data/nova/instances/de5084e1-5a5e-48d2-a3ef-7f29898d1d2d/disk 1073741824" returned: 0 in 0.060s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:45:11 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-3b9c4a69-bf21-4b00-8715-5655ae905b0e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Lock "666f7b25567510f45761a65277e1eb0e52001fde" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.255s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:45:11 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-3b9c4a69-bf21-4b00-8715-5655ae905b0e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/666f7b25567510f45761a65277e1eb0e52001fde --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:45:11 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-3b9c4a69-bf21-4b00-8715-5655ae905b0e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/666f7b25567510f45761a65277e1eb0e52001fde --force-share --output=json" returned: 0 in 0.185s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:45:11 user nova-compute[73449]: DEBUG nova.virt.disk.api [None req-3b9c4a69-bf21-4b00-8715-5655ae905b0e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Checking if we can resize image /opt/stack/data/nova/instances/de5084e1-5a5e-48d2-a3ef-7f29898d1d2d/disk. size=1073741824 {{(pid=73449) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 11:45:11 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-3b9c4a69-bf21-4b00-8715-5655ae905b0e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de5084e1-5a5e-48d2-a3ef-7f29898d1d2d/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:45:11 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:45:11 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-3b9c4a69-bf21-4b00-8715-5655ae905b0e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de5084e1-5a5e-48d2-a3ef-7f29898d1d2d/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:45:11 user nova-compute[73449]: DEBUG nova.virt.disk.api [None req-3b9c4a69-bf21-4b00-8715-5655ae905b0e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Cannot resize image /opt/stack/data/nova/instances/de5084e1-5a5e-48d2-a3ef-7f29898d1d2d/disk to a smaller size. {{(pid=73449) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 11:45:11 user nova-compute[73449]: DEBUG nova.objects.instance [None req-3b9c4a69-bf21-4b00-8715-5655ae905b0e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Lazy-loading 'migration_context' on Instance uuid de5084e1-5a5e-48d2-a3ef-7f29898d1d2d {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:45:11 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-3b9c4a69-bf21-4b00-8715-5655ae905b0e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] Created local disks {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 11:45:11 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-3b9c4a69-bf21-4b00-8715-5655ae905b0e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] Ensure instance console log exists: /opt/stack/data/nova/instances/de5084e1-5a5e-48d2-a3ef-7f29898d1d2d/console.log {{(pid=73449) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 11:45:11 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-3b9c4a69-bf21-4b00-8715-5655ae905b0e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:45:11 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-3b9c4a69-bf21-4b00-8715-5655ae905b0e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:45:11 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-3b9c4a69-bf21-4b00-8715-5655ae905b0e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:45:11 user nova-compute[73449]: DEBUG nova.network.neutron [None req-3b9c4a69-bf21-4b00-8715-5655ae905b0e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] Updating instance_info_cache with network_info: [{"id": "e2af7fce-7442-48b4-8611-da3171b0672b", "address": "fa:16:3e:c0:c8:a6", "network": {"id": "ff73f5c3-bae6-46cc-bcb8-bbd5be1b478d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1229197917-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5ba3ebf47bd4b999e68c74a5c0ab060", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2af7fce-74", "ovs_interfaceid": "e2af7fce-7442-48b4-8611-da3171b0672b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:45:11 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-3b9c4a69-bf21-4b00-8715-5655ae905b0e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Releasing lock "refresh_cache-de5084e1-5a5e-48d2-a3ef-7f29898d1d2d" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:45:11 user nova-compute[73449]: DEBUG nova.compute.manager [None req-3b9c4a69-bf21-4b00-8715-5655ae905b0e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] Instance network_info: |[{"id": "e2af7fce-7442-48b4-8611-da3171b0672b", "address": "fa:16:3e:c0:c8:a6", "network": {"id": "ff73f5c3-bae6-46cc-bcb8-bbd5be1b478d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1229197917-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5ba3ebf47bd4b999e68c74a5c0ab060", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2af7fce-74", "ovs_interfaceid": "e2af7fce-7442-48b4-8611-da3171b0672b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73449) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 11:45:11 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-31ae42bb-b46a-4230-95c3-2239d49dc983 req-eeab8dbf-4107-4217-9298-7ac4d4f15527 service nova] Acquired lock "refresh_cache-de5084e1-5a5e-48d2-a3ef-7f29898d1d2d" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:45:11 user nova-compute[73449]: DEBUG nova.network.neutron [req-31ae42bb-b46a-4230-95c3-2239d49dc983 req-eeab8dbf-4107-4217-9298-7ac4d4f15527 service nova] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] Refreshing network info cache for port e2af7fce-7442-48b4-8611-da3171b0672b {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 11:45:11 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-3b9c4a69-bf21-4b00-8715-5655ae905b0e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] Start _get_guest_xml network_info=[{"id": "e2af7fce-7442-48b4-8611-da3171b0672b", "address": "fa:16:3e:c0:c8:a6", "network": {"id": "ff73f5c3-bae6-46cc-bcb8-bbd5be1b478d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1229197917-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5ba3ebf47bd4b999e68c74a5c0ab060", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2af7fce-74", "ovs_interfaceid": "e2af7fce-7442-48b4-8611-da3171b0672b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T11:45:04Z,direct_url=<?>,disk_format='qcow2',id=fb1d2645-7169-4a0c-a0b3-f384ea3ca6ee,min_disk=0,min_ram=0,name='tempest-scenario-img--1242051369',owner='b5ba3ebf47bd4b999e68c74a5c0ab060',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T11:45:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': 'fb1d2645-7169-4a0c-a0b3-f384ea3ca6ee'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 11:45:11 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-3b9c4a69-bf21-4b00-8715-5655ae905b0e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:45:11 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-3b9c4a69-bf21-4b00-8715-5655ae905b0e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:45:11 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-3b9c4a69-bf21-4b00-8715-5655ae905b0e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 11:45:11 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-3b9c4a69-bf21-4b00-8715-5655ae905b0e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] CPU controller missing on host. {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 11:45:11 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-3b9c4a69-bf21-4b00-8715-5655ae905b0e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 11:45:11 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-3b9c4a69-bf21-4b00-8715-5655ae905b0e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] CPU controller found on host. {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 11:45:11 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-3b9c4a69-bf21-4b00-8715-5655ae905b0e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73449) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 11:45:11 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-3b9c4a69-bf21-4b00-8715-5655ae905b0e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T11:35:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T11:45:04Z,direct_url=<?>,disk_format='qcow2',id=fb1d2645-7169-4a0c-a0b3-f384ea3ca6ee,min_disk=0,min_ram=0,name='tempest-scenario-img--1242051369',owner='b5ba3ebf47bd4b999e68c74a5c0ab060',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T11:45:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 11:45:11 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-3b9c4a69-bf21-4b00-8715-5655ae905b0e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Flavor limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 11:45:11 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-3b9c4a69-bf21-4b00-8715-5655ae905b0e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Image limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 11:45:11 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-3b9c4a69-bf21-4b00-8715-5655ae905b0e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Flavor pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 11:45:11 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-3b9c4a69-bf21-4b00-8715-5655ae905b0e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Image pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 11:45:11 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-3b9c4a69-bf21-4b00-8715-5655ae905b0e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 11:45:11 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-3b9c4a69-bf21-4b00-8715-5655ae905b0e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 11:45:11 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-3b9c4a69-bf21-4b00-8715-5655ae905b0e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 11:45:11 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-3b9c4a69-bf21-4b00-8715-5655ae905b0e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Got 1 possible topologies {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 11:45:11 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-3b9c4a69-bf21-4b00-8715-5655ae905b0e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 11:45:11 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-3b9c4a69-bf21-4b00-8715-5655ae905b0e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 11:45:11 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-3b9c4a69-bf21-4b00-8715-5655ae905b0e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:45:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1351274734',display_name='tempest-TestMinimumBasicScenario-server-1351274734',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1351274734',id=15,image_ref='fb1d2645-7169-4a0c-a0b3-f384ea3ca6ee',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK6F1KbqG2L7a63s8u4cdTuNvzTcmprfe52KFjhIPaxJjtgOgScs7eLTzZK2UKsaCKRsFSlnWB9z6cQbolaXqixSV5LaBk/UTgveylZJ3QdcXGKc0GT695r/cb4yrtsjUA==',key_name='tempest-TestMinimumBasicScenario-1748788689',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b5ba3ebf47bd4b999e68c74a5c0ab060',ramdisk_id='',reservation_id='r-yy0x01ti',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fb1d2645-7169-4a0c-a0b3-f384ea3ca6ee',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1063498076',owner_user_name='tempest-TestMinimumBasicScenario-1063498076-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T11:45:09Z,user_data=None,user_id='a388f1f7e6254e8cace000ec1249d6c6',uuid=de5084e1-5a5e-48d2-a3ef-7f29898d1d2d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e2af7fce-7442-48b4-8611-da3171b0672b", "address": "fa:16:3e:c0:c8:a6", "network": {"id": "ff73f5c3-bae6-46cc-bcb8-bbd5be1b478d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1229197917-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5ba3ebf47bd4b999e68c74a5c0ab060", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2af7fce-74", "ovs_interfaceid": "e2af7fce-7442-48b4-8611-da3171b0672b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73449) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 11:45:11 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-3b9c4a69-bf21-4b00-8715-5655ae905b0e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Converting VIF {"id": "e2af7fce-7442-48b4-8611-da3171b0672b", "address": "fa:16:3e:c0:c8:a6", "network": {"id": "ff73f5c3-bae6-46cc-bcb8-bbd5be1b478d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1229197917-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5ba3ebf47bd4b999e68c74a5c0ab060", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2af7fce-74", "ovs_interfaceid": "e2af7fce-7442-48b4-8611-da3171b0672b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:45:11 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-3b9c4a69-bf21-4b00-8715-5655ae905b0e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:c8:a6,bridge_name='br-int',has_traffic_filtering=True,id=e2af7fce-7442-48b4-8611-da3171b0672b,network=Network(ff73f5c3-bae6-46cc-bcb8-bbd5be1b478d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2af7fce-74') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:45:11 user nova-compute[73449]: DEBUG nova.objects.instance [None req-3b9c4a69-bf21-4b00-8715-5655ae905b0e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Lazy-loading 'pci_devices' on Instance uuid de5084e1-5a5e-48d2-a3ef-7f29898d1d2d {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:45:11 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:45:12 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-3b9c4a69-bf21-4b00-8715-5655ae905b0e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] End _get_guest_xml xml=<domain type="kvm">
Aug 17 11:45:12 user nova-compute[73449]:   <uuid>de5084e1-5a5e-48d2-a3ef-7f29898d1d2d</uuid>
Aug 17 11:45:12 user nova-compute[73449]:   <name>instance-0000000f</name>
Aug 17 11:45:12 user nova-compute[73449]:   <memory>524288</memory>
Aug 17 11:45:12 user nova-compute[73449]:   <vcpu>1</vcpu>
Aug 17 11:45:12 user nova-compute[73449]:   <metadata>
Aug 17 11:45:12 user nova-compute[73449]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 11:45:12 user nova-compute[73449]:       <nova:package version="0.0.0"/>
Aug 17 11:45:12 user nova-compute[73449]:       <nova:name>tempest-TestMinimumBasicScenario-server-1351274734</nova:name>
Aug 17 11:45:12 user nova-compute[73449]:       <nova:creationTime>2023-08-17 11:45:11</nova:creationTime>
Aug 17 11:45:12 user nova-compute[73449]:       <nova:flavor name="m1.tiny">
Aug 17 11:45:12 user nova-compute[73449]:         <nova:memory>512</nova:memory>
Aug 17 11:45:12 user nova-compute[73449]:         <nova:disk>1</nova:disk>
Aug 17 11:45:12 user nova-compute[73449]:         <nova:swap>0</nova:swap>
Aug 17 11:45:12 user nova-compute[73449]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 11:45:12 user nova-compute[73449]:         <nova:vcpus>1</nova:vcpus>
Aug 17 11:45:12 user nova-compute[73449]:       </nova:flavor>
Aug 17 11:45:12 user nova-compute[73449]:       <nova:owner>
Aug 17 11:45:12 user nova-compute[73449]:         <nova:user uuid="a388f1f7e6254e8cace000ec1249d6c6">tempest-TestMinimumBasicScenario-1063498076-project-member</nova:user>
Aug 17 11:45:12 user nova-compute[73449]:         <nova:project uuid="b5ba3ebf47bd4b999e68c74a5c0ab060">tempest-TestMinimumBasicScenario-1063498076</nova:project>
Aug 17 11:45:12 user nova-compute[73449]:       </nova:owner>
Aug 17 11:45:12 user nova-compute[73449]:       <nova:root type="image" uuid="fb1d2645-7169-4a0c-a0b3-f384ea3ca6ee"/>
Aug 17 11:45:12 user nova-compute[73449]:       <nova:ports>
Aug 17 11:45:12 user nova-compute[73449]:         <nova:port uuid="e2af7fce-7442-48b4-8611-da3171b0672b">
Aug 17 11:45:12 user nova-compute[73449]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 17 11:45:12 user nova-compute[73449]:         </nova:port>
Aug 17 11:45:12 user nova-compute[73449]:       </nova:ports>
Aug 17 11:45:12 user nova-compute[73449]:     </nova:instance>
Aug 17 11:45:12 user nova-compute[73449]:   </metadata>
Aug 17 11:45:12 user nova-compute[73449]:   <sysinfo type="smbios">
Aug 17 11:45:12 user nova-compute[73449]:     <system>
Aug 17 11:45:12 user nova-compute[73449]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 11:45:12 user nova-compute[73449]:       <entry name="product">OpenStack Nova</entry>
Aug 17 11:45:12 user nova-compute[73449]:       <entry name="version">0.0.0</entry>
Aug 17 11:45:12 user nova-compute[73449]:       <entry name="serial">de5084e1-5a5e-48d2-a3ef-7f29898d1d2d</entry>
Aug 17 11:45:12 user nova-compute[73449]:       <entry name="uuid">de5084e1-5a5e-48d2-a3ef-7f29898d1d2d</entry>
Aug 17 11:45:12 user nova-compute[73449]:       <entry name="family">Virtual Machine</entry>
Aug 17 11:45:12 user nova-compute[73449]:     </system>
Aug 17 11:45:12 user nova-compute[73449]:   </sysinfo>
Aug 17 11:45:12 user nova-compute[73449]:   <os>
Aug 17 11:45:12 user nova-compute[73449]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 11:45:12 user nova-compute[73449]:     <boot dev="hd"/>
Aug 17 11:45:12 user nova-compute[73449]:     <smbios mode="sysinfo"/>
Aug 17 11:45:12 user nova-compute[73449]:   </os>
Aug 17 11:45:12 user nova-compute[73449]:   <features>
Aug 17 11:45:12 user nova-compute[73449]:     <acpi/>
Aug 17 11:45:12 user nova-compute[73449]:     <apic/>
Aug 17 11:45:12 user nova-compute[73449]:     <vmcoreinfo/>
Aug 17 11:45:12 user nova-compute[73449]:   </features>
Aug 17 11:45:12 user nova-compute[73449]:   <clock offset="utc">
Aug 17 11:45:12 user nova-compute[73449]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 11:45:12 user nova-compute[73449]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 11:45:12 user nova-compute[73449]:     <timer name="hpet" present="no"/>
Aug 17 11:45:12 user nova-compute[73449]:   </clock>
Aug 17 11:45:12 user nova-compute[73449]:   <cpu mode="custom" match="exact">
Aug 17 11:45:12 user nova-compute[73449]:     <model>Nehalem</model>
Aug 17 11:45:12 user nova-compute[73449]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 11:45:12 user nova-compute[73449]:   </cpu>
Aug 17 11:45:12 user nova-compute[73449]:   <devices>
Aug 17 11:45:12 user nova-compute[73449]:     <disk type="file" device="disk">
Aug 17 11:45:12 user nova-compute[73449]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 11:45:12 user nova-compute[73449]:       <source file="/opt/stack/data/nova/instances/de5084e1-5a5e-48d2-a3ef-7f29898d1d2d/disk"/>
Aug 17 11:45:12 user nova-compute[73449]:       <target dev="vda" bus="virtio"/>
Aug 17 11:45:12 user nova-compute[73449]:     </disk>
Aug 17 11:45:12 user nova-compute[73449]:     <interface type="ethernet">
Aug 17 11:45:12 user nova-compute[73449]:       <mac address="fa:16:3e:c0:c8:a6"/>
Aug 17 11:45:12 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 11:45:12 user nova-compute[73449]:       <mtu size="1442"/>
Aug 17 11:45:12 user nova-compute[73449]:       <target dev="tape2af7fce-74"/>
Aug 17 11:45:12 user nova-compute[73449]:     </interface>
Aug 17 11:45:12 user nova-compute[73449]:     <serial type="pty">
Aug 17 11:45:12 user nova-compute[73449]:       <log file="/opt/stack/data/nova/instances/de5084e1-5a5e-48d2-a3ef-7f29898d1d2d/console.log" append="off"/>
Aug 17 11:45:12 user nova-compute[73449]:     </serial>
Aug 17 11:45:12 user nova-compute[73449]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 11:45:12 user nova-compute[73449]:     <video>
Aug 17 11:45:12 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 11:45:12 user nova-compute[73449]:     </video>
Aug 17 11:45:12 user nova-compute[73449]:     <rng model="virtio">
Aug 17 11:45:12 user nova-compute[73449]:       <backend model="random">/dev/urandom</backend>
Aug 17 11:45:12 user nova-compute[73449]:     </rng>
Aug 17 11:45:12 user nova-compute[73449]:     <controller type="usb" index="0" model="none"/>
Aug 17 11:45:12 user nova-compute[73449]:     <memballoon model="virtio">
Aug 17 11:45:12 user nova-compute[73449]:       <stats period="10"/>
Aug 17 11:45:12 user nova-compute[73449]:     </memballoon>
Aug 17 11:45:12 user nova-compute[73449]:   </devices>
Aug 17 11:45:12 user nova-compute[73449]: </domain>
Aug 17 11:45:12 user nova-compute[73449]:  {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 11:45:12 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-3b9c4a69-bf21-4b00-8715-5655ae905b0e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:45:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1351274734',display_name='tempest-TestMinimumBasicScenario-server-1351274734',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1351274734',id=15,image_ref='fb1d2645-7169-4a0c-a0b3-f384ea3ca6ee',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK6F1KbqG2L7a63s8u4cdTuNvzTcmprfe52KFjhIPaxJjtgOgScs7eLTzZK2UKsaCKRsFSlnWB9z6cQbolaXqixSV5LaBk/UTgveylZJ3QdcXGKc0GT695r/cb4yrtsjUA==',key_name='tempest-TestMinimumBasicScenario-1748788689',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b5ba3ebf47bd4b999e68c74a5c0ab060',ramdisk_id='',reservation_id='r-yy0x01ti',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fb1d2645-7169-4a0c-a0b3-f384ea3ca6ee',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1063498076',owner_user_name='tempest-TestMinimumBasicScenario-1063498076-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T11:45:09Z,user_data=None,user_id='a388f1f7e6254e8cace000ec1249d6c6',uuid=de5084e1-5a5e-48d2-a3ef-7f29898d1d2d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e2af7fce-7442-48b4-8611-da3171b0672b", "address": "fa:16:3e:c0:c8:a6", "network": {"id": "ff73f5c3-bae6-46cc-bcb8-bbd5be1b478d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1229197917-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5ba3ebf47bd4b999e68c74a5c0ab060", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2af7fce-74", "ovs_interfaceid": "e2af7fce-7442-48b4-8611-da3171b0672b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 11:45:12 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-3b9c4a69-bf21-4b00-8715-5655ae905b0e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Converting VIF {"id": "e2af7fce-7442-48b4-8611-da3171b0672b", "address": "fa:16:3e:c0:c8:a6", "network": {"id": "ff73f5c3-bae6-46cc-bcb8-bbd5be1b478d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1229197917-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5ba3ebf47bd4b999e68c74a5c0ab060", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2af7fce-74", "ovs_interfaceid": "e2af7fce-7442-48b4-8611-da3171b0672b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:45:12 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-3b9c4a69-bf21-4b00-8715-5655ae905b0e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:c8:a6,bridge_name='br-int',has_traffic_filtering=True,id=e2af7fce-7442-48b4-8611-da3171b0672b,network=Network(ff73f5c3-bae6-46cc-bcb8-bbd5be1b478d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2af7fce-74') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:45:12 user nova-compute[73449]: DEBUG os_vif [None req-3b9c4a69-bf21-4b00-8715-5655ae905b0e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:c8:a6,bridge_name='br-int',has_traffic_filtering=True,id=e2af7fce-7442-48b4-8611-da3171b0672b,network=Network(ff73f5c3-bae6-46cc-bcb8-bbd5be1b478d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2af7fce-74') {{(pid=73449) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 11:45:12 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:45:12 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:45:12 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 11:45:12 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:45:12 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape2af7fce-74, may_exist=True, interface_attrs={}) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:45:12 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape2af7fce-74, col_values=(('external_ids', {'iface-id': 'e2af7fce-7442-48b4-8611-da3171b0672b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c0:c8:a6', 'vm-uuid': 'de5084e1-5a5e-48d2-a3ef-7f29898d1d2d'}),), if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:45:12 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:45:12 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:45:12 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:45:12 user nova-compute[73449]: INFO os_vif [None req-3b9c4a69-bf21-4b00-8715-5655ae905b0e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:c8:a6,bridge_name='br-int',has_traffic_filtering=True,id=e2af7fce-7442-48b4-8611-da3171b0672b,network=Network(ff73f5c3-bae6-46cc-bcb8-bbd5be1b478d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2af7fce-74')
Aug 17 11:45:12 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-3b9c4a69-bf21-4b00-8715-5655ae905b0e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] No BDM found with device name vda, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 11:45:12 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-3b9c4a69-bf21-4b00-8715-5655ae905b0e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] No VIF found with MAC fa:16:3e:c0:c8:a6, not building metadata {{(pid=73449) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 11:45:12 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:45:12 user nova-compute[73449]: DEBUG nova.network.neutron [req-31ae42bb-b46a-4230-95c3-2239d49dc983 req-eeab8dbf-4107-4217-9298-7ac4d4f15527 service nova] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] Updated VIF entry in instance network info cache for port e2af7fce-7442-48b4-8611-da3171b0672b. {{(pid=73449) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 11:45:12 user nova-compute[73449]: DEBUG nova.network.neutron [req-31ae42bb-b46a-4230-95c3-2239d49dc983 req-eeab8dbf-4107-4217-9298-7ac4d4f15527 service nova] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] Updating instance_info_cache with network_info: [{"id": "e2af7fce-7442-48b4-8611-da3171b0672b", "address": "fa:16:3e:c0:c8:a6", "network": {"id": "ff73f5c3-bae6-46cc-bcb8-bbd5be1b478d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1229197917-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5ba3ebf47bd4b999e68c74a5c0ab060", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2af7fce-74", "ovs_interfaceid": "e2af7fce-7442-48b4-8611-da3171b0672b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:45:12 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-31ae42bb-b46a-4230-95c3-2239d49dc983 req-eeab8dbf-4107-4217-9298-7ac4d4f15527 service nova] Releasing lock "refresh_cache-de5084e1-5a5e-48d2-a3ef-7f29898d1d2d" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:45:12 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:45:13 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:45:13 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:45:13 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:45:14 user nova-compute[73449]: DEBUG nova.compute.manager [req-b5e10484-b644-4cb9-8ce0-bef12a9877bc req-78dafdeb-a1a5-4ac6-b2a8-96572f1fff94 service nova] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] Received event network-vif-plugged-e2af7fce-7442-48b4-8611-da3171b0672b {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:45:14 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-b5e10484-b644-4cb9-8ce0-bef12a9877bc req-78dafdeb-a1a5-4ac6-b2a8-96572f1fff94 service nova] Acquiring lock "de5084e1-5a5e-48d2-a3ef-7f29898d1d2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:45:14 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-b5e10484-b644-4cb9-8ce0-bef12a9877bc req-78dafdeb-a1a5-4ac6-b2a8-96572f1fff94 service nova] Lock "de5084e1-5a5e-48d2-a3ef-7f29898d1d2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:45:14 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-b5e10484-b644-4cb9-8ce0-bef12a9877bc req-78dafdeb-a1a5-4ac6-b2a8-96572f1fff94 service nova] Lock "de5084e1-5a5e-48d2-a3ef-7f29898d1d2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:45:14 user nova-compute[73449]: DEBUG nova.compute.manager [req-b5e10484-b644-4cb9-8ce0-bef12a9877bc req-78dafdeb-a1a5-4ac6-b2a8-96572f1fff94 service nova] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] No waiting events found dispatching network-vif-plugged-e2af7fce-7442-48b4-8611-da3171b0672b {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:45:14 user nova-compute[73449]: WARNING nova.compute.manager [req-b5e10484-b644-4cb9-8ce0-bef12a9877bc req-78dafdeb-a1a5-4ac6-b2a8-96572f1fff94 service nova] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] Received unexpected event network-vif-plugged-e2af7fce-7442-48b4-8611-da3171b0672b for instance with vm_state building and task_state spawning.
Aug 17 11:45:14 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:45:14 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:45:14 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:45:15 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:45:15 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692272715.9807534, de5084e1-5a5e-48d2-a3ef-7f29898d1d2d => Resumed> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:45:15 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] VM Resumed (Lifecycle Event)
Aug 17 11:45:15 user nova-compute[73449]: DEBUG nova.compute.manager [None req-3b9c4a69-bf21-4b00-8715-5655ae905b0e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] Instance event wait completed in 0 seconds for  {{(pid=73449) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 11:45:15 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-3b9c4a69-bf21-4b00-8715-5655ae905b0e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] Guest created on hypervisor {{(pid=73449) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 11:45:15 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] Instance spawned successfully.
Aug 17 11:45:15 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-3b9c4a69-bf21-4b00-8715-5655ae905b0e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 11:45:16 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:45:16 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 11:45:16 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-3b9c4a69-bf21-4b00-8715-5655ae905b0e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] Found default for hw_cdrom_bus of ide {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:45:16 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-3b9c4a69-bf21-4b00-8715-5655ae905b0e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] Found default for hw_disk_bus of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:45:16 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-3b9c4a69-bf21-4b00-8715-5655ae905b0e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] Found default for hw_input_bus of None {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:45:16 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-3b9c4a69-bf21-4b00-8715-5655ae905b0e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] Found default for hw_pointer_model of None {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:45:16 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-3b9c4a69-bf21-4b00-8715-5655ae905b0e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] Found default for hw_video_model of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:45:16 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-3b9c4a69-bf21-4b00-8715-5655ae905b0e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] Found default for hw_vif_model of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:45:16 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 11:45:16 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692272715.9820454, de5084e1-5a5e-48d2-a3ef-7f29898d1d2d => Started> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:45:16 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] VM Started (Lifecycle Event)
Aug 17 11:45:16 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:45:16 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 11:45:16 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 11:45:16 user nova-compute[73449]: INFO nova.compute.manager [None req-3b9c4a69-bf21-4b00-8715-5655ae905b0e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] Took 6.74 seconds to spawn the instance on the hypervisor.
Aug 17 11:45:16 user nova-compute[73449]: DEBUG nova.compute.manager [None req-3b9c4a69-bf21-4b00-8715-5655ae905b0e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:45:16 user nova-compute[73449]: INFO nova.compute.manager [None req-3b9c4a69-bf21-4b00-8715-5655ae905b0e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] Took 7.68 seconds to build instance.
Aug 17 11:45:16 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-3b9c4a69-bf21-4b00-8715-5655ae905b0e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Lock "de5084e1-5a5e-48d2-a3ef-7f29898d1d2d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.805s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:45:16 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-301998f8-e85b-4928-a10a-7970e05859eb tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] Acquiring lock "c69e7643-8c60-4982-986b-484e8cfc3fa9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:45:16 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-301998f8-e85b-4928-a10a-7970e05859eb tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] Lock "c69e7643-8c60-4982-986b-484e8cfc3fa9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.006s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:45:16 user nova-compute[73449]: DEBUG nova.compute.manager [None req-301998f8-e85b-4928-a10a-7970e05859eb tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] [instance: c69e7643-8c60-4982-986b-484e8cfc3fa9] Starting instance... {{(pid=73449) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 11:45:16 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-301998f8-e85b-4928-a10a-7970e05859eb tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:45:16 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-301998f8-e85b-4928-a10a-7970e05859eb tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:45:16 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-301998f8-e85b-4928-a10a-7970e05859eb tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73449) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 11:45:16 user nova-compute[73449]: INFO nova.compute.claims [None req-301998f8-e85b-4928-a10a-7970e05859eb tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] [instance: c69e7643-8c60-4982-986b-484e8cfc3fa9] Claim successful on node user
Aug 17 11:45:16 user nova-compute[73449]: DEBUG nova.compute.manager [req-1e9cda2c-16dc-49c9-9c4b-ca319f815240 req-ea3c8d34-f1b6-492f-be65-247a1feab01b service nova] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] Received event network-vif-plugged-e2af7fce-7442-48b4-8611-da3171b0672b {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:45:16 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-1e9cda2c-16dc-49c9-9c4b-ca319f815240 req-ea3c8d34-f1b6-492f-be65-247a1feab01b service nova] Acquiring lock "de5084e1-5a5e-48d2-a3ef-7f29898d1d2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:45:16 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-1e9cda2c-16dc-49c9-9c4b-ca319f815240 req-ea3c8d34-f1b6-492f-be65-247a1feab01b service nova] Lock "de5084e1-5a5e-48d2-a3ef-7f29898d1d2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:45:16 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-1e9cda2c-16dc-49c9-9c4b-ca319f815240 req-ea3c8d34-f1b6-492f-be65-247a1feab01b service nova] Lock "de5084e1-5a5e-48d2-a3ef-7f29898d1d2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:45:16 user nova-compute[73449]: DEBUG nova.compute.manager [req-1e9cda2c-16dc-49c9-9c4b-ca319f815240 req-ea3c8d34-f1b6-492f-be65-247a1feab01b service nova] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] No waiting events found dispatching network-vif-plugged-e2af7fce-7442-48b4-8611-da3171b0672b {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:45:16 user nova-compute[73449]: WARNING nova.compute.manager [req-1e9cda2c-16dc-49c9-9c4b-ca319f815240 req-ea3c8d34-f1b6-492f-be65-247a1feab01b service nova] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] Received unexpected event network-vif-plugged-e2af7fce-7442-48b4-8611-da3171b0672b for instance with vm_state active and task_state None.
Aug 17 11:45:17 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-301998f8-e85b-4928-a10a-7970e05859eb tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 11:45:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:45:17 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-301998f8-e85b-4928-a10a-7970e05859eb tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 11:45:17 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-301998f8-e85b-4928-a10a-7970e05859eb tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.719s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:45:17 user nova-compute[73449]: DEBUG nova.compute.manager [None req-301998f8-e85b-4928-a10a-7970e05859eb tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] [instance: c69e7643-8c60-4982-986b-484e8cfc3fa9] Start building networks asynchronously for instance. {{(pid=73449) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 11:45:17 user nova-compute[73449]: DEBUG nova.compute.manager [None req-301998f8-e85b-4928-a10a-7970e05859eb tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] [instance: c69e7643-8c60-4982-986b-484e8cfc3fa9] Allocating IP information in the background. {{(pid=73449) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 11:45:17 user nova-compute[73449]: DEBUG nova.network.neutron [None req-301998f8-e85b-4928-a10a-7970e05859eb tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] [instance: c69e7643-8c60-4982-986b-484e8cfc3fa9] allocate_for_instance() {{(pid=73449) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 11:45:17 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-301998f8-e85b-4928-a10a-7970e05859eb tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] [instance: c69e7643-8c60-4982-986b-484e8cfc3fa9] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Aug 17 11:45:17 user nova-compute[73449]: DEBUG nova.compute.manager [None req-301998f8-e85b-4928-a10a-7970e05859eb tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] [instance: c69e7643-8c60-4982-986b-484e8cfc3fa9] Start building block device mappings for instance. {{(pid=73449) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 11:45:17 user nova-compute[73449]: DEBUG nova.policy [None req-301998f8-e85b-4928-a10a-7970e05859eb tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'eecfcdb00dee44fab4245d9af952d1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f0abc92468b407f992a1c233e53ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73449) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 11:45:17 user nova-compute[73449]: DEBUG nova.compute.manager [None req-301998f8-e85b-4928-a10a-7970e05859eb tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] [instance: c69e7643-8c60-4982-986b-484e8cfc3fa9] Start spawning the instance on the hypervisor. {{(pid=73449) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 11:45:17 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-301998f8-e85b-4928-a10a-7970e05859eb tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] [instance: c69e7643-8c60-4982-986b-484e8cfc3fa9] Creating instance directory {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 11:45:17 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-301998f8-e85b-4928-a10a-7970e05859eb tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] [instance: c69e7643-8c60-4982-986b-484e8cfc3fa9] Creating image(s)
Aug 17 11:45:17 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-301998f8-e85b-4928-a10a-7970e05859eb tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] Acquiring lock "/opt/stack/data/nova/instances/c69e7643-8c60-4982-986b-484e8cfc3fa9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:45:17 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-301998f8-e85b-4928-a10a-7970e05859eb tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] Lock "/opt/stack/data/nova/instances/c69e7643-8c60-4982-986b-484e8cfc3fa9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:45:17 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-301998f8-e85b-4928-a10a-7970e05859eb tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] Lock "/opt/stack/data/nova/instances/c69e7643-8c60-4982-986b-484e8cfc3fa9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:45:17 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-301998f8-e85b-4928-a10a-7970e05859eb tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] Acquiring lock "a294791ad67d1cbb4d0bc871d0c352e0a0990fb6" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:45:17 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-301998f8-e85b-4928-a10a-7970e05859eb tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] Lock "a294791ad67d1cbb4d0bc871d0c352e0a0990fb6" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:45:18 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-301998f8-e85b-4928-a10a-7970e05859eb tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a294791ad67d1cbb4d0bc871d0c352e0a0990fb6.part --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:45:18 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:45:18 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-301998f8-e85b-4928-a10a-7970e05859eb tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a294791ad67d1cbb4d0bc871d0c352e0a0990fb6.part --force-share --output=json" returned: 0 in 0.352s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:45:18 user nova-compute[73449]: DEBUG nova.virt.images [None req-301998f8-e85b-4928-a10a-7970e05859eb tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] 4dee885a-2bb4-4463-b90b-833cafa0b7e2 was qcow2, converting to raw {{(pid=73449) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 17 11:45:18 user nova-compute[73449]: DEBUG nova.privsep.utils [None req-301998f8-e85b-4928-a10a-7970e05859eb tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73449) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 11:45:18 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-301998f8-e85b-4928-a10a-7970e05859eb tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a294791ad67d1cbb4d0bc871d0c352e0a0990fb6.part /opt/stack/data/nova/instances/_base/a294791ad67d1cbb4d0bc871d0c352e0a0990fb6.converted {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:45:18 user nova-compute[73449]: DEBUG nova.network.neutron [None req-301998f8-e85b-4928-a10a-7970e05859eb tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] [instance: c69e7643-8c60-4982-986b-484e8cfc3fa9] Successfully created port: 8fd82fbd-985b-4260-a066-3bda2e4c1f1c {{(pid=73449) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 11:45:18 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-301998f8-e85b-4928-a10a-7970e05859eb tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a294791ad67d1cbb4d0bc871d0c352e0a0990fb6.part /opt/stack/data/nova/instances/_base/a294791ad67d1cbb4d0bc871d0c352e0a0990fb6.converted" returned: 0 in 0.382s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:45:18 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-301998f8-e85b-4928-a10a-7970e05859eb tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a294791ad67d1cbb4d0bc871d0c352e0a0990fb6.converted --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:45:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-301998f8-e85b-4928-a10a-7970e05859eb tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a294791ad67d1cbb4d0bc871d0c352e0a0990fb6.converted --force-share --output=json" returned: 0 in 0.236s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:45:19 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-301998f8-e85b-4928-a10a-7970e05859eb tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] Lock "a294791ad67d1cbb4d0bc871d0c352e0a0990fb6" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.617s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:45:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-301998f8-e85b-4928-a10a-7970e05859eb tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a294791ad67d1cbb4d0bc871d0c352e0a0990fb6 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:45:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-301998f8-e85b-4928-a10a-7970e05859eb tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a294791ad67d1cbb4d0bc871d0c352e0a0990fb6 --force-share --output=json" returned: 0 in 0.254s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:45:19 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-301998f8-e85b-4928-a10a-7970e05859eb tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] Acquiring lock "a294791ad67d1cbb4d0bc871d0c352e0a0990fb6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:45:19 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-301998f8-e85b-4928-a10a-7970e05859eb tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] Lock "a294791ad67d1cbb4d0bc871d0c352e0a0990fb6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:45:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-301998f8-e85b-4928-a10a-7970e05859eb tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a294791ad67d1cbb4d0bc871d0c352e0a0990fb6 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:45:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-301998f8-e85b-4928-a10a-7970e05859eb tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a294791ad67d1cbb4d0bc871d0c352e0a0990fb6 --force-share --output=json" returned: 0 in 0.244s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:45:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-301998f8-e85b-4928-a10a-7970e05859eb tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a294791ad67d1cbb4d0bc871d0c352e0a0990fb6,backing_fmt=raw /opt/stack/data/nova/instances/c69e7643-8c60-4982-986b-484e8cfc3fa9/disk 1073741824 {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:45:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-301998f8-e85b-4928-a10a-7970e05859eb tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a294791ad67d1cbb4d0bc871d0c352e0a0990fb6,backing_fmt=raw /opt/stack/data/nova/instances/c69e7643-8c60-4982-986b-484e8cfc3fa9/disk 1073741824" returned: 0 in 0.075s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:45:19 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-301998f8-e85b-4928-a10a-7970e05859eb tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] Lock "a294791ad67d1cbb4d0bc871d0c352e0a0990fb6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.342s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:45:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-301998f8-e85b-4928-a10a-7970e05859eb tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a294791ad67d1cbb4d0bc871d0c352e0a0990fb6 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:45:19 user nova-compute[73449]: DEBUG nova.network.neutron [None req-301998f8-e85b-4928-a10a-7970e05859eb tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] [instance: c69e7643-8c60-4982-986b-484e8cfc3fa9] Successfully updated port: 8fd82fbd-985b-4260-a066-3bda2e4c1f1c {{(pid=73449) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 11:45:19 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-301998f8-e85b-4928-a10a-7970e05859eb tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] Acquiring lock "refresh_cache-c69e7643-8c60-4982-986b-484e8cfc3fa9" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:45:19 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-301998f8-e85b-4928-a10a-7970e05859eb tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] Acquired lock "refresh_cache-c69e7643-8c60-4982-986b-484e8cfc3fa9" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:45:19 user nova-compute[73449]: DEBUG nova.network.neutron [None req-301998f8-e85b-4928-a10a-7970e05859eb tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] [instance: c69e7643-8c60-4982-986b-484e8cfc3fa9] Building network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG nova.compute.manager [req-196faec1-1f06-488f-8124-09590e740787 req-4b6a7b32-6e73-43af-abfa-6ebef9d722d6 service nova] [instance: c69e7643-8c60-4982-986b-484e8cfc3fa9] Received event network-changed-8fd82fbd-985b-4260-a066-3bda2e4c1f1c {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG nova.compute.manager [req-196faec1-1f06-488f-8124-09590e740787 req-4b6a7b32-6e73-43af-abfa-6ebef9d722d6 service nova] [instance: c69e7643-8c60-4982-986b-484e8cfc3fa9] Refreshing instance network info cache due to event network-changed-8fd82fbd-985b-4260-a066-3bda2e4c1f1c. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-196faec1-1f06-488f-8124-09590e740787 req-4b6a7b32-6e73-43af-abfa-6ebef9d722d6 service nova] Acquiring lock "refresh_cache-c69e7643-8c60-4982-986b-484e8cfc3fa9" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG nova.compute.manager [None req-5da3ce2d-9195-42ac-b065-5f310c535a68 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: b12d9412-be17-4908-a4c2-b80c0fa38fc0] Start spawning the instance on the hypervisor. {{(pid=73449) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-5da3ce2d-9195-42ac-b065-5f310c535a68 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: b12d9412-be17-4908-a4c2-b80c0fa38fc0] Creating instance directory {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 11:45:20 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-5da3ce2d-9195-42ac-b065-5f310c535a68 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: b12d9412-be17-4908-a4c2-b80c0fa38fc0] Creating image(s)
Aug 17 11:45:20 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-5da3ce2d-9195-42ac-b065-5f310c535a68 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: b12d9412-be17-4908-a4c2-b80c0fa38fc0] Did not create local disks {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-5da3ce2d-9195-42ac-b065-5f310c535a68 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: b12d9412-be17-4908-a4c2-b80c0fa38fc0] Ensure instance console log exists: /opt/stack/data/nova/instances/b12d9412-be17-4908-a4c2-b80c0fa38fc0/console.log {{(pid=73449) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-5da3ce2d-9195-42ac-b065-5f310c535a68 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-5da3ce2d-9195-42ac-b065-5f310c535a68 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-5da3ce2d-9195-42ac-b065-5f310c535a68 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-5da3ce2d-9195-42ac-b065-5f310c535a68 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: b12d9412-be17-4908-a4c2-b80c0fa38fc0] Start _get_guest_xml network_info=[{"id": "be4bd89d-1a52-49a7-8241-ca24224fb018", "address": "fa:16:3e:f6:25:6f", "network": {"id": "a9e8fcd6-4152-466b-99ad-44b85db05a05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-920564935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bd46cdaff7a4b40955f7c8a12c55452", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe4bd89d-1a", "ovs_interfaceid": "be4bd89d-1a52-49a7-8241-ca24224fb018", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'attachment_id': '356be55a-e1c6-4594-aba4-32e5cde38e23', 'boot_index': 0, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:d22566b5-74eb-4aeb-b14c-0bd5aa9e35ee'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QGUcqwyf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b12d9412-be17-4908-a4c2-b80c0fa38fc0', 'attached_at': '', 'detached_at': '', 'volume_id': 'd22566b5-74eb-4aeb-b14c-0bd5aa9e35ee', 'serial': 'd22566b5-74eb-4aeb-b14c-0bd5aa9e35ee'}, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-301998f8-e85b-4928-a10a-7970e05859eb tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a294791ad67d1cbb4d0bc871d0c352e0a0990fb6 --force-share --output=json" returned: 0 in 0.293s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG nova.virt.disk.api [None req-301998f8-e85b-4928-a10a-7970e05859eb tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c69e7643-8c60-4982-986b-484e8cfc3fa9/disk. size=1073741824 {{(pid=73449) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-301998f8-e85b-4928-a10a-7970e05859eb tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c69e7643-8c60-4982-986b-484e8cfc3fa9/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG nova.network.neutron [None req-301998f8-e85b-4928-a10a-7970e05859eb tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] [instance: c69e7643-8c60-4982-986b-484e8cfc3fa9] Instance cache missing network info. {{(pid=73449) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 11:45:20 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-5da3ce2d-9195-42ac-b065-5f310c535a68 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:45:20 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-5da3ce2d-9195-42ac-b065-5f310c535a68 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:45:20 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-5da3ce2d-9195-42ac-b065-5f310c535a68 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-5da3ce2d-9195-42ac-b065-5f310c535a68 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] CPU controller missing on host. {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-5da3ce2d-9195-42ac-b065-5f310c535a68 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-5da3ce2d-9195-42ac-b065-5f310c535a68 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] CPU controller found on host. {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-5da3ce2d-9195-42ac-b065-5f310c535a68 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73449) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-5da3ce2d-9195-42ac-b065-5f310c535a68 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T11:35:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-5da3ce2d-9195-42ac-b065-5f310c535a68 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Flavor limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-5da3ce2d-9195-42ac-b065-5f310c535a68 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Image limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-5da3ce2d-9195-42ac-b065-5f310c535a68 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Flavor pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-5da3ce2d-9195-42ac-b065-5f310c535a68 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Image pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-5da3ce2d-9195-42ac-b065-5f310c535a68 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-5da3ce2d-9195-42ac-b065-5f310c535a68 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-5da3ce2d-9195-42ac-b065-5f310c535a68 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-5da3ce2d-9195-42ac-b065-5f310c535a68 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Got 1 possible topologies {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-5da3ce2d-9195-42ac-b065-5f310c535a68 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-5da3ce2d-9195-42ac-b065-5f310c535a68 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5da3ce2d-9195-42ac-b065-5f310c535a68 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: b12d9412-be17-4908-a4c2-b80c0fa38fc0] Calling os-brick to attach iSCSI Volume {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-5da3ce2d-9195-42ac-b065-5f310c535a68 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d22566b5-74eb-4aeb-b14c-0bd5aa9e35ee'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QGUcqwyf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 11:45:20 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-5da3ce2d-9195-42ac-b065-5f310c535a68 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 11:45:20 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-5da3ce2d-9195-42ac-b065-5f310c535a68 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-5da3ce2d-9195-42ac-b065-5f310c535a68 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:45:20 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-5da3ce2d-9195-42ac-b065-5f310c535a68 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 11:45:20 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-5da3ce2d-9195-42ac-b065-5f310c535a68 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d22566b5-74eb-4aeb-b14c-0bd5aa9e35ee" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-5da3ce2d-9195-42ac-b065-5f310c535a68 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d22566b5-74eb-4aeb-b14c-0bd5aa9e35ee" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:45:20 user nova-compute[73449]: INFO os_brick.initiator.connectors.iscsi [None req-5da3ce2d-9195-42ac-b065-5f310c535a68 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 11:45:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d22566b5-74eb-4aeb-b14c-0bd5aa9e35ee -p 172.16.0.220:3260 {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d22566b5-74eb-4aeb-b14c-0bd5aa9e35ee -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[2511082e-b32e-4204-9205-d75374d9c2bf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-5da3ce2d-9195-42ac-b065-5f310c535a68 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 11:45:20 user nova-compute[73449]:  {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d22566b5-74eb-4aeb-b14c-0bd5aa9e35ee -p 172.16.0.220:3260 --interface default --op new {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d22566b5-74eb-4aeb-b14c-0bd5aa9e35ee -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.033s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fad38aa-2ef7-4445-8101-6595a901e9a8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d22566b5-74eb-4aeb-b14c-0bd5aa9e35ee] added\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-5da3ce2d-9195-42ac-b065-5f310c535a68 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d22566b5-74eb-4aeb-b14c-0bd5aa9e35ee] added
Aug 17 11:45:20 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d22566b5-74eb-4aeb-b14c-0bd5aa9e35ee -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d22566b5-74eb-4aeb-b14c-0bd5aa9e35ee -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[3711c5f9-c88c-4d59-9066-cef5f2364b74]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-5da3ce2d-9195-42ac-b065-5f310c535a68 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-301998f8-e85b-4928-a10a-7970e05859eb tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c69e7643-8c60-4982-986b-484e8cfc3fa9/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG nova.virt.disk.api [None req-301998f8-e85b-4928-a10a-7970e05859eb tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] Cannot resize image /opt/stack/data/nova/instances/c69e7643-8c60-4982-986b-484e8cfc3fa9/disk to a smaller size. {{(pid=73449) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG nova.objects.instance [None req-301998f8-e85b-4928-a10a-7970e05859eb tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] Lazy-loading 'migration_context' on Instance uuid c69e7643-8c60-4982-986b-484e8cfc3fa9 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d22566b5-74eb-4aeb-b14c-0bd5aa9e35ee -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d22566b5-74eb-4aeb-b14c-0bd5aa9e35ee -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e428cb6-5cc2-4b66-b4c4-50daa9eccfb3]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-301998f8-e85b-4928-a10a-7970e05859eb tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] [instance: c69e7643-8c60-4982-986b-484e8cfc3fa9] Created local disks {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-301998f8-e85b-4928-a10a-7970e05859eb tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] [instance: c69e7643-8c60-4982-986b-484e8cfc3fa9] Ensure instance console log exists: /opt/stack/data/nova/instances/c69e7643-8c60-4982-986b-484e8cfc3fa9/console.log {{(pid=73449) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-301998f8-e85b-4928-a10a-7970e05859eb tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-301998f8-e85b-4928-a10a-7970e05859eb tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-301998f8-e85b-4928-a10a-7970e05859eb tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-5da3ce2d-9195-42ac-b065-5f310c535a68 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d22566b5-74eb-4aeb-b14c-0bd5aa9e35ee -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QGUcqwyf {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d22566b5-74eb-4aeb-b14c-0bd5aa9e35ee -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QGUcqwyf" returned: 0 in 0.025s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cd81482-6b6e-4c1c-b0bc-2fa696a15391]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-5da3ce2d-9195-42ac-b065-5f310c535a68 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QGUcqwyf'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d22566b5-74eb-4aeb-b14c-0bd5aa9e35ee -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d22566b5-74eb-4aeb-b14c-0bd5aa9e35ee -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f0e0af1-8380-49ce-893d-8aee32c22ee3]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-5da3ce2d-9195-42ac-b065-5f310c535a68 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[747559e1-f068-4fb5-ae83-a0225b75595c]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-5da3ce2d-9195-42ac-b065-5f310c535a68 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe (non-flash)
Aug 17 11:45:20 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-5da3ce2d-9195-42ac-b065-5f310c535a68 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe (non-flash)
Aug 17 11:45:20 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d22566b5-74eb-4aeb-b14c-0bd5aa9e35ee -p 172.16.0.220:3260 --login {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d22566b5-74eb-4aeb-b14c-0bd5aa9e35ee -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[c32b788c-70e0-47e1-8847-8d34f87f4d29]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d22566b5-74eb-4aeb-b14c-0bd5aa9e35ee, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d22566b5-74eb-4aeb-b14c-0bd5aa9e35ee, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-5da3ce2d-9195-42ac-b065-5f310c535a68 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d22566b5-74eb-4aeb-b14c-0bd5aa9e35ee, portal: 172.16.0.220,3260]
Aug 17 11:45:20 user nova-compute[73449]: Login to [iface: default, target: iqn.2010-10.org.openstack:d22566b5-74eb-4aeb-b14c-0bd5aa9e35ee, portal: 172.16.0.220,3260] successful.
Aug 17 11:45:20 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d22566b5-74eb-4aeb-b14c-0bd5aa9e35ee -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d22566b5-74eb-4aeb-b14c-0bd5aa9e35ee -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c221ee4-1400-4327-98be-61672344ff55]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-5da3ce2d-9195-42ac-b065-5f310c535a68 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[31076843-3b9a-44cf-ad10-425584dac8eb]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d22566b5-74eb-4aeb-b14c-0bd5aa9e35ee (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-5da3ce2d-9195-42ac-b065-5f310c535a68 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe (non-flash)
Aug 17 11:45:20 user nova-compute[73449]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d22566b5-74eb-4aeb-b14c-0bd5aa9e35ee (non-flash)
Aug 17 11:45:20 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-5da3ce2d-9195-42ac-b065-5f310c535a68 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe (non-flash)
Aug 17 11:45:20 user nova-compute[73449]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d22566b5-74eb-4aeb-b14c-0bd5aa9e35ee (non-flash)
Aug 17 11:45:20 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-5da3ce2d-9195-42ac-b065-5f310c535a68 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d22566b5-74eb-4aeb-b14c-0bd5aa9e35ee" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.380s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-5da3ce2d-9195-42ac-b065-5f310c535a68 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Connected to 172.16.0.220:3260 {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-5da3ce2d-9195-42ac-b065-5f310c535a68 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] HCTL ('33', '-', '-', 0) found on session 16 with lun 0 {{(pid=73449) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-5da3ce2d-9195-42ac-b065-5f310c535a68 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73449) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb2ca3ad-e600-4fe5-948c-002a869a2c51]: (4, ('- - 0', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-5da3ce2d-9195-42ac-b065-5f310c535a68 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Searching for a device in session 16 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73449) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-5da3ce2d-9195-42ac-b065-5f310c535a68 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QGUcqwyf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG nova.network.neutron [None req-301998f8-e85b-4928-a10a-7970e05859eb tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] [instance: c69e7643-8c60-4982-986b-484e8cfc3fa9] Updating instance_info_cache with network_info: [{"id": "8fd82fbd-985b-4260-a066-3bda2e4c1f1c", "address": "fa:16:3e:e3:a9:e0", "network": {"id": "56945a89-4894-401c-a1bd-dba725ffbcca", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-590943835-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f0abc92468b407f992a1c233e53ff48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fd82fbd-98", "ovs_interfaceid": "8fd82fbd-985b-4260-a066-3bda2e4c1f1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-301998f8-e85b-4928-a10a-7970e05859eb tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] Releasing lock "refresh_cache-c69e7643-8c60-4982-986b-484e8cfc3fa9" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG nova.compute.manager [None req-301998f8-e85b-4928-a10a-7970e05859eb tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] [instance: c69e7643-8c60-4982-986b-484e8cfc3fa9] Instance network_info: |[{"id": "8fd82fbd-985b-4260-a066-3bda2e4c1f1c", "address": "fa:16:3e:e3:a9:e0", "network": {"id": "56945a89-4894-401c-a1bd-dba725ffbcca", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-590943835-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f0abc92468b407f992a1c233e53ff48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fd82fbd-98", "ovs_interfaceid": "8fd82fbd-985b-4260-a066-3bda2e4c1f1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73449) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-196faec1-1f06-488f-8124-09590e740787 req-4b6a7b32-6e73-43af-abfa-6ebef9d722d6 service nova] Acquired lock "refresh_cache-c69e7643-8c60-4982-986b-484e8cfc3fa9" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG nova.network.neutron [req-196faec1-1f06-488f-8124-09590e740787 req-4b6a7b32-6e73-43af-abfa-6ebef9d722d6 service nova] [instance: c69e7643-8c60-4982-986b-484e8cfc3fa9] Refreshing network info cache for port 8fd82fbd-985b-4260-a066-3bda2e4c1f1c {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-301998f8-e85b-4928-a10a-7970e05859eb tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] [instance: c69e7643-8c60-4982-986b-484e8cfc3fa9] Start _get_guest_xml network_info=[{"id": "8fd82fbd-985b-4260-a066-3bda2e4c1f1c", "address": "fa:16:3e:e3:a9:e0", "network": {"id": "56945a89-4894-401c-a1bd-dba725ffbcca", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-590943835-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f0abc92468b407f992a1c233e53ff48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fd82fbd-98", "ovs_interfaceid": "8fd82fbd-985b-4260-a066-3bda2e4c1f1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T11:45:09Z,direct_url=<?>,disk_format='qcow2',id=4dee885a-2bb4-4463-b90b-833cafa0b7e2,min_disk=0,min_ram=0,name='',owner='591864ee2fbf420dbfed4b644d3cbdeb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T11:45:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encryption_format': None, 'disk_bus': 'scsi', 'device_name': '/dev/sda', 'encryption_options': None, 'image_id': '4dee885a-2bb4-4463-b90b-833cafa0b7e2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 11:45:20 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-301998f8-e85b-4928-a10a-7970e05859eb tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:45:20 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-301998f8-e85b-4928-a10a-7970e05859eb tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:45:20 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-301998f8-e85b-4928-a10a-7970e05859eb tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-301998f8-e85b-4928-a10a-7970e05859eb tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] CPU controller missing on host. {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-301998f8-e85b-4928-a10a-7970e05859eb tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-301998f8-e85b-4928-a10a-7970e05859eb tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] CPU controller found on host. {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-301998f8-e85b-4928-a10a-7970e05859eb tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73449) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-301998f8-e85b-4928-a10a-7970e05859eb tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T11:35:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T11:45:09Z,direct_url=<?>,disk_format='qcow2',id=4dee885a-2bb4-4463-b90b-833cafa0b7e2,min_disk=0,min_ram=0,name='',owner='591864ee2fbf420dbfed4b644d3cbdeb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T11:45:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-301998f8-e85b-4928-a10a-7970e05859eb tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] Flavor limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-301998f8-e85b-4928-a10a-7970e05859eb tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] Image limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-301998f8-e85b-4928-a10a-7970e05859eb tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] Flavor pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-301998f8-e85b-4928-a10a-7970e05859eb tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] Image pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-301998f8-e85b-4928-a10a-7970e05859eb tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-301998f8-e85b-4928-a10a-7970e05859eb tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-301998f8-e85b-4928-a10a-7970e05859eb tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-301998f8-e85b-4928-a10a-7970e05859eb tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] Got 1 possible topologies {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-301998f8-e85b-4928-a10a-7970e05859eb tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-301998f8-e85b-4928-a10a-7970e05859eb tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-301998f8-e85b-4928-a10a-7970e05859eb tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T11:45:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-833970667',display_name='tempest-AttachSCSIVolumeTestJSON-server-833970667',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-833970667',id=16,image_ref='4dee885a-2bb4-4463-b90b-833cafa0b7e2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFwWs8cCKEZb5agnvncFaZSWCrGZ6sbqIA5yyGzM9tPWYYsByZ+TqHuao8ZU/3DhnBBHaoc37vD2IMX+z3VCzlVX1tciX1nrsMs1Kw0uYAzWyps7sc78BJxmV/xKUlD1GA==',key_name='tempest-keypair-179167240',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7f0abc92468b407f992a1c233e53ff48',ramdisk_id='',reservation_id='r-hyvw950d',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4dee885a-2bb4-4463-b90b-833cafa0b7e2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1145020015',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1145020015-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T11:45:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eecfcdb00dee44fab4245d9af952d1dd',uuid=c69e7643-8c60-4982-986b-484e8cfc3fa9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8fd82fbd-985b-4260-a066-3bda2e4c1f1c", "address": "fa:16:3e:e3:a9:e0", "network": {"id": "56945a89-4894-401c-a1bd-dba725ffbcca", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-590943835-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f0abc92468b407f992a1c233e53ff48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fd82fbd-98", "ovs_interfaceid": "8fd82fbd-985b-4260-a066-3bda2e4c1f1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73449) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-301998f8-e85b-4928-a10a-7970e05859eb tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] Converting VIF {"id": "8fd82fbd-985b-4260-a066-3bda2e4c1f1c", "address": "fa:16:3e:e3:a9:e0", "network": {"id": "56945a89-4894-401c-a1bd-dba725ffbcca", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-590943835-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f0abc92468b407f992a1c233e53ff48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fd82fbd-98", "ovs_interfaceid": "8fd82fbd-985b-4260-a066-3bda2e4c1f1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-301998f8-e85b-4928-a10a-7970e05859eb tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:a9:e0,bridge_name='br-int',has_traffic_filtering=True,id=8fd82fbd-985b-4260-a066-3bda2e4c1f1c,network=Network(56945a89-4894-401c-a1bd-dba725ffbcca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fd82fbd-98') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG nova.objects.instance [None req-301998f8-e85b-4928-a10a-7970e05859eb tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] Lazy-loading 'pci_devices' on Instance uuid c69e7643-8c60-4982-986b-484e8cfc3fa9 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-301998f8-e85b-4928-a10a-7970e05859eb tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] [instance: c69e7643-8c60-4982-986b-484e8cfc3fa9] End _get_guest_xml xml=<domain type="kvm">
Aug 17 11:45:20 user nova-compute[73449]:   <uuid>c69e7643-8c60-4982-986b-484e8cfc3fa9</uuid>
Aug 17 11:45:20 user nova-compute[73449]:   <name>instance-00000010</name>
Aug 17 11:45:20 user nova-compute[73449]:   <memory>524288</memory>
Aug 17 11:45:20 user nova-compute[73449]:   <vcpu>1</vcpu>
Aug 17 11:45:20 user nova-compute[73449]:   <metadata>
Aug 17 11:45:20 user nova-compute[73449]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 11:45:20 user nova-compute[73449]:       <nova:package version="0.0.0"/>
Aug 17 11:45:20 user nova-compute[73449]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-833970667</nova:name>
Aug 17 11:45:20 user nova-compute[73449]:       <nova:creationTime>2023-08-17 11:45:20</nova:creationTime>
Aug 17 11:45:20 user nova-compute[73449]:       <nova:flavor name="m1.tiny">
Aug 17 11:45:20 user nova-compute[73449]:         <nova:memory>512</nova:memory>
Aug 17 11:45:20 user nova-compute[73449]:         <nova:disk>1</nova:disk>
Aug 17 11:45:20 user nova-compute[73449]:         <nova:swap>0</nova:swap>
Aug 17 11:45:20 user nova-compute[73449]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 11:45:20 user nova-compute[73449]:         <nova:vcpus>1</nova:vcpus>
Aug 17 11:45:20 user nova-compute[73449]:       </nova:flavor>
Aug 17 11:45:20 user nova-compute[73449]:       <nova:owner>
Aug 17 11:45:20 user nova-compute[73449]:         <nova:user uuid="eecfcdb00dee44fab4245d9af952d1dd">tempest-AttachSCSIVolumeTestJSON-1145020015-project-member</nova:user>
Aug 17 11:45:20 user nova-compute[73449]:         <nova:project uuid="7f0abc92468b407f992a1c233e53ff48">tempest-AttachSCSIVolumeTestJSON-1145020015</nova:project>
Aug 17 11:45:20 user nova-compute[73449]:       </nova:owner>
Aug 17 11:45:20 user nova-compute[73449]:       <nova:root type="image" uuid="4dee885a-2bb4-4463-b90b-833cafa0b7e2"/>
Aug 17 11:45:20 user nova-compute[73449]:       <nova:ports>
Aug 17 11:45:20 user nova-compute[73449]:         <nova:port uuid="8fd82fbd-985b-4260-a066-3bda2e4c1f1c">
Aug 17 11:45:20 user nova-compute[73449]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 17 11:45:20 user nova-compute[73449]:         </nova:port>
Aug 17 11:45:20 user nova-compute[73449]:       </nova:ports>
Aug 17 11:45:20 user nova-compute[73449]:     </nova:instance>
Aug 17 11:45:20 user nova-compute[73449]:   </metadata>
Aug 17 11:45:20 user nova-compute[73449]:   <sysinfo type="smbios">
Aug 17 11:45:20 user nova-compute[73449]:     <system>
Aug 17 11:45:20 user nova-compute[73449]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 11:45:20 user nova-compute[73449]:       <entry name="product">OpenStack Nova</entry>
Aug 17 11:45:20 user nova-compute[73449]:       <entry name="version">0.0.0</entry>
Aug 17 11:45:20 user nova-compute[73449]:       <entry name="serial">c69e7643-8c60-4982-986b-484e8cfc3fa9</entry>
Aug 17 11:45:20 user nova-compute[73449]:       <entry name="uuid">c69e7643-8c60-4982-986b-484e8cfc3fa9</entry>
Aug 17 11:45:20 user nova-compute[73449]:       <entry name="family">Virtual Machine</entry>
Aug 17 11:45:20 user nova-compute[73449]:     </system>
Aug 17 11:45:20 user nova-compute[73449]:   </sysinfo>
Aug 17 11:45:20 user nova-compute[73449]:   <os>
Aug 17 11:45:20 user nova-compute[73449]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 11:45:20 user nova-compute[73449]:     <boot dev="hd"/>
Aug 17 11:45:20 user nova-compute[73449]:     <smbios mode="sysinfo"/>
Aug 17 11:45:20 user nova-compute[73449]:   </os>
Aug 17 11:45:20 user nova-compute[73449]:   <features>
Aug 17 11:45:20 user nova-compute[73449]:     <acpi/>
Aug 17 11:45:20 user nova-compute[73449]:     <apic/>
Aug 17 11:45:20 user nova-compute[73449]:     <vmcoreinfo/>
Aug 17 11:45:20 user nova-compute[73449]:   </features>
Aug 17 11:45:20 user nova-compute[73449]:   <clock offset="utc">
Aug 17 11:45:20 user nova-compute[73449]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 11:45:20 user nova-compute[73449]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 11:45:20 user nova-compute[73449]:     <timer name="hpet" present="no"/>
Aug 17 11:45:20 user nova-compute[73449]:   </clock>
Aug 17 11:45:20 user nova-compute[73449]:   <cpu mode="custom" match="exact">
Aug 17 11:45:20 user nova-compute[73449]:     <model>Nehalem</model>
Aug 17 11:45:20 user nova-compute[73449]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 11:45:20 user nova-compute[73449]:   </cpu>
Aug 17 11:45:20 user nova-compute[73449]:   <devices>
Aug 17 11:45:20 user nova-compute[73449]:     <disk type="file" device="disk">
Aug 17 11:45:20 user nova-compute[73449]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 11:45:20 user nova-compute[73449]:       <source file="/opt/stack/data/nova/instances/c69e7643-8c60-4982-986b-484e8cfc3fa9/disk"/>
Aug 17 11:45:20 user nova-compute[73449]:       <target dev="sda" bus="scsi"/>
Aug 17 11:45:20 user nova-compute[73449]:       <address type="drive" controller="0" unit="0"/>
Aug 17 11:45:20 user nova-compute[73449]:     </disk>
Aug 17 11:45:20 user nova-compute[73449]:     <disk type="file" device="cdrom">
Aug 17 11:45:20 user nova-compute[73449]:       <driver name="qemu" type="raw" cache="none"/>
Aug 17 11:45:20 user nova-compute[73449]:       <source file="/opt/stack/data/nova/instances/c69e7643-8c60-4982-986b-484e8cfc3fa9/disk.config"/>
Aug 17 11:45:20 user nova-compute[73449]:       <target dev="sdb" bus="scsi"/>
Aug 17 11:45:20 user nova-compute[73449]:       <address type="drive" controller="0" unit="1"/>
Aug 17 11:45:20 user nova-compute[73449]:     </disk>
Aug 17 11:45:20 user nova-compute[73449]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Aug 17 11:45:20 user nova-compute[73449]:     <interface type="ethernet">
Aug 17 11:45:20 user nova-compute[73449]:       <mac address="fa:16:3e:e3:a9:e0"/>
Aug 17 11:45:20 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 11:45:20 user nova-compute[73449]:       <mtu size="1442"/>
Aug 17 11:45:20 user nova-compute[73449]:       <target dev="tap8fd82fbd-98"/>
Aug 17 11:45:20 user nova-compute[73449]:     </interface>
Aug 17 11:45:20 user nova-compute[73449]:     <serial type="pty">
Aug 17 11:45:20 user nova-compute[73449]:       <log file="/opt/stack/data/nova/instances/c69e7643-8c60-4982-986b-484e8cfc3fa9/console.log" append="off"/>
Aug 17 11:45:20 user nova-compute[73449]:     </serial>
Aug 17 11:45:20 user nova-compute[73449]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 11:45:20 user nova-compute[73449]:     <video>
Aug 17 11:45:20 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 11:45:20 user nova-compute[73449]:     </video>
Aug 17 11:45:20 user nova-compute[73449]:     <rng model="virtio">
Aug 17 11:45:20 user nova-compute[73449]:       <backend model="random">/dev/urandom</backend>
Aug 17 11:45:20 user nova-compute[73449]:     </rng>
Aug 17 11:45:20 user nova-compute[73449]:     <controller type="usb" index="0" model="none"/>
Aug 17 11:45:20 user nova-compute[73449]:     <memballoon model="virtio">
Aug 17 11:45:20 user nova-compute[73449]:       <stats period="10"/>
Aug 17 11:45:20 user nova-compute[73449]:     </memballoon>
Aug 17 11:45:20 user nova-compute[73449]:   </devices>
Aug 17 11:45:20 user nova-compute[73449]: </domain>
Aug 17 11:45:20 user nova-compute[73449]:  {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-301998f8-e85b-4928-a10a-7970e05859eb tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T11:45:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-833970667',display_name='tempest-AttachSCSIVolumeTestJSON-server-833970667',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-833970667',id=16,image_ref='4dee885a-2bb4-4463-b90b-833cafa0b7e2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFwWs8cCKEZb5agnvncFaZSWCrGZ6sbqIA5yyGzM9tPWYYsByZ+TqHuao8ZU/3DhnBBHaoc37vD2IMX+z3VCzlVX1tciX1nrsMs1Kw0uYAzWyps7sc78BJxmV/xKUlD1GA==',key_name='tempest-keypair-179167240',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7f0abc92468b407f992a1c233e53ff48',ramdisk_id='',reservation_id='r-hyvw950d',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4dee885a-2bb4-4463-b90b-833cafa0b7e2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1145020015',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1145020015-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T11:45:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eecfcdb00dee44fab4245d9af952d1dd',uuid=c69e7643-8c60-4982-986b-484e8cfc3fa9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8fd82fbd-985b-4260-a066-3bda2e4c1f1c", "address": "fa:16:3e:e3:a9:e0", "network": {"id": "56945a89-4894-401c-a1bd-dba725ffbcca", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-590943835-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f0abc92468b407f992a1c233e53ff48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fd82fbd-98", "ovs_interfaceid": "8fd82fbd-985b-4260-a066-3bda2e4c1f1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-301998f8-e85b-4928-a10a-7970e05859eb tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] Converting VIF {"id": "8fd82fbd-985b-4260-a066-3bda2e4c1f1c", "address": "fa:16:3e:e3:a9:e0", "network": {"id": "56945a89-4894-401c-a1bd-dba725ffbcca", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-590943835-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f0abc92468b407f992a1c233e53ff48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fd82fbd-98", "ovs_interfaceid": "8fd82fbd-985b-4260-a066-3bda2e4c1f1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-301998f8-e85b-4928-a10a-7970e05859eb tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:a9:e0,bridge_name='br-int',has_traffic_filtering=True,id=8fd82fbd-985b-4260-a066-3bda2e4c1f1c,network=Network(56945a89-4894-401c-a1bd-dba725ffbcca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fd82fbd-98') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG os_vif [None req-301998f8-e85b-4928-a10a-7970e05859eb tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:a9:e0,bridge_name='br-int',has_traffic_filtering=True,id=8fd82fbd-985b-4260-a066-3bda2e4c1f1c,network=Network(56945a89-4894-401c-a1bd-dba725ffbcca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fd82fbd-98') {{(pid=73449) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8fd82fbd-98, may_exist=True, interface_attrs={}) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8fd82fbd-98, col_values=(('external_ids', {'iface-id': '8fd82fbd-985b-4260-a066-3bda2e4c1f1c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e3:a9:e0', 'vm-uuid': 'c69e7643-8c60-4982-986b-484e8cfc3fa9'}),), if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:45:20 user nova-compute[73449]: INFO os_vif [None req-301998f8-e85b-4928-a10a-7970e05859eb tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:a9:e0,bridge_name='br-int',has_traffic_filtering=True,id=8fd82fbd-985b-4260-a066-3bda2e4c1f1c,network=Network(56945a89-4894-401c-a1bd-dba725ffbcca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fd82fbd-98')
Aug 17 11:45:20 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-301998f8-e85b-4928-a10a-7970e05859eb tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] No BDM found with device name sda, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-301998f8-e85b-4928-a10a-7970e05859eb tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] No BDM found with device name sdb, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 11:45:20 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-301998f8-e85b-4928-a10a-7970e05859eb tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] No VIF found with MAC fa:16:3e:e3:a9:e0, not building metadata {{(pid=73449) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 11:45:20 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-301998f8-e85b-4928-a10a-7970e05859eb tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] [instance: c69e7643-8c60-4982-986b-484e8cfc3fa9] Using config drive
Aug 17 11:45:21 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-301998f8-e85b-4928-a10a-7970e05859eb tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] [instance: c69e7643-8c60-4982-986b-484e8cfc3fa9] Creating config drive at /opt/stack/data/nova/instances/c69e7643-8c60-4982-986b-484e8cfc3fa9/disk.config
Aug 17 11:45:21 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-301998f8-e85b-4928-a10a-7970e05859eb tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/c69e7643-8c60-4982-986b-484e8cfc3fa9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpd_f9f697 {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:45:21 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-301998f8-e85b-4928-a10a-7970e05859eb tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/c69e7643-8c60-4982-986b-484e8cfc3fa9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpd_f9f697" returned: 0 in 0.065s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:45:21 user nova-compute[73449]: DEBUG nova.network.neutron [req-196faec1-1f06-488f-8124-09590e740787 req-4b6a7b32-6e73-43af-abfa-6ebef9d722d6 service nova] [instance: c69e7643-8c60-4982-986b-484e8cfc3fa9] Updated VIF entry in instance network info cache for port 8fd82fbd-985b-4260-a066-3bda2e4c1f1c. {{(pid=73449) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 11:45:21 user nova-compute[73449]: DEBUG nova.network.neutron [req-196faec1-1f06-488f-8124-09590e740787 req-4b6a7b32-6e73-43af-abfa-6ebef9d722d6 service nova] [instance: c69e7643-8c60-4982-986b-484e8cfc3fa9] Updating instance_info_cache with network_info: [{"id": "8fd82fbd-985b-4260-a066-3bda2e4c1f1c", "address": "fa:16:3e:e3:a9:e0", "network": {"id": "56945a89-4894-401c-a1bd-dba725ffbcca", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-590943835-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f0abc92468b407f992a1c233e53ff48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fd82fbd-98", "ovs_interfaceid": "8fd82fbd-985b-4260-a066-3bda2e4c1f1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:45:21 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-196faec1-1f06-488f-8124-09590e740787 req-4b6a7b32-6e73-43af-abfa-6ebef9d722d6 service nova] Releasing lock "refresh_cache-c69e7643-8c60-4982-986b-484e8cfc3fa9" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:45:21 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-5da3ce2d-9195-42ac-b065-5f310c535a68 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.424s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:45:21 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-5da3ce2d-9195-42ac-b065-5f310c535a68 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] <== connect_volume: return (1426ms) {'type': 'block', 'scsi_wwn': '23836343163326236', 'path': '/dev/sdb'} {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 11:45:21 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5da3ce2d-9195-42ac-b065-5f310c535a68 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: b12d9412-be17-4908-a4c2-b80c0fa38fc0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23836343163326236', 'path': '/dev/sdb'} {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 11:45:21 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-5da3ce2d-9195-42ac-b065-5f310c535a68 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:44:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-47931512',display_name='tempest-TestVolumeBootPattern-server-47931512',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-47931512',id=14,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4bd46cdaff7a4b40955f7c8a12c55452',ramdisk_id='',reservation_id='r-7ghfj8v7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-813872552',owner_user_name='tempest-TestVolumeBootPattern-813872552-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T11:45:00Z,user_data=None,user_id='804ccb0440fb46a4a4c0ae65c3893296',uuid=b12d9412-be17-4908-a4c2-b80c0fa38fc0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "be4bd89d-1a52-49a7-8241-ca24224fb018", "address": "fa:16:3e:f6:25:6f", "network": {"id": "a9e8fcd6-4152-466b-99ad-44b85db05a05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-920564935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bd46cdaff7a4b40955f7c8a12c55452", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe4bd89d-1a", "ovs_interfaceid": "be4bd89d-1a52-49a7-8241-ca24224fb018", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73449) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 11:45:21 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-5da3ce2d-9195-42ac-b065-5f310c535a68 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Converting VIF {"id": "be4bd89d-1a52-49a7-8241-ca24224fb018", "address": "fa:16:3e:f6:25:6f", "network": {"id": "a9e8fcd6-4152-466b-99ad-44b85db05a05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-920564935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bd46cdaff7a4b40955f7c8a12c55452", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe4bd89d-1a", "ovs_interfaceid": "be4bd89d-1a52-49a7-8241-ca24224fb018", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:45:21 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-5da3ce2d-9195-42ac-b065-5f310c535a68 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:25:6f,bridge_name='br-int',has_traffic_filtering=True,id=be4bd89d-1a52-49a7-8241-ca24224fb018,network=Network(a9e8fcd6-4152-466b-99ad-44b85db05a05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe4bd89d-1a') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:45:21 user nova-compute[73449]: DEBUG nova.objects.instance [None req-5da3ce2d-9195-42ac-b065-5f310c535a68 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Lazy-loading 'pci_devices' on Instance uuid b12d9412-be17-4908-a4c2-b80c0fa38fc0 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:45:21 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-5da3ce2d-9195-42ac-b065-5f310c535a68 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: b12d9412-be17-4908-a4c2-b80c0fa38fc0] End _get_guest_xml xml=<domain type="kvm">
Aug 17 11:45:21 user nova-compute[73449]:   <uuid>b12d9412-be17-4908-a4c2-b80c0fa38fc0</uuid>
Aug 17 11:45:21 user nova-compute[73449]:   <name>instance-0000000e</name>
Aug 17 11:45:21 user nova-compute[73449]:   <memory>524288</memory>
Aug 17 11:45:21 user nova-compute[73449]:   <vcpu>1</vcpu>
Aug 17 11:45:21 user nova-compute[73449]:   <metadata>
Aug 17 11:45:21 user nova-compute[73449]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 11:45:21 user nova-compute[73449]:       <nova:package version="0.0.0"/>
Aug 17 11:45:21 user nova-compute[73449]:       <nova:name>tempest-TestVolumeBootPattern-server-47931512</nova:name>
Aug 17 11:45:21 user nova-compute[73449]:       <nova:creationTime>2023-08-17 11:45:20</nova:creationTime>
Aug 17 11:45:21 user nova-compute[73449]:       <nova:flavor name="m1.tiny">
Aug 17 11:45:21 user nova-compute[73449]:         <nova:memory>512</nova:memory>
Aug 17 11:45:21 user nova-compute[73449]:         <nova:disk>1</nova:disk>
Aug 17 11:45:21 user nova-compute[73449]:         <nova:swap>0</nova:swap>
Aug 17 11:45:21 user nova-compute[73449]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 11:45:21 user nova-compute[73449]:         <nova:vcpus>1</nova:vcpus>
Aug 17 11:45:21 user nova-compute[73449]:       </nova:flavor>
Aug 17 11:45:21 user nova-compute[73449]:       <nova:owner>
Aug 17 11:45:21 user nova-compute[73449]:         <nova:user uuid="804ccb0440fb46a4a4c0ae65c3893296">tempest-TestVolumeBootPattern-813872552-project-member</nova:user>
Aug 17 11:45:21 user nova-compute[73449]:         <nova:project uuid="4bd46cdaff7a4b40955f7c8a12c55452">tempest-TestVolumeBootPattern-813872552</nova:project>
Aug 17 11:45:21 user nova-compute[73449]:       </nova:owner>
Aug 17 11:45:21 user nova-compute[73449]:       <nova:ports>
Aug 17 11:45:21 user nova-compute[73449]:         <nova:port uuid="be4bd89d-1a52-49a7-8241-ca24224fb018">
Aug 17 11:45:21 user nova-compute[73449]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 17 11:45:21 user nova-compute[73449]:         </nova:port>
Aug 17 11:45:21 user nova-compute[73449]:       </nova:ports>
Aug 17 11:45:21 user nova-compute[73449]:     </nova:instance>
Aug 17 11:45:21 user nova-compute[73449]:   </metadata>
Aug 17 11:45:21 user nova-compute[73449]:   <sysinfo type="smbios">
Aug 17 11:45:21 user nova-compute[73449]:     <system>
Aug 17 11:45:21 user nova-compute[73449]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 11:45:21 user nova-compute[73449]:       <entry name="product">OpenStack Nova</entry>
Aug 17 11:45:21 user nova-compute[73449]:       <entry name="version">0.0.0</entry>
Aug 17 11:45:21 user nova-compute[73449]:       <entry name="serial">b12d9412-be17-4908-a4c2-b80c0fa38fc0</entry>
Aug 17 11:45:21 user nova-compute[73449]:       <entry name="uuid">b12d9412-be17-4908-a4c2-b80c0fa38fc0</entry>
Aug 17 11:45:21 user nova-compute[73449]:       <entry name="family">Virtual Machine</entry>
Aug 17 11:45:21 user nova-compute[73449]:     </system>
Aug 17 11:45:21 user nova-compute[73449]:   </sysinfo>
Aug 17 11:45:21 user nova-compute[73449]:   <os>
Aug 17 11:45:21 user nova-compute[73449]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 11:45:21 user nova-compute[73449]:     <boot dev="hd"/>
Aug 17 11:45:21 user nova-compute[73449]:     <smbios mode="sysinfo"/>
Aug 17 11:45:21 user nova-compute[73449]:   </os>
Aug 17 11:45:21 user nova-compute[73449]:   <features>
Aug 17 11:45:21 user nova-compute[73449]:     <acpi/>
Aug 17 11:45:21 user nova-compute[73449]:     <apic/>
Aug 17 11:45:21 user nova-compute[73449]:     <vmcoreinfo/>
Aug 17 11:45:21 user nova-compute[73449]:   </features>
Aug 17 11:45:21 user nova-compute[73449]:   <clock offset="utc">
Aug 17 11:45:21 user nova-compute[73449]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 11:45:21 user nova-compute[73449]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 11:45:21 user nova-compute[73449]:     <timer name="hpet" present="no"/>
Aug 17 11:45:21 user nova-compute[73449]:   </clock>
Aug 17 11:45:21 user nova-compute[73449]:   <cpu mode="custom" match="exact">
Aug 17 11:45:21 user nova-compute[73449]:     <model>Nehalem</model>
Aug 17 11:45:21 user nova-compute[73449]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 11:45:21 user nova-compute[73449]:   </cpu>
Aug 17 11:45:21 user nova-compute[73449]:   <devices>
Aug 17 11:45:21 user nova-compute[73449]:     <disk type="block" device="disk">
Aug 17 11:45:21 user nova-compute[73449]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 11:45:21 user nova-compute[73449]:       <source dev="/dev/sdb"/>
Aug 17 11:45:21 user nova-compute[73449]:       <target dev="vda" bus="virtio"/>
Aug 17 11:45:21 user nova-compute[73449]:       <serial>d22566b5-74eb-4aeb-b14c-0bd5aa9e35ee</serial>
Aug 17 11:45:21 user nova-compute[73449]:     </disk>
Aug 17 11:45:21 user nova-compute[73449]:     <interface type="ethernet">
Aug 17 11:45:21 user nova-compute[73449]:       <mac address="fa:16:3e:f6:25:6f"/>
Aug 17 11:45:21 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 11:45:21 user nova-compute[73449]:       <mtu size="1442"/>
Aug 17 11:45:21 user nova-compute[73449]:       <target dev="tapbe4bd89d-1a"/>
Aug 17 11:45:21 user nova-compute[73449]:     </interface>
Aug 17 11:45:21 user nova-compute[73449]:     <serial type="pty">
Aug 17 11:45:21 user nova-compute[73449]:       <log file="/opt/stack/data/nova/instances/b12d9412-be17-4908-a4c2-b80c0fa38fc0/console.log" append="off"/>
Aug 17 11:45:21 user nova-compute[73449]:     </serial>
Aug 17 11:45:21 user nova-compute[73449]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 11:45:21 user nova-compute[73449]:     <video>
Aug 17 11:45:21 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 11:45:21 user nova-compute[73449]:     </video>
Aug 17 11:45:21 user nova-compute[73449]:     <rng model="virtio">
Aug 17 11:45:21 user nova-compute[73449]:       <backend model="random">/dev/urandom</backend>
Aug 17 11:45:21 user nova-compute[73449]:     </rng>
Aug 17 11:45:21 user nova-compute[73449]:     <controller type="usb" index="0" model="none"/>
Aug 17 11:45:21 user nova-compute[73449]:     <memballoon model="virtio">
Aug 17 11:45:21 user nova-compute[73449]:       <stats period="10"/>
Aug 17 11:45:21 user nova-compute[73449]:     </memballoon>
Aug 17 11:45:21 user nova-compute[73449]:   </devices>
Aug 17 11:45:21 user nova-compute[73449]: </domain>
Aug 17 11:45:21 user nova-compute[73449]:  {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 11:45:21 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-5da3ce2d-9195-42ac-b065-5f310c535a68 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:44:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-47931512',display_name='tempest-TestVolumeBootPattern-server-47931512',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-47931512',id=14,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4bd46cdaff7a4b40955f7c8a12c55452',ramdisk_id='',reservation_id='r-7ghfj8v7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-813872552',owner_user_name='tempest-TestVolumeBootPattern-813872552-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T11:45:00Z,user_data=None,user_id='804ccb0440fb46a4a4c0ae65c3893296',uuid=b12d9412-be17-4908-a4c2-b80c0fa38fc0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "be4bd89d-1a52-49a7-8241-ca24224fb018", "address": "fa:16:3e:f6:25:6f", "network": {"id": "a9e8fcd6-4152-466b-99ad-44b85db05a05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-920564935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bd46cdaff7a4b40955f7c8a12c55452", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe4bd89d-1a", "ovs_interfaceid": "be4bd89d-1a52-49a7-8241-ca24224fb018", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 11:45:21 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-5da3ce2d-9195-42ac-b065-5f310c535a68 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Converting VIF {"id": "be4bd89d-1a52-49a7-8241-ca24224fb018", "address": "fa:16:3e:f6:25:6f", "network": {"id": "a9e8fcd6-4152-466b-99ad-44b85db05a05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-920564935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bd46cdaff7a4b40955f7c8a12c55452", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe4bd89d-1a", "ovs_interfaceid": "be4bd89d-1a52-49a7-8241-ca24224fb018", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:45:21 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-5da3ce2d-9195-42ac-b065-5f310c535a68 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:25:6f,bridge_name='br-int',has_traffic_filtering=True,id=be4bd89d-1a52-49a7-8241-ca24224fb018,network=Network(a9e8fcd6-4152-466b-99ad-44b85db05a05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe4bd89d-1a') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:45:21 user nova-compute[73449]: DEBUG os_vif [None req-5da3ce2d-9195-42ac-b065-5f310c535a68 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:25:6f,bridge_name='br-int',has_traffic_filtering=True,id=be4bd89d-1a52-49a7-8241-ca24224fb018,network=Network(a9e8fcd6-4152-466b-99ad-44b85db05a05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe4bd89d-1a') {{(pid=73449) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 11:45:21 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:45:21 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:45:21 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 11:45:21 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:45:21 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbe4bd89d-1a, may_exist=True, interface_attrs={}) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:45:21 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbe4bd89d-1a, col_values=(('external_ids', {'iface-id': 'be4bd89d-1a52-49a7-8241-ca24224fb018', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f6:25:6f', 'vm-uuid': 'b12d9412-be17-4908-a4c2-b80c0fa38fc0'}),), if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:45:21 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:45:21 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:45:21 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:45:21 user nova-compute[73449]: INFO os_vif [None req-5da3ce2d-9195-42ac-b065-5f310c535a68 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:25:6f,bridge_name='br-int',has_traffic_filtering=True,id=be4bd89d-1a52-49a7-8241-ca24224fb018,network=Network(a9e8fcd6-4152-466b-99ad-44b85db05a05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe4bd89d-1a')
Aug 17 11:45:22 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-5da3ce2d-9195-42ac-b065-5f310c535a68 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] No BDM found with device name vda, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 11:45:22 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-5da3ce2d-9195-42ac-b065-5f310c535a68 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] No VIF found with MAC fa:16:3e:f6:25:6f, not building metadata {{(pid=73449) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 11:45:22 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:45:24 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:45:24 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:45:24 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:45:24 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:45:24 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:45:24 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:45:24 user nova-compute[73449]: DEBUG nova.compute.manager [req-d925b958-b681-4c53-b78c-f8fd997af365 req-e2148790-5eec-4ba7-93cb-a7d0780f4637 service nova] [instance: c69e7643-8c60-4982-986b-484e8cfc3fa9] Received event network-vif-plugged-8fd82fbd-985b-4260-a066-3bda2e4c1f1c {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:45:24 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-d925b958-b681-4c53-b78c-f8fd997af365 req-e2148790-5eec-4ba7-93cb-a7d0780f4637 service nova] Acquiring lock "c69e7643-8c60-4982-986b-484e8cfc3fa9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:45:24 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-d925b958-b681-4c53-b78c-f8fd997af365 req-e2148790-5eec-4ba7-93cb-a7d0780f4637 service nova] Lock "c69e7643-8c60-4982-986b-484e8cfc3fa9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:45:24 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-d925b958-b681-4c53-b78c-f8fd997af365 req-e2148790-5eec-4ba7-93cb-a7d0780f4637 service nova] Lock "c69e7643-8c60-4982-986b-484e8cfc3fa9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:45:24 user nova-compute[73449]: DEBUG nova.compute.manager [req-d925b958-b681-4c53-b78c-f8fd997af365 req-e2148790-5eec-4ba7-93cb-a7d0780f4637 service nova] [instance: c69e7643-8c60-4982-986b-484e8cfc3fa9] No waiting events found dispatching network-vif-plugged-8fd82fbd-985b-4260-a066-3bda2e4c1f1c {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:45:24 user nova-compute[73449]: WARNING nova.compute.manager [req-d925b958-b681-4c53-b78c-f8fd997af365 req-e2148790-5eec-4ba7-93cb-a7d0780f4637 service nova] [instance: c69e7643-8c60-4982-986b-484e8cfc3fa9] Received unexpected event network-vif-plugged-8fd82fbd-985b-4260-a066-3bda2e4c1f1c for instance with vm_state building and task_state spawning.
Aug 17 11:45:24 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:45:25 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:45:25 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:45:25 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:45:25 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:45:26 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:45:26 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:45:26 user nova-compute[73449]: DEBUG nova.compute.manager [req-2af2f1ae-78e6-4bda-9a56-75788c500336 req-6e0c8610-47eb-48b2-a319-a1d29b580076 service nova] [instance: c69e7643-8c60-4982-986b-484e8cfc3fa9] Received event network-vif-plugged-8fd82fbd-985b-4260-a066-3bda2e4c1f1c {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:45:26 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-2af2f1ae-78e6-4bda-9a56-75788c500336 req-6e0c8610-47eb-48b2-a319-a1d29b580076 service nova] Acquiring lock "c69e7643-8c60-4982-986b-484e8cfc3fa9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:45:26 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-2af2f1ae-78e6-4bda-9a56-75788c500336 req-6e0c8610-47eb-48b2-a319-a1d29b580076 service nova] Lock "c69e7643-8c60-4982-986b-484e8cfc3fa9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:45:26 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-2af2f1ae-78e6-4bda-9a56-75788c500336 req-6e0c8610-47eb-48b2-a319-a1d29b580076 service nova] Lock "c69e7643-8c60-4982-986b-484e8cfc3fa9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:45:26 user nova-compute[73449]: DEBUG nova.compute.manager [req-2af2f1ae-78e6-4bda-9a56-75788c500336 req-6e0c8610-47eb-48b2-a319-a1d29b580076 service nova] [instance: c69e7643-8c60-4982-986b-484e8cfc3fa9] No waiting events found dispatching network-vif-plugged-8fd82fbd-985b-4260-a066-3bda2e4c1f1c {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:45:26 user nova-compute[73449]: WARNING nova.compute.manager [req-2af2f1ae-78e6-4bda-9a56-75788c500336 req-6e0c8610-47eb-48b2-a319-a1d29b580076 service nova] [instance: c69e7643-8c60-4982-986b-484e8cfc3fa9] Received unexpected event network-vif-plugged-8fd82fbd-985b-4260-a066-3bda2e4c1f1c for instance with vm_state building and task_state spawning.
Aug 17 11:45:26 user nova-compute[73449]: DEBUG nova.compute.manager [req-2af2f1ae-78e6-4bda-9a56-75788c500336 req-6e0c8610-47eb-48b2-a319-a1d29b580076 service nova] [instance: b12d9412-be17-4908-a4c2-b80c0fa38fc0] Received event network-vif-plugged-be4bd89d-1a52-49a7-8241-ca24224fb018 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:45:26 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-2af2f1ae-78e6-4bda-9a56-75788c500336 req-6e0c8610-47eb-48b2-a319-a1d29b580076 service nova] Acquiring lock "b12d9412-be17-4908-a4c2-b80c0fa38fc0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:45:26 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-2af2f1ae-78e6-4bda-9a56-75788c500336 req-6e0c8610-47eb-48b2-a319-a1d29b580076 service nova] Lock "b12d9412-be17-4908-a4c2-b80c0fa38fc0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:45:26 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-2af2f1ae-78e6-4bda-9a56-75788c500336 req-6e0c8610-47eb-48b2-a319-a1d29b580076 service nova] Lock "b12d9412-be17-4908-a4c2-b80c0fa38fc0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:45:26 user nova-compute[73449]: DEBUG nova.compute.manager [req-2af2f1ae-78e6-4bda-9a56-75788c500336 req-6e0c8610-47eb-48b2-a319-a1d29b580076 service nova] [instance: b12d9412-be17-4908-a4c2-b80c0fa38fc0] No waiting events found dispatching network-vif-plugged-be4bd89d-1a52-49a7-8241-ca24224fb018 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:45:26 user nova-compute[73449]: WARNING nova.compute.manager [req-2af2f1ae-78e6-4bda-9a56-75788c500336 req-6e0c8610-47eb-48b2-a319-a1d29b580076 service nova] [instance: b12d9412-be17-4908-a4c2-b80c0fa38fc0] Received unexpected event network-vif-plugged-be4bd89d-1a52-49a7-8241-ca24224fb018 for instance with vm_state building and task_state spawning.
Aug 17 11:45:26 user nova-compute[73449]: DEBUG nova.compute.manager [req-2af2f1ae-78e6-4bda-9a56-75788c500336 req-6e0c8610-47eb-48b2-a319-a1d29b580076 service nova] [instance: b12d9412-be17-4908-a4c2-b80c0fa38fc0] Received event network-vif-plugged-be4bd89d-1a52-49a7-8241-ca24224fb018 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:45:26 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-2af2f1ae-78e6-4bda-9a56-75788c500336 req-6e0c8610-47eb-48b2-a319-a1d29b580076 service nova] Acquiring lock "b12d9412-be17-4908-a4c2-b80c0fa38fc0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:45:26 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-2af2f1ae-78e6-4bda-9a56-75788c500336 req-6e0c8610-47eb-48b2-a319-a1d29b580076 service nova] Lock "b12d9412-be17-4908-a4c2-b80c0fa38fc0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:45:26 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-2af2f1ae-78e6-4bda-9a56-75788c500336 req-6e0c8610-47eb-48b2-a319-a1d29b580076 service nova] Lock "b12d9412-be17-4908-a4c2-b80c0fa38fc0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:45:26 user nova-compute[73449]: DEBUG nova.compute.manager [req-2af2f1ae-78e6-4bda-9a56-75788c500336 req-6e0c8610-47eb-48b2-a319-a1d29b580076 service nova] [instance: b12d9412-be17-4908-a4c2-b80c0fa38fc0] No waiting events found dispatching network-vif-plugged-be4bd89d-1a52-49a7-8241-ca24224fb018 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:45:26 user nova-compute[73449]: WARNING nova.compute.manager [req-2af2f1ae-78e6-4bda-9a56-75788c500336 req-6e0c8610-47eb-48b2-a319-a1d29b580076 service nova] [instance: b12d9412-be17-4908-a4c2-b80c0fa38fc0] Received unexpected event network-vif-plugged-be4bd89d-1a52-49a7-8241-ca24224fb018 for instance with vm_state building and task_state spawning.
Aug 17 11:45:26 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:45:27 user nova-compute[73449]: DEBUG nova.compute.manager [None req-301998f8-e85b-4928-a10a-7970e05859eb tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] [instance: c69e7643-8c60-4982-986b-484e8cfc3fa9] Instance event wait completed in 0 seconds for  {{(pid=73449) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 11:45:27 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-301998f8-e85b-4928-a10a-7970e05859eb tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] [instance: c69e7643-8c60-4982-986b-484e8cfc3fa9] Guest created on hypervisor {{(pid=73449) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 11:45:27 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692272727.640783, c69e7643-8c60-4982-986b-484e8cfc3fa9 => Resumed> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:45:27 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: c69e7643-8c60-4982-986b-484e8cfc3fa9] VM Resumed (Lifecycle Event)
Aug 17 11:45:27 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: c69e7643-8c60-4982-986b-484e8cfc3fa9] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:45:27 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: c69e7643-8c60-4982-986b-484e8cfc3fa9] Instance spawned successfully.
Aug 17 11:45:27 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-301998f8-e85b-4928-a10a-7970e05859eb tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] [instance: c69e7643-8c60-4982-986b-484e8cfc3fa9] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 11:45:27 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: c69e7643-8c60-4982-986b-484e8cfc3fa9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 11:45:27 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-301998f8-e85b-4928-a10a-7970e05859eb tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] [instance: c69e7643-8c60-4982-986b-484e8cfc3fa9] Found default for hw_input_bus of None {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:45:27 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-301998f8-e85b-4928-a10a-7970e05859eb tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] [instance: c69e7643-8c60-4982-986b-484e8cfc3fa9] Found default for hw_pointer_model of None {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:45:27 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-301998f8-e85b-4928-a10a-7970e05859eb tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] [instance: c69e7643-8c60-4982-986b-484e8cfc3fa9] Found default for hw_video_model of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:45:27 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-301998f8-e85b-4928-a10a-7970e05859eb tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] [instance: c69e7643-8c60-4982-986b-484e8cfc3fa9] Found default for hw_vif_model of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:45:27 user nova-compute[73449]: DEBUG nova.compute.manager [None req-5da3ce2d-9195-42ac-b065-5f310c535a68 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: b12d9412-be17-4908-a4c2-b80c0fa38fc0] Instance event wait completed in 0 seconds for  {{(pid=73449) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 11:45:27 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-5da3ce2d-9195-42ac-b065-5f310c535a68 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: b12d9412-be17-4908-a4c2-b80c0fa38fc0] Guest created on hypervisor {{(pid=73449) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 11:45:27 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: c69e7643-8c60-4982-986b-484e8cfc3fa9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 11:45:27 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692272727.648288, c69e7643-8c60-4982-986b-484e8cfc3fa9 => Started> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:45:27 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: c69e7643-8c60-4982-986b-484e8cfc3fa9] VM Started (Lifecycle Event)
Aug 17 11:45:27 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: b12d9412-be17-4908-a4c2-b80c0fa38fc0] Instance spawned successfully.
Aug 17 11:45:27 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-5da3ce2d-9195-42ac-b065-5f310c535a68 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: b12d9412-be17-4908-a4c2-b80c0fa38fc0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 11:45:27 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: c69e7643-8c60-4982-986b-484e8cfc3fa9] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:45:27 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: c69e7643-8c60-4982-986b-484e8cfc3fa9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 11:45:27 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-5da3ce2d-9195-42ac-b065-5f310c535a68 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: b12d9412-be17-4908-a4c2-b80c0fa38fc0] Found default for hw_cdrom_bus of ide {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:45:27 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-5da3ce2d-9195-42ac-b065-5f310c535a68 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: b12d9412-be17-4908-a4c2-b80c0fa38fc0] Found default for hw_disk_bus of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:45:27 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-5da3ce2d-9195-42ac-b065-5f310c535a68 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: b12d9412-be17-4908-a4c2-b80c0fa38fc0] Found default for hw_input_bus of None {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:45:27 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-5da3ce2d-9195-42ac-b065-5f310c535a68 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: b12d9412-be17-4908-a4c2-b80c0fa38fc0] Found default for hw_pointer_model of None {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:45:27 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-5da3ce2d-9195-42ac-b065-5f310c535a68 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: b12d9412-be17-4908-a4c2-b80c0fa38fc0] Found default for hw_video_model of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:45:27 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-5da3ce2d-9195-42ac-b065-5f310c535a68 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: b12d9412-be17-4908-a4c2-b80c0fa38fc0] Found default for hw_vif_model of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:45:27 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:45:27 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: c69e7643-8c60-4982-986b-484e8cfc3fa9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 11:45:27 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692272727.721419, b12d9412-be17-4908-a4c2-b80c0fa38fc0 => Resumed> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:45:27 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: b12d9412-be17-4908-a4c2-b80c0fa38fc0] VM Resumed (Lifecycle Event)
Aug 17 11:45:27 user nova-compute[73449]: INFO nova.compute.manager [None req-301998f8-e85b-4928-a10a-7970e05859eb tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] [instance: c69e7643-8c60-4982-986b-484e8cfc3fa9] Took 10.32 seconds to spawn the instance on the hypervisor.
Aug 17 11:45:27 user nova-compute[73449]: DEBUG nova.compute.manager [None req-301998f8-e85b-4928-a10a-7970e05859eb tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] [instance: c69e7643-8c60-4982-986b-484e8cfc3fa9] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:45:27 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: b12d9412-be17-4908-a4c2-b80c0fa38fc0] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:45:27 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: b12d9412-be17-4908-a4c2-b80c0fa38fc0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 11:45:27 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: b12d9412-be17-4908-a4c2-b80c0fa38fc0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 11:45:27 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692272727.7215493, b12d9412-be17-4908-a4c2-b80c0fa38fc0 => Started> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:45:27 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: b12d9412-be17-4908-a4c2-b80c0fa38fc0] VM Started (Lifecycle Event)
Aug 17 11:45:27 user nova-compute[73449]: INFO nova.compute.manager [None req-5da3ce2d-9195-42ac-b065-5f310c535a68 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: b12d9412-be17-4908-a4c2-b80c0fa38fc0] Took 7.88 seconds to spawn the instance on the hypervisor.
Aug 17 11:45:27 user nova-compute[73449]: DEBUG nova.compute.manager [None req-5da3ce2d-9195-42ac-b065-5f310c535a68 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: b12d9412-be17-4908-a4c2-b80c0fa38fc0] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:45:27 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: b12d9412-be17-4908-a4c2-b80c0fa38fc0] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:45:27 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: b12d9412-be17-4908-a4c2-b80c0fa38fc0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 11:45:27 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: b12d9412-be17-4908-a4c2-b80c0fa38fc0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 11:45:27 user nova-compute[73449]: INFO nova.compute.manager [None req-301998f8-e85b-4928-a10a-7970e05859eb tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] [instance: c69e7643-8c60-4982-986b-484e8cfc3fa9] Took 11.64 seconds to build instance.
Aug 17 11:45:28 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-301998f8-e85b-4928-a10a-7970e05859eb tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] Lock "c69e7643-8c60-4982-986b-484e8cfc3fa9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.766s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:45:28 user nova-compute[73449]: INFO nova.compute.manager [None req-5da3ce2d-9195-42ac-b065-5f310c535a68 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: b12d9412-be17-4908-a4c2-b80c0fa38fc0] Took 28.47 seconds to build instance.
Aug 17 11:45:28 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-5da3ce2d-9195-42ac-b065-5f310c535a68 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Lock "b12d9412-be17-4908-a4c2-b80c0fa38fc0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 28.575s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:45:30 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:45:31 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:45:32 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:45:33 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-0b386429-b788-46e8-845f-b5c0d2adbc33 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Acquiring lock "e8e7d9aa-150f-424a-b3af-be149ee421c3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:45:33 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-0b386429-b788-46e8-845f-b5c0d2adbc33 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Lock "e8e7d9aa-150f-424a-b3af-be149ee421c3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:45:33 user nova-compute[73449]: DEBUG nova.compute.manager [None req-0b386429-b788-46e8-845f-b5c0d2adbc33 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] Starting instance... {{(pid=73449) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 11:45:33 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-0b386429-b788-46e8-845f-b5c0d2adbc33 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:45:33 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-0b386429-b788-46e8-845f-b5c0d2adbc33 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:45:33 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-0b386429-b788-46e8-845f-b5c0d2adbc33 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73449) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 11:45:33 user nova-compute[73449]: INFO nova.compute.claims [None req-0b386429-b788-46e8-845f-b5c0d2adbc33 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] Claim successful on node user
Aug 17 11:45:34 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-0b386429-b788-46e8-845f-b5c0d2adbc33 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 11:45:34 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-0b386429-b788-46e8-845f-b5c0d2adbc33 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 11:45:34 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-0b386429-b788-46e8-845f-b5c0d2adbc33 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.646s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:45:34 user nova-compute[73449]: DEBUG nova.compute.manager [None req-0b386429-b788-46e8-845f-b5c0d2adbc33 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] Start building networks asynchronously for instance. {{(pid=73449) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 11:45:34 user nova-compute[73449]: DEBUG nova.compute.manager [None req-0b386429-b788-46e8-845f-b5c0d2adbc33 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] Allocating IP information in the background. {{(pid=73449) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 11:45:34 user nova-compute[73449]: DEBUG nova.network.neutron [None req-0b386429-b788-46e8-845f-b5c0d2adbc33 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] allocate_for_instance() {{(pid=73449) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 11:45:34 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-0b386429-b788-46e8-845f-b5c0d2adbc33 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 11:45:34 user nova-compute[73449]: DEBUG nova.compute.manager [None req-0b386429-b788-46e8-845f-b5c0d2adbc33 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] Start building block device mappings for instance. {{(pid=73449) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 11:45:34 user nova-compute[73449]: INFO nova.virt.block_device [None req-0b386429-b788-46e8-845f-b5c0d2adbc33 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] Booting with volume 71f6919a-6a55-4d8f-ae84-7bb40d59f4ed at /dev/vda
Aug 17 11:45:34 user nova-compute[73449]: DEBUG nova.policy [None req-0b386429-b788-46e8-845f-b5c0d2adbc33 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cae6f48da3304f37a5d5010f3cbd7698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a0323f43b04829a3b1e81266986cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73449) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 11:45:34 user nova-compute[73449]: DEBUG os_brick.utils [None req-0b386429-b788-46e8-845f-b5c0d2adbc33 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 11:45:34 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:45:34 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:45:34 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2fedfee-1d70-43be-b024-b3f563d9ec91]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4d3924302012\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:45:34 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:45:34 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:45:34 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c9aa7d7-ad69-4c16-abb4-50d5d75ec0c2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:45:34 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:45:34 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.026s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:45:34 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4af0512-eeb3-4391-b612-f461f05420e7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:45:34 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7c8d244-f178-4208-a488-061b720195fb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:45:34 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-0b386429-b788-46e8-845f-b5c0d2adbc33 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Running cmd (subprocess): nvme version {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:45:34 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-0b386429-b788-46e8-845f-b5c0d2adbc33 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] 'nvme version' failed. Not Retrying. {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 11:45:34 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0b386429-b788-46e8-845f-b5c0d2adbc33 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] nvme not present on system {{(pid=73449) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 11:45:34 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:45:34 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 11:45:34 user nova-compute[73449]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 11:45:34 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[9523d5ef-f8dd-4972-a566-f75fa1159776]: (4, '') {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:45:34 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-0b386429-b788-46e8-845f-b5c0d2adbc33 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73449) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 11:45:34 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-0b386429-b788-46e8-845f-b5c0d2adbc33 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73449) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 11:45:34 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-0b386429-b788-46e8-845f-b5c0d2adbc33 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] LIGHTOS: no hostnqn found. {{(pid=73449) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 11:45:34 user nova-compute[73449]: DEBUG os_brick.utils [None req-0b386429-b788-46e8-845f-b5c0d2adbc33 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] <== get_connector_properties: return (166ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4d3924302012', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 11:45:34 user nova-compute[73449]: DEBUG nova.virt.block_device [None req-0b386429-b788-46e8-845f-b5c0d2adbc33 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] Updating existing volume attachment record: dce2d49e-5334-4373-b3f4-9cd1fd4ba1d4 {{(pid=73449) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 11:45:35 user nova-compute[73449]: DEBUG nova.network.neutron [None req-0b386429-b788-46e8-845f-b5c0d2adbc33 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] Successfully created port: 460de6e4-4651-4b83-93bd-fbb5db34bcfa {{(pid=73449) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 11:45:36 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:45:36 user nova-compute[73449]: DEBUG nova.network.neutron [None req-0b386429-b788-46e8-845f-b5c0d2adbc33 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] Successfully updated port: 460de6e4-4651-4b83-93bd-fbb5db34bcfa {{(pid=73449) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 11:45:36 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-0b386429-b788-46e8-845f-b5c0d2adbc33 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Acquiring lock "refresh_cache-e8e7d9aa-150f-424a-b3af-be149ee421c3" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:45:36 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-0b386429-b788-46e8-845f-b5c0d2adbc33 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Acquired lock "refresh_cache-e8e7d9aa-150f-424a-b3af-be149ee421c3" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:45:36 user nova-compute[73449]: DEBUG nova.network.neutron [None req-0b386429-b788-46e8-845f-b5c0d2adbc33 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] Building network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 11:45:36 user nova-compute[73449]: DEBUG nova.compute.manager [req-cc2ad951-f6f0-4401-8839-26da21fc0378 req-a43c511a-5077-4b7d-8df4-68fc29e357c7 service nova] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] Received event network-changed-460de6e4-4651-4b83-93bd-fbb5db34bcfa {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:45:36 user nova-compute[73449]: DEBUG nova.compute.manager [req-cc2ad951-f6f0-4401-8839-26da21fc0378 req-a43c511a-5077-4b7d-8df4-68fc29e357c7 service nova] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] Refreshing instance network info cache due to event network-changed-460de6e4-4651-4b83-93bd-fbb5db34bcfa. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 11:45:36 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-cc2ad951-f6f0-4401-8839-26da21fc0378 req-a43c511a-5077-4b7d-8df4-68fc29e357c7 service nova] Acquiring lock "refresh_cache-e8e7d9aa-150f-424a-b3af-be149ee421c3" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:45:36 user nova-compute[73449]: DEBUG nova.network.neutron [None req-0b386429-b788-46e8-845f-b5c0d2adbc33 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] Instance cache missing network info. {{(pid=73449) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 11:45:36 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:45:37 user nova-compute[73449]: DEBUG nova.network.neutron [None req-0b386429-b788-46e8-845f-b5c0d2adbc33 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] Updating instance_info_cache with network_info: [{"id": "460de6e4-4651-4b83-93bd-fbb5db34bcfa", "address": "fa:16:3e:59:e7:ee", "network": {"id": "d4fc5f62-8de4-4df1-9e12-0f192a793f5f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1016129651-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a0323f43b04829a3b1e81266986cbf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap460de6e4-46", "ovs_interfaceid": "460de6e4-4651-4b83-93bd-fbb5db34bcfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:45:37 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-0b386429-b788-46e8-845f-b5c0d2adbc33 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Releasing lock "refresh_cache-e8e7d9aa-150f-424a-b3af-be149ee421c3" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:45:37 user nova-compute[73449]: DEBUG nova.compute.manager [None req-0b386429-b788-46e8-845f-b5c0d2adbc33 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] Instance network_info: |[{"id": "460de6e4-4651-4b83-93bd-fbb5db34bcfa", "address": "fa:16:3e:59:e7:ee", "network": {"id": "d4fc5f62-8de4-4df1-9e12-0f192a793f5f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1016129651-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a0323f43b04829a3b1e81266986cbf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap460de6e4-46", "ovs_interfaceid": "460de6e4-4651-4b83-93bd-fbb5db34bcfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73449) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 11:45:37 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-cc2ad951-f6f0-4401-8839-26da21fc0378 req-a43c511a-5077-4b7d-8df4-68fc29e357c7 service nova] Acquired lock "refresh_cache-e8e7d9aa-150f-424a-b3af-be149ee421c3" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:45:37 user nova-compute[73449]: DEBUG nova.network.neutron [req-cc2ad951-f6f0-4401-8839-26da21fc0378 req-a43c511a-5077-4b7d-8df4-68fc29e357c7 service nova] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] Refreshing network info cache for port 460de6e4-4651-4b83-93bd-fbb5db34bcfa {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 11:45:37 user nova-compute[73449]: DEBUG nova.network.neutron [req-cc2ad951-f6f0-4401-8839-26da21fc0378 req-a43c511a-5077-4b7d-8df4-68fc29e357c7 service nova] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] Updated VIF entry in instance network info cache for port 460de6e4-4651-4b83-93bd-fbb5db34bcfa. {{(pid=73449) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 11:45:37 user nova-compute[73449]: DEBUG nova.network.neutron [req-cc2ad951-f6f0-4401-8839-26da21fc0378 req-a43c511a-5077-4b7d-8df4-68fc29e357c7 service nova] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] Updating instance_info_cache with network_info: [{"id": "460de6e4-4651-4b83-93bd-fbb5db34bcfa", "address": "fa:16:3e:59:e7:ee", "network": {"id": "d4fc5f62-8de4-4df1-9e12-0f192a793f5f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1016129651-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a0323f43b04829a3b1e81266986cbf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap460de6e4-46", "ovs_interfaceid": "460de6e4-4651-4b83-93bd-fbb5db34bcfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:45:37 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-cc2ad951-f6f0-4401-8839-26da21fc0378 req-a43c511a-5077-4b7d-8df4-68fc29e357c7 service nova] Releasing lock "refresh_cache-e8e7d9aa-150f-424a-b3af-be149ee421c3" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:45:37 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:45:40 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:45:41 user nova-compute[73449]: DEBUG nova.compute.manager [req-95768145-20fc-4385-9827-f19546244250 req-0050764c-b068-4f6e-b191-c9eb6e76733c service nova] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] Received event network-changed-e86f2a61-e64f-49ea-83ad-386755b33e00 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:45:41 user nova-compute[73449]: DEBUG nova.compute.manager [req-95768145-20fc-4385-9827-f19546244250 req-0050764c-b068-4f6e-b191-c9eb6e76733c service nova] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] Refreshing instance network info cache due to event network-changed-e86f2a61-e64f-49ea-83ad-386755b33e00. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 11:45:41 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-95768145-20fc-4385-9827-f19546244250 req-0050764c-b068-4f6e-b191-c9eb6e76733c service nova] Acquiring lock "refresh_cache-f35b7f2b-2f88-4b09-86ac-cb5a78a94584" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:45:41 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-95768145-20fc-4385-9827-f19546244250 req-0050764c-b068-4f6e-b191-c9eb6e76733c service nova] Acquired lock "refresh_cache-f35b7f2b-2f88-4b09-86ac-cb5a78a94584" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:45:41 user nova-compute[73449]: DEBUG nova.network.neutron [req-95768145-20fc-4385-9827-f19546244250 req-0050764c-b068-4f6e-b191-c9eb6e76733c service nova] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] Refreshing network info cache for port e86f2a61-e64f-49ea-83ad-386755b33e00 {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 11:45:41 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:45:42 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-71fcf266-9928-4a10-b971-f13d1bc8ac03 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Acquiring lock "f35b7f2b-2f88-4b09-86ac-cb5a78a94584" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:45:42 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-71fcf266-9928-4a10-b971-f13d1bc8ac03 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Lock "f35b7f2b-2f88-4b09-86ac-cb5a78a94584" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:45:42 user nova-compute[73449]: DEBUG nova.objects.instance [None req-71fcf266-9928-4a10-b971-f13d1bc8ac03 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Lazy-loading 'flavor' on Instance uuid f35b7f2b-2f88-4b09-86ac-cb5a78a94584 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:45:42 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-71fcf266-9928-4a10-b971-f13d1bc8ac03 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Lock "f35b7f2b-2f88-4b09-86ac-cb5a78a94584" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.083s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:45:42 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-71fcf266-9928-4a10-b971-f13d1bc8ac03 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Acquiring lock "f35b7f2b-2f88-4b09-86ac-cb5a78a94584" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:45:42 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-71fcf266-9928-4a10-b971-f13d1bc8ac03 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Lock "f35b7f2b-2f88-4b09-86ac-cb5a78a94584" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:45:42 user nova-compute[73449]: INFO nova.compute.manager [None req-71fcf266-9928-4a10-b971-f13d1bc8ac03 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] Attaching volume 0254b152-714d-470d-bfac-2bb7b2761466 to /dev/vdb
Aug 17 11:45:42 user nova-compute[73449]: DEBUG os_brick.utils [None req-71fcf266-9928-4a10-b971-f13d1bc8ac03 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 11:45:42 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:45:42 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:45:42 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6919575-be44-4679-8f57-6810e5b8ab4d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4d3924302012\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:45:42 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:45:42 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:45:42 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[d88b08e5-e67f-4f00-aa91-d555be79d739]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:45:42 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:45:42 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:45:42 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb03df05-64b2-48bf-821f-feeabedda8f4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:45:42 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[e26cd1c6-bbde-46df-9807-8a28b36ffef4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:45:42 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-71fcf266-9928-4a10-b971-f13d1bc8ac03 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Running cmd (subprocess): nvme version {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:45:42 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-71fcf266-9928-4a10-b971-f13d1bc8ac03 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] 'nvme version' failed. Not Retrying. {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 11:45:42 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.nvmeof [None req-71fcf266-9928-4a10-b971-f13d1bc8ac03 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] nvme not present on system {{(pid=73449) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 11:45:42 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:45:42 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 11:45:42 user nova-compute[73449]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 11:45:42 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[d98e1e23-a8e7-471d-9745-a8340d166a61]: (4, '') {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:45:42 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-71fcf266-9928-4a10-b971-f13d1bc8ac03 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73449) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 11:45:42 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-71fcf266-9928-4a10-b971-f13d1bc8ac03 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73449) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 11:45:42 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-71fcf266-9928-4a10-b971-f13d1bc8ac03 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] LIGHTOS: no hostnqn found. {{(pid=73449) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 11:45:42 user nova-compute[73449]: DEBUG os_brick.utils [None req-71fcf266-9928-4a10-b971-f13d1bc8ac03 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] <== get_connector_properties: return (157ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4d3924302012', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 11:45:42 user nova-compute[73449]: DEBUG nova.virt.block_device [None req-71fcf266-9928-4a10-b971-f13d1bc8ac03 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] Updating existing volume attachment record: bfea2e5f-3ed1-476d-a9da-936e22d4f7cc {{(pid=73449) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 11:45:42 user nova-compute[73449]: DEBUG nova.network.neutron [req-95768145-20fc-4385-9827-f19546244250 req-0050764c-b068-4f6e-b191-c9eb6e76733c service nova] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] Updated VIF entry in instance network info cache for port e86f2a61-e64f-49ea-83ad-386755b33e00. {{(pid=73449) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 11:45:42 user nova-compute[73449]: DEBUG nova.network.neutron [req-95768145-20fc-4385-9827-f19546244250 req-0050764c-b068-4f6e-b191-c9eb6e76733c service nova] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] Updating instance_info_cache with network_info: [{"id": "e86f2a61-e64f-49ea-83ad-386755b33e00", "address": "fa:16:3e:4e:54:ff", "network": {"id": "72c50a42-688f-4868-8e19-c40b103a49cd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1792423641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "068c5270255744a18208a0ad9b35f168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape86f2a61-e6", "ovs_interfaceid": "e86f2a61-e64f-49ea-83ad-386755b33e00", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:45:42 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-95768145-20fc-4385-9827-f19546244250 req-0050764c-b068-4f6e-b191-c9eb6e76733c service nova] Releasing lock "refresh_cache-f35b7f2b-2f88-4b09-86ac-cb5a78a94584" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:45:42 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:45:42 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:45:42 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Cleaning up deleted instances {{(pid=73449) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 17 11:45:42 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] There are 0 instances to clean {{(pid=73449) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 17 11:45:44 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:45:44 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:45:45 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:45:45 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-7c67c828-7964-47aa-a8f0-fa0ad4cf6f52 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Acquiring lock "5e5229d5-65a2-4d60-8e50-c30357372a80" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:45:45 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-7c67c828-7964-47aa-a8f0-fa0ad4cf6f52 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Lock "5e5229d5-65a2-4d60-8e50-c30357372a80" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:45:45 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-7c67c828-7964-47aa-a8f0-fa0ad4cf6f52 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Acquiring lock "5e5229d5-65a2-4d60-8e50-c30357372a80-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:45:45 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-7c67c828-7964-47aa-a8f0-fa0ad4cf6f52 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Lock "5e5229d5-65a2-4d60-8e50-c30357372a80-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:45:45 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-7c67c828-7964-47aa-a8f0-fa0ad4cf6f52 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Lock "5e5229d5-65a2-4d60-8e50-c30357372a80-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:45:45 user nova-compute[73449]: INFO nova.compute.manager [None req-7c67c828-7964-47aa-a8f0-fa0ad4cf6f52 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] [instance: 5e5229d5-65a2-4d60-8e50-c30357372a80] Terminating instance
Aug 17 11:45:45 user nova-compute[73449]: DEBUG nova.compute.manager [None req-7c67c828-7964-47aa-a8f0-fa0ad4cf6f52 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] [instance: 5e5229d5-65a2-4d60-8e50-c30357372a80] Start destroying the instance on the hypervisor. {{(pid=73449) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 11:45:45 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:45:45 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:45:46 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:45:46 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:45:46 user nova-compute[73449]: DEBUG nova.compute.manager [req-0f3753fc-5096-4782-8597-b7c54472be38 req-84e5512a-384d-4741-aeac-505f39547b63 service nova] [instance: 5e5229d5-65a2-4d60-8e50-c30357372a80] Received event network-vif-unplugged-01a7a900-b5c9-46c8-b5b6-1aed4bef301e {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:45:46 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-0f3753fc-5096-4782-8597-b7c54472be38 req-84e5512a-384d-4741-aeac-505f39547b63 service nova] Acquiring lock "5e5229d5-65a2-4d60-8e50-c30357372a80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:45:46 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-0f3753fc-5096-4782-8597-b7c54472be38 req-84e5512a-384d-4741-aeac-505f39547b63 service nova] Lock "5e5229d5-65a2-4d60-8e50-c30357372a80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:45:46 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-0f3753fc-5096-4782-8597-b7c54472be38 req-84e5512a-384d-4741-aeac-505f39547b63 service nova] Lock "5e5229d5-65a2-4d60-8e50-c30357372a80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:45:46 user nova-compute[73449]: DEBUG nova.compute.manager [req-0f3753fc-5096-4782-8597-b7c54472be38 req-84e5512a-384d-4741-aeac-505f39547b63 service nova] [instance: 5e5229d5-65a2-4d60-8e50-c30357372a80] No waiting events found dispatching network-vif-unplugged-01a7a900-b5c9-46c8-b5b6-1aed4bef301e {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:45:46 user nova-compute[73449]: DEBUG nova.compute.manager [req-0f3753fc-5096-4782-8597-b7c54472be38 req-84e5512a-384d-4741-aeac-505f39547b63 service nova] [instance: 5e5229d5-65a2-4d60-8e50-c30357372a80] Received event network-vif-unplugged-01a7a900-b5c9-46c8-b5b6-1aed4bef301e for instance with task_state deleting. {{(pid=73449) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 11:45:46 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: 5e5229d5-65a2-4d60-8e50-c30357372a80] Instance destroyed successfully.
Aug 17 11:45:46 user nova-compute[73449]: DEBUG nova.objects.instance [None req-7c67c828-7964-47aa-a8f0-fa0ad4cf6f52 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Lazy-loading 'resources' on Instance uuid 5e5229d5-65a2-4d60-8e50-c30357372a80 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:45:46 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-7c67c828-7964-47aa-a8f0-fa0ad4cf6f52 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:43:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-835157661',display_name='tempest-VolumesAdminNegativeTest-server-835157661',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-835157661',id=11,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T11:43:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2513ad48149f45e2a2bd4b404ebc13b6',ramdisk_id='',reservation_id='r-c0xvumfn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1247532735',owner_user_name='tempest-VolumesAdminNegativeTest-1247532735-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T11:43:42Z,user_data=None,user_id='4cfe2e3e87454eb38768c2ed81450b1d',uuid=5e5229d5-65a2-4d60-8e50-c30357372a80,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "01a7a900-b5c9-46c8-b5b6-1aed4bef301e", "address": "fa:16:3e:c4:2b:67", "network": {"id": "ef0c44c4-ef68-433d-bfbc-71272ed64948", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-24887935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2513ad48149f45e2a2bd4b404ebc13b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01a7a900-b5", "ovs_interfaceid": "01a7a900-b5c9-46c8-b5b6-1aed4bef301e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 11:45:46 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-7c67c828-7964-47aa-a8f0-fa0ad4cf6f52 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Converting VIF {"id": "01a7a900-b5c9-46c8-b5b6-1aed4bef301e", "address": "fa:16:3e:c4:2b:67", "network": {"id": "ef0c44c4-ef68-433d-bfbc-71272ed64948", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-24887935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2513ad48149f45e2a2bd4b404ebc13b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01a7a900-b5", "ovs_interfaceid": "01a7a900-b5c9-46c8-b5b6-1aed4bef301e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:45:46 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-7c67c828-7964-47aa-a8f0-fa0ad4cf6f52 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:2b:67,bridge_name='br-int',has_traffic_filtering=True,id=01a7a900-b5c9-46c8-b5b6-1aed4bef301e,network=Network(ef0c44c4-ef68-433d-bfbc-71272ed64948),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01a7a900-b5') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:45:46 user nova-compute[73449]: DEBUG os_vif [None req-7c67c828-7964-47aa-a8f0-fa0ad4cf6f52 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:2b:67,bridge_name='br-int',has_traffic_filtering=True,id=01a7a900-b5c9-46c8-b5b6-1aed4bef301e,network=Network(ef0c44c4-ef68-433d-bfbc-71272ed64948),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01a7a900-b5') {{(pid=73449) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 11:45:46 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:45:46 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap01a7a900-b5, bridge=br-int, if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:45:46 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:45:46 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:45:46 user nova-compute[73449]: INFO os_vif [None req-7c67c828-7964-47aa-a8f0-fa0ad4cf6f52 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:2b:67,bridge_name='br-int',has_traffic_filtering=True,id=01a7a900-b5c9-46c8-b5b6-1aed4bef301e,network=Network(ef0c44c4-ef68-433d-bfbc-71272ed64948),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01a7a900-b5')
Aug 17 11:45:46 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-7c67c828-7964-47aa-a8f0-fa0ad4cf6f52 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] [instance: 5e5229d5-65a2-4d60-8e50-c30357372a80] Deleting instance files /opt/stack/data/nova/instances/5e5229d5-65a2-4d60-8e50-c30357372a80_del
Aug 17 11:45:46 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-7c67c828-7964-47aa-a8f0-fa0ad4cf6f52 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] [instance: 5e5229d5-65a2-4d60-8e50-c30357372a80] Deletion of /opt/stack/data/nova/instances/5e5229d5-65a2-4d60-8e50-c30357372a80_del complete
Aug 17 11:45:46 user nova-compute[73449]: INFO nova.compute.manager [None req-7c67c828-7964-47aa-a8f0-fa0ad4cf6f52 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] [instance: 5e5229d5-65a2-4d60-8e50-c30357372a80] Took 0.93 seconds to destroy the instance on the hypervisor.
Aug 17 11:45:46 user nova-compute[73449]: DEBUG oslo.service.loopingcall [None req-7c67c828-7964-47aa-a8f0-fa0ad4cf6f52 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73449) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 11:45:46 user nova-compute[73449]: DEBUG nova.compute.manager [-] [instance: 5e5229d5-65a2-4d60-8e50-c30357372a80] Deallocating network for instance {{(pid=73449) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 11:45:46 user nova-compute[73449]: DEBUG nova.network.neutron [-] [instance: 5e5229d5-65a2-4d60-8e50-c30357372a80] deallocate_for_instance() {{(pid=73449) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 11:45:46 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:45:47 user nova-compute[73449]: DEBUG nova.network.neutron [-] [instance: 5e5229d5-65a2-4d60-8e50-c30357372a80] Updating instance_info_cache with network_info: [] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:45:47 user nova-compute[73449]: INFO nova.compute.manager [-] [instance: 5e5229d5-65a2-4d60-8e50-c30357372a80] Took 1.24 seconds to deallocate network for instance.
Aug 17 11:45:47 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:45:47 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-7c67c828-7964-47aa-a8f0-fa0ad4cf6f52 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:45:47 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-7c67c828-7964-47aa-a8f0-fa0ad4cf6f52 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:45:47 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:45:47 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:45:48 user nova-compute[73449]: DEBUG nova.compute.manager [req-a3349ad7-88eb-4138-887c-e13a8f4f8bd1 req-a91a326b-849e-42cf-9995-fba146278e8d service nova] [instance: 5e5229d5-65a2-4d60-8e50-c30357372a80] Received event network-vif-plugged-01a7a900-b5c9-46c8-b5b6-1aed4bef301e {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:45:48 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-a3349ad7-88eb-4138-887c-e13a8f4f8bd1 req-a91a326b-849e-42cf-9995-fba146278e8d service nova] Acquiring lock "5e5229d5-65a2-4d60-8e50-c30357372a80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:45:48 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-a3349ad7-88eb-4138-887c-e13a8f4f8bd1 req-a91a326b-849e-42cf-9995-fba146278e8d service nova] Lock "5e5229d5-65a2-4d60-8e50-c30357372a80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:45:48 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-a3349ad7-88eb-4138-887c-e13a8f4f8bd1 req-a91a326b-849e-42cf-9995-fba146278e8d service nova] Lock "5e5229d5-65a2-4d60-8e50-c30357372a80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:45:48 user nova-compute[73449]: DEBUG nova.compute.manager [req-a3349ad7-88eb-4138-887c-e13a8f4f8bd1 req-a91a326b-849e-42cf-9995-fba146278e8d service nova] [instance: 5e5229d5-65a2-4d60-8e50-c30357372a80] No waiting events found dispatching network-vif-plugged-01a7a900-b5c9-46c8-b5b6-1aed4bef301e {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:45:48 user nova-compute[73449]: WARNING nova.compute.manager [req-a3349ad7-88eb-4138-887c-e13a8f4f8bd1 req-a91a326b-849e-42cf-9995-fba146278e8d service nova] [instance: 5e5229d5-65a2-4d60-8e50-c30357372a80] Received unexpected event network-vif-plugged-01a7a900-b5c9-46c8-b5b6-1aed4bef301e for instance with vm_state deleted and task_state None.
Aug 17 11:45:48 user nova-compute[73449]: DEBUG nova.compute.manager [req-a3349ad7-88eb-4138-887c-e13a8f4f8bd1 req-a91a326b-849e-42cf-9995-fba146278e8d service nova] [instance: 5e5229d5-65a2-4d60-8e50-c30357372a80] Received event network-vif-deleted-01a7a900-b5c9-46c8-b5b6-1aed4bef301e {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:45:48 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-7c67c828-7964-47aa-a8f0-fa0ad4cf6f52 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 11:45:48 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-7c67c828-7964-47aa-a8f0-fa0ad4cf6f52 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 11:45:48 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-7c67c828-7964-47aa-a8f0-fa0ad4cf6f52 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.347s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:45:48 user nova-compute[73449]: INFO nova.scheduler.client.report [None req-7c67c828-7964-47aa-a8f0-fa0ad4cf6f52 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Deleted allocations for instance 5e5229d5-65a2-4d60-8e50-c30357372a80
Aug 17 11:45:48 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-7c67c828-7964-47aa-a8f0-fa0ad4cf6f52 tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Lock "5e5229d5-65a2-4d60-8e50-c30357372a80" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.739s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:45:48 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:45:48 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:45:48 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73449) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 17 11:45:48 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:45:48 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:45:49 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:45:49 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:45:49 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73449) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 11:45:50 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-48f8ed28-9e9a-4bac-979b-3f9d701567c9 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Acquiring lock "3d74c8f6-fb4e-4460-b722-674a8a1e2d25" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:45:50 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-48f8ed28-9e9a-4bac-979b-3f9d701567c9 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Lock "3d74c8f6-fb4e-4460-b722-674a8a1e2d25" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:45:50 user nova-compute[73449]: DEBUG nova.compute.manager [None req-48f8ed28-9e9a-4bac-979b-3f9d701567c9 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] Starting instance... {{(pid=73449) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 11:45:51 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-48f8ed28-9e9a-4bac-979b-3f9d701567c9 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:45:51 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-48f8ed28-9e9a-4bac-979b-3f9d701567c9 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:45:51 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-48f8ed28-9e9a-4bac-979b-3f9d701567c9 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73449) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 11:45:51 user nova-compute[73449]: INFO nova.compute.claims [None req-48f8ed28-9e9a-4bac-979b-3f9d701567c9 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] Claim successful on node user
Aug 17 11:45:51 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:45:51 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-48f8ed28-9e9a-4bac-979b-3f9d701567c9 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 11:45:51 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-48f8ed28-9e9a-4bac-979b-3f9d701567c9 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 11:45:51 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-48f8ed28-9e9a-4bac-979b-3f9d701567c9 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.777s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:45:51 user nova-compute[73449]: DEBUG nova.compute.manager [None req-48f8ed28-9e9a-4bac-979b-3f9d701567c9 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] Start building networks asynchronously for instance. {{(pid=73449) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 11:45:51 user nova-compute[73449]: DEBUG nova.compute.manager [None req-48f8ed28-9e9a-4bac-979b-3f9d701567c9 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] Allocating IP information in the background. {{(pid=73449) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 11:45:51 user nova-compute[73449]: DEBUG nova.network.neutron [None req-48f8ed28-9e9a-4bac-979b-3f9d701567c9 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] allocate_for_instance() {{(pid=73449) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 11:45:51 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-48f8ed28-9e9a-4bac-979b-3f9d701567c9 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 11:45:51 user nova-compute[73449]: DEBUG nova.compute.manager [None req-48f8ed28-9e9a-4bac-979b-3f9d701567c9 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] Start building block device mappings for instance. {{(pid=73449) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 11:45:51 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:45:51 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Starting heal instance info cache {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 11:45:51 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Rebuilding the list of instances to heal {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 11:45:52 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] Skipping network cache update for instance because it is Building. {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 17 11:45:52 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] Skipping network cache update for instance because it is Building. {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 17 11:45:52 user nova-compute[73449]: DEBUG nova.compute.manager [None req-48f8ed28-9e9a-4bac-979b-3f9d701567c9 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] Start spawning the instance on the hypervisor. {{(pid=73449) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 11:45:52 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-48f8ed28-9e9a-4bac-979b-3f9d701567c9 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] Creating instance directory {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 11:45:52 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-48f8ed28-9e9a-4bac-979b-3f9d701567c9 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] Creating image(s)
Aug 17 11:45:52 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-48f8ed28-9e9a-4bac-979b-3f9d701567c9 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Acquiring lock "/opt/stack/data/nova/instances/3d74c8f6-fb4e-4460-b722-674a8a1e2d25/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:45:52 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-48f8ed28-9e9a-4bac-979b-3f9d701567c9 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Lock "/opt/stack/data/nova/instances/3d74c8f6-fb4e-4460-b722-674a8a1e2d25/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.003s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:45:52 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-48f8ed28-9e9a-4bac-979b-3f9d701567c9 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Lock "/opt/stack/data/nova/instances/3d74c8f6-fb4e-4460-b722-674a8a1e2d25/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:45:52 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "refresh_cache-4a9e8ad2-19db-4975-87e4-2efce603a7d7" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:45:52 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquired lock "refresh_cache-4a9e8ad2-19db-4975-87e4-2efce603a7d7" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:45:52 user nova-compute[73449]: DEBUG nova.network.neutron [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: 4a9e8ad2-19db-4975-87e4-2efce603a7d7] Forcefully refreshing network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 11:45:52 user nova-compute[73449]: DEBUG nova.objects.instance [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lazy-loading 'info_cache' on Instance uuid 4a9e8ad2-19db-4975-87e4-2efce603a7d7 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:45:52 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-48f8ed28-9e9a-4bac-979b-3f9d701567c9 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:45:52 user nova-compute[73449]: DEBUG nova.policy [None req-48f8ed28-9e9a-4bac-979b-3f9d701567c9 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7ccb76bc93f84e0897da59b8d5928238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722edee53ed4a9188366c38f3b8b52f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73449) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 11:45:52 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-986f4884-4f55-4831-be2d-487c851fe939 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Acquiring lock "ae75d334-431a-4008-8b3d-f2a727d92417" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:45:52 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-986f4884-4f55-4831-be2d-487c851fe939 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Lock "ae75d334-431a-4008-8b3d-f2a727d92417" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:45:52 user nova-compute[73449]: DEBUG nova.compute.manager [None req-986f4884-4f55-4831-be2d-487c851fe939 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: ae75d334-431a-4008-8b3d-f2a727d92417] Starting instance... {{(pid=73449) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 11:45:52 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-48f8ed28-9e9a-4bac-979b-3f9d701567c9 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json" returned: 0 in 0.189s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:45:52 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-48f8ed28-9e9a-4bac-979b-3f9d701567c9 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Acquiring lock "7e267a577c062ee862e95ede6b48cfd5632f3ea3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:45:52 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-48f8ed28-9e9a-4bac-979b-3f9d701567c9 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Lock "7e267a577c062ee862e95ede6b48cfd5632f3ea3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:45:52 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-48f8ed28-9e9a-4bac-979b-3f9d701567c9 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:45:52 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-986f4884-4f55-4831-be2d-487c851fe939 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:45:52 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-986f4884-4f55-4831-be2d-487c851fe939 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:45:52 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-986f4884-4f55-4831-be2d-487c851fe939 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73449) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 11:45:52 user nova-compute[73449]: INFO nova.compute.claims [None req-986f4884-4f55-4831-be2d-487c851fe939 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: ae75d334-431a-4008-8b3d-f2a727d92417] Claim successful on node user
Aug 17 11:45:52 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-48f8ed28-9e9a-4bac-979b-3f9d701567c9 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json" returned: 0 in 0.218s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:45:52 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-48f8ed28-9e9a-4bac-979b-3f9d701567c9 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3,backing_fmt=raw /opt/stack/data/nova/instances/3d74c8f6-fb4e-4460-b722-674a8a1e2d25/disk 1073741824 {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:45:52 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-48f8ed28-9e9a-4bac-979b-3f9d701567c9 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3,backing_fmt=raw /opt/stack/data/nova/instances/3d74c8f6-fb4e-4460-b722-674a8a1e2d25/disk 1073741824" returned: 0 in 0.080s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:45:52 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-48f8ed28-9e9a-4bac-979b-3f9d701567c9 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Lock "7e267a577c062ee862e95ede6b48cfd5632f3ea3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.303s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:45:52 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-48f8ed28-9e9a-4bac-979b-3f9d701567c9 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:45:52 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-48f8ed28-9e9a-4bac-979b-3f9d701567c9 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json" returned: 0 in 0.222s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:45:52 user nova-compute[73449]: DEBUG nova.virt.disk.api [None req-48f8ed28-9e9a-4bac-979b-3f9d701567c9 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3d74c8f6-fb4e-4460-b722-674a8a1e2d25/disk. size=1073741824 {{(pid=73449) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 11:45:52 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-48f8ed28-9e9a-4bac-979b-3f9d701567c9 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d74c8f6-fb4e-4460-b722-674a8a1e2d25/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:45:52 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:45:53 user nova-compute[73449]: DEBUG nova.network.neutron [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: 4a9e8ad2-19db-4975-87e4-2efce603a7d7] Updating instance_info_cache with network_info: [{"id": "3c5f8e97-0654-42f0-9575-eab6d833283a", "address": "fa:16:3e:c8:b7:51", "network": {"id": "72c50a42-688f-4868-8e19-c40b103a49cd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1792423641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "068c5270255744a18208a0ad9b35f168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c5f8e97-06", "ovs_interfaceid": "3c5f8e97-0654-42f0-9575-eab6d833283a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:45:53 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Releasing lock "refresh_cache-4a9e8ad2-19db-4975-87e4-2efce603a7d7" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:45:53 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: 4a9e8ad2-19db-4975-87e4-2efce603a7d7] Updated the network info_cache for instance {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 11:45:53 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:45:53 user nova-compute[73449]: DEBUG nova.network.neutron [None req-48f8ed28-9e9a-4bac-979b-3f9d701567c9 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] Successfully created port: a0e89b76-95af-4e50-a972-b223cc5b3cab {{(pid=73449) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 11:45:53 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:45:53 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-48f8ed28-9e9a-4bac-979b-3f9d701567c9 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d74c8f6-fb4e-4460-b722-674a8a1e2d25/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:45:53 user nova-compute[73449]: DEBUG nova.virt.disk.api [None req-48f8ed28-9e9a-4bac-979b-3f9d701567c9 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Cannot resize image /opt/stack/data/nova/instances/3d74c8f6-fb4e-4460-b722-674a8a1e2d25/disk to a smaller size. {{(pid=73449) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 11:45:53 user nova-compute[73449]: DEBUG nova.objects.instance [None req-48f8ed28-9e9a-4bac-979b-3f9d701567c9 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Lazy-loading 'migration_context' on Instance uuid 3d74c8f6-fb4e-4460-b722-674a8a1e2d25 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:45:53 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-48f8ed28-9e9a-4bac-979b-3f9d701567c9 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] Created local disks {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 11:45:53 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-48f8ed28-9e9a-4bac-979b-3f9d701567c9 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] Ensure instance console log exists: /opt/stack/data/nova/instances/3d74c8f6-fb4e-4460-b722-674a8a1e2d25/console.log {{(pid=73449) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 11:45:53 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-48f8ed28-9e9a-4bac-979b-3f9d701567c9 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:45:53 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-48f8ed28-9e9a-4bac-979b-3f9d701567c9 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:45:53 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-48f8ed28-9e9a-4bac-979b-3f9d701567c9 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:45:53 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-986f4884-4f55-4831-be2d-487c851fe939 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 11:45:53 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-986f4884-4f55-4831-be2d-487c851fe939 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 11:45:53 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-986f4884-4f55-4831-be2d-487c851fe939 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.742s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:45:53 user nova-compute[73449]: DEBUG nova.compute.manager [None req-986f4884-4f55-4831-be2d-487c851fe939 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: ae75d334-431a-4008-8b3d-f2a727d92417] Start building networks asynchronously for instance. {{(pid=73449) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 11:45:53 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.106s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:45:53 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:45:53 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=73449) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 11:45:53 user nova-compute[73449]: DEBUG nova.compute.manager [None req-986f4884-4f55-4831-be2d-487c851fe939 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: ae75d334-431a-4008-8b3d-f2a727d92417] Allocating IP information in the background. {{(pid=73449) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 11:45:53 user nova-compute[73449]: DEBUG nova.network.neutron [None req-986f4884-4f55-4831-be2d-487c851fe939 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: ae75d334-431a-4008-8b3d-f2a727d92417] allocate_for_instance() {{(pid=73449) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 11:45:53 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-986f4884-4f55-4831-be2d-487c851fe939 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: ae75d334-431a-4008-8b3d-f2a727d92417] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 11:45:53 user nova-compute[73449]: DEBUG nova.compute.manager [None req-986f4884-4f55-4831-be2d-487c851fe939 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: ae75d334-431a-4008-8b3d-f2a727d92417] Start building block device mappings for instance. {{(pid=73449) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 11:45:53 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c69e7643-8c60-4982-986b-484e8cfc3fa9/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:45:53 user nova-compute[73449]: DEBUG nova.policy [None req-986f4884-4f55-4831-be2d-487c851fe939 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7ccb76bc93f84e0897da59b8d5928238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722edee53ed4a9188366c38f3b8b52f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73449) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 11:45:53 user nova-compute[73449]: DEBUG nova.compute.manager [None req-986f4884-4f55-4831-be2d-487c851fe939 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: ae75d334-431a-4008-8b3d-f2a727d92417] Start spawning the instance on the hypervisor. {{(pid=73449) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 11:45:53 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-986f4884-4f55-4831-be2d-487c851fe939 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: ae75d334-431a-4008-8b3d-f2a727d92417] Creating instance directory {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 11:45:53 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-986f4884-4f55-4831-be2d-487c851fe939 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: ae75d334-431a-4008-8b3d-f2a727d92417] Creating image(s)
Aug 17 11:45:53 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-986f4884-4f55-4831-be2d-487c851fe939 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Acquiring lock "/opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:45:53 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-986f4884-4f55-4831-be2d-487c851fe939 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Lock "/opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:45:53 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-986f4884-4f55-4831-be2d-487c851fe939 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Lock "/opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:45:53 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-986f4884-4f55-4831-be2d-487c851fe939 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:45:53 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c69e7643-8c60-4982-986b-484e8cfc3fa9/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:45:53 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c69e7643-8c60-4982-986b-484e8cfc3fa9/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:45:53 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-986f4884-4f55-4831-be2d-487c851fe939 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json" returned: 0 in 0.201s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:45:53 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-986f4884-4f55-4831-be2d-487c851fe939 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Acquiring lock "7e267a577c062ee862e95ede6b48cfd5632f3ea3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:45:53 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-986f4884-4f55-4831-be2d-487c851fe939 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Lock "7e267a577c062ee862e95ede6b48cfd5632f3ea3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:45:53 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-986f4884-4f55-4831-be2d-487c851fe939 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:45:53 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:45:53 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c69e7643-8c60-4982-986b-484e8cfc3fa9/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:45:53 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a9e8ad2-19db-4975-87e4-2efce603a7d7/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:45:53 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-986f4884-4f55-4831-be2d-487c851fe939 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json" returned: 0 in 0.222s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:45:53 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-986f4884-4f55-4831-be2d-487c851fe939 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3,backing_fmt=raw /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk 1073741824 {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:45:53 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-986f4884-4f55-4831-be2d-487c851fe939 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3,backing_fmt=raw /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk 1073741824" returned: 0 in 0.054s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:45:53 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-986f4884-4f55-4831-be2d-487c851fe939 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Lock "7e267a577c062ee862e95ede6b48cfd5632f3ea3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.284s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:45:53 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-986f4884-4f55-4831-be2d-487c851fe939 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:45:53 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a9e8ad2-19db-4975-87e4-2efce603a7d7/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:45:53 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a9e8ad2-19db-4975-87e4-2efce603a7d7/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:45:54 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-986f4884-4f55-4831-be2d-487c851fe939 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json" returned: 0 in 0.192s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:45:54 user nova-compute[73449]: DEBUG nova.virt.disk.api [None req-986f4884-4f55-4831-be2d-487c851fe939 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk. size=1073741824 {{(pid=73449) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 11:45:54 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-986f4884-4f55-4831-be2d-487c851fe939 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:45:54 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a9e8ad2-19db-4975-87e4-2efce603a7d7/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:45:54 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de5084e1-5a5e-48d2-a3ef-7f29898d1d2d/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:45:54 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-986f4884-4f55-4831-be2d-487c851fe939 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:45:54 user nova-compute[73449]: DEBUG nova.virt.disk.api [None req-986f4884-4f55-4831-be2d-487c851fe939 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Cannot resize image /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk to a smaller size. {{(pid=73449) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 11:45:54 user nova-compute[73449]: DEBUG nova.objects.instance [None req-986f4884-4f55-4831-be2d-487c851fe939 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Lazy-loading 'migration_context' on Instance uuid ae75d334-431a-4008-8b3d-f2a727d92417 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:45:54 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-986f4884-4f55-4831-be2d-487c851fe939 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: ae75d334-431a-4008-8b3d-f2a727d92417] Created local disks {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 11:45:54 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-986f4884-4f55-4831-be2d-487c851fe939 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: ae75d334-431a-4008-8b3d-f2a727d92417] Ensure instance console log exists: /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/console.log {{(pid=73449) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 11:45:54 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-986f4884-4f55-4831-be2d-487c851fe939 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:45:54 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-986f4884-4f55-4831-be2d-487c851fe939 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:45:54 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-986f4884-4f55-4831-be2d-487c851fe939 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:45:54 user nova-compute[73449]: DEBUG nova.network.neutron [None req-986f4884-4f55-4831-be2d-487c851fe939 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: ae75d334-431a-4008-8b3d-f2a727d92417] Successfully created port: 0cd51063-e3d9-44a8-a1cd-b89bb41a4438 {{(pid=73449) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 11:45:54 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de5084e1-5a5e-48d2-a3ef-7f29898d1d2d/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:45:54 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de5084e1-5a5e-48d2-a3ef-7f29898d1d2d/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:45:54 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de5084e1-5a5e-48d2-a3ef-7f29898d1d2d/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:45:54 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73449) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 11:45:54 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3523d22-7165-46ad-be10-5e6ae374f91d/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:45:54 user nova-compute[73449]: DEBUG nova.network.neutron [None req-48f8ed28-9e9a-4bac-979b-3f9d701567c9 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] Successfully updated port: a0e89b76-95af-4e50-a972-b223cc5b3cab {{(pid=73449) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 11:45:54 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-48f8ed28-9e9a-4bac-979b-3f9d701567c9 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Acquiring lock "refresh_cache-3d74c8f6-fb4e-4460-b722-674a8a1e2d25" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:45:54 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-48f8ed28-9e9a-4bac-979b-3f9d701567c9 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Acquired lock "refresh_cache-3d74c8f6-fb4e-4460-b722-674a8a1e2d25" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:45:54 user nova-compute[73449]: DEBUG nova.network.neutron [None req-48f8ed28-9e9a-4bac-979b-3f9d701567c9 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] Building network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 11:45:54 user nova-compute[73449]: DEBUG nova.compute.manager [req-eeb0f69d-71c9-4334-b3a2-cd2fca31b5c3 req-f83b72be-7a97-4f0a-8b62-f55f8d9cb77d service nova] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] Received event network-changed-a0e89b76-95af-4e50-a972-b223cc5b3cab {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:45:54 user nova-compute[73449]: DEBUG nova.compute.manager [req-eeb0f69d-71c9-4334-b3a2-cd2fca31b5c3 req-f83b72be-7a97-4f0a-8b62-f55f8d9cb77d service nova] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] Refreshing instance network info cache due to event network-changed-a0e89b76-95af-4e50-a972-b223cc5b3cab. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 11:45:54 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-eeb0f69d-71c9-4334-b3a2-cd2fca31b5c3 req-f83b72be-7a97-4f0a-8b62-f55f8d9cb77d service nova] Acquiring lock "refresh_cache-3d74c8f6-fb4e-4460-b722-674a8a1e2d25" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:45:54 user nova-compute[73449]: DEBUG nova.network.neutron [None req-48f8ed28-9e9a-4bac-979b-3f9d701567c9 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] Instance cache missing network info. {{(pid=73449) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 11:45:54 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3523d22-7165-46ad-be10-5e6ae374f91d/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:45:54 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3523d22-7165-46ad-be10-5e6ae374f91d/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:45:55 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3523d22-7165-46ad-be10-5e6ae374f91d/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:45:55 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=73449) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 11:45:55 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3523d22-7165-46ad-be10-5e6ae374f91d/disk.rescue --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:45:55 user nova-compute[73449]: DEBUG nova.network.neutron [None req-986f4884-4f55-4831-be2d-487c851fe939 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: ae75d334-431a-4008-8b3d-f2a727d92417] Successfully updated port: 0cd51063-e3d9-44a8-a1cd-b89bb41a4438 {{(pid=73449) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 11:45:55 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-986f4884-4f55-4831-be2d-487c851fe939 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Acquiring lock "refresh_cache-ae75d334-431a-4008-8b3d-f2a727d92417" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:45:55 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-986f4884-4f55-4831-be2d-487c851fe939 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Acquired lock "refresh_cache-ae75d334-431a-4008-8b3d-f2a727d92417" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:45:55 user nova-compute[73449]: DEBUG nova.network.neutron [None req-986f4884-4f55-4831-be2d-487c851fe939 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: ae75d334-431a-4008-8b3d-f2a727d92417] Building network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 11:45:55 user nova-compute[73449]: DEBUG nova.compute.manager [req-09f1ab17-25bd-4b6a-af05-9809c85a3256 req-13a8b651-4f65-4945-a21b-84965bbf3d99 service nova] [instance: ae75d334-431a-4008-8b3d-f2a727d92417] Received event network-changed-0cd51063-e3d9-44a8-a1cd-b89bb41a4438 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:45:55 user nova-compute[73449]: DEBUG nova.compute.manager [req-09f1ab17-25bd-4b6a-af05-9809c85a3256 req-13a8b651-4f65-4945-a21b-84965bbf3d99 service nova] [instance: ae75d334-431a-4008-8b3d-f2a727d92417] Refreshing instance network info cache due to event network-changed-0cd51063-e3d9-44a8-a1cd-b89bb41a4438. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 11:45:55 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-09f1ab17-25bd-4b6a-af05-9809c85a3256 req-13a8b651-4f65-4945-a21b-84965bbf3d99 service nova] Acquiring lock "refresh_cache-ae75d334-431a-4008-8b3d-f2a727d92417" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:45:55 user nova-compute[73449]: DEBUG nova.network.neutron [None req-48f8ed28-9e9a-4bac-979b-3f9d701567c9 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] Updating instance_info_cache with network_info: [{"id": "a0e89b76-95af-4e50-a972-b223cc5b3cab", "address": "fa:16:3e:5c:ab:e7", "network": {"id": "f7298070-baaa-4842-b3b2-d9fe1058d3b6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1715911399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8722edee53ed4a9188366c38f3b8b52f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0e89b76-95", "ovs_interfaceid": "a0e89b76-95af-4e50-a972-b223cc5b3cab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:45:55 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-48f8ed28-9e9a-4bac-979b-3f9d701567c9 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Releasing lock "refresh_cache-3d74c8f6-fb4e-4460-b722-674a8a1e2d25" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:45:55 user nova-compute[73449]: DEBUG nova.compute.manager [None req-48f8ed28-9e9a-4bac-979b-3f9d701567c9 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] Instance network_info: |[{"id": "a0e89b76-95af-4e50-a972-b223cc5b3cab", "address": "fa:16:3e:5c:ab:e7", "network": {"id": "f7298070-baaa-4842-b3b2-d9fe1058d3b6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1715911399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8722edee53ed4a9188366c38f3b8b52f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0e89b76-95", "ovs_interfaceid": "a0e89b76-95af-4e50-a972-b223cc5b3cab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73449) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 11:45:55 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-eeb0f69d-71c9-4334-b3a2-cd2fca31b5c3 req-f83b72be-7a97-4f0a-8b62-f55f8d9cb77d service nova] Acquired lock "refresh_cache-3d74c8f6-fb4e-4460-b722-674a8a1e2d25" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:45:55 user nova-compute[73449]: DEBUG nova.network.neutron [req-eeb0f69d-71c9-4334-b3a2-cd2fca31b5c3 req-f83b72be-7a97-4f0a-8b62-f55f8d9cb77d service nova] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] Refreshing network info cache for port a0e89b76-95af-4e50-a972-b223cc5b3cab {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 11:45:55 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-48f8ed28-9e9a-4bac-979b-3f9d701567c9 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] Start _get_guest_xml network_info=[{"id": "a0e89b76-95af-4e50-a972-b223cc5b3cab", "address": "fa:16:3e:5c:ab:e7", "network": {"id": "f7298070-baaa-4842-b3b2-d9fe1058d3b6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1715911399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8722edee53ed4a9188366c38f3b8b52f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0e89b76-95", "ovs_interfaceid": "a0e89b76-95af-4e50-a972-b223cc5b3cab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T11:36:11Z,direct_url=<?>,disk_format='qcow2',id=0a2904ae-083d-41c8-83db-343132b36148,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7a77880136a54ef195c82e018e1939db',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T11:36:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': '0a2904ae-083d-41c8-83db-343132b36148'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 11:45:55 user nova-compute[73449]: DEBUG nova.network.neutron [None req-986f4884-4f55-4831-be2d-487c851fe939 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: ae75d334-431a-4008-8b3d-f2a727d92417] Instance cache missing network info. {{(pid=73449) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 11:45:55 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-48f8ed28-9e9a-4bac-979b-3f9d701567c9 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:45:55 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-48f8ed28-9e9a-4bac-979b-3f9d701567c9 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:45:55 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-48f8ed28-9e9a-4bac-979b-3f9d701567c9 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 11:45:55 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-48f8ed28-9e9a-4bac-979b-3f9d701567c9 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] CPU controller missing on host. {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 11:45:55 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-48f8ed28-9e9a-4bac-979b-3f9d701567c9 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 11:45:55 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-48f8ed28-9e9a-4bac-979b-3f9d701567c9 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] CPU controller found on host. {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 11:45:55 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-48f8ed28-9e9a-4bac-979b-3f9d701567c9 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73449) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 11:45:55 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-48f8ed28-9e9a-4bac-979b-3f9d701567c9 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T11:35:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T11:36:11Z,direct_url=<?>,disk_format='qcow2',id=0a2904ae-083d-41c8-83db-343132b36148,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7a77880136a54ef195c82e018e1939db',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T11:36:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 11:45:55 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-48f8ed28-9e9a-4bac-979b-3f9d701567c9 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Flavor limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 11:45:55 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-48f8ed28-9e9a-4bac-979b-3f9d701567c9 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Image limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 11:45:55 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-48f8ed28-9e9a-4bac-979b-3f9d701567c9 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Flavor pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 11:45:55 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-48f8ed28-9e9a-4bac-979b-3f9d701567c9 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Image pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 11:45:55 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-48f8ed28-9e9a-4bac-979b-3f9d701567c9 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 11:45:55 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-48f8ed28-9e9a-4bac-979b-3f9d701567c9 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 11:45:55 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-48f8ed28-9e9a-4bac-979b-3f9d701567c9 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 11:45:55 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-48f8ed28-9e9a-4bac-979b-3f9d701567c9 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Got 1 possible topologies {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 11:45:55 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-48f8ed28-9e9a-4bac-979b-3f9d701567c9 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 11:45:55 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-48f8ed28-9e9a-4bac-979b-3f9d701567c9 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 11:45:55 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-48f8ed28-9e9a-4bac-979b-3f9d701567c9 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:45:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-232739498',display_name='tempest-ServerRescueNegativeTestJSON-server-232739498',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-232739498',id=18,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8722edee53ed4a9188366c38f3b8b52f',ramdisk_id='',reservation_id='r-yxd32tyb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1458167730',owner_user_name='tempest-ServerRescueNegativeTestJSON-1458167730-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T11:45:52Z,user_data=None,user_id='7ccb76bc93f84e0897da59b8d5928238',uuid=3d74c8f6-fb4e-4460-b722-674a8a1e2d25,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a0e89b76-95af-4e50-a972-b223cc5b3cab", "address": "fa:16:3e:5c:ab:e7", "network": {"id": "f7298070-baaa-4842-b3b2-d9fe1058d3b6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1715911399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8722edee53ed4a9188366c38f3b8b52f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0e89b76-95", "ovs_interfaceid": "a0e89b76-95af-4e50-a972-b223cc5b3cab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73449) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 11:45:55 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-48f8ed28-9e9a-4bac-979b-3f9d701567c9 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Converting VIF {"id": "a0e89b76-95af-4e50-a972-b223cc5b3cab", "address": "fa:16:3e:5c:ab:e7", "network": {"id": "f7298070-baaa-4842-b3b2-d9fe1058d3b6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1715911399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8722edee53ed4a9188366c38f3b8b52f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0e89b76-95", "ovs_interfaceid": "a0e89b76-95af-4e50-a972-b223cc5b3cab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:45:55 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-48f8ed28-9e9a-4bac-979b-3f9d701567c9 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:ab:e7,bridge_name='br-int',has_traffic_filtering=True,id=a0e89b76-95af-4e50-a972-b223cc5b3cab,network=Network(f7298070-baaa-4842-b3b2-d9fe1058d3b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0e89b76-95') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:45:55 user nova-compute[73449]: DEBUG nova.objects.instance [None req-48f8ed28-9e9a-4bac-979b-3f9d701567c9 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Lazy-loading 'pci_devices' on Instance uuid 3d74c8f6-fb4e-4460-b722-674a8a1e2d25 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:45:55 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3523d22-7165-46ad-be10-5e6ae374f91d/disk.rescue --force-share --output=json" returned: 0 in 0.322s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:45:55 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3523d22-7165-46ad-be10-5e6ae374f91d/disk.rescue --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:45:55 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-48f8ed28-9e9a-4bac-979b-3f9d701567c9 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] End _get_guest_xml xml=<domain type="kvm">
Aug 17 11:45:55 user nova-compute[73449]:   <uuid>3d74c8f6-fb4e-4460-b722-674a8a1e2d25</uuid>
Aug 17 11:45:55 user nova-compute[73449]:   <name>instance-00000012</name>
Aug 17 11:45:55 user nova-compute[73449]:   <memory>524288</memory>
Aug 17 11:45:55 user nova-compute[73449]:   <vcpu>1</vcpu>
Aug 17 11:45:55 user nova-compute[73449]:   <metadata>
Aug 17 11:45:55 user nova-compute[73449]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 11:45:55 user nova-compute[73449]:       <nova:package version="0.0.0"/>
Aug 17 11:45:55 user nova-compute[73449]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-232739498</nova:name>
Aug 17 11:45:55 user nova-compute[73449]:       <nova:creationTime>2023-08-17 11:45:55</nova:creationTime>
Aug 17 11:45:55 user nova-compute[73449]:       <nova:flavor name="m1.tiny">
Aug 17 11:45:55 user nova-compute[73449]:         <nova:memory>512</nova:memory>
Aug 17 11:45:55 user nova-compute[73449]:         <nova:disk>1</nova:disk>
Aug 17 11:45:55 user nova-compute[73449]:         <nova:swap>0</nova:swap>
Aug 17 11:45:55 user nova-compute[73449]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 11:45:55 user nova-compute[73449]:         <nova:vcpus>1</nova:vcpus>
Aug 17 11:45:55 user nova-compute[73449]:       </nova:flavor>
Aug 17 11:45:55 user nova-compute[73449]:       <nova:owner>
Aug 17 11:45:55 user nova-compute[73449]:         <nova:user uuid="7ccb76bc93f84e0897da59b8d5928238">tempest-ServerRescueNegativeTestJSON-1458167730-project-member</nova:user>
Aug 17 11:45:55 user nova-compute[73449]:         <nova:project uuid="8722edee53ed4a9188366c38f3b8b52f">tempest-ServerRescueNegativeTestJSON-1458167730</nova:project>
Aug 17 11:45:55 user nova-compute[73449]:       </nova:owner>
Aug 17 11:45:55 user nova-compute[73449]:       <nova:root type="image" uuid="0a2904ae-083d-41c8-83db-343132b36148"/>
Aug 17 11:45:55 user nova-compute[73449]:       <nova:ports>
Aug 17 11:45:55 user nova-compute[73449]:         <nova:port uuid="a0e89b76-95af-4e50-a972-b223cc5b3cab">
Aug 17 11:45:55 user nova-compute[73449]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 17 11:45:55 user nova-compute[73449]:         </nova:port>
Aug 17 11:45:55 user nova-compute[73449]:       </nova:ports>
Aug 17 11:45:55 user nova-compute[73449]:     </nova:instance>
Aug 17 11:45:55 user nova-compute[73449]:   </metadata>
Aug 17 11:45:55 user nova-compute[73449]:   <sysinfo type="smbios">
Aug 17 11:45:55 user nova-compute[73449]:     <system>
Aug 17 11:45:55 user nova-compute[73449]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 11:45:55 user nova-compute[73449]:       <entry name="product">OpenStack Nova</entry>
Aug 17 11:45:55 user nova-compute[73449]:       <entry name="version">0.0.0</entry>
Aug 17 11:45:55 user nova-compute[73449]:       <entry name="serial">3d74c8f6-fb4e-4460-b722-674a8a1e2d25</entry>
Aug 17 11:45:55 user nova-compute[73449]:       <entry name="uuid">3d74c8f6-fb4e-4460-b722-674a8a1e2d25</entry>
Aug 17 11:45:55 user nova-compute[73449]:       <entry name="family">Virtual Machine</entry>
Aug 17 11:45:55 user nova-compute[73449]:     </system>
Aug 17 11:45:55 user nova-compute[73449]:   </sysinfo>
Aug 17 11:45:55 user nova-compute[73449]:   <os>
Aug 17 11:45:55 user nova-compute[73449]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 11:45:55 user nova-compute[73449]:     <boot dev="hd"/>
Aug 17 11:45:55 user nova-compute[73449]:     <smbios mode="sysinfo"/>
Aug 17 11:45:55 user nova-compute[73449]:   </os>
Aug 17 11:45:55 user nova-compute[73449]:   <features>
Aug 17 11:45:55 user nova-compute[73449]:     <acpi/>
Aug 17 11:45:55 user nova-compute[73449]:     <apic/>
Aug 17 11:45:55 user nova-compute[73449]:     <vmcoreinfo/>
Aug 17 11:45:55 user nova-compute[73449]:   </features>
Aug 17 11:45:55 user nova-compute[73449]:   <clock offset="utc">
Aug 17 11:45:55 user nova-compute[73449]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 11:45:55 user nova-compute[73449]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 11:45:55 user nova-compute[73449]:     <timer name="hpet" present="no"/>
Aug 17 11:45:55 user nova-compute[73449]:   </clock>
Aug 17 11:45:55 user nova-compute[73449]:   <cpu mode="custom" match="exact">
Aug 17 11:45:55 user nova-compute[73449]:     <model>Nehalem</model>
Aug 17 11:45:55 user nova-compute[73449]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 11:45:55 user nova-compute[73449]:   </cpu>
Aug 17 11:45:55 user nova-compute[73449]:   <devices>
Aug 17 11:45:55 user nova-compute[73449]:     <disk type="file" device="disk">
Aug 17 11:45:55 user nova-compute[73449]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 11:45:55 user nova-compute[73449]:       <source file="/opt/stack/data/nova/instances/3d74c8f6-fb4e-4460-b722-674a8a1e2d25/disk"/>
Aug 17 11:45:55 user nova-compute[73449]:       <target dev="vda" bus="virtio"/>
Aug 17 11:45:55 user nova-compute[73449]:     </disk>
Aug 17 11:45:55 user nova-compute[73449]:     <interface type="ethernet">
Aug 17 11:45:55 user nova-compute[73449]:       <mac address="fa:16:3e:5c:ab:e7"/>
Aug 17 11:45:55 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 11:45:55 user nova-compute[73449]:       <mtu size="1442"/>
Aug 17 11:45:55 user nova-compute[73449]:       <target dev="tapa0e89b76-95"/>
Aug 17 11:45:55 user nova-compute[73449]:     </interface>
Aug 17 11:45:55 user nova-compute[73449]:     <serial type="pty">
Aug 17 11:45:55 user nova-compute[73449]:       <log file="/opt/stack/data/nova/instances/3d74c8f6-fb4e-4460-b722-674a8a1e2d25/console.log" append="off"/>
Aug 17 11:45:55 user nova-compute[73449]:     </serial>
Aug 17 11:45:55 user nova-compute[73449]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 11:45:55 user nova-compute[73449]:     <video>
Aug 17 11:45:55 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 11:45:55 user nova-compute[73449]:     </video>
Aug 17 11:45:55 user nova-compute[73449]:     <rng model="virtio">
Aug 17 11:45:55 user nova-compute[73449]:       <backend model="random">/dev/urandom</backend>
Aug 17 11:45:55 user nova-compute[73449]:     </rng>
Aug 17 11:45:55 user nova-compute[73449]:     <controller type="usb" index="0" model="none"/>
Aug 17 11:45:55 user nova-compute[73449]:     <memballoon model="virtio">
Aug 17 11:45:55 user nova-compute[73449]:       <stats period="10"/>
Aug 17 11:45:55 user nova-compute[73449]:     </memballoon>
Aug 17 11:45:55 user nova-compute[73449]:   </devices>
Aug 17 11:45:55 user nova-compute[73449]: </domain>
Aug 17 11:45:55 user nova-compute[73449]:  {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 11:45:55 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-48f8ed28-9e9a-4bac-979b-3f9d701567c9 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:45:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-232739498',display_name='tempest-ServerRescueNegativeTestJSON-server-232739498',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-232739498',id=18,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8722edee53ed4a9188366c38f3b8b52f',ramdisk_id='',reservation_id='r-yxd32tyb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1458167730',owner_user_name='tempest-ServerRescueNegativeTestJSON-1458167730-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T11:45:52Z,user_data=None,user_id='7ccb76bc93f84e0897da59b8d5928238',uuid=3d74c8f6-fb4e-4460-b722-674a8a1e2d25,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a0e89b76-95af-4e50-a972-b223cc5b3cab", "address": "fa:16:3e:5c:ab:e7", "network": {"id": "f7298070-baaa-4842-b3b2-d9fe1058d3b6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1715911399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8722edee53ed4a9188366c38f3b8b52f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0e89b76-95", "ovs_interfaceid": "a0e89b76-95af-4e50-a972-b223cc5b3cab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 11:45:55 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-48f8ed28-9e9a-4bac-979b-3f9d701567c9 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Converting VIF {"id": "a0e89b76-95af-4e50-a972-b223cc5b3cab", "address": "fa:16:3e:5c:ab:e7", "network": {"id": "f7298070-baaa-4842-b3b2-d9fe1058d3b6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1715911399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8722edee53ed4a9188366c38f3b8b52f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0e89b76-95", "ovs_interfaceid": "a0e89b76-95af-4e50-a972-b223cc5b3cab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:45:55 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-48f8ed28-9e9a-4bac-979b-3f9d701567c9 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:ab:e7,bridge_name='br-int',has_traffic_filtering=True,id=a0e89b76-95af-4e50-a972-b223cc5b3cab,network=Network(f7298070-baaa-4842-b3b2-d9fe1058d3b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0e89b76-95') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:45:55 user nova-compute[73449]: DEBUG os_vif [None req-48f8ed28-9e9a-4bac-979b-3f9d701567c9 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:ab:e7,bridge_name='br-int',has_traffic_filtering=True,id=a0e89b76-95af-4e50-a972-b223cc5b3cab,network=Network(f7298070-baaa-4842-b3b2-d9fe1058d3b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0e89b76-95') {{(pid=73449) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 11:45:55 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:45:55 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:45:55 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 11:45:55 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:45:55 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa0e89b76-95, may_exist=True, interface_attrs={}) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:45:55 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa0e89b76-95, col_values=(('external_ids', {'iface-id': 'a0e89b76-95af-4e50-a972-b223cc5b3cab', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5c:ab:e7', 'vm-uuid': '3d74c8f6-fb4e-4460-b722-674a8a1e2d25'}),), if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:45:55 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:45:55 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:45:55 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:45:55 user nova-compute[73449]: INFO os_vif [None req-48f8ed28-9e9a-4bac-979b-3f9d701567c9 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:ab:e7,bridge_name='br-int',has_traffic_filtering=True,id=a0e89b76-95af-4e50-a972-b223cc5b3cab,network=Network(f7298070-baaa-4842-b3b2-d9fe1058d3b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0e89b76-95')
Aug 17 11:45:55 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-48f8ed28-9e9a-4bac-979b-3f9d701567c9 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] No BDM found with device name vda, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 11:45:55 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-48f8ed28-9e9a-4bac-979b-3f9d701567c9 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] No VIF found with MAC fa:16:3e:5c:ab:e7, not building metadata {{(pid=73449) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 11:45:55 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3523d22-7165-46ad-be10-5e6ae374f91d/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:45:55 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:45:55 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71fcf266-9928-4a10-b971-f13d1bc8ac03 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] Calling os-brick to attach iSCSI Volume {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 11:45:55 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-71fcf266-9928-4a10-b971-f13d1bc8ac03 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sIVNXdDt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 11:45:55 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-71fcf266-9928-4a10-b971-f13d1bc8ac03 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 11:45:55 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-71fcf266-9928-4a10-b971-f13d1bc8ac03 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:45:55 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-71fcf266-9928-4a10-b971-f13d1bc8ac03 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:45:55 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-71fcf266-9928-4a10-b971-f13d1bc8ac03 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 11:45:55 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-71fcf266-9928-4a10-b971-f13d1bc8ac03 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:45:55 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-71fcf266-9928-4a10-b971-f13d1bc8ac03 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:45:55 user nova-compute[73449]: INFO os_brick.initiator.connectors.iscsi [None req-71fcf266-9928-4a10-b971-f13d1bc8ac03 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 11:45:55 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466 -p 172.16.0.220:3260 {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:45:55 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:45:55 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[4af6b894-4cbe-4e5b-ab16-6656e19e6813]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:45:55 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-71fcf266-9928-4a10-b971-f13d1bc8ac03 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 11:45:55 user nova-compute[73449]:  {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:45:55 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466 -p 172.16.0.220:3260 --interface default --op new {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:45:55 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:45:55 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3d050d0-4074-489c-8481-168a811268d3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466] added\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:45:55 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-71fcf266-9928-4a10-b971-f13d1bc8ac03 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466] added
Aug 17 11:45:55 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:45:55 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:45:55 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:45:55 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[587de400-ed6f-4bd8-a8aa-2c09e4dc3189]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:45:55 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-71fcf266-9928-4a10-b971-f13d1bc8ac03 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:45:55 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:45:55 user nova-compute[73449]: DEBUG nova.network.neutron [None req-986f4884-4f55-4831-be2d-487c851fe939 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: ae75d334-431a-4008-8b3d-f2a727d92417] Updating instance_info_cache with network_info: [{"id": "0cd51063-e3d9-44a8-a1cd-b89bb41a4438", "address": "fa:16:3e:54:1f:e7", "network": {"id": "f7298070-baaa-4842-b3b2-d9fe1058d3b6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1715911399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8722edee53ed4a9188366c38f3b8b52f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cd51063-e3", "ovs_interfaceid": "0cd51063-e3d9-44a8-a1cd-b89bb41a4438", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:45:55 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:45:55 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[c87d22fe-01f1-4a19-b2a9-78a248272338]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:45:55 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-71fcf266-9928-4a10-b971-f13d1bc8ac03 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:45:55 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sIVNXdDt {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:45:55 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-986f4884-4f55-4831-be2d-487c851fe939 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Releasing lock "refresh_cache-ae75d334-431a-4008-8b3d-f2a727d92417" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:45:55 user nova-compute[73449]: DEBUG nova.compute.manager [None req-986f4884-4f55-4831-be2d-487c851fe939 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: ae75d334-431a-4008-8b3d-f2a727d92417] Instance network_info: |[{"id": "0cd51063-e3d9-44a8-a1cd-b89bb41a4438", "address": "fa:16:3e:54:1f:e7", "network": {"id": "f7298070-baaa-4842-b3b2-d9fe1058d3b6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1715911399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8722edee53ed4a9188366c38f3b8b52f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cd51063-e3", "ovs_interfaceid": "0cd51063-e3d9-44a8-a1cd-b89bb41a4438", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73449) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 11:45:55 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-09f1ab17-25bd-4b6a-af05-9809c85a3256 req-13a8b651-4f65-4945-a21b-84965bbf3d99 service nova] Acquired lock "refresh_cache-ae75d334-431a-4008-8b3d-f2a727d92417" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:45:55 user nova-compute[73449]: DEBUG nova.network.neutron [req-09f1ab17-25bd-4b6a-af05-9809c85a3256 req-13a8b651-4f65-4945-a21b-84965bbf3d99 service nova] [instance: ae75d334-431a-4008-8b3d-f2a727d92417] Refreshing network info cache for port 0cd51063-e3d9-44a8-a1cd-b89bb41a4438 {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 11:45:55 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-986f4884-4f55-4831-be2d-487c851fe939 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: ae75d334-431a-4008-8b3d-f2a727d92417] Start _get_guest_xml network_info=[{"id": "0cd51063-e3d9-44a8-a1cd-b89bb41a4438", "address": "fa:16:3e:54:1f:e7", "network": {"id": "f7298070-baaa-4842-b3b2-d9fe1058d3b6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1715911399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8722edee53ed4a9188366c38f3b8b52f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cd51063-e3", "ovs_interfaceid": "0cd51063-e3d9-44a8-a1cd-b89bb41a4438", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T11:36:11Z,direct_url=<?>,disk_format='qcow2',id=0a2904ae-083d-41c8-83db-343132b36148,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7a77880136a54ef195c82e018e1939db',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T11:36:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': '0a2904ae-083d-41c8-83db-343132b36148'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 11:45:55 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:45:55 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sIVNXdDt" returned: 0 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:45:55 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6a17c35-ae76-4d42-b2f6-79ba4b5717f8]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:45:55 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:45:56 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-71fcf266-9928-4a10-b971-f13d1bc8ac03 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sIVNXdDt'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:45:56 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:45:56 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:45:56 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[982af3e5-68bd-4a9b-8a5c-5252029d7812]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:45:56 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-71fcf266-9928-4a10-b971-f13d1bc8ac03 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:45:56 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:45:56 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-986f4884-4f55-4831-be2d-487c851fe939 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:45:56 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-986f4884-4f55-4831-be2d-487c851fe939 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:45:56 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-986f4884-4f55-4831-be2d-487c851fe939 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 11:45:56 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-986f4884-4f55-4831-be2d-487c851fe939 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] CPU controller missing on host. {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 11:45:56 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-986f4884-4f55-4831-be2d-487c851fe939 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 11:45:56 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-986f4884-4f55-4831-be2d-487c851fe939 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] CPU controller found on host. {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 11:45:56 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-986f4884-4f55-4831-be2d-487c851fe939 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73449) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 11:45:56 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-986f4884-4f55-4831-be2d-487c851fe939 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T11:35:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T11:36:11Z,direct_url=<?>,disk_format='qcow2',id=0a2904ae-083d-41c8-83db-343132b36148,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7a77880136a54ef195c82e018e1939db',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T11:36:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 11:45:56 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-986f4884-4f55-4831-be2d-487c851fe939 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Flavor limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 11:45:56 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-986f4884-4f55-4831-be2d-487c851fe939 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Image limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 11:45:56 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-986f4884-4f55-4831-be2d-487c851fe939 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Flavor pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 11:45:56 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-986f4884-4f55-4831-be2d-487c851fe939 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Image pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 11:45:56 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-986f4884-4f55-4831-be2d-487c851fe939 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 11:45:56 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-986f4884-4f55-4831-be2d-487c851fe939 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 11:45:56 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-986f4884-4f55-4831-be2d-487c851fe939 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 11:45:56 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-986f4884-4f55-4831-be2d-487c851fe939 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Got 1 possible topologies {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 11:45:56 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-986f4884-4f55-4831-be2d-487c851fe939 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 11:45:56 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-986f4884-4f55-4831-be2d-487c851fe939 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 11:45:56 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-986f4884-4f55-4831-be2d-487c851fe939 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:45:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2048350466',display_name='tempest-ServerRescueNegativeTestJSON-server-2048350466',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2048350466',id=19,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8722edee53ed4a9188366c38f3b8b52f',ramdisk_id='',reservation_id='r-9gepo79y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1458167730',owner_user_name='tempest-ServerRescueNegativeTestJSON-1458167730-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T11:45:53Z,user_data=None,user_id='7ccb76bc93f84e0897da59b8d5928238',uuid=ae75d334-431a-4008-8b3d-f2a727d92417,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0cd51063-e3d9-44a8-a1cd-b89bb41a4438", "address": "fa:16:3e:54:1f:e7", "network": {"id": "f7298070-baaa-4842-b3b2-d9fe1058d3b6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1715911399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8722edee53ed4a9188366c38f3b8b52f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cd51063-e3", "ovs_interfaceid": "0cd51063-e3d9-44a8-a1cd-b89bb41a4438", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73449) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 11:45:56 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-986f4884-4f55-4831-be2d-487c851fe939 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Converting VIF {"id": "0cd51063-e3d9-44a8-a1cd-b89bb41a4438", "address": "fa:16:3e:54:1f:e7", "network": {"id": "f7298070-baaa-4842-b3b2-d9fe1058d3b6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1715911399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8722edee53ed4a9188366c38f3b8b52f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cd51063-e3", "ovs_interfaceid": "0cd51063-e3d9-44a8-a1cd-b89bb41a4438", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:45:56 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-986f4884-4f55-4831-be2d-487c851fe939 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:1f:e7,bridge_name='br-int',has_traffic_filtering=True,id=0cd51063-e3d9-44a8-a1cd-b89bb41a4438,network=Network(f7298070-baaa-4842-b3b2-d9fe1058d3b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cd51063-e3') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:45:56 user nova-compute[73449]: DEBUG nova.objects.instance [None req-986f4884-4f55-4831-be2d-487c851fe939 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Lazy-loading 'pci_devices' on Instance uuid ae75d334-431a-4008-8b3d-f2a727d92417 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:45:56 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:45:56 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4c4dca1-791a-433e-ae3f-4a9c0da4b1e4]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d22566b5-74eb-4aeb-b14c-0bd5aa9e35ee (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:45:56 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-71fcf266-9928-4a10-b971-f13d1bc8ac03 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe (non-flash)
Aug 17 11:45:56 user nova-compute[73449]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d22566b5-74eb-4aeb-b14c-0bd5aa9e35ee (non-flash)
Aug 17 11:45:56 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:45:56 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-71fcf266-9928-4a10-b971-f13d1bc8ac03 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe (non-flash)
Aug 17 11:45:56 user nova-compute[73449]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d22566b5-74eb-4aeb-b14c-0bd5aa9e35ee (non-flash)
Aug 17 11:45:56 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:45:56 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466 -p 172.16.0.220:3260 --login {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:45:56 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-986f4884-4f55-4831-be2d-487c851fe939 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: ae75d334-431a-4008-8b3d-f2a727d92417] End _get_guest_xml xml=<domain type="kvm">
Aug 17 11:45:56 user nova-compute[73449]:   <uuid>ae75d334-431a-4008-8b3d-f2a727d92417</uuid>
Aug 17 11:45:56 user nova-compute[73449]:   <name>instance-00000013</name>
Aug 17 11:45:56 user nova-compute[73449]:   <memory>524288</memory>
Aug 17 11:45:56 user nova-compute[73449]:   <vcpu>1</vcpu>
Aug 17 11:45:56 user nova-compute[73449]:   <metadata>
Aug 17 11:45:56 user nova-compute[73449]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 11:45:56 user nova-compute[73449]:       <nova:package version="0.0.0"/>
Aug 17 11:45:56 user nova-compute[73449]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2048350466</nova:name>
Aug 17 11:45:56 user nova-compute[73449]:       <nova:creationTime>2023-08-17 11:45:56</nova:creationTime>
Aug 17 11:45:56 user nova-compute[73449]:       <nova:flavor name="m1.tiny">
Aug 17 11:45:56 user nova-compute[73449]:         <nova:memory>512</nova:memory>
Aug 17 11:45:56 user nova-compute[73449]:         <nova:disk>1</nova:disk>
Aug 17 11:45:56 user nova-compute[73449]:         <nova:swap>0</nova:swap>
Aug 17 11:45:56 user nova-compute[73449]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 11:45:56 user nova-compute[73449]:         <nova:vcpus>1</nova:vcpus>
Aug 17 11:45:56 user nova-compute[73449]:       </nova:flavor>
Aug 17 11:45:56 user nova-compute[73449]:       <nova:owner>
Aug 17 11:45:56 user nova-compute[73449]:         <nova:user uuid="7ccb76bc93f84e0897da59b8d5928238">tempest-ServerRescueNegativeTestJSON-1458167730-project-member</nova:user>
Aug 17 11:45:56 user nova-compute[73449]:         <nova:project uuid="8722edee53ed4a9188366c38f3b8b52f">tempest-ServerRescueNegativeTestJSON-1458167730</nova:project>
Aug 17 11:45:56 user nova-compute[73449]:       </nova:owner>
Aug 17 11:45:56 user nova-compute[73449]:       <nova:root type="image" uuid="0a2904ae-083d-41c8-83db-343132b36148"/>
Aug 17 11:45:56 user nova-compute[73449]:       <nova:ports>
Aug 17 11:45:56 user nova-compute[73449]:         <nova:port uuid="0cd51063-e3d9-44a8-a1cd-b89bb41a4438">
Aug 17 11:45:56 user nova-compute[73449]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 17 11:45:56 user nova-compute[73449]:         </nova:port>
Aug 17 11:45:56 user nova-compute[73449]:       </nova:ports>
Aug 17 11:45:56 user nova-compute[73449]:     </nova:instance>
Aug 17 11:45:56 user nova-compute[73449]:   </metadata>
Aug 17 11:45:56 user nova-compute[73449]:   <sysinfo type="smbios">
Aug 17 11:45:56 user nova-compute[73449]:     <system>
Aug 17 11:45:56 user nova-compute[73449]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 11:45:56 user nova-compute[73449]:       <entry name="product">OpenStack Nova</entry>
Aug 17 11:45:56 user nova-compute[73449]:       <entry name="version">0.0.0</entry>
Aug 17 11:45:56 user nova-compute[73449]:       <entry name="serial">ae75d334-431a-4008-8b3d-f2a727d92417</entry>
Aug 17 11:45:56 user nova-compute[73449]:       <entry name="uuid">ae75d334-431a-4008-8b3d-f2a727d92417</entry>
Aug 17 11:45:56 user nova-compute[73449]:       <entry name="family">Virtual Machine</entry>
Aug 17 11:45:56 user nova-compute[73449]:     </system>
Aug 17 11:45:56 user nova-compute[73449]:   </sysinfo>
Aug 17 11:45:56 user nova-compute[73449]:   <os>
Aug 17 11:45:56 user nova-compute[73449]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 11:45:56 user nova-compute[73449]:     <boot dev="hd"/>
Aug 17 11:45:56 user nova-compute[73449]:     <smbios mode="sysinfo"/>
Aug 17 11:45:56 user nova-compute[73449]:   </os>
Aug 17 11:45:56 user nova-compute[73449]:   <features>
Aug 17 11:45:56 user nova-compute[73449]:     <acpi/>
Aug 17 11:45:56 user nova-compute[73449]:     <apic/>
Aug 17 11:45:56 user nova-compute[73449]:     <vmcoreinfo/>
Aug 17 11:45:56 user nova-compute[73449]:   </features>
Aug 17 11:45:56 user nova-compute[73449]:   <clock offset="utc">
Aug 17 11:45:56 user nova-compute[73449]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 11:45:56 user nova-compute[73449]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 11:45:56 user nova-compute[73449]:     <timer name="hpet" present="no"/>
Aug 17 11:45:56 user nova-compute[73449]:   </clock>
Aug 17 11:45:56 user nova-compute[73449]:   <cpu mode="custom" match="exact">
Aug 17 11:45:56 user nova-compute[73449]:     <model>Nehalem</model>
Aug 17 11:45:56 user nova-compute[73449]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 11:45:56 user nova-compute[73449]:   </cpu>
Aug 17 11:45:56 user nova-compute[73449]:   <devices>
Aug 17 11:45:56 user nova-compute[73449]:     <disk type="file" device="disk">
Aug 17 11:45:56 user nova-compute[73449]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 11:45:56 user nova-compute[73449]:       <source file="/opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk"/>
Aug 17 11:45:56 user nova-compute[73449]:       <target dev="vda" bus="virtio"/>
Aug 17 11:45:56 user nova-compute[73449]:     </disk>
Aug 17 11:45:56 user nova-compute[73449]:     <interface type="ethernet">
Aug 17 11:45:56 user nova-compute[73449]:       <mac address="fa:16:3e:54:1f:e7"/>
Aug 17 11:45:56 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 11:45:56 user nova-compute[73449]:       <mtu size="1442"/>
Aug 17 11:45:56 user nova-compute[73449]:       <target dev="tap0cd51063-e3"/>
Aug 17 11:45:56 user nova-compute[73449]:     </interface>
Aug 17 11:45:56 user nova-compute[73449]:     <serial type="pty">
Aug 17 11:45:56 user nova-compute[73449]:       <log file="/opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/console.log" append="off"/>
Aug 17 11:45:56 user nova-compute[73449]:     </serial>
Aug 17 11:45:56 user nova-compute[73449]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 11:45:56 user nova-compute[73449]:     <video>
Aug 17 11:45:56 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 11:45:56 user nova-compute[73449]:     </video>
Aug 17 11:45:56 user nova-compute[73449]:     <rng model="virtio">
Aug 17 11:45:56 user nova-compute[73449]:       <backend model="random">/dev/urandom</backend>
Aug 17 11:45:56 user nova-compute[73449]:     </rng>
Aug 17 11:45:56 user nova-compute[73449]:     <controller type="usb" index="0" model="none"/>
Aug 17 11:45:56 user nova-compute[73449]:     <memballoon model="virtio">
Aug 17 11:45:56 user nova-compute[73449]:       <stats period="10"/>
Aug 17 11:45:56 user nova-compute[73449]:     </memballoon>
Aug 17 11:45:56 user nova-compute[73449]:   </devices>
Aug 17 11:45:56 user nova-compute[73449]: </domain>
Aug 17 11:45:56 user nova-compute[73449]:  {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 11:45:56 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-986f4884-4f55-4831-be2d-487c851fe939 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:45:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2048350466',display_name='tempest-ServerRescueNegativeTestJSON-server-2048350466',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2048350466',id=19,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8722edee53ed4a9188366c38f3b8b52f',ramdisk_id='',reservation_id='r-9gepo79y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1458167730',owner_user_name='tempest-ServerRescueNegativeTestJSON-1458167730-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T11:45:53Z,user_data=None,user_id='7ccb76bc93f84e0897da59b8d5928238',uuid=ae75d334-431a-4008-8b3d-f2a727d92417,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0cd51063-e3d9-44a8-a1cd-b89bb41a4438", "address": "fa:16:3e:54:1f:e7", "network": {"id": "f7298070-baaa-4842-b3b2-d9fe1058d3b6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1715911399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8722edee53ed4a9188366c38f3b8b52f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cd51063-e3", "ovs_interfaceid": "0cd51063-e3d9-44a8-a1cd-b89bb41a4438", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 11:45:56 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-986f4884-4f55-4831-be2d-487c851fe939 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Converting VIF {"id": "0cd51063-e3d9-44a8-a1cd-b89bb41a4438", "address": "fa:16:3e:54:1f:e7", "network": {"id": "f7298070-baaa-4842-b3b2-d9fe1058d3b6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1715911399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8722edee53ed4a9188366c38f3b8b52f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cd51063-e3", "ovs_interfaceid": "0cd51063-e3d9-44a8-a1cd-b89bb41a4438", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:45:56 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-986f4884-4f55-4831-be2d-487c851fe939 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:1f:e7,bridge_name='br-int',has_traffic_filtering=True,id=0cd51063-e3d9-44a8-a1cd-b89bb41a4438,network=Network(f7298070-baaa-4842-b3b2-d9fe1058d3b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cd51063-e3') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:45:56 user nova-compute[73449]: DEBUG os_vif [None req-986f4884-4f55-4831-be2d-487c851fe939 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:1f:e7,bridge_name='br-int',has_traffic_filtering=True,id=0cd51063-e3d9-44a8-a1cd-b89bb41a4438,network=Network(f7298070-baaa-4842-b3b2-d9fe1058d3b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cd51063-e3') {{(pid=73449) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 11:45:56 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:45:56 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:45:56 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 11:45:56 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:45:56 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0cd51063-e3, may_exist=True, interface_attrs={}) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:45:56 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0cd51063-e3, col_values=(('external_ids', {'iface-id': '0cd51063-e3d9-44a8-a1cd-b89bb41a4438', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:54:1f:e7', 'vm-uuid': 'ae75d334-431a-4008-8b3d-f2a727d92417'}),), if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:45:56 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:45:56 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:45:56 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:45:56 user nova-compute[73449]: INFO os_vif [None req-986f4884-4f55-4831-be2d-487c851fe939 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:1f:e7,bridge_name='br-int',has_traffic_filtering=True,id=0cd51063-e3d9-44a8-a1cd-b89bb41a4438,network=Network(f7298070-baaa-4842-b3b2-d9fe1058d3b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cd51063-e3')
Aug 17 11:45:56 user nova-compute[73449]: DEBUG nova.network.neutron [req-eeb0f69d-71c9-4334-b3a2-cd2fca31b5c3 req-f83b72be-7a97-4f0a-8b62-f55f8d9cb77d service nova] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] Updated VIF entry in instance network info cache for port a0e89b76-95af-4e50-a972-b223cc5b3cab. {{(pid=73449) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 11:45:56 user nova-compute[73449]: DEBUG nova.network.neutron [req-eeb0f69d-71c9-4334-b3a2-cd2fca31b5c3 req-f83b72be-7a97-4f0a-8b62-f55f8d9cb77d service nova] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] Updating instance_info_cache with network_info: [{"id": "a0e89b76-95af-4e50-a972-b223cc5b3cab", "address": "fa:16:3e:5c:ab:e7", "network": {"id": "f7298070-baaa-4842-b3b2-d9fe1058d3b6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1715911399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8722edee53ed4a9188366c38f3b8b52f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0e89b76-95", "ovs_interfaceid": "a0e89b76-95af-4e50-a972-b223cc5b3cab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:45:56 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:45:56 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2b2e0a6-3a30-4b7d-88b2-3366c5cd8d29]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:45:56 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-eeb0f69d-71c9-4334-b3a2-cd2fca31b5c3 req-f83b72be-7a97-4f0a-8b62-f55f8d9cb77d service nova] Releasing lock "refresh_cache-3d74c8f6-fb4e-4460-b722-674a8a1e2d25" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:45:56 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-71fcf266-9928-4a10-b971-f13d1bc8ac03 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466, portal: 172.16.0.220,3260]
Aug 17 11:45:56 user nova-compute[73449]: Login to [iface: default, target: iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466, portal: 172.16.0.220,3260] successful.
Aug 17 11:45:56 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:45:56 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:45:56 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:45:56 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/848599ce-8cf5-4116-b1d6-4cf9d79cfbc0/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:45:56 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:45:56 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[de24120a-153b-4878-ba74-3717cd510d61]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:45:56 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-71fcf266-9928-4a10-b971-f13d1bc8ac03 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:45:56 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:45:56 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-986f4884-4f55-4831-be2d-487c851fe939 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] No BDM found with device name vda, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 11:45:56 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-986f4884-4f55-4831-be2d-487c851fe939 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] No VIF found with MAC fa:16:3e:54:1f:e7, not building metadata {{(pid=73449) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 11:45:56 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:45:56 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[748f95cb-8658-4bba-a96d-8a2bfae40c25]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d22566b5-74eb-4aeb-b14c-0bd5aa9e35ee (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466 (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:45:56 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-71fcf266-9928-4a10-b971-f13d1bc8ac03 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe (non-flash)
Aug 17 11:45:56 user nova-compute[73449]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d22566b5-74eb-4aeb-b14c-0bd5aa9e35ee (non-flash)
Aug 17 11:45:56 user nova-compute[73449]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466 (non-flash)
Aug 17 11:45:56 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:45:56 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-71fcf266-9928-4a10-b971-f13d1bc8ac03 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe (non-flash)
Aug 17 11:45:56 user nova-compute[73449]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d22566b5-74eb-4aeb-b14c-0bd5aa9e35ee (non-flash)
Aug 17 11:45:56 user nova-compute[73449]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466 (non-flash)
Aug 17 11:45:56 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:45:56 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-71fcf266-9928-4a10-b971-f13d1bc8ac03 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.482s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:45:56 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-71fcf266-9928-4a10-b971-f13d1bc8ac03 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Connected to 172.16.0.220:3260 {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 11:45:56 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-71fcf266-9928-4a10-b971-f13d1bc8ac03 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] HCTL ('34', '-', '-', 0) found on session 17 with lun 0 {{(pid=73449) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 11:45:56 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-71fcf266-9928-4a10-b971-f13d1bc8ac03 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73449) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 11:45:56 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:45:56 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:45:56 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[1761000c-3873-46a4-aa72-e3c158411db9]: (4, ('- - 0', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:45:56 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-71fcf266-9928-4a10-b971-f13d1bc8ac03 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Searching for a device in session 17 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73449) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 11:45:56 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-71fcf266-9928-4a10-b971-f13d1bc8ac03 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sIVNXdDt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 11:45:56 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/848599ce-8cf5-4116-b1d6-4cf9d79cfbc0/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:45:56 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/848599ce-8cf5-4116-b1d6-4cf9d79cfbc0/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:45:56 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/848599ce-8cf5-4116-b1d6-4cf9d79cfbc0/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:45:56 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f35b7f2b-2f88-4b09-86ac-cb5a78a94584/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:45:56 user nova-compute[73449]: DEBUG nova.network.neutron [req-09f1ab17-25bd-4b6a-af05-9809c85a3256 req-13a8b651-4f65-4945-a21b-84965bbf3d99 service nova] [instance: ae75d334-431a-4008-8b3d-f2a727d92417] Updated VIF entry in instance network info cache for port 0cd51063-e3d9-44a8-a1cd-b89bb41a4438. {{(pid=73449) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 11:45:56 user nova-compute[73449]: DEBUG nova.network.neutron [req-09f1ab17-25bd-4b6a-af05-9809c85a3256 req-13a8b651-4f65-4945-a21b-84965bbf3d99 service nova] [instance: ae75d334-431a-4008-8b3d-f2a727d92417] Updating instance_info_cache with network_info: [{"id": "0cd51063-e3d9-44a8-a1cd-b89bb41a4438", "address": "fa:16:3e:54:1f:e7", "network": {"id": "f7298070-baaa-4842-b3b2-d9fe1058d3b6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1715911399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8722edee53ed4a9188366c38f3b8b52f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cd51063-e3", "ovs_interfaceid": "0cd51063-e3d9-44a8-a1cd-b89bb41a4438", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:45:56 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-09f1ab17-25bd-4b6a-af05-9809c85a3256 req-13a8b651-4f65-4945-a21b-84965bbf3d99 service nova] Releasing lock "refresh_cache-ae75d334-431a-4008-8b3d-f2a727d92417" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:45:56 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f35b7f2b-2f88-4b09-86ac-cb5a78a94584/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:45:56 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f35b7f2b-2f88-4b09-86ac-cb5a78a94584/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:45:57 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f35b7f2b-2f88-4b09-86ac-cb5a78a94584/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:45:57 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-71fcf266-9928-4a10-b971-f13d1bc8ac03 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.755s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:45:57 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-71fcf266-9928-4a10-b971-f13d1bc8ac03 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] <== connect_volume: return (1757ms) {'type': 'block', 'scsi_wwn': '26635613739613438', 'path': '/dev/sdc'} {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 11:45:57 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71fcf266-9928-4a10-b971-f13d1bc8ac03 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26635613739613438', 'path': '/dev/sdc'} {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 11:45:57 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:45:57 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:45:57 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Hypervisor/Node resource view: name=user free_ram=7307MB free_disk=25.298221588134766GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73449) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 11:45:57 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:45:57 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:45:57 user nova-compute[73449]: DEBUG nova.objects.instance [None req-71fcf266-9928-4a10-b971-f13d1bc8ac03 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Lazy-loading 'flavor' on Instance uuid f35b7f2b-2f88-4b09-86ac-cb5a78a94584 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:45:57 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-71fcf266-9928-4a10-b971-f13d1bc8ac03 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 11:45:57 user nova-compute[73449]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 11:45:57 user nova-compute[73449]:   <source dev="/dev/sdc"/>
Aug 17 11:45:57 user nova-compute[73449]:   <target dev="vdb" bus="virtio"/>
Aug 17 11:45:57 user nova-compute[73449]:   <serial>0254b152-714d-470d-bfac-2bb7b2761466</serial>
Aug 17 11:45:57 user nova-compute[73449]: </disk>
Aug 17 11:45:57 user nova-compute[73449]:  {{(pid=73449) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 11:45:57 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 4a9e8ad2-19db-4975-87e4-2efce603a7d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:45:57 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance a3523d22-7165-46ad-be10-5e6ae374f91d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:45:57 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:45:57 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance f35b7f2b-2f88-4b09-86ac-cb5a78a94584 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:45:57 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 848599ce-8cf5-4116-b1d6-4cf9d79cfbc0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:45:57 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance b12d9412-be17-4908-a4c2-b80c0fa38fc0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:45:57 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance de5084e1-5a5e-48d2-a3ef-7f29898d1d2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:45:57 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance c69e7643-8c60-4982-986b-484e8cfc3fa9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:45:57 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance e8e7d9aa-150f-424a-b3af-be149ee421c3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:45:57 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 3d74c8f6-fb4e-4460-b722-674a8a1e2d25 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:45:57 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance ae75d334-431a-4008-8b3d-f2a727d92417 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:45:57 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=73449) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 11:45:57 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=73449) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 11:45:57 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:45:57 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:45:58 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 11:45:58 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 11:45:58 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Compute_service record updated for user:user {{(pid=73449) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 11:45:58 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.558s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:45:58 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-71fcf266-9928-4a10-b971-f13d1bc8ac03 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] No BDM found with device name vda, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 11:45:58 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-71fcf266-9928-4a10-b971-f13d1bc8ac03 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 11:45:58 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-71fcf266-9928-4a10-b971-f13d1bc8ac03 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] No VIF found with MAC fa:16:3e:4e:54:ff, not building metadata {{(pid=73449) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 11:45:58 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-71fcf266-9928-4a10-b971-f13d1bc8ac03 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Lock "f35b7f2b-2f88-4b09-86ac-cb5a78a94584" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.133s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:45:58 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:45:58 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:45:58 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:45:58 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:45:58 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:45:58 user nova-compute[73449]: DEBUG nova.compute.manager [req-12ac6c8c-d906-4e2f-b2c8-aa3fdb105057 req-df5531c5-2e68-4d06-94d2-7cb412ca015e service nova] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] Received event network-vif-plugged-a0e89b76-95af-4e50-a972-b223cc5b3cab {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:45:58 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-12ac6c8c-d906-4e2f-b2c8-aa3fdb105057 req-df5531c5-2e68-4d06-94d2-7cb412ca015e service nova] Acquiring lock "3d74c8f6-fb4e-4460-b722-674a8a1e2d25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:45:58 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-12ac6c8c-d906-4e2f-b2c8-aa3fdb105057 req-df5531c5-2e68-4d06-94d2-7cb412ca015e service nova] Lock "3d74c8f6-fb4e-4460-b722-674a8a1e2d25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:45:58 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-12ac6c8c-d906-4e2f-b2c8-aa3fdb105057 req-df5531c5-2e68-4d06-94d2-7cb412ca015e service nova] Lock "3d74c8f6-fb4e-4460-b722-674a8a1e2d25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:45:58 user nova-compute[73449]: DEBUG nova.compute.manager [req-12ac6c8c-d906-4e2f-b2c8-aa3fdb105057 req-df5531c5-2e68-4d06-94d2-7cb412ca015e service nova] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] No waiting events found dispatching network-vif-plugged-a0e89b76-95af-4e50-a972-b223cc5b3cab {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:45:58 user nova-compute[73449]: WARNING nova.compute.manager [req-12ac6c8c-d906-4e2f-b2c8-aa3fdb105057 req-df5531c5-2e68-4d06-94d2-7cb412ca015e service nova] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] Received unexpected event network-vif-plugged-a0e89b76-95af-4e50-a972-b223cc5b3cab for instance with vm_state building and task_state spawning.
Aug 17 11:45:58 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:45:59 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:45:59 user nova-compute[73449]: DEBUG nova.compute.manager [req-416a7a94-f70b-44da-9b71-93992eae50e5 req-2caf8437-3a12-4c34-a6d3-866e38944760 service nova] [instance: ae75d334-431a-4008-8b3d-f2a727d92417] Received event network-vif-plugged-0cd51063-e3d9-44a8-a1cd-b89bb41a4438 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:45:59 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-416a7a94-f70b-44da-9b71-93992eae50e5 req-2caf8437-3a12-4c34-a6d3-866e38944760 service nova] Acquiring lock "ae75d334-431a-4008-8b3d-f2a727d92417-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:45:59 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-416a7a94-f70b-44da-9b71-93992eae50e5 req-2caf8437-3a12-4c34-a6d3-866e38944760 service nova] Lock "ae75d334-431a-4008-8b3d-f2a727d92417-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:45:59 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-416a7a94-f70b-44da-9b71-93992eae50e5 req-2caf8437-3a12-4c34-a6d3-866e38944760 service nova] Lock "ae75d334-431a-4008-8b3d-f2a727d92417-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:45:59 user nova-compute[73449]: DEBUG nova.compute.manager [req-416a7a94-f70b-44da-9b71-93992eae50e5 req-2caf8437-3a12-4c34-a6d3-866e38944760 service nova] [instance: ae75d334-431a-4008-8b3d-f2a727d92417] No waiting events found dispatching network-vif-plugged-0cd51063-e3d9-44a8-a1cd-b89bb41a4438 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:45:59 user nova-compute[73449]: WARNING nova.compute.manager [req-416a7a94-f70b-44da-9b71-93992eae50e5 req-2caf8437-3a12-4c34-a6d3-866e38944760 service nova] [instance: ae75d334-431a-4008-8b3d-f2a727d92417] Received unexpected event network-vif-plugged-0cd51063-e3d9-44a8-a1cd-b89bb41a4438 for instance with vm_state building and task_state spawning.
Aug 17 11:45:59 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:45:59 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:45:59 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:45:59 user nova-compute[73449]: INFO nova.compute.manager [None req-2ee01c43-3d23-46f4-af23-6785a3727a3f tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Unrescuing
Aug 17 11:45:59 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-2ee01c43-3d23-46f4-af23-6785a3727a3f tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Acquiring lock "refresh_cache-a3523d22-7165-46ad-be10-5e6ae374f91d" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:45:59 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-2ee01c43-3d23-46f4-af23-6785a3727a3f tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Acquired lock "refresh_cache-a3523d22-7165-46ad-be10-5e6ae374f91d" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:45:59 user nova-compute[73449]: DEBUG nova.network.neutron [None req-2ee01c43-3d23-46f4-af23-6785a3727a3f tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Building network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 11:45:59 user nova-compute[73449]: INFO nova.compute.manager [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] Rebuilding instance
Aug 17 11:46:00 user nova-compute[73449]: DEBUG nova.objects.instance [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Lazy-loading 'trusted_certs' on Instance uuid f35b7f2b-2f88-4b09-86ac-cb5a78a94584 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:46:00 user nova-compute[73449]: DEBUG nova.compute.manager [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:46:00 user nova-compute[73449]: DEBUG nova.objects.instance [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Lazy-loading 'pci_requests' on Instance uuid f35b7f2b-2f88-4b09-86ac-cb5a78a94584 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:46:00 user nova-compute[73449]: DEBUG nova.objects.instance [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Lazy-loading 'pci_devices' on Instance uuid f35b7f2b-2f88-4b09-86ac-cb5a78a94584 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:46:00 user nova-compute[73449]: DEBUG nova.objects.instance [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Lazy-loading 'resources' on Instance uuid f35b7f2b-2f88-4b09-86ac-cb5a78a94584 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:46:00 user nova-compute[73449]: DEBUG nova.objects.instance [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Lazy-loading 'migration_context' on Instance uuid f35b7f2b-2f88-4b09-86ac-cb5a78a94584 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:46:00 user nova-compute[73449]: DEBUG nova.objects.instance [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] Trying to apply a migration context that does not seem to be set for this instance {{(pid=73449) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 17 11:46:00 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:46:00 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:46:00 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:46:00 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:46:00 user nova-compute[73449]: DEBUG nova.compute.manager [req-21ad67d8-d963-49fb-b751-16cc1b64a25a req-c0447595-abcf-4340-8783-6d7ce55c66b7 service nova] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] Received event network-vif-plugged-a0e89b76-95af-4e50-a972-b223cc5b3cab {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:46:00 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-21ad67d8-d963-49fb-b751-16cc1b64a25a req-c0447595-abcf-4340-8783-6d7ce55c66b7 service nova] Acquiring lock "3d74c8f6-fb4e-4460-b722-674a8a1e2d25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:46:00 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-21ad67d8-d963-49fb-b751-16cc1b64a25a req-c0447595-abcf-4340-8783-6d7ce55c66b7 service nova] Lock "3d74c8f6-fb4e-4460-b722-674a8a1e2d25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:46:00 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-21ad67d8-d963-49fb-b751-16cc1b64a25a req-c0447595-abcf-4340-8783-6d7ce55c66b7 service nova] Lock "3d74c8f6-fb4e-4460-b722-674a8a1e2d25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:46:00 user nova-compute[73449]: DEBUG nova.compute.manager [req-21ad67d8-d963-49fb-b751-16cc1b64a25a req-c0447595-abcf-4340-8783-6d7ce55c66b7 service nova] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] No waiting events found dispatching network-vif-plugged-a0e89b76-95af-4e50-a972-b223cc5b3cab {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:46:00 user nova-compute[73449]: WARNING nova.compute.manager [req-21ad67d8-d963-49fb-b751-16cc1b64a25a req-c0447595-abcf-4340-8783-6d7ce55c66b7 service nova] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] Received unexpected event network-vif-plugged-a0e89b76-95af-4e50-a972-b223cc5b3cab for instance with vm_state building and task_state spawning.
Aug 17 11:46:01 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:46:01 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:46:01 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] Instance destroyed successfully.
Aug 17 11:46:01 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:46:01 user nova-compute[73449]: DEBUG nova.network.neutron [None req-2ee01c43-3d23-46f4-af23-6785a3727a3f tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Updating instance_info_cache with network_info: [{"id": "2a0eb61f-9398-4db6-9ae0-f142ad2e60c4", "address": "fa:16:3e:15:cd:09", "network": {"id": "d54a402f-1fa9-43d8-b68e-0aa7ae6f0e73", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1441085328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eed9899860d4e7ca8a4500bbda4be13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a0eb61f-93", "ovs_interfaceid": "2a0eb61f-9398-4db6-9ae0-f142ad2e60c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:46:01 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-2ee01c43-3d23-46f4-af23-6785a3727a3f tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Releasing lock "refresh_cache-a3523d22-7165-46ad-be10-5e6ae374f91d" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:46:01 user nova-compute[73449]: DEBUG nova.objects.instance [None req-2ee01c43-3d23-46f4-af23-6785a3727a3f tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Lazy-loading 'flavor' on Instance uuid a3523d22-7165-46ad-be10-5e6ae374f91d {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:46:01 user nova-compute[73449]: INFO nova.compute.manager [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] Detaching volume 0254b152-714d-470d-bfac-2bb7b2761466
Aug 17 11:46:01 user nova-compute[73449]: DEBUG nova.compute.manager [req-ff09880b-4b74-4938-af6e-b3995d92c9bf req-3f453d5d-12b7-4ff4-96a7-13f892544670 service nova] [instance: ae75d334-431a-4008-8b3d-f2a727d92417] Received event network-vif-plugged-0cd51063-e3d9-44a8-a1cd-b89bb41a4438 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:46:01 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-ff09880b-4b74-4938-af6e-b3995d92c9bf req-3f453d5d-12b7-4ff4-96a7-13f892544670 service nova] Acquiring lock "ae75d334-431a-4008-8b3d-f2a727d92417-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:46:01 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-ff09880b-4b74-4938-af6e-b3995d92c9bf req-3f453d5d-12b7-4ff4-96a7-13f892544670 service nova] Lock "ae75d334-431a-4008-8b3d-f2a727d92417-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:46:01 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-ff09880b-4b74-4938-af6e-b3995d92c9bf req-3f453d5d-12b7-4ff4-96a7-13f892544670 service nova] Lock "ae75d334-431a-4008-8b3d-f2a727d92417-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:46:01 user nova-compute[73449]: DEBUG nova.compute.manager [req-ff09880b-4b74-4938-af6e-b3995d92c9bf req-3f453d5d-12b7-4ff4-96a7-13f892544670 service nova] [instance: ae75d334-431a-4008-8b3d-f2a727d92417] No waiting events found dispatching network-vif-plugged-0cd51063-e3d9-44a8-a1cd-b89bb41a4438 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:46:01 user nova-compute[73449]: WARNING nova.compute.manager [req-ff09880b-4b74-4938-af6e-b3995d92c9bf req-3f453d5d-12b7-4ff4-96a7-13f892544670 service nova] [instance: ae75d334-431a-4008-8b3d-f2a727d92417] Received unexpected event network-vif-plugged-0cd51063-e3d9-44a8-a1cd-b89bb41a4438 for instance with vm_state building and task_state spawning.
Aug 17 11:46:01 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:46:01 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:46:01 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:46:01 user nova-compute[73449]: INFO nova.virt.block_device [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] Attempting to driver detach volume 0254b152-714d-470d-bfac-2bb7b2761466 from mountpoint /dev/vdb
Aug 17 11:46:01 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:46:01 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Attempting to detach device vdb from instance f35b7f2b-2f88-4b09-86ac-cb5a78a94584 from the persistent domain config. {{(pid=73449) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 11:46:01 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 11:46:01 user nova-compute[73449]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 11:46:01 user nova-compute[73449]:   <source dev="/dev/sdc"/>
Aug 17 11:46:01 user nova-compute[73449]:   <target dev="vdb" bus="virtio"/>
Aug 17 11:46:01 user nova-compute[73449]:   <serial>0254b152-714d-470d-bfac-2bb7b2761466</serial>
Aug 17 11:46:01 user nova-compute[73449]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 11:46:01 user nova-compute[73449]: </disk>
Aug 17 11:46:01 user nova-compute[73449]:  {{(pid=73449) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 11:46:01 user nova-compute[73449]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692272746.439662, 5e5229d5-65a2-4d60-8e50-c30357372a80 => Stopped> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:46:01 user nova-compute[73449]: INFO nova.compute.manager [-] [instance: 5e5229d5-65a2-4d60-8e50-c30357372a80] VM Stopped (Lifecycle Event)
Aug 17 11:46:01 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b7a42544-af96-496c-b87e-a503a66e3ae3 None None] [instance: 5e5229d5-65a2-4d60-8e50-c30357372a80] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:46:01 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Successfully detached device vdb from instance f35b7f2b-2f88-4b09-86ac-cb5a78a94584 from the persistent domain config.
Aug 17 11:46:01 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] calling os-brick to detach iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 11:46:01 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, {'target_iqns': ['iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sIVNXdDt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 11:46:01 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 17 11:46:01 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:46:01 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:46:01 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466', 0)] {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 11:46:01 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:46:01 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:46:01 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a3842ed-4741-4a32-a070-5c2a812e244d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d22566b5-74eb-4aeb-b14c-0bd5aa9e35ee\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:46:01 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:46:01 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:46:01 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[6578fe07-b86c-4946-914c-1fa239e4a7a1]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d22566b5-74eb-4aeb-b14c-0bd5aa9e35ee (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466 (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:46:01 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe (non-flash)
Aug 17 11:46:01 user nova-compute[73449]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d22566b5-74eb-4aeb-b14c-0bd5aa9e35ee (non-flash)
Aug 17 11:46:01 user nova-compute[73449]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466 (non-flash)
Aug 17 11:46:01 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:46:01 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe (non-flash)
Aug 17 11:46:01 user nova-compute[73449]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d22566b5-74eb-4aeb-b14c-0bd5aa9e35ee (non-flash)
Aug 17 11:46:01 user nova-compute[73449]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466 (non-flash)
Aug 17 11:46:01 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:46:01 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe7582c0790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466'): ({'sdc'}, set())}) {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 11:46:01 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Removing single pathed devices sdc {{(pid=73449) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 11:46:01 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:46:01 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:46:01 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f55fe59-fb45-4a8f-9ae4-2c383e9d1265]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:46:01 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:46:01 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.027s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:46:01 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[d491ac26-0a76-4f72-8826-31197bd5f7bf]: (4, ('ok\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:46:01 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Flushing IO for device /dev/sdc {{(pid=73449) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 11:46:01 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:46:01 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:46:01 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[55a24d25-8196-458a-8619-c13cf04b5a75]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:46:01 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73449) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 11:46:01 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:46:01 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.121s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:46:01 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[afdb1fe7-f5b2-4b37-9446-b140dbc72f0e]: (4, ('1', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:46:01 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73449) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 11:46:01 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] SCSI volumes sdc have been removed. {{(pid=73449) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 11:46:01 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466')] {{(pid=73449) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 11:46:01 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:46:01 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:46:01 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:46:01 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c42d3ee-002a-4f66-a6e1-004a4002183f]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:46:01 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:46:01 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466 -p 172.16.0.220:3260 --logout {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:46:01 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:46:01 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:46:01 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:46:01 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aeeddb3-b0a0-4594-b797-3a7959041926]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:46:01 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466, portal: 172.16.0.220,3260]
Aug 17 11:46:01 user nova-compute[73449]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466, portal: 172.16.0.220,3260] successful.
Aug 17 11:46:01 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:46:01 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692272761.8877556, 3d74c8f6-fb4e-4460-b722-674a8a1e2d25 => Resumed> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:46:01 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] VM Resumed (Lifecycle Event)
Aug 17 11:46:01 user nova-compute[73449]: DEBUG nova.compute.manager [None req-48f8ed28-9e9a-4bac-979b-3f9d701567c9 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] Instance event wait completed in 0 seconds for  {{(pid=73449) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 11:46:01 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-48f8ed28-9e9a-4bac-979b-3f9d701567c9 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] Guest created on hypervisor {{(pid=73449) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 11:46:01 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466 -p 172.16.0.220:3260 --op delete {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:46:01 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] Instance spawned successfully.
Aug 17 11:46:01 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-48f8ed28-9e9a-4bac-979b-3f9d701567c9 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 11:46:01 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:46:01 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 11:46:01 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:46:01 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5a0f987-f28d-4f87-9607-92a2fad6d3d9]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:46:01 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:46:01 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.431s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:46:01 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] <== disconnect_volume: return (433ms) None {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 11:46:01 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] Disconnected iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 11:46:01 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:46:01 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-48f8ed28-9e9a-4bac-979b-3f9d701567c9 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] Found default for hw_cdrom_bus of ide {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:46:01 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-48f8ed28-9e9a-4bac-979b-3f9d701567c9 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] Found default for hw_disk_bus of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:46:01 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-48f8ed28-9e9a-4bac-979b-3f9d701567c9 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] Found default for hw_input_bus of None {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:46:01 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-48f8ed28-9e9a-4bac-979b-3f9d701567c9 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] Found default for hw_pointer_model of None {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:46:01 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-48f8ed28-9e9a-4bac-979b-3f9d701567c9 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] Found default for hw_video_model of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:46:01 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-48f8ed28-9e9a-4bac-979b-3f9d701567c9 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] Found default for hw_vif_model of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:46:01 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 11:46:01 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692272761.8893423, 3d74c8f6-fb4e-4460-b722-674a8a1e2d25 => Started> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:46:01 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] VM Started (Lifecycle Event)
Aug 17 11:46:01 user nova-compute[73449]: DEBUG nova.compute.manager [None req-986f4884-4f55-4831-be2d-487c851fe939 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: ae75d334-431a-4008-8b3d-f2a727d92417] Instance event wait completed in 0 seconds for  {{(pid=73449) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 11:46:01 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-986f4884-4f55-4831-be2d-487c851fe939 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: ae75d334-431a-4008-8b3d-f2a727d92417] Guest created on hypervisor {{(pid=73449) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 11:46:01 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: ae75d334-431a-4008-8b3d-f2a727d92417] Instance spawned successfully.
Aug 17 11:46:01 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-986f4884-4f55-4831-be2d-487c851fe939 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: ae75d334-431a-4008-8b3d-f2a727d92417] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 11:46:01 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:46:02 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 11:46:02 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-986f4884-4f55-4831-be2d-487c851fe939 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: ae75d334-431a-4008-8b3d-f2a727d92417] Found default for hw_cdrom_bus of ide {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:46:02 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-986f4884-4f55-4831-be2d-487c851fe939 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: ae75d334-431a-4008-8b3d-f2a727d92417] Found default for hw_disk_bus of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:46:02 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-986f4884-4f55-4831-be2d-487c851fe939 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: ae75d334-431a-4008-8b3d-f2a727d92417] Found default for hw_input_bus of None {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:46:02 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-986f4884-4f55-4831-be2d-487c851fe939 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: ae75d334-431a-4008-8b3d-f2a727d92417] Found default for hw_pointer_model of None {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:46:02 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-986f4884-4f55-4831-be2d-487c851fe939 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: ae75d334-431a-4008-8b3d-f2a727d92417] Found default for hw_video_model of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:46:02 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-986f4884-4f55-4831-be2d-487c851fe939 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: ae75d334-431a-4008-8b3d-f2a727d92417] Found default for hw_vif_model of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:46:02 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 11:46:02 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692272761.9683433, ae75d334-431a-4008-8b3d-f2a727d92417 => Resumed> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:46:02 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: ae75d334-431a-4008-8b3d-f2a727d92417] VM Resumed (Lifecycle Event)
Aug 17 11:46:02 user nova-compute[73449]: INFO nova.compute.manager [None req-48f8ed28-9e9a-4bac-979b-3f9d701567c9 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] Took 10.00 seconds to spawn the instance on the hypervisor.
Aug 17 11:46:02 user nova-compute[73449]: DEBUG nova.compute.manager [None req-48f8ed28-9e9a-4bac-979b-3f9d701567c9 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:46:02 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: ae75d334-431a-4008-8b3d-f2a727d92417] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:46:02 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: ae75d334-431a-4008-8b3d-f2a727d92417] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 11:46:02 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Instance destroyed successfully.
Aug 17 11:46:02 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: ae75d334-431a-4008-8b3d-f2a727d92417] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 11:46:02 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692272761.9739304, ae75d334-431a-4008-8b3d-f2a727d92417 => Started> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:46:02 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: ae75d334-431a-4008-8b3d-f2a727d92417] VM Started (Lifecycle Event)
Aug 17 11:46:02 user nova-compute[73449]: INFO nova.compute.manager [None req-986f4884-4f55-4831-be2d-487c851fe939 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: ae75d334-431a-4008-8b3d-f2a727d92417] Took 8.80 seconds to spawn the instance on the hypervisor.
Aug 17 11:46:02 user nova-compute[73449]: DEBUG nova.compute.manager [None req-986f4884-4f55-4831-be2d-487c851fe939 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: ae75d334-431a-4008-8b3d-f2a727d92417] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:46:02 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: ae75d334-431a-4008-8b3d-f2a727d92417] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:46:02 user nova-compute[73449]: INFO nova.compute.manager [None req-48f8ed28-9e9a-4bac-979b-3f9d701567c9 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] Took 11.28 seconds to build instance.
Aug 17 11:46:02 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: ae75d334-431a-4008-8b3d-f2a727d92417] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 11:46:02 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-48f8ed28-9e9a-4bac-979b-3f9d701567c9 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Lock "3d74c8f6-fb4e-4460-b722-674a8a1e2d25" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.387s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:46:02 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: ae75d334-431a-4008-8b3d-f2a727d92417] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 11:46:02 user nova-compute[73449]: INFO nova.compute.manager [None req-986f4884-4f55-4831-be2d-487c851fe939 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: ae75d334-431a-4008-8b3d-f2a727d92417] Took 10.02 seconds to build instance.
Aug 17 11:46:02 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-986f4884-4f55-4831-be2d-487c851fe939 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Lock "ae75d334-431a-4008-8b3d-f2a727d92417" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.159s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:46:02 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:46:02 user nova-compute[73449]: DEBUG nova.compute.manager [req-87381e4a-2ebf-42c2-a187-a453ef56a074 req-fabc11bb-db2a-4f0c-bf28-42e9636fa9aa service nova] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] Received event network-vif-unplugged-e86f2a61-e64f-49ea-83ad-386755b33e00 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:46:02 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-87381e4a-2ebf-42c2-a187-a453ef56a074 req-fabc11bb-db2a-4f0c-bf28-42e9636fa9aa service nova] Acquiring lock "f35b7f2b-2f88-4b09-86ac-cb5a78a94584-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:46:02 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-87381e4a-2ebf-42c2-a187-a453ef56a074 req-fabc11bb-db2a-4f0c-bf28-42e9636fa9aa service nova] Lock "f35b7f2b-2f88-4b09-86ac-cb5a78a94584-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:46:02 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-87381e4a-2ebf-42c2-a187-a453ef56a074 req-fabc11bb-db2a-4f0c-bf28-42e9636fa9aa service nova] Lock "f35b7f2b-2f88-4b09-86ac-cb5a78a94584-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:46:02 user nova-compute[73449]: DEBUG nova.compute.manager [req-87381e4a-2ebf-42c2-a187-a453ef56a074 req-fabc11bb-db2a-4f0c-bf28-42e9636fa9aa service nova] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] No waiting events found dispatching network-vif-unplugged-e86f2a61-e64f-49ea-83ad-386755b33e00 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:46:02 user nova-compute[73449]: WARNING nova.compute.manager [req-87381e4a-2ebf-42c2-a187-a453ef56a074 req-fabc11bb-db2a-4f0c-bf28-42e9636fa9aa service nova] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] Received unexpected event network-vif-unplugged-e86f2a61-e64f-49ea-83ad-386755b33e00 for instance with vm_state active and task_state rebuilding.
Aug 17 11:46:02 user nova-compute[73449]: DEBUG nova.compute.manager [req-87381e4a-2ebf-42c2-a187-a453ef56a074 req-fabc11bb-db2a-4f0c-bf28-42e9636fa9aa service nova] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] Received event network-vif-plugged-e86f2a61-e64f-49ea-83ad-386755b33e00 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:46:02 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-87381e4a-2ebf-42c2-a187-a453ef56a074 req-fabc11bb-db2a-4f0c-bf28-42e9636fa9aa service nova] Acquiring lock "f35b7f2b-2f88-4b09-86ac-cb5a78a94584-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:46:02 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-87381e4a-2ebf-42c2-a187-a453ef56a074 req-fabc11bb-db2a-4f0c-bf28-42e9636fa9aa service nova] Lock "f35b7f2b-2f88-4b09-86ac-cb5a78a94584-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:46:02 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-87381e4a-2ebf-42c2-a187-a453ef56a074 req-fabc11bb-db2a-4f0c-bf28-42e9636fa9aa service nova] Lock "f35b7f2b-2f88-4b09-86ac-cb5a78a94584-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:46:02 user nova-compute[73449]: DEBUG nova.compute.manager [req-87381e4a-2ebf-42c2-a187-a453ef56a074 req-fabc11bb-db2a-4f0c-bf28-42e9636fa9aa service nova] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] No waiting events found dispatching network-vif-plugged-e86f2a61-e64f-49ea-83ad-386755b33e00 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:46:02 user nova-compute[73449]: WARNING nova.compute.manager [req-87381e4a-2ebf-42c2-a187-a453ef56a074 req-fabc11bb-db2a-4f0c-bf28-42e9636fa9aa service nova] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] Received unexpected event network-vif-plugged-e86f2a61-e64f-49ea-83ad-386755b33e00 for instance with vm_state active and task_state rebuilding.
Aug 17 11:46:03 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] Instance destroyed successfully.
Aug 17 11:46:03 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:43:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-2119051174',display_name='tempest-ServerActionsTestOtherA-server-1113411740',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-2119051174',id=12,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBslNxfjqeXy15++V9lUN1dUPSj0u5ix1Nnljk5AjIrZhZF+tQog/IhoD1HSXnZkSrwagPwVC/Uewn/Q/J6AkryzpFNZdKWZ4r8749mZJ2bXrxgJUs51emgx4vTQbsCJiQ==',key_name='tempest-keypair-1878071127',keypairs=<?>,launch_index=0,launched_at=2023-08-17T11:43:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='068c5270255744a18208a0ad9b35f168',ramdisk_id='',reservation_id='r-raxmup83',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-303961666',owner_user_name='tempest-ServerActionsTestOtherA-303961666-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T11:46:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e44f6d8893da4d95a8ebe95180355c04',uuid=f35b7f2b-2f88-4b09-86ac-cb5a78a94584,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e86f2a61-e64f-49ea-83ad-386755b33e00", "address": "fa:16:3e:4e:54:ff", "network": {"id": "72c50a42-688f-4868-8e19-c40b103a49cd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1792423641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "068c5270255744a18208a0ad9b35f168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape86f2a61-e6", "ovs_interfaceid": "e86f2a61-e64f-49ea-83ad-386755b33e00", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Converting VIF {"id": "e86f2a61-e64f-49ea-83ad-386755b33e00", "address": "fa:16:3e:4e:54:ff", "network": {"id": "72c50a42-688f-4868-8e19-c40b103a49cd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1792423641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "068c5270255744a18208a0ad9b35f168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape86f2a61-e6", "ovs_interfaceid": "e86f2a61-e64f-49ea-83ad-386755b33e00", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4e:54:ff,bridge_name='br-int',has_traffic_filtering=True,id=e86f2a61-e64f-49ea-83ad-386755b33e00,network=Network(72c50a42-688f-4868-8e19-c40b103a49cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape86f2a61-e6') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG os_vif [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4e:54:ff,bridge_name='br-int',has_traffic_filtering=True,id=e86f2a61-e64f-49ea-83ad-386755b33e00,network=Network(72c50a42-688f-4868-8e19-c40b103a49cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape86f2a61-e6') {{(pid=73449) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape86f2a61-e6, bridge=br-int, if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:46:03 user nova-compute[73449]: INFO os_vif [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4e:54:ff,bridge_name='br-int',has_traffic_filtering=True,id=e86f2a61-e64f-49ea-83ad-386755b33e00,network=Network(72c50a42-688f-4868-8e19-c40b103a49cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape86f2a61-e6')
Aug 17 11:46:03 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] calling os-brick to detach iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, {'target_iqns': ['iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sIVNXdDt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 11:46:03 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 17 11:46:03 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466', 0)] {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[361c35ba-7502-4942-86a7-e81689f503c4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d22566b5-74eb-4aeb-b14c-0bd5aa9e35ee\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f2ba75d-a700-455b-9472-fc1db063134c]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d22566b5-74eb-4aeb-b14c-0bd5aa9e35ee (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe (non-flash)
Aug 17 11:46:03 user nova-compute[73449]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d22566b5-74eb-4aeb-b14c-0bd5aa9e35ee (non-flash)
Aug 17 11:46:03 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe (non-flash)
Aug 17 11:46:03 user nova-compute[73449]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d22566b5-74eb-4aeb-b14c-0bd5aa9e35ee (non-flash)
Aug 17 11:46:03 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe75812a290>, {}) {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Disconnecting from: [] {{(pid=73449) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.054s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] <== disconnect_volume: return (55ms) None {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] Disconnected iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 11:46:03 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] Deleting instance files /opt/stack/data/nova/instances/f35b7f2b-2f88-4b09-86ac-cb5a78a94584_del
Aug 17 11:46:03 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] Deletion of /opt/stack/data/nova/instances/f35b7f2b-2f88-4b09-86ac-cb5a78a94584_del complete
Aug 17 11:46:03 user nova-compute[73449]: DEBUG nova.compute.manager [None req-0b386429-b788-46e8-845f-b5c0d2adbc33 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] Start spawning the instance on the hypervisor. {{(pid=73449) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-0b386429-b788-46e8-845f-b5c0d2adbc33 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] Creating instance directory {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 11:46:03 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-0b386429-b788-46e8-845f-b5c0d2adbc33 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] Creating image(s)
Aug 17 11:46:03 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-0b386429-b788-46e8-845f-b5c0d2adbc33 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] Did not create local disks {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-0b386429-b788-46e8-845f-b5c0d2adbc33 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] Ensure instance console log exists: /opt/stack/data/nova/instances/e8e7d9aa-150f-424a-b3af-be149ee421c3/console.log {{(pid=73449) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-0b386429-b788-46e8-845f-b5c0d2adbc33 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-0b386429-b788-46e8-845f-b5c0d2adbc33 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.003s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-0b386429-b788-46e8-845f-b5c0d2adbc33 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-0b386429-b788-46e8-845f-b5c0d2adbc33 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] Start _get_guest_xml network_info=[{"id": "460de6e4-4651-4b83-93bd-fbb5db34bcfa", "address": "fa:16:3e:59:e7:ee", "network": {"id": "d4fc5f62-8de4-4df1-9e12-0f192a793f5f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1016129651-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a0323f43b04829a3b1e81266986cbf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap460de6e4-46", "ovs_interfaceid": "460de6e4-4651-4b83-93bd-fbb5db34bcfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'attachment_id': 'dce2d49e-5334-4373-b3f4-9cd1fd4ba1d4', 'boot_index': 0, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XGrhlpAM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e8e7d9aa-150f-424a-b3af-be149ee421c3', 'attached_at': '', 'detached_at': '', 'volume_id': '71f6919a-6a55-4d8f-ae84-7bb40d59f4ed', 'serial': '71f6919a-6a55-4d8f-ae84-7bb40d59f4ed'}, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 11:46:03 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-0b386429-b788-46e8-845f-b5c0d2adbc33 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:46:03 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-0b386429-b788-46e8-845f-b5c0d2adbc33 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:46:03 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-0b386429-b788-46e8-845f-b5c0d2adbc33 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-0b386429-b788-46e8-845f-b5c0d2adbc33 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] CPU controller missing on host. {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-0b386429-b788-46e8-845f-b5c0d2adbc33 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-0b386429-b788-46e8-845f-b5c0d2adbc33 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] CPU controller found on host. {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-0b386429-b788-46e8-845f-b5c0d2adbc33 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73449) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-0b386429-b788-46e8-845f-b5c0d2adbc33 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T11:35:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-0b386429-b788-46e8-845f-b5c0d2adbc33 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Flavor limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-0b386429-b788-46e8-845f-b5c0d2adbc33 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Image limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-0b386429-b788-46e8-845f-b5c0d2adbc33 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Flavor pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-0b386429-b788-46e8-845f-b5c0d2adbc33 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Image pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-0b386429-b788-46e8-845f-b5c0d2adbc33 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-0b386429-b788-46e8-845f-b5c0d2adbc33 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-0b386429-b788-46e8-845f-b5c0d2adbc33 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-0b386429-b788-46e8-845f-b5c0d2adbc33 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Got 1 possible topologies {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-0b386429-b788-46e8-845f-b5c0d2adbc33 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-0b386429-b788-46e8-845f-b5c0d2adbc33 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b386429-b788-46e8-845f-b5c0d2adbc33 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] Calling os-brick to attach iSCSI Volume {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b386429-b788-46e8-845f-b5c0d2adbc33 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XGrhlpAM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 11:46:03 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-0b386429-b788-46e8-845f-b5c0d2adbc33 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 11:46:03 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-0b386429-b788-46e8-845f-b5c0d2adbc33 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-0b386429-b788-46e8-845f-b5c0d2adbc33 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:46:03 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-0b386429-b788-46e8-845f-b5c0d2adbc33 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 11:46:03 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-0b386429-b788-46e8-845f-b5c0d2adbc33 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-0b386429-b788-46e8-845f-b5c0d2adbc33 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:46:03 user nova-compute[73449]: INFO os_brick.initiator.connectors.iscsi [None req-0b386429-b788-46e8-845f-b5c0d2adbc33 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 11:46:03 user nova-compute[73449]: INFO nova.virt.block_device [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] Booting with volume 0254b152-714d-470d-bfac-2bb7b2761466 at /dev/vdb
Aug 17 11:46:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed -p 172.16.0.220:3260 {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG nova.compute.manager [req-6ba2d84f-ab88-47c0-aaf1-adf9d0d69e94 req-9dde6aa1-904e-419c-a787-ad295ca84c39 service nova] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Received event network-vif-unplugged-2a0eb61f-9398-4db6-9ae0-f142ad2e60c4 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-6ba2d84f-ab88-47c0-aaf1-adf9d0d69e94 req-9dde6aa1-904e-419c-a787-ad295ca84c39 service nova] Acquiring lock "a3523d22-7165-46ad-be10-5e6ae374f91d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-6ba2d84f-ab88-47c0-aaf1-adf9d0d69e94 req-9dde6aa1-904e-419c-a787-ad295ca84c39 service nova] Lock "a3523d22-7165-46ad-be10-5e6ae374f91d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-6ba2d84f-ab88-47c0-aaf1-adf9d0d69e94 req-9dde6aa1-904e-419c-a787-ad295ca84c39 service nova] Lock "a3523d22-7165-46ad-be10-5e6ae374f91d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG nova.compute.manager [req-6ba2d84f-ab88-47c0-aaf1-adf9d0d69e94 req-9dde6aa1-904e-419c-a787-ad295ca84c39 service nova] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] No waiting events found dispatching network-vif-unplugged-2a0eb61f-9398-4db6-9ae0-f142ad2e60c4 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:46:03 user nova-compute[73449]: WARNING nova.compute.manager [req-6ba2d84f-ab88-47c0-aaf1-adf9d0d69e94 req-9dde6aa1-904e-419c-a787-ad295ca84c39 service nova] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Received unexpected event network-vif-unplugged-2a0eb61f-9398-4db6-9ae0-f142ad2e60c4 for instance with vm_state rescued and task_state unrescuing.
Aug 17 11:46:03 user nova-compute[73449]: DEBUG nova.compute.manager [req-6ba2d84f-ab88-47c0-aaf1-adf9d0d69e94 req-9dde6aa1-904e-419c-a787-ad295ca84c39 service nova] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Received event network-vif-plugged-2a0eb61f-9398-4db6-9ae0-f142ad2e60c4 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-6ba2d84f-ab88-47c0-aaf1-adf9d0d69e94 req-9dde6aa1-904e-419c-a787-ad295ca84c39 service nova] Acquiring lock "a3523d22-7165-46ad-be10-5e6ae374f91d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-6ba2d84f-ab88-47c0-aaf1-adf9d0d69e94 req-9dde6aa1-904e-419c-a787-ad295ca84c39 service nova] Lock "a3523d22-7165-46ad-be10-5e6ae374f91d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-6ba2d84f-ab88-47c0-aaf1-adf9d0d69e94 req-9dde6aa1-904e-419c-a787-ad295ca84c39 service nova] Lock "a3523d22-7165-46ad-be10-5e6ae374f91d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG nova.compute.manager [req-6ba2d84f-ab88-47c0-aaf1-adf9d0d69e94 req-9dde6aa1-904e-419c-a787-ad295ca84c39 service nova] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] No waiting events found dispatching network-vif-plugged-2a0eb61f-9398-4db6-9ae0-f142ad2e60c4 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:46:03 user nova-compute[73449]: WARNING nova.compute.manager [req-6ba2d84f-ab88-47c0-aaf1-adf9d0d69e94 req-9dde6aa1-904e-419c-a787-ad295ca84c39 service nova] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Received unexpected event network-vif-plugged-2a0eb61f-9398-4db6-9ae0-f142ad2e60c4 for instance with vm_state rescued and task_state unrescuing.
Aug 17 11:46:03 user nova-compute[73449]: DEBUG nova.compute.manager [req-6ba2d84f-ab88-47c0-aaf1-adf9d0d69e94 req-9dde6aa1-904e-419c-a787-ad295ca84c39 service nova] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Received event network-changed-2a0eb61f-9398-4db6-9ae0-f142ad2e60c4 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG nova.compute.manager [req-6ba2d84f-ab88-47c0-aaf1-adf9d0d69e94 req-9dde6aa1-904e-419c-a787-ad295ca84c39 service nova] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Refreshing instance network info cache due to event network-changed-2a0eb61f-9398-4db6-9ae0-f142ad2e60c4. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-6ba2d84f-ab88-47c0-aaf1-adf9d0d69e94 req-9dde6aa1-904e-419c-a787-ad295ca84c39 service nova] Acquiring lock "refresh_cache-a3523d22-7165-46ad-be10-5e6ae374f91d" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-6ba2d84f-ab88-47c0-aaf1-adf9d0d69e94 req-9dde6aa1-904e-419c-a787-ad295ca84c39 service nova] Acquired lock "refresh_cache-a3523d22-7165-46ad-be10-5e6ae374f91d" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG nova.network.neutron [req-6ba2d84f-ab88-47c0-aaf1-adf9d0d69e94 req-9dde6aa1-904e-419c-a787-ad295ca84c39 service nova] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Refreshing network info cache for port 2a0eb61f-9398-4db6-9ae0-f142ad2e60c4 {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed -p 172.16.0.220:3260" returned: 21 in 0.044s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9357904-c0b2-4bd4-82d4-e864cf7f0105]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b386429-b788-46e8-845f-b5c0d2adbc33 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 11:46:03 user nova-compute[73449]:  {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed -p 172.16.0.220:3260 --interface default --op new {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.042s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[c24ff696-33e0-4476-945c-1979ec7b3376]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed] added\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b386429-b788-46e8-845f-b5c0d2adbc33 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed] added
Aug 17 11:46:03 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.035s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0fa03e6-3931-4b0d-878d-a1df3d730d0e]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b386429-b788-46e8-845f-b5c0d2adbc33 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[e01e68c2-3ff8-492c-8856-b34fb827d992]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b386429-b788-46e8-845f-b5c0d2adbc33 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XGrhlpAM {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XGrhlpAM" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[63d718c6-4e99-4cf8-96f7-919a7a73c057]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b386429-b788-46e8-845f-b5c0d2adbc33 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XGrhlpAM'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG os_brick.utils [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.048s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[f420afa0-caf7-4b25-b376-3d1c6f8082fa]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b386429-b788-46e8-845f-b5c0d2adbc33 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.025s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4250e5d-ab1e-4dfa-bdb3-83b25ca3b76c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4d3924302012\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.052s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ae36372-1a13-44de-9686-7051616e613a]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d22566b5-74eb-4aeb-b14c-0bd5aa9e35ee (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b386429-b788-46e8-845f-b5c0d2adbc33 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe (non-flash)
Aug 17 11:46:03 user nova-compute[73449]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d22566b5-74eb-4aeb-b14c-0bd5aa9e35ee (non-flash)
Aug 17 11:46:03 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b386429-b788-46e8-845f-b5c0d2adbc33 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe (non-flash)
Aug 17 11:46:03 user nova-compute[73449]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d22566b5-74eb-4aeb-b14c-0bd5aa9e35ee (non-flash)
Aug 17 11:46:03 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.048s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[c416083e-7700-48b8-a12f-99b957004aa4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed -p 172.16.0.220:3260 --login {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.047s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[462db0d9-571b-4a98-a0af-40aa38769967]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8fd6758-2cac-4695-abf0-c9e4625aa93b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b386429-b788-46e8-845f-b5c0d2adbc33 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed, portal: 172.16.0.220,3260]
Aug 17 11:46:03 user nova-compute[73449]: Login to [iface: default, target: iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed, portal: 172.16.0.220,3260] successful.
Aug 17 11:46:03 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[66c3922b-97d1-4250-9593-0268a81be485]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Running cmd (subprocess): nvme version {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[a707a46a-9e8d-4f15-aa40-f2a219b145f9]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b386429-b788-46e8-845f-b5c0d2adbc33 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] 'nvme version' failed. Not Retrying. {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.nvmeof [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] nvme not present on system {{(pid=73449) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 11:46:03 user nova-compute[73449]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 11:46:03 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[6071dd2c-9440-4609-b117-389c0931874d]: (4, '') {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffd2e7e5-c5d1-4d70-bc0d-b59e7ff09f7d]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d22566b5-74eb-4aeb-b14c-0bd5aa9e35ee (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73449) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73449) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] LIGHTOS: no hostnqn found. {{(pid=73449) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG os_brick.utils [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] <== get_connector_properties: return (382ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4d3924302012', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG nova.virt.block_device [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] Updating existing volume attachment record: f037353a-2366-4578-b7da-dc731576d346 {{(pid=73449) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b386429-b788-46e8-845f-b5c0d2adbc33 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe (non-flash)
Aug 17 11:46:03 user nova-compute[73449]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d22566b5-74eb-4aeb-b14c-0bd5aa9e35ee (non-flash)
Aug 17 11:46:03 user nova-compute[73449]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed (non-flash)
Aug 17 11:46:03 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b386429-b788-46e8-845f-b5c0d2adbc33 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe (non-flash)
Aug 17 11:46:03 user nova-compute[73449]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d22566b5-74eb-4aeb-b14c-0bd5aa9e35ee (non-flash)
Aug 17 11:46:03 user nova-compute[73449]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed (non-flash)
Aug 17 11:46:03 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-0b386429-b788-46e8-845f-b5c0d2adbc33 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.617s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b386429-b788-46e8-845f-b5c0d2adbc33 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Connected to 172.16.0.220:3260 {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-0b386429-b788-46e8-845f-b5c0d2adbc33 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] HCTL ('34', '-', '-', 0) found on session 18 with lun 0 {{(pid=73449) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-0b386429-b788-46e8-845f-b5c0d2adbc33 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73449) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 11:46:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:46:04 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:46:04 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[19c890d8-a224-4ff5-820a-e9c2b284312a]: (4, ('- - 0', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:46:04 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-0b386429-b788-46e8-845f-b5c0d2adbc33 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Searching for a device in session 18 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73449) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 11:46:04 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b386429-b788-46e8-845f-b5c0d2adbc33 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XGrhlpAM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 11:46:04 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:46:04 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:46:04 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:46:05 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-0b386429-b788-46e8-845f-b5c0d2adbc33 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.662s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:46:05 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b386429-b788-46e8-845f-b5c0d2adbc33 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] <== connect_volume: return (1663ms) {'type': 'block', 'scsi_wwn': '23830653435646130', 'path': '/dev/sdc'} {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 11:46:05 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b386429-b788-46e8-845f-b5c0d2adbc33 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23830653435646130', 'path': '/dev/sdc'} {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 11:46:05 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-0b386429-b788-46e8-845f-b5c0d2adbc33 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:45:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1049115068',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1049115068',id=17,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP+u1MgbCgptDidYv18wcR/3nbMgBF04KyJdujQocUddcCZfAdpmYsBffqoFwPxl9btx5HmOLcrmmkZwWw4EsmmDOWNMZubobpCSM0EcykYa0gcYe9cSWHyIH4n+5UjBLw==',key_name='tempest-keypair-100521889',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e6a0323f43b04829a3b1e81266986cbf',ramdisk_id='',reservation_id='r-syt2v71c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1991725074',owner_user_name='tempest-ServerActionsV293TestJSON-1991725074-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T11:45:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cae6f48da3304f37a5d5010f3cbd7698',uuid=e8e7d9aa-150f-424a-b3af-be149ee421c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "460de6e4-4651-4b83-93bd-fbb5db34bcfa", "address": "fa:16:3e:59:e7:ee", "network": {"id": "d4fc5f62-8de4-4df1-9e12-0f192a793f5f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1016129651-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a0323f43b04829a3b1e81266986cbf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap460de6e4-46", "ovs_interfaceid": "460de6e4-4651-4b83-93bd-fbb5db34bcfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73449) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 11:46:05 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-0b386429-b788-46e8-845f-b5c0d2adbc33 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Converting VIF {"id": "460de6e4-4651-4b83-93bd-fbb5db34bcfa", "address": "fa:16:3e:59:e7:ee", "network": {"id": "d4fc5f62-8de4-4df1-9e12-0f192a793f5f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1016129651-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a0323f43b04829a3b1e81266986cbf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap460de6e4-46", "ovs_interfaceid": "460de6e4-4651-4b83-93bd-fbb5db34bcfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:46:05 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-0b386429-b788-46e8-845f-b5c0d2adbc33 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:e7:ee,bridge_name='br-int',has_traffic_filtering=True,id=460de6e4-4651-4b83-93bd-fbb5db34bcfa,network=Network(d4fc5f62-8de4-4df1-9e12-0f192a793f5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap460de6e4-46') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:46:05 user nova-compute[73449]: DEBUG nova.objects.instance [None req-0b386429-b788-46e8-845f-b5c0d2adbc33 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Lazy-loading 'pci_devices' on Instance uuid e8e7d9aa-150f-424a-b3af-be149ee421c3 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:46:05 user nova-compute[73449]: DEBUG nova.network.neutron [req-6ba2d84f-ab88-47c0-aaf1-adf9d0d69e94 req-9dde6aa1-904e-419c-a787-ad295ca84c39 service nova] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Updated VIF entry in instance network info cache for port 2a0eb61f-9398-4db6-9ae0-f142ad2e60c4. {{(pid=73449) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 11:46:05 user nova-compute[73449]: DEBUG nova.network.neutron [req-6ba2d84f-ab88-47c0-aaf1-adf9d0d69e94 req-9dde6aa1-904e-419c-a787-ad295ca84c39 service nova] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Updating instance_info_cache with network_info: [{"id": "2a0eb61f-9398-4db6-9ae0-f142ad2e60c4", "address": "fa:16:3e:15:cd:09", "network": {"id": "d54a402f-1fa9-43d8-b68e-0aa7ae6f0e73", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1441085328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eed9899860d4e7ca8a4500bbda4be13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a0eb61f-93", "ovs_interfaceid": "2a0eb61f-9398-4db6-9ae0-f142ad2e60c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:46:05 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-0b386429-b788-46e8-845f-b5c0d2adbc33 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] End _get_guest_xml xml=<domain type="kvm">
Aug 17 11:46:05 user nova-compute[73449]:   <uuid>e8e7d9aa-150f-424a-b3af-be149ee421c3</uuid>
Aug 17 11:46:05 user nova-compute[73449]:   <name>instance-00000011</name>
Aug 17 11:46:05 user nova-compute[73449]:   <memory>524288</memory>
Aug 17 11:46:05 user nova-compute[73449]:   <vcpu>1</vcpu>
Aug 17 11:46:05 user nova-compute[73449]:   <metadata>
Aug 17 11:46:05 user nova-compute[73449]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 11:46:05 user nova-compute[73449]:       <nova:package version="0.0.0"/>
Aug 17 11:46:05 user nova-compute[73449]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1049115068</nova:name>
Aug 17 11:46:05 user nova-compute[73449]:       <nova:creationTime>2023-08-17 11:46:03</nova:creationTime>
Aug 17 11:46:05 user nova-compute[73449]:       <nova:flavor name="m1.tiny">
Aug 17 11:46:05 user nova-compute[73449]:         <nova:memory>512</nova:memory>
Aug 17 11:46:05 user nova-compute[73449]:         <nova:disk>1</nova:disk>
Aug 17 11:46:05 user nova-compute[73449]:         <nova:swap>0</nova:swap>
Aug 17 11:46:05 user nova-compute[73449]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 11:46:05 user nova-compute[73449]:         <nova:vcpus>1</nova:vcpus>
Aug 17 11:46:05 user nova-compute[73449]:       </nova:flavor>
Aug 17 11:46:05 user nova-compute[73449]:       <nova:owner>
Aug 17 11:46:05 user nova-compute[73449]:         <nova:user uuid="cae6f48da3304f37a5d5010f3cbd7698">tempest-ServerActionsV293TestJSON-1991725074-project-member</nova:user>
Aug 17 11:46:05 user nova-compute[73449]:         <nova:project uuid="e6a0323f43b04829a3b1e81266986cbf">tempest-ServerActionsV293TestJSON-1991725074</nova:project>
Aug 17 11:46:05 user nova-compute[73449]:       </nova:owner>
Aug 17 11:46:05 user nova-compute[73449]:       <nova:ports>
Aug 17 11:46:05 user nova-compute[73449]:         <nova:port uuid="460de6e4-4651-4b83-93bd-fbb5db34bcfa">
Aug 17 11:46:05 user nova-compute[73449]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 17 11:46:05 user nova-compute[73449]:         </nova:port>
Aug 17 11:46:05 user nova-compute[73449]:       </nova:ports>
Aug 17 11:46:05 user nova-compute[73449]:     </nova:instance>
Aug 17 11:46:05 user nova-compute[73449]:   </metadata>
Aug 17 11:46:05 user nova-compute[73449]:   <sysinfo type="smbios">
Aug 17 11:46:05 user nova-compute[73449]:     <system>
Aug 17 11:46:05 user nova-compute[73449]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 11:46:05 user nova-compute[73449]:       <entry name="product">OpenStack Nova</entry>
Aug 17 11:46:05 user nova-compute[73449]:       <entry name="version">0.0.0</entry>
Aug 17 11:46:05 user nova-compute[73449]:       <entry name="serial">e8e7d9aa-150f-424a-b3af-be149ee421c3</entry>
Aug 17 11:46:05 user nova-compute[73449]:       <entry name="uuid">e8e7d9aa-150f-424a-b3af-be149ee421c3</entry>
Aug 17 11:46:05 user nova-compute[73449]:       <entry name="family">Virtual Machine</entry>
Aug 17 11:46:05 user nova-compute[73449]:     </system>
Aug 17 11:46:05 user nova-compute[73449]:   </sysinfo>
Aug 17 11:46:05 user nova-compute[73449]:   <os>
Aug 17 11:46:05 user nova-compute[73449]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 11:46:05 user nova-compute[73449]:     <boot dev="hd"/>
Aug 17 11:46:05 user nova-compute[73449]:     <smbios mode="sysinfo"/>
Aug 17 11:46:05 user nova-compute[73449]:   </os>
Aug 17 11:46:05 user nova-compute[73449]:   <features>
Aug 17 11:46:05 user nova-compute[73449]:     <acpi/>
Aug 17 11:46:05 user nova-compute[73449]:     <apic/>
Aug 17 11:46:05 user nova-compute[73449]:     <vmcoreinfo/>
Aug 17 11:46:05 user nova-compute[73449]:   </features>
Aug 17 11:46:05 user nova-compute[73449]:   <clock offset="utc">
Aug 17 11:46:05 user nova-compute[73449]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 11:46:05 user nova-compute[73449]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 11:46:05 user nova-compute[73449]:     <timer name="hpet" present="no"/>
Aug 17 11:46:05 user nova-compute[73449]:   </clock>
Aug 17 11:46:05 user nova-compute[73449]:   <cpu mode="custom" match="exact">
Aug 17 11:46:05 user nova-compute[73449]:     <model>Nehalem</model>
Aug 17 11:46:05 user nova-compute[73449]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 11:46:05 user nova-compute[73449]:   </cpu>
Aug 17 11:46:05 user nova-compute[73449]:   <devices>
Aug 17 11:46:05 user nova-compute[73449]:     <disk type="block" device="disk">
Aug 17 11:46:05 user nova-compute[73449]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 11:46:05 user nova-compute[73449]:       <source dev="/dev/sdc"/>
Aug 17 11:46:05 user nova-compute[73449]:       <target dev="vda" bus="virtio"/>
Aug 17 11:46:05 user nova-compute[73449]:       <serial>71f6919a-6a55-4d8f-ae84-7bb40d59f4ed</serial>
Aug 17 11:46:05 user nova-compute[73449]:     </disk>
Aug 17 11:46:05 user nova-compute[73449]:     <interface type="ethernet">
Aug 17 11:46:05 user nova-compute[73449]:       <mac address="fa:16:3e:59:e7:ee"/>
Aug 17 11:46:05 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 11:46:05 user nova-compute[73449]:       <mtu size="1442"/>
Aug 17 11:46:05 user nova-compute[73449]:       <target dev="tap460de6e4-46"/>
Aug 17 11:46:05 user nova-compute[73449]:     </interface>
Aug 17 11:46:05 user nova-compute[73449]:     <serial type="pty">
Aug 17 11:46:05 user nova-compute[73449]:       <log file="/opt/stack/data/nova/instances/e8e7d9aa-150f-424a-b3af-be149ee421c3/console.log" append="off"/>
Aug 17 11:46:05 user nova-compute[73449]:     </serial>
Aug 17 11:46:05 user nova-compute[73449]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 11:46:05 user nova-compute[73449]:     <video>
Aug 17 11:46:05 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 11:46:05 user nova-compute[73449]:     </video>
Aug 17 11:46:05 user nova-compute[73449]:     <rng model="virtio">
Aug 17 11:46:05 user nova-compute[73449]:       <backend model="random">/dev/urandom</backend>
Aug 17 11:46:05 user nova-compute[73449]:     </rng>
Aug 17 11:46:05 user nova-compute[73449]:     <controller type="usb" index="0" model="none"/>
Aug 17 11:46:05 user nova-compute[73449]:     <memballoon model="virtio">
Aug 17 11:46:05 user nova-compute[73449]:       <stats period="10"/>
Aug 17 11:46:05 user nova-compute[73449]:     </memballoon>
Aug 17 11:46:05 user nova-compute[73449]:   </devices>
Aug 17 11:46:05 user nova-compute[73449]: </domain>
Aug 17 11:46:05 user nova-compute[73449]:  {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 11:46:05 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-0b386429-b788-46e8-845f-b5c0d2adbc33 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:45:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1049115068',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1049115068',id=17,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP+u1MgbCgptDidYv18wcR/3nbMgBF04KyJdujQocUddcCZfAdpmYsBffqoFwPxl9btx5HmOLcrmmkZwWw4EsmmDOWNMZubobpCSM0EcykYa0gcYe9cSWHyIH4n+5UjBLw==',key_name='tempest-keypair-100521889',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e6a0323f43b04829a3b1e81266986cbf',ramdisk_id='',reservation_id='r-syt2v71c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1991725074',owner_user_name='tempest-ServerActionsV293TestJSON-1991725074-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T11:45:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cae6f48da3304f37a5d5010f3cbd7698',uuid=e8e7d9aa-150f-424a-b3af-be149ee421c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "460de6e4-4651-4b83-93bd-fbb5db34bcfa", "address": "fa:16:3e:59:e7:ee", "network": {"id": "d4fc5f62-8de4-4df1-9e12-0f192a793f5f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1016129651-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a0323f43b04829a3b1e81266986cbf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap460de6e4-46", "ovs_interfaceid": "460de6e4-4651-4b83-93bd-fbb5db34bcfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 11:46:05 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-0b386429-b788-46e8-845f-b5c0d2adbc33 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Converting VIF {"id": "460de6e4-4651-4b83-93bd-fbb5db34bcfa", "address": "fa:16:3e:59:e7:ee", "network": {"id": "d4fc5f62-8de4-4df1-9e12-0f192a793f5f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1016129651-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a0323f43b04829a3b1e81266986cbf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap460de6e4-46", "ovs_interfaceid": "460de6e4-4651-4b83-93bd-fbb5db34bcfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:46:05 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-0b386429-b788-46e8-845f-b5c0d2adbc33 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:e7:ee,bridge_name='br-int',has_traffic_filtering=True,id=460de6e4-4651-4b83-93bd-fbb5db34bcfa,network=Network(d4fc5f62-8de4-4df1-9e12-0f192a793f5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap460de6e4-46') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:46:05 user nova-compute[73449]: DEBUG os_vif [None req-0b386429-b788-46e8-845f-b5c0d2adbc33 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:e7:ee,bridge_name='br-int',has_traffic_filtering=True,id=460de6e4-4651-4b83-93bd-fbb5db34bcfa,network=Network(d4fc5f62-8de4-4df1-9e12-0f192a793f5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap460de6e4-46') {{(pid=73449) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 11:46:05 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:46:05 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:46:05 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 11:46:05 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-6ba2d84f-ab88-47c0-aaf1-adf9d0d69e94 req-9dde6aa1-904e-419c-a787-ad295ca84c39 service nova] Releasing lock "refresh_cache-a3523d22-7165-46ad-be10-5e6ae374f91d" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:46:05 user nova-compute[73449]: DEBUG nova.compute.manager [req-6ba2d84f-ab88-47c0-aaf1-adf9d0d69e94 req-9dde6aa1-904e-419c-a787-ad295ca84c39 service nova] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Received event network-changed-2a0eb61f-9398-4db6-9ae0-f142ad2e60c4 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:46:05 user nova-compute[73449]: DEBUG nova.compute.manager [req-6ba2d84f-ab88-47c0-aaf1-adf9d0d69e94 req-9dde6aa1-904e-419c-a787-ad295ca84c39 service nova] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Refreshing instance network info cache due to event network-changed-2a0eb61f-9398-4db6-9ae0-f142ad2e60c4. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 11:46:05 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-6ba2d84f-ab88-47c0-aaf1-adf9d0d69e94 req-9dde6aa1-904e-419c-a787-ad295ca84c39 service nova] Acquiring lock "refresh_cache-a3523d22-7165-46ad-be10-5e6ae374f91d" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:46:05 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-6ba2d84f-ab88-47c0-aaf1-adf9d0d69e94 req-9dde6aa1-904e-419c-a787-ad295ca84c39 service nova] Acquired lock "refresh_cache-a3523d22-7165-46ad-be10-5e6ae374f91d" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:46:05 user nova-compute[73449]: DEBUG nova.network.neutron [req-6ba2d84f-ab88-47c0-aaf1-adf9d0d69e94 req-9dde6aa1-904e-419c-a787-ad295ca84c39 service nova] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Refreshing network info cache for port 2a0eb61f-9398-4db6-9ae0-f142ad2e60c4 {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 11:46:05 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:46:05 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap460de6e4-46, may_exist=True, interface_attrs={}) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:46:05 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap460de6e4-46, col_values=(('external_ids', {'iface-id': '460de6e4-4651-4b83-93bd-fbb5db34bcfa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:59:e7:ee', 'vm-uuid': 'e8e7d9aa-150f-424a-b3af-be149ee421c3'}),), if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:46:05 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:46:05 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:46:05 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:46:05 user nova-compute[73449]: INFO os_vif [None req-0b386429-b788-46e8-845f-b5c0d2adbc33 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:e7:ee,bridge_name='br-int',has_traffic_filtering=True,id=460de6e4-4651-4b83-93bd-fbb5db34bcfa,network=Network(d4fc5f62-8de4-4df1-9e12-0f192a793f5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap460de6e4-46')
Aug 17 11:46:05 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-0b386429-b788-46e8-845f-b5c0d2adbc33 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] No BDM found with device name vda, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 11:46:05 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-0b386429-b788-46e8-845f-b5c0d2adbc33 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] No VIF found with MAC fa:16:3e:59:e7:ee, not building metadata {{(pid=73449) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 11:46:05 user nova-compute[73449]: DEBUG nova.compute.manager [req-c53125c3-9f66-4a7d-88b2-a6a1566d2870 req-02b97a90-7788-43b8-b2c8-383c9182927f service nova] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Received event network-vif-plugged-2a0eb61f-9398-4db6-9ae0-f142ad2e60c4 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:46:05 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-c53125c3-9f66-4a7d-88b2-a6a1566d2870 req-02b97a90-7788-43b8-b2c8-383c9182927f service nova] Acquiring lock "a3523d22-7165-46ad-be10-5e6ae374f91d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:46:05 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-c53125c3-9f66-4a7d-88b2-a6a1566d2870 req-02b97a90-7788-43b8-b2c8-383c9182927f service nova] Lock "a3523d22-7165-46ad-be10-5e6ae374f91d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:46:05 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-c53125c3-9f66-4a7d-88b2-a6a1566d2870 req-02b97a90-7788-43b8-b2c8-383c9182927f service nova] Lock "a3523d22-7165-46ad-be10-5e6ae374f91d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:46:05 user nova-compute[73449]: DEBUG nova.compute.manager [req-c53125c3-9f66-4a7d-88b2-a6a1566d2870 req-02b97a90-7788-43b8-b2c8-383c9182927f service nova] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] No waiting events found dispatching network-vif-plugged-2a0eb61f-9398-4db6-9ae0-f142ad2e60c4 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:46:05 user nova-compute[73449]: WARNING nova.compute.manager [req-c53125c3-9f66-4a7d-88b2-a6a1566d2870 req-02b97a90-7788-43b8-b2c8-383c9182927f service nova] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Received unexpected event network-vif-plugged-2a0eb61f-9398-4db6-9ae0-f142ad2e60c4 for instance with vm_state rescued and task_state unrescuing.
Aug 17 11:46:05 user nova-compute[73449]: DEBUG nova.compute.manager [req-c53125c3-9f66-4a7d-88b2-a6a1566d2870 req-02b97a90-7788-43b8-b2c8-383c9182927f service nova] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Received event network-vif-plugged-2a0eb61f-9398-4db6-9ae0-f142ad2e60c4 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:46:05 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-c53125c3-9f66-4a7d-88b2-a6a1566d2870 req-02b97a90-7788-43b8-b2c8-383c9182927f service nova] Acquiring lock "a3523d22-7165-46ad-be10-5e6ae374f91d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:46:05 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-c53125c3-9f66-4a7d-88b2-a6a1566d2870 req-02b97a90-7788-43b8-b2c8-383c9182927f service nova] Lock "a3523d22-7165-46ad-be10-5e6ae374f91d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:46:05 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-c53125c3-9f66-4a7d-88b2-a6a1566d2870 req-02b97a90-7788-43b8-b2c8-383c9182927f service nova] Lock "a3523d22-7165-46ad-be10-5e6ae374f91d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:46:05 user nova-compute[73449]: DEBUG nova.compute.manager [req-c53125c3-9f66-4a7d-88b2-a6a1566d2870 req-02b97a90-7788-43b8-b2c8-383c9182927f service nova] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] No waiting events found dispatching network-vif-plugged-2a0eb61f-9398-4db6-9ae0-f142ad2e60c4 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:46:05 user nova-compute[73449]: WARNING nova.compute.manager [req-c53125c3-9f66-4a7d-88b2-a6a1566d2870 req-02b97a90-7788-43b8-b2c8-383c9182927f service nova] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Received unexpected event network-vif-plugged-2a0eb61f-9398-4db6-9ae0-f142ad2e60c4 for instance with vm_state rescued and task_state unrescuing.
Aug 17 11:46:06 user nova-compute[73449]: DEBUG nova.network.neutron [req-6ba2d84f-ab88-47c0-aaf1-adf9d0d69e94 req-9dde6aa1-904e-419c-a787-ad295ca84c39 service nova] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Updated VIF entry in instance network info cache for port 2a0eb61f-9398-4db6-9ae0-f142ad2e60c4. {{(pid=73449) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 11:46:06 user nova-compute[73449]: DEBUG nova.network.neutron [req-6ba2d84f-ab88-47c0-aaf1-adf9d0d69e94 req-9dde6aa1-904e-419c-a787-ad295ca84c39 service nova] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Updating instance_info_cache with network_info: [{"id": "2a0eb61f-9398-4db6-9ae0-f142ad2e60c4", "address": "fa:16:3e:15:cd:09", "network": {"id": "d54a402f-1fa9-43d8-b68e-0aa7ae6f0e73", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1441085328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eed9899860d4e7ca8a4500bbda4be13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a0eb61f-93", "ovs_interfaceid": "2a0eb61f-9398-4db6-9ae0-f142ad2e60c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:46:06 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-6ba2d84f-ab88-47c0-aaf1-adf9d0d69e94 req-9dde6aa1-904e-419c-a787-ad295ca84c39 service nova] Releasing lock "refresh_cache-a3523d22-7165-46ad-be10-5e6ae374f91d" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:46:06 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:46:06 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:46:06 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:46:06 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Removed pending event for a3523d22-7165-46ad-be10-5e6ae374f91d due to event {{(pid=73449) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 17 11:46:06 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692272766.749468, a3523d22-7165-46ad-be10-5e6ae374f91d => Resumed> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:46:06 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] VM Resumed (Lifecycle Event)
Aug 17 11:46:06 user nova-compute[73449]: DEBUG nova.compute.manager [None req-2ee01c43-3d23-46f4-af23-6785a3727a3f tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:46:06 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:46:06 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 11:46:06 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 17 11:46:06 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692272766.7506251, a3523d22-7165-46ad-be10-5e6ae374f91d => Started> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:46:06 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] VM Started (Lifecycle Event)
Aug 17 11:46:06 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:46:06 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 11:46:07 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:46:07 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:46:07 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:46:07 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:46:08 user nova-compute[73449]: DEBUG nova.compute.manager [req-81ff4738-96fc-47a1-8381-4208c25c42b7 req-c87ddff1-75ca-42f8-82fd-b19b7c4d3c83 service nova] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] Received event network-vif-plugged-460de6e4-4651-4b83-93bd-fbb5db34bcfa {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:46:08 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-81ff4738-96fc-47a1-8381-4208c25c42b7 req-c87ddff1-75ca-42f8-82fd-b19b7c4d3c83 service nova] Acquiring lock "e8e7d9aa-150f-424a-b3af-be149ee421c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:46:08 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-81ff4738-96fc-47a1-8381-4208c25c42b7 req-c87ddff1-75ca-42f8-82fd-b19b7c4d3c83 service nova] Lock "e8e7d9aa-150f-424a-b3af-be149ee421c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:46:08 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-81ff4738-96fc-47a1-8381-4208c25c42b7 req-c87ddff1-75ca-42f8-82fd-b19b7c4d3c83 service nova] Lock "e8e7d9aa-150f-424a-b3af-be149ee421c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:46:08 user nova-compute[73449]: DEBUG nova.compute.manager [req-81ff4738-96fc-47a1-8381-4208c25c42b7 req-c87ddff1-75ca-42f8-82fd-b19b7c4d3c83 service nova] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] No waiting events found dispatching network-vif-plugged-460de6e4-4651-4b83-93bd-fbb5db34bcfa {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:46:08 user nova-compute[73449]: WARNING nova.compute.manager [req-81ff4738-96fc-47a1-8381-4208c25c42b7 req-c87ddff1-75ca-42f8-82fd-b19b7c4d3c83 service nova] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] Received unexpected event network-vif-plugged-460de6e4-4651-4b83-93bd-fbb5db34bcfa for instance with vm_state building and task_state spawning.
Aug 17 11:46:08 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:46:09 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692272769.6648033, e8e7d9aa-150f-424a-b3af-be149ee421c3 => Resumed> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:46:09 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] VM Resumed (Lifecycle Event)
Aug 17 11:46:09 user nova-compute[73449]: DEBUG nova.compute.manager [None req-0b386429-b788-46e8-845f-b5c0d2adbc33 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] Instance event wait completed in 0 seconds for  {{(pid=73449) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 11:46:09 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-0b386429-b788-46e8-845f-b5c0d2adbc33 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] Guest created on hypervisor {{(pid=73449) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 11:46:09 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] Instance spawned successfully.
Aug 17 11:46:09 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-0b386429-b788-46e8-845f-b5c0d2adbc33 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 11:46:09 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:46:09 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 11:46:09 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-0b386429-b788-46e8-845f-b5c0d2adbc33 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] Found default for hw_cdrom_bus of ide {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:46:09 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-0b386429-b788-46e8-845f-b5c0d2adbc33 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] Found default for hw_disk_bus of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:46:09 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-0b386429-b788-46e8-845f-b5c0d2adbc33 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] Found default for hw_input_bus of None {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:46:09 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-0b386429-b788-46e8-845f-b5c0d2adbc33 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] Found default for hw_pointer_model of None {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:46:09 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-0b386429-b788-46e8-845f-b5c0d2adbc33 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] Found default for hw_video_model of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:46:09 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-0b386429-b788-46e8-845f-b5c0d2adbc33 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] Found default for hw_vif_model of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:46:09 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 11:46:09 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692272769.669731, e8e7d9aa-150f-424a-b3af-be149ee421c3 => Started> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:46:09 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] VM Started (Lifecycle Event)
Aug 17 11:46:09 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:46:09 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 11:46:09 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 11:46:09 user nova-compute[73449]: INFO nova.compute.manager [None req-0b386429-b788-46e8-845f-b5c0d2adbc33 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] Took 6.64 seconds to spawn the instance on the hypervisor.
Aug 17 11:46:09 user nova-compute[73449]: DEBUG nova.compute.manager [None req-0b386429-b788-46e8-845f-b5c0d2adbc33 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:46:09 user nova-compute[73449]: INFO nova.compute.manager [None req-0b386429-b788-46e8-845f-b5c0d2adbc33 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] Took 36.36 seconds to build instance.
Aug 17 11:46:10 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:46:10 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-0b386429-b788-46e8-845f-b5c0d2adbc33 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Lock "e8e7d9aa-150f-424a-b3af-be149ee421c3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 36.729s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:46:10 user nova-compute[73449]: DEBUG nova.compute.manager [req-73a4122a-a005-4fb2-88f5-f25c0d5bf7a7 req-4ca02f59-23c7-4fb6-ba01-e382837c18b3 service nova] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] Received event network-vif-plugged-460de6e4-4651-4b83-93bd-fbb5db34bcfa {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:46:10 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-73a4122a-a005-4fb2-88f5-f25c0d5bf7a7 req-4ca02f59-23c7-4fb6-ba01-e382837c18b3 service nova] Acquiring lock "e8e7d9aa-150f-424a-b3af-be149ee421c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:46:10 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-73a4122a-a005-4fb2-88f5-f25c0d5bf7a7 req-4ca02f59-23c7-4fb6-ba01-e382837c18b3 service nova] Lock "e8e7d9aa-150f-424a-b3af-be149ee421c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:46:10 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-73a4122a-a005-4fb2-88f5-f25c0d5bf7a7 req-4ca02f59-23c7-4fb6-ba01-e382837c18b3 service nova] Lock "e8e7d9aa-150f-424a-b3af-be149ee421c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:46:10 user nova-compute[73449]: DEBUG nova.compute.manager [req-73a4122a-a005-4fb2-88f5-f25c0d5bf7a7 req-4ca02f59-23c7-4fb6-ba01-e382837c18b3 service nova] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] No waiting events found dispatching network-vif-plugged-460de6e4-4651-4b83-93bd-fbb5db34bcfa {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:46:10 user nova-compute[73449]: WARNING nova.compute.manager [req-73a4122a-a005-4fb2-88f5-f25c0d5bf7a7 req-4ca02f59-23c7-4fb6-ba01-e382837c18b3 service nova] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] Received unexpected event network-vif-plugged-460de6e4-4651-4b83-93bd-fbb5db34bcfa for instance with vm_state active and task_state None.
Aug 17 11:46:11 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:46:12 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:46:12 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:46:13 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:46:13 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-83827b4f-b04e-4894-a543-094d88dd7c8c tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Acquiring lock "848599ce-8cf5-4116-b1d6-4cf9d79cfbc0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:46:13 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-83827b4f-b04e-4894-a543-094d88dd7c8c tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Lock "848599ce-8cf5-4116-b1d6-4cf9d79cfbc0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:46:13 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-83827b4f-b04e-4894-a543-094d88dd7c8c tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Acquiring lock "848599ce-8cf5-4116-b1d6-4cf9d79cfbc0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:46:13 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-83827b4f-b04e-4894-a543-094d88dd7c8c tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Lock "848599ce-8cf5-4116-b1d6-4cf9d79cfbc0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:46:13 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-83827b4f-b04e-4894-a543-094d88dd7c8c tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Lock "848599ce-8cf5-4116-b1d6-4cf9d79cfbc0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:46:13 user nova-compute[73449]: INFO nova.compute.manager [None req-83827b4f-b04e-4894-a543-094d88dd7c8c tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] [instance: 848599ce-8cf5-4116-b1d6-4cf9d79cfbc0] Terminating instance
Aug 17 11:46:13 user nova-compute[73449]: DEBUG nova.compute.manager [None req-83827b4f-b04e-4894-a543-094d88dd7c8c tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] [instance: 848599ce-8cf5-4116-b1d6-4cf9d79cfbc0] Start destroying the instance on the hypervisor. {{(pid=73449) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 11:46:13 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:46:13 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:46:13 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:46:13 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:46:13 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:46:14 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:46:14 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: 848599ce-8cf5-4116-b1d6-4cf9d79cfbc0] Instance destroyed successfully.
Aug 17 11:46:14 user nova-compute[73449]: DEBUG nova.objects.instance [None req-83827b4f-b04e-4894-a543-094d88dd7c8c tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Lazy-loading 'resources' on Instance uuid 848599ce-8cf5-4116-b1d6-4cf9d79cfbc0 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:46:14 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-83827b4f-b04e-4894-a543-094d88dd7c8c tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:44:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-26898897',display_name='tempest-VolumesActionsTest-instance-26898897',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-26898897',id=13,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T11:44:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='54b447696c4a49e5838ae21456bc60e3',ramdisk_id='',reservation_id='r-yh18a1ak',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-407682915',owner_user_name='tempest-VolumesActionsTest-407682915-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T11:44:31Z,user_data=None,user_id='652d1ea975dc454aa4c72d74ddd8af68',uuid=848599ce-8cf5-4116-b1d6-4cf9d79cfbc0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c380d879-a174-4b76-bb8a-4ba6f215ce47", "address": "fa:16:3e:b0:74:52", "network": {"id": "76705db8-2e7f-449c-b512-6747bad0c324", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1601912422-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54b447696c4a49e5838ae21456bc60e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc380d879-a1", "ovs_interfaceid": "c380d879-a174-4b76-bb8a-4ba6f215ce47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 11:46:14 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-83827b4f-b04e-4894-a543-094d88dd7c8c tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Converting VIF {"id": "c380d879-a174-4b76-bb8a-4ba6f215ce47", "address": "fa:16:3e:b0:74:52", "network": {"id": "76705db8-2e7f-449c-b512-6747bad0c324", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1601912422-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54b447696c4a49e5838ae21456bc60e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc380d879-a1", "ovs_interfaceid": "c380d879-a174-4b76-bb8a-4ba6f215ce47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:46:14 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-83827b4f-b04e-4894-a543-094d88dd7c8c tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:74:52,bridge_name='br-int',has_traffic_filtering=True,id=c380d879-a174-4b76-bb8a-4ba6f215ce47,network=Network(76705db8-2e7f-449c-b512-6747bad0c324),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc380d879-a1') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:46:14 user nova-compute[73449]: DEBUG os_vif [None req-83827b4f-b04e-4894-a543-094d88dd7c8c tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:74:52,bridge_name='br-int',has_traffic_filtering=True,id=c380d879-a174-4b76-bb8a-4ba6f215ce47,network=Network(76705db8-2e7f-449c-b512-6747bad0c324),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc380d879-a1') {{(pid=73449) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 11:46:14 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:46:14 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc380d879-a1, bridge=br-int, if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:46:14 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:46:14 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:46:14 user nova-compute[73449]: INFO os_vif [None req-83827b4f-b04e-4894-a543-094d88dd7c8c tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:74:52,bridge_name='br-int',has_traffic_filtering=True,id=c380d879-a174-4b76-bb8a-4ba6f215ce47,network=Network(76705db8-2e7f-449c-b512-6747bad0c324),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc380d879-a1')
Aug 17 11:46:14 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-83827b4f-b04e-4894-a543-094d88dd7c8c tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] [instance: 848599ce-8cf5-4116-b1d6-4cf9d79cfbc0] Deleting instance files /opt/stack/data/nova/instances/848599ce-8cf5-4116-b1d6-4cf9d79cfbc0_del
Aug 17 11:46:14 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-83827b4f-b04e-4894-a543-094d88dd7c8c tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] [instance: 848599ce-8cf5-4116-b1d6-4cf9d79cfbc0] Deletion of /opt/stack/data/nova/instances/848599ce-8cf5-4116-b1d6-4cf9d79cfbc0_del complete
Aug 17 11:46:14 user nova-compute[73449]: INFO nova.compute.manager [None req-83827b4f-b04e-4894-a543-094d88dd7c8c tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] [instance: 848599ce-8cf5-4116-b1d6-4cf9d79cfbc0] Took 1.09 seconds to destroy the instance on the hypervisor.
Aug 17 11:46:14 user nova-compute[73449]: DEBUG oslo.service.loopingcall [None req-83827b4f-b04e-4894-a543-094d88dd7c8c tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73449) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 11:46:14 user nova-compute[73449]: DEBUG nova.compute.manager [-] [instance: 848599ce-8cf5-4116-b1d6-4cf9d79cfbc0] Deallocating network for instance {{(pid=73449) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 11:46:14 user nova-compute[73449]: DEBUG nova.network.neutron [-] [instance: 848599ce-8cf5-4116-b1d6-4cf9d79cfbc0] deallocate_for_instance() {{(pid=73449) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 11:46:16 user nova-compute[73449]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692272761.0942285, f35b7f2b-2f88-4b09-86ac-cb5a78a94584 => Stopped> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:46:16 user nova-compute[73449]: INFO nova.compute.manager [-] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] VM Stopped (Lifecycle Event)
Aug 17 11:46:16 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6f52a23a-a280-44e8-a780-970e22a07cb2 None None] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:46:16 user nova-compute[73449]: DEBUG nova.network.neutron [-] [instance: 848599ce-8cf5-4116-b1d6-4cf9d79cfbc0] Updating instance_info_cache with network_info: [] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:46:16 user nova-compute[73449]: INFO nova.compute.manager [-] [instance: 848599ce-8cf5-4116-b1d6-4cf9d79cfbc0] Took 1.80 seconds to deallocate network for instance.
Aug 17 11:46:16 user nova-compute[73449]: DEBUG nova.compute.manager [req-02eb7201-e9b6-47c4-8c14-5fd878a8970d req-2feec08a-9a50-4a5d-90f4-c96ee01a3614 service nova] [instance: 848599ce-8cf5-4116-b1d6-4cf9d79cfbc0] Received event network-vif-deleted-c380d879-a174-4b76-bb8a-4ba6f215ce47 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:46:16 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-83827b4f-b04e-4894-a543-094d88dd7c8c tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:46:16 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-83827b4f-b04e-4894-a543-094d88dd7c8c tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:46:17 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-83827b4f-b04e-4894-a543-094d88dd7c8c tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 11:46:17 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-83827b4f-b04e-4894-a543-094d88dd7c8c tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 11:46:17 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-83827b4f-b04e-4894-a543-094d88dd7c8c tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.478s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:46:17 user nova-compute[73449]: INFO nova.scheduler.client.report [None req-83827b4f-b04e-4894-a543-094d88dd7c8c tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Deleted allocations for instance 848599ce-8cf5-4116-b1d6-4cf9d79cfbc0
Aug 17 11:46:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:46:17 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-83827b4f-b04e-4894-a543-094d88dd7c8c tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Lock "848599ce-8cf5-4116-b1d6-4cf9d79cfbc0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.638s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:46:17 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a68a5a7f-5813-4ea6-8104-a3350e100c8d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Acquiring lock "3d468854-6182-49c8-acb7-0641df2d5219" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:46:17 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a68a5a7f-5813-4ea6-8104-a3350e100c8d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Lock "3d468854-6182-49c8-acb7-0641df2d5219" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:46:17 user nova-compute[73449]: DEBUG nova.compute.manager [None req-a68a5a7f-5813-4ea6-8104-a3350e100c8d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Starting instance... {{(pid=73449) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 11:46:17 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a68a5a7f-5813-4ea6-8104-a3350e100c8d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:46:17 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a68a5a7f-5813-4ea6-8104-a3350e100c8d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:46:17 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-a68a5a7f-5813-4ea6-8104-a3350e100c8d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73449) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 11:46:17 user nova-compute[73449]: INFO nova.compute.claims [None req-a68a5a7f-5813-4ea6-8104-a3350e100c8d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Claim successful on node user
Aug 17 11:46:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:46:18 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-a68a5a7f-5813-4ea6-8104-a3350e100c8d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 11:46:18 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-a68a5a7f-5813-4ea6-8104-a3350e100c8d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 11:46:18 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a68a5a7f-5813-4ea6-8104-a3350e100c8d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.916s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:46:18 user nova-compute[73449]: DEBUG nova.compute.manager [None req-a68a5a7f-5813-4ea6-8104-a3350e100c8d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Start building networks asynchronously for instance. {{(pid=73449) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 11:46:18 user nova-compute[73449]: DEBUG nova.compute.manager [None req-a68a5a7f-5813-4ea6-8104-a3350e100c8d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Allocating IP information in the background. {{(pid=73449) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 11:46:18 user nova-compute[73449]: DEBUG nova.network.neutron [None req-a68a5a7f-5813-4ea6-8104-a3350e100c8d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] allocate_for_instance() {{(pid=73449) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 11:46:18 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-a68a5a7f-5813-4ea6-8104-a3350e100c8d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 11:46:18 user nova-compute[73449]: DEBUG nova.compute.manager [None req-a68a5a7f-5813-4ea6-8104-a3350e100c8d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Start building block device mappings for instance. {{(pid=73449) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 11:46:18 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] Creating instance directory {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 11:46:18 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] Creating image(s)
Aug 17 11:46:18 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Acquiring lock "/opt/stack/data/nova/instances/f35b7f2b-2f88-4b09-86ac-cb5a78a94584/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:46:18 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Lock "/opt/stack/data/nova/instances/f35b7f2b-2f88-4b09-86ac-cb5a78a94584/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:46:18 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Lock "/opt/stack/data/nova/instances/f35b7f2b-2f88-4b09-86ac-cb5a78a94584/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:46:18 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:46:18 user nova-compute[73449]: DEBUG nova.policy [None req-a68a5a7f-5813-4ea6-8104-a3350e100c8d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2791de1444c2428f9120cc907529cfcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6856b60c404a34b6355b5fd6dd7bb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73449) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 11:46:18 user nova-compute[73449]: DEBUG nova.compute.manager [None req-a68a5a7f-5813-4ea6-8104-a3350e100c8d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Start spawning the instance on the hypervisor. {{(pid=73449) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 11:46:18 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-a68a5a7f-5813-4ea6-8104-a3350e100c8d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Creating instance directory {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 11:46:18 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-a68a5a7f-5813-4ea6-8104-a3350e100c8d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Creating image(s)
Aug 17 11:46:18 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a68a5a7f-5813-4ea6-8104-a3350e100c8d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Acquiring lock "/opt/stack/data/nova/instances/3d468854-6182-49c8-acb7-0641df2d5219/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:46:18 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a68a5a7f-5813-4ea6-8104-a3350e100c8d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Lock "/opt/stack/data/nova/instances/3d468854-6182-49c8-acb7-0641df2d5219/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:46:18 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a68a5a7f-5813-4ea6-8104-a3350e100c8d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Lock "/opt/stack/data/nova/instances/3d468854-6182-49c8-acb7-0641df2d5219/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:46:18 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-a68a5a7f-5813-4ea6-8104-a3350e100c8d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:46:18 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json" returned: 0 in 0.233s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:46:18 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Acquiring lock "7e267a577c062ee862e95ede6b48cfd5632f3ea3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:46:18 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Lock "7e267a577c062ee862e95ede6b48cfd5632f3ea3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:46:18 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:46:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-a68a5a7f-5813-4ea6-8104-a3350e100c8d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json" returned: 0 in 0.234s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:46:19 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a68a5a7f-5813-4ea6-8104-a3350e100c8d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Acquiring lock "7e267a577c062ee862e95ede6b48cfd5632f3ea3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:46:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json" returned: 0 in 0.204s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:46:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3,backing_fmt=raw /opt/stack/data/nova/instances/f35b7f2b-2f88-4b09-86ac-cb5a78a94584/disk 1073741824 {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:46:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3,backing_fmt=raw /opt/stack/data/nova/instances/f35b7f2b-2f88-4b09-86ac-cb5a78a94584/disk 1073741824" returned: 0 in 0.062s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:46:19 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Lock "7e267a577c062ee862e95ede6b48cfd5632f3ea3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.275s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:46:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:46:19 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a68a5a7f-5813-4ea6-8104-a3350e100c8d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Lock "7e267a577c062ee862e95ede6b48cfd5632f3ea3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.232s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:46:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-a68a5a7f-5813-4ea6-8104-a3350e100c8d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:46:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json" returned: 0 in 0.193s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:46:19 user nova-compute[73449]: DEBUG nova.virt.disk.api [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f35b7f2b-2f88-4b09-86ac-cb5a78a94584/disk. size=1073741824 {{(pid=73449) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 11:46:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f35b7f2b-2f88-4b09-86ac-cb5a78a94584/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:46:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-a68a5a7f-5813-4ea6-8104-a3350e100c8d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json" returned: 0 in 0.195s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:46:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-a68a5a7f-5813-4ea6-8104-a3350e100c8d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3,backing_fmt=raw /opt/stack/data/nova/instances/3d468854-6182-49c8-acb7-0641df2d5219/disk 1073741824 {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:46:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-a68a5a7f-5813-4ea6-8104-a3350e100c8d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3,backing_fmt=raw /opt/stack/data/nova/instances/3d468854-6182-49c8-acb7-0641df2d5219/disk 1073741824" returned: 0 in 0.059s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:46:19 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a68a5a7f-5813-4ea6-8104-a3350e100c8d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Lock "7e267a577c062ee862e95ede6b48cfd5632f3ea3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.265s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:46:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-a68a5a7f-5813-4ea6-8104-a3350e100c8d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:46:19 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:46:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f35b7f2b-2f88-4b09-86ac-cb5a78a94584/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:46:19 user nova-compute[73449]: DEBUG nova.virt.disk.api [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Cannot resize image /opt/stack/data/nova/instances/f35b7f2b-2f88-4b09-86ac-cb5a78a94584/disk to a smaller size. {{(pid=73449) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 11:46:19 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] Created local disks {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 11:46:19 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] Ensure instance console log exists: /opt/stack/data/nova/instances/f35b7f2b-2f88-4b09-86ac-cb5a78a94584/console.log {{(pid=73449) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 11:46:19 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:46:19 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:46:19 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:46:19 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] Start _get_guest_xml network_info=[{"id": "e86f2a61-e64f-49ea-83ad-386755b33e00", "address": "fa:16:3e:4e:54:ff", "network": {"id": "72c50a42-688f-4868-8e19-c40b103a49cd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1792423641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "068c5270255744a18208a0ad9b35f168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape86f2a61-e6", "ovs_interfaceid": "e86f2a61-e64f-49ea-83ad-386755b33e00", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T11:36:11Z,direct_url=<?>,disk_format='qcow2',id=0a2904ae-083d-41c8-83db-343132b36148,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7a77880136a54ef195c82e018e1939db',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T11:36:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': '0a2904ae-083d-41c8-83db-343132b36148'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'attachment_id': 'f037353a-2366-4578-b7da-dc731576d346', 'boot_index': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sIVNXdDt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f35b7f2b-2f88-4b09-86ac-cb5a78a94584', 'attached_at': '', 'detached_at': '', 'volume_id': '0254b152-714d-470d-bfac-2bb7b2761466', 'serial': '0254b152-714d-470d-bfac-2bb7b2761466'}, 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 11:46:19 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 17 11:46:19 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 17 11:46:19 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 11:46:19 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] CPU controller missing on host. {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 11:46:19 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 11:46:19 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] CPU controller found on host. {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 11:46:19 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73449) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 11:46:19 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T11:35:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T11:36:11Z,direct_url=<?>,disk_format='qcow2',id=0a2904ae-083d-41c8-83db-343132b36148,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7a77880136a54ef195c82e018e1939db',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T11:36:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 11:46:19 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Flavor limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 11:46:19 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Image limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 11:46:19 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Flavor pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 11:46:19 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Image pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 11:46:19 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 11:46:19 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 11:46:19 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 11:46:19 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Got 1 possible topologies {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 11:46:19 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 11:46:19 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 11:46:19 user nova-compute[73449]: DEBUG nova.objects.instance [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Lazy-loading 'vcpu_model' on Instance uuid f35b7f2b-2f88-4b09-86ac-cb5a78a94584 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:46:19 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] Calling os-brick to attach iSCSI Volume {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 11:46:19 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sIVNXdDt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 11:46:19 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 17 11:46:19 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:46:19 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:46:19 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 17 11:46:19 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:46:19 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:46:19 user nova-compute[73449]: INFO os_brick.initiator.connectors.iscsi [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 11:46:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466 -p 172.16.0.220:3260 {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:46:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-a68a5a7f-5813-4ea6-8104-a3350e100c8d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json" returned: 0 in 0.229s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:46:19 user nova-compute[73449]: DEBUG nova.virt.disk.api [None req-a68a5a7f-5813-4ea6-8104-a3350e100c8d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3d468854-6182-49c8-acb7-0641df2d5219/disk. size=1073741824 {{(pid=73449) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 11:46:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-a68a5a7f-5813-4ea6-8104-a3350e100c8d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d468854-6182-49c8-acb7-0641df2d5219/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:46:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466 -p 172.16.0.220:3260" returned: 21 in 0.028s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:46:19 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[67142ffc-3017-4234-9736-06719ec360ad]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:46:19 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 11:46:19 user nova-compute[73449]:  {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:46:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466 -p 172.16.0.220:3260 --interface default --op new {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:46:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:46:19 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a027dc2-b0a4-4986-9f76-ba5acef4262a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466] added\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:46:19 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466] added
Aug 17 11:46:19 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:46:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:46:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:46:19 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4dbeed9-49c8-4d78-b905-2afa7265313e]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:46:19 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:46:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:46:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:46:19 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e45c1c7-faef-4b65-9e70-e86351b774fe]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:46:19 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:46:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sIVNXdDt {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:46:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sIVNXdDt" returned: 0 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:46:19 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[22197a65-01e2-4af4-807e-e60d0f347212]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:46:19 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sIVNXdDt'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:46:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:46:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:46:20 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[994302ff-74fa-4dda-9d14-752084e2a8ee]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:46:20 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:46:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:46:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:46:20 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[194290ca-a0b0-41e0-80a9-c7a6162c0f81]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d22566b5-74eb-4aeb-b14c-0bd5aa9e35ee (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:46:20 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe (non-flash)
Aug 17 11:46:20 user nova-compute[73449]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d22566b5-74eb-4aeb-b14c-0bd5aa9e35ee (non-flash)
Aug 17 11:46:20 user nova-compute[73449]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed (non-flash)
Aug 17 11:46:20 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:46:20 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe (non-flash)
Aug 17 11:46:20 user nova-compute[73449]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d22566b5-74eb-4aeb-b14c-0bd5aa9e35ee (non-flash)
Aug 17 11:46:20 user nova-compute[73449]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed (non-flash)
Aug 17 11:46:20 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:46:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466 -p 172.16.0.220:3260 --login {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:46:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-a68a5a7f-5813-4ea6-8104-a3350e100c8d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d468854-6182-49c8-acb7-0641df2d5219/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:46:20 user nova-compute[73449]: DEBUG nova.virt.disk.api [None req-a68a5a7f-5813-4ea6-8104-a3350e100c8d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Cannot resize image /opt/stack/data/nova/instances/3d468854-6182-49c8-acb7-0641df2d5219/disk to a smaller size. {{(pid=73449) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 11:46:20 user nova-compute[73449]: DEBUG nova.objects.instance [None req-a68a5a7f-5813-4ea6-8104-a3350e100c8d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Lazy-loading 'migration_context' on Instance uuid 3d468854-6182-49c8-acb7-0641df2d5219 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:46:20 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-a68a5a7f-5813-4ea6-8104-a3350e100c8d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Created local disks {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 11:46:20 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-a68a5a7f-5813-4ea6-8104-a3350e100c8d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Ensure instance console log exists: /opt/stack/data/nova/instances/3d468854-6182-49c8-acb7-0641df2d5219/console.log {{(pid=73449) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 11:46:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a68a5a7f-5813-4ea6-8104-a3350e100c8d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:46:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a68a5a7f-5813-4ea6-8104-a3350e100c8d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:46:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a68a5a7f-5813-4ea6-8104-a3350e100c8d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.008s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:46:20 user nova-compute[73449]: DEBUG nova.network.neutron [None req-a68a5a7f-5813-4ea6-8104-a3350e100c8d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Successfully created port: 1ec58d7f-18a4-4ddb-a137-2b72c5221621 {{(pid=73449) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 11:46:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466 -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:46:20 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[c158446f-e933-4fda-bbc5-8c9e47ad8c7d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:46:20 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466, portal: 172.16.0.220,3260]
Aug 17 11:46:20 user nova-compute[73449]: Login to [iface: default, target: iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466, portal: 172.16.0.220,3260] successful.
Aug 17 11:46:20 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:46:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:46:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:46:20 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ee48b6a-3c88-4380-bc8b-f9a945521f2a]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:46:20 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:46:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:46:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:46:20 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d3031a6-5108-41f5-b252-48ea1eb94b3b]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d22566b5-74eb-4aeb-b14c-0bd5aa9e35ee (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466 (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:46:20 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe (non-flash)
Aug 17 11:46:20 user nova-compute[73449]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d22566b5-74eb-4aeb-b14c-0bd5aa9e35ee (non-flash)
Aug 17 11:46:20 user nova-compute[73449]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed (non-flash)
Aug 17 11:46:20 user nova-compute[73449]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466 (non-flash)
Aug 17 11:46:20 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:46:20 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe (non-flash)
Aug 17 11:46:20 user nova-compute[73449]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d22566b5-74eb-4aeb-b14c-0bd5aa9e35ee (non-flash)
Aug 17 11:46:20 user nova-compute[73449]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed (non-flash)
Aug 17 11:46:20 user nova-compute[73449]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466 (non-flash)
Aug 17 11:46:20 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:46:20 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.409s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:46:20 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Connected to 172.16.0.220:3260 {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 11:46:20 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] HCTL ('35', '-', '-', 0) found on session 19 with lun 0 {{(pid=73449) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 11:46:20 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73449) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 11:46:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:46:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.027s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:46:20 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[1623633d-0525-4d08-ae4a-d1d1f0ae7279]: (4, ('- - 0', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:46:20 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Searching for a device in session 19 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73449) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 11:46:20 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sIVNXdDt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 11:46:20 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:46:20 user nova-compute[73449]: WARNING nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] While synchronizing instance power states, found 11 instances in the database and 9 instances on the hypervisor.
Aug 17 11:46:20 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Triggering sync for uuid 4a9e8ad2-19db-4975-87e4-2efce603a7d7 {{(pid=73449) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 11:46:20 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Triggering sync for uuid a3523d22-7165-46ad-be10-5e6ae374f91d {{(pid=73449) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 11:46:20 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Triggering sync for uuid fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2 {{(pid=73449) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 11:46:20 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Triggering sync for uuid f35b7f2b-2f88-4b09-86ac-cb5a78a94584 {{(pid=73449) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 11:46:20 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Triggering sync for uuid b12d9412-be17-4908-a4c2-b80c0fa38fc0 {{(pid=73449) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 11:46:20 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Triggering sync for uuid de5084e1-5a5e-48d2-a3ef-7f29898d1d2d {{(pid=73449) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 11:46:20 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Triggering sync for uuid c69e7643-8c60-4982-986b-484e8cfc3fa9 {{(pid=73449) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 11:46:20 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Triggering sync for uuid e8e7d9aa-150f-424a-b3af-be149ee421c3 {{(pid=73449) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 11:46:20 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Triggering sync for uuid 3d74c8f6-fb4e-4460-b722-674a8a1e2d25 {{(pid=73449) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 11:46:20 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Triggering sync for uuid ae75d334-431a-4008-8b3d-f2a727d92417 {{(pid=73449) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 11:46:20 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Triggering sync for uuid 3d468854-6182-49c8-acb7-0641df2d5219 {{(pid=73449) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 11:46:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "4a9e8ad2-19db-4975-87e4-2efce603a7d7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:46:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "4a9e8ad2-19db-4975-87e4-2efce603a7d7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:46:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "a3523d22-7165-46ad-be10-5e6ae374f91d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:46:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "a3523d22-7165-46ad-be10-5e6ae374f91d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:46:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:46:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:46:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "f35b7f2b-2f88-4b09-86ac-cb5a78a94584" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:46:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "f35b7f2b-2f88-4b09-86ac-cb5a78a94584" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:46:20 user nova-compute[73449]: INFO nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 17 11:46:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "f35b7f2b-2f88-4b09-86ac-cb5a78a94584" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:46:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "b12d9412-be17-4908-a4c2-b80c0fa38fc0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:46:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "b12d9412-be17-4908-a4c2-b80c0fa38fc0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:46:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "de5084e1-5a5e-48d2-a3ef-7f29898d1d2d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:46:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "de5084e1-5a5e-48d2-a3ef-7f29898d1d2d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:46:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "c69e7643-8c60-4982-986b-484e8cfc3fa9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:46:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "c69e7643-8c60-4982-986b-484e8cfc3fa9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:46:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "e8e7d9aa-150f-424a-b3af-be149ee421c3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:46:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "e8e7d9aa-150f-424a-b3af-be149ee421c3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:46:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "3d74c8f6-fb4e-4460-b722-674a8a1e2d25" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:46:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "3d74c8f6-fb4e-4460-b722-674a8a1e2d25" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:46:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "ae75d334-431a-4008-8b3d-f2a727d92417" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:46:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "ae75d334-431a-4008-8b3d-f2a727d92417" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:46:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "3d468854-6182-49c8-acb7-0641df2d5219" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:46:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "a3523d22-7165-46ad-be10-5e6ae374f91d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.099s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:46:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "4a9e8ad2-19db-4975-87e4-2efce603a7d7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.130s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:46:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "de5084e1-5a5e-48d2-a3ef-7f29898d1d2d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.123s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:46:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "b12d9412-be17-4908-a4c2-b80c0fa38fc0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.127s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:46:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "3d74c8f6-fb4e-4460-b722-674a8a1e2d25" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.127s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:46:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "e8e7d9aa-150f-424a-b3af-be149ee421c3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.140s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:46:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.149s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:46:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "ae75d334-431a-4008-8b3d-f2a727d92417" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.163s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:46:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "c69e7643-8c60-4982-986b-484e8cfc3fa9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.166s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:46:21 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.457s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:46:21 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] <== connect_volume: return (1458ms) {'type': 'block', 'scsi_wwn': '26635613739613438', 'path': '/dev/sdd'} {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 11:46:21 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26635613739613438', 'path': '/dev/sdd'} {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 11:46:21 user nova-compute[73449]: DEBUG nova.network.neutron [None req-a68a5a7f-5813-4ea6-8104-a3350e100c8d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Successfully updated port: 1ec58d7f-18a4-4ddb-a137-2b72c5221621 {{(pid=73449) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 11:46:21 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a68a5a7f-5813-4ea6-8104-a3350e100c8d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Acquiring lock "refresh_cache-3d468854-6182-49c8-acb7-0641df2d5219" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:46:21 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a68a5a7f-5813-4ea6-8104-a3350e100c8d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Acquired lock "refresh_cache-3d468854-6182-49c8-acb7-0641df2d5219" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:46:21 user nova-compute[73449]: DEBUG nova.network.neutron [None req-a68a5a7f-5813-4ea6-8104-a3350e100c8d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Building network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 11:46:21 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T11:43:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-2119051174',display_name='tempest-ServerActionsTestOtherA-server-1113411740',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-2119051174',id=12,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBslNxfjqeXy15++V9lUN1dUPSj0u5ix1Nnljk5AjIrZhZF+tQog/IhoD1HSXnZkSrwagPwVC/Uewn/Q/J6AkryzpFNZdKWZ4r8749mZJ2bXrxgJUs51emgx4vTQbsCJiQ==',key_name='tempest-keypair-1878071127',keypairs=<?>,launch_index=0,launched_at=2023-08-17T11:43:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='068c5270255744a18208a0ad9b35f168',ramdisk_id='',reservation_id='r-raxmup83',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-303961666',owner_user_name='tempest-ServerActionsTestOtherA-303961666-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T11:46:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e44f6d8893da4d95a8ebe95180355c04',uuid=f35b7f2b-2f88-4b09-86ac-cb5a78a94584,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e86f2a61-e64f-49ea-83ad-386755b33e00", "address": "fa:16:3e:4e:54:ff", "network": {"id": "72c50a42-688f-4868-8e19-c40b103a49cd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1792423641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "068c5270255744a18208a0ad9b35f168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape86f2a61-e6", "ovs_interfaceid": "e86f2a61-e64f-49ea-83ad-386755b33e00", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73449) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 11:46:21 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Converting VIF {"id": "e86f2a61-e64f-49ea-83ad-386755b33e00", "address": "fa:16:3e:4e:54:ff", "network": {"id": "72c50a42-688f-4868-8e19-c40b103a49cd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1792423641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "068c5270255744a18208a0ad9b35f168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape86f2a61-e6", "ovs_interfaceid": "e86f2a61-e64f-49ea-83ad-386755b33e00", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:46:21 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4e:54:ff,bridge_name='br-int',has_traffic_filtering=True,id=e86f2a61-e64f-49ea-83ad-386755b33e00,network=Network(72c50a42-688f-4868-8e19-c40b103a49cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape86f2a61-e6') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:46:21 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] End _get_guest_xml xml=<domain type="kvm">
Aug 17 11:46:21 user nova-compute[73449]:   <uuid>f35b7f2b-2f88-4b09-86ac-cb5a78a94584</uuid>
Aug 17 11:46:21 user nova-compute[73449]:   <name>instance-0000000c</name>
Aug 17 11:46:21 user nova-compute[73449]:   <memory>524288</memory>
Aug 17 11:46:21 user nova-compute[73449]:   <vcpu>1</vcpu>
Aug 17 11:46:21 user nova-compute[73449]:   <metadata>
Aug 17 11:46:21 user nova-compute[73449]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 11:46:21 user nova-compute[73449]:       <nova:package version="0.0.0"/>
Aug 17 11:46:21 user nova-compute[73449]:       <nova:name>tempest-ServerActionsTestOtherA-server-1113411740</nova:name>
Aug 17 11:46:21 user nova-compute[73449]:       <nova:creationTime>2023-08-17 11:46:19</nova:creationTime>
Aug 17 11:46:21 user nova-compute[73449]:       <nova:flavor name="m1.tiny">
Aug 17 11:46:21 user nova-compute[73449]:         <nova:memory>512</nova:memory>
Aug 17 11:46:21 user nova-compute[73449]:         <nova:disk>1</nova:disk>
Aug 17 11:46:21 user nova-compute[73449]:         <nova:swap>0</nova:swap>
Aug 17 11:46:21 user nova-compute[73449]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 11:46:21 user nova-compute[73449]:         <nova:vcpus>1</nova:vcpus>
Aug 17 11:46:21 user nova-compute[73449]:       </nova:flavor>
Aug 17 11:46:21 user nova-compute[73449]:       <nova:owner>
Aug 17 11:46:21 user nova-compute[73449]:         <nova:user uuid="e44f6d8893da4d95a8ebe95180355c04">tempest-ServerActionsTestOtherA-303961666-project-member</nova:user>
Aug 17 11:46:21 user nova-compute[73449]:         <nova:project uuid="068c5270255744a18208a0ad9b35f168">tempest-ServerActionsTestOtherA-303961666</nova:project>
Aug 17 11:46:21 user nova-compute[73449]:       </nova:owner>
Aug 17 11:46:21 user nova-compute[73449]:       <nova:root type="image" uuid="0a2904ae-083d-41c8-83db-343132b36148"/>
Aug 17 11:46:21 user nova-compute[73449]:       <nova:ports>
Aug 17 11:46:21 user nova-compute[73449]:         <nova:port uuid="e86f2a61-e64f-49ea-83ad-386755b33e00">
Aug 17 11:46:21 user nova-compute[73449]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 17 11:46:21 user nova-compute[73449]:         </nova:port>
Aug 17 11:46:21 user nova-compute[73449]:       </nova:ports>
Aug 17 11:46:21 user nova-compute[73449]:     </nova:instance>
Aug 17 11:46:21 user nova-compute[73449]:   </metadata>
Aug 17 11:46:21 user nova-compute[73449]:   <sysinfo type="smbios">
Aug 17 11:46:21 user nova-compute[73449]:     <system>
Aug 17 11:46:21 user nova-compute[73449]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 11:46:21 user nova-compute[73449]:       <entry name="product">OpenStack Nova</entry>
Aug 17 11:46:21 user nova-compute[73449]:       <entry name="version">0.0.0</entry>
Aug 17 11:46:21 user nova-compute[73449]:       <entry name="serial">f35b7f2b-2f88-4b09-86ac-cb5a78a94584</entry>
Aug 17 11:46:21 user nova-compute[73449]:       <entry name="uuid">f35b7f2b-2f88-4b09-86ac-cb5a78a94584</entry>
Aug 17 11:46:21 user nova-compute[73449]:       <entry name="family">Virtual Machine</entry>
Aug 17 11:46:21 user nova-compute[73449]:     </system>
Aug 17 11:46:21 user nova-compute[73449]:   </sysinfo>
Aug 17 11:46:21 user nova-compute[73449]:   <os>
Aug 17 11:46:21 user nova-compute[73449]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 11:46:21 user nova-compute[73449]:     <boot dev="hd"/>
Aug 17 11:46:21 user nova-compute[73449]:     <smbios mode="sysinfo"/>
Aug 17 11:46:21 user nova-compute[73449]:   </os>
Aug 17 11:46:21 user nova-compute[73449]:   <features>
Aug 17 11:46:21 user nova-compute[73449]:     <acpi/>
Aug 17 11:46:21 user nova-compute[73449]:     <apic/>
Aug 17 11:46:21 user nova-compute[73449]:     <vmcoreinfo/>
Aug 17 11:46:21 user nova-compute[73449]:   </features>
Aug 17 11:46:21 user nova-compute[73449]:   <clock offset="utc">
Aug 17 11:46:21 user nova-compute[73449]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 11:46:21 user nova-compute[73449]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 11:46:21 user nova-compute[73449]:     <timer name="hpet" present="no"/>
Aug 17 11:46:21 user nova-compute[73449]:   </clock>
Aug 17 11:46:21 user nova-compute[73449]:   <cpu mode="custom" match="exact">
Aug 17 11:46:21 user nova-compute[73449]:     <model>Nehalem</model>
Aug 17 11:46:21 user nova-compute[73449]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 11:46:21 user nova-compute[73449]:   </cpu>
Aug 17 11:46:21 user nova-compute[73449]:   <devices>
Aug 17 11:46:21 user nova-compute[73449]:     <disk type="file" device="disk">
Aug 17 11:46:21 user nova-compute[73449]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 11:46:21 user nova-compute[73449]:       <source file="/opt/stack/data/nova/instances/f35b7f2b-2f88-4b09-86ac-cb5a78a94584/disk"/>
Aug 17 11:46:21 user nova-compute[73449]:       <target dev="vda" bus="virtio"/>
Aug 17 11:46:21 user nova-compute[73449]:     </disk>
Aug 17 11:46:21 user nova-compute[73449]:     <disk type="block" device="disk">
Aug 17 11:46:21 user nova-compute[73449]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 11:46:21 user nova-compute[73449]:       <source dev="/dev/sdd"/>
Aug 17 11:46:21 user nova-compute[73449]:       <target dev="vdb" bus="virtio"/>
Aug 17 11:46:21 user nova-compute[73449]:       <serial>0254b152-714d-470d-bfac-2bb7b2761466</serial>
Aug 17 11:46:21 user nova-compute[73449]:     </disk>
Aug 17 11:46:21 user nova-compute[73449]:     <interface type="ethernet">
Aug 17 11:46:21 user nova-compute[73449]:       <mac address="fa:16:3e:4e:54:ff"/>
Aug 17 11:46:21 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 11:46:21 user nova-compute[73449]:       <mtu size="1442"/>
Aug 17 11:46:21 user nova-compute[73449]:       <target dev="tape86f2a61-e6"/>
Aug 17 11:46:21 user nova-compute[73449]:     </interface>
Aug 17 11:46:21 user nova-compute[73449]:     <serial type="pty">
Aug 17 11:46:21 user nova-compute[73449]:       <log file="/opt/stack/data/nova/instances/f35b7f2b-2f88-4b09-86ac-cb5a78a94584/console.log" append="off"/>
Aug 17 11:46:21 user nova-compute[73449]:     </serial>
Aug 17 11:46:21 user nova-compute[73449]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 11:46:21 user nova-compute[73449]:     <video>
Aug 17 11:46:21 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 11:46:21 user nova-compute[73449]:     </video>
Aug 17 11:46:21 user nova-compute[73449]:     <rng model="virtio">
Aug 17 11:46:21 user nova-compute[73449]:       <backend model="random">/dev/urandom</backend>
Aug 17 11:46:21 user nova-compute[73449]:     </rng>
Aug 17 11:46:21 user nova-compute[73449]:     <controller type="usb" index="0" model="none"/>
Aug 17 11:46:21 user nova-compute[73449]:     <memballoon model="virtio">
Aug 17 11:46:21 user nova-compute[73449]:       <stats period="10"/>
Aug 17 11:46:21 user nova-compute[73449]:     </memballoon>
Aug 17 11:46:21 user nova-compute[73449]:   </devices>
Aug 17 11:46:21 user nova-compute[73449]: </domain>
Aug 17 11:46:21 user nova-compute[73449]:  {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 11:46:21 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T11:43:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-2119051174',display_name='tempest-ServerActionsTestOtherA-server-1113411740',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-2119051174',id=12,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBslNxfjqeXy15++V9lUN1dUPSj0u5ix1Nnljk5AjIrZhZF+tQog/IhoD1HSXnZkSrwagPwVC/Uewn/Q/J6AkryzpFNZdKWZ4r8749mZJ2bXrxgJUs51emgx4vTQbsCJiQ==',key_name='tempest-keypair-1878071127',keypairs=<?>,launch_index=0,launched_at=2023-08-17T11:43:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='068c5270255744a18208a0ad9b35f168',ramdisk_id='',reservation_id='r-raxmup83',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-303961666',owner_user_name='tempest-ServerActionsTestOtherA-303961666-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T11:46:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e44f6d8893da4d95a8ebe95180355c04',uuid=f35b7f2b-2f88-4b09-86ac-cb5a78a94584,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e86f2a61-e64f-49ea-83ad-386755b33e00", "address": "fa:16:3e:4e:54:ff", "network": {"id": "72c50a42-688f-4868-8e19-c40b103a49cd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1792423641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "068c5270255744a18208a0ad9b35f168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape86f2a61-e6", "ovs_interfaceid": "e86f2a61-e64f-49ea-83ad-386755b33e00", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 11:46:21 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Converting VIF {"id": "e86f2a61-e64f-49ea-83ad-386755b33e00", "address": "fa:16:3e:4e:54:ff", "network": {"id": "72c50a42-688f-4868-8e19-c40b103a49cd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1792423641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "068c5270255744a18208a0ad9b35f168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape86f2a61-e6", "ovs_interfaceid": "e86f2a61-e64f-49ea-83ad-386755b33e00", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:46:21 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4e:54:ff,bridge_name='br-int',has_traffic_filtering=True,id=e86f2a61-e64f-49ea-83ad-386755b33e00,network=Network(72c50a42-688f-4868-8e19-c40b103a49cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape86f2a61-e6') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:46:21 user nova-compute[73449]: DEBUG os_vif [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4e:54:ff,bridge_name='br-int',has_traffic_filtering=True,id=e86f2a61-e64f-49ea-83ad-386755b33e00,network=Network(72c50a42-688f-4868-8e19-c40b103a49cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape86f2a61-e6') {{(pid=73449) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 11:46:21 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:46:21 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:46:21 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 11:46:21 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:46:21 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape86f2a61-e6, may_exist=True, interface_attrs={}) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:46:21 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape86f2a61-e6, col_values=(('external_ids', {'iface-id': 'e86f2a61-e64f-49ea-83ad-386755b33e00', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4e:54:ff', 'vm-uuid': 'f35b7f2b-2f88-4b09-86ac-cb5a78a94584'}),), if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:46:21 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:46:21 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:46:21 user nova-compute[73449]: INFO os_vif [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4e:54:ff,bridge_name='br-int',has_traffic_filtering=True,id=e86f2a61-e64f-49ea-83ad-386755b33e00,network=Network(72c50a42-688f-4868-8e19-c40b103a49cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape86f2a61-e6')
Aug 17 11:46:21 user nova-compute[73449]: DEBUG nova.compute.manager [req-54efb124-ed2f-4521-9074-61f93755069a req-80499bb2-1344-4170-897c-7faaef306050 service nova] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Received event network-changed-1ec58d7f-18a4-4ddb-a137-2b72c5221621 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:46:21 user nova-compute[73449]: DEBUG nova.compute.manager [req-54efb124-ed2f-4521-9074-61f93755069a req-80499bb2-1344-4170-897c-7faaef306050 service nova] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Refreshing instance network info cache due to event network-changed-1ec58d7f-18a4-4ddb-a137-2b72c5221621. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 11:46:21 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-54efb124-ed2f-4521-9074-61f93755069a req-80499bb2-1344-4170-897c-7faaef306050 service nova] Acquiring lock "refresh_cache-3d468854-6182-49c8-acb7-0641df2d5219" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:46:21 user nova-compute[73449]: DEBUG nova.network.neutron [None req-a68a5a7f-5813-4ea6-8104-a3350e100c8d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Instance cache missing network info. {{(pid=73449) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 11:46:21 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] No BDM found with device name vda, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 11:46:21 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 11:46:21 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] No VIF found with MAC fa:16:3e:4e:54:ff, not building metadata {{(pid=73449) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 11:46:21 user nova-compute[73449]: DEBUG nova.network.neutron [None req-a68a5a7f-5813-4ea6-8104-a3350e100c8d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Updating instance_info_cache with network_info: [{"id": "1ec58d7f-18a4-4ddb-a137-2b72c5221621", "address": "fa:16:3e:8d:35:49", "network": {"id": "870c4b80-1ae0-4a10-89b8-ec734c66c244", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2050219794-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d6856b60c404a34b6355b5fd6dd7bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec58d7f-18", "ovs_interfaceid": "1ec58d7f-18a4-4ddb-a137-2b72c5221621", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:46:21 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a68a5a7f-5813-4ea6-8104-a3350e100c8d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Releasing lock "refresh_cache-3d468854-6182-49c8-acb7-0641df2d5219" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:46:21 user nova-compute[73449]: DEBUG nova.compute.manager [None req-a68a5a7f-5813-4ea6-8104-a3350e100c8d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Instance network_info: |[{"id": "1ec58d7f-18a4-4ddb-a137-2b72c5221621", "address": "fa:16:3e:8d:35:49", "network": {"id": "870c4b80-1ae0-4a10-89b8-ec734c66c244", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2050219794-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d6856b60c404a34b6355b5fd6dd7bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec58d7f-18", "ovs_interfaceid": "1ec58d7f-18a4-4ddb-a137-2b72c5221621", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73449) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 11:46:21 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-54efb124-ed2f-4521-9074-61f93755069a req-80499bb2-1344-4170-897c-7faaef306050 service nova] Acquired lock "refresh_cache-3d468854-6182-49c8-acb7-0641df2d5219" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:46:21 user nova-compute[73449]: DEBUG nova.network.neutron [req-54efb124-ed2f-4521-9074-61f93755069a req-80499bb2-1344-4170-897c-7faaef306050 service nova] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Refreshing network info cache for port 1ec58d7f-18a4-4ddb-a137-2b72c5221621 {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 11:46:21 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-a68a5a7f-5813-4ea6-8104-a3350e100c8d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Start _get_guest_xml network_info=[{"id": "1ec58d7f-18a4-4ddb-a137-2b72c5221621", "address": "fa:16:3e:8d:35:49", "network": {"id": "870c4b80-1ae0-4a10-89b8-ec734c66c244", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2050219794-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d6856b60c404a34b6355b5fd6dd7bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec58d7f-18", "ovs_interfaceid": "1ec58d7f-18a4-4ddb-a137-2b72c5221621", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T11:36:11Z,direct_url=<?>,disk_format='qcow2',id=0a2904ae-083d-41c8-83db-343132b36148,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7a77880136a54ef195c82e018e1939db',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T11:36:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': '0a2904ae-083d-41c8-83db-343132b36148'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 11:46:21 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-a68a5a7f-5813-4ea6-8104-a3350e100c8d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:46:21 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-a68a5a7f-5813-4ea6-8104-a3350e100c8d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:46:21 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-a68a5a7f-5813-4ea6-8104-a3350e100c8d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 11:46:21 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-a68a5a7f-5813-4ea6-8104-a3350e100c8d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] CPU controller missing on host. {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 11:46:21 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-a68a5a7f-5813-4ea6-8104-a3350e100c8d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 11:46:21 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-a68a5a7f-5813-4ea6-8104-a3350e100c8d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] CPU controller found on host. {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 11:46:21 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-a68a5a7f-5813-4ea6-8104-a3350e100c8d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73449) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 11:46:21 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-a68a5a7f-5813-4ea6-8104-a3350e100c8d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T11:35:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T11:36:11Z,direct_url=<?>,disk_format='qcow2',id=0a2904ae-083d-41c8-83db-343132b36148,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7a77880136a54ef195c82e018e1939db',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T11:36:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 11:46:21 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-a68a5a7f-5813-4ea6-8104-a3350e100c8d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Flavor limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 11:46:21 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-a68a5a7f-5813-4ea6-8104-a3350e100c8d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Image limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 11:46:21 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-a68a5a7f-5813-4ea6-8104-a3350e100c8d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Flavor pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 11:46:21 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-a68a5a7f-5813-4ea6-8104-a3350e100c8d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Image pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 11:46:21 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-a68a5a7f-5813-4ea6-8104-a3350e100c8d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 11:46:21 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-a68a5a7f-5813-4ea6-8104-a3350e100c8d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 11:46:21 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-a68a5a7f-5813-4ea6-8104-a3350e100c8d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 11:46:21 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-a68a5a7f-5813-4ea6-8104-a3350e100c8d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Got 1 possible topologies {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 11:46:21 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-a68a5a7f-5813-4ea6-8104-a3350e100c8d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 11:46:21 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-a68a5a7f-5813-4ea6-8104-a3350e100c8d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 11:46:21 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-a68a5a7f-5813-4ea6-8104-a3350e100c8d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:46:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1456627687',display_name='tempest-ServerActionsTestOtherB-server-1456627687',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1456627687',id=20,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNxG3No2zUVrbEXbRYCvyFo5zdmNWjUQ1w9Et6I/UYTR5GdEjRnJlmF8yAFQAym8G0hKrThB6Qoa83CCIr+oCSIdRZoU+FBKHtl3+QzEAuOyPVMVYrkASnAypoGWlwjgpQ==',key_name='tempest-keypair-1350250606',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d6856b60c404a34b6355b5fd6dd7bb8',ramdisk_id='',reservation_id='r-2byzpdg1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-108358124',owner_user_name='tempest-ServerActionsTestOtherB-108358124-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T11:46:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2791de1444c2428f9120cc907529cfcf',uuid=3d468854-6182-49c8-acb7-0641df2d5219,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1ec58d7f-18a4-4ddb-a137-2b72c5221621", "address": "fa:16:3e:8d:35:49", "network": {"id": "870c4b80-1ae0-4a10-89b8-ec734c66c244", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2050219794-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d6856b60c404a34b6355b5fd6dd7bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec58d7f-18", "ovs_interfaceid": "1ec58d7f-18a4-4ddb-a137-2b72c5221621", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73449) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 11:46:21 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-a68a5a7f-5813-4ea6-8104-a3350e100c8d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Converting VIF {"id": "1ec58d7f-18a4-4ddb-a137-2b72c5221621", "address": "fa:16:3e:8d:35:49", "network": {"id": "870c4b80-1ae0-4a10-89b8-ec734c66c244", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2050219794-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d6856b60c404a34b6355b5fd6dd7bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec58d7f-18", "ovs_interfaceid": "1ec58d7f-18a4-4ddb-a137-2b72c5221621", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:46:21 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-a68a5a7f-5813-4ea6-8104-a3350e100c8d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:35:49,bridge_name='br-int',has_traffic_filtering=True,id=1ec58d7f-18a4-4ddb-a137-2b72c5221621,network=Network(870c4b80-1ae0-4a10-89b8-ec734c66c244),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ec58d7f-18') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:46:21 user nova-compute[73449]: DEBUG nova.objects.instance [None req-a68a5a7f-5813-4ea6-8104-a3350e100c8d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Lazy-loading 'pci_devices' on Instance uuid 3d468854-6182-49c8-acb7-0641df2d5219 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:46:21 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-a68a5a7f-5813-4ea6-8104-a3350e100c8d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] End _get_guest_xml xml=<domain type="kvm">
Aug 17 11:46:21 user nova-compute[73449]:   <uuid>3d468854-6182-49c8-acb7-0641df2d5219</uuid>
Aug 17 11:46:21 user nova-compute[73449]:   <name>instance-00000014</name>
Aug 17 11:46:21 user nova-compute[73449]:   <memory>524288</memory>
Aug 17 11:46:21 user nova-compute[73449]:   <vcpu>1</vcpu>
Aug 17 11:46:21 user nova-compute[73449]:   <metadata>
Aug 17 11:46:21 user nova-compute[73449]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 11:46:21 user nova-compute[73449]:       <nova:package version="0.0.0"/>
Aug 17 11:46:21 user nova-compute[73449]:       <nova:name>tempest-ServerActionsTestOtherB-server-1456627687</nova:name>
Aug 17 11:46:21 user nova-compute[73449]:       <nova:creationTime>2023-08-17 11:46:21</nova:creationTime>
Aug 17 11:46:21 user nova-compute[73449]:       <nova:flavor name="m1.tiny">
Aug 17 11:46:21 user nova-compute[73449]:         <nova:memory>512</nova:memory>
Aug 17 11:46:21 user nova-compute[73449]:         <nova:disk>1</nova:disk>
Aug 17 11:46:21 user nova-compute[73449]:         <nova:swap>0</nova:swap>
Aug 17 11:46:21 user nova-compute[73449]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 11:46:21 user nova-compute[73449]:         <nova:vcpus>1</nova:vcpus>
Aug 17 11:46:21 user nova-compute[73449]:       </nova:flavor>
Aug 17 11:46:21 user nova-compute[73449]:       <nova:owner>
Aug 17 11:46:21 user nova-compute[73449]:         <nova:user uuid="2791de1444c2428f9120cc907529cfcf">tempest-ServerActionsTestOtherB-108358124-project-member</nova:user>
Aug 17 11:46:21 user nova-compute[73449]:         <nova:project uuid="4d6856b60c404a34b6355b5fd6dd7bb8">tempest-ServerActionsTestOtherB-108358124</nova:project>
Aug 17 11:46:21 user nova-compute[73449]:       </nova:owner>
Aug 17 11:46:21 user nova-compute[73449]:       <nova:root type="image" uuid="0a2904ae-083d-41c8-83db-343132b36148"/>
Aug 17 11:46:21 user nova-compute[73449]:       <nova:ports>
Aug 17 11:46:21 user nova-compute[73449]:         <nova:port uuid="1ec58d7f-18a4-4ddb-a137-2b72c5221621">
Aug 17 11:46:21 user nova-compute[73449]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 17 11:46:21 user nova-compute[73449]:         </nova:port>
Aug 17 11:46:21 user nova-compute[73449]:       </nova:ports>
Aug 17 11:46:21 user nova-compute[73449]:     </nova:instance>
Aug 17 11:46:21 user nova-compute[73449]:   </metadata>
Aug 17 11:46:21 user nova-compute[73449]:   <sysinfo type="smbios">
Aug 17 11:46:21 user nova-compute[73449]:     <system>
Aug 17 11:46:21 user nova-compute[73449]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 11:46:21 user nova-compute[73449]:       <entry name="product">OpenStack Nova</entry>
Aug 17 11:46:21 user nova-compute[73449]:       <entry name="version">0.0.0</entry>
Aug 17 11:46:21 user nova-compute[73449]:       <entry name="serial">3d468854-6182-49c8-acb7-0641df2d5219</entry>
Aug 17 11:46:21 user nova-compute[73449]:       <entry name="uuid">3d468854-6182-49c8-acb7-0641df2d5219</entry>
Aug 17 11:46:21 user nova-compute[73449]:       <entry name="family">Virtual Machine</entry>
Aug 17 11:46:21 user nova-compute[73449]:     </system>
Aug 17 11:46:21 user nova-compute[73449]:   </sysinfo>
Aug 17 11:46:21 user nova-compute[73449]:   <os>
Aug 17 11:46:21 user nova-compute[73449]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 11:46:21 user nova-compute[73449]:     <boot dev="hd"/>
Aug 17 11:46:21 user nova-compute[73449]:     <smbios mode="sysinfo"/>
Aug 17 11:46:21 user nova-compute[73449]:   </os>
Aug 17 11:46:21 user nova-compute[73449]:   <features>
Aug 17 11:46:21 user nova-compute[73449]:     <acpi/>
Aug 17 11:46:21 user nova-compute[73449]:     <apic/>
Aug 17 11:46:21 user nova-compute[73449]:     <vmcoreinfo/>
Aug 17 11:46:21 user nova-compute[73449]:   </features>
Aug 17 11:46:21 user nova-compute[73449]:   <clock offset="utc">
Aug 17 11:46:21 user nova-compute[73449]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 11:46:21 user nova-compute[73449]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 11:46:21 user nova-compute[73449]:     <timer name="hpet" present="no"/>
Aug 17 11:46:21 user nova-compute[73449]:   </clock>
Aug 17 11:46:21 user nova-compute[73449]:   <cpu mode="custom" match="exact">
Aug 17 11:46:21 user nova-compute[73449]:     <model>Nehalem</model>
Aug 17 11:46:21 user nova-compute[73449]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 11:46:21 user nova-compute[73449]:   </cpu>
Aug 17 11:46:21 user nova-compute[73449]:   <devices>
Aug 17 11:46:21 user nova-compute[73449]:     <disk type="file" device="disk">
Aug 17 11:46:21 user nova-compute[73449]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 11:46:21 user nova-compute[73449]:       <source file="/opt/stack/data/nova/instances/3d468854-6182-49c8-acb7-0641df2d5219/disk"/>
Aug 17 11:46:21 user nova-compute[73449]:       <target dev="vda" bus="virtio"/>
Aug 17 11:46:21 user nova-compute[73449]:     </disk>
Aug 17 11:46:21 user nova-compute[73449]:     <interface type="ethernet">
Aug 17 11:46:21 user nova-compute[73449]:       <mac address="fa:16:3e:8d:35:49"/>
Aug 17 11:46:21 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 11:46:21 user nova-compute[73449]:       <mtu size="1442"/>
Aug 17 11:46:21 user nova-compute[73449]:       <target dev="tap1ec58d7f-18"/>
Aug 17 11:46:21 user nova-compute[73449]:     </interface>
Aug 17 11:46:21 user nova-compute[73449]:     <serial type="pty">
Aug 17 11:46:21 user nova-compute[73449]:       <log file="/opt/stack/data/nova/instances/3d468854-6182-49c8-acb7-0641df2d5219/console.log" append="off"/>
Aug 17 11:46:21 user nova-compute[73449]:     </serial>
Aug 17 11:46:21 user nova-compute[73449]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 11:46:21 user nova-compute[73449]:     <video>
Aug 17 11:46:21 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 11:46:21 user nova-compute[73449]:     </video>
Aug 17 11:46:21 user nova-compute[73449]:     <rng model="virtio">
Aug 17 11:46:21 user nova-compute[73449]:       <backend model="random">/dev/urandom</backend>
Aug 17 11:46:21 user nova-compute[73449]:     </rng>
Aug 17 11:46:21 user nova-compute[73449]:     <controller type="usb" index="0" model="none"/>
Aug 17 11:46:21 user nova-compute[73449]:     <memballoon model="virtio">
Aug 17 11:46:21 user nova-compute[73449]:       <stats period="10"/>
Aug 17 11:46:21 user nova-compute[73449]:     </memballoon>
Aug 17 11:46:21 user nova-compute[73449]:   </devices>
Aug 17 11:46:21 user nova-compute[73449]: </domain>
Aug 17 11:46:21 user nova-compute[73449]:  {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 11:46:21 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-a68a5a7f-5813-4ea6-8104-a3350e100c8d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:46:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1456627687',display_name='tempest-ServerActionsTestOtherB-server-1456627687',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1456627687',id=20,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNxG3No2zUVrbEXbRYCvyFo5zdmNWjUQ1w9Et6I/UYTR5GdEjRnJlmF8yAFQAym8G0hKrThB6Qoa83CCIr+oCSIdRZoU+FBKHtl3+QzEAuOyPVMVYrkASnAypoGWlwjgpQ==',key_name='tempest-keypair-1350250606',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d6856b60c404a34b6355b5fd6dd7bb8',ramdisk_id='',reservation_id='r-2byzpdg1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-108358124',owner_user_name='tempest-ServerActionsTestOtherB-108358124-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T11:46:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2791de1444c2428f9120cc907529cfcf',uuid=3d468854-6182-49c8-acb7-0641df2d5219,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1ec58d7f-18a4-4ddb-a137-2b72c5221621", "address": "fa:16:3e:8d:35:49", "network": {"id": "870c4b80-1ae0-4a10-89b8-ec734c66c244", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2050219794-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d6856b60c404a34b6355b5fd6dd7bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec58d7f-18", "ovs_interfaceid": "1ec58d7f-18a4-4ddb-a137-2b72c5221621", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 11:46:21 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-a68a5a7f-5813-4ea6-8104-a3350e100c8d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Converting VIF {"id": "1ec58d7f-18a4-4ddb-a137-2b72c5221621", "address": "fa:16:3e:8d:35:49", "network": {"id": "870c4b80-1ae0-4a10-89b8-ec734c66c244", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2050219794-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d6856b60c404a34b6355b5fd6dd7bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec58d7f-18", "ovs_interfaceid": "1ec58d7f-18a4-4ddb-a137-2b72c5221621", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:46:21 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-a68a5a7f-5813-4ea6-8104-a3350e100c8d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:35:49,bridge_name='br-int',has_traffic_filtering=True,id=1ec58d7f-18a4-4ddb-a137-2b72c5221621,network=Network(870c4b80-1ae0-4a10-89b8-ec734c66c244),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ec58d7f-18') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:46:21 user nova-compute[73449]: DEBUG os_vif [None req-a68a5a7f-5813-4ea6-8104-a3350e100c8d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:35:49,bridge_name='br-int',has_traffic_filtering=True,id=1ec58d7f-18a4-4ddb-a137-2b72c5221621,network=Network(870c4b80-1ae0-4a10-89b8-ec734c66c244),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ec58d7f-18') {{(pid=73449) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 11:46:21 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:46:21 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:46:21 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 11:46:21 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:46:21 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1ec58d7f-18, may_exist=True, interface_attrs={}) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:46:21 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1ec58d7f-18, col_values=(('external_ids', {'iface-id': '1ec58d7f-18a4-4ddb-a137-2b72c5221621', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8d:35:49', 'vm-uuid': '3d468854-6182-49c8-acb7-0641df2d5219'}),), if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:46:21 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:46:21 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:46:21 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:46:21 user nova-compute[73449]: INFO os_vif [None req-a68a5a7f-5813-4ea6-8104-a3350e100c8d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:35:49,bridge_name='br-int',has_traffic_filtering=True,id=1ec58d7f-18a4-4ddb-a137-2b72c5221621,network=Network(870c4b80-1ae0-4a10-89b8-ec734c66c244),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ec58d7f-18')
Aug 17 11:46:22 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-a68a5a7f-5813-4ea6-8104-a3350e100c8d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] No BDM found with device name vda, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 11:46:22 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-a68a5a7f-5813-4ea6-8104-a3350e100c8d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] No VIF found with MAC fa:16:3e:8d:35:49, not building metadata {{(pid=73449) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 11:46:22 user nova-compute[73449]: DEBUG nova.network.neutron [req-54efb124-ed2f-4521-9074-61f93755069a req-80499bb2-1344-4170-897c-7faaef306050 service nova] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Updated VIF entry in instance network info cache for port 1ec58d7f-18a4-4ddb-a137-2b72c5221621. {{(pid=73449) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 11:46:22 user nova-compute[73449]: DEBUG nova.network.neutron [req-54efb124-ed2f-4521-9074-61f93755069a req-80499bb2-1344-4170-897c-7faaef306050 service nova] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Updating instance_info_cache with network_info: [{"id": "1ec58d7f-18a4-4ddb-a137-2b72c5221621", "address": "fa:16:3e:8d:35:49", "network": {"id": "870c4b80-1ae0-4a10-89b8-ec734c66c244", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2050219794-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d6856b60c404a34b6355b5fd6dd7bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec58d7f-18", "ovs_interfaceid": "1ec58d7f-18a4-4ddb-a137-2b72c5221621", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:46:22 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-54efb124-ed2f-4521-9074-61f93755069a req-80499bb2-1344-4170-897c-7faaef306050 service nova] Releasing lock "refresh_cache-3d468854-6182-49c8-acb7-0641df2d5219" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:46:22 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:46:23 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:46:23 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:46:23 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:46:23 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:46:23 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:46:23 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:46:23 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:46:24 user nova-compute[73449]: DEBUG nova.compute.manager [req-4b7dcbb2-e85a-4631-94d2-c54c17c24573 req-25989568-3212-4579-8314-765c59e39442 service nova] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] Received event network-vif-plugged-e86f2a61-e64f-49ea-83ad-386755b33e00 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:46:24 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-4b7dcbb2-e85a-4631-94d2-c54c17c24573 req-25989568-3212-4579-8314-765c59e39442 service nova] Acquiring lock "f35b7f2b-2f88-4b09-86ac-cb5a78a94584-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:46:24 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-4b7dcbb2-e85a-4631-94d2-c54c17c24573 req-25989568-3212-4579-8314-765c59e39442 service nova] Lock "f35b7f2b-2f88-4b09-86ac-cb5a78a94584-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:46:24 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-4b7dcbb2-e85a-4631-94d2-c54c17c24573 req-25989568-3212-4579-8314-765c59e39442 service nova] Lock "f35b7f2b-2f88-4b09-86ac-cb5a78a94584-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:46:24 user nova-compute[73449]: DEBUG nova.compute.manager [req-4b7dcbb2-e85a-4631-94d2-c54c17c24573 req-25989568-3212-4579-8314-765c59e39442 service nova] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] No waiting events found dispatching network-vif-plugged-e86f2a61-e64f-49ea-83ad-386755b33e00 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:46:24 user nova-compute[73449]: WARNING nova.compute.manager [req-4b7dcbb2-e85a-4631-94d2-c54c17c24573 req-25989568-3212-4579-8314-765c59e39442 service nova] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] Received unexpected event network-vif-plugged-e86f2a61-e64f-49ea-83ad-386755b33e00 for instance with vm_state active and task_state rebuild_spawning.
Aug 17 11:46:24 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:46:24 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:46:24 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:46:25 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:46:25 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:46:25 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:46:25 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:46:25 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:46:26 user nova-compute[73449]: DEBUG nova.compute.manager [req-6737ee34-422d-44cf-a9f6-371ad957bb92 req-dd0c649f-2bf8-4edf-ab36-450e720fe8e8 service nova] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Received event network-vif-plugged-1ec58d7f-18a4-4ddb-a137-2b72c5221621 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:46:26 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-6737ee34-422d-44cf-a9f6-371ad957bb92 req-dd0c649f-2bf8-4edf-ab36-450e720fe8e8 service nova] Acquiring lock "3d468854-6182-49c8-acb7-0641df2d5219-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:46:26 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-6737ee34-422d-44cf-a9f6-371ad957bb92 req-dd0c649f-2bf8-4edf-ab36-450e720fe8e8 service nova] Lock "3d468854-6182-49c8-acb7-0641df2d5219-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:46:26 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-6737ee34-422d-44cf-a9f6-371ad957bb92 req-dd0c649f-2bf8-4edf-ab36-450e720fe8e8 service nova] Lock "3d468854-6182-49c8-acb7-0641df2d5219-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:46:26 user nova-compute[73449]: DEBUG nova.compute.manager [req-6737ee34-422d-44cf-a9f6-371ad957bb92 req-dd0c649f-2bf8-4edf-ab36-450e720fe8e8 service nova] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] No waiting events found dispatching network-vif-plugged-1ec58d7f-18a4-4ddb-a137-2b72c5221621 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:46:26 user nova-compute[73449]: WARNING nova.compute.manager [req-6737ee34-422d-44cf-a9f6-371ad957bb92 req-dd0c649f-2bf8-4edf-ab36-450e720fe8e8 service nova] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Received unexpected event network-vif-plugged-1ec58d7f-18a4-4ddb-a137-2b72c5221621 for instance with vm_state building and task_state spawning.
Aug 17 11:46:26 user nova-compute[73449]: DEBUG nova.compute.manager [req-303697b5-d1d8-493c-8342-255bfc9bdce3 req-fb5bf53b-4707-4655-b6ee-d890f31b9b20 service nova] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] Received event network-vif-plugged-e86f2a61-e64f-49ea-83ad-386755b33e00 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:46:26 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-303697b5-d1d8-493c-8342-255bfc9bdce3 req-fb5bf53b-4707-4655-b6ee-d890f31b9b20 service nova] Acquiring lock "f35b7f2b-2f88-4b09-86ac-cb5a78a94584-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:46:26 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-303697b5-d1d8-493c-8342-255bfc9bdce3 req-fb5bf53b-4707-4655-b6ee-d890f31b9b20 service nova] Lock "f35b7f2b-2f88-4b09-86ac-cb5a78a94584-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:46:26 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-303697b5-d1d8-493c-8342-255bfc9bdce3 req-fb5bf53b-4707-4655-b6ee-d890f31b9b20 service nova] Lock "f35b7f2b-2f88-4b09-86ac-cb5a78a94584-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:46:26 user nova-compute[73449]: DEBUG nova.compute.manager [req-303697b5-d1d8-493c-8342-255bfc9bdce3 req-fb5bf53b-4707-4655-b6ee-d890f31b9b20 service nova] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] No waiting events found dispatching network-vif-plugged-e86f2a61-e64f-49ea-83ad-386755b33e00 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:46:26 user nova-compute[73449]: WARNING nova.compute.manager [req-303697b5-d1d8-493c-8342-255bfc9bdce3 req-fb5bf53b-4707-4655-b6ee-d890f31b9b20 service nova] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] Received unexpected event network-vif-plugged-e86f2a61-e64f-49ea-83ad-386755b33e00 for instance with vm_state active and task_state rebuild_spawning.
Aug 17 11:46:26 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:46:27 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692272787.1232374, f35b7f2b-2f88-4b09-86ac-cb5a78a94584 => Resumed> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:46:27 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] VM Resumed (Lifecycle Event)
Aug 17 11:46:27 user nova-compute[73449]: DEBUG nova.compute.manager [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] Instance event wait completed in 0 seconds for  {{(pid=73449) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 11:46:27 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] Guest created on hypervisor {{(pid=73449) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 11:46:27 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] Instance spawned successfully.
Aug 17 11:46:27 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 11:46:27 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:46:27 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 11:46:27 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 17 11:46:27 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692272787.1257167, f35b7f2b-2f88-4b09-86ac-cb5a78a94584 => Started> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:46:27 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] VM Started (Lifecycle Event)
Aug 17 11:46:27 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] Found default for hw_cdrom_bus of ide {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:46:27 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] Found default for hw_disk_bus of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:46:27 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] Found default for hw_input_bus of None {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:46:27 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] Found default for hw_pointer_model of None {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:46:27 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] Found default for hw_video_model of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:46:27 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] Found default for hw_vif_model of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:46:27 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:46:27 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 11:46:27 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 17 11:46:27 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692272787.2567906, 3d468854-6182-49c8-acb7-0641df2d5219 => Resumed> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:46:27 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] VM Resumed (Lifecycle Event)
Aug 17 11:46:27 user nova-compute[73449]: DEBUG nova.compute.manager [None req-a68a5a7f-5813-4ea6-8104-a3350e100c8d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Instance event wait completed in 0 seconds for  {{(pid=73449) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 11:46:27 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-a68a5a7f-5813-4ea6-8104-a3350e100c8d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Guest created on hypervisor {{(pid=73449) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 11:46:27 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Instance spawned successfully.
Aug 17 11:46:27 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-a68a5a7f-5813-4ea6-8104-a3350e100c8d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 11:46:27 user nova-compute[73449]: DEBUG nova.compute.manager [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:46:27 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-a68a5a7f-5813-4ea6-8104-a3350e100c8d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Found default for hw_cdrom_bus of ide {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:46:27 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-a68a5a7f-5813-4ea6-8104-a3350e100c8d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Found default for hw_disk_bus of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:46:27 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-a68a5a7f-5813-4ea6-8104-a3350e100c8d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Found default for hw_input_bus of None {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:46:27 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-a68a5a7f-5813-4ea6-8104-a3350e100c8d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Found default for hw_pointer_model of None {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:46:27 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-a68a5a7f-5813-4ea6-8104-a3350e100c8d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Found default for hw_video_model of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:46:27 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-a68a5a7f-5813-4ea6-8104-a3350e100c8d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Found default for hw_vif_model of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:46:27 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:46:27 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 11:46:27 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 11:46:27 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692272787.258989, 3d468854-6182-49c8-acb7-0641df2d5219 => Started> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:46:27 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] VM Started (Lifecycle Event)
Aug 17 11:46:27 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:46:27 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:46:27 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:46:27 user nova-compute[73449]: DEBUG nova.objects.instance [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] Trying to apply a migration context that does not seem to be set for this instance {{(pid=73449) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 17 11:46:27 user nova-compute[73449]: INFO nova.compute.manager [None req-a68a5a7f-5813-4ea6-8104-a3350e100c8d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Took 8.59 seconds to spawn the instance on the hypervisor.
Aug 17 11:46:27 user nova-compute[73449]: DEBUG nova.compute.manager [None req-a68a5a7f-5813-4ea6-8104-a3350e100c8d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:46:27 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 11:46:27 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 11:46:27 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-11dd530c-7d99-44e2-a9a9-70db7f97bd36 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.076s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:46:27 user nova-compute[73449]: INFO nova.compute.manager [None req-a68a5a7f-5813-4ea6-8104-a3350e100c8d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Took 10.22 seconds to build instance.
Aug 17 11:46:27 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a68a5a7f-5813-4ea6-8104-a3350e100c8d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Lock "3d468854-6182-49c8-acb7-0641df2d5219" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.351s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:46:27 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "3d468854-6182-49c8-acb7-0641df2d5219" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 7.204s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:46:27 user nova-compute[73449]: INFO nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 11:46:27 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "3d468854-6182-49c8-acb7-0641df2d5219" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:46:27 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:46:28 user nova-compute[73449]: DEBUG nova.compute.manager [req-4dec185d-7d69-4ff4-9efa-553b30b68dcf req-52873ac9-db34-4fb4-a143-b200744443f3 service nova] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Received event network-vif-plugged-1ec58d7f-18a4-4ddb-a137-2b72c5221621 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:46:28 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-4dec185d-7d69-4ff4-9efa-553b30b68dcf req-52873ac9-db34-4fb4-a143-b200744443f3 service nova] Acquiring lock "3d468854-6182-49c8-acb7-0641df2d5219-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:46:28 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-4dec185d-7d69-4ff4-9efa-553b30b68dcf req-52873ac9-db34-4fb4-a143-b200744443f3 service nova] Lock "3d468854-6182-49c8-acb7-0641df2d5219-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:46:28 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-4dec185d-7d69-4ff4-9efa-553b30b68dcf req-52873ac9-db34-4fb4-a143-b200744443f3 service nova] Lock "3d468854-6182-49c8-acb7-0641df2d5219-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:46:28 user nova-compute[73449]: DEBUG nova.compute.manager [req-4dec185d-7d69-4ff4-9efa-553b30b68dcf req-52873ac9-db34-4fb4-a143-b200744443f3 service nova] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] No waiting events found dispatching network-vif-plugged-1ec58d7f-18a4-4ddb-a137-2b72c5221621 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:46:28 user nova-compute[73449]: WARNING nova.compute.manager [req-4dec185d-7d69-4ff4-9efa-553b30b68dcf req-52873ac9-db34-4fb4-a143-b200744443f3 service nova] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Received unexpected event network-vif-plugged-1ec58d7f-18a4-4ddb-a137-2b72c5221621 for instance with vm_state active and task_state None.
Aug 17 11:46:29 user nova-compute[73449]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692272774.5275424, 848599ce-8cf5-4116-b1d6-4cf9d79cfbc0 => Stopped> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:46:29 user nova-compute[73449]: INFO nova.compute.manager [-] [instance: 848599ce-8cf5-4116-b1d6-4cf9d79cfbc0] VM Stopped (Lifecycle Event)
Aug 17 11:46:29 user nova-compute[73449]: DEBUG nova.compute.manager [None req-4e68cc06-0090-4282-a5e3-778b38f0bfb6 None None] [instance: 848599ce-8cf5-4116-b1d6-4cf9d79cfbc0] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:46:31 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:46:32 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:46:34 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-3749fadb-a9f5-4270-846f-25953cd69c3e tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Acquiring lock "a3523d22-7165-46ad-be10-5e6ae374f91d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:46:34 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-3749fadb-a9f5-4270-846f-25953cd69c3e tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Lock "a3523d22-7165-46ad-be10-5e6ae374f91d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:46:34 user nova-compute[73449]: INFO nova.compute.manager [None req-3749fadb-a9f5-4270-846f-25953cd69c3e tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Detaching volume c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe
Aug 17 11:46:34 user nova-compute[73449]: INFO nova.virt.block_device [None req-3749fadb-a9f5-4270-846f-25953cd69c3e tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Attempting to driver detach volume c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe from mountpoint /dev/vdb
Aug 17 11:46:34 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-3749fadb-a9f5-4270-846f-25953cd69c3e tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Attempting to detach device vdb from instance a3523d22-7165-46ad-be10-5e6ae374f91d from the persistent domain config. {{(pid=73449) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 11:46:34 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-3749fadb-a9f5-4270-846f-25953cd69c3e tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 11:46:34 user nova-compute[73449]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 11:46:34 user nova-compute[73449]:   <source dev="/dev/sdh"/>
Aug 17 11:46:34 user nova-compute[73449]:   <target dev="vdb" bus="virtio"/>
Aug 17 11:46:34 user nova-compute[73449]:   <serial>c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe</serial>
Aug 17 11:46:34 user nova-compute[73449]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 11:46:34 user nova-compute[73449]: </disk>
Aug 17 11:46:34 user nova-compute[73449]:  {{(pid=73449) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 11:46:34 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-3749fadb-a9f5-4270-846f-25953cd69c3e tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Successfully detached device vdb from instance a3523d22-7165-46ad-be10-5e6ae374f91d from the persistent domain config.
Aug 17 11:46:34 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-3749fadb-a9f5-4270-846f-25953cd69c3e tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a3523d22-7165-46ad-be10-5e6ae374f91d from the live domain config. {{(pid=73449) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 11:46:34 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-3749fadb-a9f5-4270-846f-25953cd69c3e tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 11:46:34 user nova-compute[73449]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 11:46:34 user nova-compute[73449]:   <source dev="/dev/sdh"/>
Aug 17 11:46:34 user nova-compute[73449]:   <target dev="vdb" bus="virtio"/>
Aug 17 11:46:34 user nova-compute[73449]:   <serial>c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe</serial>
Aug 17 11:46:34 user nova-compute[73449]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 11:46:34 user nova-compute[73449]: </disk>
Aug 17 11:46:34 user nova-compute[73449]:  {{(pid=73449) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 11:46:34 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Received event <DeviceRemovedEvent: 1692272794.9901333, a3523d22-7165-46ad-be10-5e6ae374f91d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73449) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 11:46:34 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-3749fadb-a9f5-4270-846f-25953cd69c3e tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a3523d22-7165-46ad-be10-5e6ae374f91d {{(pid=73449) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 11:46:35 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-3749fadb-a9f5-4270-846f-25953cd69c3e tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Successfully detached device vdb from instance a3523d22-7165-46ad-be10-5e6ae374f91d from the live domain config.
Aug 17 11:46:35 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3749fadb-a9f5-4270-846f-25953cd69c3e tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] calling os-brick to detach iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 11:46:35 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-3749fadb-a9f5-4270-846f-25953cd69c3e tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, {'target_iqns': ['iqn.2010-10.org.openstack:c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QsgWpRYJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 11:46:35 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-3749fadb-a9f5-4270-846f-25953cd69c3e tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 11:46:35 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-3749fadb-a9f5-4270-846f-25953cd69c3e tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:46:35 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-3749fadb-a9f5-4270-846f-25953cd69c3e tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:46:35 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-3749fadb-a9f5-4270-846f-25953cd69c3e tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe', 0)] {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 11:46:35 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:46:35 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:46:35 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[1707744d-370f-4bc8-8ebf-3ea909219122]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d22566b5-74eb-4aeb-b14c-0bd5aa9e35ee\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:46:35 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:46:35 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:46:35 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[fccfd9cc-4223-431c-ac1a-206ab1c14a42]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d22566b5-74eb-4aeb-b14c-0bd5aa9e35ee (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466 (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:46:35 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-3749fadb-a9f5-4270-846f-25953cd69c3e tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe (non-flash)
Aug 17 11:46:35 user nova-compute[73449]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d22566b5-74eb-4aeb-b14c-0bd5aa9e35ee (non-flash)
Aug 17 11:46:35 user nova-compute[73449]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed (non-flash)
Aug 17 11:46:35 user nova-compute[73449]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466 (non-flash)
Aug 17 11:46:35 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:46:35 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-3749fadb-a9f5-4270-846f-25953cd69c3e tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe (non-flash)
Aug 17 11:46:35 user nova-compute[73449]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d22566b5-74eb-4aeb-b14c-0bd5aa9e35ee (non-flash)
Aug 17 11:46:35 user nova-compute[73449]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed (non-flash)
Aug 17 11:46:35 user nova-compute[73449]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466 (non-flash)
Aug 17 11:46:35 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:46:35 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-3749fadb-a9f5-4270-846f-25953cd69c3e tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe75815ee60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe'): ({'sdh'}, set())}) {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 11:46:35 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-3749fadb-a9f5-4270-846f-25953cd69c3e tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Removing single pathed devices sdh {{(pid=73449) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 11:46:35 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:46:35 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:46:35 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[1daf6125-f902-437c-a11a-7292c194afbc]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:46:35 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:46:35 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.022s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:46:35 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b5af70c-1b9e-426d-9cc1-de1ac296e049]: (4, ('ok\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:46:35 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-3749fadb-a9f5-4270-846f-25953cd69c3e tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Flushing IO for device /dev/sdh {{(pid=73449) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 11:46:35 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:46:35 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.017s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:46:35 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d24a878-8f7a-4cda-befa-2d0da31c844b]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:46:35 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-3749fadb-a9f5-4270-846f-25953cd69c3e tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=73449) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 11:46:35 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:46:35 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.036s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:46:35 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[a541b114-6062-48a4-b254-02f4db0752db]: (4, ('1', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:46:35 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-3749fadb-a9f5-4270-846f-25953cd69c3e tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=73449) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 11:46:35 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-3749fadb-a9f5-4270-846f-25953cd69c3e tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] SCSI volumes sdh have been removed. {{(pid=73449) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 11:46:35 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-3749fadb-a9f5-4270-846f-25953cd69c3e tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe')] {{(pid=73449) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 11:46:35 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:46:35 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:46:35 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[0684a6e8-d0c4-4df2-8031-8b82cb40b71b]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:46:35 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-3749fadb-a9f5-4270-846f-25953cd69c3e tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:46:35 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe -p 172.16.0.220:3260 --logout {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:46:35 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:46:35 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eee6cad-488f-4d86-9883-44f7a4928881]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:46:35 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-3749fadb-a9f5-4270-846f-25953cd69c3e tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe, portal: 172.16.0.220,3260]
Aug 17 11:46:35 user nova-compute[73449]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe, portal: 172.16.0.220,3260] successful.
Aug 17 11:46:35 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:46:35 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe -p 172.16.0.220:3260 --op delete {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:46:35 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0cb5d20-ddb3-4f2c-8c8b-870364ff2dbe -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:46:35 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[de1696a4-eacb-4a59-9471-f85fa57ee130]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:46:35 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-3749fadb-a9f5-4270-846f-25953cd69c3e tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:46:35 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-3749fadb-a9f5-4270-846f-25953cd69c3e tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:46:35 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-3749fadb-a9f5-4270-846f-25953cd69c3e tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] <== disconnect_volume: return (307ms) None {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 11:46:35 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3749fadb-a9f5-4270-846f-25953cd69c3e tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Disconnected iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 11:46:36 user nova-compute[73449]: DEBUG nova.objects.instance [None req-3749fadb-a9f5-4270-846f-25953cd69c3e tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Lazy-loading 'flavor' on Instance uuid a3523d22-7165-46ad-be10-5e6ae374f91d {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:46:36 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-3749fadb-a9f5-4270-846f-25953cd69c3e tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Lock "a3523d22-7165-46ad-be10-5e6ae374f91d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.929s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:46:36 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:46:37 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:46:40 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-0d6d0da4-cd7c-4fb2-a65e-3f3b75d734f6 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Acquiring lock "5612f7d1-a901-4bdd-a24a-faf9a980cd04" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:46:40 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-0d6d0da4-cd7c-4fb2-a65e-3f3b75d734f6 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Lock "5612f7d1-a901-4bdd-a24a-faf9a980cd04" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:46:40 user nova-compute[73449]: DEBUG nova.compute.manager [None req-0d6d0da4-cd7c-4fb2-a65e-3f3b75d734f6 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Starting instance... {{(pid=73449) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 11:46:40 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-0d6d0da4-cd7c-4fb2-a65e-3f3b75d734f6 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:46:40 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-0d6d0da4-cd7c-4fb2-a65e-3f3b75d734f6 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:46:40 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-0d6d0da4-cd7c-4fb2-a65e-3f3b75d734f6 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73449) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 11:46:40 user nova-compute[73449]: INFO nova.compute.claims [None req-0d6d0da4-cd7c-4fb2-a65e-3f3b75d734f6 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Claim successful on node user
Aug 17 11:46:40 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-0d6d0da4-cd7c-4fb2-a65e-3f3b75d734f6 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Refreshing inventories for resource provider 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 17 11:46:41 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-0d6d0da4-cd7c-4fb2-a65e-3f3b75d734f6 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Updating ProviderTree inventory for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 17 11:46:41 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-0d6d0da4-cd7c-4fb2-a65e-3f3b75d734f6 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Updating inventory in ProviderTree for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 11:46:41 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-0d6d0da4-cd7c-4fb2-a65e-3f3b75d734f6 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Refreshing aggregate associations for resource provider 20986bee-3f54-4b89-bec1-f8387ef700c4, aggregates: None {{(pid=73449) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 17 11:46:41 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-0d6d0da4-cd7c-4fb2-a65e-3f3b75d734f6 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Refreshing trait associations for resource provider 20986bee-3f54-4b89-bec1-f8387ef700c4, traits: COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NODE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE42,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSSE3,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_ISO {{(pid=73449) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 17 11:46:41 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-0d6d0da4-cd7c-4fb2-a65e-3f3b75d734f6 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 11:46:41 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-0d6d0da4-cd7c-4fb2-a65e-3f3b75d734f6 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 11:46:41 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-0d6d0da4-cd7c-4fb2-a65e-3f3b75d734f6 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.689s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:46:41 user nova-compute[73449]: DEBUG nova.compute.manager [None req-0d6d0da4-cd7c-4fb2-a65e-3f3b75d734f6 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Start building networks asynchronously for instance. {{(pid=73449) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 11:46:41 user nova-compute[73449]: DEBUG nova.compute.manager [None req-0d6d0da4-cd7c-4fb2-a65e-3f3b75d734f6 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Allocating IP information in the background. {{(pid=73449) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 11:46:41 user nova-compute[73449]: DEBUG nova.network.neutron [None req-0d6d0da4-cd7c-4fb2-a65e-3f3b75d734f6 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] allocate_for_instance() {{(pid=73449) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 11:46:41 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-0d6d0da4-cd7c-4fb2-a65e-3f3b75d734f6 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 11:46:41 user nova-compute[73449]: DEBUG nova.compute.manager [None req-0d6d0da4-cd7c-4fb2-a65e-3f3b75d734f6 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Start building block device mappings for instance. {{(pid=73449) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 11:46:41 user nova-compute[73449]: DEBUG nova.policy [None req-0d6d0da4-cd7c-4fb2-a65e-3f3b75d734f6 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'db7e0b2abd4b4df3b2e7886ddc3840c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b906d3cc3acb46818cd2c9583f351893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73449) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 11:46:41 user nova-compute[73449]: INFO nova.virt.block_device [None req-0d6d0da4-cd7c-4fb2-a65e-3f3b75d734f6 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Booting with volume fc3c38dd-5692-448f-b1fc-b8fe08052611 at /dev/vda
Aug 17 11:46:41 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:46:42 user nova-compute[73449]: DEBUG os_brick.utils [None req-0d6d0da4-cd7c-4fb2-a65e-3f3b75d734f6 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 11:46:42 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:46:42 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:46:42 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6e2cb87-a86b-4cad-af3c-d63c42523cf7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4d3924302012\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:46:42 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:46:42 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:46:42 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[16f1ae72-ec84-4317-9022-ed89598761c4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:46:42 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:46:42 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:46:42 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbf9fc9d-b121-4d01-8229-42c466613056]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:46:42 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f2ca885-5bea-4557-a70b-d202b73373f9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:46:42 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-0d6d0da4-cd7c-4fb2-a65e-3f3b75d734f6 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Running cmd (subprocess): nvme version {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:46:42 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-0d6d0da4-cd7c-4fb2-a65e-3f3b75d734f6 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] 'nvme version' failed. Not Retrying. {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 11:46:42 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0d6d0da4-cd7c-4fb2-a65e-3f3b75d734f6 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] nvme not present on system {{(pid=73449) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 11:46:42 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:46:42 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 11:46:42 user nova-compute[73449]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 11:46:42 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[48f8c07c-64fb-434a-a7dc-6046c9a27b6e]: (4, '') {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:46:42 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-0d6d0da4-cd7c-4fb2-a65e-3f3b75d734f6 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73449) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 11:46:42 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-0d6d0da4-cd7c-4fb2-a65e-3f3b75d734f6 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73449) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 11:46:42 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-0d6d0da4-cd7c-4fb2-a65e-3f3b75d734f6 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] LIGHTOS: no hostnqn found. {{(pid=73449) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 11:46:42 user nova-compute[73449]: DEBUG os_brick.utils [None req-0d6d0da4-cd7c-4fb2-a65e-3f3b75d734f6 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4d3924302012', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 11:46:42 user nova-compute[73449]: DEBUG nova.virt.block_device [None req-0d6d0da4-cd7c-4fb2-a65e-3f3b75d734f6 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Updating existing volume attachment record: 2e81ae58-3f12-47de-9393-f1fecdbe869f {{(pid=73449) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 11:46:42 user nova-compute[73449]: DEBUG nova.network.neutron [None req-0d6d0da4-cd7c-4fb2-a65e-3f3b75d734f6 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Successfully created port: 599e177a-d05b-4d24-8c89-8a868182940c {{(pid=73449) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 11:46:42 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:46:43 user nova-compute[73449]: DEBUG nova.network.neutron [None req-0d6d0da4-cd7c-4fb2-a65e-3f3b75d734f6 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Successfully updated port: 599e177a-d05b-4d24-8c89-8a868182940c {{(pid=73449) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 11:46:43 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-0d6d0da4-cd7c-4fb2-a65e-3f3b75d734f6 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Acquiring lock "refresh_cache-5612f7d1-a901-4bdd-a24a-faf9a980cd04" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:46:43 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-0d6d0da4-cd7c-4fb2-a65e-3f3b75d734f6 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Acquired lock "refresh_cache-5612f7d1-a901-4bdd-a24a-faf9a980cd04" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:46:43 user nova-compute[73449]: DEBUG nova.network.neutron [None req-0d6d0da4-cd7c-4fb2-a65e-3f3b75d734f6 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Building network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 11:46:43 user nova-compute[73449]: DEBUG nova.compute.manager [req-58417524-3312-4d3f-9ad2-684ae57ddb4d req-97e2ee87-1c73-4cf1-8792-151e1891afea service nova] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Received event network-changed-599e177a-d05b-4d24-8c89-8a868182940c {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:46:43 user nova-compute[73449]: DEBUG nova.compute.manager [req-58417524-3312-4d3f-9ad2-684ae57ddb4d req-97e2ee87-1c73-4cf1-8792-151e1891afea service nova] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Refreshing instance network info cache due to event network-changed-599e177a-d05b-4d24-8c89-8a868182940c. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 11:46:43 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-58417524-3312-4d3f-9ad2-684ae57ddb4d req-97e2ee87-1c73-4cf1-8792-151e1891afea service nova] Acquiring lock "refresh_cache-5612f7d1-a901-4bdd-a24a-faf9a980cd04" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:46:43 user nova-compute[73449]: DEBUG nova.network.neutron [None req-0d6d0da4-cd7c-4fb2-a65e-3f3b75d734f6 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Instance cache missing network info. {{(pid=73449) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 11:46:43 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-127177a9-cc98-48f7-9713-e56340f8dafa tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Acquiring lock "fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:46:43 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-127177a9-cc98-48f7-9713-e56340f8dafa tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Lock "fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:46:43 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-127177a9-cc98-48f7-9713-e56340f8dafa tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Acquiring lock "fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:46:43 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-127177a9-cc98-48f7-9713-e56340f8dafa tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Lock "fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:46:43 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-127177a9-cc98-48f7-9713-e56340f8dafa tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Lock "fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:46:43 user nova-compute[73449]: INFO nova.compute.manager [None req-127177a9-cc98-48f7-9713-e56340f8dafa tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] [instance: fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2] Terminating instance
Aug 17 11:46:43 user nova-compute[73449]: DEBUG nova.compute.manager [None req-127177a9-cc98-48f7-9713-e56340f8dafa tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] [instance: fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2] Start destroying the instance on the hypervisor. {{(pid=73449) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 11:46:44 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:46:44 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:46:44 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:46:44 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:46:44 user nova-compute[73449]: DEBUG nova.network.neutron [None req-0d6d0da4-cd7c-4fb2-a65e-3f3b75d734f6 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Updating instance_info_cache with network_info: [{"id": "599e177a-d05b-4d24-8c89-8a868182940c", "address": "fa:16:3e:8d:36:ef", "network": {"id": "41adee44-4e1c-4cc6-aa63-8054da5d97b4", "bridge": "br-int", "label": "tempest-TestShelveInstance-1953236522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b906d3cc3acb46818cd2c9583f351893", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap599e177a-d0", "ovs_interfaceid": "599e177a-d05b-4d24-8c89-8a868182940c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:46:44 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-0d6d0da4-cd7c-4fb2-a65e-3f3b75d734f6 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Releasing lock "refresh_cache-5612f7d1-a901-4bdd-a24a-faf9a980cd04" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:46:44 user nova-compute[73449]: DEBUG nova.compute.manager [None req-0d6d0da4-cd7c-4fb2-a65e-3f3b75d734f6 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Instance network_info: |[{"id": "599e177a-d05b-4d24-8c89-8a868182940c", "address": "fa:16:3e:8d:36:ef", "network": {"id": "41adee44-4e1c-4cc6-aa63-8054da5d97b4", "bridge": "br-int", "label": "tempest-TestShelveInstance-1953236522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b906d3cc3acb46818cd2c9583f351893", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap599e177a-d0", "ovs_interfaceid": "599e177a-d05b-4d24-8c89-8a868182940c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73449) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 11:46:44 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-58417524-3312-4d3f-9ad2-684ae57ddb4d req-97e2ee87-1c73-4cf1-8792-151e1891afea service nova] Acquired lock "refresh_cache-5612f7d1-a901-4bdd-a24a-faf9a980cd04" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:46:44 user nova-compute[73449]: DEBUG nova.network.neutron [req-58417524-3312-4d3f-9ad2-684ae57ddb4d req-97e2ee87-1c73-4cf1-8792-151e1891afea service nova] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Refreshing network info cache for port 599e177a-d05b-4d24-8c89-8a868182940c {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 11:46:44 user nova-compute[73449]: DEBUG nova.compute.manager [req-d6d2d5ea-f6a4-4a8d-aad4-9f19909a5bf7 req-58f73816-25eb-4c1b-9edb-3abffdca0310 service nova] [instance: fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2] Received event network-vif-unplugged-850d3d8f-2b5b-4e82-9c33-83f440f2a428 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:46:44 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-d6d2d5ea-f6a4-4a8d-aad4-9f19909a5bf7 req-58f73816-25eb-4c1b-9edb-3abffdca0310 service nova] Acquiring lock "fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:46:44 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-d6d2d5ea-f6a4-4a8d-aad4-9f19909a5bf7 req-58f73816-25eb-4c1b-9edb-3abffdca0310 service nova] Lock "fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:46:44 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-d6d2d5ea-f6a4-4a8d-aad4-9f19909a5bf7 req-58f73816-25eb-4c1b-9edb-3abffdca0310 service nova] Lock "fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:46:44 user nova-compute[73449]: DEBUG nova.compute.manager [req-d6d2d5ea-f6a4-4a8d-aad4-9f19909a5bf7 req-58f73816-25eb-4c1b-9edb-3abffdca0310 service nova] [instance: fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2] No waiting events found dispatching network-vif-unplugged-850d3d8f-2b5b-4e82-9c33-83f440f2a428 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:46:44 user nova-compute[73449]: DEBUG nova.compute.manager [req-d6d2d5ea-f6a4-4a8d-aad4-9f19909a5bf7 req-58f73816-25eb-4c1b-9edb-3abffdca0310 service nova] [instance: fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2] Received event network-vif-unplugged-850d3d8f-2b5b-4e82-9c33-83f440f2a428 for instance with task_state deleting. {{(pid=73449) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 11:46:44 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:46:44 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:46:44 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:46:44 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2] Instance destroyed successfully.
Aug 17 11:46:44 user nova-compute[73449]: DEBUG nova.objects.instance [None req-127177a9-cc98-48f7-9713-e56340f8dafa tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Lazy-loading 'resources' on Instance uuid fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:46:44 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-127177a9-cc98-48f7-9713-e56340f8dafa tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:40:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-818139989',display_name='tempest-VolumesAdminNegativeTest-server-818139989',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-818139989',id=5,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAYt3jjD8mFJIRzFJzYvggXhUydY1gZjkAmdg2KmwvJIRG1V5SRsfFdQMOj/WSLs2yODZFgpWb1vJz4f4y/s0dcZSQs6XzaAwUCBcvnAOIaRlbUiaiWaV72mm4zDO+vVWA==',key_name='tempest-keypair-61366657',keypairs=<?>,launch_index=0,launched_at=2023-08-17T11:40:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2513ad48149f45e2a2bd4b404ebc13b6',ramdisk_id='',reservation_id='r-h39aecbb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1247532735',owner_user_name='tempest-VolumesAdminNegativeTest-1247532735-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T11:40:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4cfe2e3e87454eb38768c2ed81450b1d',uuid=fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "850d3d8f-2b5b-4e82-9c33-83f440f2a428", "address": "fa:16:3e:de:a4:f4", "network": {"id": "ef0c44c4-ef68-433d-bfbc-71272ed64948", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-24887935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2513ad48149f45e2a2bd4b404ebc13b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap850d3d8f-2b", "ovs_interfaceid": "850d3d8f-2b5b-4e82-9c33-83f440f2a428", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 11:46:44 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-127177a9-cc98-48f7-9713-e56340f8dafa tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Converting VIF {"id": "850d3d8f-2b5b-4e82-9c33-83f440f2a428", "address": "fa:16:3e:de:a4:f4", "network": {"id": "ef0c44c4-ef68-433d-bfbc-71272ed64948", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-24887935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2513ad48149f45e2a2bd4b404ebc13b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap850d3d8f-2b", "ovs_interfaceid": "850d3d8f-2b5b-4e82-9c33-83f440f2a428", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:46:44 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-127177a9-cc98-48f7-9713-e56340f8dafa tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:de:a4:f4,bridge_name='br-int',has_traffic_filtering=True,id=850d3d8f-2b5b-4e82-9c33-83f440f2a428,network=Network(ef0c44c4-ef68-433d-bfbc-71272ed64948),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap850d3d8f-2b') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:46:44 user nova-compute[73449]: DEBUG os_vif [None req-127177a9-cc98-48f7-9713-e56340f8dafa tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:a4:f4,bridge_name='br-int',has_traffic_filtering=True,id=850d3d8f-2b5b-4e82-9c33-83f440f2a428,network=Network(ef0c44c4-ef68-433d-bfbc-71272ed64948),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap850d3d8f-2b') {{(pid=73449) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 11:46:44 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:46:44 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap850d3d8f-2b, bridge=br-int, if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:46:44 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:46:44 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:46:44 user nova-compute[73449]: INFO os_vif [None req-127177a9-cc98-48f7-9713-e56340f8dafa tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:a4:f4,bridge_name='br-int',has_traffic_filtering=True,id=850d3d8f-2b5b-4e82-9c33-83f440f2a428,network=Network(ef0c44c4-ef68-433d-bfbc-71272ed64948),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap850d3d8f-2b')
Aug 17 11:46:44 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-127177a9-cc98-48f7-9713-e56340f8dafa tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] [instance: fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2] Deleting instance files /opt/stack/data/nova/instances/fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2_del
Aug 17 11:46:44 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-127177a9-cc98-48f7-9713-e56340f8dafa tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] [instance: fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2] Deletion of /opt/stack/data/nova/instances/fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2_del complete
Aug 17 11:46:45 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:46:45 user nova-compute[73449]: INFO nova.compute.manager [None req-127177a9-cc98-48f7-9713-e56340f8dafa tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] [instance: fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2] Took 1.10 seconds to destroy the instance on the hypervisor.
Aug 17 11:46:45 user nova-compute[73449]: DEBUG oslo.service.loopingcall [None req-127177a9-cc98-48f7-9713-e56340f8dafa tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73449) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 11:46:45 user nova-compute[73449]: DEBUG nova.compute.manager [-] [instance: fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2] Deallocating network for instance {{(pid=73449) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 11:46:45 user nova-compute[73449]: DEBUG nova.network.neutron [-] [instance: fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2] deallocate_for_instance() {{(pid=73449) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 11:46:45 user nova-compute[73449]: DEBUG nova.network.neutron [req-58417524-3312-4d3f-9ad2-684ae57ddb4d req-97e2ee87-1c73-4cf1-8792-151e1891afea service nova] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Updated VIF entry in instance network info cache for port 599e177a-d05b-4d24-8c89-8a868182940c. {{(pid=73449) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 11:46:45 user nova-compute[73449]: DEBUG nova.network.neutron [req-58417524-3312-4d3f-9ad2-684ae57ddb4d req-97e2ee87-1c73-4cf1-8792-151e1891afea service nova] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Updating instance_info_cache with network_info: [{"id": "599e177a-d05b-4d24-8c89-8a868182940c", "address": "fa:16:3e:8d:36:ef", "network": {"id": "41adee44-4e1c-4cc6-aa63-8054da5d97b4", "bridge": "br-int", "label": "tempest-TestShelveInstance-1953236522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b906d3cc3acb46818cd2c9583f351893", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap599e177a-d0", "ovs_interfaceid": "599e177a-d05b-4d24-8c89-8a868182940c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:46:45 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-58417524-3312-4d3f-9ad2-684ae57ddb4d req-97e2ee87-1c73-4cf1-8792-151e1891afea service nova] Releasing lock "refresh_cache-5612f7d1-a901-4bdd-a24a-faf9a980cd04" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:46:45 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:46:45 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:46:45 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:46:45 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:46:46 user nova-compute[73449]: DEBUG nova.network.neutron [-] [instance: fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2] Updating instance_info_cache with network_info: [] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:46:46 user nova-compute[73449]: INFO nova.compute.manager [-] [instance: fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2] Took 1.44 seconds to deallocate network for instance.
Aug 17 11:46:46 user nova-compute[73449]: DEBUG nova.compute.manager [req-c906ab11-6856-43ea-9955-3b88f94670ca req-825fb059-07ec-4c8e-a7ae-94ad373d1f48 service nova] [instance: fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2] Received event network-vif-deleted-850d3d8f-2b5b-4e82-9c33-83f440f2a428 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:46:46 user nova-compute[73449]: DEBUG nova.compute.manager [req-a26ffd68-8376-4e02-aabf-0d4c5f3fc37e req-5c74d8f4-3cfa-4e53-a261-42d81f4f9a52 service nova] [instance: fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2] Received event network-vif-plugged-850d3d8f-2b5b-4e82-9c33-83f440f2a428 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:46:46 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-a26ffd68-8376-4e02-aabf-0d4c5f3fc37e req-5c74d8f4-3cfa-4e53-a261-42d81f4f9a52 service nova] Acquiring lock "fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:46:46 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-a26ffd68-8376-4e02-aabf-0d4c5f3fc37e req-5c74d8f4-3cfa-4e53-a261-42d81f4f9a52 service nova] Lock "fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:46:46 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-a26ffd68-8376-4e02-aabf-0d4c5f3fc37e req-5c74d8f4-3cfa-4e53-a261-42d81f4f9a52 service nova] Lock "fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:46:46 user nova-compute[73449]: DEBUG nova.compute.manager [req-a26ffd68-8376-4e02-aabf-0d4c5f3fc37e req-5c74d8f4-3cfa-4e53-a261-42d81f4f9a52 service nova] [instance: fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2] No waiting events found dispatching network-vif-plugged-850d3d8f-2b5b-4e82-9c33-83f440f2a428 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:46:46 user nova-compute[73449]: WARNING nova.compute.manager [req-a26ffd68-8376-4e02-aabf-0d4c5f3fc37e req-5c74d8f4-3cfa-4e53-a261-42d81f4f9a52 service nova] [instance: fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2] Received unexpected event network-vif-plugged-850d3d8f-2b5b-4e82-9c33-83f440f2a428 for instance with vm_state active and task_state deleting.
Aug 17 11:46:46 user nova-compute[73449]: DEBUG nova.compute.manager [req-a26ffd68-8376-4e02-aabf-0d4c5f3fc37e req-5c74d8f4-3cfa-4e53-a261-42d81f4f9a52 service nova] [instance: fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2] Received event network-vif-plugged-850d3d8f-2b5b-4e82-9c33-83f440f2a428 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:46:46 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-a26ffd68-8376-4e02-aabf-0d4c5f3fc37e req-5c74d8f4-3cfa-4e53-a261-42d81f4f9a52 service nova] Acquiring lock "fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:46:46 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-a26ffd68-8376-4e02-aabf-0d4c5f3fc37e req-5c74d8f4-3cfa-4e53-a261-42d81f4f9a52 service nova] Lock "fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:46:46 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-a26ffd68-8376-4e02-aabf-0d4c5f3fc37e req-5c74d8f4-3cfa-4e53-a261-42d81f4f9a52 service nova] Lock "fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:46:46 user nova-compute[73449]: DEBUG nova.compute.manager [req-a26ffd68-8376-4e02-aabf-0d4c5f3fc37e req-5c74d8f4-3cfa-4e53-a261-42d81f4f9a52 service nova] [instance: fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2] No waiting events found dispatching network-vif-plugged-850d3d8f-2b5b-4e82-9c33-83f440f2a428 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:46:46 user nova-compute[73449]: WARNING nova.compute.manager [req-a26ffd68-8376-4e02-aabf-0d4c5f3fc37e req-5c74d8f4-3cfa-4e53-a261-42d81f4f9a52 service nova] [instance: fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2] Received unexpected event network-vif-plugged-850d3d8f-2b5b-4e82-9c33-83f440f2a428 for instance with vm_state active and task_state deleting.
Aug 17 11:46:46 user nova-compute[73449]: DEBUG nova.compute.manager [req-a26ffd68-8376-4e02-aabf-0d4c5f3fc37e req-5c74d8f4-3cfa-4e53-a261-42d81f4f9a52 service nova] [instance: fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2] Received event network-vif-plugged-850d3d8f-2b5b-4e82-9c33-83f440f2a428 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:46:46 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-a26ffd68-8376-4e02-aabf-0d4c5f3fc37e req-5c74d8f4-3cfa-4e53-a261-42d81f4f9a52 service nova] Acquiring lock "fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:46:46 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-a26ffd68-8376-4e02-aabf-0d4c5f3fc37e req-5c74d8f4-3cfa-4e53-a261-42d81f4f9a52 service nova] Lock "fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:46:46 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-a26ffd68-8376-4e02-aabf-0d4c5f3fc37e req-5c74d8f4-3cfa-4e53-a261-42d81f4f9a52 service nova] Lock "fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:46:46 user nova-compute[73449]: DEBUG nova.compute.manager [req-a26ffd68-8376-4e02-aabf-0d4c5f3fc37e req-5c74d8f4-3cfa-4e53-a261-42d81f4f9a52 service nova] [instance: fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2] No waiting events found dispatching network-vif-plugged-850d3d8f-2b5b-4e82-9c33-83f440f2a428 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:46:46 user nova-compute[73449]: WARNING nova.compute.manager [req-a26ffd68-8376-4e02-aabf-0d4c5f3fc37e req-5c74d8f4-3cfa-4e53-a261-42d81f4f9a52 service nova] [instance: fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2] Received unexpected event network-vif-plugged-850d3d8f-2b5b-4e82-9c33-83f440f2a428 for instance with vm_state active and task_state deleting.
Aug 17 11:46:46 user nova-compute[73449]: DEBUG nova.compute.manager [req-a26ffd68-8376-4e02-aabf-0d4c5f3fc37e req-5c74d8f4-3cfa-4e53-a261-42d81f4f9a52 service nova] [instance: fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2] Received event network-vif-unplugged-850d3d8f-2b5b-4e82-9c33-83f440f2a428 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:46:46 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-a26ffd68-8376-4e02-aabf-0d4c5f3fc37e req-5c74d8f4-3cfa-4e53-a261-42d81f4f9a52 service nova] Acquiring lock "fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:46:46 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-a26ffd68-8376-4e02-aabf-0d4c5f3fc37e req-5c74d8f4-3cfa-4e53-a261-42d81f4f9a52 service nova] Lock "fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:46:46 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-a26ffd68-8376-4e02-aabf-0d4c5f3fc37e req-5c74d8f4-3cfa-4e53-a261-42d81f4f9a52 service nova] Lock "fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:46:46 user nova-compute[73449]: DEBUG nova.compute.manager [req-a26ffd68-8376-4e02-aabf-0d4c5f3fc37e req-5c74d8f4-3cfa-4e53-a261-42d81f4f9a52 service nova] [instance: fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2] No waiting events found dispatching network-vif-unplugged-850d3d8f-2b5b-4e82-9c33-83f440f2a428 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:46:46 user nova-compute[73449]: DEBUG nova.compute.manager [req-a26ffd68-8376-4e02-aabf-0d4c5f3fc37e req-5c74d8f4-3cfa-4e53-a261-42d81f4f9a52 service nova] [instance: fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2] Received event network-vif-unplugged-850d3d8f-2b5b-4e82-9c33-83f440f2a428 for instance with task_state deleting. {{(pid=73449) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 11:46:46 user nova-compute[73449]: DEBUG nova.compute.manager [req-a26ffd68-8376-4e02-aabf-0d4c5f3fc37e req-5c74d8f4-3cfa-4e53-a261-42d81f4f9a52 service nova] [instance: fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2] Received event network-vif-plugged-850d3d8f-2b5b-4e82-9c33-83f440f2a428 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:46:46 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-a26ffd68-8376-4e02-aabf-0d4c5f3fc37e req-5c74d8f4-3cfa-4e53-a261-42d81f4f9a52 service nova] Acquiring lock "fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:46:46 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-a26ffd68-8376-4e02-aabf-0d4c5f3fc37e req-5c74d8f4-3cfa-4e53-a261-42d81f4f9a52 service nova] Lock "fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:46:46 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-a26ffd68-8376-4e02-aabf-0d4c5f3fc37e req-5c74d8f4-3cfa-4e53-a261-42d81f4f9a52 service nova] Lock "fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:46:46 user nova-compute[73449]: DEBUG nova.compute.manager [req-a26ffd68-8376-4e02-aabf-0d4c5f3fc37e req-5c74d8f4-3cfa-4e53-a261-42d81f4f9a52 service nova] [instance: fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2] No waiting events found dispatching network-vif-plugged-850d3d8f-2b5b-4e82-9c33-83f440f2a428 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:46:46 user nova-compute[73449]: WARNING nova.compute.manager [req-a26ffd68-8376-4e02-aabf-0d4c5f3fc37e req-5c74d8f4-3cfa-4e53-a261-42d81f4f9a52 service nova] [instance: fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2] Received unexpected event network-vif-plugged-850d3d8f-2b5b-4e82-9c33-83f440f2a428 for instance with vm_state active and task_state deleting.
Aug 17 11:46:46 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-127177a9-cc98-48f7-9713-e56340f8dafa tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:46:46 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-127177a9-cc98-48f7-9713-e56340f8dafa tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:46:46 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-127177a9-cc98-48f7-9713-e56340f8dafa tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 11:46:46 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-127177a9-cc98-48f7-9713-e56340f8dafa tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 11:46:46 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-127177a9-cc98-48f7-9713-e56340f8dafa tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.376s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:46:47 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:46:47 user nova-compute[73449]: INFO nova.scheduler.client.report [None req-127177a9-cc98-48f7-9713-e56340f8dafa tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Deleted allocations for instance fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2
Aug 17 11:46:47 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-127177a9-cc98-48f7-9713-e56340f8dafa tempest-VolumesAdminNegativeTest-1247532735 tempest-VolumesAdminNegativeTest-1247532735-project-member] Lock "fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.161s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:46:47 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:46:48 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:46:48 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:46:48 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:46:49 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:46:50 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-24a62959-38e2-4ceb-9910-a9e8c1e6eb83 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Acquiring lock "b12d9412-be17-4908-a4c2-b80c0fa38fc0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:46:50 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-24a62959-38e2-4ceb-9910-a9e8c1e6eb83 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Lock "b12d9412-be17-4908-a4c2-b80c0fa38fc0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:46:50 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-24a62959-38e2-4ceb-9910-a9e8c1e6eb83 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Acquiring lock "b12d9412-be17-4908-a4c2-b80c0fa38fc0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:46:50 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-24a62959-38e2-4ceb-9910-a9e8c1e6eb83 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Lock "b12d9412-be17-4908-a4c2-b80c0fa38fc0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:46:50 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-24a62959-38e2-4ceb-9910-a9e8c1e6eb83 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Lock "b12d9412-be17-4908-a4c2-b80c0fa38fc0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:46:50 user nova-compute[73449]: INFO nova.compute.manager [None req-24a62959-38e2-4ceb-9910-a9e8c1e6eb83 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: b12d9412-be17-4908-a4c2-b80c0fa38fc0] Terminating instance
Aug 17 11:46:50 user nova-compute[73449]: DEBUG nova.compute.manager [None req-24a62959-38e2-4ceb-9910-a9e8c1e6eb83 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: b12d9412-be17-4908-a4c2-b80c0fa38fc0] Start destroying the instance on the hypervisor. {{(pid=73449) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 11:46:50 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:46:50 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:46:50 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:46:50 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:46:50 user nova-compute[73449]: DEBUG nova.compute.manager [req-b8531df4-fbb2-419d-8992-24b90e98f70d req-6ed51ca9-757d-4851-b9df-9f61f8cda905 service nova] [instance: b12d9412-be17-4908-a4c2-b80c0fa38fc0] Received event network-vif-unplugged-be4bd89d-1a52-49a7-8241-ca24224fb018 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:46:50 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-b8531df4-fbb2-419d-8992-24b90e98f70d req-6ed51ca9-757d-4851-b9df-9f61f8cda905 service nova] Acquiring lock "b12d9412-be17-4908-a4c2-b80c0fa38fc0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:46:50 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-b8531df4-fbb2-419d-8992-24b90e98f70d req-6ed51ca9-757d-4851-b9df-9f61f8cda905 service nova] Lock "b12d9412-be17-4908-a4c2-b80c0fa38fc0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:46:50 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-b8531df4-fbb2-419d-8992-24b90e98f70d req-6ed51ca9-757d-4851-b9df-9f61f8cda905 service nova] Lock "b12d9412-be17-4908-a4c2-b80c0fa38fc0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:46:50 user nova-compute[73449]: DEBUG nova.compute.manager [req-b8531df4-fbb2-419d-8992-24b90e98f70d req-6ed51ca9-757d-4851-b9df-9f61f8cda905 service nova] [instance: b12d9412-be17-4908-a4c2-b80c0fa38fc0] No waiting events found dispatching network-vif-unplugged-be4bd89d-1a52-49a7-8241-ca24224fb018 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:46:50 user nova-compute[73449]: DEBUG nova.compute.manager [req-b8531df4-fbb2-419d-8992-24b90e98f70d req-6ed51ca9-757d-4851-b9df-9f61f8cda905 service nova] [instance: b12d9412-be17-4908-a4c2-b80c0fa38fc0] Received event network-vif-unplugged-be4bd89d-1a52-49a7-8241-ca24224fb018 for instance with task_state deleting. {{(pid=73449) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 11:46:50 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:46:51 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: b12d9412-be17-4908-a4c2-b80c0fa38fc0] Instance destroyed successfully.
Aug 17 11:46:51 user nova-compute[73449]: DEBUG nova.objects.instance [None req-24a62959-38e2-4ceb-9910-a9e8c1e6eb83 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Lazy-loading 'resources' on Instance uuid b12d9412-be17-4908-a4c2-b80c0fa38fc0 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:46:51 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-24a62959-38e2-4ceb-9910-a9e8c1e6eb83 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:44:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-47931512',display_name='tempest-TestVolumeBootPattern-server-47931512',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-47931512',id=14,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T11:45:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4bd46cdaff7a4b40955f7c8a12c55452',ramdisk_id='',reservation_id='r-7ghfj8v7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-813872552',owner_user_name='tempest-TestVolumeBootPattern-813872552-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T11:45:28Z,user_data=None,user_id='804ccb0440fb46a4a4c0ae65c3893296',uuid=b12d9412-be17-4908-a4c2-b80c0fa38fc0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "be4bd89d-1a52-49a7-8241-ca24224fb018", "address": "fa:16:3e:f6:25:6f", "network": {"id": "a9e8fcd6-4152-466b-99ad-44b85db05a05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-920564935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bd46cdaff7a4b40955f7c8a12c55452", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe4bd89d-1a", "ovs_interfaceid": "be4bd89d-1a52-49a7-8241-ca24224fb018", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 11:46:51 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-24a62959-38e2-4ceb-9910-a9e8c1e6eb83 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Converting VIF {"id": "be4bd89d-1a52-49a7-8241-ca24224fb018", "address": "fa:16:3e:f6:25:6f", "network": {"id": "a9e8fcd6-4152-466b-99ad-44b85db05a05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-920564935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bd46cdaff7a4b40955f7c8a12c55452", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe4bd89d-1a", "ovs_interfaceid": "be4bd89d-1a52-49a7-8241-ca24224fb018", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:46:51 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-24a62959-38e2-4ceb-9910-a9e8c1e6eb83 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:25:6f,bridge_name='br-int',has_traffic_filtering=True,id=be4bd89d-1a52-49a7-8241-ca24224fb018,network=Network(a9e8fcd6-4152-466b-99ad-44b85db05a05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe4bd89d-1a') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:46:51 user nova-compute[73449]: DEBUG os_vif [None req-24a62959-38e2-4ceb-9910-a9e8c1e6eb83 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:25:6f,bridge_name='br-int',has_traffic_filtering=True,id=be4bd89d-1a52-49a7-8241-ca24224fb018,network=Network(a9e8fcd6-4152-466b-99ad-44b85db05a05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe4bd89d-1a') {{(pid=73449) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 11:46:51 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:46:51 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbe4bd89d-1a, bridge=br-int, if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:46:51 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:46:51 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:46:51 user nova-compute[73449]: INFO os_vif [None req-24a62959-38e2-4ceb-9910-a9e8c1e6eb83 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:25:6f,bridge_name='br-int',has_traffic_filtering=True,id=be4bd89d-1a52-49a7-8241-ca24224fb018,network=Network(a9e8fcd6-4152-466b-99ad-44b85db05a05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe4bd89d-1a')
Aug 17 11:46:51 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24a62959-38e2-4ceb-9910-a9e8c1e6eb83 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: b12d9412-be17-4908-a4c2-b80c0fa38fc0] calling os-brick to detach iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 11:46:51 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-24a62959-38e2-4ceb-9910-a9e8c1e6eb83 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, {'target_iqns': ['iqn.2010-10.org.openstack:d22566b5-74eb-4aeb-b14c-0bd5aa9e35ee'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QGUcqwyf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 11:46:51 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-24a62959-38e2-4ceb-9910-a9e8c1e6eb83 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 11:46:51 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-24a62959-38e2-4ceb-9910-a9e8c1e6eb83 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:46:51 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-24a62959-38e2-4ceb-9910-a9e8c1e6eb83 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:46:51 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-24a62959-38e2-4ceb-9910-a9e8c1e6eb83 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d22566b5-74eb-4aeb-b14c-0bd5aa9e35ee', 0)] {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 11:46:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:46:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:46:51 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb4f7eed-3ef5-4e9b-9f25-de73c0d34829]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d22566b5-74eb-4aeb-b14c-0bd5aa9e35ee\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:46:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:46:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:46:51 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[d27aaacf-6872-47b6-9816-3bc303bba37a]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d22566b5-74eb-4aeb-b14c-0bd5aa9e35ee (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466 (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:46:51 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-24a62959-38e2-4ceb-9910-a9e8c1e6eb83 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d22566b5-74eb-4aeb-b14c-0bd5aa9e35ee (non-flash)
Aug 17 11:46:51 user nova-compute[73449]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed (non-flash)
Aug 17 11:46:51 user nova-compute[73449]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466 (non-flash)
Aug 17 11:46:51 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:46:51 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-24a62959-38e2-4ceb-9910-a9e8c1e6eb83 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d22566b5-74eb-4aeb-b14c-0bd5aa9e35ee (non-flash)
Aug 17 11:46:51 user nova-compute[73449]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed (non-flash)
Aug 17 11:46:51 user nova-compute[73449]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466 (non-flash)
Aug 17 11:46:51 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:46:51 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-24a62959-38e2-4ceb-9910-a9e8c1e6eb83 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe7582ed2d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d22566b5-74eb-4aeb-b14c-0bd5aa9e35ee'): ({'sdb'}, set())}) {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 11:46:51 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-24a62959-38e2-4ceb-9910-a9e8c1e6eb83 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Removing single pathed devices sdb {{(pid=73449) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 11:46:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:46:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:46:51 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[2195498e-508e-4180-9ca2-189a67c26c55]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:46:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:46:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:46:51 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[9925b178-93d8-4733-9ac5-a1ff748cb04b]: (4, ('ok\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:46:51 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-24a62959-38e2-4ceb-9910-a9e8c1e6eb83 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Flushing IO for device /dev/sdb {{(pid=73449) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 11:46:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:46:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:46:51 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1066c8c-d3db-422e-b633-e368283465ee]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:46:51 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-24a62959-38e2-4ceb-9910-a9e8c1e6eb83 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73449) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 11:46:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:46:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:46:51 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[a99d6f4d-8fdd-43e3-b6ce-14cdae54b39d]: (4, ('1', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:46:51 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-24a62959-38e2-4ceb-9910-a9e8c1e6eb83 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73449) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 11:46:51 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-24a62959-38e2-4ceb-9910-a9e8c1e6eb83 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] SCSI volumes sdb have been removed. {{(pid=73449) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 11:46:51 user nova-compute[73449]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_5633f1ea', '/dev/disk/by-id/scsi-23836343163326236', '/dev/disk/by-id/scsi-1SCST_BIO5633f1ea-8641c2b6b0bd11dd') {{(pid=84309) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 17 11:46:51 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a4a7d9-f4e5-4f20-bc02-6e84d69669c9]: (4, None) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:46:51 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-24a62959-38e2-4ceb-9910-a9e8c1e6eb83 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d22566b5-74eb-4aeb-b14c-0bd5aa9e35ee')] {{(pid=73449) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 11:46:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d22566b5-74eb-4aeb-b14c-0bd5aa9e35ee -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:46:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d22566b5-74eb-4aeb-b14c-0bd5aa9e35ee -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:46:51 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fdcd8df-ac33-44de-84ac-078270e941e3]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:46:51 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-24a62959-38e2-4ceb-9910-a9e8c1e6eb83 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:46:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d22566b5-74eb-4aeb-b14c-0bd5aa9e35ee -p 172.16.0.220:3260 --logout {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:46:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d22566b5-74eb-4aeb-b14c-0bd5aa9e35ee -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:46:51 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[f930a03a-e9c0-40eb-9ca5-7654c48795b7]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:d22566b5-74eb-4aeb-b14c-0bd5aa9e35ee, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:d22566b5-74eb-4aeb-b14c-0bd5aa9e35ee, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:46:51 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-24a62959-38e2-4ceb-9910-a9e8c1e6eb83 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:d22566b5-74eb-4aeb-b14c-0bd5aa9e35ee, portal: 172.16.0.220,3260]
Aug 17 11:46:51 user nova-compute[73449]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:d22566b5-74eb-4aeb-b14c-0bd5aa9e35ee, portal: 172.16.0.220,3260] successful.
Aug 17 11:46:51 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:46:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d22566b5-74eb-4aeb-b14c-0bd5aa9e35ee -p 172.16.0.220:3260 --op delete {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:46:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d22566b5-74eb-4aeb-b14c-0bd5aa9e35ee -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:46:51 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[62fb380b-83f2-4b43-ae30-6c827b80c998]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:46:51 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-24a62959-38e2-4ceb-9910-a9e8c1e6eb83 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:46:51 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-24a62959-38e2-4ceb-9910-a9e8c1e6eb83 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:46:51 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-24a62959-38e2-4ceb-9910-a9e8c1e6eb83 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] <== disconnect_volume: return (317ms) None {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 11:46:51 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24a62959-38e2-4ceb-9910-a9e8c1e6eb83 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: b12d9412-be17-4908-a4c2-b80c0fa38fc0] Disconnected iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 11:46:51 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-24a62959-38e2-4ceb-9910-a9e8c1e6eb83 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: b12d9412-be17-4908-a4c2-b80c0fa38fc0] Deleting instance files /opt/stack/data/nova/instances/b12d9412-be17-4908-a4c2-b80c0fa38fc0_del
Aug 17 11:46:51 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-24a62959-38e2-4ceb-9910-a9e8c1e6eb83 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: b12d9412-be17-4908-a4c2-b80c0fa38fc0] Deletion of /opt/stack/data/nova/instances/b12d9412-be17-4908-a4c2-b80c0fa38fc0_del complete
Aug 17 11:46:51 user nova-compute[73449]: INFO nova.compute.manager [None req-24a62959-38e2-4ceb-9910-a9e8c1e6eb83 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: b12d9412-be17-4908-a4c2-b80c0fa38fc0] Took 1.17 seconds to destroy the instance on the hypervisor.
Aug 17 11:46:51 user nova-compute[73449]: DEBUG oslo.service.loopingcall [None req-24a62959-38e2-4ceb-9910-a9e8c1e6eb83 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73449) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 11:46:51 user nova-compute[73449]: DEBUG nova.compute.manager [-] [instance: b12d9412-be17-4908-a4c2-b80c0fa38fc0] Deallocating network for instance {{(pid=73449) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 11:46:51 user nova-compute[73449]: DEBUG nova.network.neutron [-] [instance: b12d9412-be17-4908-a4c2-b80c0fa38fc0] deallocate_for_instance() {{(pid=73449) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 11:46:51 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:46:51 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73449) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 11:46:52 user nova-compute[73449]: DEBUG nova.network.neutron [-] [instance: b12d9412-be17-4908-a4c2-b80c0fa38fc0] Updating instance_info_cache with network_info: [] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:46:52 user nova-compute[73449]: INFO nova.compute.manager [-] [instance: b12d9412-be17-4908-a4c2-b80c0fa38fc0] Took 0.61 seconds to deallocate network for instance.
Aug 17 11:46:52 user nova-compute[73449]: DEBUG nova.compute.manager [req-fa1a12fb-75d3-4613-a4c7-8d787f1a57a0 req-3bc01972-ddd2-4d6b-a7a8-642fd77434a9 service nova] [instance: b12d9412-be17-4908-a4c2-b80c0fa38fc0] Received event network-vif-deleted-be4bd89d-1a52-49a7-8241-ca24224fb018 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:46:52 user nova-compute[73449]: INFO nova.compute.manager [req-fa1a12fb-75d3-4613-a4c7-8d787f1a57a0 req-3bc01972-ddd2-4d6b-a7a8-642fd77434a9 service nova] [instance: b12d9412-be17-4908-a4c2-b80c0fa38fc0] Neutron deleted interface be4bd89d-1a52-49a7-8241-ca24224fb018; detaching it from the instance and deleting it from the info cache
Aug 17 11:46:52 user nova-compute[73449]: DEBUG nova.network.neutron [req-fa1a12fb-75d3-4613-a4c7-8d787f1a57a0 req-3bc01972-ddd2-4d6b-a7a8-642fd77434a9 service nova] [instance: b12d9412-be17-4908-a4c2-b80c0fa38fc0] Updating instance_info_cache with network_info: [] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:46:52 user nova-compute[73449]: DEBUG nova.compute.manager [req-fa1a12fb-75d3-4613-a4c7-8d787f1a57a0 req-3bc01972-ddd2-4d6b-a7a8-642fd77434a9 service nova] [instance: b12d9412-be17-4908-a4c2-b80c0fa38fc0] Detach interface failed, port_id=be4bd89d-1a52-49a7-8241-ca24224fb018, reason: Instance b12d9412-be17-4908-a4c2-b80c0fa38fc0 could not be found. {{(pid=73449) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 11:46:52 user nova-compute[73449]: DEBUG nova.compute.manager [req-cf807f36-b3d4-41b2-bfda-eb3842ab8846 req-f3f9b33a-6900-4a8a-9794-1080e1a4d9a4 service nova] [instance: b12d9412-be17-4908-a4c2-b80c0fa38fc0] Received event network-vif-plugged-be4bd89d-1a52-49a7-8241-ca24224fb018 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:46:52 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-cf807f36-b3d4-41b2-bfda-eb3842ab8846 req-f3f9b33a-6900-4a8a-9794-1080e1a4d9a4 service nova] Acquiring lock "b12d9412-be17-4908-a4c2-b80c0fa38fc0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:46:52 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-cf807f36-b3d4-41b2-bfda-eb3842ab8846 req-f3f9b33a-6900-4a8a-9794-1080e1a4d9a4 service nova] Lock "b12d9412-be17-4908-a4c2-b80c0fa38fc0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:46:52 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-cf807f36-b3d4-41b2-bfda-eb3842ab8846 req-f3f9b33a-6900-4a8a-9794-1080e1a4d9a4 service nova] Lock "b12d9412-be17-4908-a4c2-b80c0fa38fc0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:46:52 user nova-compute[73449]: DEBUG nova.compute.manager [req-cf807f36-b3d4-41b2-bfda-eb3842ab8846 req-f3f9b33a-6900-4a8a-9794-1080e1a4d9a4 service nova] [instance: b12d9412-be17-4908-a4c2-b80c0fa38fc0] No waiting events found dispatching network-vif-plugged-be4bd89d-1a52-49a7-8241-ca24224fb018 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:46:52 user nova-compute[73449]: WARNING nova.compute.manager [req-cf807f36-b3d4-41b2-bfda-eb3842ab8846 req-f3f9b33a-6900-4a8a-9794-1080e1a4d9a4 service nova] [instance: b12d9412-be17-4908-a4c2-b80c0fa38fc0] Received unexpected event network-vif-plugged-be4bd89d-1a52-49a7-8241-ca24224fb018 for instance with vm_state active and task_state deleting.
Aug 17 11:46:52 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:46:53 user nova-compute[73449]: INFO nova.compute.manager [None req-24a62959-38e2-4ceb-9910-a9e8c1e6eb83 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: b12d9412-be17-4908-a4c2-b80c0fa38fc0] Took 0.80 seconds to detach 1 volumes for instance.
Aug 17 11:46:53 user nova-compute[73449]: DEBUG nova.compute.manager [None req-24a62959-38e2-4ceb-9910-a9e8c1e6eb83 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: b12d9412-be17-4908-a4c2-b80c0fa38fc0] Deleting volume: d22566b5-74eb-4aeb-b14c-0bd5aa9e35ee {{(pid=73449) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 17 11:46:53 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-24a62959-38e2-4ceb-9910-a9e8c1e6eb83 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:46:53 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-24a62959-38e2-4ceb-9910-a9e8c1e6eb83 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:46:53 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-24a62959-38e2-4ceb-9910-a9e8c1e6eb83 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 11:46:53 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-24a62959-38e2-4ceb-9910-a9e8c1e6eb83 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 11:46:53 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-24a62959-38e2-4ceb-9910-a9e8c1e6eb83 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.391s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:46:53 user nova-compute[73449]: INFO nova.scheduler.client.report [None req-24a62959-38e2-4ceb-9910-a9e8c1e6eb83 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Deleted allocations for instance b12d9412-be17-4908-a4c2-b80c0fa38fc0
Aug 17 11:46:53 user nova-compute[73449]: DEBUG nova.compute.manager [None req-0d6d0da4-cd7c-4fb2-a65e-3f3b75d734f6 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Start spawning the instance on the hypervisor. {{(pid=73449) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 11:46:53 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-0d6d0da4-cd7c-4fb2-a65e-3f3b75d734f6 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Creating instance directory {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 11:46:53 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-0d6d0da4-cd7c-4fb2-a65e-3f3b75d734f6 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Creating image(s)
Aug 17 11:46:53 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-0d6d0da4-cd7c-4fb2-a65e-3f3b75d734f6 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Did not create local disks {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 11:46:53 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-0d6d0da4-cd7c-4fb2-a65e-3f3b75d734f6 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Ensure instance console log exists: /opt/stack/data/nova/instances/5612f7d1-a901-4bdd-a24a-faf9a980cd04/console.log {{(pid=73449) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 11:46:53 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-0d6d0da4-cd7c-4fb2-a65e-3f3b75d734f6 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:46:53 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-0d6d0da4-cd7c-4fb2-a65e-3f3b75d734f6 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:46:53 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-0d6d0da4-cd7c-4fb2-a65e-3f3b75d734f6 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:46:53 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-0d6d0da4-cd7c-4fb2-a65e-3f3b75d734f6 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Start _get_guest_xml network_info=[{"id": "599e177a-d05b-4d24-8c89-8a868182940c", "address": "fa:16:3e:8d:36:ef", "network": {"id": "41adee44-4e1c-4cc6-aa63-8054da5d97b4", "bridge": "br-int", "label": "tempest-TestShelveInstance-1953236522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b906d3cc3acb46818cd2c9583f351893", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap599e177a-d0", "ovs_interfaceid": "599e177a-d05b-4d24-8c89-8a868182940c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'attachment_id': '2e81ae58-3f12-47de-9393-f1fecdbe869f', 'boot_index': 0, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zWFHJgbD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5612f7d1-a901-4bdd-a24a-faf9a980cd04', 'attached_at': '', 'detached_at': '', 'volume_id': 'fc3c38dd-5692-448f-b1fc-b8fe08052611', 'serial': 'fc3c38dd-5692-448f-b1fc-b8fe08052611'}, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 11:46:53 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-0d6d0da4-cd7c-4fb2-a65e-3f3b75d734f6 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:46:53 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-0d6d0da4-cd7c-4fb2-a65e-3f3b75d734f6 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:46:53 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-0d6d0da4-cd7c-4fb2-a65e-3f3b75d734f6 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 11:46:53 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-0d6d0da4-cd7c-4fb2-a65e-3f3b75d734f6 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] CPU controller missing on host. {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 11:46:53 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-0d6d0da4-cd7c-4fb2-a65e-3f3b75d734f6 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 11:46:53 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-0d6d0da4-cd7c-4fb2-a65e-3f3b75d734f6 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] CPU controller found on host. {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 11:46:53 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-0d6d0da4-cd7c-4fb2-a65e-3f3b75d734f6 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73449) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 11:46:53 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-0d6d0da4-cd7c-4fb2-a65e-3f3b75d734f6 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T11:35:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 11:46:53 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-0d6d0da4-cd7c-4fb2-a65e-3f3b75d734f6 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Flavor limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 11:46:53 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-0d6d0da4-cd7c-4fb2-a65e-3f3b75d734f6 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Image limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 11:46:53 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-0d6d0da4-cd7c-4fb2-a65e-3f3b75d734f6 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Flavor pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 11:46:53 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-0d6d0da4-cd7c-4fb2-a65e-3f3b75d734f6 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Image pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 11:46:53 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-0d6d0da4-cd7c-4fb2-a65e-3f3b75d734f6 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 11:46:53 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-0d6d0da4-cd7c-4fb2-a65e-3f3b75d734f6 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 11:46:53 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-0d6d0da4-cd7c-4fb2-a65e-3f3b75d734f6 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 11:46:53 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-0d6d0da4-cd7c-4fb2-a65e-3f3b75d734f6 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Got 1 possible topologies {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 11:46:53 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-0d6d0da4-cd7c-4fb2-a65e-3f3b75d734f6 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 11:46:53 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-0d6d0da4-cd7c-4fb2-a65e-3f3b75d734f6 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 11:46:53 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d6d0da4-cd7c-4fb2-a65e-3f3b75d734f6 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Calling os-brick to attach iSCSI Volume {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 11:46:53 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d6d0da4-cd7c-4fb2-a65e-3f3b75d734f6 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zWFHJgbD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 11:46:53 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-0d6d0da4-cd7c-4fb2-a65e-3f3b75d734f6 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 11:46:53 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-0d6d0da4-cd7c-4fb2-a65e-3f3b75d734f6 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:46:53 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-0d6d0da4-cd7c-4fb2-a65e-3f3b75d734f6 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:46:53 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-0d6d0da4-cd7c-4fb2-a65e-3f3b75d734f6 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 11:46:53 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-0d6d0da4-cd7c-4fb2-a65e-3f3b75d734f6 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:46:53 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-0d6d0da4-cd7c-4fb2-a65e-3f3b75d734f6 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:46:53 user nova-compute[73449]: INFO os_brick.initiator.connectors.iscsi [None req-0d6d0da4-cd7c-4fb2-a65e-3f3b75d734f6 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 11:46:53 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611 -p 172.16.0.220:3260 {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:46:53 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-24a62959-38e2-4ceb-9910-a9e8c1e6eb83 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Lock "b12d9412-be17-4908-a4c2-b80c0fa38fc0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.260s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:46:53 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:46:53 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bcdfff3-0776-4fea-985b-b00b96935039]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:46:53 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d6d0da4-cd7c-4fb2-a65e-3f3b75d734f6 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 11:46:53 user nova-compute[73449]:  {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:46:53 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611 -p 172.16.0.220:3260 --interface default --op new {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:46:53 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:46:53 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc9a98cd-8564-4922-836c-ffd4fa03bf91]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611] added\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:46:53 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d6d0da4-cd7c-4fb2-a65e-3f3b75d734f6 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611] added
Aug 17 11:46:53 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:46:53 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:46:53 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:46:53 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[13f56b65-f908-45d8-aa18-cfe1c619c6fc]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:46:53 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d6d0da4-cd7c-4fb2-a65e-3f3b75d734f6 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:46:53 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:46:53 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:46:53 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c0e1caf-c17d-4f29-b0f0-122ab06de43a]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:46:53 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d6d0da4-cd7c-4fb2-a65e-3f3b75d734f6 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:46:53 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zWFHJgbD {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:46:53 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zWFHJgbD" returned: 0 in 0.016s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:46:53 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa517cca-89b5-4a4a-b451-fbbfc5cf24b5]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:46:53 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d6d0da4-cd7c-4fb2-a65e-3f3b75d734f6 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zWFHJgbD'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:46:53 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:46:53 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:46:53 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[90c5e0fe-ec42-4a20-8c09-1044f2c214b9]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:46:53 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d6d0da4-cd7c-4fb2-a65e-3f3b75d734f6 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:46:53 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:46:53 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:46:53 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bc69081-6555-4882-9856-12e15bc146a9]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466 (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:46:53 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d6d0da4-cd7c-4fb2-a65e-3f3b75d734f6 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed (non-flash)
Aug 17 11:46:53 user nova-compute[73449]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466 (non-flash)
Aug 17 11:46:53 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:46:53 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d6d0da4-cd7c-4fb2-a65e-3f3b75d734f6 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed (non-flash)
Aug 17 11:46:53 user nova-compute[73449]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466 (non-flash)
Aug 17 11:46:53 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:46:53 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611 -p 172.16.0.220:3260 --login {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:46:53 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:46:53 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Starting heal instance info cache {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 11:46:53 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:46:53 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f72f520-79cd-4980-92c7-c0fa0f29e1f7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:46:53 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d6d0da4-cd7c-4fb2-a65e-3f3b75d734f6 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611, portal: 172.16.0.220,3260]
Aug 17 11:46:53 user nova-compute[73449]: Login to [iface: default, target: iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611, portal: 172.16.0.220,3260] successful.
Aug 17 11:46:53 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:46:53 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:46:54 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:46:54 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[1722149e-f1ff-4326-a659-f80fe9206380]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:46:54 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d6d0da4-cd7c-4fb2-a65e-3f3b75d734f6 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:46:54 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:46:54 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:46:54 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e4716c3-1ca6-4b66-b8d4-91d3cc04c376]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611 (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:46:54 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d6d0da4-cd7c-4fb2-a65e-3f3b75d734f6 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed (non-flash)
Aug 17 11:46:54 user nova-compute[73449]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466 (non-flash)
Aug 17 11:46:54 user nova-compute[73449]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611 (non-flash)
Aug 17 11:46:54 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:46:54 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d6d0da4-cd7c-4fb2-a65e-3f3b75d734f6 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed (non-flash)
Aug 17 11:46:54 user nova-compute[73449]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466 (non-flash)
Aug 17 11:46:54 user nova-compute[73449]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611 (non-flash)
Aug 17 11:46:54 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:46:54 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-0d6d0da4-cd7c-4fb2-a65e-3f3b75d734f6 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:46:54 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d6d0da4-cd7c-4fb2-a65e-3f3b75d734f6 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Connected to 172.16.0.220:3260 {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 11:46:54 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-0d6d0da4-cd7c-4fb2-a65e-3f3b75d734f6 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] HCTL ('33', '-', '-', 0) found on session 20 with lun 0 {{(pid=73449) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 11:46:54 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-0d6d0da4-cd7c-4fb2-a65e-3f3b75d734f6 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73449) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 11:46:54 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:46:54 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:46:54 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd88d877-2776-47d1-ae21-fb08c45ccb53]: (4, ('- - 0', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:46:54 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-0d6d0da4-cd7c-4fb2-a65e-3f3b75d734f6 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Searching for a device in session 20 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73449) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 11:46:54 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d6d0da4-cd7c-4fb2-a65e-3f3b75d734f6 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zWFHJgbD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 11:46:54 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "refresh_cache-a3523d22-7165-46ad-be10-5e6ae374f91d" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:46:54 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquired lock "refresh_cache-a3523d22-7165-46ad-be10-5e6ae374f91d" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:46:54 user nova-compute[73449]: DEBUG nova.network.neutron [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Forcefully refreshing network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 11:46:54 user nova-compute[73449]: DEBUG nova.network.neutron [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Updating instance_info_cache with network_info: [{"id": "2a0eb61f-9398-4db6-9ae0-f142ad2e60c4", "address": "fa:16:3e:15:cd:09", "network": {"id": "d54a402f-1fa9-43d8-b68e-0aa7ae6f0e73", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1441085328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eed9899860d4e7ca8a4500bbda4be13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a0eb61f-93", "ovs_interfaceid": "2a0eb61f-9398-4db6-9ae0-f142ad2e60c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:46:54 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Releasing lock "refresh_cache-a3523d22-7165-46ad-be10-5e6ae374f91d" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:46:54 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Updated the network info_cache for instance {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 11:46:54 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:46:54 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:46:54 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:46:54 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:46:54 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=73449) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 11:46:54 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c69e7643-8c60-4982-986b-484e8cfc3fa9/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:46:54 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c69e7643-8c60-4982-986b-484e8cfc3fa9/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:46:54 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c69e7643-8c60-4982-986b-484e8cfc3fa9/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:46:55 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-0d6d0da4-cd7c-4fb2-a65e-3f3b75d734f6 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.320s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:46:55 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d6d0da4-cd7c-4fb2-a65e-3f3b75d734f6 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] <== connect_volume: return (1324ms) {'type': 'block', 'scsi_wwn': '23738386630383739', 'path': '/dev/sdb'} {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 11:46:55 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d6d0da4-cd7c-4fb2-a65e-3f3b75d734f6 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23738386630383739', 'path': '/dev/sdb'} {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 11:46:55 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-0d6d0da4-cd7c-4fb2-a65e-3f3b75d734f6 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:46:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1849786392',display_name='tempest-TestShelveInstance-server-1849786392',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1849786392',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA55lazAqHP3vcEkHgxf0GkDCEWKxw301Wqk4UvPSVrCTPIFpM0ItDTNB5vmnGG+ellud4ExTu114P7nZoUxO7bGtJGKBcvDyG2fdaDBOPDuLrsnSKO7Wa6GZ9ttkbdXeA==',key_name='tempest-TestShelveInstance-1460867700',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b906d3cc3acb46818cd2c9583f351893',ramdisk_id='',reservation_id='r-6d1v12wz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-917557205',owner_user_name='tempest-TestShelveInstance-917557205-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T11:46:42Z,user_data=None,user_id='db7e0b2abd4b4df3b2e7886ddc3840c0',uuid=5612f7d1-a901-4bdd-a24a-faf9a980cd04,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "599e177a-d05b-4d24-8c89-8a868182940c", "address": "fa:16:3e:8d:36:ef", "network": {"id": "41adee44-4e1c-4cc6-aa63-8054da5d97b4", "bridge": "br-int", "label": "tempest-TestShelveInstance-1953236522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b906d3cc3acb46818cd2c9583f351893", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap599e177a-d0", "ovs_interfaceid": "599e177a-d05b-4d24-8c89-8a868182940c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73449) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 11:46:55 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-0d6d0da4-cd7c-4fb2-a65e-3f3b75d734f6 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Converting VIF {"id": "599e177a-d05b-4d24-8c89-8a868182940c", "address": "fa:16:3e:8d:36:ef", "network": {"id": "41adee44-4e1c-4cc6-aa63-8054da5d97b4", "bridge": "br-int", "label": "tempest-TestShelveInstance-1953236522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b906d3cc3acb46818cd2c9583f351893", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap599e177a-d0", "ovs_interfaceid": "599e177a-d05b-4d24-8c89-8a868182940c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:46:55 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-0d6d0da4-cd7c-4fb2-a65e-3f3b75d734f6 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:36:ef,bridge_name='br-int',has_traffic_filtering=True,id=599e177a-d05b-4d24-8c89-8a868182940c,network=Network(41adee44-4e1c-4cc6-aa63-8054da5d97b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap599e177a-d0') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:46:55 user nova-compute[73449]: DEBUG nova.objects.instance [None req-0d6d0da4-cd7c-4fb2-a65e-3f3b75d734f6 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Lazy-loading 'pci_devices' on Instance uuid 5612f7d1-a901-4bdd-a24a-faf9a980cd04 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:46:55 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-0d6d0da4-cd7c-4fb2-a65e-3f3b75d734f6 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] End _get_guest_xml xml=<domain type="kvm">
Aug 17 11:46:55 user nova-compute[73449]:   <uuid>5612f7d1-a901-4bdd-a24a-faf9a980cd04</uuid>
Aug 17 11:46:55 user nova-compute[73449]:   <name>instance-00000015</name>
Aug 17 11:46:55 user nova-compute[73449]:   <memory>524288</memory>
Aug 17 11:46:55 user nova-compute[73449]:   <vcpu>1</vcpu>
Aug 17 11:46:55 user nova-compute[73449]:   <metadata>
Aug 17 11:46:55 user nova-compute[73449]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 11:46:55 user nova-compute[73449]:       <nova:package version="0.0.0"/>
Aug 17 11:46:55 user nova-compute[73449]:       <nova:name>tempest-TestShelveInstance-server-1849786392</nova:name>
Aug 17 11:46:55 user nova-compute[73449]:       <nova:creationTime>2023-08-17 11:46:53</nova:creationTime>
Aug 17 11:46:55 user nova-compute[73449]:       <nova:flavor name="m1.tiny">
Aug 17 11:46:55 user nova-compute[73449]:         <nova:memory>512</nova:memory>
Aug 17 11:46:55 user nova-compute[73449]:         <nova:disk>1</nova:disk>
Aug 17 11:46:55 user nova-compute[73449]:         <nova:swap>0</nova:swap>
Aug 17 11:46:55 user nova-compute[73449]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 11:46:55 user nova-compute[73449]:         <nova:vcpus>1</nova:vcpus>
Aug 17 11:46:55 user nova-compute[73449]:       </nova:flavor>
Aug 17 11:46:55 user nova-compute[73449]:       <nova:owner>
Aug 17 11:46:55 user nova-compute[73449]:         <nova:user uuid="db7e0b2abd4b4df3b2e7886ddc3840c0">tempest-TestShelveInstance-917557205-project-member</nova:user>
Aug 17 11:46:55 user nova-compute[73449]:         <nova:project uuid="b906d3cc3acb46818cd2c9583f351893">tempest-TestShelveInstance-917557205</nova:project>
Aug 17 11:46:55 user nova-compute[73449]:       </nova:owner>
Aug 17 11:46:55 user nova-compute[73449]:       <nova:ports>
Aug 17 11:46:55 user nova-compute[73449]:         <nova:port uuid="599e177a-d05b-4d24-8c89-8a868182940c">
Aug 17 11:46:55 user nova-compute[73449]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 17 11:46:55 user nova-compute[73449]:         </nova:port>
Aug 17 11:46:55 user nova-compute[73449]:       </nova:ports>
Aug 17 11:46:55 user nova-compute[73449]:     </nova:instance>
Aug 17 11:46:55 user nova-compute[73449]:   </metadata>
Aug 17 11:46:55 user nova-compute[73449]:   <sysinfo type="smbios">
Aug 17 11:46:55 user nova-compute[73449]:     <system>
Aug 17 11:46:55 user nova-compute[73449]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 11:46:55 user nova-compute[73449]:       <entry name="product">OpenStack Nova</entry>
Aug 17 11:46:55 user nova-compute[73449]:       <entry name="version">0.0.0</entry>
Aug 17 11:46:55 user nova-compute[73449]:       <entry name="serial">5612f7d1-a901-4bdd-a24a-faf9a980cd04</entry>
Aug 17 11:46:55 user nova-compute[73449]:       <entry name="uuid">5612f7d1-a901-4bdd-a24a-faf9a980cd04</entry>
Aug 17 11:46:55 user nova-compute[73449]:       <entry name="family">Virtual Machine</entry>
Aug 17 11:46:55 user nova-compute[73449]:     </system>
Aug 17 11:46:55 user nova-compute[73449]:   </sysinfo>
Aug 17 11:46:55 user nova-compute[73449]:   <os>
Aug 17 11:46:55 user nova-compute[73449]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 11:46:55 user nova-compute[73449]:     <boot dev="hd"/>
Aug 17 11:46:55 user nova-compute[73449]:     <smbios mode="sysinfo"/>
Aug 17 11:46:55 user nova-compute[73449]:   </os>
Aug 17 11:46:55 user nova-compute[73449]:   <features>
Aug 17 11:46:55 user nova-compute[73449]:     <acpi/>
Aug 17 11:46:55 user nova-compute[73449]:     <apic/>
Aug 17 11:46:55 user nova-compute[73449]:     <vmcoreinfo/>
Aug 17 11:46:55 user nova-compute[73449]:   </features>
Aug 17 11:46:55 user nova-compute[73449]:   <clock offset="utc">
Aug 17 11:46:55 user nova-compute[73449]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 11:46:55 user nova-compute[73449]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 11:46:55 user nova-compute[73449]:     <timer name="hpet" present="no"/>
Aug 17 11:46:55 user nova-compute[73449]:   </clock>
Aug 17 11:46:55 user nova-compute[73449]:   <cpu mode="custom" match="exact">
Aug 17 11:46:55 user nova-compute[73449]:     <model>Nehalem</model>
Aug 17 11:46:55 user nova-compute[73449]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 11:46:55 user nova-compute[73449]:   </cpu>
Aug 17 11:46:55 user nova-compute[73449]:   <devices>
Aug 17 11:46:55 user nova-compute[73449]:     <disk type="block" device="disk">
Aug 17 11:46:55 user nova-compute[73449]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 11:46:55 user nova-compute[73449]:       <source dev="/dev/sdb"/>
Aug 17 11:46:55 user nova-compute[73449]:       <target dev="vda" bus="virtio"/>
Aug 17 11:46:55 user nova-compute[73449]:       <serial>fc3c38dd-5692-448f-b1fc-b8fe08052611</serial>
Aug 17 11:46:55 user nova-compute[73449]:     </disk>
Aug 17 11:46:55 user nova-compute[73449]:     <interface type="ethernet">
Aug 17 11:46:55 user nova-compute[73449]:       <mac address="fa:16:3e:8d:36:ef"/>
Aug 17 11:46:55 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 11:46:55 user nova-compute[73449]:       <mtu size="1442"/>
Aug 17 11:46:55 user nova-compute[73449]:       <target dev="tap599e177a-d0"/>
Aug 17 11:46:55 user nova-compute[73449]:     </interface>
Aug 17 11:46:55 user nova-compute[73449]:     <serial type="pty">
Aug 17 11:46:55 user nova-compute[73449]:       <log file="/opt/stack/data/nova/instances/5612f7d1-a901-4bdd-a24a-faf9a980cd04/console.log" append="off"/>
Aug 17 11:46:55 user nova-compute[73449]:     </serial>
Aug 17 11:46:55 user nova-compute[73449]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 11:46:55 user nova-compute[73449]:     <video>
Aug 17 11:46:55 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 11:46:55 user nova-compute[73449]:     </video>
Aug 17 11:46:55 user nova-compute[73449]:     <rng model="virtio">
Aug 17 11:46:55 user nova-compute[73449]:       <backend model="random">/dev/urandom</backend>
Aug 17 11:46:55 user nova-compute[73449]:     </rng>
Aug 17 11:46:55 user nova-compute[73449]:     <controller type="usb" index="0" model="none"/>
Aug 17 11:46:55 user nova-compute[73449]:     <memballoon model="virtio">
Aug 17 11:46:55 user nova-compute[73449]:       <stats period="10"/>
Aug 17 11:46:55 user nova-compute[73449]:     </memballoon>
Aug 17 11:46:55 user nova-compute[73449]:   </devices>
Aug 17 11:46:55 user nova-compute[73449]: </domain>
Aug 17 11:46:55 user nova-compute[73449]:  {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 11:46:55 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-0d6d0da4-cd7c-4fb2-a65e-3f3b75d734f6 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:46:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1849786392',display_name='tempest-TestShelveInstance-server-1849786392',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1849786392',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA55lazAqHP3vcEkHgxf0GkDCEWKxw301Wqk4UvPSVrCTPIFpM0ItDTNB5vmnGG+ellud4ExTu114P7nZoUxO7bGtJGKBcvDyG2fdaDBOPDuLrsnSKO7Wa6GZ9ttkbdXeA==',key_name='tempest-TestShelveInstance-1460867700',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b906d3cc3acb46818cd2c9583f351893',ramdisk_id='',reservation_id='r-6d1v12wz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-917557205',owner_user_name='tempest-TestShelveInstance-917557205-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T11:46:42Z,user_data=None,user_id='db7e0b2abd4b4df3b2e7886ddc3840c0',uuid=5612f7d1-a901-4bdd-a24a-faf9a980cd04,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "599e177a-d05b-4d24-8c89-8a868182940c", "address": "fa:16:3e:8d:36:ef", "network": {"id": "41adee44-4e1c-4cc6-aa63-8054da5d97b4", "bridge": "br-int", "label": "tempest-TestShelveInstance-1953236522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b906d3cc3acb46818cd2c9583f351893", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap599e177a-d0", "ovs_interfaceid": "599e177a-d05b-4d24-8c89-8a868182940c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 11:46:55 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-0d6d0da4-cd7c-4fb2-a65e-3f3b75d734f6 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Converting VIF {"id": "599e177a-d05b-4d24-8c89-8a868182940c", "address": "fa:16:3e:8d:36:ef", "network": {"id": "41adee44-4e1c-4cc6-aa63-8054da5d97b4", "bridge": "br-int", "label": "tempest-TestShelveInstance-1953236522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b906d3cc3acb46818cd2c9583f351893", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap599e177a-d0", "ovs_interfaceid": "599e177a-d05b-4d24-8c89-8a868182940c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:46:55 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-0d6d0da4-cd7c-4fb2-a65e-3f3b75d734f6 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:36:ef,bridge_name='br-int',has_traffic_filtering=True,id=599e177a-d05b-4d24-8c89-8a868182940c,network=Network(41adee44-4e1c-4cc6-aa63-8054da5d97b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap599e177a-d0') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:46:55 user nova-compute[73449]: DEBUG os_vif [None req-0d6d0da4-cd7c-4fb2-a65e-3f3b75d734f6 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:36:ef,bridge_name='br-int',has_traffic_filtering=True,id=599e177a-d05b-4d24-8c89-8a868182940c,network=Network(41adee44-4e1c-4cc6-aa63-8054da5d97b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap599e177a-d0') {{(pid=73449) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 11:46:55 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:46:55 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:46:55 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 11:46:55 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:46:55 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap599e177a-d0, may_exist=True, interface_attrs={}) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:46:55 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap599e177a-d0, col_values=(('external_ids', {'iface-id': '599e177a-d05b-4d24-8c89-8a868182940c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8d:36:ef', 'vm-uuid': '5612f7d1-a901-4bdd-a24a-faf9a980cd04'}),), if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:46:55 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:46:55 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:46:55 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:46:55 user nova-compute[73449]: INFO os_vif [None req-0d6d0da4-cd7c-4fb2-a65e-3f3b75d734f6 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:36:ef,bridge_name='br-int',has_traffic_filtering=True,id=599e177a-d05b-4d24-8c89-8a868182940c,network=Network(41adee44-4e1c-4cc6-aa63-8054da5d97b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap599e177a-d0')
Aug 17 11:46:55 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c69e7643-8c60-4982-986b-484e8cfc3fa9/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:46:55 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a9e8ad2-19db-4975-87e4-2efce603a7d7/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:46:55 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-0d6d0da4-cd7c-4fb2-a65e-3f3b75d734f6 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] No BDM found with device name vda, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 11:46:55 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-0d6d0da4-cd7c-4fb2-a65e-3f3b75d734f6 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] No VIF found with MAC fa:16:3e:8d:36:ef, not building metadata {{(pid=73449) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 11:46:55 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a9e8ad2-19db-4975-87e4-2efce603a7d7/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:46:55 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a9e8ad2-19db-4975-87e4-2efce603a7d7/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:46:55 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a9e8ad2-19db-4975-87e4-2efce603a7d7/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:46:55 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:46:55 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:46:55 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:46:55 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:46:55 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de5084e1-5a5e-48d2-a3ef-7f29898d1d2d/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:46:56 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de5084e1-5a5e-48d2-a3ef-7f29898d1d2d/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:46:56 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de5084e1-5a5e-48d2-a3ef-7f29898d1d2d/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:46:56 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de5084e1-5a5e-48d2-a3ef-7f29898d1d2d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:46:56 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73449) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 11:46:56 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3523d22-7165-46ad-be10-5e6ae374f91d/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:46:56 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:46:56 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:46:56 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:46:56 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3523d22-7165-46ad-be10-5e6ae374f91d/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:46:56 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3523d22-7165-46ad-be10-5e6ae374f91d/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:46:56 user nova-compute[73449]: DEBUG nova.compute.manager [req-4a62d944-6491-402c-bb4a-ca2691399775 req-b639fac3-ab1a-44eb-b11b-2b2ce0a13de3 service nova] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Received event network-vif-plugged-599e177a-d05b-4d24-8c89-8a868182940c {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:46:56 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-4a62d944-6491-402c-bb4a-ca2691399775 req-b639fac3-ab1a-44eb-b11b-2b2ce0a13de3 service nova] Acquiring lock "5612f7d1-a901-4bdd-a24a-faf9a980cd04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:46:56 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-4a62d944-6491-402c-bb4a-ca2691399775 req-b639fac3-ab1a-44eb-b11b-2b2ce0a13de3 service nova] Lock "5612f7d1-a901-4bdd-a24a-faf9a980cd04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:46:56 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-4a62d944-6491-402c-bb4a-ca2691399775 req-b639fac3-ab1a-44eb-b11b-2b2ce0a13de3 service nova] Lock "5612f7d1-a901-4bdd-a24a-faf9a980cd04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:46:56 user nova-compute[73449]: DEBUG nova.compute.manager [req-4a62d944-6491-402c-bb4a-ca2691399775 req-b639fac3-ab1a-44eb-b11b-2b2ce0a13de3 service nova] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] No waiting events found dispatching network-vif-plugged-599e177a-d05b-4d24-8c89-8a868182940c {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:46:56 user nova-compute[73449]: WARNING nova.compute.manager [req-4a62d944-6491-402c-bb4a-ca2691399775 req-b639fac3-ab1a-44eb-b11b-2b2ce0a13de3 service nova] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Received unexpected event network-vif-plugged-599e177a-d05b-4d24-8c89-8a868182940c for instance with vm_state building and task_state spawning.
Aug 17 11:46:56 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3523d22-7165-46ad-be10-5e6ae374f91d/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:46:56 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d74c8f6-fb4e-4460-b722-674a8a1e2d25/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:46:57 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d74c8f6-fb4e-4460-b722-674a8a1e2d25/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:46:57 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d74c8f6-fb4e-4460-b722-674a8a1e2d25/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:46:57 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:46:57 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:46:57 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:46:57 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d74c8f6-fb4e-4460-b722-674a8a1e2d25/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:46:57 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f35b7f2b-2f88-4b09-86ac-cb5a78a94584/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:46:57 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:46:57 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f35b7f2b-2f88-4b09-86ac-cb5a78a94584/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:46:57 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f35b7f2b-2f88-4b09-86ac-cb5a78a94584/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:46:57 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f35b7f2b-2f88-4b09-86ac-cb5a78a94584/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:46:57 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73449) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 11:46:57 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d468854-6182-49c8-acb7-0641df2d5219/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:46:57 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d468854-6182-49c8-acb7-0641df2d5219/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:46:57 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d468854-6182-49c8-acb7-0641df2d5219/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:46:57 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:46:58 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d468854-6182-49c8-acb7-0641df2d5219/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:46:58 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:46:58 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:46:58 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Hypervisor/Node resource view: name=user free_ram=6924MB free_disk=25.22957992553711GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73449) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 11:46:58 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:46:58 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:46:58 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 4a9e8ad2-19db-4975-87e4-2efce603a7d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:46:58 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance a3523d22-7165-46ad-be10-5e6ae374f91d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:46:58 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance f35b7f2b-2f88-4b09-86ac-cb5a78a94584 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:46:58 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance de5084e1-5a5e-48d2-a3ef-7f29898d1d2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:46:58 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance c69e7643-8c60-4982-986b-484e8cfc3fa9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:46:58 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance e8e7d9aa-150f-424a-b3af-be149ee421c3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:46:58 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 3d74c8f6-fb4e-4460-b722-674a8a1e2d25 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:46:58 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance ae75d334-431a-4008-8b3d-f2a727d92417 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:46:58 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 3d468854-6182-49c8-acb7-0641df2d5219 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:46:58 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 5612f7d1-a901-4bdd-a24a-faf9a980cd04 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:46:58 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73449) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 11:46:58 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73449) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 11:46:58 user nova-compute[73449]: DEBUG nova.compute.manager [req-c39c0291-48eb-4374-8424-4a8444b43ed3 req-8175fabb-5441-4862-b24d-06ae0c0cb5ec service nova] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Received event network-vif-plugged-599e177a-d05b-4d24-8c89-8a868182940c {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:46:58 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-c39c0291-48eb-4374-8424-4a8444b43ed3 req-8175fabb-5441-4862-b24d-06ae0c0cb5ec service nova] Acquiring lock "5612f7d1-a901-4bdd-a24a-faf9a980cd04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:46:58 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-c39c0291-48eb-4374-8424-4a8444b43ed3 req-8175fabb-5441-4862-b24d-06ae0c0cb5ec service nova] Lock "5612f7d1-a901-4bdd-a24a-faf9a980cd04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:46:58 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-c39c0291-48eb-4374-8424-4a8444b43ed3 req-8175fabb-5441-4862-b24d-06ae0c0cb5ec service nova] Lock "5612f7d1-a901-4bdd-a24a-faf9a980cd04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:46:58 user nova-compute[73449]: DEBUG nova.compute.manager [req-c39c0291-48eb-4374-8424-4a8444b43ed3 req-8175fabb-5441-4862-b24d-06ae0c0cb5ec service nova] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] No waiting events found dispatching network-vif-plugged-599e177a-d05b-4d24-8c89-8a868182940c {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:46:58 user nova-compute[73449]: WARNING nova.compute.manager [req-c39c0291-48eb-4374-8424-4a8444b43ed3 req-8175fabb-5441-4862-b24d-06ae0c0cb5ec service nova] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Received unexpected event network-vif-plugged-599e177a-d05b-4d24-8c89-8a868182940c for instance with vm_state building and task_state spawning.
Aug 17 11:46:58 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692272818.8829374, 5612f7d1-a901-4bdd-a24a-faf9a980cd04 => Resumed> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:46:58 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] VM Resumed (Lifecycle Event)
Aug 17 11:46:58 user nova-compute[73449]: DEBUG nova.compute.manager [None req-0d6d0da4-cd7c-4fb2-a65e-3f3b75d734f6 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Instance event wait completed in 0 seconds for  {{(pid=73449) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 11:46:58 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-0d6d0da4-cd7c-4fb2-a65e-3f3b75d734f6 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Guest created on hypervisor {{(pid=73449) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 11:46:58 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Instance spawned successfully.
Aug 17 11:46:58 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-0d6d0da4-cd7c-4fb2-a65e-3f3b75d734f6 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 11:46:58 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:46:58 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 11:46:58 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-0d6d0da4-cd7c-4fb2-a65e-3f3b75d734f6 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Found default for hw_cdrom_bus of ide {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:46:58 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-0d6d0da4-cd7c-4fb2-a65e-3f3b75d734f6 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Found default for hw_disk_bus of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:46:58 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-0d6d0da4-cd7c-4fb2-a65e-3f3b75d734f6 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Found default for hw_input_bus of None {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:46:58 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-0d6d0da4-cd7c-4fb2-a65e-3f3b75d734f6 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Found default for hw_pointer_model of None {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:46:58 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-0d6d0da4-cd7c-4fb2-a65e-3f3b75d734f6 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Found default for hw_video_model of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:46:58 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-0d6d0da4-cd7c-4fb2-a65e-3f3b75d734f6 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Found default for hw_vif_model of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:46:58 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 11:46:58 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692272818.8845537, 5612f7d1-a901-4bdd-a24a-faf9a980cd04 => Started> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:46:58 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] VM Started (Lifecycle Event)
Aug 17 11:46:58 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:46:58 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 11:46:59 user nova-compute[73449]: INFO nova.compute.manager [None req-0d6d0da4-cd7c-4fb2-a65e-3f3b75d734f6 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Took 5.31 seconds to spawn the instance on the hypervisor.
Aug 17 11:46:59 user nova-compute[73449]: DEBUG nova.compute.manager [None req-0d6d0da4-cd7c-4fb2-a65e-3f3b75d734f6 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:46:59 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 11:46:59 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 11:46:59 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 11:46:59 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Compute_service record updated for user:user {{(pid=73449) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 11:46:59 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.523s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:46:59 user nova-compute[73449]: INFO nova.compute.manager [None req-0d6d0da4-cd7c-4fb2-a65e-3f3b75d734f6 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Took 18.58 seconds to build instance.
Aug 17 11:46:59 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-0d6d0da4-cd7c-4fb2-a65e-3f3b75d734f6 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Lock "5612f7d1-a901-4bdd-a24a-faf9a980cd04" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.714s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:46:59 user nova-compute[73449]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692272804.8914466, fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2 => Stopped> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:46:59 user nova-compute[73449]: INFO nova.compute.manager [-] [instance: fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2] VM Stopped (Lifecycle Event)
Aug 17 11:46:59 user nova-compute[73449]: DEBUG nova.compute.manager [None req-7e8fecc8-27a6-4908-a741-02c6fc91121b None None] [instance: fc9cf95f-6e26-464c-bba4-3e6cf1f8a6e2] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:47:00 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:47:00 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:47:02 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:47:04 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a48502da-ba55-4691-807f-a76206858ac2 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Acquiring lock "de5084e1-5a5e-48d2-a3ef-7f29898d1d2d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:47:04 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a48502da-ba55-4691-807f-a76206858ac2 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Lock "de5084e1-5a5e-48d2-a3ef-7f29898d1d2d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:47:04 user nova-compute[73449]: DEBUG nova.objects.instance [None req-a48502da-ba55-4691-807f-a76206858ac2 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Lazy-loading 'flavor' on Instance uuid de5084e1-5a5e-48d2-a3ef-7f29898d1d2d {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:47:04 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a48502da-ba55-4691-807f-a76206858ac2 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Lock "de5084e1-5a5e-48d2-a3ef-7f29898d1d2d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:47:04 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a48502da-ba55-4691-807f-a76206858ac2 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Acquiring lock "de5084e1-5a5e-48d2-a3ef-7f29898d1d2d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:47:04 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a48502da-ba55-4691-807f-a76206858ac2 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Lock "de5084e1-5a5e-48d2-a3ef-7f29898d1d2d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:47:04 user nova-compute[73449]: INFO nova.compute.manager [None req-a48502da-ba55-4691-807f-a76206858ac2 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] Attaching volume 365e93f2-f46d-4b14-b207-f56656bc918c to /dev/vdb
Aug 17 11:47:04 user nova-compute[73449]: DEBUG os_brick.utils [None req-a48502da-ba55-4691-807f-a76206858ac2 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 11:47:04 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:47:04 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:47:04 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[86083343-9032-47bd-a8bc-5b1b1fd9be45]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4d3924302012\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:47:04 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:47:04 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:47:04 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac31108b-ef00-4a4b-9c54-b14ddd064124]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:47:04 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:47:04 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:47:04 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[44f6075e-bbb0-4c20-a16e-b4605fafbfa8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:47:04 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2ecae8f-4297-409a-9972-b4cbfe9d5a69]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:47:04 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-a48502da-ba55-4691-807f-a76206858ac2 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Running cmd (subprocess): nvme version {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:47:04 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-a48502da-ba55-4691-807f-a76206858ac2 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] 'nvme version' failed. Not Retrying. {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 11:47:04 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a48502da-ba55-4691-807f-a76206858ac2 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] nvme not present on system {{(pid=73449) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 11:47:04 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:47:04 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 11:47:04 user nova-compute[73449]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 11:47:04 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[c471c78e-a87b-4a51-ab7c-57f673290422]: (4, '') {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:47:04 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-a48502da-ba55-4691-807f-a76206858ac2 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73449) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 11:47:04 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-a48502da-ba55-4691-807f-a76206858ac2 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73449) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 11:47:04 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-a48502da-ba55-4691-807f-a76206858ac2 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] LIGHTOS: no hostnqn found. {{(pid=73449) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 11:47:04 user nova-compute[73449]: DEBUG os_brick.utils [None req-a48502da-ba55-4691-807f-a76206858ac2 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4d3924302012', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 11:47:04 user nova-compute[73449]: DEBUG nova.virt.block_device [None req-a48502da-ba55-4691-807f-a76206858ac2 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] Updating existing volume attachment record: 45f337f7-3cfc-4d14-8c91-7da372daf6f3 {{(pid=73449) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 11:47:05 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:47:05 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-4d6fb0e2-a6a1-4a1f-9811-d1ea55a1acc4 tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Acquiring lock "a5836f8c-079b-4437-ab51-6878f0a4a7f8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:47:05 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-4d6fb0e2-a6a1-4a1f-9811-d1ea55a1acc4 tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Lock "a5836f8c-079b-4437-ab51-6878f0a4a7f8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:47:05 user nova-compute[73449]: DEBUG nova.compute.manager [None req-4d6fb0e2-a6a1-4a1f-9811-d1ea55a1acc4 tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] [instance: a5836f8c-079b-4437-ab51-6878f0a4a7f8] Starting instance... {{(pid=73449) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 11:47:05 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-4d6fb0e2-a6a1-4a1f-9811-d1ea55a1acc4 tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:47:05 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-4d6fb0e2-a6a1-4a1f-9811-d1ea55a1acc4 tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:47:05 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-4d6fb0e2-a6a1-4a1f-9811-d1ea55a1acc4 tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73449) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 11:47:05 user nova-compute[73449]: INFO nova.compute.claims [None req-4d6fb0e2-a6a1-4a1f-9811-d1ea55a1acc4 tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] [instance: a5836f8c-079b-4437-ab51-6878f0a4a7f8] Claim successful on node user
Aug 17 11:47:05 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-4d6fb0e2-a6a1-4a1f-9811-d1ea55a1acc4 tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 11:47:05 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-4d6fb0e2-a6a1-4a1f-9811-d1ea55a1acc4 tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 11:47:05 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-4d6fb0e2-a6a1-4a1f-9811-d1ea55a1acc4 tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.542s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:47:05 user nova-compute[73449]: DEBUG nova.compute.manager [None req-4d6fb0e2-a6a1-4a1f-9811-d1ea55a1acc4 tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] [instance: a5836f8c-079b-4437-ab51-6878f0a4a7f8] Start building networks asynchronously for instance. {{(pid=73449) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 11:47:05 user nova-compute[73449]: DEBUG nova.compute.manager [None req-4d6fb0e2-a6a1-4a1f-9811-d1ea55a1acc4 tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] [instance: a5836f8c-079b-4437-ab51-6878f0a4a7f8] Allocating IP information in the background. {{(pid=73449) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 11:47:05 user nova-compute[73449]: DEBUG nova.network.neutron [None req-4d6fb0e2-a6a1-4a1f-9811-d1ea55a1acc4 tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] [instance: a5836f8c-079b-4437-ab51-6878f0a4a7f8] allocate_for_instance() {{(pid=73449) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 11:47:05 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-4d6fb0e2-a6a1-4a1f-9811-d1ea55a1acc4 tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] [instance: a5836f8c-079b-4437-ab51-6878f0a4a7f8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 11:47:05 user nova-compute[73449]: DEBUG nova.compute.manager [None req-4d6fb0e2-a6a1-4a1f-9811-d1ea55a1acc4 tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] [instance: a5836f8c-079b-4437-ab51-6878f0a4a7f8] Start building block device mappings for instance. {{(pid=73449) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 11:47:06 user nova-compute[73449]: DEBUG nova.policy [None req-4d6fb0e2-a6a1-4a1f-9811-d1ea55a1acc4 tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '652d1ea975dc454aa4c72d74ddd8af68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b447696c4a49e5838ae21456bc60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73449) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 11:47:06 user nova-compute[73449]: DEBUG nova.compute.manager [None req-4d6fb0e2-a6a1-4a1f-9811-d1ea55a1acc4 tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] [instance: a5836f8c-079b-4437-ab51-6878f0a4a7f8] Start spawning the instance on the hypervisor. {{(pid=73449) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 11:47:06 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-4d6fb0e2-a6a1-4a1f-9811-d1ea55a1acc4 tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] [instance: a5836f8c-079b-4437-ab51-6878f0a4a7f8] Creating instance directory {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 11:47:06 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-4d6fb0e2-a6a1-4a1f-9811-d1ea55a1acc4 tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] [instance: a5836f8c-079b-4437-ab51-6878f0a4a7f8] Creating image(s)
Aug 17 11:47:06 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-4d6fb0e2-a6a1-4a1f-9811-d1ea55a1acc4 tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Acquiring lock "/opt/stack/data/nova/instances/a5836f8c-079b-4437-ab51-6878f0a4a7f8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:47:06 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-4d6fb0e2-a6a1-4a1f-9811-d1ea55a1acc4 tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Lock "/opt/stack/data/nova/instances/a5836f8c-079b-4437-ab51-6878f0a4a7f8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:47:06 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-4d6fb0e2-a6a1-4a1f-9811-d1ea55a1acc4 tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Lock "/opt/stack/data/nova/instances/a5836f8c-079b-4437-ab51-6878f0a4a7f8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:47:06 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-4d6fb0e2-a6a1-4a1f-9811-d1ea55a1acc4 tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:47:06 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-4d6fb0e2-a6a1-4a1f-9811-d1ea55a1acc4 tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json" returned: 0 in 0.182s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:47:06 user nova-compute[73449]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692272811.2418215, b12d9412-be17-4908-a4c2-b80c0fa38fc0 => Stopped> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:47:06 user nova-compute[73449]: INFO nova.compute.manager [-] [instance: b12d9412-be17-4908-a4c2-b80c0fa38fc0] VM Stopped (Lifecycle Event)
Aug 17 11:47:06 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-4d6fb0e2-a6a1-4a1f-9811-d1ea55a1acc4 tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Acquiring lock "7e267a577c062ee862e95ede6b48cfd5632f3ea3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:47:06 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-4d6fb0e2-a6a1-4a1f-9811-d1ea55a1acc4 tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Lock "7e267a577c062ee862e95ede6b48cfd5632f3ea3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.006s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:47:06 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-4d6fb0e2-a6a1-4a1f-9811-d1ea55a1acc4 tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:47:06 user nova-compute[73449]: DEBUG nova.compute.manager [None req-c7a93503-a6cc-4a2b-a6d9-a1aa3f6ce152 None None] [instance: b12d9412-be17-4908-a4c2-b80c0fa38fc0] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:47:06 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-4d6fb0e2-a6a1-4a1f-9811-d1ea55a1acc4 tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json" returned: 0 in 0.199s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:47:06 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-4d6fb0e2-a6a1-4a1f-9811-d1ea55a1acc4 tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3,backing_fmt=raw /opt/stack/data/nova/instances/a5836f8c-079b-4437-ab51-6878f0a4a7f8/disk 1073741824 {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:47:06 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-4d6fb0e2-a6a1-4a1f-9811-d1ea55a1acc4 tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3,backing_fmt=raw /opt/stack/data/nova/instances/a5836f8c-079b-4437-ab51-6878f0a4a7f8/disk 1073741824" returned: 0 in 0.156s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:47:06 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-4d6fb0e2-a6a1-4a1f-9811-d1ea55a1acc4 tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Lock "7e267a577c062ee862e95ede6b48cfd5632f3ea3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.362s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:47:06 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-4d6fb0e2-a6a1-4a1f-9811-d1ea55a1acc4 tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:47:06 user nova-compute[73449]: DEBUG nova.network.neutron [None req-4d6fb0e2-a6a1-4a1f-9811-d1ea55a1acc4 tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] [instance: a5836f8c-079b-4437-ab51-6878f0a4a7f8] Successfully created port: 452715bd-2291-4c3c-b6e8-a692dc72d1ac {{(pid=73449) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 11:47:06 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-4d6fb0e2-a6a1-4a1f-9811-d1ea55a1acc4 tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json" returned: 0 in 0.218s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:47:06 user nova-compute[73449]: DEBUG nova.virt.disk.api [None req-4d6fb0e2-a6a1-4a1f-9811-d1ea55a1acc4 tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a5836f8c-079b-4437-ab51-6878f0a4a7f8/disk. size=1073741824 {{(pid=73449) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 11:47:06 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-4d6fb0e2-a6a1-4a1f-9811-d1ea55a1acc4 tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5836f8c-079b-4437-ab51-6878f0a4a7f8/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:47:07 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-4d6fb0e2-a6a1-4a1f-9811-d1ea55a1acc4 tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5836f8c-079b-4437-ab51-6878f0a4a7f8/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:47:07 user nova-compute[73449]: DEBUG nova.virt.disk.api [None req-4d6fb0e2-a6a1-4a1f-9811-d1ea55a1acc4 tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Cannot resize image /opt/stack/data/nova/instances/a5836f8c-079b-4437-ab51-6878f0a4a7f8/disk to a smaller size. {{(pid=73449) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 11:47:07 user nova-compute[73449]: DEBUG nova.objects.instance [None req-4d6fb0e2-a6a1-4a1f-9811-d1ea55a1acc4 tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Lazy-loading 'migration_context' on Instance uuid a5836f8c-079b-4437-ab51-6878f0a4a7f8 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:47:07 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-4d6fb0e2-a6a1-4a1f-9811-d1ea55a1acc4 tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] [instance: a5836f8c-079b-4437-ab51-6878f0a4a7f8] Created local disks {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 11:47:07 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-4d6fb0e2-a6a1-4a1f-9811-d1ea55a1acc4 tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] [instance: a5836f8c-079b-4437-ab51-6878f0a4a7f8] Ensure instance console log exists: /opt/stack/data/nova/instances/a5836f8c-079b-4437-ab51-6878f0a4a7f8/console.log {{(pid=73449) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 11:47:07 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-4d6fb0e2-a6a1-4a1f-9811-d1ea55a1acc4 tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:47:07 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-4d6fb0e2-a6a1-4a1f-9811-d1ea55a1acc4 tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:47:07 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-4d6fb0e2-a6a1-4a1f-9811-d1ea55a1acc4 tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:47:07 user nova-compute[73449]: DEBUG nova.compute.manager [req-d447ee0c-2d75-4370-b851-cafbd244275e req-7829acc0-efff-444a-a4ca-009a6eda2eed service nova] [instance: c69e7643-8c60-4982-986b-484e8cfc3fa9] Received event network-changed-8fd82fbd-985b-4260-a066-3bda2e4c1f1c {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:47:07 user nova-compute[73449]: DEBUG nova.compute.manager [req-d447ee0c-2d75-4370-b851-cafbd244275e req-7829acc0-efff-444a-a4ca-009a6eda2eed service nova] [instance: c69e7643-8c60-4982-986b-484e8cfc3fa9] Refreshing instance network info cache due to event network-changed-8fd82fbd-985b-4260-a066-3bda2e4c1f1c. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 11:47:07 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-d447ee0c-2d75-4370-b851-cafbd244275e req-7829acc0-efff-444a-a4ca-009a6eda2eed service nova] Acquiring lock "refresh_cache-c69e7643-8c60-4982-986b-484e8cfc3fa9" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:47:07 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-d447ee0c-2d75-4370-b851-cafbd244275e req-7829acc0-efff-444a-a4ca-009a6eda2eed service nova] Acquired lock "refresh_cache-c69e7643-8c60-4982-986b-484e8cfc3fa9" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:47:07 user nova-compute[73449]: DEBUG nova.network.neutron [req-d447ee0c-2d75-4370-b851-cafbd244275e req-7829acc0-efff-444a-a4ca-009a6eda2eed service nova] [instance: c69e7643-8c60-4982-986b-484e8cfc3fa9] Refreshing network info cache for port 8fd82fbd-985b-4260-a066-3bda2e4c1f1c {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 11:47:07 user nova-compute[73449]: DEBUG nova.network.neutron [None req-4d6fb0e2-a6a1-4a1f-9811-d1ea55a1acc4 tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] [instance: a5836f8c-079b-4437-ab51-6878f0a4a7f8] Successfully updated port: 452715bd-2291-4c3c-b6e8-a692dc72d1ac {{(pid=73449) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 11:47:07 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-4d6fb0e2-a6a1-4a1f-9811-d1ea55a1acc4 tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Acquiring lock "refresh_cache-a5836f8c-079b-4437-ab51-6878f0a4a7f8" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:47:07 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-4d6fb0e2-a6a1-4a1f-9811-d1ea55a1acc4 tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Acquired lock "refresh_cache-a5836f8c-079b-4437-ab51-6878f0a4a7f8" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:47:07 user nova-compute[73449]: DEBUG nova.network.neutron [None req-4d6fb0e2-a6a1-4a1f-9811-d1ea55a1acc4 tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] [instance: a5836f8c-079b-4437-ab51-6878f0a4a7f8] Building network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 11:47:07 user nova-compute[73449]: DEBUG nova.compute.manager [req-efeadbfd-5d15-4b7c-9c94-875b04212362 req-798ae8ec-525a-442b-b971-4b970c4260a9 service nova] [instance: a5836f8c-079b-4437-ab51-6878f0a4a7f8] Received event network-changed-452715bd-2291-4c3c-b6e8-a692dc72d1ac {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:47:07 user nova-compute[73449]: DEBUG nova.compute.manager [req-efeadbfd-5d15-4b7c-9c94-875b04212362 req-798ae8ec-525a-442b-b971-4b970c4260a9 service nova] [instance: a5836f8c-079b-4437-ab51-6878f0a4a7f8] Refreshing instance network info cache due to event network-changed-452715bd-2291-4c3c-b6e8-a692dc72d1ac. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 11:47:07 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-efeadbfd-5d15-4b7c-9c94-875b04212362 req-798ae8ec-525a-442b-b971-4b970c4260a9 service nova] Acquiring lock "refresh_cache-a5836f8c-079b-4437-ab51-6878f0a4a7f8" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:47:07 user nova-compute[73449]: DEBUG nova.network.neutron [None req-4d6fb0e2-a6a1-4a1f-9811-d1ea55a1acc4 tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] [instance: a5836f8c-079b-4437-ab51-6878f0a4a7f8] Instance cache missing network info. {{(pid=73449) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 11:47:07 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:47:08 user nova-compute[73449]: DEBUG nova.network.neutron [req-d447ee0c-2d75-4370-b851-cafbd244275e req-7829acc0-efff-444a-a4ca-009a6eda2eed service nova] [instance: c69e7643-8c60-4982-986b-484e8cfc3fa9] Updated VIF entry in instance network info cache for port 8fd82fbd-985b-4260-a066-3bda2e4c1f1c. {{(pid=73449) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 11:47:08 user nova-compute[73449]: DEBUG nova.network.neutron [req-d447ee0c-2d75-4370-b851-cafbd244275e req-7829acc0-efff-444a-a4ca-009a6eda2eed service nova] [instance: c69e7643-8c60-4982-986b-484e8cfc3fa9] Updating instance_info_cache with network_info: [{"id": "8fd82fbd-985b-4260-a066-3bda2e4c1f1c", "address": "fa:16:3e:e3:a9:e0", "network": {"id": "56945a89-4894-401c-a1bd-dba725ffbcca", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-590943835-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f0abc92468b407f992a1c233e53ff48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fd82fbd-98", "ovs_interfaceid": "8fd82fbd-985b-4260-a066-3bda2e4c1f1c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:47:08 user nova-compute[73449]: DEBUG nova.network.neutron [None req-4d6fb0e2-a6a1-4a1f-9811-d1ea55a1acc4 tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] [instance: a5836f8c-079b-4437-ab51-6878f0a4a7f8] Updating instance_info_cache with network_info: [{"id": "452715bd-2291-4c3c-b6e8-a692dc72d1ac", "address": "fa:16:3e:75:d1:04", "network": {"id": "76705db8-2e7f-449c-b512-6747bad0c324", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1601912422-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54b447696c4a49e5838ae21456bc60e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap452715bd-22", "ovs_interfaceid": "452715bd-2291-4c3c-b6e8-a692dc72d1ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:47:08 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-d447ee0c-2d75-4370-b851-cafbd244275e req-7829acc0-efff-444a-a4ca-009a6eda2eed service nova] Releasing lock "refresh_cache-c69e7643-8c60-4982-986b-484e8cfc3fa9" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:47:08 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-4d6fb0e2-a6a1-4a1f-9811-d1ea55a1acc4 tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Releasing lock "refresh_cache-a5836f8c-079b-4437-ab51-6878f0a4a7f8" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:47:08 user nova-compute[73449]: DEBUG nova.compute.manager [None req-4d6fb0e2-a6a1-4a1f-9811-d1ea55a1acc4 tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] [instance: a5836f8c-079b-4437-ab51-6878f0a4a7f8] Instance network_info: |[{"id": "452715bd-2291-4c3c-b6e8-a692dc72d1ac", "address": "fa:16:3e:75:d1:04", "network": {"id": "76705db8-2e7f-449c-b512-6747bad0c324", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1601912422-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54b447696c4a49e5838ae21456bc60e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap452715bd-22", "ovs_interfaceid": "452715bd-2291-4c3c-b6e8-a692dc72d1ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73449) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 11:47:08 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-efeadbfd-5d15-4b7c-9c94-875b04212362 req-798ae8ec-525a-442b-b971-4b970c4260a9 service nova] Acquired lock "refresh_cache-a5836f8c-079b-4437-ab51-6878f0a4a7f8" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:47:08 user nova-compute[73449]: DEBUG nova.network.neutron [req-efeadbfd-5d15-4b7c-9c94-875b04212362 req-798ae8ec-525a-442b-b971-4b970c4260a9 service nova] [instance: a5836f8c-079b-4437-ab51-6878f0a4a7f8] Refreshing network info cache for port 452715bd-2291-4c3c-b6e8-a692dc72d1ac {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 11:47:08 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-4d6fb0e2-a6a1-4a1f-9811-d1ea55a1acc4 tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] [instance: a5836f8c-079b-4437-ab51-6878f0a4a7f8] Start _get_guest_xml network_info=[{"id": "452715bd-2291-4c3c-b6e8-a692dc72d1ac", "address": "fa:16:3e:75:d1:04", "network": {"id": "76705db8-2e7f-449c-b512-6747bad0c324", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1601912422-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54b447696c4a49e5838ae21456bc60e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap452715bd-22", "ovs_interfaceid": "452715bd-2291-4c3c-b6e8-a692dc72d1ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T11:36:11Z,direct_url=<?>,disk_format='qcow2',id=0a2904ae-083d-41c8-83db-343132b36148,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7a77880136a54ef195c82e018e1939db',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T11:36:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': '0a2904ae-083d-41c8-83db-343132b36148'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 11:47:08 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-4d6fb0e2-a6a1-4a1f-9811-d1ea55a1acc4 tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:47:08 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-4d6fb0e2-a6a1-4a1f-9811-d1ea55a1acc4 tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:47:08 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-4d6fb0e2-a6a1-4a1f-9811-d1ea55a1acc4 tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 11:47:08 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-4d6fb0e2-a6a1-4a1f-9811-d1ea55a1acc4 tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] CPU controller missing on host. {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 11:47:08 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-4d6fb0e2-a6a1-4a1f-9811-d1ea55a1acc4 tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 11:47:08 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-4d6fb0e2-a6a1-4a1f-9811-d1ea55a1acc4 tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] CPU controller found on host. {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 11:47:08 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-4d6fb0e2-a6a1-4a1f-9811-d1ea55a1acc4 tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73449) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 11:47:08 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-4d6fb0e2-a6a1-4a1f-9811-d1ea55a1acc4 tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T11:35:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T11:36:11Z,direct_url=<?>,disk_format='qcow2',id=0a2904ae-083d-41c8-83db-343132b36148,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7a77880136a54ef195c82e018e1939db',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T11:36:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 11:47:08 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-4d6fb0e2-a6a1-4a1f-9811-d1ea55a1acc4 tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Flavor limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 11:47:08 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-4d6fb0e2-a6a1-4a1f-9811-d1ea55a1acc4 tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Image limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 11:47:08 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-4d6fb0e2-a6a1-4a1f-9811-d1ea55a1acc4 tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Flavor pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 11:47:08 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-4d6fb0e2-a6a1-4a1f-9811-d1ea55a1acc4 tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Image pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 11:47:08 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-4d6fb0e2-a6a1-4a1f-9811-d1ea55a1acc4 tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 11:47:08 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-4d6fb0e2-a6a1-4a1f-9811-d1ea55a1acc4 tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 11:47:08 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-4d6fb0e2-a6a1-4a1f-9811-d1ea55a1acc4 tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 11:47:08 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-4d6fb0e2-a6a1-4a1f-9811-d1ea55a1acc4 tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Got 1 possible topologies {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 11:47:08 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-4d6fb0e2-a6a1-4a1f-9811-d1ea55a1acc4 tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 11:47:08 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-4d6fb0e2-a6a1-4a1f-9811-d1ea55a1acc4 tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 11:47:08 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-4d6fb0e2-a6a1-4a1f-9811-d1ea55a1acc4 tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:47:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1497429960',display_name='tempest-VolumesActionsTest-instance-1497429960',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1497429960',id=22,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='54b447696c4a49e5838ae21456bc60e3',ramdisk_id='',reservation_id='r-pg6f2cf2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-407682915',owner_user_name='tempest-VolumesActionsTest-407682915-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T11:47:06Z,user_data=None,user_id='652d1ea975dc454aa4c72d74ddd8af68',uuid=a5836f8c-079b-4437-ab51-6878f0a4a7f8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "452715bd-2291-4c3c-b6e8-a692dc72d1ac", "address": "fa:16:3e:75:d1:04", "network": {"id": "76705db8-2e7f-449c-b512-6747bad0c324", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1601912422-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54b447696c4a49e5838ae21456bc60e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap452715bd-22", "ovs_interfaceid": "452715bd-2291-4c3c-b6e8-a692dc72d1ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73449) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 11:47:08 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-4d6fb0e2-a6a1-4a1f-9811-d1ea55a1acc4 tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Converting VIF {"id": "452715bd-2291-4c3c-b6e8-a692dc72d1ac", "address": "fa:16:3e:75:d1:04", "network": {"id": "76705db8-2e7f-449c-b512-6747bad0c324", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1601912422-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54b447696c4a49e5838ae21456bc60e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap452715bd-22", "ovs_interfaceid": "452715bd-2291-4c3c-b6e8-a692dc72d1ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:47:08 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-4d6fb0e2-a6a1-4a1f-9811-d1ea55a1acc4 tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:d1:04,bridge_name='br-int',has_traffic_filtering=True,id=452715bd-2291-4c3c-b6e8-a692dc72d1ac,network=Network(76705db8-2e7f-449c-b512-6747bad0c324),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap452715bd-22') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:47:08 user nova-compute[73449]: DEBUG nova.objects.instance [None req-4d6fb0e2-a6a1-4a1f-9811-d1ea55a1acc4 tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Lazy-loading 'pci_devices' on Instance uuid a5836f8c-079b-4437-ab51-6878f0a4a7f8 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:47:08 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-4d6fb0e2-a6a1-4a1f-9811-d1ea55a1acc4 tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] [instance: a5836f8c-079b-4437-ab51-6878f0a4a7f8] End _get_guest_xml xml=<domain type="kvm">
Aug 17 11:47:08 user nova-compute[73449]:   <uuid>a5836f8c-079b-4437-ab51-6878f0a4a7f8</uuid>
Aug 17 11:47:08 user nova-compute[73449]:   <name>instance-00000016</name>
Aug 17 11:47:08 user nova-compute[73449]:   <memory>524288</memory>
Aug 17 11:47:08 user nova-compute[73449]:   <vcpu>1</vcpu>
Aug 17 11:47:08 user nova-compute[73449]:   <metadata>
Aug 17 11:47:08 user nova-compute[73449]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 11:47:08 user nova-compute[73449]:       <nova:package version="0.0.0"/>
Aug 17 11:47:08 user nova-compute[73449]:       <nova:name>tempest-VolumesActionsTest-instance-1497429960</nova:name>
Aug 17 11:47:08 user nova-compute[73449]:       <nova:creationTime>2023-08-17 11:47:08</nova:creationTime>
Aug 17 11:47:08 user nova-compute[73449]:       <nova:flavor name="m1.tiny">
Aug 17 11:47:08 user nova-compute[73449]:         <nova:memory>512</nova:memory>
Aug 17 11:47:08 user nova-compute[73449]:         <nova:disk>1</nova:disk>
Aug 17 11:47:08 user nova-compute[73449]:         <nova:swap>0</nova:swap>
Aug 17 11:47:08 user nova-compute[73449]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 11:47:08 user nova-compute[73449]:         <nova:vcpus>1</nova:vcpus>
Aug 17 11:47:08 user nova-compute[73449]:       </nova:flavor>
Aug 17 11:47:08 user nova-compute[73449]:       <nova:owner>
Aug 17 11:47:08 user nova-compute[73449]:         <nova:user uuid="652d1ea975dc454aa4c72d74ddd8af68">tempest-VolumesActionsTest-407682915-project-member</nova:user>
Aug 17 11:47:08 user nova-compute[73449]:         <nova:project uuid="54b447696c4a49e5838ae21456bc60e3">tempest-VolumesActionsTest-407682915</nova:project>
Aug 17 11:47:08 user nova-compute[73449]:       </nova:owner>
Aug 17 11:47:08 user nova-compute[73449]:       <nova:root type="image" uuid="0a2904ae-083d-41c8-83db-343132b36148"/>
Aug 17 11:47:08 user nova-compute[73449]:       <nova:ports>
Aug 17 11:47:08 user nova-compute[73449]:         <nova:port uuid="452715bd-2291-4c3c-b6e8-a692dc72d1ac">
Aug 17 11:47:08 user nova-compute[73449]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 17 11:47:08 user nova-compute[73449]:         </nova:port>
Aug 17 11:47:08 user nova-compute[73449]:       </nova:ports>
Aug 17 11:47:08 user nova-compute[73449]:     </nova:instance>
Aug 17 11:47:08 user nova-compute[73449]:   </metadata>
Aug 17 11:47:08 user nova-compute[73449]:   <sysinfo type="smbios">
Aug 17 11:47:08 user nova-compute[73449]:     <system>
Aug 17 11:47:08 user nova-compute[73449]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 11:47:08 user nova-compute[73449]:       <entry name="product">OpenStack Nova</entry>
Aug 17 11:47:08 user nova-compute[73449]:       <entry name="version">0.0.0</entry>
Aug 17 11:47:08 user nova-compute[73449]:       <entry name="serial">a5836f8c-079b-4437-ab51-6878f0a4a7f8</entry>
Aug 17 11:47:08 user nova-compute[73449]:       <entry name="uuid">a5836f8c-079b-4437-ab51-6878f0a4a7f8</entry>
Aug 17 11:47:08 user nova-compute[73449]:       <entry name="family">Virtual Machine</entry>
Aug 17 11:47:08 user nova-compute[73449]:     </system>
Aug 17 11:47:08 user nova-compute[73449]:   </sysinfo>
Aug 17 11:47:08 user nova-compute[73449]:   <os>
Aug 17 11:47:08 user nova-compute[73449]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 11:47:08 user nova-compute[73449]:     <boot dev="hd"/>
Aug 17 11:47:08 user nova-compute[73449]:     <smbios mode="sysinfo"/>
Aug 17 11:47:08 user nova-compute[73449]:   </os>
Aug 17 11:47:08 user nova-compute[73449]:   <features>
Aug 17 11:47:08 user nova-compute[73449]:     <acpi/>
Aug 17 11:47:08 user nova-compute[73449]:     <apic/>
Aug 17 11:47:08 user nova-compute[73449]:     <vmcoreinfo/>
Aug 17 11:47:08 user nova-compute[73449]:   </features>
Aug 17 11:47:08 user nova-compute[73449]:   <clock offset="utc">
Aug 17 11:47:08 user nova-compute[73449]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 11:47:08 user nova-compute[73449]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 11:47:08 user nova-compute[73449]:     <timer name="hpet" present="no"/>
Aug 17 11:47:08 user nova-compute[73449]:   </clock>
Aug 17 11:47:08 user nova-compute[73449]:   <cpu mode="custom" match="exact">
Aug 17 11:47:08 user nova-compute[73449]:     <model>Nehalem</model>
Aug 17 11:47:08 user nova-compute[73449]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 11:47:08 user nova-compute[73449]:   </cpu>
Aug 17 11:47:08 user nova-compute[73449]:   <devices>
Aug 17 11:47:08 user nova-compute[73449]:     <disk type="file" device="disk">
Aug 17 11:47:08 user nova-compute[73449]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 11:47:08 user nova-compute[73449]:       <source file="/opt/stack/data/nova/instances/a5836f8c-079b-4437-ab51-6878f0a4a7f8/disk"/>
Aug 17 11:47:08 user nova-compute[73449]:       <target dev="vda" bus="virtio"/>
Aug 17 11:47:08 user nova-compute[73449]:     </disk>
Aug 17 11:47:08 user nova-compute[73449]:     <interface type="ethernet">
Aug 17 11:47:08 user nova-compute[73449]:       <mac address="fa:16:3e:75:d1:04"/>
Aug 17 11:47:08 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 11:47:08 user nova-compute[73449]:       <mtu size="1442"/>
Aug 17 11:47:08 user nova-compute[73449]:       <target dev="tap452715bd-22"/>
Aug 17 11:47:08 user nova-compute[73449]:     </interface>
Aug 17 11:47:08 user nova-compute[73449]:     <serial type="pty">
Aug 17 11:47:08 user nova-compute[73449]:       <log file="/opt/stack/data/nova/instances/a5836f8c-079b-4437-ab51-6878f0a4a7f8/console.log" append="off"/>
Aug 17 11:47:08 user nova-compute[73449]:     </serial>
Aug 17 11:47:08 user nova-compute[73449]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 11:47:08 user nova-compute[73449]:     <video>
Aug 17 11:47:08 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 11:47:08 user nova-compute[73449]:     </video>
Aug 17 11:47:08 user nova-compute[73449]:     <rng model="virtio">
Aug 17 11:47:08 user nova-compute[73449]:       <backend model="random">/dev/urandom</backend>
Aug 17 11:47:08 user nova-compute[73449]:     </rng>
Aug 17 11:47:08 user nova-compute[73449]:     <controller type="usb" index="0" model="none"/>
Aug 17 11:47:08 user nova-compute[73449]:     <memballoon model="virtio">
Aug 17 11:47:08 user nova-compute[73449]:       <stats period="10"/>
Aug 17 11:47:08 user nova-compute[73449]:     </memballoon>
Aug 17 11:47:08 user nova-compute[73449]:   </devices>
Aug 17 11:47:08 user nova-compute[73449]: </domain>
Aug 17 11:47:08 user nova-compute[73449]:  {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 11:47:08 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-4d6fb0e2-a6a1-4a1f-9811-d1ea55a1acc4 tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:47:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1497429960',display_name='tempest-VolumesActionsTest-instance-1497429960',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1497429960',id=22,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='54b447696c4a49e5838ae21456bc60e3',ramdisk_id='',reservation_id='r-pg6f2cf2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-407682915',owner_user_name='tempest-VolumesActionsTest-407682915-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T11:47:06Z,user_data=None,user_id='652d1ea975dc454aa4c72d74ddd8af68',uuid=a5836f8c-079b-4437-ab51-6878f0a4a7f8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "452715bd-2291-4c3c-b6e8-a692dc72d1ac", "address": "fa:16:3e:75:d1:04", "network": {"id": "76705db8-2e7f-449c-b512-6747bad0c324", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1601912422-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54b447696c4a49e5838ae21456bc60e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap452715bd-22", "ovs_interfaceid": "452715bd-2291-4c3c-b6e8-a692dc72d1ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 11:47:08 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-4d6fb0e2-a6a1-4a1f-9811-d1ea55a1acc4 tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Converting VIF {"id": "452715bd-2291-4c3c-b6e8-a692dc72d1ac", "address": "fa:16:3e:75:d1:04", "network": {"id": "76705db8-2e7f-449c-b512-6747bad0c324", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1601912422-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54b447696c4a49e5838ae21456bc60e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap452715bd-22", "ovs_interfaceid": "452715bd-2291-4c3c-b6e8-a692dc72d1ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:47:08 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-4d6fb0e2-a6a1-4a1f-9811-d1ea55a1acc4 tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:d1:04,bridge_name='br-int',has_traffic_filtering=True,id=452715bd-2291-4c3c-b6e8-a692dc72d1ac,network=Network(76705db8-2e7f-449c-b512-6747bad0c324),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap452715bd-22') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:47:08 user nova-compute[73449]: DEBUG os_vif [None req-4d6fb0e2-a6a1-4a1f-9811-d1ea55a1acc4 tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:d1:04,bridge_name='br-int',has_traffic_filtering=True,id=452715bd-2291-4c3c-b6e8-a692dc72d1ac,network=Network(76705db8-2e7f-449c-b512-6747bad0c324),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap452715bd-22') {{(pid=73449) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 11:47:08 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:47:08 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:47:08 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 11:47:08 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:47:08 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap452715bd-22, may_exist=True, interface_attrs={}) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:47:08 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap452715bd-22, col_values=(('external_ids', {'iface-id': '452715bd-2291-4c3c-b6e8-a692dc72d1ac', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:75:d1:04', 'vm-uuid': 'a5836f8c-079b-4437-ab51-6878f0a4a7f8'}),), if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:47:08 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:47:08 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:47:08 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:47:08 user nova-compute[73449]: INFO os_vif [None req-4d6fb0e2-a6a1-4a1f-9811-d1ea55a1acc4 tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:d1:04,bridge_name='br-int',has_traffic_filtering=True,id=452715bd-2291-4c3c-b6e8-a692dc72d1ac,network=Network(76705db8-2e7f-449c-b512-6747bad0c324),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap452715bd-22')
Aug 17 11:47:08 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-4d6fb0e2-a6a1-4a1f-9811-d1ea55a1acc4 tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] No BDM found with device name vda, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 11:47:08 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-4d6fb0e2-a6a1-4a1f-9811-d1ea55a1acc4 tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] No VIF found with MAC fa:16:3e:75:d1:04, not building metadata {{(pid=73449) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 11:47:08 user nova-compute[73449]: DEBUG nova.network.neutron [req-efeadbfd-5d15-4b7c-9c94-875b04212362 req-798ae8ec-525a-442b-b971-4b970c4260a9 service nova] [instance: a5836f8c-079b-4437-ab51-6878f0a4a7f8] Updated VIF entry in instance network info cache for port 452715bd-2291-4c3c-b6e8-a692dc72d1ac. {{(pid=73449) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 11:47:08 user nova-compute[73449]: DEBUG nova.network.neutron [req-efeadbfd-5d15-4b7c-9c94-875b04212362 req-798ae8ec-525a-442b-b971-4b970c4260a9 service nova] [instance: a5836f8c-079b-4437-ab51-6878f0a4a7f8] Updating instance_info_cache with network_info: [{"id": "452715bd-2291-4c3c-b6e8-a692dc72d1ac", "address": "fa:16:3e:75:d1:04", "network": {"id": "76705db8-2e7f-449c-b512-6747bad0c324", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1601912422-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54b447696c4a49e5838ae21456bc60e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap452715bd-22", "ovs_interfaceid": "452715bd-2291-4c3c-b6e8-a692dc72d1ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:47:08 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-efeadbfd-5d15-4b7c-9c94-875b04212362 req-798ae8ec-525a-442b-b971-4b970c4260a9 service nova] Releasing lock "refresh_cache-a5836f8c-079b-4437-ab51-6878f0a4a7f8" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:47:09 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:47:09 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:47:09 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:47:09 user nova-compute[73449]: DEBUG nova.compute.manager [req-48b027b1-0583-4c07-8ba4-5b1788b99d0f req-98a5d573-10a9-4b44-a19f-d80c0db42faf service nova] [instance: a5836f8c-079b-4437-ab51-6878f0a4a7f8] Received event network-vif-plugged-452715bd-2291-4c3c-b6e8-a692dc72d1ac {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:47:09 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-48b027b1-0583-4c07-8ba4-5b1788b99d0f req-98a5d573-10a9-4b44-a19f-d80c0db42faf service nova] Acquiring lock "a5836f8c-079b-4437-ab51-6878f0a4a7f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:47:09 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-48b027b1-0583-4c07-8ba4-5b1788b99d0f req-98a5d573-10a9-4b44-a19f-d80c0db42faf service nova] Lock "a5836f8c-079b-4437-ab51-6878f0a4a7f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:47:09 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-48b027b1-0583-4c07-8ba4-5b1788b99d0f req-98a5d573-10a9-4b44-a19f-d80c0db42faf service nova] Lock "a5836f8c-079b-4437-ab51-6878f0a4a7f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:47:09 user nova-compute[73449]: DEBUG nova.compute.manager [req-48b027b1-0583-4c07-8ba4-5b1788b99d0f req-98a5d573-10a9-4b44-a19f-d80c0db42faf service nova] [instance: a5836f8c-079b-4437-ab51-6878f0a4a7f8] No waiting events found dispatching network-vif-plugged-452715bd-2291-4c3c-b6e8-a692dc72d1ac {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:47:09 user nova-compute[73449]: WARNING nova.compute.manager [req-48b027b1-0583-4c07-8ba4-5b1788b99d0f req-98a5d573-10a9-4b44-a19f-d80c0db42faf service nova] [instance: a5836f8c-079b-4437-ab51-6878f0a4a7f8] Received unexpected event network-vif-plugged-452715bd-2291-4c3c-b6e8-a692dc72d1ac for instance with vm_state building and task_state spawning.
Aug 17 11:47:10 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:47:10 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:47:10 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:47:10 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:47:11 user nova-compute[73449]: DEBUG nova.compute.manager [req-18836d82-e04c-497c-9b85-f3b1c816d787 req-42c3664f-dbaf-4912-8b26-068a70382e2b service nova] [instance: a5836f8c-079b-4437-ab51-6878f0a4a7f8] Received event network-vif-plugged-452715bd-2291-4c3c-b6e8-a692dc72d1ac {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:47:11 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-18836d82-e04c-497c-9b85-f3b1c816d787 req-42c3664f-dbaf-4912-8b26-068a70382e2b service nova] Acquiring lock "a5836f8c-079b-4437-ab51-6878f0a4a7f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:47:11 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-18836d82-e04c-497c-9b85-f3b1c816d787 req-42c3664f-dbaf-4912-8b26-068a70382e2b service nova] Lock "a5836f8c-079b-4437-ab51-6878f0a4a7f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:47:11 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-18836d82-e04c-497c-9b85-f3b1c816d787 req-42c3664f-dbaf-4912-8b26-068a70382e2b service nova] Lock "a5836f8c-079b-4437-ab51-6878f0a4a7f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:47:11 user nova-compute[73449]: DEBUG nova.compute.manager [req-18836d82-e04c-497c-9b85-f3b1c816d787 req-42c3664f-dbaf-4912-8b26-068a70382e2b service nova] [instance: a5836f8c-079b-4437-ab51-6878f0a4a7f8] No waiting events found dispatching network-vif-plugged-452715bd-2291-4c3c-b6e8-a692dc72d1ac {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:47:11 user nova-compute[73449]: WARNING nova.compute.manager [req-18836d82-e04c-497c-9b85-f3b1c816d787 req-42c3664f-dbaf-4912-8b26-068a70382e2b service nova] [instance: a5836f8c-079b-4437-ab51-6878f0a4a7f8] Received unexpected event network-vif-plugged-452715bd-2291-4c3c-b6e8-a692dc72d1ac for instance with vm_state building and task_state spawning.
Aug 17 11:47:11 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692272831.9681165, a5836f8c-079b-4437-ab51-6878f0a4a7f8 => Resumed> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:47:11 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: a5836f8c-079b-4437-ab51-6878f0a4a7f8] VM Resumed (Lifecycle Event)
Aug 17 11:47:11 user nova-compute[73449]: DEBUG nova.compute.manager [None req-4d6fb0e2-a6a1-4a1f-9811-d1ea55a1acc4 tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] [instance: a5836f8c-079b-4437-ab51-6878f0a4a7f8] Instance event wait completed in 0 seconds for  {{(pid=73449) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 11:47:11 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-4d6fb0e2-a6a1-4a1f-9811-d1ea55a1acc4 tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] [instance: a5836f8c-079b-4437-ab51-6878f0a4a7f8] Guest created on hypervisor {{(pid=73449) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 11:47:11 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: a5836f8c-079b-4437-ab51-6878f0a4a7f8] Instance spawned successfully.
Aug 17 11:47:11 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-4d6fb0e2-a6a1-4a1f-9811-d1ea55a1acc4 tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] [instance: a5836f8c-079b-4437-ab51-6878f0a4a7f8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 11:47:11 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: a5836f8c-079b-4437-ab51-6878f0a4a7f8] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:47:11 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: a5836f8c-079b-4437-ab51-6878f0a4a7f8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 11:47:12 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-4d6fb0e2-a6a1-4a1f-9811-d1ea55a1acc4 tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] [instance: a5836f8c-079b-4437-ab51-6878f0a4a7f8] Found default for hw_cdrom_bus of ide {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:47:12 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-4d6fb0e2-a6a1-4a1f-9811-d1ea55a1acc4 tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] [instance: a5836f8c-079b-4437-ab51-6878f0a4a7f8] Found default for hw_disk_bus of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:47:12 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-4d6fb0e2-a6a1-4a1f-9811-d1ea55a1acc4 tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] [instance: a5836f8c-079b-4437-ab51-6878f0a4a7f8] Found default for hw_input_bus of None {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:47:12 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-4d6fb0e2-a6a1-4a1f-9811-d1ea55a1acc4 tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] [instance: a5836f8c-079b-4437-ab51-6878f0a4a7f8] Found default for hw_pointer_model of None {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:47:12 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-4d6fb0e2-a6a1-4a1f-9811-d1ea55a1acc4 tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] [instance: a5836f8c-079b-4437-ab51-6878f0a4a7f8] Found default for hw_video_model of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:47:12 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-4d6fb0e2-a6a1-4a1f-9811-d1ea55a1acc4 tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] [instance: a5836f8c-079b-4437-ab51-6878f0a4a7f8] Found default for hw_vif_model of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:47:12 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: a5836f8c-079b-4437-ab51-6878f0a4a7f8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 11:47:12 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692272831.9721189, a5836f8c-079b-4437-ab51-6878f0a4a7f8 => Started> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:47:12 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: a5836f8c-079b-4437-ab51-6878f0a4a7f8] VM Started (Lifecycle Event)
Aug 17 11:47:12 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: a5836f8c-079b-4437-ab51-6878f0a4a7f8] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:47:12 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: a5836f8c-079b-4437-ab51-6878f0a4a7f8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 11:47:12 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: a5836f8c-079b-4437-ab51-6878f0a4a7f8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 11:47:12 user nova-compute[73449]: INFO nova.compute.manager [None req-4d6fb0e2-a6a1-4a1f-9811-d1ea55a1acc4 tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] [instance: a5836f8c-079b-4437-ab51-6878f0a4a7f8] Took 6.03 seconds to spawn the instance on the hypervisor.
Aug 17 11:47:12 user nova-compute[73449]: DEBUG nova.compute.manager [None req-4d6fb0e2-a6a1-4a1f-9811-d1ea55a1acc4 tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] [instance: a5836f8c-079b-4437-ab51-6878f0a4a7f8] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:47:12 user nova-compute[73449]: INFO nova.compute.manager [None req-4d6fb0e2-a6a1-4a1f-9811-d1ea55a1acc4 tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] [instance: a5836f8c-079b-4437-ab51-6878f0a4a7f8] Took 6.91 seconds to build instance.
Aug 17 11:47:12 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-4d6fb0e2-a6a1-4a1f-9811-d1ea55a1acc4 tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Lock "a5836f8c-079b-4437-ab51-6878f0a4a7f8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.004s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:47:12 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-31167253-0f40-4f0f-b064-b3f378d48b68 tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] Acquiring lock "c69e7643-8c60-4982-986b-484e8cfc3fa9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:47:12 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-31167253-0f40-4f0f-b064-b3f378d48b68 tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] Lock "c69e7643-8c60-4982-986b-484e8cfc3fa9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:47:12 user nova-compute[73449]: DEBUG nova.objects.instance [None req-31167253-0f40-4f0f-b064-b3f378d48b68 tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] Lazy-loading 'flavor' on Instance uuid c69e7643-8c60-4982-986b-484e8cfc3fa9 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:47:12 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-31167253-0f40-4f0f-b064-b3f378d48b68 tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] Lock "c69e7643-8c60-4982-986b-484e8cfc3fa9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:47:12 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-31167253-0f40-4f0f-b064-b3f378d48b68 tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] Acquiring lock "c69e7643-8c60-4982-986b-484e8cfc3fa9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:47:12 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-31167253-0f40-4f0f-b064-b3f378d48b68 tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] Lock "c69e7643-8c60-4982-986b-484e8cfc3fa9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:47:12 user nova-compute[73449]: INFO nova.compute.manager [None req-31167253-0f40-4f0f-b064-b3f378d48b68 tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] [instance: c69e7643-8c60-4982-986b-484e8cfc3fa9] Attaching volume a802ac33-831b-4da8-b9b9-a08ce8014504 to /dev/sdc
Aug 17 11:47:12 user nova-compute[73449]: DEBUG os_brick.utils [None req-31167253-0f40-4f0f-b064-b3f378d48b68 tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 11:47:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:47:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:47:12 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[476e2ecb-2129-4cae-8703-93aece7e7052]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4d3924302012\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:47:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:47:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:47:12 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbb06d8e-6606-4480-aafc-5c96e6e531af]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:47:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:47:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:47:12 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[99f0fb0e-bfd7-4383-9d64-6aea1ce4d920]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:47:12 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[456e7ba4-7e9e-473f-b5d8-768a9adbf1cb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:47:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-31167253-0f40-4f0f-b064-b3f378d48b68 tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] Running cmd (subprocess): nvme version {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:47:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-31167253-0f40-4f0f-b064-b3f378d48b68 tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] 'nvme version' failed. Not Retrying. {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 11:47:12 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.nvmeof [None req-31167253-0f40-4f0f-b064-b3f378d48b68 tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] nvme not present on system {{(pid=73449) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 11:47:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:47:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 11:47:12 user nova-compute[73449]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 11:47:12 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[f57039f9-6905-4642-935c-4af17befb4c9]: (4, '') {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:47:12 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-31167253-0f40-4f0f-b064-b3f378d48b68 tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73449) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 11:47:12 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-31167253-0f40-4f0f-b064-b3f378d48b68 tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73449) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 11:47:12 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-31167253-0f40-4f0f-b064-b3f378d48b68 tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] LIGHTOS: no hostnqn found. {{(pid=73449) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 11:47:12 user nova-compute[73449]: DEBUG os_brick.utils [None req-31167253-0f40-4f0f-b064-b3f378d48b68 tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4d3924302012', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 11:47:12 user nova-compute[73449]: DEBUG nova.virt.block_device [None req-31167253-0f40-4f0f-b064-b3f378d48b68 tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] [instance: c69e7643-8c60-4982-986b-484e8cfc3fa9] Updating existing volume attachment record: 4c39a793-7815-4f84-a127-02370fcd31c8 {{(pid=73449) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 11:47:12 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:47:13 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:47:16 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a48502da-ba55-4691-807f-a76206858ac2 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] Calling os-brick to attach iSCSI Volume {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 11:47:16 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-a48502da-ba55-4691-807f-a76206858ac2 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gcRoTASv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 11:47:16 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-a48502da-ba55-4691-807f-a76206858ac2 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 11:47:16 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-a48502da-ba55-4691-807f-a76206858ac2 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:47:16 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-a48502da-ba55-4691-807f-a76206858ac2 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:47:16 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-a48502da-ba55-4691-807f-a76206858ac2 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 11:47:16 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-a48502da-ba55-4691-807f-a76206858ac2 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:47:16 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-a48502da-ba55-4691-807f-a76206858ac2 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:47:16 user nova-compute[73449]: INFO os_brick.initiator.connectors.iscsi [None req-a48502da-ba55-4691-807f-a76206858ac2 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 11:47:16 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c -p 172.16.0.220:3260 {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:47:16 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:47:16 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[f344606b-1a38-4305-9881-ad91caeb2fc9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:47:16 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-a48502da-ba55-4691-807f-a76206858ac2 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 11:47:16 user nova-compute[73449]:  {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:47:16 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c -p 172.16.0.220:3260 --interface default --op new {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:47:16 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:47:16 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[c51adf1f-ca9e-4941-bbca-bac31534af77]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c] added\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:47:16 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-a48502da-ba55-4691-807f-a76206858ac2 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c] added
Aug 17 11:47:16 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:47:16 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:47:16 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:47:16 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7885dee-7bee-4d1d-bb3d-2e5c66ad2bc9]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:47:16 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-a48502da-ba55-4691-807f-a76206858ac2 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:47:16 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:47:16 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:47:16 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[97f067d8-5fcd-4388-b51c-538edd737e57]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:47:16 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-a48502da-ba55-4691-807f-a76206858ac2 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:47:16 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gcRoTASv {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:47:16 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gcRoTASv" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:47:16 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a2bc3d5-b11f-4778-89fe-889091481665]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:47:16 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-a48502da-ba55-4691-807f-a76206858ac2 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gcRoTASv'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:47:16 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:47:16 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:47:16 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce0b1e31-d788-43f6-aca4-6ae87df46691]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:47:16 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-a48502da-ba55-4691-807f-a76206858ac2 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:47:16 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:47:16 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:47:16 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[44475860-5e22-4ad2-9a4e-ebf5c9208892]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611 (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:47:16 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-a48502da-ba55-4691-807f-a76206858ac2 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed (non-flash)
Aug 17 11:47:16 user nova-compute[73449]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466 (non-flash)
Aug 17 11:47:16 user nova-compute[73449]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611 (non-flash)
Aug 17 11:47:16 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:47:16 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-a48502da-ba55-4691-807f-a76206858ac2 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed (non-flash)
Aug 17 11:47:16 user nova-compute[73449]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466 (non-flash)
Aug 17 11:47:16 user nova-compute[73449]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611 (non-flash)
Aug 17 11:47:16 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:47:16 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c -p 172.16.0.220:3260 --login {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:47:17 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:47:17 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c2c22db-a69d-4a7f-8b1e-e3464fe1e8e3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:47:17 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-a48502da-ba55-4691-807f-a76206858ac2 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c, portal: 172.16.0.220,3260]
Aug 17 11:47:17 user nova-compute[73449]: Login to [iface: default, target: iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c, portal: 172.16.0.220,3260] successful.
Aug 17 11:47:17 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:47:17 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:47:17 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:47:17 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[a31d15f1-0d52-4f24-a2c8-5ee5688f6da2]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:47:17 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-a48502da-ba55-4691-807f-a76206858ac2 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:47:17 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:47:17 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:47:17 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[3959778d-bf44-40b2-8710-17d687e01e5a]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:47:17 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-a48502da-ba55-4691-807f-a76206858ac2 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed (non-flash)
Aug 17 11:47:17 user nova-compute[73449]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466 (non-flash)
Aug 17 11:47:17 user nova-compute[73449]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611 (non-flash)
Aug 17 11:47:17 user nova-compute[73449]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c (non-flash)
Aug 17 11:47:17 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:47:17 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-a48502da-ba55-4691-807f-a76206858ac2 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed (non-flash)
Aug 17 11:47:17 user nova-compute[73449]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466 (non-flash)
Aug 17 11:47:17 user nova-compute[73449]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611 (non-flash)
Aug 17 11:47:17 user nova-compute[73449]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c (non-flash)
Aug 17 11:47:17 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:47:17 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-a48502da-ba55-4691-807f-a76206858ac2 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:47:17 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-a48502da-ba55-4691-807f-a76206858ac2 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Connected to 172.16.0.220:3260 {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 11:47:17 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-a48502da-ba55-4691-807f-a76206858ac2 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] HCTL ('36', '-', '-', 0) found on session 21 with lun 0 {{(pid=73449) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 11:47:17 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-a48502da-ba55-4691-807f-a76206858ac2 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73449) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 11:47:17 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:47:17 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:47:17 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[889bf4b3-7f94-4647-ae08-56006cffbd46]: (4, ('- - 0', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:47:17 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-a48502da-ba55-4691-807f-a76206858ac2 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Searching for a device in session 21 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73449) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 11:47:17 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-a48502da-ba55-4691-807f-a76206858ac2 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gcRoTASv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 11:47:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:47:18 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-a48502da-ba55-4691-807f-a76206858ac2 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.347s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:47:18 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-a48502da-ba55-4691-807f-a76206858ac2 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] <== connect_volume: return (1349ms) {'type': 'block', 'scsi_wwn': '26633623061353231', 'path': '/dev/sde'} {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 11:47:18 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a48502da-ba55-4691-807f-a76206858ac2 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26633623061353231', 'path': '/dev/sde'} {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 11:47:18 user nova-compute[73449]: DEBUG nova.objects.instance [None req-a48502da-ba55-4691-807f-a76206858ac2 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Lazy-loading 'flavor' on Instance uuid de5084e1-5a5e-48d2-a3ef-7f29898d1d2d {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:47:18 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-a48502da-ba55-4691-807f-a76206858ac2 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 11:47:18 user nova-compute[73449]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 11:47:18 user nova-compute[73449]:   <source dev="/dev/sde"/>
Aug 17 11:47:18 user nova-compute[73449]:   <target dev="vdb" bus="virtio"/>
Aug 17 11:47:18 user nova-compute[73449]:   <serial>365e93f2-f46d-4b14-b207-f56656bc918c</serial>
Aug 17 11:47:18 user nova-compute[73449]: </disk>
Aug 17 11:47:18 user nova-compute[73449]:  {{(pid=73449) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 11:47:18 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:47:18 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-a48502da-ba55-4691-807f-a76206858ac2 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] No BDM found with device name vda, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 11:47:18 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-a48502da-ba55-4691-807f-a76206858ac2 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 11:47:18 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-a48502da-ba55-4691-807f-a76206858ac2 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] No VIF found with MAC fa:16:3e:c0:c8:a6, not building metadata {{(pid=73449) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 11:47:18 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a48502da-ba55-4691-807f-a76206858ac2 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Lock "de5084e1-5a5e-48d2-a3ef-7f29898d1d2d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.215s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:47:19 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:47:22 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:47:23 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:47:24 user nova-compute[73449]: DEBUG nova.compute.manager [req-54284997-3c62-4573-b211-3edd7f25f8b5 req-cc966bd6-ab10-42f5-bd77-15d1041593bb service nova] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] Received event network-changed-460de6e4-4651-4b83-93bd-fbb5db34bcfa {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:47:24 user nova-compute[73449]: DEBUG nova.compute.manager [req-54284997-3c62-4573-b211-3edd7f25f8b5 req-cc966bd6-ab10-42f5-bd77-15d1041593bb service nova] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] Refreshing instance network info cache due to event network-changed-460de6e4-4651-4b83-93bd-fbb5db34bcfa. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 11:47:24 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-54284997-3c62-4573-b211-3edd7f25f8b5 req-cc966bd6-ab10-42f5-bd77-15d1041593bb service nova] Acquiring lock "refresh_cache-e8e7d9aa-150f-424a-b3af-be149ee421c3" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:47:24 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-54284997-3c62-4573-b211-3edd7f25f8b5 req-cc966bd6-ab10-42f5-bd77-15d1041593bb service nova] Acquired lock "refresh_cache-e8e7d9aa-150f-424a-b3af-be149ee421c3" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:47:24 user nova-compute[73449]: DEBUG nova.network.neutron [req-54284997-3c62-4573-b211-3edd7f25f8b5 req-cc966bd6-ab10-42f5-bd77-15d1041593bb service nova] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] Refreshing network info cache for port 460de6e4-4651-4b83-93bd-fbb5db34bcfa {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 11:47:24 user nova-compute[73449]: DEBUG nova.network.neutron [req-54284997-3c62-4573-b211-3edd7f25f8b5 req-cc966bd6-ab10-42f5-bd77-15d1041593bb service nova] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] Updated VIF entry in instance network info cache for port 460de6e4-4651-4b83-93bd-fbb5db34bcfa. {{(pid=73449) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 11:47:24 user nova-compute[73449]: DEBUG nova.network.neutron [req-54284997-3c62-4573-b211-3edd7f25f8b5 req-cc966bd6-ab10-42f5-bd77-15d1041593bb service nova] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] Updating instance_info_cache with network_info: [{"id": "460de6e4-4651-4b83-93bd-fbb5db34bcfa", "address": "fa:16:3e:59:e7:ee", "network": {"id": "d4fc5f62-8de4-4df1-9e12-0f192a793f5f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1016129651-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a0323f43b04829a3b1e81266986cbf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap460de6e4-46", "ovs_interfaceid": "460de6e4-4651-4b83-93bd-fbb5db34bcfa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:47:24 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-54284997-3c62-4573-b211-3edd7f25f8b5 req-cc966bd6-ab10-42f5-bd77-15d1041593bb service nova] Releasing lock "refresh_cache-e8e7d9aa-150f-424a-b3af-be149ee421c3" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:47:25 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-51849c9e-271f-49d3-9fbe-1aa91bc62f08 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Acquiring lock "a3523d22-7165-46ad-be10-5e6ae374f91d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:47:25 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-51849c9e-271f-49d3-9fbe-1aa91bc62f08 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Lock "a3523d22-7165-46ad-be10-5e6ae374f91d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:47:25 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-51849c9e-271f-49d3-9fbe-1aa91bc62f08 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Acquiring lock "a3523d22-7165-46ad-be10-5e6ae374f91d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:47:25 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-51849c9e-271f-49d3-9fbe-1aa91bc62f08 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Lock "a3523d22-7165-46ad-be10-5e6ae374f91d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:47:25 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-51849c9e-271f-49d3-9fbe-1aa91bc62f08 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Lock "a3523d22-7165-46ad-be10-5e6ae374f91d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:47:25 user nova-compute[73449]: INFO nova.compute.manager [None req-51849c9e-271f-49d3-9fbe-1aa91bc62f08 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Terminating instance
Aug 17 11:47:25 user nova-compute[73449]: DEBUG nova.compute.manager [None req-51849c9e-271f-49d3-9fbe-1aa91bc62f08 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Start destroying the instance on the hypervisor. {{(pid=73449) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 11:47:25 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:47:25 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:47:25 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:47:25 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:47:25 user nova-compute[73449]: INFO nova.compute.manager [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] Rebuilding instance
Aug 17 11:47:25 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31167253-0f40-4f0f-b064-b3f378d48b68 tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] [instance: c69e7643-8c60-4982-986b-484e8cfc3fa9] Calling os-brick to attach iSCSI Volume {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 11:47:25 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-31167253-0f40-4f0f-b064-b3f378d48b68 tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a802ac33-831b-4da8-b9b9-a08ce8014504'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WqBJeswn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 11:47:25 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-31167253-0f40-4f0f-b064-b3f378d48b68 tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 11:47:25 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-31167253-0f40-4f0f-b064-b3f378d48b68 tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:47:25 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-31167253-0f40-4f0f-b064-b3f378d48b68 tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:47:25 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-31167253-0f40-4f0f-b064-b3f378d48b68 tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 11:47:25 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-31167253-0f40-4f0f-b064-b3f378d48b68 tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a802ac33-831b-4da8-b9b9-a08ce8014504" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:47:25 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-31167253-0f40-4f0f-b064-b3f378d48b68 tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a802ac33-831b-4da8-b9b9-a08ce8014504" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:47:25 user nova-compute[73449]: INFO os_brick.initiator.connectors.iscsi [None req-31167253-0f40-4f0f-b064-b3f378d48b68 tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 11:47:25 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a802ac33-831b-4da8-b9b9-a08ce8014504 -p 172.16.0.220:3260 {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:47:25 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a802ac33-831b-4da8-b9b9-a08ce8014504 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:47:25 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[1531bfbb-4d5d-4bfa-8622-8efdba706c0a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:47:25 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-31167253-0f40-4f0f-b064-b3f378d48b68 tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 11:47:25 user nova-compute[73449]:  {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:47:25 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a802ac33-831b-4da8-b9b9-a08ce8014504 -p 172.16.0.220:3260 --interface default --op new {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:47:25 user nova-compute[73449]: DEBUG nova.objects.instance [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Lazy-loading 'trusted_certs' on Instance uuid e8e7d9aa-150f-424a-b3af-be149ee421c3 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:47:25 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a802ac33-831b-4da8-b9b9-a08ce8014504 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:47:25 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd5e9a36-1982-4f4b-bbf2-040ba74def9e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a802ac33-831b-4da8-b9b9-a08ce8014504] added\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:47:25 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-31167253-0f40-4f0f-b064-b3f378d48b68 tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a802ac33-831b-4da8-b9b9-a08ce8014504] added
Aug 17 11:47:25 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:47:25 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a802ac33-831b-4da8-b9b9-a08ce8014504 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:47:25 user nova-compute[73449]: DEBUG nova.compute.manager [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:47:25 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a802ac33-831b-4da8-b9b9-a08ce8014504 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:47:25 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[f355f6f3-e89f-4cea-8544-005c9e1cb2ce]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:47:25 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-31167253-0f40-4f0f-b064-b3f378d48b68 tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:47:25 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a802ac33-831b-4da8-b9b9-a08ce8014504 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:47:25 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a802ac33-831b-4da8-b9b9-a08ce8014504 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:47:25 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d6b8dde-a665-42ee-bd32-912311437721]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:47:25 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-31167253-0f40-4f0f-b064-b3f378d48b68 tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:47:25 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a802ac33-831b-4da8-b9b9-a08ce8014504 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WqBJeswn {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:47:25 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a802ac33-831b-4da8-b9b9-a08ce8014504 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WqBJeswn" returned: 0 in 0.024s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:47:25 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc6a5ca9-4097-4994-b215-2ab5a9ce993c]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:47:25 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-31167253-0f40-4f0f-b064-b3f378d48b68 tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WqBJeswn'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:47:25 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a802ac33-831b-4da8-b9b9-a08ce8014504 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:47:25 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a802ac33-831b-4da8-b9b9-a08ce8014504 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:47:25 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[bca6dfff-7a3b-4bd6-99cc-be1f3cf2aab7]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:47:25 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-31167253-0f40-4f0f-b064-b3f378d48b68 tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:47:25 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:47:25 user nova-compute[73449]: DEBUG nova.objects.instance [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Lazy-loading 'pci_requests' on Instance uuid e8e7d9aa-150f-424a-b3af-be149ee421c3 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:47:25 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:47:25 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[1006f1ce-c01c-40fc-9ef4-05a137dd8700]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:47:25 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-31167253-0f40-4f0f-b064-b3f378d48b68 tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed (non-flash)
Aug 17 11:47:25 user nova-compute[73449]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466 (non-flash)
Aug 17 11:47:25 user nova-compute[73449]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611 (non-flash)
Aug 17 11:47:25 user nova-compute[73449]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c (non-flash)
Aug 17 11:47:25 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:47:25 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-31167253-0f40-4f0f-b064-b3f378d48b68 tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed (non-flash)
Aug 17 11:47:25 user nova-compute[73449]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466 (non-flash)
Aug 17 11:47:25 user nova-compute[73449]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611 (non-flash)
Aug 17 11:47:25 user nova-compute[73449]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c (non-flash)
Aug 17 11:47:25 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:47:25 user nova-compute[73449]: DEBUG nova.objects.instance [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Lazy-loading 'pci_devices' on Instance uuid e8e7d9aa-150f-424a-b3af-be149ee421c3 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:47:25 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a802ac33-831b-4da8-b9b9-a08ce8014504 -p 172.16.0.220:3260 --login {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:47:25 user nova-compute[73449]: DEBUG nova.objects.instance [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Lazy-loading 'resources' on Instance uuid e8e7d9aa-150f-424a-b3af-be149ee421c3 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:47:25 user nova-compute[73449]: DEBUG nova.objects.instance [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Lazy-loading 'migration_context' on Instance uuid e8e7d9aa-150f-424a-b3af-be149ee421c3 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:47:25 user nova-compute[73449]: DEBUG nova.objects.instance [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] Trying to apply a migration context that does not seem to be set for this instance {{(pid=73449) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 17 11:47:25 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a802ac33-831b-4da8-b9b9-a08ce8014504 -p 172.16.0.220:3260 --login" returned: 0 in 0.095s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:47:25 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1055c8d-5b14-481c-8bdf-c3a9229ff581]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a802ac33-831b-4da8-b9b9-a08ce8014504, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a802ac33-831b-4da8-b9b9-a08ce8014504, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:47:25 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-31167253-0f40-4f0f-b064-b3f378d48b68 tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a802ac33-831b-4da8-b9b9-a08ce8014504, portal: 172.16.0.220,3260]
Aug 17 11:47:25 user nova-compute[73449]: Login to [iface: default, target: iqn.2010-10.org.openstack:a802ac33-831b-4da8-b9b9-a08ce8014504, portal: 172.16.0.220,3260] successful.
Aug 17 11:47:25 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:47:25 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a802ac33-831b-4da8-b9b9-a08ce8014504 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:47:25 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:47:25 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a802ac33-831b-4da8-b9b9-a08ce8014504 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:47:25 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[3692bd8b-7188-48a0-a050-e3a9d52829a4]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:47:25 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-31167253-0f40-4f0f-b064-b3f378d48b68 tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:47:25 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:47:25 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Instance destroyed successfully.
Aug 17 11:47:25 user nova-compute[73449]: DEBUG nova.objects.instance [None req-51849c9e-271f-49d3-9fbe-1aa91bc62f08 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Lazy-loading 'resources' on Instance uuid a3523d22-7165-46ad-be10-5e6ae374f91d {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:47:25 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-51849c9e-271f-49d3-9fbe-1aa91bc62f08 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:40:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1694310922',display_name='tempest-ServerStableDeviceRescueTest-server-1694310922',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1694310922',id=3,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHtRTrQb6UH8zrb1TbmYhNcUUKT9x8E5WNd+hiFJcSJTxxGQa8gp0XBdyZFjt5NbH6w45uBC2lCrVZUblWmjSKUPuTRaSHQWpvcVWlL40C4ztfmmZssisFEp6QhzuuUl/g==',key_name='tempest-keypair-75432170',keypairs=<?>,launch_index=0,launched_at=2023-08-17T11:44:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9eed9899860d4e7ca8a4500bbda4be13',ramdisk_id='',reservation_id='r-rl7fxx5l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-2093936836',owner_user_name='tempest-ServerStableDeviceRescueTest-2093936836-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T11:46:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d01f62699d2648cfa940fd73d9a82dbe',uuid=a3523d22-7165-46ad-be10-5e6ae374f91d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2a0eb61f-9398-4db6-9ae0-f142ad2e60c4", "address": "fa:16:3e:15:cd:09", "network": {"id": "d54a402f-1fa9-43d8-b68e-0aa7ae6f0e73", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1441085328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eed9899860d4e7ca8a4500bbda4be13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a0eb61f-93", "ovs_interfaceid": "2a0eb61f-9398-4db6-9ae0-f142ad2e60c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 11:47:25 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-51849c9e-271f-49d3-9fbe-1aa91bc62f08 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Converting VIF {"id": "2a0eb61f-9398-4db6-9ae0-f142ad2e60c4", "address": "fa:16:3e:15:cd:09", "network": {"id": "d54a402f-1fa9-43d8-b68e-0aa7ae6f0e73", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1441085328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eed9899860d4e7ca8a4500bbda4be13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a0eb61f-93", "ovs_interfaceid": "2a0eb61f-9398-4db6-9ae0-f142ad2e60c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:47:25 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-51849c9e-271f-49d3-9fbe-1aa91bc62f08 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:15:cd:09,bridge_name='br-int',has_traffic_filtering=True,id=2a0eb61f-9398-4db6-9ae0-f142ad2e60c4,network=Network(d54a402f-1fa9-43d8-b68e-0aa7ae6f0e73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a0eb61f-93') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:47:25 user nova-compute[73449]: DEBUG os_vif [None req-51849c9e-271f-49d3-9fbe-1aa91bc62f08 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:15:cd:09,bridge_name='br-int',has_traffic_filtering=True,id=2a0eb61f-9398-4db6-9ae0-f142ad2e60c4,network=Network(d54a402f-1fa9-43d8-b68e-0aa7ae6f0e73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a0eb61f-93') {{(pid=73449) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 11:47:25 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:47:25 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6a8f31c-3d8d-4ab7-91db-0079d013c568]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a802ac33-831b-4da8-b9b9-a08ce8014504 (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:47:25 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:47:25 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2a0eb61f-93, bridge=br-int, if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:47:25 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-31167253-0f40-4f0f-b064-b3f378d48b68 tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed (non-flash)
Aug 17 11:47:25 user nova-compute[73449]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466 (non-flash)
Aug 17 11:47:25 user nova-compute[73449]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611 (non-flash)
Aug 17 11:47:25 user nova-compute[73449]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c (non-flash)
Aug 17 11:47:25 user nova-compute[73449]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a802ac33-831b-4da8-b9b9-a08ce8014504 (non-flash)
Aug 17 11:47:25 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:47:25 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-31167253-0f40-4f0f-b064-b3f378d48b68 tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed (non-flash)
Aug 17 11:47:25 user nova-compute[73449]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466 (non-flash)
Aug 17 11:47:25 user nova-compute[73449]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611 (non-flash)
Aug 17 11:47:25 user nova-compute[73449]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c (non-flash)
Aug 17 11:47:25 user nova-compute[73449]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a802ac33-831b-4da8-b9b9-a08ce8014504 (non-flash)
Aug 17 11:47:25 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:47:25 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-31167253-0f40-4f0f-b064-b3f378d48b68 tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a802ac33-831b-4da8-b9b9-a08ce8014504" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.394s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:47:25 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-31167253-0f40-4f0f-b064-b3f378d48b68 tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] Connected to 172.16.0.220:3260 {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 11:47:25 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-31167253-0f40-4f0f-b064-b3f378d48b68 tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] HCTL ('37', '-', '-', 0) found on session 22 with lun 0 {{(pid=73449) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 11:47:25 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-31167253-0f40-4f0f-b064-b3f378d48b68 tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73449) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 11:47:25 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:47:25 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:47:25 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:47:25 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:47:25 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[9711a5a2-982f-42ee-bb19-f71cbbe18b3e]: (4, ('- - 0', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:47:25 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-31167253-0f40-4f0f-b064-b3f378d48b68 tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] Searching for a device in session 22 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73449) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 11:47:25 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-31167253-0f40-4f0f-b064-b3f378d48b68 tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WqBJeswn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 11:47:25 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:47:25 user nova-compute[73449]: INFO os_vif [None req-51849c9e-271f-49d3-9fbe-1aa91bc62f08 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:15:cd:09,bridge_name='br-int',has_traffic_filtering=True,id=2a0eb61f-9398-4db6-9ae0-f142ad2e60c4,network=Network(d54a402f-1fa9-43d8-b68e-0aa7ae6f0e73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a0eb61f-93')
Aug 17 11:47:25 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-51849c9e-271f-49d3-9fbe-1aa91bc62f08 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Deleting instance files /opt/stack/data/nova/instances/a3523d22-7165-46ad-be10-5e6ae374f91d_del
Aug 17 11:47:25 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-51849c9e-271f-49d3-9fbe-1aa91bc62f08 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Deletion of /opt/stack/data/nova/instances/a3523d22-7165-46ad-be10-5e6ae374f91d_del complete
Aug 17 11:47:26 user nova-compute[73449]: INFO nova.compute.manager [None req-51849c9e-271f-49d3-9fbe-1aa91bc62f08 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Took 0.99 seconds to destroy the instance on the hypervisor.
Aug 17 11:47:26 user nova-compute[73449]: DEBUG oslo.service.loopingcall [None req-51849c9e-271f-49d3-9fbe-1aa91bc62f08 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73449) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 11:47:26 user nova-compute[73449]: DEBUG nova.compute.manager [-] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Deallocating network for instance {{(pid=73449) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 11:47:26 user nova-compute[73449]: DEBUG nova.network.neutron [-] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] deallocate_for_instance() {{(pid=73449) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 11:47:26 user nova-compute[73449]: DEBUG nova.compute.manager [req-c2d67ac1-2493-4b16-9c52-d89db056dfae req-bd684f14-7d6c-4f37-af10-6847cedf8862 service nova] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] Received event network-vif-unplugged-460de6e4-4651-4b83-93bd-fbb5db34bcfa {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:47:26 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-c2d67ac1-2493-4b16-9c52-d89db056dfae req-bd684f14-7d6c-4f37-af10-6847cedf8862 service nova] Acquiring lock "e8e7d9aa-150f-424a-b3af-be149ee421c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:47:26 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-c2d67ac1-2493-4b16-9c52-d89db056dfae req-bd684f14-7d6c-4f37-af10-6847cedf8862 service nova] Lock "e8e7d9aa-150f-424a-b3af-be149ee421c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:47:26 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-c2d67ac1-2493-4b16-9c52-d89db056dfae req-bd684f14-7d6c-4f37-af10-6847cedf8862 service nova] Lock "e8e7d9aa-150f-424a-b3af-be149ee421c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:47:26 user nova-compute[73449]: DEBUG nova.compute.manager [req-c2d67ac1-2493-4b16-9c52-d89db056dfae req-bd684f14-7d6c-4f37-af10-6847cedf8862 service nova] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] No waiting events found dispatching network-vif-unplugged-460de6e4-4651-4b83-93bd-fbb5db34bcfa {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:47:26 user nova-compute[73449]: WARNING nova.compute.manager [req-c2d67ac1-2493-4b16-9c52-d89db056dfae req-bd684f14-7d6c-4f37-af10-6847cedf8862 service nova] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] Received unexpected event network-vif-unplugged-460de6e4-4651-4b83-93bd-fbb5db34bcfa for instance with vm_state active and task_state rebuilding.
Aug 17 11:47:26 user nova-compute[73449]: DEBUG nova.compute.manager [req-620a83d9-e1da-40fe-8907-da7481b96bd1 req-28d6c7ad-52bc-4988-b541-3a4997b1e550 service nova] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Received event network-vif-unplugged-2a0eb61f-9398-4db6-9ae0-f142ad2e60c4 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:47:26 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-620a83d9-e1da-40fe-8907-da7481b96bd1 req-28d6c7ad-52bc-4988-b541-3a4997b1e550 service nova] Acquiring lock "a3523d22-7165-46ad-be10-5e6ae374f91d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:47:26 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-620a83d9-e1da-40fe-8907-da7481b96bd1 req-28d6c7ad-52bc-4988-b541-3a4997b1e550 service nova] Lock "a3523d22-7165-46ad-be10-5e6ae374f91d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:47:26 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-620a83d9-e1da-40fe-8907-da7481b96bd1 req-28d6c7ad-52bc-4988-b541-3a4997b1e550 service nova] Lock "a3523d22-7165-46ad-be10-5e6ae374f91d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:47:26 user nova-compute[73449]: DEBUG nova.compute.manager [req-620a83d9-e1da-40fe-8907-da7481b96bd1 req-28d6c7ad-52bc-4988-b541-3a4997b1e550 service nova] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] No waiting events found dispatching network-vif-unplugged-2a0eb61f-9398-4db6-9ae0-f142ad2e60c4 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:47:26 user nova-compute[73449]: DEBUG nova.compute.manager [req-620a83d9-e1da-40fe-8907-da7481b96bd1 req-28d6c7ad-52bc-4988-b541-3a4997b1e550 service nova] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Received event network-vif-unplugged-2a0eb61f-9398-4db6-9ae0-f142ad2e60c4 for instance with task_state deleting. {{(pid=73449) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 11:47:26 user nova-compute[73449]: DEBUG nova.compute.manager [req-620a83d9-e1da-40fe-8907-da7481b96bd1 req-28d6c7ad-52bc-4988-b541-3a4997b1e550 service nova] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Received event network-vif-plugged-2a0eb61f-9398-4db6-9ae0-f142ad2e60c4 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:47:26 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-620a83d9-e1da-40fe-8907-da7481b96bd1 req-28d6c7ad-52bc-4988-b541-3a4997b1e550 service nova] Acquiring lock "a3523d22-7165-46ad-be10-5e6ae374f91d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:47:26 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-620a83d9-e1da-40fe-8907-da7481b96bd1 req-28d6c7ad-52bc-4988-b541-3a4997b1e550 service nova] Lock "a3523d22-7165-46ad-be10-5e6ae374f91d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:47:26 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-620a83d9-e1da-40fe-8907-da7481b96bd1 req-28d6c7ad-52bc-4988-b541-3a4997b1e550 service nova] Lock "a3523d22-7165-46ad-be10-5e6ae374f91d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:47:26 user nova-compute[73449]: DEBUG nova.compute.manager [req-620a83d9-e1da-40fe-8907-da7481b96bd1 req-28d6c7ad-52bc-4988-b541-3a4997b1e550 service nova] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] No waiting events found dispatching network-vif-plugged-2a0eb61f-9398-4db6-9ae0-f142ad2e60c4 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:47:26 user nova-compute[73449]: WARNING nova.compute.manager [req-620a83d9-e1da-40fe-8907-da7481b96bd1 req-28d6c7ad-52bc-4988-b541-3a4997b1e550 service nova] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Received unexpected event network-vif-plugged-2a0eb61f-9398-4db6-9ae0-f142ad2e60c4 for instance with vm_state active and task_state deleting.
Aug 17 11:47:26 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:47:26 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:47:26 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:47:26 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:47:26 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] Instance destroyed successfully.
Aug 17 11:47:26 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] Instance destroyed successfully.
Aug 17 11:47:26 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:45:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-966756449',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1049115068',id=17,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP+u1MgbCgptDidYv18wcR/3nbMgBF04KyJdujQocUddcCZfAdpmYsBffqoFwPxl9btx5HmOLcrmmkZwWw4EsmmDOWNMZubobpCSM0EcykYa0gcYe9cSWHyIH4n+5UjBLw==',key_name='tempest-keypair-100521889',keypairs=<?>,launch_index=0,launched_at=2023-08-17T11:46:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e6a0323f43b04829a3b1e81266986cbf',ramdisk_id='',reservation_id='r-syt2v71c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1991725074',owner_user_name='tempest-ServerActionsV293TestJSON-1991725074-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T11:47:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cae6f48da3304f37a5d5010f3cbd7698',uuid=e8e7d9aa-150f-424a-b3af-be149ee421c3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "460de6e4-4651-4b83-93bd-fbb5db34bcfa", "address": "fa:16:3e:59:e7:ee", "network": {"id": "d4fc5f62-8de4-4df1-9e12-0f192a793f5f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1016129651-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a0323f43b04829a3b1e81266986cbf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap460de6e4-46", "ovs_interfaceid": "460de6e4-4651-4b83-93bd-fbb5db34bcfa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 11:47:26 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Converting VIF {"id": "460de6e4-4651-4b83-93bd-fbb5db34bcfa", "address": "fa:16:3e:59:e7:ee", "network": {"id": "d4fc5f62-8de4-4df1-9e12-0f192a793f5f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1016129651-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a0323f43b04829a3b1e81266986cbf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap460de6e4-46", "ovs_interfaceid": "460de6e4-4651-4b83-93bd-fbb5db34bcfa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:47:26 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:59:e7:ee,bridge_name='br-int',has_traffic_filtering=True,id=460de6e4-4651-4b83-93bd-fbb5db34bcfa,network=Network(d4fc5f62-8de4-4df1-9e12-0f192a793f5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap460de6e4-46') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:47:26 user nova-compute[73449]: DEBUG os_vif [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:e7:ee,bridge_name='br-int',has_traffic_filtering=True,id=460de6e4-4651-4b83-93bd-fbb5db34bcfa,network=Network(d4fc5f62-8de4-4df1-9e12-0f192a793f5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap460de6e4-46') {{(pid=73449) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 11:47:26 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:47:26 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap460de6e4-46, bridge=br-int, if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:47:26 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:47:26 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:47:26 user nova-compute[73449]: INFO os_vif [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:e7:ee,bridge_name='br-int',has_traffic_filtering=True,id=460de6e4-4651-4b83-93bd-fbb5db34bcfa,network=Network(d4fc5f62-8de4-4df1-9e12-0f192a793f5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap460de6e4-46')
Aug 17 11:47:26 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] calling os-brick to detach iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 11:47:26 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, {'target_iqns': ['iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XGrhlpAM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 11:47:26 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 17 11:47:26 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:47:26 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-31167253-0f40-4f0f-b064-b3f378d48b68 tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.431s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:47:26 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-31167253-0f40-4f0f-b064-b3f378d48b68 tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] <== connect_volume: return (1434ms) {'type': 'block', 'scsi_wwn': '26662316638396338', 'path': '/dev/sdf'} {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 11:47:26 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31167253-0f40-4f0f-b064-b3f378d48b68 tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] [instance: c69e7643-8c60-4982-986b-484e8cfc3fa9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26662316638396338', 'path': '/dev/sdf'} {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 11:47:26 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.286s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:47:26 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed', 0)] {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 11:47:26 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:47:26 user nova-compute[73449]: DEBUG nova.objects.instance [None req-31167253-0f40-4f0f-b064-b3f378d48b68 tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] Lazy-loading 'flavor' on Instance uuid c69e7643-8c60-4982-986b-484e8cfc3fa9 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:47:27 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:47:27 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[261f72d6-e158-4f83-b0b3-fd1a3b708727]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a802ac33-831b-4da8-b9b9-a08ce8014504\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:47:27 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:47:27 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-31167253-0f40-4f0f-b064-b3f378d48b68 tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 11:47:27 user nova-compute[73449]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 11:47:27 user nova-compute[73449]:   <source dev="/dev/sdf"/>
Aug 17 11:47:27 user nova-compute[73449]:   <target dev="sdc" bus="scsi"/>
Aug 17 11:47:27 user nova-compute[73449]:   <serial>a802ac33-831b-4da8-b9b9-a08ce8014504</serial>
Aug 17 11:47:27 user nova-compute[73449]:   <address type="drive" controller="0" unit="2"/>
Aug 17 11:47:27 user nova-compute[73449]: </disk>
Aug 17 11:47:27 user nova-compute[73449]:  {{(pid=73449) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 11:47:27 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:47:27 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[18126cab-d3c4-44a7-9452-a94ae666526a]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a802ac33-831b-4da8-b9b9-a08ce8014504 (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:47:27 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed (non-flash)
Aug 17 11:47:27 user nova-compute[73449]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466 (non-flash)
Aug 17 11:47:27 user nova-compute[73449]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611 (non-flash)
Aug 17 11:47:27 user nova-compute[73449]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c (non-flash)
Aug 17 11:47:27 user nova-compute[73449]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a802ac33-831b-4da8-b9b9-a08ce8014504 (non-flash)
Aug 17 11:47:27 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:47:27 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed (non-flash)
Aug 17 11:47:27 user nova-compute[73449]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466 (non-flash)
Aug 17 11:47:27 user nova-compute[73449]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611 (non-flash)
Aug 17 11:47:27 user nova-compute[73449]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c (non-flash)
Aug 17 11:47:27 user nova-compute[73449]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a802ac33-831b-4da8-b9b9-a08ce8014504 (non-flash)
Aug 17 11:47:27 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:47:27 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe7582ed3f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed'): ({'sdc'}, set())}) {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 11:47:27 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Removing single pathed devices sdc {{(pid=73449) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 11:47:27 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:47:27 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:47:27 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb40049e-d279-4db1-878b-a9193ef64c86]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:47:27 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:47:27 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.025s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:47:27 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[dff27204-527a-4132-bdcc-9081b258b0d3]: (4, ('ok\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:47:27 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Flushing IO for device /dev/sdc {{(pid=73449) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 11:47:27 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:47:27 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:47:27 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecb31d32-a47e-4cbf-9e45-a28c7ed94ada]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:47:27 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73449) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 11:47:27 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:47:27 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.056s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:47:27 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[4176cd7e-9fd6-4ed9-aab2-c544704cc2d1]: (4, ('1', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:47:27 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73449) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 11:47:27 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] SCSI volumes sdc have been removed. {{(pid=73449) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 11:47:27 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed')] {{(pid=73449) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 11:47:27 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:47:27 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:47:27 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[818dabf8-c85f-4140-8cfe-cbf03c42dab3]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:47:27 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:47:27 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed -p 172.16.0.220:3260 --logout {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:47:27 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:47:27 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:47:27 user nova-compute[73449]: DEBUG nova.network.neutron [-] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Updating instance_info_cache with network_info: [] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:47:27 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:47:27 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:47:27 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:47:27 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[5102ac1b-b108-43f0-891f-f9395ecd759d]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:47:27 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed, portal: 172.16.0.220,3260]
Aug 17 11:47:27 user nova-compute[73449]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed, portal: 172.16.0.220,3260] successful.
Aug 17 11:47:27 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:47:27 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed -p 172.16.0.220:3260 --op delete {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:47:27 user nova-compute[73449]: INFO nova.compute.manager [-] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Took 1.25 seconds to deallocate network for instance.
Aug 17 11:47:27 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:47:27 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:47:27 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4402d8c-5c86-4752-9986-eb5af0e88d60]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:47:27 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:47:27 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.369s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:47:27 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] <== disconnect_volume: return (655ms) None {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 11:47:27 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] Disconnected iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 11:47:27 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] Deleting instance files /opt/stack/data/nova/instances/e8e7d9aa-150f-424a-b3af-be149ee421c3_del
Aug 17 11:47:27 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] Deletion of /opt/stack/data/nova/instances/e8e7d9aa-150f-424a-b3af-be149ee421c3_del complete
Aug 17 11:47:27 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:47:27 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:47:27 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-51849c9e-271f-49d3-9fbe-1aa91bc62f08 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:47:27 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-51849c9e-271f-49d3-9fbe-1aa91bc62f08 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:47:27 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:47:27 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-31167253-0f40-4f0f-b064-b3f378d48b68 tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] No BDM found with device name sda, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 11:47:27 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-31167253-0f40-4f0f-b064-b3f378d48b68 tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] No BDM found with device name sdb, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 11:47:27 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-31167253-0f40-4f0f-b064-b3f378d48b68 tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] No BDM found with device name sdc, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 11:47:27 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-31167253-0f40-4f0f-b064-b3f378d48b68 tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] No VIF found with MAC fa:16:3e:e3:a9:e0, not building metadata {{(pid=73449) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 11:47:27 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance e8e7d9aa-150f-424a-b3af-be149ee421c3 could not be found.
Aug 17 11:47:27 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] calling os-brick to detach iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 11:47:27 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, {'target_iqns': ['iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XGrhlpAM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 11:47:27 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 17 11:47:27 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:47:27 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:47:27 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed', 0)] {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 11:47:27 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:47:27 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:47:27 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b9c35e5-5fa5-4648-ae7a-1ba8354e9c3b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a802ac33-831b-4da8-b9b9-a08ce8014504\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:47:27 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:47:27 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:47:27 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[082fa97d-0c38-4fa8-9537-2f3ee16aaba0]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a802ac33-831b-4da8-b9b9-a08ce8014504 (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:47:27 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466 (non-flash)
Aug 17 11:47:27 user nova-compute[73449]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611 (non-flash)
Aug 17 11:47:27 user nova-compute[73449]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c (non-flash)
Aug 17 11:47:27 user nova-compute[73449]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a802ac33-831b-4da8-b9b9-a08ce8014504 (non-flash)
Aug 17 11:47:27 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:47:27 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466 (non-flash)
Aug 17 11:47:27 user nova-compute[73449]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611 (non-flash)
Aug 17 11:47:27 user nova-compute[73449]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c (non-flash)
Aug 17 11:47:27 user nova-compute[73449]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a802ac33-831b-4da8-b9b9-a08ce8014504 (non-flash)
Aug 17 11:47:27 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:47:27 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe75817e9e0>, {}) {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 11:47:27 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Disconnecting from: [] {{(pid=73449) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 11:47:27 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.060s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:47:27 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] <== disconnect_volume: return (61ms) None {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 11:47:27 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] Disconnected iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 11:47:27 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-31167253-0f40-4f0f-b064-b3f378d48b68 tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] Lock "c69e7643-8c60-4982-986b-484e8cfc3fa9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.090s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:47:27 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-51849c9e-271f-49d3-9fbe-1aa91bc62f08 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 11:47:27 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-51849c9e-271f-49d3-9fbe-1aa91bc62f08 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 11:47:27 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-51849c9e-271f-49d3-9fbe-1aa91bc62f08 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.470s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:47:27 user nova-compute[73449]: INFO nova.scheduler.client.report [None req-51849c9e-271f-49d3-9fbe-1aa91bc62f08 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Deleted allocations for instance a3523d22-7165-46ad-be10-5e6ae374f91d
Aug 17 11:47:27 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:47:28 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-51849c9e-271f-49d3-9fbe-1aa91bc62f08 tempest-ServerStableDeviceRescueTest-2093936836 tempest-ServerStableDeviceRescueTest-2093936836-project-member] Lock "a3523d22-7165-46ad-be10-5e6ae374f91d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.931s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:47:28 user nova-compute[73449]: DEBUG nova.compute.manager [req-297378a9-4eb9-4de7-bed6-1967df4679b1 req-f166d36f-5a33-4474-b526-2e530e6949ab service nova] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] Received event network-vif-plugged-460de6e4-4651-4b83-93bd-fbb5db34bcfa {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:47:28 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-297378a9-4eb9-4de7-bed6-1967df4679b1 req-f166d36f-5a33-4474-b526-2e530e6949ab service nova] Acquiring lock "e8e7d9aa-150f-424a-b3af-be149ee421c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:47:28 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-297378a9-4eb9-4de7-bed6-1967df4679b1 req-f166d36f-5a33-4474-b526-2e530e6949ab service nova] Lock "e8e7d9aa-150f-424a-b3af-be149ee421c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:47:28 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-297378a9-4eb9-4de7-bed6-1967df4679b1 req-f166d36f-5a33-4474-b526-2e530e6949ab service nova] Lock "e8e7d9aa-150f-424a-b3af-be149ee421c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:47:28 user nova-compute[73449]: DEBUG nova.compute.manager [req-297378a9-4eb9-4de7-bed6-1967df4679b1 req-f166d36f-5a33-4474-b526-2e530e6949ab service nova] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] No waiting events found dispatching network-vif-plugged-460de6e4-4651-4b83-93bd-fbb5db34bcfa {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:47:28 user nova-compute[73449]: WARNING nova.compute.manager [req-297378a9-4eb9-4de7-bed6-1967df4679b1 req-f166d36f-5a33-4474-b526-2e530e6949ab service nova] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] Received unexpected event network-vif-plugged-460de6e4-4651-4b83-93bd-fbb5db34bcfa for instance with vm_state active and task_state rebuilding.
Aug 17 11:47:28 user nova-compute[73449]: DEBUG nova.compute.manager [req-297378a9-4eb9-4de7-bed6-1967df4679b1 req-f166d36f-5a33-4474-b526-2e530e6949ab service nova] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Received event network-vif-deleted-2a0eb61f-9398-4db6-9ae0-f142ad2e60c4 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:47:28 user nova-compute[73449]: DEBUG nova.compute.manager [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] Preparing to wait for external event volume-reimaged-71f6919a-6a55-4d8f-ae84-7bb40d59f4ed {{(pid=73449) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Aug 17 11:47:28 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Acquiring lock "e8e7d9aa-150f-424a-b3af-be149ee421c3-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:47:28 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Lock "e8e7d9aa-150f-424a-b3af-be149ee421c3-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:47:28 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Lock "e8e7d9aa-150f-424a-b3af-be149ee421c3-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:47:29 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a56b347f-c43e-4ee7-aaba-764a240fa28b tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] Acquiring lock "c69e7643-8c60-4982-986b-484e8cfc3fa9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:47:29 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a56b347f-c43e-4ee7-aaba-764a240fa28b tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] Lock "c69e7643-8c60-4982-986b-484e8cfc3fa9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:47:29 user nova-compute[73449]: INFO nova.compute.manager [None req-a56b347f-c43e-4ee7-aaba-764a240fa28b tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] [instance: c69e7643-8c60-4982-986b-484e8cfc3fa9] Detaching volume a802ac33-831b-4da8-b9b9-a08ce8014504
Aug 17 11:47:29 user nova-compute[73449]: INFO nova.virt.block_device [None req-a56b347f-c43e-4ee7-aaba-764a240fa28b tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] [instance: c69e7643-8c60-4982-986b-484e8cfc3fa9] Attempting to driver detach volume a802ac33-831b-4da8-b9b9-a08ce8014504 from mountpoint /dev/sdc
Aug 17 11:47:29 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-a56b347f-c43e-4ee7-aaba-764a240fa28b tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] Attempting to detach device sdc from instance c69e7643-8c60-4982-986b-484e8cfc3fa9 from the persistent domain config. {{(pid=73449) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 11:47:29 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-a56b347f-c43e-4ee7-aaba-764a240fa28b tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 11:47:29 user nova-compute[73449]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 11:47:29 user nova-compute[73449]:   <source dev="/dev/sdf"/>
Aug 17 11:47:29 user nova-compute[73449]:   <target dev="sdc" bus="scsi"/>
Aug 17 11:47:29 user nova-compute[73449]:   <serial>a802ac33-831b-4da8-b9b9-a08ce8014504</serial>
Aug 17 11:47:29 user nova-compute[73449]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 17 11:47:29 user nova-compute[73449]: </disk>
Aug 17 11:47:29 user nova-compute[73449]:  {{(pid=73449) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 11:47:29 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-a56b347f-c43e-4ee7-aaba-764a240fa28b tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] Successfully detached device sdc from instance c69e7643-8c60-4982-986b-484e8cfc3fa9 from the persistent domain config.
Aug 17 11:47:29 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-a56b347f-c43e-4ee7-aaba-764a240fa28b tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance c69e7643-8c60-4982-986b-484e8cfc3fa9 from the live domain config. {{(pid=73449) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 11:47:29 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-a56b347f-c43e-4ee7-aaba-764a240fa28b tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 11:47:29 user nova-compute[73449]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 11:47:29 user nova-compute[73449]:   <source dev="/dev/sdf"/>
Aug 17 11:47:29 user nova-compute[73449]:   <target dev="sdc" bus="scsi"/>
Aug 17 11:47:29 user nova-compute[73449]:   <serial>a802ac33-831b-4da8-b9b9-a08ce8014504</serial>
Aug 17 11:47:29 user nova-compute[73449]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 17 11:47:29 user nova-compute[73449]: </disk>
Aug 17 11:47:29 user nova-compute[73449]:  {{(pid=73449) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 11:47:29 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Received event <DeviceRemovedEvent: 1692272849.9017928, c69e7643-8c60-4982-986b-484e8cfc3fa9 => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73449) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 11:47:29 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-a56b347f-c43e-4ee7-aaba-764a240fa28b tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance c69e7643-8c60-4982-986b-484e8cfc3fa9 {{(pid=73449) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 11:47:29 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-a56b347f-c43e-4ee7-aaba-764a240fa28b tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] Successfully detached device sdc from instance c69e7643-8c60-4982-986b-484e8cfc3fa9 from the live domain config.
Aug 17 11:47:29 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a56b347f-c43e-4ee7-aaba-764a240fa28b tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] [instance: c69e7643-8c60-4982-986b-484e8cfc3fa9] calling os-brick to detach iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 11:47:29 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-a56b347f-c43e-4ee7-aaba-764a240fa28b tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, {'target_iqns': ['iqn.2010-10.org.openstack:a802ac33-831b-4da8-b9b9-a08ce8014504'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WqBJeswn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 11:47:29 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-a56b347f-c43e-4ee7-aaba-764a240fa28b tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 11:47:29 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-a56b347f-c43e-4ee7-aaba-764a240fa28b tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:47:29 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-a56b347f-c43e-4ee7-aaba-764a240fa28b tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:47:29 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-a56b347f-c43e-4ee7-aaba-764a240fa28b tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a802ac33-831b-4da8-b9b9-a08ce8014504', 0)] {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 11:47:29 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:47:29 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:47:29 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[4af5eb4c-6465-4ebd-bc68-a418c05f46d9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a802ac33-831b-4da8-b9b9-a08ce8014504\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:47:29 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:47:29 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:47:29 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[c303d6f6-154c-471a-9ec6-f2dc6aaed297]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a802ac33-831b-4da8-b9b9-a08ce8014504 (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:47:29 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-a56b347f-c43e-4ee7-aaba-764a240fa28b tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466 (non-flash)
Aug 17 11:47:29 user nova-compute[73449]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611 (non-flash)
Aug 17 11:47:29 user nova-compute[73449]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c (non-flash)
Aug 17 11:47:29 user nova-compute[73449]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a802ac33-831b-4da8-b9b9-a08ce8014504 (non-flash)
Aug 17 11:47:29 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:47:29 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-a56b347f-c43e-4ee7-aaba-764a240fa28b tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466 (non-flash)
Aug 17 11:47:29 user nova-compute[73449]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611 (non-flash)
Aug 17 11:47:29 user nova-compute[73449]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c (non-flash)
Aug 17 11:47:29 user nova-compute[73449]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a802ac33-831b-4da8-b9b9-a08ce8014504 (non-flash)
Aug 17 11:47:29 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:47:29 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-a56b347f-c43e-4ee7-aaba-764a240fa28b tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe7582ba4d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a802ac33-831b-4da8-b9b9-a08ce8014504'): ({'sdf'}, set())}) {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 11:47:29 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-a56b347f-c43e-4ee7-aaba-764a240fa28b tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] Removing single pathed devices sdf {{(pid=73449) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 11:47:29 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:47:29 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:47:29 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[143b3796-893c-47c2-b818-1d7e99b8cb90]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:47:29 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:47:30 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.024s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:47:30 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb4a0969-2acb-430b-bacd-9d6d87c10ea7]: (4, ('ok\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:47:30 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-a56b347f-c43e-4ee7-aaba-764a240fa28b tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] Flushing IO for device /dev/sdf {{(pid=73449) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 11:47:30 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:47:30 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:47:30 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[148422f7-1a71-4645-8fff-c227d1c0b137]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:47:30 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-a56b347f-c43e-4ee7-aaba-764a240fa28b tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73449) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 11:47:30 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:47:30 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.045s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:47:30 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[78fe5a47-7c45-4a90-8bb2-1c8c42b71869]: (4, ('1', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:47:30 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-a56b347f-c43e-4ee7-aaba-764a240fa28b tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73449) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 11:47:30 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-a56b347f-c43e-4ee7-aaba-764a240fa28b tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] SCSI volumes sdf have been removed. {{(pid=73449) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 11:47:30 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-a56b347f-c43e-4ee7-aaba-764a240fa28b tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a802ac33-831b-4da8-b9b9-a08ce8014504')] {{(pid=73449) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 11:47:30 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a802ac33-831b-4da8-b9b9-a08ce8014504 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:47:30 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a802ac33-831b-4da8-b9b9-a08ce8014504 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:47:30 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[2629d858-6823-451a-9607-5df003a893ae]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:47:30 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-a56b347f-c43e-4ee7-aaba-764a240fa28b tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:47:30 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a802ac33-831b-4da8-b9b9-a08ce8014504 -p 172.16.0.220:3260 --logout {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:47:30 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a802ac33-831b-4da8-b9b9-a08ce8014504 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:47:30 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a5c35f6-2ac7-4b16-8325-d6ce60cc1320]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:a802ac33-831b-4da8-b9b9-a08ce8014504, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:a802ac33-831b-4da8-b9b9-a08ce8014504, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:47:30 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-a56b347f-c43e-4ee7-aaba-764a240fa28b tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:a802ac33-831b-4da8-b9b9-a08ce8014504, portal: 172.16.0.220,3260]
Aug 17 11:47:30 user nova-compute[73449]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:a802ac33-831b-4da8-b9b9-a08ce8014504, portal: 172.16.0.220,3260] successful.
Aug 17 11:47:30 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:47:30 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a802ac33-831b-4da8-b9b9-a08ce8014504 -p 172.16.0.220:3260 --op delete {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:47:30 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a802ac33-831b-4da8-b9b9-a08ce8014504 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:47:30 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe163db7-6485-4231-835d-10e9383231ae]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:47:30 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-a56b347f-c43e-4ee7-aaba-764a240fa28b tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:47:30 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-a56b347f-c43e-4ee7-aaba-764a240fa28b tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:47:30 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-a56b347f-c43e-4ee7-aaba-764a240fa28b tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] <== disconnect_volume: return (302ms) None {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 11:47:30 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a56b347f-c43e-4ee7-aaba-764a240fa28b tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] [instance: c69e7643-8c60-4982-986b-484e8cfc3fa9] Disconnected iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 11:47:31 user nova-compute[73449]: DEBUG nova.objects.instance [None req-a56b347f-c43e-4ee7-aaba-764a240fa28b tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] Lazy-loading 'flavor' on Instance uuid c69e7643-8c60-4982-986b-484e8cfc3fa9 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:47:31 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a56b347f-c43e-4ee7-aaba-764a240fa28b tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] Lock "c69e7643-8c60-4982-986b-484e8cfc3fa9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.069s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:47:31 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:47:32 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-4a27c85f-b255-4977-aa60-fa90a6d19516 tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] Acquiring lock "c69e7643-8c60-4982-986b-484e8cfc3fa9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:47:32 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-4a27c85f-b255-4977-aa60-fa90a6d19516 tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] Lock "c69e7643-8c60-4982-986b-484e8cfc3fa9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:47:32 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-4a27c85f-b255-4977-aa60-fa90a6d19516 tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] Acquiring lock "c69e7643-8c60-4982-986b-484e8cfc3fa9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:47:32 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-4a27c85f-b255-4977-aa60-fa90a6d19516 tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] Lock "c69e7643-8c60-4982-986b-484e8cfc3fa9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:47:32 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-4a27c85f-b255-4977-aa60-fa90a6d19516 tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] Lock "c69e7643-8c60-4982-986b-484e8cfc3fa9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:47:32 user nova-compute[73449]: INFO nova.compute.manager [None req-4a27c85f-b255-4977-aa60-fa90a6d19516 tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] [instance: c69e7643-8c60-4982-986b-484e8cfc3fa9] Terminating instance
Aug 17 11:47:32 user nova-compute[73449]: DEBUG nova.compute.manager [None req-4a27c85f-b255-4977-aa60-fa90a6d19516 tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] [instance: c69e7643-8c60-4982-986b-484e8cfc3fa9] Start destroying the instance on the hypervisor. {{(pid=73449) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 11:47:32 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:47:32 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:47:32 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:47:32 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:47:32 user nova-compute[73449]: DEBUG nova.compute.manager [req-6ac14db5-4173-47a3-9c24-077fb51b14cf req-eeacd8dd-e9c7-4062-979a-7b7c196fa7a9 service nova] [instance: c69e7643-8c60-4982-986b-484e8cfc3fa9] Received event network-vif-unplugged-8fd82fbd-985b-4260-a066-3bda2e4c1f1c {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:47:32 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-6ac14db5-4173-47a3-9c24-077fb51b14cf req-eeacd8dd-e9c7-4062-979a-7b7c196fa7a9 service nova] Acquiring lock "c69e7643-8c60-4982-986b-484e8cfc3fa9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:47:32 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-6ac14db5-4173-47a3-9c24-077fb51b14cf req-eeacd8dd-e9c7-4062-979a-7b7c196fa7a9 service nova] Lock "c69e7643-8c60-4982-986b-484e8cfc3fa9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:47:32 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-6ac14db5-4173-47a3-9c24-077fb51b14cf req-eeacd8dd-e9c7-4062-979a-7b7c196fa7a9 service nova] Lock "c69e7643-8c60-4982-986b-484e8cfc3fa9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:47:32 user nova-compute[73449]: DEBUG nova.compute.manager [req-6ac14db5-4173-47a3-9c24-077fb51b14cf req-eeacd8dd-e9c7-4062-979a-7b7c196fa7a9 service nova] [instance: c69e7643-8c60-4982-986b-484e8cfc3fa9] No waiting events found dispatching network-vif-unplugged-8fd82fbd-985b-4260-a066-3bda2e4c1f1c {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:47:32 user nova-compute[73449]: DEBUG nova.compute.manager [req-6ac14db5-4173-47a3-9c24-077fb51b14cf req-eeacd8dd-e9c7-4062-979a-7b7c196fa7a9 service nova] [instance: c69e7643-8c60-4982-986b-484e8cfc3fa9] Received event network-vif-unplugged-8fd82fbd-985b-4260-a066-3bda2e4c1f1c for instance with task_state deleting. {{(pid=73449) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 11:47:32 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: c69e7643-8c60-4982-986b-484e8cfc3fa9] Instance destroyed successfully.
Aug 17 11:47:32 user nova-compute[73449]: DEBUG nova.objects.instance [None req-4a27c85f-b255-4977-aa60-fa90a6d19516 tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] Lazy-loading 'resources' on Instance uuid c69e7643-8c60-4982-986b-484e8cfc3fa9 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:47:32 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-4a27c85f-b255-4977-aa60-fa90a6d19516 tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T11:45:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-833970667',display_name='tempest-AttachSCSIVolumeTestJSON-server-833970667',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-833970667',id=16,image_ref='4dee885a-2bb4-4463-b90b-833cafa0b7e2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFwWs8cCKEZb5agnvncFaZSWCrGZ6sbqIA5yyGzM9tPWYYsByZ+TqHuao8ZU/3DhnBBHaoc37vD2IMX+z3VCzlVX1tciX1nrsMs1Kw0uYAzWyps7sc78BJxmV/xKUlD1GA==',key_name='tempest-keypair-179167240',keypairs=<?>,launch_index=0,launched_at=2023-08-17T11:45:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7f0abc92468b407f992a1c233e53ff48',ramdisk_id='',reservation_id='r-hyvw950d',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4dee885a-2bb4-4463-b90b-833cafa0b7e2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1145020015',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1145020015-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T11:45:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eecfcdb00dee44fab4245d9af952d1dd',uuid=c69e7643-8c60-4982-986b-484e8cfc3fa9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8fd82fbd-985b-4260-a066-3bda2e4c1f1c", "address": "fa:16:3e:e3:a9:e0", "network": {"id": "56945a89-4894-401c-a1bd-dba725ffbcca", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-590943835-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f0abc92468b407f992a1c233e53ff48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fd82fbd-98", "ovs_interfaceid": "8fd82fbd-985b-4260-a066-3bda2e4c1f1c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 11:47:32 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-4a27c85f-b255-4977-aa60-fa90a6d19516 tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] Converting VIF {"id": "8fd82fbd-985b-4260-a066-3bda2e4c1f1c", "address": "fa:16:3e:e3:a9:e0", "network": {"id": "56945a89-4894-401c-a1bd-dba725ffbcca", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-590943835-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f0abc92468b407f992a1c233e53ff48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fd82fbd-98", "ovs_interfaceid": "8fd82fbd-985b-4260-a066-3bda2e4c1f1c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:47:32 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-4a27c85f-b255-4977-aa60-fa90a6d19516 tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e3:a9:e0,bridge_name='br-int',has_traffic_filtering=True,id=8fd82fbd-985b-4260-a066-3bda2e4c1f1c,network=Network(56945a89-4894-401c-a1bd-dba725ffbcca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fd82fbd-98') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:47:32 user nova-compute[73449]: DEBUG os_vif [None req-4a27c85f-b255-4977-aa60-fa90a6d19516 tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:a9:e0,bridge_name='br-int',has_traffic_filtering=True,id=8fd82fbd-985b-4260-a066-3bda2e4c1f1c,network=Network(56945a89-4894-401c-a1bd-dba725ffbcca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fd82fbd-98') {{(pid=73449) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 11:47:32 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:47:32 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8fd82fbd-98, bridge=br-int, if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:47:32 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:47:32 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:47:32 user nova-compute[73449]: INFO os_vif [None req-4a27c85f-b255-4977-aa60-fa90a6d19516 tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:a9:e0,bridge_name='br-int',has_traffic_filtering=True,id=8fd82fbd-985b-4260-a066-3bda2e4c1f1c,network=Network(56945a89-4894-401c-a1bd-dba725ffbcca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fd82fbd-98')
Aug 17 11:47:32 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-4a27c85f-b255-4977-aa60-fa90a6d19516 tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] [instance: c69e7643-8c60-4982-986b-484e8cfc3fa9] Deleting instance files /opt/stack/data/nova/instances/c69e7643-8c60-4982-986b-484e8cfc3fa9_del
Aug 17 11:47:32 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-4a27c85f-b255-4977-aa60-fa90a6d19516 tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] [instance: c69e7643-8c60-4982-986b-484e8cfc3fa9] Deletion of /opt/stack/data/nova/instances/c69e7643-8c60-4982-986b-484e8cfc3fa9_del complete
Aug 17 11:47:32 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:47:33 user nova-compute[73449]: INFO nova.compute.manager [None req-4a27c85f-b255-4977-aa60-fa90a6d19516 tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] [instance: c69e7643-8c60-4982-986b-484e8cfc3fa9] Took 0.95 seconds to destroy the instance on the hypervisor.
Aug 17 11:47:33 user nova-compute[73449]: DEBUG oslo.service.loopingcall [None req-4a27c85f-b255-4977-aa60-fa90a6d19516 tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73449) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 11:47:33 user nova-compute[73449]: DEBUG nova.compute.manager [-] [instance: c69e7643-8c60-4982-986b-484e8cfc3fa9] Deallocating network for instance {{(pid=73449) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 11:47:33 user nova-compute[73449]: DEBUG nova.network.neutron [-] [instance: c69e7643-8c60-4982-986b-484e8cfc3fa9] deallocate_for_instance() {{(pid=73449) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 11:47:34 user nova-compute[73449]: DEBUG nova.network.neutron [-] [instance: c69e7643-8c60-4982-986b-484e8cfc3fa9] Updating instance_info_cache with network_info: [] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:47:34 user nova-compute[73449]: INFO nova.compute.manager [-] [instance: c69e7643-8c60-4982-986b-484e8cfc3fa9] Took 1.26 seconds to deallocate network for instance.
Aug 17 11:47:34 user nova-compute[73449]: DEBUG nova.compute.manager [req-5a0f3a00-104d-4f5f-a7c2-092031338464 req-4e64040a-4167-4714-99c5-038a8c0de3c2 service nova] [instance: c69e7643-8c60-4982-986b-484e8cfc3fa9] Received event network-vif-deleted-8fd82fbd-985b-4260-a066-3bda2e4c1f1c {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:47:34 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-4a27c85f-b255-4977-aa60-fa90a6d19516 tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:47:34 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-4a27c85f-b255-4977-aa60-fa90a6d19516 tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:47:34 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-4a27c85f-b255-4977-aa60-fa90a6d19516 tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 11:47:34 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-4a27c85f-b255-4977-aa60-fa90a6d19516 tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 11:47:34 user nova-compute[73449]: DEBUG nova.compute.manager [req-4c536ff6-4b87-42c3-bdc3-490a479cb422 req-af18a7e5-f74e-4c39-b3c9-fa52cfb8e419 service nova] [instance: c69e7643-8c60-4982-986b-484e8cfc3fa9] Received event network-vif-plugged-8fd82fbd-985b-4260-a066-3bda2e4c1f1c {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:47:34 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-4c536ff6-4b87-42c3-bdc3-490a479cb422 req-af18a7e5-f74e-4c39-b3c9-fa52cfb8e419 service nova] Acquiring lock "c69e7643-8c60-4982-986b-484e8cfc3fa9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:47:34 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-4c536ff6-4b87-42c3-bdc3-490a479cb422 req-af18a7e5-f74e-4c39-b3c9-fa52cfb8e419 service nova] Lock "c69e7643-8c60-4982-986b-484e8cfc3fa9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:47:34 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-4c536ff6-4b87-42c3-bdc3-490a479cb422 req-af18a7e5-f74e-4c39-b3c9-fa52cfb8e419 service nova] Lock "c69e7643-8c60-4982-986b-484e8cfc3fa9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:47:34 user nova-compute[73449]: DEBUG nova.compute.manager [req-4c536ff6-4b87-42c3-bdc3-490a479cb422 req-af18a7e5-f74e-4c39-b3c9-fa52cfb8e419 service nova] [instance: c69e7643-8c60-4982-986b-484e8cfc3fa9] No waiting events found dispatching network-vif-plugged-8fd82fbd-985b-4260-a066-3bda2e4c1f1c {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:47:34 user nova-compute[73449]: WARNING nova.compute.manager [req-4c536ff6-4b87-42c3-bdc3-490a479cb422 req-af18a7e5-f74e-4c39-b3c9-fa52cfb8e419 service nova] [instance: c69e7643-8c60-4982-986b-484e8cfc3fa9] Received unexpected event network-vif-plugged-8fd82fbd-985b-4260-a066-3bda2e4c1f1c for instance with vm_state deleted and task_state None.
Aug 17 11:47:34 user nova-compute[73449]: DEBUG nova.compute.manager [req-4c536ff6-4b87-42c3-bdc3-490a479cb422 req-af18a7e5-f74e-4c39-b3c9-fa52cfb8e419 service nova] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] Received event network-changed-e2af7fce-7442-48b4-8611-da3171b0672b {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:47:34 user nova-compute[73449]: DEBUG nova.compute.manager [req-4c536ff6-4b87-42c3-bdc3-490a479cb422 req-af18a7e5-f74e-4c39-b3c9-fa52cfb8e419 service nova] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] Refreshing instance network info cache due to event network-changed-e2af7fce-7442-48b4-8611-da3171b0672b. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 11:47:34 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-4c536ff6-4b87-42c3-bdc3-490a479cb422 req-af18a7e5-f74e-4c39-b3c9-fa52cfb8e419 service nova] Acquiring lock "refresh_cache-de5084e1-5a5e-48d2-a3ef-7f29898d1d2d" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:47:34 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-4c536ff6-4b87-42c3-bdc3-490a479cb422 req-af18a7e5-f74e-4c39-b3c9-fa52cfb8e419 service nova] Acquired lock "refresh_cache-de5084e1-5a5e-48d2-a3ef-7f29898d1d2d" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:47:34 user nova-compute[73449]: DEBUG nova.network.neutron [req-4c536ff6-4b87-42c3-bdc3-490a479cb422 req-af18a7e5-f74e-4c39-b3c9-fa52cfb8e419 service nova] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] Refreshing network info cache for port e2af7fce-7442-48b4-8611-da3171b0672b {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 11:47:34 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-4a27c85f-b255-4977-aa60-fa90a6d19516 tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.337s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:47:34 user nova-compute[73449]: INFO nova.scheduler.client.report [None req-4a27c85f-b255-4977-aa60-fa90a6d19516 tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] Deleted allocations for instance c69e7643-8c60-4982-986b-484e8cfc3fa9
Aug 17 11:47:34 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-4a27c85f-b255-4977-aa60-fa90a6d19516 tempest-AttachSCSIVolumeTestJSON-1145020015 tempest-AttachSCSIVolumeTestJSON-1145020015-project-member] Lock "c69e7643-8c60-4982-986b-484e8cfc3fa9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.730s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:47:35 user nova-compute[73449]: DEBUG nova.network.neutron [req-4c536ff6-4b87-42c3-bdc3-490a479cb422 req-af18a7e5-f74e-4c39-b3c9-fa52cfb8e419 service nova] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] Updated VIF entry in instance network info cache for port e2af7fce-7442-48b4-8611-da3171b0672b. {{(pid=73449) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 11:47:35 user nova-compute[73449]: DEBUG nova.network.neutron [req-4c536ff6-4b87-42c3-bdc3-490a479cb422 req-af18a7e5-f74e-4c39-b3c9-fa52cfb8e419 service nova] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] Updating instance_info_cache with network_info: [{"id": "e2af7fce-7442-48b4-8611-da3171b0672b", "address": "fa:16:3e:c0:c8:a6", "network": {"id": "ff73f5c3-bae6-46cc-bcb8-bbd5be1b478d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1229197917-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5ba3ebf47bd4b999e68c74a5c0ab060", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2af7fce-74", "ovs_interfaceid": "e2af7fce-7442-48b4-8611-da3171b0672b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:47:35 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-4c536ff6-4b87-42c3-bdc3-490a479cb422 req-af18a7e5-f74e-4c39-b3c9-fa52cfb8e419 service nova] Releasing lock "refresh_cache-de5084e1-5a5e-48d2-a3ef-7f29898d1d2d" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:47:35 user nova-compute[73449]: DEBUG nova.compute.manager [req-d0d54d33-cabc-4430-930b-afac9f30e688 req-552ca35f-f89c-4f6d-8d77-83318c3b135f service nova] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] Received event network-changed-e2af7fce-7442-48b4-8611-da3171b0672b {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:47:35 user nova-compute[73449]: DEBUG nova.compute.manager [req-d0d54d33-cabc-4430-930b-afac9f30e688 req-552ca35f-f89c-4f6d-8d77-83318c3b135f service nova] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] Refreshing instance network info cache due to event network-changed-e2af7fce-7442-48b4-8611-da3171b0672b. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 11:47:35 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-d0d54d33-cabc-4430-930b-afac9f30e688 req-552ca35f-f89c-4f6d-8d77-83318c3b135f service nova] Acquiring lock "refresh_cache-de5084e1-5a5e-48d2-a3ef-7f29898d1d2d" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:47:35 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-d0d54d33-cabc-4430-930b-afac9f30e688 req-552ca35f-f89c-4f6d-8d77-83318c3b135f service nova] Acquired lock "refresh_cache-de5084e1-5a5e-48d2-a3ef-7f29898d1d2d" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:47:35 user nova-compute[73449]: DEBUG nova.network.neutron [req-d0d54d33-cabc-4430-930b-afac9f30e688 req-552ca35f-f89c-4f6d-8d77-83318c3b135f service nova] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] Refreshing network info cache for port e2af7fce-7442-48b4-8611-da3171b0672b {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 11:47:36 user nova-compute[73449]: DEBUG nova.network.neutron [req-d0d54d33-cabc-4430-930b-afac9f30e688 req-552ca35f-f89c-4f6d-8d77-83318c3b135f service nova] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] Updated VIF entry in instance network info cache for port e2af7fce-7442-48b4-8611-da3171b0672b. {{(pid=73449) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 11:47:36 user nova-compute[73449]: DEBUG nova.network.neutron [req-d0d54d33-cabc-4430-930b-afac9f30e688 req-552ca35f-f89c-4f6d-8d77-83318c3b135f service nova] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] Updating instance_info_cache with network_info: [{"id": "e2af7fce-7442-48b4-8611-da3171b0672b", "address": "fa:16:3e:c0:c8:a6", "network": {"id": "ff73f5c3-bae6-46cc-bcb8-bbd5be1b478d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1229197917-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5ba3ebf47bd4b999e68c74a5c0ab060", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2af7fce-74", "ovs_interfaceid": "e2af7fce-7442-48b4-8611-da3171b0672b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:47:36 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-d0d54d33-cabc-4430-930b-afac9f30e688 req-552ca35f-f89c-4f6d-8d77-83318c3b135f service nova] Releasing lock "refresh_cache-de5084e1-5a5e-48d2-a3ef-7f29898d1d2d" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:47:37 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:47:37 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:47:38 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:47:40 user nova-compute[73449]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692272845.886854, a3523d22-7165-46ad-be10-5e6ae374f91d => Stopped> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:47:40 user nova-compute[73449]: INFO nova.compute.manager [-] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] VM Stopped (Lifecycle Event)
Aug 17 11:47:40 user nova-compute[73449]: DEBUG nova.compute.manager [None req-090c0da0-5079-46a4-8c6f-2d1d6ede392f None None] [instance: a3523d22-7165-46ad-be10-5e6ae374f91d] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:47:41 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:47:41 user nova-compute[73449]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692272846.6134162, e8e7d9aa-150f-424a-b3af-be149ee421c3 => Stopped> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:47:41 user nova-compute[73449]: INFO nova.compute.manager [-] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] VM Stopped (Lifecycle Event)
Aug 17 11:47:41 user nova-compute[73449]: DEBUG nova.compute.manager [None req-72413ed0-c88e-4afb-8e3c-72d1fcacccb7 None None] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:47:42 user nova-compute[73449]: INFO nova.compute.manager [None req-57884099-5454-411a-a430-232370889293 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: ae75d334-431a-4008-8b3d-f2a727d92417] Rescuing
Aug 17 11:47:42 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-57884099-5454-411a-a430-232370889293 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Acquiring lock "refresh_cache-ae75d334-431a-4008-8b3d-f2a727d92417" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:47:42 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-57884099-5454-411a-a430-232370889293 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Acquired lock "refresh_cache-ae75d334-431a-4008-8b3d-f2a727d92417" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:47:42 user nova-compute[73449]: DEBUG nova.network.neutron [None req-57884099-5454-411a-a430-232370889293 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: ae75d334-431a-4008-8b3d-f2a727d92417] Building network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 11:47:42 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:47:42 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:47:43 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-1b55e45b-77b5-4f89-bd0c-1730703bfb63 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Acquiring lock "de5084e1-5a5e-48d2-a3ef-7f29898d1d2d" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:47:43 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-1b55e45b-77b5-4f89-bd0c-1730703bfb63 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Lock "de5084e1-5a5e-48d2-a3ef-7f29898d1d2d" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:47:43 user nova-compute[73449]: INFO nova.compute.manager [None req-1b55e45b-77b5-4f89-bd0c-1730703bfb63 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] Rebooting instance
Aug 17 11:47:43 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-1b55e45b-77b5-4f89-bd0c-1730703bfb63 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Acquiring lock "refresh_cache-de5084e1-5a5e-48d2-a3ef-7f29898d1d2d" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:47:43 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-1b55e45b-77b5-4f89-bd0c-1730703bfb63 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Acquired lock "refresh_cache-de5084e1-5a5e-48d2-a3ef-7f29898d1d2d" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:47:43 user nova-compute[73449]: DEBUG nova.network.neutron [None req-1b55e45b-77b5-4f89-bd0c-1730703bfb63 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] Building network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 11:47:43 user nova-compute[73449]: DEBUG nova.network.neutron [None req-57884099-5454-411a-a430-232370889293 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: ae75d334-431a-4008-8b3d-f2a727d92417] Updating instance_info_cache with network_info: [{"id": "0cd51063-e3d9-44a8-a1cd-b89bb41a4438", "address": "fa:16:3e:54:1f:e7", "network": {"id": "f7298070-baaa-4842-b3b2-d9fe1058d3b6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1715911399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8722edee53ed4a9188366c38f3b8b52f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cd51063-e3", "ovs_interfaceid": "0cd51063-e3d9-44a8-a1cd-b89bb41a4438", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:47:43 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-57884099-5454-411a-a430-232370889293 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Releasing lock "refresh_cache-ae75d334-431a-4008-8b3d-f2a727d92417" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:47:43 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:47:43 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:47:43 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:47:43 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:47:43 user nova-compute[73449]: DEBUG nova.compute.manager [req-5922e0df-0127-4d85-8428-c7fbd824265f req-caf542a8-11d5-4d9b-ac38-4cd937b8c86e service nova] [instance: ae75d334-431a-4008-8b3d-f2a727d92417] Received event network-vif-unplugged-0cd51063-e3d9-44a8-a1cd-b89bb41a4438 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:47:43 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-5922e0df-0127-4d85-8428-c7fbd824265f req-caf542a8-11d5-4d9b-ac38-4cd937b8c86e service nova] Acquiring lock "ae75d334-431a-4008-8b3d-f2a727d92417-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:47:43 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-5922e0df-0127-4d85-8428-c7fbd824265f req-caf542a8-11d5-4d9b-ac38-4cd937b8c86e service nova] Lock "ae75d334-431a-4008-8b3d-f2a727d92417-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:47:43 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-5922e0df-0127-4d85-8428-c7fbd824265f req-caf542a8-11d5-4d9b-ac38-4cd937b8c86e service nova] Lock "ae75d334-431a-4008-8b3d-f2a727d92417-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:47:43 user nova-compute[73449]: DEBUG nova.compute.manager [req-5922e0df-0127-4d85-8428-c7fbd824265f req-caf542a8-11d5-4d9b-ac38-4cd937b8c86e service nova] [instance: ae75d334-431a-4008-8b3d-f2a727d92417] No waiting events found dispatching network-vif-unplugged-0cd51063-e3d9-44a8-a1cd-b89bb41a4438 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:47:43 user nova-compute[73449]: WARNING nova.compute.manager [req-5922e0df-0127-4d85-8428-c7fbd824265f req-caf542a8-11d5-4d9b-ac38-4cd937b8c86e service nova] [instance: ae75d334-431a-4008-8b3d-f2a727d92417] Received unexpected event network-vif-unplugged-0cd51063-e3d9-44a8-a1cd-b89bb41a4438 for instance with vm_state active and task_state rescuing.
Aug 17 11:47:43 user nova-compute[73449]: DEBUG nova.network.neutron [None req-1b55e45b-77b5-4f89-bd0c-1730703bfb63 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] Updating instance_info_cache with network_info: [{"id": "e2af7fce-7442-48b4-8611-da3171b0672b", "address": "fa:16:3e:c0:c8:a6", "network": {"id": "ff73f5c3-bae6-46cc-bcb8-bbd5be1b478d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1229197917-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5ba3ebf47bd4b999e68c74a5c0ab060", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2af7fce-74", "ovs_interfaceid": "e2af7fce-7442-48b4-8611-da3171b0672b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:47:43 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-1b55e45b-77b5-4f89-bd0c-1730703bfb63 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Releasing lock "refresh_cache-de5084e1-5a5e-48d2-a3ef-7f29898d1d2d" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:47:43 user nova-compute[73449]: DEBUG nova.compute.manager [None req-1b55e45b-77b5-4f89-bd0c-1730703bfb63 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:47:43 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:47:43 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:47:43 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: ae75d334-431a-4008-8b3d-f2a727d92417] Instance destroyed successfully.
Aug 17 11:47:43 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-57884099-5454-411a-a430-232370889293 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: ae75d334-431a-4008-8b3d-f2a727d92417] Attempting rescue
Aug 17 11:47:43 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-57884099-5454-411a-a430-232370889293 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73449) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 17 11:47:43 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-57884099-5454-411a-a430-232370889293 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: ae75d334-431a-4008-8b3d-f2a727d92417] Instance directory exists: not creating {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 17 11:47:43 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-57884099-5454-411a-a430-232370889293 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: ae75d334-431a-4008-8b3d-f2a727d92417] Creating image(s)
Aug 17 11:47:43 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-57884099-5454-411a-a430-232370889293 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Acquiring lock "/opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:47:43 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-57884099-5454-411a-a430-232370889293 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Lock "/opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:47:43 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-57884099-5454-411a-a430-232370889293 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Lock "/opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:47:43 user nova-compute[73449]: DEBUG nova.objects.instance [None req-57884099-5454-411a-a430-232370889293 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Lazy-loading 'trusted_certs' on Instance uuid ae75d334-431a-4008-8b3d-f2a727d92417 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:47:43 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:47:43 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:47:43 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-57884099-5454-411a-a430-232370889293 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Acquiring lock "7e267a577c062ee862e95ede6b48cfd5632f3ea3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:47:43 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-57884099-5454-411a-a430-232370889293 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Lock "7e267a577c062ee862e95ede6b48cfd5632f3ea3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:47:43 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-57884099-5454-411a-a430-232370889293 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:47:44 user nova-compute[73449]: DEBUG nova.compute.manager [req-d14ae3e9-1702-4517-b0f7-fdf38975d6e7 req-30ea2f26-d6e6-4a5b-8a1a-775927834329 service nova] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] Received event network-vif-unplugged-e2af7fce-7442-48b4-8611-da3171b0672b {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:47:44 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-d14ae3e9-1702-4517-b0f7-fdf38975d6e7 req-30ea2f26-d6e6-4a5b-8a1a-775927834329 service nova] Acquiring lock "de5084e1-5a5e-48d2-a3ef-7f29898d1d2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:47:44 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-d14ae3e9-1702-4517-b0f7-fdf38975d6e7 req-30ea2f26-d6e6-4a5b-8a1a-775927834329 service nova] Lock "de5084e1-5a5e-48d2-a3ef-7f29898d1d2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:47:44 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-d14ae3e9-1702-4517-b0f7-fdf38975d6e7 req-30ea2f26-d6e6-4a5b-8a1a-775927834329 service nova] Lock "de5084e1-5a5e-48d2-a3ef-7f29898d1d2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:47:44 user nova-compute[73449]: DEBUG nova.compute.manager [req-d14ae3e9-1702-4517-b0f7-fdf38975d6e7 req-30ea2f26-d6e6-4a5b-8a1a-775927834329 service nova] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] No waiting events found dispatching network-vif-unplugged-e2af7fce-7442-48b4-8611-da3171b0672b {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:47:44 user nova-compute[73449]: WARNING nova.compute.manager [req-d14ae3e9-1702-4517-b0f7-fdf38975d6e7 req-30ea2f26-d6e6-4a5b-8a1a-775927834329 service nova] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] Received unexpected event network-vif-unplugged-e2af7fce-7442-48b4-8611-da3171b0672b for instance with vm_state active and task_state reboot_started_hard.
Aug 17 11:47:44 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-57884099-5454-411a-a430-232370889293 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json" returned: 0 in 0.206s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:47:44 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-57884099-5454-411a-a430-232370889293 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3,backing_fmt=raw /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk.rescue {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:47:44 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-57884099-5454-411a-a430-232370889293 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3,backing_fmt=raw /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk.rescue" returned: 0 in 0.062s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:47:44 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-57884099-5454-411a-a430-232370889293 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Lock "7e267a577c062ee862e95ede6b48cfd5632f3ea3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.273s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:47:44 user nova-compute[73449]: DEBUG nova.objects.instance [None req-57884099-5454-411a-a430-232370889293 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Lazy-loading 'migration_context' on Instance uuid ae75d334-431a-4008-8b3d-f2a727d92417 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:47:44 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-57884099-5454-411a-a430-232370889293 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: ae75d334-431a-4008-8b3d-f2a727d92417] Created local disks {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 11:47:44 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-57884099-5454-411a-a430-232370889293 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: ae75d334-431a-4008-8b3d-f2a727d92417] Start _get_guest_xml network_info=[{"id": "0cd51063-e3d9-44a8-a1cd-b89bb41a4438", "address": "fa:16:3e:54:1f:e7", "network": {"id": "f7298070-baaa-4842-b3b2-d9fe1058d3b6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1715911399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1715911399-network", "vif_mac": "fa:16:3e:54:1f:e7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8722edee53ed4a9188366c38f3b8b52f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cd51063-e3", "ovs_interfaceid": "0cd51063-e3d9-44a8-a1cd-b89bb41a4438", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T11:36:11Z,direct_url=<?>,disk_format='qcow2',id=0a2904ae-083d-41c8-83db-343132b36148,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7a77880136a54ef195c82e018e1939db',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T11:36:13Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '0a2904ae-083d-41c8-83db-343132b36148', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 11:47:44 user nova-compute[73449]: DEBUG nova.objects.instance [None req-57884099-5454-411a-a430-232370889293 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Lazy-loading 'resources' on Instance uuid ae75d334-431a-4008-8b3d-f2a727d92417 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:47:44 user nova-compute[73449]: DEBUG nova.objects.instance [None req-57884099-5454-411a-a430-232370889293 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Lazy-loading 'numa_topology' on Instance uuid ae75d334-431a-4008-8b3d-f2a727d92417 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:47:44 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-57884099-5454-411a-a430-232370889293 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:47:44 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-57884099-5454-411a-a430-232370889293 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:47:44 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-57884099-5454-411a-a430-232370889293 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 11:47:44 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-57884099-5454-411a-a430-232370889293 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] CPU controller missing on host. {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 11:47:44 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-57884099-5454-411a-a430-232370889293 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 11:47:44 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-57884099-5454-411a-a430-232370889293 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] CPU controller found on host. {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 11:47:44 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-57884099-5454-411a-a430-232370889293 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73449) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 11:47:44 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-57884099-5454-411a-a430-232370889293 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T11:35:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T11:36:11Z,direct_url=<?>,disk_format='qcow2',id=0a2904ae-083d-41c8-83db-343132b36148,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7a77880136a54ef195c82e018e1939db',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T11:36:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 11:47:44 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-57884099-5454-411a-a430-232370889293 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Flavor limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 11:47:44 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-57884099-5454-411a-a430-232370889293 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Image limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 11:47:44 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-57884099-5454-411a-a430-232370889293 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Flavor pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 11:47:44 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-57884099-5454-411a-a430-232370889293 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Image pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 11:47:44 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-57884099-5454-411a-a430-232370889293 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 11:47:44 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-57884099-5454-411a-a430-232370889293 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 11:47:44 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-57884099-5454-411a-a430-232370889293 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 11:47:44 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-57884099-5454-411a-a430-232370889293 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Got 1 possible topologies {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 11:47:44 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-57884099-5454-411a-a430-232370889293 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 11:47:44 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-57884099-5454-411a-a430-232370889293 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 11:47:44 user nova-compute[73449]: DEBUG nova.objects.instance [None req-57884099-5454-411a-a430-232370889293 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Lazy-loading 'vcpu_model' on Instance uuid ae75d334-431a-4008-8b3d-f2a727d92417 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:47:44 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-57884099-5454-411a-a430-232370889293 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:45:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2048350466',display_name='tempest-ServerRescueNegativeTestJSON-server-2048350466',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2048350466',id=19,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T11:46:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8722edee53ed4a9188366c38f3b8b52f',ramdisk_id='',reservation_id='r-9gepo79y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1458167730',owner_user_name='tempest-ServerRescueNegativeTestJSON-1458167730-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T11:46:02Z,user_data=None,user_id='7ccb76bc93f84e0897da59b8d5928238',uuid=ae75d334-431a-4008-8b3d-f2a727d92417,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0cd51063-e3d9-44a8-a1cd-b89bb41a4438", "address": "fa:16:3e:54:1f:e7", "network": {"id": "f7298070-baaa-4842-b3b2-d9fe1058d3b6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1715911399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1715911399-network", "vif_mac": "fa:16:3e:54:1f:e7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8722edee53ed4a9188366c38f3b8b52f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cd51063-e3", "ovs_interfaceid": "0cd51063-e3d9-44a8-a1cd-b89bb41a4438", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73449) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 11:47:44 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-57884099-5454-411a-a430-232370889293 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Converting VIF {"id": "0cd51063-e3d9-44a8-a1cd-b89bb41a4438", "address": "fa:16:3e:54:1f:e7", "network": {"id": "f7298070-baaa-4842-b3b2-d9fe1058d3b6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1715911399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1715911399-network", "vif_mac": "fa:16:3e:54:1f:e7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8722edee53ed4a9188366c38f3b8b52f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cd51063-e3", "ovs_interfaceid": "0cd51063-e3d9-44a8-a1cd-b89bb41a4438", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:47:44 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-57884099-5454-411a-a430-232370889293 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:54:1f:e7,bridge_name='br-int',has_traffic_filtering=True,id=0cd51063-e3d9-44a8-a1cd-b89bb41a4438,network=Network(f7298070-baaa-4842-b3b2-d9fe1058d3b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cd51063-e3') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:47:44 user nova-compute[73449]: DEBUG nova.objects.instance [None req-57884099-5454-411a-a430-232370889293 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Lazy-loading 'pci_devices' on Instance uuid ae75d334-431a-4008-8b3d-f2a727d92417 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:47:44 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-57884099-5454-411a-a430-232370889293 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: ae75d334-431a-4008-8b3d-f2a727d92417] End _get_guest_xml xml=<domain type="kvm">
Aug 17 11:47:44 user nova-compute[73449]:   <uuid>ae75d334-431a-4008-8b3d-f2a727d92417</uuid>
Aug 17 11:47:44 user nova-compute[73449]:   <name>instance-00000013</name>
Aug 17 11:47:44 user nova-compute[73449]:   <memory>524288</memory>
Aug 17 11:47:44 user nova-compute[73449]:   <vcpu>1</vcpu>
Aug 17 11:47:44 user nova-compute[73449]:   <metadata>
Aug 17 11:47:44 user nova-compute[73449]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 11:47:44 user nova-compute[73449]:       <nova:package version="0.0.0"/>
Aug 17 11:47:44 user nova-compute[73449]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2048350466</nova:name>
Aug 17 11:47:44 user nova-compute[73449]:       <nova:creationTime>2023-08-17 11:47:44</nova:creationTime>
Aug 17 11:47:44 user nova-compute[73449]:       <nova:flavor name="m1.tiny">
Aug 17 11:47:44 user nova-compute[73449]:         <nova:memory>512</nova:memory>
Aug 17 11:47:44 user nova-compute[73449]:         <nova:disk>1</nova:disk>
Aug 17 11:47:44 user nova-compute[73449]:         <nova:swap>0</nova:swap>
Aug 17 11:47:44 user nova-compute[73449]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 11:47:44 user nova-compute[73449]:         <nova:vcpus>1</nova:vcpus>
Aug 17 11:47:44 user nova-compute[73449]:       </nova:flavor>
Aug 17 11:47:44 user nova-compute[73449]:       <nova:owner>
Aug 17 11:47:44 user nova-compute[73449]:         <nova:user uuid="7ccb76bc93f84e0897da59b8d5928238">tempest-ServerRescueNegativeTestJSON-1458167730-project-member</nova:user>
Aug 17 11:47:44 user nova-compute[73449]:         <nova:project uuid="8722edee53ed4a9188366c38f3b8b52f">tempest-ServerRescueNegativeTestJSON-1458167730</nova:project>
Aug 17 11:47:44 user nova-compute[73449]:       </nova:owner>
Aug 17 11:47:44 user nova-compute[73449]:       <nova:root type="image" uuid="0a2904ae-083d-41c8-83db-343132b36148"/>
Aug 17 11:47:44 user nova-compute[73449]:       <nova:ports>
Aug 17 11:47:44 user nova-compute[73449]:         <nova:port uuid="0cd51063-e3d9-44a8-a1cd-b89bb41a4438">
Aug 17 11:47:44 user nova-compute[73449]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 17 11:47:44 user nova-compute[73449]:         </nova:port>
Aug 17 11:47:44 user nova-compute[73449]:       </nova:ports>
Aug 17 11:47:44 user nova-compute[73449]:     </nova:instance>
Aug 17 11:47:44 user nova-compute[73449]:   </metadata>
Aug 17 11:47:44 user nova-compute[73449]:   <sysinfo type="smbios">
Aug 17 11:47:44 user nova-compute[73449]:     <system>
Aug 17 11:47:44 user nova-compute[73449]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 11:47:44 user nova-compute[73449]:       <entry name="product">OpenStack Nova</entry>
Aug 17 11:47:44 user nova-compute[73449]:       <entry name="version">0.0.0</entry>
Aug 17 11:47:44 user nova-compute[73449]:       <entry name="serial">ae75d334-431a-4008-8b3d-f2a727d92417</entry>
Aug 17 11:47:44 user nova-compute[73449]:       <entry name="uuid">ae75d334-431a-4008-8b3d-f2a727d92417</entry>
Aug 17 11:47:44 user nova-compute[73449]:       <entry name="family">Virtual Machine</entry>
Aug 17 11:47:44 user nova-compute[73449]:     </system>
Aug 17 11:47:44 user nova-compute[73449]:   </sysinfo>
Aug 17 11:47:44 user nova-compute[73449]:   <os>
Aug 17 11:47:44 user nova-compute[73449]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 11:47:44 user nova-compute[73449]:     <smbios mode="sysinfo"/>
Aug 17 11:47:44 user nova-compute[73449]:   </os>
Aug 17 11:47:44 user nova-compute[73449]:   <features>
Aug 17 11:47:44 user nova-compute[73449]:     <acpi/>
Aug 17 11:47:44 user nova-compute[73449]:     <apic/>
Aug 17 11:47:44 user nova-compute[73449]:     <vmcoreinfo/>
Aug 17 11:47:44 user nova-compute[73449]:   </features>
Aug 17 11:47:44 user nova-compute[73449]:   <clock offset="utc">
Aug 17 11:47:44 user nova-compute[73449]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 11:47:44 user nova-compute[73449]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 11:47:44 user nova-compute[73449]:     <timer name="hpet" present="no"/>
Aug 17 11:47:44 user nova-compute[73449]:   </clock>
Aug 17 11:47:44 user nova-compute[73449]:   <cpu mode="custom" match="exact">
Aug 17 11:47:44 user nova-compute[73449]:     <model>Nehalem</model>
Aug 17 11:47:44 user nova-compute[73449]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 11:47:44 user nova-compute[73449]:   </cpu>
Aug 17 11:47:44 user nova-compute[73449]:   <devices>
Aug 17 11:47:44 user nova-compute[73449]:     <disk type="file" device="disk">
Aug 17 11:47:44 user nova-compute[73449]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 11:47:44 user nova-compute[73449]:       <source file="/opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk.rescue"/>
Aug 17 11:47:44 user nova-compute[73449]:       <target dev="vda" bus="virtio"/>
Aug 17 11:47:44 user nova-compute[73449]:     </disk>
Aug 17 11:47:44 user nova-compute[73449]:     <disk type="file" device="disk">
Aug 17 11:47:44 user nova-compute[73449]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 11:47:44 user nova-compute[73449]:       <source file="/opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk"/>
Aug 17 11:47:44 user nova-compute[73449]:       <target dev="vdb" bus="virtio"/>
Aug 17 11:47:44 user nova-compute[73449]:     </disk>
Aug 17 11:47:44 user nova-compute[73449]:     <interface type="ethernet">
Aug 17 11:47:44 user nova-compute[73449]:       <mac address="fa:16:3e:54:1f:e7"/>
Aug 17 11:47:44 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 11:47:44 user nova-compute[73449]:       <mtu size="1442"/>
Aug 17 11:47:44 user nova-compute[73449]:       <target dev="tap0cd51063-e3"/>
Aug 17 11:47:44 user nova-compute[73449]:     </interface>
Aug 17 11:47:44 user nova-compute[73449]:     <serial type="pty">
Aug 17 11:47:44 user nova-compute[73449]:       <log file="/opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/console.log" append="off"/>
Aug 17 11:47:44 user nova-compute[73449]:     </serial>
Aug 17 11:47:44 user nova-compute[73449]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 11:47:44 user nova-compute[73449]:     <video>
Aug 17 11:47:44 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 11:47:44 user nova-compute[73449]:     </video>
Aug 17 11:47:44 user nova-compute[73449]:     <rng model="virtio">
Aug 17 11:47:44 user nova-compute[73449]:       <backend model="random">/dev/urandom</backend>
Aug 17 11:47:44 user nova-compute[73449]:     </rng>
Aug 17 11:47:44 user nova-compute[73449]:     <controller type="usb" index="0" model="none"/>
Aug 17 11:47:44 user nova-compute[73449]:     <memballoon model="virtio">
Aug 17 11:47:44 user nova-compute[73449]:       <stats period="10"/>
Aug 17 11:47:44 user nova-compute[73449]:     </memballoon>
Aug 17 11:47:44 user nova-compute[73449]:   </devices>
Aug 17 11:47:44 user nova-compute[73449]: </domain>
Aug 17 11:47:44 user nova-compute[73449]:  {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 11:47:44 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: ae75d334-431a-4008-8b3d-f2a727d92417] Instance destroyed successfully.
Aug 17 11:47:44 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:47:44 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:47:44 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-57884099-5454-411a-a430-232370889293 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] No BDM found with device name vda, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 11:47:44 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-57884099-5454-411a-a430-232370889293 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 11:47:44 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-57884099-5454-411a-a430-232370889293 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] No VIF found with MAC fa:16:3e:54:1f:e7, not building metadata {{(pid=73449) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 11:47:44 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] Instance destroyed successfully.
Aug 17 11:47:44 user nova-compute[73449]: DEBUG nova.objects.instance [None req-1b55e45b-77b5-4f89-bd0c-1730703bfb63 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Lazy-loading 'resources' on Instance uuid de5084e1-5a5e-48d2-a3ef-7f29898d1d2d {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:47:44 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-1b55e45b-77b5-4f89-bd0c-1730703bfb63 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:45:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1351274734',display_name='tempest-TestMinimumBasicScenario-server-1351274734',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1351274734',id=15,image_ref='fb1d2645-7169-4a0c-a0b3-f384ea3ca6ee',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK6F1KbqG2L7a63s8u4cdTuNvzTcmprfe52KFjhIPaxJjtgOgScs7eLTzZK2UKsaCKRsFSlnWB9z6cQbolaXqixSV5LaBk/UTgveylZJ3QdcXGKc0GT695r/cb4yrtsjUA==',key_name='tempest-TestMinimumBasicScenario-1748788689',keypairs=<?>,launch_index=0,launched_at=2023-08-17T11:45:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b5ba3ebf47bd4b999e68c74a5c0ab060',ramdisk_id='',reservation_id='r-yy0x01ti',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fb1d2645-7169-4a0c-a0b3-f384ea3ca6ee',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1063498076',owner_user_name='tempest-TestMinimumBasicScenario-1063498076-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T11:47:44Z,user_data=None,user_id='a388f1f7e6254e8cace000ec1249d6c6',uuid=de5084e1-5a5e-48d2-a3ef-7f29898d1d2d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e2af7fce-7442-48b4-8611-da3171b0672b", "address": "fa:16:3e:c0:c8:a6", "network": {"id": "ff73f5c3-bae6-46cc-bcb8-bbd5be1b478d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1229197917-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5ba3ebf47bd4b999e68c74a5c0ab060", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2af7fce-74", "ovs_interfaceid": "e2af7fce-7442-48b4-8611-da3171b0672b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 11:47:44 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-1b55e45b-77b5-4f89-bd0c-1730703bfb63 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Converting VIF {"id": "e2af7fce-7442-48b4-8611-da3171b0672b", "address": "fa:16:3e:c0:c8:a6", "network": {"id": "ff73f5c3-bae6-46cc-bcb8-bbd5be1b478d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1229197917-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5ba3ebf47bd4b999e68c74a5c0ab060", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2af7fce-74", "ovs_interfaceid": "e2af7fce-7442-48b4-8611-da3171b0672b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:47:44 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-1b55e45b-77b5-4f89-bd0c-1730703bfb63 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c0:c8:a6,bridge_name='br-int',has_traffic_filtering=True,id=e2af7fce-7442-48b4-8611-da3171b0672b,network=Network(ff73f5c3-bae6-46cc-bcb8-bbd5be1b478d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2af7fce-74') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:47:44 user nova-compute[73449]: DEBUG os_vif [None req-1b55e45b-77b5-4f89-bd0c-1730703bfb63 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c0:c8:a6,bridge_name='br-int',has_traffic_filtering=True,id=e2af7fce-7442-48b4-8611-da3171b0672b,network=Network(ff73f5c3-bae6-46cc-bcb8-bbd5be1b478d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2af7fce-74') {{(pid=73449) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 11:47:44 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:47:44 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape2af7fce-74, bridge=br-int, if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:47:44 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:47:44 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:47:44 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:47:44 user nova-compute[73449]: INFO os_vif [None req-1b55e45b-77b5-4f89-bd0c-1730703bfb63 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c0:c8:a6,bridge_name='br-int',has_traffic_filtering=True,id=e2af7fce-7442-48b4-8611-da3171b0672b,network=Network(ff73f5c3-bae6-46cc-bcb8-bbd5be1b478d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2af7fce-74')
Aug 17 11:47:44 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b55e45b-77b5-4f89-bd0c-1730703bfb63 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] calling os-brick to detach iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 11:47:44 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b55e45b-77b5-4f89-bd0c-1730703bfb63 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, {'target_iqns': ['iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gcRoTASv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 11:47:44 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-1b55e45b-77b5-4f89-bd0c-1730703bfb63 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 11:47:44 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-1b55e45b-77b5-4f89-bd0c-1730703bfb63 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:47:44 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-1b55e45b-77b5-4f89-bd0c-1730703bfb63 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:47:44 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b55e45b-77b5-4f89-bd0c-1730703bfb63 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c', 0)] {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 11:47:44 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:47:44 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:47:44 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dd70f38-8a40-43e9-bc33-68eac63554fa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:47:44 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:47:44 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:47:44 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[384a7b30-e73a-4d61-9144-6eb1774764d3]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:47:44 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b55e45b-77b5-4f89-bd0c-1730703bfb63 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466 (non-flash)
Aug 17 11:47:44 user nova-compute[73449]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611 (non-flash)
Aug 17 11:47:44 user nova-compute[73449]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c (non-flash)
Aug 17 11:47:44 user nova-compute[73449]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed (non-flash)
Aug 17 11:47:44 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:47:44 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b55e45b-77b5-4f89-bd0c-1730703bfb63 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466 (non-flash)
Aug 17 11:47:44 user nova-compute[73449]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611 (non-flash)
Aug 17 11:47:44 user nova-compute[73449]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c (non-flash)
Aug 17 11:47:44 user nova-compute[73449]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed (non-flash)
Aug 17 11:47:44 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:47:44 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b55e45b-77b5-4f89-bd0c-1730703bfb63 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe7582b4790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c'): ({'sde'}, set())}) {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 11:47:44 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-1b55e45b-77b5-4f89-bd0c-1730703bfb63 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Removing single pathed devices sde {{(pid=73449) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 11:47:44 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:47:44 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:47:44 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[374fcf9e-0050-4593-af66-3994dd13369f]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:47:44 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:47:44 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:47:44 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[31694033-33f4-43f4-bfad-a0e5d041e5c2]: (4, ('ok\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:47:44 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-1b55e45b-77b5-4f89-bd0c-1730703bfb63 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Flushing IO for device /dev/sde {{(pid=73449) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 11:47:44 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:47:44 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:47:44 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[336a5926-3319-4561-bdf5-d3f9b715833d]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:47:44 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-1b55e45b-77b5-4f89-bd0c-1730703bfb63 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73449) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 11:47:44 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:47:44 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.054s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:47:44 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[d46dff20-d31e-47ca-aadb-fcdb2d4765e9]: (4, ('1', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:47:44 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-1b55e45b-77b5-4f89-bd0c-1730703bfb63 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73449) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 11:47:44 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-1b55e45b-77b5-4f89-bd0c-1730703bfb63 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] SCSI volumes sde have been removed. {{(pid=73449) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 11:47:44 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b55e45b-77b5-4f89-bd0c-1730703bfb63 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c')] {{(pid=73449) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 11:47:44 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:47:44 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:47:44 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaccd09c-1b18-4b3b-94c9-7ac3bd8fcc82]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:47:44 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b55e45b-77b5-4f89-bd0c-1730703bfb63 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:47:44 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c -p 172.16.0.220:3260 --logout {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:47:44 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:47:44 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbc014d8-a7bd-4020-b948-8f3e501b95b3]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:47:44 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b55e45b-77b5-4f89-bd0c-1730703bfb63 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c, portal: 172.16.0.220,3260]
Aug 17 11:47:44 user nova-compute[73449]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c, portal: 172.16.0.220,3260] successful.
Aug 17 11:47:44 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:47:44 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c -p 172.16.0.220:3260 --op delete {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:47:44 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:47:44 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[adf0fb42-177b-4d27-905b-fabd4852f732]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:47:44 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b55e45b-77b5-4f89-bd0c-1730703bfb63 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:47:44 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-1b55e45b-77b5-4f89-bd0c-1730703bfb63 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:47:44 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b55e45b-77b5-4f89-bd0c-1730703bfb63 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] <== disconnect_volume: return (331ms) None {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 11:47:44 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b55e45b-77b5-4f89-bd0c-1730703bfb63 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] Disconnected iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 11:47:44 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-1b55e45b-77b5-4f89-bd0c-1730703bfb63 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] Start _get_guest_xml network_info=[{"id": "e2af7fce-7442-48b4-8611-da3171b0672b", "address": "fa:16:3e:c0:c8:a6", "network": {"id": "ff73f5c3-bae6-46cc-bcb8-bbd5be1b478d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1229197917-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5ba3ebf47bd4b999e68c74a5c0ab060", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2af7fce-74", "ovs_interfaceid": "e2af7fce-7442-48b4-8611-da3171b0672b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=fb1d2645-7169-4a0c-a0b3-f384ea3ca6ee,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': 'fb1d2645-7169-4a0c-a0b3-f384ea3ca6ee'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'attachment_id': '45f337f7-3cfc-4d14-8c91-7da372daf6f3', 'boot_index': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gcRoTASv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': 'de5084e1-5a5e-48d2-a3ef-7f29898d1d2d', 'attached_at': '', 'detached_at': '', 'volume_id': '365e93f2-f46d-4b14-b207-f56656bc918c', 'serial': '365e93f2-f46d-4b14-b207-f56656bc918c'}, 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 11:47:44 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-1b55e45b-77b5-4f89-bd0c-1730703bfb63 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:47:44 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-1b55e45b-77b5-4f89-bd0c-1730703bfb63 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:47:44 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-1b55e45b-77b5-4f89-bd0c-1730703bfb63 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 11:47:44 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-1b55e45b-77b5-4f89-bd0c-1730703bfb63 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] CPU controller missing on host. {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 11:47:44 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-1b55e45b-77b5-4f89-bd0c-1730703bfb63 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 11:47:44 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-1b55e45b-77b5-4f89-bd0c-1730703bfb63 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] CPU controller found on host. {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 11:47:45 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-1b55e45b-77b5-4f89-bd0c-1730703bfb63 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73449) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 11:47:45 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-1b55e45b-77b5-4f89-bd0c-1730703bfb63 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T11:35:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=fb1d2645-7169-4a0c-a0b3-f384ea3ca6ee,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 11:47:45 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-1b55e45b-77b5-4f89-bd0c-1730703bfb63 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Flavor limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 11:47:45 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-1b55e45b-77b5-4f89-bd0c-1730703bfb63 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Image limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 11:47:45 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-1b55e45b-77b5-4f89-bd0c-1730703bfb63 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Flavor pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 11:47:45 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-1b55e45b-77b5-4f89-bd0c-1730703bfb63 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Image pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 11:47:45 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-1b55e45b-77b5-4f89-bd0c-1730703bfb63 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 11:47:45 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-1b55e45b-77b5-4f89-bd0c-1730703bfb63 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 11:47:45 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-1b55e45b-77b5-4f89-bd0c-1730703bfb63 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 11:47:45 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-1b55e45b-77b5-4f89-bd0c-1730703bfb63 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Got 1 possible topologies {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 11:47:45 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-1b55e45b-77b5-4f89-bd0c-1730703bfb63 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 11:47:45 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-1b55e45b-77b5-4f89-bd0c-1730703bfb63 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 11:47:45 user nova-compute[73449]: DEBUG nova.objects.instance [None req-1b55e45b-77b5-4f89-bd0c-1730703bfb63 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Lazy-loading 'vcpu_model' on Instance uuid de5084e1-5a5e-48d2-a3ef-7f29898d1d2d {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:47:45 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b55e45b-77b5-4f89-bd0c-1730703bfb63 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] Calling os-brick to attach iSCSI Volume {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 11:47:45 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b55e45b-77b5-4f89-bd0c-1730703bfb63 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gcRoTASv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 11:47:45 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-1b55e45b-77b5-4f89-bd0c-1730703bfb63 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 11:47:45 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-1b55e45b-77b5-4f89-bd0c-1730703bfb63 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:47:45 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-1b55e45b-77b5-4f89-bd0c-1730703bfb63 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:47:45 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-1b55e45b-77b5-4f89-bd0c-1730703bfb63 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 11:47:45 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-1b55e45b-77b5-4f89-bd0c-1730703bfb63 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:47:45 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-1b55e45b-77b5-4f89-bd0c-1730703bfb63 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:47:45 user nova-compute[73449]: INFO os_brick.initiator.connectors.iscsi [None req-1b55e45b-77b5-4f89-bd0c-1730703bfb63 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 11:47:45 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c -p 172.16.0.220:3260 {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:47:45 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:47:45 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[496ac3f0-198f-46e6-b4a1-e02388acb61d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:47:45 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b55e45b-77b5-4f89-bd0c-1730703bfb63 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 11:47:45 user nova-compute[73449]:  {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:47:45 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c -p 172.16.0.220:3260 --interface default --op new {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:47:45 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:47:45 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[28bd12cf-42ef-4399-99d8-2d364d3c9723]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c] added\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:47:45 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b55e45b-77b5-4f89-bd0c-1730703bfb63 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c] added
Aug 17 11:47:45 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:47:45 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:47:45 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:47:45 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[16545df4-9d1a-4831-a1f6-518667f97321]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:47:45 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b55e45b-77b5-4f89-bd0c-1730703bfb63 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:47:45 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:47:45 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:47:45 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[96ee579e-3e2c-456c-a432-f9b92677c1dd]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:47:45 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b55e45b-77b5-4f89-bd0c-1730703bfb63 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:47:45 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gcRoTASv {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:47:45 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gcRoTASv" returned: 0 in 0.025s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:47:45 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa690a83-b1a8-4ea2-bc5f-36cdc4797bd8]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:47:45 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b55e45b-77b5-4f89-bd0c-1730703bfb63 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gcRoTASv'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:47:45 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:47:45 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:47:45 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f1a1103-6a2d-41da-9e60-f66a665945df]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:47:45 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b55e45b-77b5-4f89-bd0c-1730703bfb63 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:47:45 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:47:45 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:47:45 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc0a31aa-1b36-427c-a56f-8af55ca85d11]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:47:45 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b55e45b-77b5-4f89-bd0c-1730703bfb63 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466 (non-flash)
Aug 17 11:47:45 user nova-compute[73449]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611 (non-flash)
Aug 17 11:47:45 user nova-compute[73449]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed (non-flash)
Aug 17 11:47:45 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:47:45 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b55e45b-77b5-4f89-bd0c-1730703bfb63 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466 (non-flash)
Aug 17 11:47:45 user nova-compute[73449]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611 (non-flash)
Aug 17 11:47:45 user nova-compute[73449]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed (non-flash)
Aug 17 11:47:45 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:47:45 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c -p 172.16.0.220:3260 --login {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:47:45 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:47:45 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3f40ac9-ca50-4189-a609-3101d53ba101]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:47:45 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b55e45b-77b5-4f89-bd0c-1730703bfb63 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c, portal: 172.16.0.220,3260]
Aug 17 11:47:45 user nova-compute[73449]: Login to [iface: default, target: iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c, portal: 172.16.0.220,3260] successful.
Aug 17 11:47:45 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:47:45 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:47:45 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:47:45 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eaefbdb-e898-4520-83f2-f7984f7ef2c3]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:47:45 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b55e45b-77b5-4f89-bd0c-1730703bfb63 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:47:45 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:47:45 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:47:45 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[352d576c-032d-47cb-94a9-8646c8503c6c]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:47:45 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b55e45b-77b5-4f89-bd0c-1730703bfb63 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466 (non-flash)
Aug 17 11:47:45 user nova-compute[73449]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611 (non-flash)
Aug 17 11:47:45 user nova-compute[73449]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed (non-flash)
Aug 17 11:47:45 user nova-compute[73449]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c (non-flash)
Aug 17 11:47:45 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:47:45 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b55e45b-77b5-4f89-bd0c-1730703bfb63 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466 (non-flash)
Aug 17 11:47:45 user nova-compute[73449]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611 (non-flash)
Aug 17 11:47:45 user nova-compute[73449]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed (non-flash)
Aug 17 11:47:45 user nova-compute[73449]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c (non-flash)
Aug 17 11:47:45 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:47:45 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-1b55e45b-77b5-4f89-bd0c-1730703bfb63 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.323s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:47:45 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b55e45b-77b5-4f89-bd0c-1730703bfb63 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Connected to 172.16.0.220:3260 {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 11:47:45 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-1b55e45b-77b5-4f89-bd0c-1730703bfb63 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] HCTL ('36', '-', '-', 0) found on session 24 with lun 0 {{(pid=73449) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 11:47:45 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-1b55e45b-77b5-4f89-bd0c-1730703bfb63 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73449) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 11:47:45 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:47:45 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.024s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:47:45 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa2b9f13-30ce-4ec5-a1bc-b13892bd3c8b]: (4, ('- - 0', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:47:45 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-1b55e45b-77b5-4f89-bd0c-1730703bfb63 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Searching for a device in session 24 and hctl ['36', '*', '*', 0] yield: None {{(pid=73449) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 11:47:45 user nova-compute[73449]: DEBUG nova.compute.manager [req-a300bfd9-c602-48d9-9574-dcde51963300 req-1d4fb8a9-85f3-42e3-9499-4ff47d52f960 service nova] [instance: ae75d334-431a-4008-8b3d-f2a727d92417] Received event network-vif-plugged-0cd51063-e3d9-44a8-a1cd-b89bb41a4438 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:47:45 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-a300bfd9-c602-48d9-9574-dcde51963300 req-1d4fb8a9-85f3-42e3-9499-4ff47d52f960 service nova] Acquiring lock "ae75d334-431a-4008-8b3d-f2a727d92417-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:47:45 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-a300bfd9-c602-48d9-9574-dcde51963300 req-1d4fb8a9-85f3-42e3-9499-4ff47d52f960 service nova] Lock "ae75d334-431a-4008-8b3d-f2a727d92417-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:47:45 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-a300bfd9-c602-48d9-9574-dcde51963300 req-1d4fb8a9-85f3-42e3-9499-4ff47d52f960 service nova] Lock "ae75d334-431a-4008-8b3d-f2a727d92417-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:47:45 user nova-compute[73449]: DEBUG nova.compute.manager [req-a300bfd9-c602-48d9-9574-dcde51963300 req-1d4fb8a9-85f3-42e3-9499-4ff47d52f960 service nova] [instance: ae75d334-431a-4008-8b3d-f2a727d92417] No waiting events found dispatching network-vif-plugged-0cd51063-e3d9-44a8-a1cd-b89bb41a4438 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:47:45 user nova-compute[73449]: WARNING nova.compute.manager [req-a300bfd9-c602-48d9-9574-dcde51963300 req-1d4fb8a9-85f3-42e3-9499-4ff47d52f960 service nova] [instance: ae75d334-431a-4008-8b3d-f2a727d92417] Received unexpected event network-vif-plugged-0cd51063-e3d9-44a8-a1cd-b89bb41a4438 for instance with vm_state active and task_state rescuing.
Aug 17 11:47:45 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:47:45 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:47:46 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:47:46 user nova-compute[73449]: DEBUG nova.compute.manager [req-a24df09e-841b-47da-8ae4-c9ef8352f570 req-e8133b02-bb25-4b05-8567-dc5cb998f0b9 service nova] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] Received event network-vif-plugged-e2af7fce-7442-48b4-8611-da3171b0672b {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:47:46 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-a24df09e-841b-47da-8ae4-c9ef8352f570 req-e8133b02-bb25-4b05-8567-dc5cb998f0b9 service nova] Acquiring lock "de5084e1-5a5e-48d2-a3ef-7f29898d1d2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:47:46 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-a24df09e-841b-47da-8ae4-c9ef8352f570 req-e8133b02-bb25-4b05-8567-dc5cb998f0b9 service nova] Lock "de5084e1-5a5e-48d2-a3ef-7f29898d1d2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:47:46 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-a24df09e-841b-47da-8ae4-c9ef8352f570 req-e8133b02-bb25-4b05-8567-dc5cb998f0b9 service nova] Lock "de5084e1-5a5e-48d2-a3ef-7f29898d1d2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:47:46 user nova-compute[73449]: DEBUG nova.compute.manager [req-a24df09e-841b-47da-8ae4-c9ef8352f570 req-e8133b02-bb25-4b05-8567-dc5cb998f0b9 service nova] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] No waiting events found dispatching network-vif-plugged-e2af7fce-7442-48b4-8611-da3171b0672b {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:47:46 user nova-compute[73449]: WARNING nova.compute.manager [req-a24df09e-841b-47da-8ae4-c9ef8352f570 req-e8133b02-bb25-4b05-8567-dc5cb998f0b9 service nova] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] Received unexpected event network-vif-plugged-e2af7fce-7442-48b4-8611-da3171b0672b for instance with vm_state active and task_state reboot_started_hard.
Aug 17 11:47:46 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:47:46 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-1b55e45b-77b5-4f89-bd0c-1730703bfb63 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Searching for a device in session 24 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73449) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 11:47:46 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b55e45b-77b5-4f89-bd0c-1730703bfb63 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gcRoTASv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 11:47:46 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-1b55e45b-77b5-4f89-bd0c-1730703bfb63 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.361s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:47:46 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b55e45b-77b5-4f89-bd0c-1730703bfb63 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] <== connect_volume: return (1361ms) {'type': 'block', 'scsi_wwn': '26633623061353231', 'path': '/dev/sde'} {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 11:47:46 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b55e45b-77b5-4f89-bd0c-1730703bfb63 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26633623061353231', 'path': '/dev/sde'} {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 11:47:46 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-1b55e45b-77b5-4f89-bd0c-1730703bfb63 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:45:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1351274734',display_name='tempest-TestMinimumBasicScenario-server-1351274734',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1351274734',id=15,image_ref='fb1d2645-7169-4a0c-a0b3-f384ea3ca6ee',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK6F1KbqG2L7a63s8u4cdTuNvzTcmprfe52KFjhIPaxJjtgOgScs7eLTzZK2UKsaCKRsFSlnWB9z6cQbolaXqixSV5LaBk/UTgveylZJ3QdcXGKc0GT695r/cb4yrtsjUA==',key_name='tempest-TestMinimumBasicScenario-1748788689',keypairs=<?>,launch_index=0,launched_at=2023-08-17T11:45:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b5ba3ebf47bd4b999e68c74a5c0ab060',ramdisk_id='',reservation_id='r-yy0x01ti',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fb1d2645-7169-4a0c-a0b3-f384ea3ca6ee',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1063498076',owner_user_name='tempest-TestMinimumBasicScenario-1063498076-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T11:47:44Z,user_data=None,user_id='a388f1f7e6254e8cace000ec1249d6c6',uuid=de5084e1-5a5e-48d2-a3ef-7f29898d1d2d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e2af7fce-7442-48b4-8611-da3171b0672b", "address": "fa:16:3e:c0:c8:a6", "network": {"id": "ff73f5c3-bae6-46cc-bcb8-bbd5be1b478d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1229197917-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5ba3ebf47bd4b999e68c74a5c0ab060", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2af7fce-74", "ovs_interfaceid": "e2af7fce-7442-48b4-8611-da3171b0672b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73449) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 11:47:46 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-1b55e45b-77b5-4f89-bd0c-1730703bfb63 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Converting VIF {"id": "e2af7fce-7442-48b4-8611-da3171b0672b", "address": "fa:16:3e:c0:c8:a6", "network": {"id": "ff73f5c3-bae6-46cc-bcb8-bbd5be1b478d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1229197917-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5ba3ebf47bd4b999e68c74a5c0ab060", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2af7fce-74", "ovs_interfaceid": "e2af7fce-7442-48b4-8611-da3171b0672b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:47:46 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-1b55e45b-77b5-4f89-bd0c-1730703bfb63 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c0:c8:a6,bridge_name='br-int',has_traffic_filtering=True,id=e2af7fce-7442-48b4-8611-da3171b0672b,network=Network(ff73f5c3-bae6-46cc-bcb8-bbd5be1b478d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2af7fce-74') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:47:46 user nova-compute[73449]: DEBUG nova.objects.instance [None req-1b55e45b-77b5-4f89-bd0c-1730703bfb63 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Lazy-loading 'pci_devices' on Instance uuid de5084e1-5a5e-48d2-a3ef-7f29898d1d2d {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:47:46 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-1b55e45b-77b5-4f89-bd0c-1730703bfb63 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] End _get_guest_xml xml=<domain type="kvm">
Aug 17 11:47:46 user nova-compute[73449]:   <uuid>de5084e1-5a5e-48d2-a3ef-7f29898d1d2d</uuid>
Aug 17 11:47:46 user nova-compute[73449]:   <name>instance-0000000f</name>
Aug 17 11:47:46 user nova-compute[73449]:   <memory>524288</memory>
Aug 17 11:47:46 user nova-compute[73449]:   <vcpu>1</vcpu>
Aug 17 11:47:46 user nova-compute[73449]:   <metadata>
Aug 17 11:47:46 user nova-compute[73449]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 11:47:46 user nova-compute[73449]:       <nova:package version="0.0.0"/>
Aug 17 11:47:46 user nova-compute[73449]:       <nova:name>tempest-TestMinimumBasicScenario-server-1351274734</nova:name>
Aug 17 11:47:46 user nova-compute[73449]:       <nova:creationTime>2023-08-17 11:47:44</nova:creationTime>
Aug 17 11:47:46 user nova-compute[73449]:       <nova:flavor name="m1.tiny">
Aug 17 11:47:46 user nova-compute[73449]:         <nova:memory>512</nova:memory>
Aug 17 11:47:46 user nova-compute[73449]:         <nova:disk>1</nova:disk>
Aug 17 11:47:46 user nova-compute[73449]:         <nova:swap>0</nova:swap>
Aug 17 11:47:46 user nova-compute[73449]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 11:47:46 user nova-compute[73449]:         <nova:vcpus>1</nova:vcpus>
Aug 17 11:47:46 user nova-compute[73449]:       </nova:flavor>
Aug 17 11:47:46 user nova-compute[73449]:       <nova:owner>
Aug 17 11:47:46 user nova-compute[73449]:         <nova:user uuid="a388f1f7e6254e8cace000ec1249d6c6">tempest-TestMinimumBasicScenario-1063498076-project-member</nova:user>
Aug 17 11:47:46 user nova-compute[73449]:         <nova:project uuid="b5ba3ebf47bd4b999e68c74a5c0ab060">tempest-TestMinimumBasicScenario-1063498076</nova:project>
Aug 17 11:47:46 user nova-compute[73449]:       </nova:owner>
Aug 17 11:47:46 user nova-compute[73449]:       <nova:root type="image" uuid="fb1d2645-7169-4a0c-a0b3-f384ea3ca6ee"/>
Aug 17 11:47:46 user nova-compute[73449]:       <nova:ports>
Aug 17 11:47:46 user nova-compute[73449]:         <nova:port uuid="e2af7fce-7442-48b4-8611-da3171b0672b">
Aug 17 11:47:46 user nova-compute[73449]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 17 11:47:46 user nova-compute[73449]:         </nova:port>
Aug 17 11:47:46 user nova-compute[73449]:       </nova:ports>
Aug 17 11:47:46 user nova-compute[73449]:     </nova:instance>
Aug 17 11:47:46 user nova-compute[73449]:   </metadata>
Aug 17 11:47:46 user nova-compute[73449]:   <sysinfo type="smbios">
Aug 17 11:47:46 user nova-compute[73449]:     <system>
Aug 17 11:47:46 user nova-compute[73449]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 11:47:46 user nova-compute[73449]:       <entry name="product">OpenStack Nova</entry>
Aug 17 11:47:46 user nova-compute[73449]:       <entry name="version">0.0.0</entry>
Aug 17 11:47:46 user nova-compute[73449]:       <entry name="serial">de5084e1-5a5e-48d2-a3ef-7f29898d1d2d</entry>
Aug 17 11:47:46 user nova-compute[73449]:       <entry name="uuid">de5084e1-5a5e-48d2-a3ef-7f29898d1d2d</entry>
Aug 17 11:47:46 user nova-compute[73449]:       <entry name="family">Virtual Machine</entry>
Aug 17 11:47:46 user nova-compute[73449]:     </system>
Aug 17 11:47:46 user nova-compute[73449]:   </sysinfo>
Aug 17 11:47:46 user nova-compute[73449]:   <os>
Aug 17 11:47:46 user nova-compute[73449]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 11:47:46 user nova-compute[73449]:     <boot dev="hd"/>
Aug 17 11:47:46 user nova-compute[73449]:     <smbios mode="sysinfo"/>
Aug 17 11:47:46 user nova-compute[73449]:   </os>
Aug 17 11:47:46 user nova-compute[73449]:   <features>
Aug 17 11:47:46 user nova-compute[73449]:     <acpi/>
Aug 17 11:47:46 user nova-compute[73449]:     <apic/>
Aug 17 11:47:46 user nova-compute[73449]:     <vmcoreinfo/>
Aug 17 11:47:46 user nova-compute[73449]:   </features>
Aug 17 11:47:46 user nova-compute[73449]:   <clock offset="utc">
Aug 17 11:47:46 user nova-compute[73449]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 11:47:46 user nova-compute[73449]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 11:47:46 user nova-compute[73449]:     <timer name="hpet" present="no"/>
Aug 17 11:47:46 user nova-compute[73449]:   </clock>
Aug 17 11:47:46 user nova-compute[73449]:   <cpu mode="custom" match="exact">
Aug 17 11:47:46 user nova-compute[73449]:     <model>Nehalem</model>
Aug 17 11:47:46 user nova-compute[73449]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 11:47:46 user nova-compute[73449]:   </cpu>
Aug 17 11:47:46 user nova-compute[73449]:   <devices>
Aug 17 11:47:46 user nova-compute[73449]:     <disk type="file" device="disk">
Aug 17 11:47:46 user nova-compute[73449]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 11:47:46 user nova-compute[73449]:       <source file="/opt/stack/data/nova/instances/de5084e1-5a5e-48d2-a3ef-7f29898d1d2d/disk"/>
Aug 17 11:47:46 user nova-compute[73449]:       <target dev="vda" bus="virtio"/>
Aug 17 11:47:46 user nova-compute[73449]:     </disk>
Aug 17 11:47:46 user nova-compute[73449]:     <disk type="block" device="disk">
Aug 17 11:47:46 user nova-compute[73449]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 11:47:46 user nova-compute[73449]:       <source dev="/dev/sde"/>
Aug 17 11:47:46 user nova-compute[73449]:       <target dev="vdb" bus="virtio"/>
Aug 17 11:47:46 user nova-compute[73449]:       <serial>365e93f2-f46d-4b14-b207-f56656bc918c</serial>
Aug 17 11:47:46 user nova-compute[73449]:     </disk>
Aug 17 11:47:46 user nova-compute[73449]:     <interface type="ethernet">
Aug 17 11:47:46 user nova-compute[73449]:       <mac address="fa:16:3e:c0:c8:a6"/>
Aug 17 11:47:46 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 11:47:46 user nova-compute[73449]:       <mtu size="1442"/>
Aug 17 11:47:46 user nova-compute[73449]:       <target dev="tape2af7fce-74"/>
Aug 17 11:47:46 user nova-compute[73449]:     </interface>
Aug 17 11:47:46 user nova-compute[73449]:     <serial type="pty">
Aug 17 11:47:46 user nova-compute[73449]:       <log file="/opt/stack/data/nova/instances/de5084e1-5a5e-48d2-a3ef-7f29898d1d2d/console.log" append="off"/>
Aug 17 11:47:46 user nova-compute[73449]:     </serial>
Aug 17 11:47:46 user nova-compute[73449]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 11:47:46 user nova-compute[73449]:     <video>
Aug 17 11:47:46 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 11:47:46 user nova-compute[73449]:     </video>
Aug 17 11:47:46 user nova-compute[73449]:     <rng model="virtio">
Aug 17 11:47:46 user nova-compute[73449]:       <backend model="random">/dev/urandom</backend>
Aug 17 11:47:46 user nova-compute[73449]:     </rng>
Aug 17 11:47:46 user nova-compute[73449]:     <controller type="usb" index="0" model="none"/>
Aug 17 11:47:46 user nova-compute[73449]:     <memballoon model="virtio">
Aug 17 11:47:46 user nova-compute[73449]:       <stats period="10"/>
Aug 17 11:47:46 user nova-compute[73449]:     </memballoon>
Aug 17 11:47:46 user nova-compute[73449]:   </devices>
Aug 17 11:47:46 user nova-compute[73449]: </domain>
Aug 17 11:47:46 user nova-compute[73449]:  {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 11:47:46 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-1b55e45b-77b5-4f89-bd0c-1730703bfb63 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de5084e1-5a5e-48d2-a3ef-7f29898d1d2d/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:47:46 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-1b55e45b-77b5-4f89-bd0c-1730703bfb63 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de5084e1-5a5e-48d2-a3ef-7f29898d1d2d/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:47:46 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-1b55e45b-77b5-4f89-bd0c-1730703bfb63 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de5084e1-5a5e-48d2-a3ef-7f29898d1d2d/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:47:46 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-1b55e45b-77b5-4f89-bd0c-1730703bfb63 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de5084e1-5a5e-48d2-a3ef-7f29898d1d2d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:47:46 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-1b55e45b-77b5-4f89-bd0c-1730703bfb63 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73449) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 11:47:46 user nova-compute[73449]: DEBUG nova.objects.instance [None req-1b55e45b-77b5-4f89-bd0c-1730703bfb63 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Lazy-loading 'trusted_certs' on Instance uuid de5084e1-5a5e-48d2-a3ef-7f29898d1d2d {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:47:46 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-1b55e45b-77b5-4f89-bd0c-1730703bfb63 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/666f7b25567510f45761a65277e1eb0e52001fde --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:47:47 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-1b55e45b-77b5-4f89-bd0c-1730703bfb63 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/666f7b25567510f45761a65277e1eb0e52001fde --force-share --output=json" returned: 0 in 0.180s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:47:47 user nova-compute[73449]: DEBUG nova.virt.disk.api [None req-1b55e45b-77b5-4f89-bd0c-1730703bfb63 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Checking if we can resize image /opt/stack/data/nova/instances/de5084e1-5a5e-48d2-a3ef-7f29898d1d2d/disk. size=1073741824 {{(pid=73449) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 11:47:47 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-1b55e45b-77b5-4f89-bd0c-1730703bfb63 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de5084e1-5a5e-48d2-a3ef-7f29898d1d2d/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:47:47 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-1b55e45b-77b5-4f89-bd0c-1730703bfb63 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de5084e1-5a5e-48d2-a3ef-7f29898d1d2d/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:47:47 user nova-compute[73449]: DEBUG nova.virt.disk.api [None req-1b55e45b-77b5-4f89-bd0c-1730703bfb63 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Cannot resize image /opt/stack/data/nova/instances/de5084e1-5a5e-48d2-a3ef-7f29898d1d2d/disk to a smaller size. {{(pid=73449) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 11:47:47 user nova-compute[73449]: DEBUG nova.objects.instance [None req-1b55e45b-77b5-4f89-bd0c-1730703bfb63 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Lazy-loading 'migration_context' on Instance uuid de5084e1-5a5e-48d2-a3ef-7f29898d1d2d {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:47:47 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-1b55e45b-77b5-4f89-bd0c-1730703bfb63 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:45:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1351274734',display_name='tempest-TestMinimumBasicScenario-server-1351274734',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1351274734',id=15,image_ref='fb1d2645-7169-4a0c-a0b3-f384ea3ca6ee',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK6F1KbqG2L7a63s8u4cdTuNvzTcmprfe52KFjhIPaxJjtgOgScs7eLTzZK2UKsaCKRsFSlnWB9z6cQbolaXqixSV5LaBk/UTgveylZJ3QdcXGKc0GT695r/cb4yrtsjUA==',key_name='tempest-TestMinimumBasicScenario-1748788689',keypairs=<?>,launch_index=0,launched_at=2023-08-17T11:45:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='b5ba3ebf47bd4b999e68c74a5c0ab060',ramdisk_id='',reservation_id='r-yy0x01ti',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fb1d2645-7169-4a0c-a0b3-f384ea3ca6ee',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1063498076',owner_user_name='tempest-TestMinimumBasicScenario-1063498076-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T11:47:44Z,user_data=None,user_id='a388f1f7e6254e8cace000ec1249d6c6',uuid=de5084e1-5a5e-48d2-a3ef-7f29898d1d2d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e2af7fce-7442-48b4-8611-da3171b0672b", "address": "fa:16:3e:c0:c8:a6", "network": {"id": "ff73f5c3-bae6-46cc-bcb8-bbd5be1b478d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1229197917-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5ba3ebf47bd4b999e68c74a5c0ab060", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2af7fce-74", "ovs_interfaceid": "e2af7fce-7442-48b4-8611-da3171b0672b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 11:47:47 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-1b55e45b-77b5-4f89-bd0c-1730703bfb63 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Converting VIF {"id": "e2af7fce-7442-48b4-8611-da3171b0672b", "address": "fa:16:3e:c0:c8:a6", "network": {"id": "ff73f5c3-bae6-46cc-bcb8-bbd5be1b478d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1229197917-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5ba3ebf47bd4b999e68c74a5c0ab060", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2af7fce-74", "ovs_interfaceid": "e2af7fce-7442-48b4-8611-da3171b0672b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:47:47 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-1b55e45b-77b5-4f89-bd0c-1730703bfb63 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c0:c8:a6,bridge_name='br-int',has_traffic_filtering=True,id=e2af7fce-7442-48b4-8611-da3171b0672b,network=Network(ff73f5c3-bae6-46cc-bcb8-bbd5be1b478d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2af7fce-74') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:47:47 user nova-compute[73449]: DEBUG os_vif [None req-1b55e45b-77b5-4f89-bd0c-1730703bfb63 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c0:c8:a6,bridge_name='br-int',has_traffic_filtering=True,id=e2af7fce-7442-48b4-8611-da3171b0672b,network=Network(ff73f5c3-bae6-46cc-bcb8-bbd5be1b478d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2af7fce-74') {{(pid=73449) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 11:47:47 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:47:47 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:47:47 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 11:47:47 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:47:47 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape2af7fce-74, may_exist=True, interface_attrs={}) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:47:47 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape2af7fce-74, col_values=(('external_ids', {'iface-id': 'e2af7fce-7442-48b4-8611-da3171b0672b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c0:c8:a6', 'vm-uuid': 'de5084e1-5a5e-48d2-a3ef-7f29898d1d2d'}),), if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:47:47 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:47:47 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:47:47 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:47:47 user nova-compute[73449]: INFO os_vif [None req-1b55e45b-77b5-4f89-bd0c-1730703bfb63 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c0:c8:a6,bridge_name='br-int',has_traffic_filtering=True,id=e2af7fce-7442-48b4-8611-da3171b0672b,network=Network(ff73f5c3-bae6-46cc-bcb8-bbd5be1b478d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2af7fce-74')
Aug 17 11:47:47 user nova-compute[73449]: DEBUG nova.compute.manager [req-3723d57a-e564-4d57-b6d5-ac0fba914c1b req-058f66b8-0563-41bf-a9e1-ae5d9411324e service nova] [instance: ae75d334-431a-4008-8b3d-f2a727d92417] Received event network-vif-plugged-0cd51063-e3d9-44a8-a1cd-b89bb41a4438 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:47:47 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-3723d57a-e564-4d57-b6d5-ac0fba914c1b req-058f66b8-0563-41bf-a9e1-ae5d9411324e service nova] Acquiring lock "ae75d334-431a-4008-8b3d-f2a727d92417-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:47:47 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-3723d57a-e564-4d57-b6d5-ac0fba914c1b req-058f66b8-0563-41bf-a9e1-ae5d9411324e service nova] Lock "ae75d334-431a-4008-8b3d-f2a727d92417-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:47:47 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-3723d57a-e564-4d57-b6d5-ac0fba914c1b req-058f66b8-0563-41bf-a9e1-ae5d9411324e service nova] Lock "ae75d334-431a-4008-8b3d-f2a727d92417-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:47:47 user nova-compute[73449]: DEBUG nova.compute.manager [req-3723d57a-e564-4d57-b6d5-ac0fba914c1b req-058f66b8-0563-41bf-a9e1-ae5d9411324e service nova] [instance: ae75d334-431a-4008-8b3d-f2a727d92417] No waiting events found dispatching network-vif-plugged-0cd51063-e3d9-44a8-a1cd-b89bb41a4438 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:47:47 user nova-compute[73449]: WARNING nova.compute.manager [req-3723d57a-e564-4d57-b6d5-ac0fba914c1b req-058f66b8-0563-41bf-a9e1-ae5d9411324e service nova] [instance: ae75d334-431a-4008-8b3d-f2a727d92417] Received unexpected event network-vif-plugged-0cd51063-e3d9-44a8-a1cd-b89bb41a4438 for instance with vm_state active and task_state rescuing.
Aug 17 11:47:47 user nova-compute[73449]: DEBUG nova.compute.manager [req-3723d57a-e564-4d57-b6d5-ac0fba914c1b req-058f66b8-0563-41bf-a9e1-ae5d9411324e service nova] [instance: ae75d334-431a-4008-8b3d-f2a727d92417] Received event network-vif-plugged-0cd51063-e3d9-44a8-a1cd-b89bb41a4438 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:47:47 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-3723d57a-e564-4d57-b6d5-ac0fba914c1b req-058f66b8-0563-41bf-a9e1-ae5d9411324e service nova] Acquiring lock "ae75d334-431a-4008-8b3d-f2a727d92417-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:47:47 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-3723d57a-e564-4d57-b6d5-ac0fba914c1b req-058f66b8-0563-41bf-a9e1-ae5d9411324e service nova] Lock "ae75d334-431a-4008-8b3d-f2a727d92417-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:47:47 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-3723d57a-e564-4d57-b6d5-ac0fba914c1b req-058f66b8-0563-41bf-a9e1-ae5d9411324e service nova] Lock "ae75d334-431a-4008-8b3d-f2a727d92417-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:47:47 user nova-compute[73449]: DEBUG nova.compute.manager [req-3723d57a-e564-4d57-b6d5-ac0fba914c1b req-058f66b8-0563-41bf-a9e1-ae5d9411324e service nova] [instance: ae75d334-431a-4008-8b3d-f2a727d92417] No waiting events found dispatching network-vif-plugged-0cd51063-e3d9-44a8-a1cd-b89bb41a4438 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:47:47 user nova-compute[73449]: WARNING nova.compute.manager [req-3723d57a-e564-4d57-b6d5-ac0fba914c1b req-058f66b8-0563-41bf-a9e1-ae5d9411324e service nova] [instance: ae75d334-431a-4008-8b3d-f2a727d92417] Received unexpected event network-vif-plugged-0cd51063-e3d9-44a8-a1cd-b89bb41a4438 for instance with vm_state active and task_state rescuing.
Aug 17 11:47:47 user nova-compute[73449]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692272852.917289, c69e7643-8c60-4982-986b-484e8cfc3fa9 => Stopped> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:47:47 user nova-compute[73449]: INFO nova.compute.manager [-] [instance: c69e7643-8c60-4982-986b-484e8cfc3fa9] VM Stopped (Lifecycle Event)
Aug 17 11:47:47 user nova-compute[73449]: DEBUG nova.compute.manager [None req-ddadfcc2-b44e-4b23-8f19-1b1976af7556 None None] [instance: c69e7643-8c60-4982-986b-484e8cfc3fa9] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:47:47 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:47:48 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Removed pending event for ae75d334-431a-4008-8b3d-f2a727d92417 due to event {{(pid=73449) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 17 11:47:48 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692272868.62215, ae75d334-431a-4008-8b3d-f2a727d92417 => Resumed> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:47:48 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: ae75d334-431a-4008-8b3d-f2a727d92417] VM Resumed (Lifecycle Event)
Aug 17 11:47:48 user nova-compute[73449]: DEBUG nova.compute.manager [None req-57884099-5454-411a-a430-232370889293 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: ae75d334-431a-4008-8b3d-f2a727d92417] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:47:48 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: ae75d334-431a-4008-8b3d-f2a727d92417] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:47:48 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:47:48 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: ae75d334-431a-4008-8b3d-f2a727d92417] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 11:47:48 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:47:48 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:47:48 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: ae75d334-431a-4008-8b3d-f2a727d92417] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 17 11:47:48 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692272868.6227298, ae75d334-431a-4008-8b3d-f2a727d92417 => Started> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:47:48 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: ae75d334-431a-4008-8b3d-f2a727d92417] VM Started (Lifecycle Event)
Aug 17 11:47:48 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: ae75d334-431a-4008-8b3d-f2a727d92417] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:47:48 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: ae75d334-431a-4008-8b3d-f2a727d92417] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 11:47:48 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:47:48 user nova-compute[73449]: DEBUG nova.compute.manager [req-a4a9f348-d554-496e-9829-b8faab527d2c req-8fd00c18-deff-4b34-bcf0-21b93de83340 service nova] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] Received event network-vif-plugged-e2af7fce-7442-48b4-8611-da3171b0672b {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:47:48 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-a4a9f348-d554-496e-9829-b8faab527d2c req-8fd00c18-deff-4b34-bcf0-21b93de83340 service nova] Acquiring lock "de5084e1-5a5e-48d2-a3ef-7f29898d1d2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:47:48 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-a4a9f348-d554-496e-9829-b8faab527d2c req-8fd00c18-deff-4b34-bcf0-21b93de83340 service nova] Lock "de5084e1-5a5e-48d2-a3ef-7f29898d1d2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:47:48 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-a4a9f348-d554-496e-9829-b8faab527d2c req-8fd00c18-deff-4b34-bcf0-21b93de83340 service nova] Lock "de5084e1-5a5e-48d2-a3ef-7f29898d1d2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:47:48 user nova-compute[73449]: DEBUG nova.compute.manager [req-a4a9f348-d554-496e-9829-b8faab527d2c req-8fd00c18-deff-4b34-bcf0-21b93de83340 service nova] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] No waiting events found dispatching network-vif-plugged-e2af7fce-7442-48b4-8611-da3171b0672b {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:47:48 user nova-compute[73449]: WARNING nova.compute.manager [req-a4a9f348-d554-496e-9829-b8faab527d2c req-8fd00c18-deff-4b34-bcf0-21b93de83340 service nova] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] Received unexpected event network-vif-plugged-e2af7fce-7442-48b4-8611-da3171b0672b for instance with vm_state active and task_state reboot_started_hard.
Aug 17 11:47:48 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:47:48 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:47:49 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:47:49 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:47:49 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:47:49 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:47:49 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:47:49 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:47:50 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:47:51 user nova-compute[73449]: DEBUG nova.compute.manager [req-120011a4-7312-4a8c-9f5a-8552cfd763e2 req-2cd930cb-370a-41d7-9286-bbc5710ec2e8 service nova] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] Received event network-vif-plugged-e2af7fce-7442-48b4-8611-da3171b0672b {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:47:51 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-120011a4-7312-4a8c-9f5a-8552cfd763e2 req-2cd930cb-370a-41d7-9286-bbc5710ec2e8 service nova] Acquiring lock "de5084e1-5a5e-48d2-a3ef-7f29898d1d2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:47:51 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-120011a4-7312-4a8c-9f5a-8552cfd763e2 req-2cd930cb-370a-41d7-9286-bbc5710ec2e8 service nova] Lock "de5084e1-5a5e-48d2-a3ef-7f29898d1d2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:47:51 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-120011a4-7312-4a8c-9f5a-8552cfd763e2 req-2cd930cb-370a-41d7-9286-bbc5710ec2e8 service nova] Lock "de5084e1-5a5e-48d2-a3ef-7f29898d1d2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:47:51 user nova-compute[73449]: DEBUG nova.compute.manager [req-120011a4-7312-4a8c-9f5a-8552cfd763e2 req-2cd930cb-370a-41d7-9286-bbc5710ec2e8 service nova] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] No waiting events found dispatching network-vif-plugged-e2af7fce-7442-48b4-8611-da3171b0672b {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:47:51 user nova-compute[73449]: WARNING nova.compute.manager [req-120011a4-7312-4a8c-9f5a-8552cfd763e2 req-2cd930cb-370a-41d7-9286-bbc5710ec2e8 service nova] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] Received unexpected event network-vif-plugged-e2af7fce-7442-48b4-8611-da3171b0672b for instance with vm_state active and task_state reboot_started_hard.
Aug 17 11:47:51 user nova-compute[73449]: DEBUG nova.compute.manager [req-778a19da-b08b-497e-b7ae-1557b224a7e6 req-bdf01848-11d3-4c80-8b2a-ec75da2274f4 service nova] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] Received event volume-reimaged-71f6919a-6a55-4d8f-ae84-7bb40d59f4ed {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:47:51 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-778a19da-b08b-497e-b7ae-1557b224a7e6 req-bdf01848-11d3-4c80-8b2a-ec75da2274f4 service nova] Acquiring lock "e8e7d9aa-150f-424a-b3af-be149ee421c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:47:51 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-778a19da-b08b-497e-b7ae-1557b224a7e6 req-bdf01848-11d3-4c80-8b2a-ec75da2274f4 service nova] Lock "e8e7d9aa-150f-424a-b3af-be149ee421c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:47:51 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-778a19da-b08b-497e-b7ae-1557b224a7e6 req-bdf01848-11d3-4c80-8b2a-ec75da2274f4 service nova] Lock "e8e7d9aa-150f-424a-b3af-be149ee421c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:47:51 user nova-compute[73449]: DEBUG nova.compute.manager [req-778a19da-b08b-497e-b7ae-1557b224a7e6 req-bdf01848-11d3-4c80-8b2a-ec75da2274f4 service nova] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] Processing event volume-reimaged-71f6919a-6a55-4d8f-ae84-7bb40d59f4ed {{(pid=73449) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10792}}
Aug 17 11:47:51 user nova-compute[73449]: DEBUG nova.compute.manager [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] Instance event wait completed in 22 seconds for volume-reimaged {{(pid=73449) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 11:47:51 user nova-compute[73449]: INFO nova.virt.block_device [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] Booting with volume 71f6919a-6a55-4d8f-ae84-7bb40d59f4ed at /dev/vda
Aug 17 11:47:51 user nova-compute[73449]: DEBUG os_brick.utils [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 11:47:51 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Removed pending event for de5084e1-5a5e-48d2-a3ef-7f29898d1d2d due to event {{(pid=73449) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 17 11:47:51 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692272871.2558632, de5084e1-5a5e-48d2-a3ef-7f29898d1d2d => Resumed> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:47:51 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] VM Resumed (Lifecycle Event)
Aug 17 11:47:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:47:51 user nova-compute[73449]: DEBUG nova.compute.manager [None req-1b55e45b-77b5-4f89-bd0c-1730703bfb63 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] Instance event wait completed in 0 seconds for  {{(pid=73449) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 11:47:51 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] Instance rebooted successfully.
Aug 17 11:47:51 user nova-compute[73449]: DEBUG nova.compute.manager [None req-1b55e45b-77b5-4f89-bd0c-1730703bfb63 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:47:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:47:51 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[80716133-d5fd-444e-93ee-a9cc56f47d4c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4d3924302012\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:47:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:47:51 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:47:51 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 11:47:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:47:51 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[814c922d-66b4-4ac5-8f62-558556cd3a7b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:47:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:47:51 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Aug 17 11:47:51 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692272871.2570372, de5084e1-5a5e-48d2-a3ef-7f29898d1d2d => Started> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:47:51 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] VM Started (Lifecycle Event)
Aug 17 11:47:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.030s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:47:51 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f588bbd-f162-469f-8de7-75a152d560f0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:47:51 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[640447a5-d025-43d8-9423-c115212ffa32]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:47:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Running cmd (subprocess): nvme version {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:47:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] 'nvme version' failed. Not Retrying. {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 11:47:51 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.nvmeof [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] nvme not present on system {{(pid=73449) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 11:47:51 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:47:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:47:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 11:47:51 user nova-compute[73449]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 11:47:51 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[4879563e-c7ca-4ab5-af37-93a84de896c8]: (4, '') {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:47:51 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-1b55e45b-77b5-4f89-bd0c-1730703bfb63 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Lock "de5084e1-5a5e-48d2-a3ef-7f29898d1d2d" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.424s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:47:51 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73449) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 11:47:51 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73449) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 11:47:51 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] LIGHTOS: no hostnqn found. {{(pid=73449) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 11:47:51 user nova-compute[73449]: DEBUG os_brick.utils [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] <== get_connector_properties: return (183ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4d3924302012', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 11:47:51 user nova-compute[73449]: DEBUG nova.virt.block_device [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] Updating existing volume attachment record: 937621ea-422d-4fe2-be3d-9fcdc8e5f41e {{(pid=73449) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 11:47:51 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 11:47:51 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:47:51 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73449) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 11:47:52 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:47:52 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:47:54 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:47:54 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Starting heal instance info cache {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 11:47:55 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "refresh_cache-f35b7f2b-2f88-4b09-86ac-cb5a78a94584" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:47:55 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquired lock "refresh_cache-f35b7f2b-2f88-4b09-86ac-cb5a78a94584" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:47:55 user nova-compute[73449]: DEBUG nova.network.neutron [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] Forcefully refreshing network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 11:47:55 user nova-compute[73449]: DEBUG nova.network.neutron [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] Updating instance_info_cache with network_info: [{"id": "e86f2a61-e64f-49ea-83ad-386755b33e00", "address": "fa:16:3e:4e:54:ff", "network": {"id": "72c50a42-688f-4868-8e19-c40b103a49cd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1792423641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "068c5270255744a18208a0ad9b35f168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape86f2a61-e6", "ovs_interfaceid": "e86f2a61-e64f-49ea-83ad-386755b33e00", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:47:55 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Releasing lock "refresh_cache-f35b7f2b-2f88-4b09-86ac-cb5a78a94584" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:47:55 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] Updated the network info_cache for instance {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 11:47:55 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:47:55 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:47:55 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:47:55 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:47:55 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=73449) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 11:47:56 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a9e8ad2-19db-4975-87e4-2efce603a7d7/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:47:56 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a9e8ad2-19db-4975-87e4-2efce603a7d7/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:47:56 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a9e8ad2-19db-4975-87e4-2efce603a7d7/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:47:56 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a9e8ad2-19db-4975-87e4-2efce603a7d7/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:47:56 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk.rescue --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:47:56 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk.rescue --force-share --output=json" returned: 0 in 0.251s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:47:56 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk.rescue --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:47:57 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:47:57 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:47:57 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:47:57 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:47:57 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:47:57 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:47:57 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de5084e1-5a5e-48d2-a3ef-7f29898d1d2d/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:47:57 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de5084e1-5a5e-48d2-a3ef-7f29898d1d2d/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:47:57 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de5084e1-5a5e-48d2-a3ef-7f29898d1d2d/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:47:57 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de5084e1-5a5e-48d2-a3ef-7f29898d1d2d/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:47:57 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73449) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 11:47:57 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73449) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 11:47:57 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d74c8f6-fb4e-4460-b722-674a8a1e2d25/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:47:57 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:47:58 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d74c8f6-fb4e-4460-b722-674a8a1e2d25/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:47:58 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d74c8f6-fb4e-4460-b722-674a8a1e2d25/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:47:58 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d74c8f6-fb4e-4460-b722-674a8a1e2d25/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:47:58 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f35b7f2b-2f88-4b09-86ac-cb5a78a94584/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:47:58 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f35b7f2b-2f88-4b09-86ac-cb5a78a94584/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:47:58 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f35b7f2b-2f88-4b09-86ac-cb5a78a94584/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:47:58 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f35b7f2b-2f88-4b09-86ac-cb5a78a94584/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:47:58 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73449) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 11:47:58 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d468854-6182-49c8-acb7-0641df2d5219/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:47:58 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d468854-6182-49c8-acb7-0641df2d5219/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:47:58 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d468854-6182-49c8-acb7-0641df2d5219/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:47:59 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d468854-6182-49c8-acb7-0641df2d5219/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:47:59 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5836f8c-079b-4437-ab51-6878f0a4a7f8/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:47:59 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5836f8c-079b-4437-ab51-6878f0a4a7f8/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:47:59 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5836f8c-079b-4437-ab51-6878f0a4a7f8/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:47:59 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5836f8c-079b-4437-ab51-6878f0a4a7f8/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:48:00 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:48:00 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:48:00 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Hypervisor/Node resource view: name=user free_ram=7306MB free_disk=25.338817596435547GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73449) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 11:48:00 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:48:00 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:48:00 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 4a9e8ad2-19db-4975-87e4-2efce603a7d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:48:00 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance f35b7f2b-2f88-4b09-86ac-cb5a78a94584 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:48:00 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance de5084e1-5a5e-48d2-a3ef-7f29898d1d2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:48:00 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance e8e7d9aa-150f-424a-b3af-be149ee421c3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:48:00 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 3d74c8f6-fb4e-4460-b722-674a8a1e2d25 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:48:00 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance ae75d334-431a-4008-8b3d-f2a727d92417 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:48:00 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 3d468854-6182-49c8-acb7-0641df2d5219 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:48:00 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 5612f7d1-a901-4bdd-a24a-faf9a980cd04 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:48:00 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance a5836f8c-079b-4437-ab51-6878f0a4a7f8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:48:00 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73449) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 11:48:00 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73449) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 11:48:00 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 11:48:00 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 11:48:00 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Compute_service record updated for user:user {{(pid=73449) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 11:48:00 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.591s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:48:01 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:48:02 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:48:03 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] Creating instance directory {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 11:48:03 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] Creating image(s)
Aug 17 11:48:03 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] Did not create local disks {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 11:48:03 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] Ensure instance console log exists: /opt/stack/data/nova/instances/e8e7d9aa-150f-424a-b3af-be149ee421c3/console.log {{(pid=73449) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 11:48:03 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:48:03 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:48:03 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:48:03 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] Start _get_guest_xml network_info=[{"id": "460de6e4-4651-4b83-93bd-fbb5db34bcfa", "address": "fa:16:3e:59:e7:ee", "network": {"id": "d4fc5f62-8de4-4df1-9e12-0f192a793f5f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1016129651-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a0323f43b04829a3b1e81266986cbf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap460de6e4-46", "ovs_interfaceid": "460de6e4-4651-4b83-93bd-fbb5db34bcfa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T11:36:11Z,direct_url=<?>,disk_format='qcow2',id=0a2904ae-083d-41c8-83db-343132b36148,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7a77880136a54ef195c82e018e1939db',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T11:36:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'attachment_id': '937621ea-422d-4fe2-be3d-9fcdc8e5f41e', 'boot_index': 0, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XGrhlpAM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e8e7d9aa-150f-424a-b3af-be149ee421c3', 'attached_at': '', 'detached_at': '', 'volume_id': '71f6919a-6a55-4d8f-ae84-7bb40d59f4ed', 'serial': '71f6919a-6a55-4d8f-ae84-7bb40d59f4ed'}, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 11:48:03 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 17 11:48:03 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 17 11:48:03 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 11:48:03 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] CPU controller missing on host. {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 11:48:03 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 11:48:03 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] CPU controller found on host. {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 11:48:03 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73449) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 11:48:03 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T11:35:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T11:36:11Z,direct_url=<?>,disk_format='qcow2',id=0a2904ae-083d-41c8-83db-343132b36148,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7a77880136a54ef195c82e018e1939db',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T11:36:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 11:48:03 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Flavor limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 11:48:03 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Image limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 11:48:03 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Flavor pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 11:48:03 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Image pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 11:48:03 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 11:48:03 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 11:48:03 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 11:48:03 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Got 1 possible topologies {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 11:48:03 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 11:48:03 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 11:48:03 user nova-compute[73449]: DEBUG nova.objects.instance [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Lazy-loading 'vcpu_model' on Instance uuid e8e7d9aa-150f-424a-b3af-be149ee421c3 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:48:03 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] Calling os-brick to attach iSCSI Volume {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 11:48:03 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XGrhlpAM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 11:48:03 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 17 11:48:03 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:48:03 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:48:03 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 17 11:48:03 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:48:03 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:48:03 user nova-compute[73449]: INFO os_brick.initiator.connectors.iscsi [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 11:48:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed -p 172.16.0.220:3260 {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:48:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:48:03 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[4299194c-f49f-4089-ba0a-10707d06a5a9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:48:03 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 11:48:03 user nova-compute[73449]:  {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:48:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed -p 172.16.0.220:3260 --interface default --op new {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:48:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:48:03 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[72ce04ef-c205-42fd-9bed-e4ee991aa554]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed] added\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:48:03 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed] added
Aug 17 11:48:03 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:48:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:48:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:48:03 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[19513697-83a9-495e-a3c6-d894667d45d5]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:48:03 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:48:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:48:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:48:03 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fe16801-2225-4205-aeae-9c2731e7aa0e]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:48:03 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:48:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XGrhlpAM {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:48:04 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XGrhlpAM" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:48:04 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[4655417e-e873-4865-996a-afd229a37e04]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:48:04 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XGrhlpAM'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:48:04 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:48:04 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:48:04 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[e893c6a6-3c07-48d0-be7e-b342f8cecb93]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:48:04 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:48:04 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:48:04 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:48:04 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[c370a5c8-d426-438d-a727-f4b2ec323b63]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:48:04 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466 (non-flash)
Aug 17 11:48:04 user nova-compute[73449]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611 (non-flash)
Aug 17 11:48:04 user nova-compute[73449]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c (non-flash)
Aug 17 11:48:04 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:48:04 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466 (non-flash)
Aug 17 11:48:04 user nova-compute[73449]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611 (non-flash)
Aug 17 11:48:04 user nova-compute[73449]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c (non-flash)
Aug 17 11:48:04 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:48:04 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed -p 172.16.0.220:3260 --login {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:48:04 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:48:04 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a3003de-2ac9-4432-a8bc-b84a8c8977d3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:48:04 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed, portal: 172.16.0.220,3260]
Aug 17 11:48:04 user nova-compute[73449]: Login to [iface: default, target: iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed, portal: 172.16.0.220,3260] successful.
Aug 17 11:48:04 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:48:04 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:48:04 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:48:04 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[478b2586-6a28-42fe-b2d1-66884d5a90f5]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:48:04 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:48:04 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:48:04 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:48:04 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a0497cc-2b3c-45f9-94ec-78b5f147d976]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:48:04 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466 (non-flash)
Aug 17 11:48:04 user nova-compute[73449]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611 (non-flash)
Aug 17 11:48:04 user nova-compute[73449]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c (non-flash)
Aug 17 11:48:04 user nova-compute[73449]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed (non-flash)
Aug 17 11:48:04 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:48:04 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466 (non-flash)
Aug 17 11:48:04 user nova-compute[73449]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611 (non-flash)
Aug 17 11:48:04 user nova-compute[73449]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c (non-flash)
Aug 17 11:48:04 user nova-compute[73449]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed (non-flash)
Aug 17 11:48:04 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:48:04 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.318s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:48:04 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Connected to 172.16.0.220:3260 {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 11:48:04 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] HCTL ('34', '-', '-', 0) found on session 25 with lun 0 {{(pid=73449) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 11:48:04 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73449) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 11:48:04 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:48:04 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.026s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:48:04 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7d16ad1-f46f-4bcf-8b76-3fe802540b99]: (4, ('- - 0', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:48:04 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Searching for a device in session 25 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73449) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 11:48:04 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XGrhlpAM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 11:48:05 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.363s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:48:05 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] <== connect_volume: return (1365ms) {'type': 'block', 'scsi_wwn': '23830653435646130', 'path': '/dev/sdc'} {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 11:48:05 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23830653435646130', 'path': '/dev/sdc'} {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 11:48:05 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T11:45:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-966756449',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1049115068',id=17,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP+u1MgbCgptDidYv18wcR/3nbMgBF04KyJdujQocUddcCZfAdpmYsBffqoFwPxl9btx5HmOLcrmmkZwWw4EsmmDOWNMZubobpCSM0EcykYa0gcYe9cSWHyIH4n+5UjBLw==',key_name='tempest-keypair-100521889',keypairs=<?>,launch_index=0,launched_at=2023-08-17T11:46:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e6a0323f43b04829a3b1e81266986cbf',ramdisk_id='',reservation_id='r-syt2v71c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1991725074',owner_user_name='tempest-ServerActionsV293TestJSON-1991725074-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T11:47:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cae6f48da3304f37a5d5010f3cbd7698',uuid=e8e7d9aa-150f-424a-b3af-be149ee421c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "460de6e4-4651-4b83-93bd-fbb5db34bcfa", "address": "fa:16:3e:59:e7:ee", "network": {"id": "d4fc5f62-8de4-4df1-9e12-0f192a793f5f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1016129651-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a0323f43b04829a3b1e81266986cbf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap460de6e4-46", "ovs_interfaceid": "460de6e4-4651-4b83-93bd-fbb5db34bcfa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73449) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 11:48:05 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Converting VIF {"id": "460de6e4-4651-4b83-93bd-fbb5db34bcfa", "address": "fa:16:3e:59:e7:ee", "network": {"id": "d4fc5f62-8de4-4df1-9e12-0f192a793f5f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1016129651-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a0323f43b04829a3b1e81266986cbf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap460de6e4-46", "ovs_interfaceid": "460de6e4-4651-4b83-93bd-fbb5db34bcfa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:48:05 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:59:e7:ee,bridge_name='br-int',has_traffic_filtering=True,id=460de6e4-4651-4b83-93bd-fbb5db34bcfa,network=Network(d4fc5f62-8de4-4df1-9e12-0f192a793f5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap460de6e4-46') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:48:05 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] End _get_guest_xml xml=<domain type="kvm">
Aug 17 11:48:05 user nova-compute[73449]:   <uuid>e8e7d9aa-150f-424a-b3af-be149ee421c3</uuid>
Aug 17 11:48:05 user nova-compute[73449]:   <name>instance-00000011</name>
Aug 17 11:48:05 user nova-compute[73449]:   <memory>524288</memory>
Aug 17 11:48:05 user nova-compute[73449]:   <vcpu>1</vcpu>
Aug 17 11:48:05 user nova-compute[73449]:   <metadata>
Aug 17 11:48:05 user nova-compute[73449]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 11:48:05 user nova-compute[73449]:       <nova:package version="0.0.0"/>
Aug 17 11:48:05 user nova-compute[73449]:       <nova:name>tempest-ServerActionsV293TestJSON-server-966756449</nova:name>
Aug 17 11:48:05 user nova-compute[73449]:       <nova:creationTime>2023-08-17 11:48:03</nova:creationTime>
Aug 17 11:48:05 user nova-compute[73449]:       <nova:flavor name="m1.tiny">
Aug 17 11:48:05 user nova-compute[73449]:         <nova:memory>512</nova:memory>
Aug 17 11:48:05 user nova-compute[73449]:         <nova:disk>1</nova:disk>
Aug 17 11:48:05 user nova-compute[73449]:         <nova:swap>0</nova:swap>
Aug 17 11:48:05 user nova-compute[73449]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 11:48:05 user nova-compute[73449]:         <nova:vcpus>1</nova:vcpus>
Aug 17 11:48:05 user nova-compute[73449]:       </nova:flavor>
Aug 17 11:48:05 user nova-compute[73449]:       <nova:owner>
Aug 17 11:48:05 user nova-compute[73449]:         <nova:user uuid="cae6f48da3304f37a5d5010f3cbd7698">tempest-ServerActionsV293TestJSON-1991725074-project-member</nova:user>
Aug 17 11:48:05 user nova-compute[73449]:         <nova:project uuid="e6a0323f43b04829a3b1e81266986cbf">tempest-ServerActionsV293TestJSON-1991725074</nova:project>
Aug 17 11:48:05 user nova-compute[73449]:       </nova:owner>
Aug 17 11:48:05 user nova-compute[73449]:       <nova:ports>
Aug 17 11:48:05 user nova-compute[73449]:         <nova:port uuid="460de6e4-4651-4b83-93bd-fbb5db34bcfa">
Aug 17 11:48:05 user nova-compute[73449]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 17 11:48:05 user nova-compute[73449]:         </nova:port>
Aug 17 11:48:05 user nova-compute[73449]:       </nova:ports>
Aug 17 11:48:05 user nova-compute[73449]:     </nova:instance>
Aug 17 11:48:05 user nova-compute[73449]:   </metadata>
Aug 17 11:48:05 user nova-compute[73449]:   <sysinfo type="smbios">
Aug 17 11:48:05 user nova-compute[73449]:     <system>
Aug 17 11:48:05 user nova-compute[73449]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 11:48:05 user nova-compute[73449]:       <entry name="product">OpenStack Nova</entry>
Aug 17 11:48:05 user nova-compute[73449]:       <entry name="version">0.0.0</entry>
Aug 17 11:48:05 user nova-compute[73449]:       <entry name="serial">e8e7d9aa-150f-424a-b3af-be149ee421c3</entry>
Aug 17 11:48:05 user nova-compute[73449]:       <entry name="uuid">e8e7d9aa-150f-424a-b3af-be149ee421c3</entry>
Aug 17 11:48:05 user nova-compute[73449]:       <entry name="family">Virtual Machine</entry>
Aug 17 11:48:05 user nova-compute[73449]:     </system>
Aug 17 11:48:05 user nova-compute[73449]:   </sysinfo>
Aug 17 11:48:05 user nova-compute[73449]:   <os>
Aug 17 11:48:05 user nova-compute[73449]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 11:48:05 user nova-compute[73449]:     <boot dev="hd"/>
Aug 17 11:48:05 user nova-compute[73449]:     <smbios mode="sysinfo"/>
Aug 17 11:48:05 user nova-compute[73449]:   </os>
Aug 17 11:48:05 user nova-compute[73449]:   <features>
Aug 17 11:48:05 user nova-compute[73449]:     <acpi/>
Aug 17 11:48:05 user nova-compute[73449]:     <apic/>
Aug 17 11:48:05 user nova-compute[73449]:     <vmcoreinfo/>
Aug 17 11:48:05 user nova-compute[73449]:   </features>
Aug 17 11:48:05 user nova-compute[73449]:   <clock offset="utc">
Aug 17 11:48:05 user nova-compute[73449]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 11:48:05 user nova-compute[73449]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 11:48:05 user nova-compute[73449]:     <timer name="hpet" present="no"/>
Aug 17 11:48:05 user nova-compute[73449]:   </clock>
Aug 17 11:48:05 user nova-compute[73449]:   <cpu mode="custom" match="exact">
Aug 17 11:48:05 user nova-compute[73449]:     <model>Nehalem</model>
Aug 17 11:48:05 user nova-compute[73449]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 11:48:05 user nova-compute[73449]:   </cpu>
Aug 17 11:48:05 user nova-compute[73449]:   <devices>
Aug 17 11:48:05 user nova-compute[73449]:     <disk type="block" device="disk">
Aug 17 11:48:05 user nova-compute[73449]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 11:48:05 user nova-compute[73449]:       <source dev="/dev/sdc"/>
Aug 17 11:48:05 user nova-compute[73449]:       <target dev="vda" bus="virtio"/>
Aug 17 11:48:05 user nova-compute[73449]:       <serial>71f6919a-6a55-4d8f-ae84-7bb40d59f4ed</serial>
Aug 17 11:48:05 user nova-compute[73449]:     </disk>
Aug 17 11:48:05 user nova-compute[73449]:     <interface type="ethernet">
Aug 17 11:48:05 user nova-compute[73449]:       <mac address="fa:16:3e:59:e7:ee"/>
Aug 17 11:48:05 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 11:48:05 user nova-compute[73449]:       <mtu size="1442"/>
Aug 17 11:48:05 user nova-compute[73449]:       <target dev="tap460de6e4-46"/>
Aug 17 11:48:05 user nova-compute[73449]:     </interface>
Aug 17 11:48:05 user nova-compute[73449]:     <serial type="pty">
Aug 17 11:48:05 user nova-compute[73449]:       <log file="/opt/stack/data/nova/instances/e8e7d9aa-150f-424a-b3af-be149ee421c3/console.log" append="off"/>
Aug 17 11:48:05 user nova-compute[73449]:     </serial>
Aug 17 11:48:05 user nova-compute[73449]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 11:48:05 user nova-compute[73449]:     <video>
Aug 17 11:48:05 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 11:48:05 user nova-compute[73449]:     </video>
Aug 17 11:48:05 user nova-compute[73449]:     <rng model="virtio">
Aug 17 11:48:05 user nova-compute[73449]:       <backend model="random">/dev/urandom</backend>
Aug 17 11:48:05 user nova-compute[73449]:     </rng>
Aug 17 11:48:05 user nova-compute[73449]:     <controller type="usb" index="0" model="none"/>
Aug 17 11:48:05 user nova-compute[73449]:     <memballoon model="virtio">
Aug 17 11:48:05 user nova-compute[73449]:       <stats period="10"/>
Aug 17 11:48:05 user nova-compute[73449]:     </memballoon>
Aug 17 11:48:05 user nova-compute[73449]:   </devices>
Aug 17 11:48:05 user nova-compute[73449]: </domain>
Aug 17 11:48:05 user nova-compute[73449]:  {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 11:48:05 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T11:45:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-966756449',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1049115068',id=17,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP+u1MgbCgptDidYv18wcR/3nbMgBF04KyJdujQocUddcCZfAdpmYsBffqoFwPxl9btx5HmOLcrmmkZwWw4EsmmDOWNMZubobpCSM0EcykYa0gcYe9cSWHyIH4n+5UjBLw==',key_name='tempest-keypair-100521889',keypairs=<?>,launch_index=0,launched_at=2023-08-17T11:46:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e6a0323f43b04829a3b1e81266986cbf',ramdisk_id='',reservation_id='r-syt2v71c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1991725074',owner_user_name='tempest-ServerActionsV293TestJSON-1991725074-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T11:47:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cae6f48da3304f37a5d5010f3cbd7698',uuid=e8e7d9aa-150f-424a-b3af-be149ee421c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "460de6e4-4651-4b83-93bd-fbb5db34bcfa", "address": "fa:16:3e:59:e7:ee", "network": {"id": "d4fc5f62-8de4-4df1-9e12-0f192a793f5f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1016129651-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a0323f43b04829a3b1e81266986cbf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap460de6e4-46", "ovs_interfaceid": "460de6e4-4651-4b83-93bd-fbb5db34bcfa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 11:48:05 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Converting VIF {"id": "460de6e4-4651-4b83-93bd-fbb5db34bcfa", "address": "fa:16:3e:59:e7:ee", "network": {"id": "d4fc5f62-8de4-4df1-9e12-0f192a793f5f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1016129651-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a0323f43b04829a3b1e81266986cbf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap460de6e4-46", "ovs_interfaceid": "460de6e4-4651-4b83-93bd-fbb5db34bcfa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:48:05 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:59:e7:ee,bridge_name='br-int',has_traffic_filtering=True,id=460de6e4-4651-4b83-93bd-fbb5db34bcfa,network=Network(d4fc5f62-8de4-4df1-9e12-0f192a793f5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap460de6e4-46') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:48:05 user nova-compute[73449]: DEBUG os_vif [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:e7:ee,bridge_name='br-int',has_traffic_filtering=True,id=460de6e4-4651-4b83-93bd-fbb5db34bcfa,network=Network(d4fc5f62-8de4-4df1-9e12-0f192a793f5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap460de6e4-46') {{(pid=73449) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 11:48:05 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:48:05 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:48:05 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 11:48:05 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:48:05 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap460de6e4-46, may_exist=True, interface_attrs={}) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:48:05 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap460de6e4-46, col_values=(('external_ids', {'iface-id': '460de6e4-4651-4b83-93bd-fbb5db34bcfa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:59:e7:ee', 'vm-uuid': 'e8e7d9aa-150f-424a-b3af-be149ee421c3'}),), if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:48:05 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:48:05 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:48:05 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:48:05 user nova-compute[73449]: INFO os_vif [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:e7:ee,bridge_name='br-int',has_traffic_filtering=True,id=460de6e4-4651-4b83-93bd-fbb5db34bcfa,network=Network(d4fc5f62-8de4-4df1-9e12-0f192a793f5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap460de6e4-46')
Aug 17 11:48:05 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] No BDM found with device name vda, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 11:48:05 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] No VIF found with MAC fa:16:3e:59:e7:ee, not building metadata {{(pid=73449) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 11:48:06 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:48:06 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:48:06 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:48:06 user nova-compute[73449]: DEBUG nova.compute.manager [req-0c51fe42-bd9a-4d38-8c30-5ffd9e25eca2 req-f1c80d31-655c-40dc-894f-bff2873df41a service nova] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] Received event network-vif-plugged-460de6e4-4651-4b83-93bd-fbb5db34bcfa {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:48:06 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-0c51fe42-bd9a-4d38-8c30-5ffd9e25eca2 req-f1c80d31-655c-40dc-894f-bff2873df41a service nova] Acquiring lock "e8e7d9aa-150f-424a-b3af-be149ee421c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:48:06 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-0c51fe42-bd9a-4d38-8c30-5ffd9e25eca2 req-f1c80d31-655c-40dc-894f-bff2873df41a service nova] Lock "e8e7d9aa-150f-424a-b3af-be149ee421c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:48:06 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-0c51fe42-bd9a-4d38-8c30-5ffd9e25eca2 req-f1c80d31-655c-40dc-894f-bff2873df41a service nova] Lock "e8e7d9aa-150f-424a-b3af-be149ee421c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:48:06 user nova-compute[73449]: DEBUG nova.compute.manager [req-0c51fe42-bd9a-4d38-8c30-5ffd9e25eca2 req-f1c80d31-655c-40dc-894f-bff2873df41a service nova] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] No waiting events found dispatching network-vif-plugged-460de6e4-4651-4b83-93bd-fbb5db34bcfa {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:48:06 user nova-compute[73449]: WARNING nova.compute.manager [req-0c51fe42-bd9a-4d38-8c30-5ffd9e25eca2 req-f1c80d31-655c-40dc-894f-bff2873df41a service nova] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] Received unexpected event network-vif-plugged-460de6e4-4651-4b83-93bd-fbb5db34bcfa for instance with vm_state active and task_state rebuild_spawning.
Aug 17 11:48:07 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:48:07 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:48:07 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:48:07 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:48:07 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:48:08 user nova-compute[73449]: DEBUG nova.compute.manager [req-01382c18-68c3-4c64-9de8-4000d5f0da61 req-ce338aaf-a49b-45ae-bf8e-c6baffd0227e service nova] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Received event network-changed-1ec58d7f-18a4-4ddb-a137-2b72c5221621 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:48:08 user nova-compute[73449]: DEBUG nova.compute.manager [req-01382c18-68c3-4c64-9de8-4000d5f0da61 req-ce338aaf-a49b-45ae-bf8e-c6baffd0227e service nova] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Refreshing instance network info cache due to event network-changed-1ec58d7f-18a4-4ddb-a137-2b72c5221621. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 11:48:08 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-01382c18-68c3-4c64-9de8-4000d5f0da61 req-ce338aaf-a49b-45ae-bf8e-c6baffd0227e service nova] Acquiring lock "refresh_cache-3d468854-6182-49c8-acb7-0641df2d5219" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:48:08 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-01382c18-68c3-4c64-9de8-4000d5f0da61 req-ce338aaf-a49b-45ae-bf8e-c6baffd0227e service nova] Acquired lock "refresh_cache-3d468854-6182-49c8-acb7-0641df2d5219" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:48:08 user nova-compute[73449]: DEBUG nova.network.neutron [req-01382c18-68c3-4c64-9de8-4000d5f0da61 req-ce338aaf-a49b-45ae-bf8e-c6baffd0227e service nova] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Refreshing network info cache for port 1ec58d7f-18a4-4ddb-a137-2b72c5221621 {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 11:48:08 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692272888.799683, e8e7d9aa-150f-424a-b3af-be149ee421c3 => Resumed> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:48:08 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] VM Resumed (Lifecycle Event)
Aug 17 11:48:08 user nova-compute[73449]: DEBUG nova.compute.manager [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] Instance event wait completed in 0 seconds for  {{(pid=73449) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 11:48:08 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] Guest created on hypervisor {{(pid=73449) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 11:48:08 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:48:08 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] Instance spawned successfully.
Aug 17 11:48:08 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 11:48:08 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 11:48:08 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] Found default for hw_cdrom_bus of ide {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:48:08 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] Found default for hw_disk_bus of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:48:08 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] Found default for hw_input_bus of None {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:48:08 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] Found default for hw_pointer_model of None {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:48:08 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] Found default for hw_video_model of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:48:08 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] Found default for hw_vif_model of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:48:08 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 17 11:48:08 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692272888.8048968, e8e7d9aa-150f-424a-b3af-be149ee421c3 => Started> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:48:08 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] VM Started (Lifecycle Event)
Aug 17 11:48:08 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:48:08 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 11:48:08 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 17 11:48:08 user nova-compute[73449]: DEBUG nova.compute.manager [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:48:09 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:48:09 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:48:09 user nova-compute[73449]: DEBUG nova.objects.instance [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] Trying to apply a migration context that does not seem to be set for this instance {{(pid=73449) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 17 11:48:09 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-778a19da-b08b-497e-b7ae-1557b224a7e6 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.076s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:48:09 user nova-compute[73449]: DEBUG nova.compute.manager [req-cbd7ad88-34a4-4485-9447-d015c99ad8ca req-1038d0c4-548c-42b9-b43d-c5902a29bcc6 service nova] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] Received event network-vif-plugged-460de6e4-4651-4b83-93bd-fbb5db34bcfa {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:48:09 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-cbd7ad88-34a4-4485-9447-d015c99ad8ca req-1038d0c4-548c-42b9-b43d-c5902a29bcc6 service nova] Acquiring lock "e8e7d9aa-150f-424a-b3af-be149ee421c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:48:09 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-cbd7ad88-34a4-4485-9447-d015c99ad8ca req-1038d0c4-548c-42b9-b43d-c5902a29bcc6 service nova] Lock "e8e7d9aa-150f-424a-b3af-be149ee421c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:48:09 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-cbd7ad88-34a4-4485-9447-d015c99ad8ca req-1038d0c4-548c-42b9-b43d-c5902a29bcc6 service nova] Lock "e8e7d9aa-150f-424a-b3af-be149ee421c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:48:09 user nova-compute[73449]: DEBUG nova.compute.manager [req-cbd7ad88-34a4-4485-9447-d015c99ad8ca req-1038d0c4-548c-42b9-b43d-c5902a29bcc6 service nova] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] No waiting events found dispatching network-vif-plugged-460de6e4-4651-4b83-93bd-fbb5db34bcfa {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:48:09 user nova-compute[73449]: WARNING nova.compute.manager [req-cbd7ad88-34a4-4485-9447-d015c99ad8ca req-1038d0c4-548c-42b9-b43d-c5902a29bcc6 service nova] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] Received unexpected event network-vif-plugged-460de6e4-4651-4b83-93bd-fbb5db34bcfa for instance with vm_state active and task_state None.
Aug 17 11:48:09 user nova-compute[73449]: DEBUG nova.network.neutron [req-01382c18-68c3-4c64-9de8-4000d5f0da61 req-ce338aaf-a49b-45ae-bf8e-c6baffd0227e service nova] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Updated VIF entry in instance network info cache for port 1ec58d7f-18a4-4ddb-a137-2b72c5221621. {{(pid=73449) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 11:48:09 user nova-compute[73449]: DEBUG nova.network.neutron [req-01382c18-68c3-4c64-9de8-4000d5f0da61 req-ce338aaf-a49b-45ae-bf8e-c6baffd0227e service nova] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Updating instance_info_cache with network_info: [{"id": "1ec58d7f-18a4-4ddb-a137-2b72c5221621", "address": "fa:16:3e:8d:35:49", "network": {"id": "870c4b80-1ae0-4a10-89b8-ec734c66c244", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2050219794-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d6856b60c404a34b6355b5fd6dd7bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec58d7f-18", "ovs_interfaceid": "1ec58d7f-18a4-4ddb-a137-2b72c5221621", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:48:09 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-01382c18-68c3-4c64-9de8-4000d5f0da61 req-ce338aaf-a49b-45ae-bf8e-c6baffd0227e service nova] Releasing lock "refresh_cache-3d468854-6182-49c8-acb7-0641df2d5219" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:48:10 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:48:12 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:48:15 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:48:18 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:48:20 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:48:20 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:48:22 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-7abe4bfe-d2ad-4463-b4bc-d1a3f25ec18c tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Acquiring lock "dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:48:22 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-7abe4bfe-d2ad-4463-b4bc-d1a3f25ec18c tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Lock "dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:48:22 user nova-compute[73449]: DEBUG nova.compute.manager [None req-7abe4bfe-d2ad-4463-b4bc-d1a3f25ec18c tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9] Starting instance... {{(pid=73449) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 11:48:22 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-7abe4bfe-d2ad-4463-b4bc-d1a3f25ec18c tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:48:22 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-7abe4bfe-d2ad-4463-b4bc-d1a3f25ec18c tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:48:22 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-7abe4bfe-d2ad-4463-b4bc-d1a3f25ec18c tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73449) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 11:48:22 user nova-compute[73449]: INFO nova.compute.claims [None req-7abe4bfe-d2ad-4463-b4bc-d1a3f25ec18c tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9] Claim successful on node user
Aug 17 11:48:23 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:48:23 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-7abe4bfe-d2ad-4463-b4bc-d1a3f25ec18c tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 11:48:23 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-7abe4bfe-d2ad-4463-b4bc-d1a3f25ec18c tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 11:48:23 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-7abe4bfe-d2ad-4463-b4bc-d1a3f25ec18c tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.916s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:48:23 user nova-compute[73449]: DEBUG nova.compute.manager [None req-7abe4bfe-d2ad-4463-b4bc-d1a3f25ec18c tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9] Start building networks asynchronously for instance. {{(pid=73449) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 11:48:23 user nova-compute[73449]: DEBUG nova.compute.manager [None req-7abe4bfe-d2ad-4463-b4bc-d1a3f25ec18c tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9] Allocating IP information in the background. {{(pid=73449) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 11:48:23 user nova-compute[73449]: DEBUG nova.network.neutron [None req-7abe4bfe-d2ad-4463-b4bc-d1a3f25ec18c tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9] allocate_for_instance() {{(pid=73449) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 11:48:23 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-7abe4bfe-d2ad-4463-b4bc-d1a3f25ec18c tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 11:48:24 user nova-compute[73449]: DEBUG nova.compute.manager [None req-7abe4bfe-d2ad-4463-b4bc-d1a3f25ec18c tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9] Start building block device mappings for instance. {{(pid=73449) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 11:48:24 user nova-compute[73449]: INFO nova.virt.block_device [None req-7abe4bfe-d2ad-4463-b4bc-d1a3f25ec18c tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9] Booting with volume e27b229c-be74-4782-b328-51efbb6863fe at /dev/vda
Aug 17 11:48:24 user nova-compute[73449]: DEBUG nova.policy [None req-7abe4bfe-d2ad-4463-b4bc-d1a3f25ec18c tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '804ccb0440fb46a4a4c0ae65c3893296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd46cdaff7a4b40955f7c8a12c55452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73449) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 11:48:24 user nova-compute[73449]: DEBUG os_brick.utils [None req-7abe4bfe-d2ad-4463-b4bc-d1a3f25ec18c tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 11:48:24 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:48:24 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:48:24 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[72131eb3-2d1e-41d7-ad08-ac5e498e765e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4d3924302012\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:48:24 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:48:24 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:48:24 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[f934ba13-38ed-46a6-83d7-e3103f613fea]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:48:24 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:48:24 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:48:24 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[92256fdb-2a77-42df-9408-3f966dfb1c4a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:48:24 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[feb77ece-d25e-421b-9091-91d088948286]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:48:24 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-7abe4bfe-d2ad-4463-b4bc-d1a3f25ec18c tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Running cmd (subprocess): nvme version {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:48:24 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-7abe4bfe-d2ad-4463-b4bc-d1a3f25ec18c tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] 'nvme version' failed. Not Retrying. {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 11:48:24 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7abe4bfe-d2ad-4463-b4bc-d1a3f25ec18c tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] nvme not present on system {{(pid=73449) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 11:48:24 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:48:24 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 11:48:24 user nova-compute[73449]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 11:48:24 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eee2251-c2c7-442c-bee9-db49376702dc]: (4, '') {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:48:24 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-7abe4bfe-d2ad-4463-b4bc-d1a3f25ec18c tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73449) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 11:48:24 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-7abe4bfe-d2ad-4463-b4bc-d1a3f25ec18c tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73449) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 11:48:24 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-7abe4bfe-d2ad-4463-b4bc-d1a3f25ec18c tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] LIGHTOS: no hostnqn found. {{(pid=73449) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 11:48:24 user nova-compute[73449]: DEBUG os_brick.utils [None req-7abe4bfe-d2ad-4463-b4bc-d1a3f25ec18c tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4d3924302012', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 11:48:24 user nova-compute[73449]: DEBUG nova.virt.block_device [None req-7abe4bfe-d2ad-4463-b4bc-d1a3f25ec18c tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9] Updating existing volume attachment record: 7ef0d8eb-8aae-4049-afab-5ded5282356e {{(pid=73449) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 11:48:24 user nova-compute[73449]: DEBUG nova.network.neutron [None req-7abe4bfe-d2ad-4463-b4bc-d1a3f25ec18c tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9] Successfully created port: 3fce3b24-0ebe-4f5d-b673-767f2b24a77a {{(pid=73449) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 11:48:25 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:48:25 user nova-compute[73449]: DEBUG nova.network.neutron [None req-7abe4bfe-d2ad-4463-b4bc-d1a3f25ec18c tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9] Successfully updated port: 3fce3b24-0ebe-4f5d-b673-767f2b24a77a {{(pid=73449) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 11:48:25 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-7abe4bfe-d2ad-4463-b4bc-d1a3f25ec18c tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Acquiring lock "refresh_cache-dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:48:25 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-7abe4bfe-d2ad-4463-b4bc-d1a3f25ec18c tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Acquired lock "refresh_cache-dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:48:25 user nova-compute[73449]: DEBUG nova.network.neutron [None req-7abe4bfe-d2ad-4463-b4bc-d1a3f25ec18c tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9] Building network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 11:48:25 user nova-compute[73449]: DEBUG nova.compute.manager [req-80433cff-056c-4e51-ac6d-6d02a39fc8af req-58b4fac4-8562-4b8d-9103-36cf34b4082a service nova] [instance: dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9] Received event network-changed-3fce3b24-0ebe-4f5d-b673-767f2b24a77a {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:48:25 user nova-compute[73449]: DEBUG nova.compute.manager [req-80433cff-056c-4e51-ac6d-6d02a39fc8af req-58b4fac4-8562-4b8d-9103-36cf34b4082a service nova] [instance: dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9] Refreshing instance network info cache due to event network-changed-3fce3b24-0ebe-4f5d-b673-767f2b24a77a. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 11:48:25 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-80433cff-056c-4e51-ac6d-6d02a39fc8af req-58b4fac4-8562-4b8d-9103-36cf34b4082a service nova] Acquiring lock "refresh_cache-dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:48:25 user nova-compute[73449]: DEBUG nova.network.neutron [None req-7abe4bfe-d2ad-4463-b4bc-d1a3f25ec18c tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9] Instance cache missing network info. {{(pid=73449) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 11:48:26 user nova-compute[73449]: DEBUG nova.network.neutron [None req-7abe4bfe-d2ad-4463-b4bc-d1a3f25ec18c tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9] Updating instance_info_cache with network_info: [{"id": "3fce3b24-0ebe-4f5d-b673-767f2b24a77a", "address": "fa:16:3e:18:5e:2c", "network": {"id": "a9e8fcd6-4152-466b-99ad-44b85db05a05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-920564935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bd46cdaff7a4b40955f7c8a12c55452", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fce3b24-0e", "ovs_interfaceid": "3fce3b24-0ebe-4f5d-b673-767f2b24a77a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:48:26 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-7abe4bfe-d2ad-4463-b4bc-d1a3f25ec18c tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Releasing lock "refresh_cache-dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:48:26 user nova-compute[73449]: DEBUG nova.compute.manager [None req-7abe4bfe-d2ad-4463-b4bc-d1a3f25ec18c tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9] Instance network_info: |[{"id": "3fce3b24-0ebe-4f5d-b673-767f2b24a77a", "address": "fa:16:3e:18:5e:2c", "network": {"id": "a9e8fcd6-4152-466b-99ad-44b85db05a05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-920564935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bd46cdaff7a4b40955f7c8a12c55452", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fce3b24-0e", "ovs_interfaceid": "3fce3b24-0ebe-4f5d-b673-767f2b24a77a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73449) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 11:48:26 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-80433cff-056c-4e51-ac6d-6d02a39fc8af req-58b4fac4-8562-4b8d-9103-36cf34b4082a service nova] Acquired lock "refresh_cache-dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:48:26 user nova-compute[73449]: DEBUG nova.network.neutron [req-80433cff-056c-4e51-ac6d-6d02a39fc8af req-58b4fac4-8562-4b8d-9103-36cf34b4082a service nova] [instance: dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9] Refreshing network info cache for port 3fce3b24-0ebe-4f5d-b673-767f2b24a77a {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 11:48:27 user nova-compute[73449]: DEBUG nova.network.neutron [req-80433cff-056c-4e51-ac6d-6d02a39fc8af req-58b4fac4-8562-4b8d-9103-36cf34b4082a service nova] [instance: dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9] Updated VIF entry in instance network info cache for port 3fce3b24-0ebe-4f5d-b673-767f2b24a77a. {{(pid=73449) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 11:48:27 user nova-compute[73449]: DEBUG nova.network.neutron [req-80433cff-056c-4e51-ac6d-6d02a39fc8af req-58b4fac4-8562-4b8d-9103-36cf34b4082a service nova] [instance: dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9] Updating instance_info_cache with network_info: [{"id": "3fce3b24-0ebe-4f5d-b673-767f2b24a77a", "address": "fa:16:3e:18:5e:2c", "network": {"id": "a9e8fcd6-4152-466b-99ad-44b85db05a05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-920564935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bd46cdaff7a4b40955f7c8a12c55452", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fce3b24-0e", "ovs_interfaceid": "3fce3b24-0ebe-4f5d-b673-767f2b24a77a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:48:27 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-80433cff-056c-4e51-ac6d-6d02a39fc8af req-58b4fac4-8562-4b8d-9103-36cf34b4082a service nova] Releasing lock "refresh_cache-dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:48:28 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:48:28 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:48:30 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:48:33 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:48:33 user nova-compute[73449]: DEBUG nova.compute.manager [req-32eb1d28-a9e7-4a6d-912e-acf2f8b50669 req-ce2ba851-26b1-47b2-810d-e5533bde0d5c service nova] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Received event network-changed-599e177a-d05b-4d24-8c89-8a868182940c {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:48:33 user nova-compute[73449]: DEBUG nova.compute.manager [req-32eb1d28-a9e7-4a6d-912e-acf2f8b50669 req-ce2ba851-26b1-47b2-810d-e5533bde0d5c service nova] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Refreshing instance network info cache due to event network-changed-599e177a-d05b-4d24-8c89-8a868182940c. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 11:48:33 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-32eb1d28-a9e7-4a6d-912e-acf2f8b50669 req-ce2ba851-26b1-47b2-810d-e5533bde0d5c service nova] Acquiring lock "refresh_cache-5612f7d1-a901-4bdd-a24a-faf9a980cd04" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:48:33 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-32eb1d28-a9e7-4a6d-912e-acf2f8b50669 req-ce2ba851-26b1-47b2-810d-e5533bde0d5c service nova] Acquired lock "refresh_cache-5612f7d1-a901-4bdd-a24a-faf9a980cd04" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:48:33 user nova-compute[73449]: DEBUG nova.network.neutron [req-32eb1d28-a9e7-4a6d-912e-acf2f8b50669 req-ce2ba851-26b1-47b2-810d-e5533bde0d5c service nova] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Refreshing network info cache for port 599e177a-d05b-4d24-8c89-8a868182940c {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 11:48:34 user nova-compute[73449]: DEBUG nova.network.neutron [req-32eb1d28-a9e7-4a6d-912e-acf2f8b50669 req-ce2ba851-26b1-47b2-810d-e5533bde0d5c service nova] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Updated VIF entry in instance network info cache for port 599e177a-d05b-4d24-8c89-8a868182940c. {{(pid=73449) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 11:48:34 user nova-compute[73449]: DEBUG nova.network.neutron [req-32eb1d28-a9e7-4a6d-912e-acf2f8b50669 req-ce2ba851-26b1-47b2-810d-e5533bde0d5c service nova] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Updating instance_info_cache with network_info: [{"id": "599e177a-d05b-4d24-8c89-8a868182940c", "address": "fa:16:3e:8d:36:ef", "network": {"id": "41adee44-4e1c-4cc6-aa63-8054da5d97b4", "bridge": "br-int", "label": "tempest-TestShelveInstance-1953236522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b906d3cc3acb46818cd2c9583f351893", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap599e177a-d0", "ovs_interfaceid": "599e177a-d05b-4d24-8c89-8a868182940c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:48:34 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-32eb1d28-a9e7-4a6d-912e-acf2f8b50669 req-ce2ba851-26b1-47b2-810d-e5533bde0d5c service nova] Releasing lock "refresh_cache-5612f7d1-a901-4bdd-a24a-faf9a980cd04" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:48:34 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b009e626-abda-4365-a010-9b7d485db955 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Acquiring lock "5612f7d1-a901-4bdd-a24a-faf9a980cd04" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:48:34 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b009e626-abda-4365-a010-9b7d485db955 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Lock "5612f7d1-a901-4bdd-a24a-faf9a980cd04" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:48:34 user nova-compute[73449]: INFO nova.compute.manager [None req-b009e626-abda-4365-a010-9b7d485db955 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Shelve offloading
Aug 17 11:48:34 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:48:34 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:48:34 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:48:34 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:48:34 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:48:34 user nova-compute[73449]: DEBUG nova.compute.manager [req-9771615d-a849-42c7-86f9-2087845cc499 req-6b74f969-c85c-4094-b475-b212d408e271 service nova] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Received event network-vif-unplugged-599e177a-d05b-4d24-8c89-8a868182940c {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:48:34 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-9771615d-a849-42c7-86f9-2087845cc499 req-6b74f969-c85c-4094-b475-b212d408e271 service nova] Acquiring lock "5612f7d1-a901-4bdd-a24a-faf9a980cd04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:48:34 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-9771615d-a849-42c7-86f9-2087845cc499 req-6b74f969-c85c-4094-b475-b212d408e271 service nova] Lock "5612f7d1-a901-4bdd-a24a-faf9a980cd04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:48:34 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-9771615d-a849-42c7-86f9-2087845cc499 req-6b74f969-c85c-4094-b475-b212d408e271 service nova] Lock "5612f7d1-a901-4bdd-a24a-faf9a980cd04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:48:34 user nova-compute[73449]: DEBUG nova.compute.manager [req-9771615d-a849-42c7-86f9-2087845cc499 req-6b74f969-c85c-4094-b475-b212d408e271 service nova] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] No waiting events found dispatching network-vif-unplugged-599e177a-d05b-4d24-8c89-8a868182940c {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:48:34 user nova-compute[73449]: WARNING nova.compute.manager [req-9771615d-a849-42c7-86f9-2087845cc499 req-6b74f969-c85c-4094-b475-b212d408e271 service nova] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Received unexpected event network-vif-unplugged-599e177a-d05b-4d24-8c89-8a868182940c for instance with vm_state active and task_state shelving.
Aug 17 11:48:35 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Instance destroyed successfully.
Aug 17 11:48:35 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b009e626-abda-4365-a010-9b7d485db955 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:48:35 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b009e626-abda-4365-a010-9b7d485db955 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Acquiring lock "refresh_cache-5612f7d1-a901-4bdd-a24a-faf9a980cd04" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:48:35 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b009e626-abda-4365-a010-9b7d485db955 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Acquired lock "refresh_cache-5612f7d1-a901-4bdd-a24a-faf9a980cd04" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:48:35 user nova-compute[73449]: DEBUG nova.network.neutron [None req-b009e626-abda-4365-a010-9b7d485db955 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Building network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 11:48:35 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:48:35 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:48:35 user nova-compute[73449]: DEBUG nova.network.neutron [None req-b009e626-abda-4365-a010-9b7d485db955 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Updating instance_info_cache with network_info: [{"id": "599e177a-d05b-4d24-8c89-8a868182940c", "address": "fa:16:3e:8d:36:ef", "network": {"id": "41adee44-4e1c-4cc6-aa63-8054da5d97b4", "bridge": "br-int", "label": "tempest-TestShelveInstance-1953236522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b906d3cc3acb46818cd2c9583f351893", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap599e177a-d0", "ovs_interfaceid": "599e177a-d05b-4d24-8c89-8a868182940c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:48:36 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b009e626-abda-4365-a010-9b7d485db955 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Releasing lock "refresh_cache-5612f7d1-a901-4bdd-a24a-faf9a980cd04" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:48:36 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:48:36 user nova-compute[73449]: DEBUG nova.compute.manager [None req-7abe4bfe-d2ad-4463-b4bc-d1a3f25ec18c tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9] Start spawning the instance on the hypervisor. {{(pid=73449) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 11:48:36 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-7abe4bfe-d2ad-4463-b4bc-d1a3f25ec18c tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9] Creating instance directory {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 11:48:36 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-7abe4bfe-d2ad-4463-b4bc-d1a3f25ec18c tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9] Creating image(s)
Aug 17 11:48:36 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-7abe4bfe-d2ad-4463-b4bc-d1a3f25ec18c tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9] Did not create local disks {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 11:48:36 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-7abe4bfe-d2ad-4463-b4bc-d1a3f25ec18c tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9] Ensure instance console log exists: /opt/stack/data/nova/instances/dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9/console.log {{(pid=73449) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 11:48:36 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-7abe4bfe-d2ad-4463-b4bc-d1a3f25ec18c tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:48:36 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-7abe4bfe-d2ad-4463-b4bc-d1a3f25ec18c tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:48:36 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-7abe4bfe-d2ad-4463-b4bc-d1a3f25ec18c tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:48:36 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-7abe4bfe-d2ad-4463-b4bc-d1a3f25ec18c tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9] Start _get_guest_xml network_info=[{"id": "3fce3b24-0ebe-4f5d-b673-767f2b24a77a", "address": "fa:16:3e:18:5e:2c", "network": {"id": "a9e8fcd6-4152-466b-99ad-44b85db05a05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-920564935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bd46cdaff7a4b40955f7c8a12c55452", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fce3b24-0e", "ovs_interfaceid": "3fce3b24-0ebe-4f5d-b673-767f2b24a77a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'attachment_id': '7ef0d8eb-8aae-4049-afab-5ded5282356e', 'boot_index': 0, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vwJdqhIz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9', 'attached_at': '', 'detached_at': '', 'volume_id': 'e27b229c-be74-4782-b328-51efbb6863fe', 'serial': 'e27b229c-be74-4782-b328-51efbb6863fe'}, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 11:48:36 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-7abe4bfe-d2ad-4463-b4bc-d1a3f25ec18c tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:48:36 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-7abe4bfe-d2ad-4463-b4bc-d1a3f25ec18c tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:48:36 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-7abe4bfe-d2ad-4463-b4bc-d1a3f25ec18c tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 11:48:36 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-7abe4bfe-d2ad-4463-b4bc-d1a3f25ec18c tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] CPU controller missing on host. {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 11:48:36 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-7abe4bfe-d2ad-4463-b4bc-d1a3f25ec18c tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 11:48:36 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-7abe4bfe-d2ad-4463-b4bc-d1a3f25ec18c tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] CPU controller found on host. {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 11:48:36 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-7abe4bfe-d2ad-4463-b4bc-d1a3f25ec18c tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73449) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 11:48:36 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-7abe4bfe-d2ad-4463-b4bc-d1a3f25ec18c tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T11:35:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 11:48:36 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-7abe4bfe-d2ad-4463-b4bc-d1a3f25ec18c tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Flavor limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 11:48:36 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-7abe4bfe-d2ad-4463-b4bc-d1a3f25ec18c tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Image limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 11:48:36 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-7abe4bfe-d2ad-4463-b4bc-d1a3f25ec18c tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Flavor pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 11:48:36 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-7abe4bfe-d2ad-4463-b4bc-d1a3f25ec18c tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Image pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 11:48:36 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-7abe4bfe-d2ad-4463-b4bc-d1a3f25ec18c tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 11:48:36 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-7abe4bfe-d2ad-4463-b4bc-d1a3f25ec18c tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 11:48:36 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-7abe4bfe-d2ad-4463-b4bc-d1a3f25ec18c tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 11:48:36 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-7abe4bfe-d2ad-4463-b4bc-d1a3f25ec18c tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Got 1 possible topologies {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 11:48:36 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-7abe4bfe-d2ad-4463-b4bc-d1a3f25ec18c tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 11:48:36 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-7abe4bfe-d2ad-4463-b4bc-d1a3f25ec18c tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 11:48:36 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7abe4bfe-d2ad-4463-b4bc-d1a3f25ec18c tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9] Calling os-brick to attach iSCSI Volume {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 11:48:36 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-7abe4bfe-d2ad-4463-b4bc-d1a3f25ec18c tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vwJdqhIz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 11:48:36 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-7abe4bfe-d2ad-4463-b4bc-d1a3f25ec18c tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 11:48:36 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-7abe4bfe-d2ad-4463-b4bc-d1a3f25ec18c tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:48:36 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-7abe4bfe-d2ad-4463-b4bc-d1a3f25ec18c tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:48:36 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-7abe4bfe-d2ad-4463-b4bc-d1a3f25ec18c tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 11:48:36 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-7abe4bfe-d2ad-4463-b4bc-d1a3f25ec18c tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:48:36 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-7abe4bfe-d2ad-4463-b4bc-d1a3f25ec18c tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:48:36 user nova-compute[73449]: INFO os_brick.initiator.connectors.iscsi [None req-7abe4bfe-d2ad-4463-b4bc-d1a3f25ec18c tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 11:48:36 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe -p 172.16.0.220:3260 {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:48:36 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:48:36 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aba3e5a-b2f0-4453-931f-e7851bb83fbe]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:48:36 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-7abe4bfe-d2ad-4463-b4bc-d1a3f25ec18c tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 11:48:36 user nova-compute[73449]:  {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:48:36 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe -p 172.16.0.220:3260 --interface default --op new {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:48:36 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:48:36 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ca58d97-6dbb-4868-bb91-b8de90256e5d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe] added\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:48:36 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-7abe4bfe-d2ad-4463-b4bc-d1a3f25ec18c tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe] added
Aug 17 11:48:36 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:48:36 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:48:36 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:48:36 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8e1f852-bf73-4a78-b1d9-219d54ab6bb3]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:48:36 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-7abe4bfe-d2ad-4463-b4bc-d1a3f25ec18c tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:48:36 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:48:36 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:48:36 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[b400bb55-b33e-41ad-a805-abf61918387d]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:48:36 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-7abe4bfe-d2ad-4463-b4bc-d1a3f25ec18c tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:48:36 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vwJdqhIz {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:48:36 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vwJdqhIz" returned: 0 in 0.025s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:48:36 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[692e6bcf-9458-4b06-bb8b-eb848826946c]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:48:36 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-7abe4bfe-d2ad-4463-b4bc-d1a3f25ec18c tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vwJdqhIz'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:48:36 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:48:36 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:48:36 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f404b3a-933a-4362-b941-e353e7002ff5]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:48:36 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-7abe4bfe-d2ad-4463-b4bc-d1a3f25ec18c tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:48:36 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:48:36 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:48:36 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1f4969e-0056-49bb-b360-cb87c0644025]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:48:36 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-7abe4bfe-d2ad-4463-b4bc-d1a3f25ec18c tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466 (non-flash)
Aug 17 11:48:36 user nova-compute[73449]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611 (non-flash)
Aug 17 11:48:36 user nova-compute[73449]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c (non-flash)
Aug 17 11:48:36 user nova-compute[73449]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed (non-flash)
Aug 17 11:48:36 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:48:36 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-7abe4bfe-d2ad-4463-b4bc-d1a3f25ec18c tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466 (non-flash)
Aug 17 11:48:36 user nova-compute[73449]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611 (non-flash)
Aug 17 11:48:36 user nova-compute[73449]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c (non-flash)
Aug 17 11:48:36 user nova-compute[73449]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed (non-flash)
Aug 17 11:48:36 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:48:36 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe -p 172.16.0.220:3260 --login {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:48:37 user nova-compute[73449]: DEBUG nova.compute.manager [req-da03b34a-3b0b-4ccd-be06-28816fba000e req-2303c227-5cc4-4c06-a6b7-fa54abfb5aee service nova] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Received event network-vif-plugged-599e177a-d05b-4d24-8c89-8a868182940c {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:48:37 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-da03b34a-3b0b-4ccd-be06-28816fba000e req-2303c227-5cc4-4c06-a6b7-fa54abfb5aee service nova] Acquiring lock "5612f7d1-a901-4bdd-a24a-faf9a980cd04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:48:37 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-da03b34a-3b0b-4ccd-be06-28816fba000e req-2303c227-5cc4-4c06-a6b7-fa54abfb5aee service nova] Lock "5612f7d1-a901-4bdd-a24a-faf9a980cd04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:48:37 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-da03b34a-3b0b-4ccd-be06-28816fba000e req-2303c227-5cc4-4c06-a6b7-fa54abfb5aee service nova] Lock "5612f7d1-a901-4bdd-a24a-faf9a980cd04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:48:37 user nova-compute[73449]: DEBUG nova.compute.manager [req-da03b34a-3b0b-4ccd-be06-28816fba000e req-2303c227-5cc4-4c06-a6b7-fa54abfb5aee service nova] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] No waiting events found dispatching network-vif-plugged-599e177a-d05b-4d24-8c89-8a868182940c {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:48:37 user nova-compute[73449]: WARNING nova.compute.manager [req-da03b34a-3b0b-4ccd-be06-28816fba000e req-2303c227-5cc4-4c06-a6b7-fa54abfb5aee service nova] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Received unexpected event network-vif-plugged-599e177a-d05b-4d24-8c89-8a868182940c for instance with vm_state active and task_state shelving.
Aug 17 11:48:37 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:48:37 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad23bb61-0e80-4ca4-9863-2fbc49ed10fa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:48:37 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-7abe4bfe-d2ad-4463-b4bc-d1a3f25ec18c tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe, portal: 172.16.0.220,3260]
Aug 17 11:48:37 user nova-compute[73449]: Login to [iface: default, target: iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe, portal: 172.16.0.220,3260] successful.
Aug 17 11:48:37 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:48:37 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:48:37 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:48:37 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[59cfd767-1e9f-4fa5-8bf8-f1f37f6ddd7a]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:48:37 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-7abe4bfe-d2ad-4463-b4bc-d1a3f25ec18c tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:48:37 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:48:37 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:48:37 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[8576d74f-a1d1-4a0e-9ce7-1b43258bd69d]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:48:37 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-7abe4bfe-d2ad-4463-b4bc-d1a3f25ec18c tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466 (non-flash)
Aug 17 11:48:37 user nova-compute[73449]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611 (non-flash)
Aug 17 11:48:37 user nova-compute[73449]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c (non-flash)
Aug 17 11:48:37 user nova-compute[73449]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed (non-flash)
Aug 17 11:48:37 user nova-compute[73449]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe (non-flash)
Aug 17 11:48:37 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:48:37 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-7abe4bfe-d2ad-4463-b4bc-d1a3f25ec18c tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466 (non-flash)
Aug 17 11:48:37 user nova-compute[73449]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611 (non-flash)
Aug 17 11:48:37 user nova-compute[73449]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c (non-flash)
Aug 17 11:48:37 user nova-compute[73449]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed (non-flash)
Aug 17 11:48:37 user nova-compute[73449]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe (non-flash)
Aug 17 11:48:37 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:48:37 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-7abe4bfe-d2ad-4463-b4bc-d1a3f25ec18c tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.368s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:48:37 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-7abe4bfe-d2ad-4463-b4bc-d1a3f25ec18c tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Connected to 172.16.0.220:3260 {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 11:48:37 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-7abe4bfe-d2ad-4463-b4bc-d1a3f25ec18c tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] HCTL ('37', '-', '-', 0) found on session 26 with lun 0 {{(pid=73449) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 11:48:37 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-7abe4bfe-d2ad-4463-b4bc-d1a3f25ec18c tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73449) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 11:48:37 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:48:37 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:48:37 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[56517c8c-bb70-41fd-8e52-8465f2245f3e]: (4, ('- - 0', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:48:37 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-7abe4bfe-d2ad-4463-b4bc-d1a3f25ec18c tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Searching for a device in session 26 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73449) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 11:48:37 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-7abe4bfe-d2ad-4463-b4bc-d1a3f25ec18c tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vwJdqhIz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 11:48:37 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Instance destroyed successfully.
Aug 17 11:48:37 user nova-compute[73449]: DEBUG nova.objects.instance [None req-b009e626-abda-4365-a010-9b7d485db955 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Lazy-loading 'resources' on Instance uuid 5612f7d1-a901-4bdd-a24a-faf9a980cd04 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:48:37 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-b009e626-abda-4365-a010-9b7d485db955 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:46:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1849786392',display_name='tempest-TestShelveInstance-server-1849786392',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1849786392',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA55lazAqHP3vcEkHgxf0GkDCEWKxw301Wqk4UvPSVrCTPIFpM0ItDTNB5vmnGG+ellud4ExTu114P7nZoUxO7bGtJGKBcvDyG2fdaDBOPDuLrsnSKO7Wa6GZ9ttkbdXeA==',key_name='tempest-TestShelveInstance-1460867700',keypairs=<?>,launch_index=0,launched_at=2023-08-17T11:46:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b906d3cc3acb46818cd2c9583f351893',ramdisk_id='',reservation_id='r-6d1v12wz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-917557205',owner_user_name='tempest-TestShelveInstance-917557205-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T11:46:59Z,user_data=None,user_id='db7e0b2abd4b4df3b2e7886ddc3840c0',uuid=5612f7d1-a901-4bdd-a24a-faf9a980cd04,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "599e177a-d05b-4d24-8c89-8a868182940c", "address": "fa:16:3e:8d:36:ef", "network": {"id": "41adee44-4e1c-4cc6-aa63-8054da5d97b4", "bridge": "br-int", "label": "tempest-TestShelveInstance-1953236522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b906d3cc3acb46818cd2c9583f351893", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap599e177a-d0", "ovs_interfaceid": "599e177a-d05b-4d24-8c89-8a868182940c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 11:48:37 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-b009e626-abda-4365-a010-9b7d485db955 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Converting VIF {"id": "599e177a-d05b-4d24-8c89-8a868182940c", "address": "fa:16:3e:8d:36:ef", "network": {"id": "41adee44-4e1c-4cc6-aa63-8054da5d97b4", "bridge": "br-int", "label": "tempest-TestShelveInstance-1953236522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b906d3cc3acb46818cd2c9583f351893", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap599e177a-d0", "ovs_interfaceid": "599e177a-d05b-4d24-8c89-8a868182940c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:48:37 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-b009e626-abda-4365-a010-9b7d485db955 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:36:ef,bridge_name='br-int',has_traffic_filtering=True,id=599e177a-d05b-4d24-8c89-8a868182940c,network=Network(41adee44-4e1c-4cc6-aa63-8054da5d97b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap599e177a-d0') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:48:37 user nova-compute[73449]: DEBUG os_vif [None req-b009e626-abda-4365-a010-9b7d485db955 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:36:ef,bridge_name='br-int',has_traffic_filtering=True,id=599e177a-d05b-4d24-8c89-8a868182940c,network=Network(41adee44-4e1c-4cc6-aa63-8054da5d97b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap599e177a-d0') {{(pid=73449) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 11:48:37 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:48:37 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap599e177a-d0, bridge=br-int, if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:48:37 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:48:37 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:48:37 user nova-compute[73449]: INFO os_vif [None req-b009e626-abda-4365-a010-9b7d485db955 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:36:ef,bridge_name='br-int',has_traffic_filtering=True,id=599e177a-d05b-4d24-8c89-8a868182940c,network=Network(41adee44-4e1c-4cc6-aa63-8054da5d97b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap599e177a-d0')
Aug 17 11:48:37 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b009e626-abda-4365-a010-9b7d485db955 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] calling os-brick to detach iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 11:48:37 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-b009e626-abda-4365-a010-9b7d485db955 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, {'target_iqns': ['iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zWFHJgbD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 11:48:37 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-b009e626-abda-4365-a010-9b7d485db955 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 11:48:37 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-b009e626-abda-4365-a010-9b7d485db955 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:48:38 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:48:38 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-7abe4bfe-d2ad-4463-b4bc-d1a3f25ec18c tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.408s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:48:38 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-7abe4bfe-d2ad-4463-b4bc-d1a3f25ec18c tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] <== connect_volume: return (1409ms) {'type': 'block', 'scsi_wwn': '26535386139313362', 'path': '/dev/sdf'} {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 11:48:38 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7abe4bfe-d2ad-4463-b4bc-d1a3f25ec18c tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26535386139313362', 'path': '/dev/sdf'} {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 11:48:38 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-b009e626-abda-4365-a010-9b7d485db955 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.940s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:48:38 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-b009e626-abda-4365-a010-9b7d485db955 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611', 0)] {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 11:48:38 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:48:38 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:48:38 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a2a1deb-9300-478d-9292-5a66ca5a788c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:48:38 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:48:38 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-7abe4bfe-d2ad-4463-b4bc-d1a3f25ec18c tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:48:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-538737854',display_name='tempest-TestVolumeBootPattern-volume-backed-server-538737854',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-538737854',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNzPlQhING7v8dV05hF/uDvQ8jCwFn8vDgHmZjZJwzbhTkaBSp9WDyXqzLcQEPGYU/mSNpHkWWc8LM7jrYmhuY5UDUYO/eeN/bi9CJ2rti45LOSQpRPbknHrKjG4K5iDIA==',key_name='tempest-keypair-736533808',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4bd46cdaff7a4b40955f7c8a12c55452',ramdisk_id='',reservation_id='r-3e83f7w2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-813872552',owner_user_name='tempest-TestVolumeBootPattern-813872552-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T11:48:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='804ccb0440fb46a4a4c0ae65c3893296',uuid=dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3fce3b24-0ebe-4f5d-b673-767f2b24a77a", "address": "fa:16:3e:18:5e:2c", "network": {"id": "a9e8fcd6-4152-466b-99ad-44b85db05a05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-920564935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bd46cdaff7a4b40955f7c8a12c55452", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fce3b24-0e", "ovs_interfaceid": "3fce3b24-0ebe-4f5d-b673-767f2b24a77a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73449) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 11:48:38 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-7abe4bfe-d2ad-4463-b4bc-d1a3f25ec18c tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Converting VIF {"id": "3fce3b24-0ebe-4f5d-b673-767f2b24a77a", "address": "fa:16:3e:18:5e:2c", "network": {"id": "a9e8fcd6-4152-466b-99ad-44b85db05a05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-920564935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bd46cdaff7a4b40955f7c8a12c55452", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fce3b24-0e", "ovs_interfaceid": "3fce3b24-0ebe-4f5d-b673-767f2b24a77a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:48:38 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-7abe4bfe-d2ad-4463-b4bc-d1a3f25ec18c tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:5e:2c,bridge_name='br-int',has_traffic_filtering=True,id=3fce3b24-0ebe-4f5d-b673-767f2b24a77a,network=Network(a9e8fcd6-4152-466b-99ad-44b85db05a05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fce3b24-0e') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:48:38 user nova-compute[73449]: DEBUG nova.objects.instance [None req-7abe4bfe-d2ad-4463-b4bc-d1a3f25ec18c tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Lazy-loading 'pci_devices' on Instance uuid dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:48:38 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-7abe4bfe-d2ad-4463-b4bc-d1a3f25ec18c tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9] End _get_guest_xml xml=<domain type="kvm">
Aug 17 11:48:38 user nova-compute[73449]:   <uuid>dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9</uuid>
Aug 17 11:48:38 user nova-compute[73449]:   <name>instance-00000017</name>
Aug 17 11:48:38 user nova-compute[73449]:   <memory>524288</memory>
Aug 17 11:48:38 user nova-compute[73449]:   <vcpu>1</vcpu>
Aug 17 11:48:38 user nova-compute[73449]:   <metadata>
Aug 17 11:48:38 user nova-compute[73449]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 11:48:38 user nova-compute[73449]:       <nova:package version="0.0.0"/>
Aug 17 11:48:38 user nova-compute[73449]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-538737854</nova:name>
Aug 17 11:48:38 user nova-compute[73449]:       <nova:creationTime>2023-08-17 11:48:36</nova:creationTime>
Aug 17 11:48:38 user nova-compute[73449]:       <nova:flavor name="m1.tiny">
Aug 17 11:48:38 user nova-compute[73449]:         <nova:memory>512</nova:memory>
Aug 17 11:48:38 user nova-compute[73449]:         <nova:disk>1</nova:disk>
Aug 17 11:48:38 user nova-compute[73449]:         <nova:swap>0</nova:swap>
Aug 17 11:48:38 user nova-compute[73449]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 11:48:38 user nova-compute[73449]:         <nova:vcpus>1</nova:vcpus>
Aug 17 11:48:38 user nova-compute[73449]:       </nova:flavor>
Aug 17 11:48:38 user nova-compute[73449]:       <nova:owner>
Aug 17 11:48:38 user nova-compute[73449]:         <nova:user uuid="804ccb0440fb46a4a4c0ae65c3893296">tempest-TestVolumeBootPattern-813872552-project-member</nova:user>
Aug 17 11:48:38 user nova-compute[73449]:         <nova:project uuid="4bd46cdaff7a4b40955f7c8a12c55452">tempest-TestVolumeBootPattern-813872552</nova:project>
Aug 17 11:48:38 user nova-compute[73449]:       </nova:owner>
Aug 17 11:48:38 user nova-compute[73449]:       <nova:ports>
Aug 17 11:48:38 user nova-compute[73449]:         <nova:port uuid="3fce3b24-0ebe-4f5d-b673-767f2b24a77a">
Aug 17 11:48:38 user nova-compute[73449]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 17 11:48:38 user nova-compute[73449]:         </nova:port>
Aug 17 11:48:38 user nova-compute[73449]:       </nova:ports>
Aug 17 11:48:38 user nova-compute[73449]:     </nova:instance>
Aug 17 11:48:38 user nova-compute[73449]:   </metadata>
Aug 17 11:48:38 user nova-compute[73449]:   <sysinfo type="smbios">
Aug 17 11:48:38 user nova-compute[73449]:     <system>
Aug 17 11:48:38 user nova-compute[73449]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 11:48:38 user nova-compute[73449]:       <entry name="product">OpenStack Nova</entry>
Aug 17 11:48:38 user nova-compute[73449]:       <entry name="version">0.0.0</entry>
Aug 17 11:48:38 user nova-compute[73449]:       <entry name="serial">dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9</entry>
Aug 17 11:48:38 user nova-compute[73449]:       <entry name="uuid">dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9</entry>
Aug 17 11:48:38 user nova-compute[73449]:       <entry name="family">Virtual Machine</entry>
Aug 17 11:48:38 user nova-compute[73449]:     </system>
Aug 17 11:48:38 user nova-compute[73449]:   </sysinfo>
Aug 17 11:48:38 user nova-compute[73449]:   <os>
Aug 17 11:48:38 user nova-compute[73449]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 11:48:38 user nova-compute[73449]:     <boot dev="hd"/>
Aug 17 11:48:38 user nova-compute[73449]:     <smbios mode="sysinfo"/>
Aug 17 11:48:38 user nova-compute[73449]:   </os>
Aug 17 11:48:38 user nova-compute[73449]:   <features>
Aug 17 11:48:38 user nova-compute[73449]:     <acpi/>
Aug 17 11:48:38 user nova-compute[73449]:     <apic/>
Aug 17 11:48:38 user nova-compute[73449]:     <vmcoreinfo/>
Aug 17 11:48:38 user nova-compute[73449]:   </features>
Aug 17 11:48:38 user nova-compute[73449]:   <clock offset="utc">
Aug 17 11:48:38 user nova-compute[73449]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 11:48:38 user nova-compute[73449]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 11:48:38 user nova-compute[73449]:     <timer name="hpet" present="no"/>
Aug 17 11:48:38 user nova-compute[73449]:   </clock>
Aug 17 11:48:38 user nova-compute[73449]:   <cpu mode="custom" match="exact">
Aug 17 11:48:38 user nova-compute[73449]:     <model>Nehalem</model>
Aug 17 11:48:38 user nova-compute[73449]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 11:48:38 user nova-compute[73449]:   </cpu>
Aug 17 11:48:38 user nova-compute[73449]:   <devices>
Aug 17 11:48:38 user nova-compute[73449]:     <disk type="block" device="disk">
Aug 17 11:48:38 user nova-compute[73449]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 11:48:38 user nova-compute[73449]:       <source dev="/dev/sdf"/>
Aug 17 11:48:38 user nova-compute[73449]:       <target dev="vda" bus="virtio"/>
Aug 17 11:48:38 user nova-compute[73449]:       <serial>e27b229c-be74-4782-b328-51efbb6863fe</serial>
Aug 17 11:48:38 user nova-compute[73449]:     </disk>
Aug 17 11:48:38 user nova-compute[73449]:     <interface type="ethernet">
Aug 17 11:48:38 user nova-compute[73449]:       <mac address="fa:16:3e:18:5e:2c"/>
Aug 17 11:48:38 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 11:48:38 user nova-compute[73449]:       <mtu size="1442"/>
Aug 17 11:48:38 user nova-compute[73449]:       <target dev="tap3fce3b24-0e"/>
Aug 17 11:48:38 user nova-compute[73449]:     </interface>
Aug 17 11:48:38 user nova-compute[73449]:     <serial type="pty">
Aug 17 11:48:38 user nova-compute[73449]:       <log file="/opt/stack/data/nova/instances/dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9/console.log" append="off"/>
Aug 17 11:48:38 user nova-compute[73449]:     </serial>
Aug 17 11:48:38 user nova-compute[73449]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 11:48:38 user nova-compute[73449]:     <video>
Aug 17 11:48:38 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 11:48:38 user nova-compute[73449]:     </video>
Aug 17 11:48:38 user nova-compute[73449]:     <rng model="virtio">
Aug 17 11:48:38 user nova-compute[73449]:       <backend model="random">/dev/urandom</backend>
Aug 17 11:48:38 user nova-compute[73449]:     </rng>
Aug 17 11:48:38 user nova-compute[73449]:     <controller type="usb" index="0" model="none"/>
Aug 17 11:48:38 user nova-compute[73449]:     <memballoon model="virtio">
Aug 17 11:48:38 user nova-compute[73449]:       <stats period="10"/>
Aug 17 11:48:38 user nova-compute[73449]:     </memballoon>
Aug 17 11:48:38 user nova-compute[73449]:   </devices>
Aug 17 11:48:38 user nova-compute[73449]: </domain>
Aug 17 11:48:38 user nova-compute[73449]:  {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 11:48:38 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-7abe4bfe-d2ad-4463-b4bc-d1a3f25ec18c tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:48:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-538737854',display_name='tempest-TestVolumeBootPattern-volume-backed-server-538737854',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-538737854',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNzPlQhING7v8dV05hF/uDvQ8jCwFn8vDgHmZjZJwzbhTkaBSp9WDyXqzLcQEPGYU/mSNpHkWWc8LM7jrYmhuY5UDUYO/eeN/bi9CJ2rti45LOSQpRPbknHrKjG4K5iDIA==',key_name='tempest-keypair-736533808',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4bd46cdaff7a4b40955f7c8a12c55452',ramdisk_id='',reservation_id='r-3e83f7w2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-813872552',owner_user_name='tempest-TestVolumeBootPattern-813872552-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T11:48:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='804ccb0440fb46a4a4c0ae65c3893296',uuid=dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3fce3b24-0ebe-4f5d-b673-767f2b24a77a", "address": "fa:16:3e:18:5e:2c", "network": {"id": "a9e8fcd6-4152-466b-99ad-44b85db05a05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-920564935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bd46cdaff7a4b40955f7c8a12c55452", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fce3b24-0e", "ovs_interfaceid": "3fce3b24-0ebe-4f5d-b673-767f2b24a77a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 11:48:38 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-7abe4bfe-d2ad-4463-b4bc-d1a3f25ec18c tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Converting VIF {"id": "3fce3b24-0ebe-4f5d-b673-767f2b24a77a", "address": "fa:16:3e:18:5e:2c", "network": {"id": "a9e8fcd6-4152-466b-99ad-44b85db05a05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-920564935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bd46cdaff7a4b40955f7c8a12c55452", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fce3b24-0e", "ovs_interfaceid": "3fce3b24-0ebe-4f5d-b673-767f2b24a77a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:48:38 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-7abe4bfe-d2ad-4463-b4bc-d1a3f25ec18c tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:5e:2c,bridge_name='br-int',has_traffic_filtering=True,id=3fce3b24-0ebe-4f5d-b673-767f2b24a77a,network=Network(a9e8fcd6-4152-466b-99ad-44b85db05a05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fce3b24-0e') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:48:38 user nova-compute[73449]: DEBUG os_vif [None req-7abe4bfe-d2ad-4463-b4bc-d1a3f25ec18c tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:5e:2c,bridge_name='br-int',has_traffic_filtering=True,id=3fce3b24-0ebe-4f5d-b673-767f2b24a77a,network=Network(a9e8fcd6-4152-466b-99ad-44b85db05a05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fce3b24-0e') {{(pid=73449) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 11:48:38 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:48:38 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:48:38 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 11:48:38 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:48:38 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[da92330a-2af1-4573-b0fc-5cf7fccc5b5f]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:48:38 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-b009e626-abda-4365-a010-9b7d485db955 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466 (non-flash)
Aug 17 11:48:38 user nova-compute[73449]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611 (non-flash)
Aug 17 11:48:38 user nova-compute[73449]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c (non-flash)
Aug 17 11:48:38 user nova-compute[73449]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed (non-flash)
Aug 17 11:48:38 user nova-compute[73449]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe (non-flash)
Aug 17 11:48:38 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:48:38 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-b009e626-abda-4365-a010-9b7d485db955 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466 (non-flash)
Aug 17 11:48:38 user nova-compute[73449]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611 (non-flash)
Aug 17 11:48:38 user nova-compute[73449]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c (non-flash)
Aug 17 11:48:38 user nova-compute[73449]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed (non-flash)
Aug 17 11:48:38 user nova-compute[73449]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe (non-flash)
Aug 17 11:48:38 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:48:38 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-b009e626-abda-4365-a010-9b7d485db955 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe7582ec310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611'): ({'sdb'}, set())}) {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 11:48:38 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-b009e626-abda-4365-a010-9b7d485db955 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Removing single pathed devices sdb {{(pid=73449) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 11:48:38 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:48:38 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3fce3b24-0e, may_exist=True, interface_attrs={}) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:48:38 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3fce3b24-0e, col_values=(('external_ids', {'iface-id': '3fce3b24-0ebe-4f5d-b673-767f2b24a77a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:18:5e:2c', 'vm-uuid': 'dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9'}),), if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:48:38 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:48:38 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:48:38 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:48:38 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:48:38 user nova-compute[73449]: INFO os_vif [None req-7abe4bfe-d2ad-4463-b4bc-d1a3f25ec18c tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:5e:2c,bridge_name='br-int',has_traffic_filtering=True,id=3fce3b24-0ebe-4f5d-b673-767f2b24a77a,network=Network(a9e8fcd6-4152-466b-99ad-44b85db05a05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fce3b24-0e')
Aug 17 11:48:38 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:48:38 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f28e594-643f-4c4c-98ac-419329aad378]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:48:38 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:48:38 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:48:38 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[afd350a3-cd79-43d5-9b3f-72bcca81ab70]: (4, ('ok\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:48:38 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-b009e626-abda-4365-a010-9b7d485db955 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Flushing IO for device /dev/sdb {{(pid=73449) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 11:48:38 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:48:38 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:48:38 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb109462-0911-4647-93b3-c35e49cbefcd]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:48:38 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-b009e626-abda-4365-a010-9b7d485db955 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73449) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 11:48:38 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:48:38 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-7abe4bfe-d2ad-4463-b4bc-d1a3f25ec18c tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] No BDM found with device name vda, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 11:48:38 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-7abe4bfe-d2ad-4463-b4bc-d1a3f25ec18c tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] No VIF found with MAC fa:16:3e:18:5e:2c, not building metadata {{(pid=73449) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 11:48:38 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:48:38 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[0735be22-b243-492a-8987-c02aa4757833]: (4, ('1', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:48:38 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-b009e626-abda-4365-a010-9b7d485db955 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73449) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 11:48:38 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-b009e626-abda-4365-a010-9b7d485db955 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] SCSI volumes sdb have been removed. {{(pid=73449) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 11:48:38 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-b009e626-abda-4365-a010-9b7d485db955 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611')] {{(pid=73449) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 11:48:38 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:48:38 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:48:38 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[45ab60ef-5aba-4804-97f8-d3435424e363]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:48:38 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-b009e626-abda-4365-a010-9b7d485db955 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:48:38 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611 -p 172.16.0.220:3260 --logout {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:48:38 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:48:38 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fc35e12-d288-4509-ae2f-7e74ba31253f]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:48:38 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-b009e626-abda-4365-a010-9b7d485db955 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611, portal: 172.16.0.220,3260]
Aug 17 11:48:38 user nova-compute[73449]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611, portal: 172.16.0.220,3260] successful.
Aug 17 11:48:38 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:48:38 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611 -p 172.16.0.220:3260 --op delete {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:48:38 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:48:38 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[5417d309-d10a-4fe3-8a81-d40ebd5b8ec2]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:48:38 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-b009e626-abda-4365-a010-9b7d485db955 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:48:38 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-b009e626-abda-4365-a010-9b7d485db955 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:48:38 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-b009e626-abda-4365-a010-9b7d485db955 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] <== disconnect_volume: return (1250ms) None {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 11:48:38 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b009e626-abda-4365-a010-9b7d485db955 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Disconnected iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 11:48:38 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-b009e626-abda-4365-a010-9b7d485db955 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Deleting instance files /opt/stack/data/nova/instances/5612f7d1-a901-4bdd-a24a-faf9a980cd04_del
Aug 17 11:48:38 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-b009e626-abda-4365-a010-9b7d485db955 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Deletion of /opt/stack/data/nova/instances/5612f7d1-a901-4bdd-a24a-faf9a980cd04_del complete
Aug 17 11:48:39 user nova-compute[73449]: DEBUG nova.compute.manager [req-b164fb9f-d14d-4f31-8d43-96b6681d55b5 req-b53668d8-1c14-43ed-8141-d61e1d791927 service nova] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Received event network-changed-599e177a-d05b-4d24-8c89-8a868182940c {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:48:39 user nova-compute[73449]: DEBUG nova.compute.manager [req-b164fb9f-d14d-4f31-8d43-96b6681d55b5 req-b53668d8-1c14-43ed-8141-d61e1d791927 service nova] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Refreshing instance network info cache due to event network-changed-599e177a-d05b-4d24-8c89-8a868182940c. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 11:48:39 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-b164fb9f-d14d-4f31-8d43-96b6681d55b5 req-b53668d8-1c14-43ed-8141-d61e1d791927 service nova] Acquiring lock "refresh_cache-5612f7d1-a901-4bdd-a24a-faf9a980cd04" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:48:39 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-b164fb9f-d14d-4f31-8d43-96b6681d55b5 req-b53668d8-1c14-43ed-8141-d61e1d791927 service nova] Acquired lock "refresh_cache-5612f7d1-a901-4bdd-a24a-faf9a980cd04" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:48:39 user nova-compute[73449]: DEBUG nova.network.neutron [req-b164fb9f-d14d-4f31-8d43-96b6681d55b5 req-b53668d8-1c14-43ed-8141-d61e1d791927 service nova] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Refreshing network info cache for port 599e177a-d05b-4d24-8c89-8a868182940c {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 11:48:39 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:48:39 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:48:39 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:48:39 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:48:39 user nova-compute[73449]: INFO nova.scheduler.client.report [None req-b009e626-abda-4365-a010-9b7d485db955 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Deleted allocations for instance 5612f7d1-a901-4bdd-a24a-faf9a980cd04
Aug 17 11:48:39 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b009e626-abda-4365-a010-9b7d485db955 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:48:39 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b009e626-abda-4365-a010-9b7d485db955 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:48:39 user nova-compute[73449]: DEBUG nova.objects.instance [None req-b009e626-abda-4365-a010-9b7d485db955 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Lazy-loading 'numa_topology' on Instance uuid 5612f7d1-a901-4bdd-a24a-faf9a980cd04 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:48:40 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-b009e626-abda-4365-a010-9b7d485db955 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 11:48:40 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-b009e626-abda-4365-a010-9b7d485db955 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 11:48:40 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b009e626-abda-4365-a010-9b7d485db955 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.394s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:48:40 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b009e626-abda-4365-a010-9b7d485db955 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Lock "5612f7d1-a901-4bdd-a24a-faf9a980cd04" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 5.671s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:48:40 user nova-compute[73449]: DEBUG nova.network.neutron [req-b164fb9f-d14d-4f31-8d43-96b6681d55b5 req-b53668d8-1c14-43ed-8141-d61e1d791927 service nova] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Updated VIF entry in instance network info cache for port 599e177a-d05b-4d24-8c89-8a868182940c. {{(pid=73449) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 11:48:40 user nova-compute[73449]: DEBUG nova.network.neutron [req-b164fb9f-d14d-4f31-8d43-96b6681d55b5 req-b53668d8-1c14-43ed-8141-d61e1d791927 service nova] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Updating instance_info_cache with network_info: [{"id": "599e177a-d05b-4d24-8c89-8a868182940c", "address": "fa:16:3e:8d:36:ef", "network": {"id": "41adee44-4e1c-4cc6-aa63-8054da5d97b4", "bridge": null, "label": "tempest-TestShelveInstance-1953236522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b906d3cc3acb46818cd2c9583f351893", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap599e177a-d0", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:48:40 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-b164fb9f-d14d-4f31-8d43-96b6681d55b5 req-b53668d8-1c14-43ed-8141-d61e1d791927 service nova] Releasing lock "refresh_cache-5612f7d1-a901-4bdd-a24a-faf9a980cd04" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:48:40 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:48:40 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:48:40 user nova-compute[73449]: DEBUG nova.compute.manager [req-42117908-5ba0-4a17-a4d6-4d36eccc756e req-372f3299-3488-4db5-8904-d9c4dc712d94 service nova] [instance: dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9] Received event network-vif-plugged-3fce3b24-0ebe-4f5d-b673-767f2b24a77a {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:48:40 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-42117908-5ba0-4a17-a4d6-4d36eccc756e req-372f3299-3488-4db5-8904-d9c4dc712d94 service nova] Acquiring lock "dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:48:40 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-42117908-5ba0-4a17-a4d6-4d36eccc756e req-372f3299-3488-4db5-8904-d9c4dc712d94 service nova] Lock "dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:48:40 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-42117908-5ba0-4a17-a4d6-4d36eccc756e req-372f3299-3488-4db5-8904-d9c4dc712d94 service nova] Lock "dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:48:40 user nova-compute[73449]: DEBUG nova.compute.manager [req-42117908-5ba0-4a17-a4d6-4d36eccc756e req-372f3299-3488-4db5-8904-d9c4dc712d94 service nova] [instance: dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9] No waiting events found dispatching network-vif-plugged-3fce3b24-0ebe-4f5d-b673-767f2b24a77a {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:48:40 user nova-compute[73449]: WARNING nova.compute.manager [req-42117908-5ba0-4a17-a4d6-4d36eccc756e req-372f3299-3488-4db5-8904-d9c4dc712d94 service nova] [instance: dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9] Received unexpected event network-vif-plugged-3fce3b24-0ebe-4f5d-b673-767f2b24a77a for instance with vm_state building and task_state spawning.
Aug 17 11:48:41 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-e41c323a-dc53-4e4d-b531-b7570bde4f8d tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Acquiring lock "dd4ec7bd-002e-4a71-9314-96c21427af27" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:48:41 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-e41c323a-dc53-4e4d-b531-b7570bde4f8d tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Lock "dd4ec7bd-002e-4a71-9314-96c21427af27" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:48:41 user nova-compute[73449]: DEBUG nova.compute.manager [None req-e41c323a-dc53-4e4d-b531-b7570bde4f8d tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] [instance: dd4ec7bd-002e-4a71-9314-96c21427af27] Starting instance... {{(pid=73449) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 11:48:41 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:48:41 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-e41c323a-dc53-4e4d-b531-b7570bde4f8d tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:48:41 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-e41c323a-dc53-4e4d-b531-b7570bde4f8d tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:48:41 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-e41c323a-dc53-4e4d-b531-b7570bde4f8d tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73449) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 11:48:41 user nova-compute[73449]: INFO nova.compute.claims [None req-e41c323a-dc53-4e4d-b531-b7570bde4f8d tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] [instance: dd4ec7bd-002e-4a71-9314-96c21427af27] Claim successful on node user
Aug 17 11:48:41 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692272921.8787498, dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9 => Resumed> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:48:41 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9] VM Resumed (Lifecycle Event)
Aug 17 11:48:41 user nova-compute[73449]: DEBUG nova.compute.manager [None req-7abe4bfe-d2ad-4463-b4bc-d1a3f25ec18c tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9] Instance event wait completed in 0 seconds for  {{(pid=73449) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 11:48:41 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-7abe4bfe-d2ad-4463-b4bc-d1a3f25ec18c tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9] Guest created on hypervisor {{(pid=73449) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 11:48:41 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9] Instance spawned successfully.
Aug 17 11:48:41 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-7abe4bfe-d2ad-4463-b4bc-d1a3f25ec18c tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 11:48:41 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:48:41 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 11:48:41 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-7abe4bfe-d2ad-4463-b4bc-d1a3f25ec18c tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9] Found default for hw_cdrom_bus of ide {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:48:41 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-7abe4bfe-d2ad-4463-b4bc-d1a3f25ec18c tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9] Found default for hw_disk_bus of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:48:41 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-7abe4bfe-d2ad-4463-b4bc-d1a3f25ec18c tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9] Found default for hw_input_bus of None {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:48:41 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-7abe4bfe-d2ad-4463-b4bc-d1a3f25ec18c tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9] Found default for hw_pointer_model of None {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:48:41 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-7abe4bfe-d2ad-4463-b4bc-d1a3f25ec18c tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9] Found default for hw_video_model of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:48:41 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-7abe4bfe-d2ad-4463-b4bc-d1a3f25ec18c tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9] Found default for hw_vif_model of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:48:41 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 11:48:41 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692272921.8790042, dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9 => Started> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:48:41 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9] VM Started (Lifecycle Event)
Aug 17 11:48:41 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:48:41 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 11:48:42 user nova-compute[73449]: INFO nova.compute.manager [None req-7abe4bfe-d2ad-4463-b4bc-d1a3f25ec18c tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9] Took 5.27 seconds to spawn the instance on the hypervisor.
Aug 17 11:48:42 user nova-compute[73449]: DEBUG nova.compute.manager [None req-7abe4bfe-d2ad-4463-b4bc-d1a3f25ec18c tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:48:42 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 11:48:42 user nova-compute[73449]: INFO nova.compute.manager [None req-7abe4bfe-d2ad-4463-b4bc-d1a3f25ec18c tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9] Took 19.15 seconds to build instance.
Aug 17 11:48:42 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-7abe4bfe-d2ad-4463-b4bc-d1a3f25ec18c tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Lock "dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.251s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:48:42 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-e41c323a-dc53-4e4d-b531-b7570bde4f8d tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 11:48:42 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-e41c323a-dc53-4e4d-b531-b7570bde4f8d tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 11:48:42 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-e41c323a-dc53-4e4d-b531-b7570bde4f8d tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.464s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:48:42 user nova-compute[73449]: DEBUG nova.compute.manager [None req-e41c323a-dc53-4e4d-b531-b7570bde4f8d tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] [instance: dd4ec7bd-002e-4a71-9314-96c21427af27] Start building networks asynchronously for instance. {{(pid=73449) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 11:48:42 user nova-compute[73449]: DEBUG nova.compute.manager [None req-e41c323a-dc53-4e4d-b531-b7570bde4f8d tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] [instance: dd4ec7bd-002e-4a71-9314-96c21427af27] Allocating IP information in the background. {{(pid=73449) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 11:48:42 user nova-compute[73449]: DEBUG nova.network.neutron [None req-e41c323a-dc53-4e4d-b531-b7570bde4f8d tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] [instance: dd4ec7bd-002e-4a71-9314-96c21427af27] allocate_for_instance() {{(pid=73449) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 11:48:42 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-e41c323a-dc53-4e4d-b531-b7570bde4f8d tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] [instance: dd4ec7bd-002e-4a71-9314-96c21427af27] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 11:48:42 user nova-compute[73449]: DEBUG nova.compute.manager [None req-e41c323a-dc53-4e4d-b531-b7570bde4f8d tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] [instance: dd4ec7bd-002e-4a71-9314-96c21427af27] Start building block device mappings for instance. {{(pid=73449) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 11:48:42 user nova-compute[73449]: DEBUG nova.policy [None req-e41c323a-dc53-4e4d-b531-b7570bde4f8d tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '56d7fd2eae7c4e62a7cc0e917287f03f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbaa73b99e5a498dac668e5307654fd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73449) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 11:48:42 user nova-compute[73449]: DEBUG nova.compute.manager [None req-e41c323a-dc53-4e4d-b531-b7570bde4f8d tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] [instance: dd4ec7bd-002e-4a71-9314-96c21427af27] Start spawning the instance on the hypervisor. {{(pid=73449) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 11:48:42 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-e41c323a-dc53-4e4d-b531-b7570bde4f8d tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] [instance: dd4ec7bd-002e-4a71-9314-96c21427af27] Creating instance directory {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 11:48:42 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-e41c323a-dc53-4e4d-b531-b7570bde4f8d tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] [instance: dd4ec7bd-002e-4a71-9314-96c21427af27] Creating image(s)
Aug 17 11:48:42 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-e41c323a-dc53-4e4d-b531-b7570bde4f8d tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Acquiring lock "/opt/stack/data/nova/instances/dd4ec7bd-002e-4a71-9314-96c21427af27/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:48:42 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-e41c323a-dc53-4e4d-b531-b7570bde4f8d tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Lock "/opt/stack/data/nova/instances/dd4ec7bd-002e-4a71-9314-96c21427af27/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:48:42 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-e41c323a-dc53-4e4d-b531-b7570bde4f8d tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Lock "/opt/stack/data/nova/instances/dd4ec7bd-002e-4a71-9314-96c21427af27/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:48:42 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-e41c323a-dc53-4e4d-b531-b7570bde4f8d tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:48:42 user nova-compute[73449]: DEBUG nova.compute.manager [req-3c02ac31-1de5-40c2-b751-f529401b6ac5 req-0f3e2771-dd08-4309-933a-796147d78b95 service nova] [instance: dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9] Received event network-vif-plugged-3fce3b24-0ebe-4f5d-b673-767f2b24a77a {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:48:42 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-3c02ac31-1de5-40c2-b751-f529401b6ac5 req-0f3e2771-dd08-4309-933a-796147d78b95 service nova] Acquiring lock "dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:48:42 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-3c02ac31-1de5-40c2-b751-f529401b6ac5 req-0f3e2771-dd08-4309-933a-796147d78b95 service nova] Lock "dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:48:42 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-3c02ac31-1de5-40c2-b751-f529401b6ac5 req-0f3e2771-dd08-4309-933a-796147d78b95 service nova] Lock "dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:48:42 user nova-compute[73449]: DEBUG nova.compute.manager [req-3c02ac31-1de5-40c2-b751-f529401b6ac5 req-0f3e2771-dd08-4309-933a-796147d78b95 service nova] [instance: dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9] No waiting events found dispatching network-vif-plugged-3fce3b24-0ebe-4f5d-b673-767f2b24a77a {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:48:42 user nova-compute[73449]: WARNING nova.compute.manager [req-3c02ac31-1de5-40c2-b751-f529401b6ac5 req-0f3e2771-dd08-4309-933a-796147d78b95 service nova] [instance: dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9] Received unexpected event network-vif-plugged-3fce3b24-0ebe-4f5d-b673-767f2b24a77a for instance with vm_state active and task_state None.
Aug 17 11:48:42 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-e41c323a-dc53-4e4d-b531-b7570bde4f8d tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json" returned: 0 in 0.224s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:48:42 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-e41c323a-dc53-4e4d-b531-b7570bde4f8d tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Acquiring lock "7e267a577c062ee862e95ede6b48cfd5632f3ea3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:48:42 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-e41c323a-dc53-4e4d-b531-b7570bde4f8d tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Lock "7e267a577c062ee862e95ede6b48cfd5632f3ea3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:48:42 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-e41c323a-dc53-4e4d-b531-b7570bde4f8d tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:48:42 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-e41c323a-dc53-4e4d-b531-b7570bde4f8d tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json" returned: 0 in 0.173s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:48:42 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-e41c323a-dc53-4e4d-b531-b7570bde4f8d tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3,backing_fmt=raw /opt/stack/data/nova/instances/dd4ec7bd-002e-4a71-9314-96c21427af27/disk 1073741824 {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:48:42 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-e41c323a-dc53-4e4d-b531-b7570bde4f8d tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3,backing_fmt=raw /opt/stack/data/nova/instances/dd4ec7bd-002e-4a71-9314-96c21427af27/disk 1073741824" returned: 0 in 0.051s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:48:42 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-e41c323a-dc53-4e4d-b531-b7570bde4f8d tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Lock "7e267a577c062ee862e95ede6b48cfd5632f3ea3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:48:42 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-e41c323a-dc53-4e4d-b531-b7570bde4f8d tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:48:43 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:48:43 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-e41c323a-dc53-4e4d-b531-b7570bde4f8d tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json" returned: 0 in 0.259s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:48:43 user nova-compute[73449]: DEBUG nova.virt.disk.api [None req-e41c323a-dc53-4e4d-b531-b7570bde4f8d tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dd4ec7bd-002e-4a71-9314-96c21427af27/disk. size=1073741824 {{(pid=73449) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 11:48:43 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-e41c323a-dc53-4e4d-b531-b7570bde4f8d tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd4ec7bd-002e-4a71-9314-96c21427af27/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:48:43 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:48:43 user nova-compute[73449]: DEBUG nova.network.neutron [None req-e41c323a-dc53-4e4d-b531-b7570bde4f8d tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] [instance: dd4ec7bd-002e-4a71-9314-96c21427af27] Successfully created port: 24acbd43-f1af-45d2-953d-53b3e4c24335 {{(pid=73449) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 11:48:43 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-e41c323a-dc53-4e4d-b531-b7570bde4f8d tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd4ec7bd-002e-4a71-9314-96c21427af27/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:48:43 user nova-compute[73449]: DEBUG nova.virt.disk.api [None req-e41c323a-dc53-4e4d-b531-b7570bde4f8d tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Cannot resize image /opt/stack/data/nova/instances/dd4ec7bd-002e-4a71-9314-96c21427af27/disk to a smaller size. {{(pid=73449) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 11:48:43 user nova-compute[73449]: DEBUG nova.objects.instance [None req-e41c323a-dc53-4e4d-b531-b7570bde4f8d tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Lazy-loading 'migration_context' on Instance uuid dd4ec7bd-002e-4a71-9314-96c21427af27 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:48:43 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-e41c323a-dc53-4e4d-b531-b7570bde4f8d tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] [instance: dd4ec7bd-002e-4a71-9314-96c21427af27] Created local disks {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 11:48:43 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-e41c323a-dc53-4e4d-b531-b7570bde4f8d tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] [instance: dd4ec7bd-002e-4a71-9314-96c21427af27] Ensure instance console log exists: /opt/stack/data/nova/instances/dd4ec7bd-002e-4a71-9314-96c21427af27/console.log {{(pid=73449) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 11:48:43 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-e41c323a-dc53-4e4d-b531-b7570bde4f8d tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:48:43 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-e41c323a-dc53-4e4d-b531-b7570bde4f8d tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:48:43 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-e41c323a-dc53-4e4d-b531-b7570bde4f8d tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:48:44 user nova-compute[73449]: DEBUG nova.network.neutron [None req-e41c323a-dc53-4e4d-b531-b7570bde4f8d tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] [instance: dd4ec7bd-002e-4a71-9314-96c21427af27] Successfully updated port: 24acbd43-f1af-45d2-953d-53b3e4c24335 {{(pid=73449) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 11:48:44 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-e41c323a-dc53-4e4d-b531-b7570bde4f8d tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Acquiring lock "refresh_cache-dd4ec7bd-002e-4a71-9314-96c21427af27" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:48:44 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-e41c323a-dc53-4e4d-b531-b7570bde4f8d tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Acquired lock "refresh_cache-dd4ec7bd-002e-4a71-9314-96c21427af27" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:48:44 user nova-compute[73449]: DEBUG nova.network.neutron [None req-e41c323a-dc53-4e4d-b531-b7570bde4f8d tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] [instance: dd4ec7bd-002e-4a71-9314-96c21427af27] Building network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 11:48:44 user nova-compute[73449]: DEBUG nova.compute.manager [req-aaac601a-c08b-459b-a4b9-016e793998e2 req-b8751464-5555-498f-8491-cf8d4292eb50 service nova] [instance: dd4ec7bd-002e-4a71-9314-96c21427af27] Received event network-changed-24acbd43-f1af-45d2-953d-53b3e4c24335 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:48:44 user nova-compute[73449]: DEBUG nova.compute.manager [req-aaac601a-c08b-459b-a4b9-016e793998e2 req-b8751464-5555-498f-8491-cf8d4292eb50 service nova] [instance: dd4ec7bd-002e-4a71-9314-96c21427af27] Refreshing instance network info cache due to event network-changed-24acbd43-f1af-45d2-953d-53b3e4c24335. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 11:48:44 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-aaac601a-c08b-459b-a4b9-016e793998e2 req-b8751464-5555-498f-8491-cf8d4292eb50 service nova] Acquiring lock "refresh_cache-dd4ec7bd-002e-4a71-9314-96c21427af27" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:48:44 user nova-compute[73449]: DEBUG nova.network.neutron [None req-e41c323a-dc53-4e4d-b531-b7570bde4f8d tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] [instance: dd4ec7bd-002e-4a71-9314-96c21427af27] Instance cache missing network info. {{(pid=73449) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 11:48:44 user nova-compute[73449]: DEBUG nova.network.neutron [None req-e41c323a-dc53-4e4d-b531-b7570bde4f8d tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] [instance: dd4ec7bd-002e-4a71-9314-96c21427af27] Updating instance_info_cache with network_info: [{"id": "24acbd43-f1af-45d2-953d-53b3e4c24335", "address": "fa:16:3e:20:8e:ea", "network": {"id": "c3e9bf16-545d-4ae8-bbad-5092c0e8f735", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1927778048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbaa73b99e5a498dac668e5307654fd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24acbd43-f1", "ovs_interfaceid": "24acbd43-f1af-45d2-953d-53b3e4c24335", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:48:44 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-e41c323a-dc53-4e4d-b531-b7570bde4f8d tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Releasing lock "refresh_cache-dd4ec7bd-002e-4a71-9314-96c21427af27" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:48:44 user nova-compute[73449]: DEBUG nova.compute.manager [None req-e41c323a-dc53-4e4d-b531-b7570bde4f8d tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] [instance: dd4ec7bd-002e-4a71-9314-96c21427af27] Instance network_info: |[{"id": "24acbd43-f1af-45d2-953d-53b3e4c24335", "address": "fa:16:3e:20:8e:ea", "network": {"id": "c3e9bf16-545d-4ae8-bbad-5092c0e8f735", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1927778048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbaa73b99e5a498dac668e5307654fd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24acbd43-f1", "ovs_interfaceid": "24acbd43-f1af-45d2-953d-53b3e4c24335", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73449) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 11:48:44 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-aaac601a-c08b-459b-a4b9-016e793998e2 req-b8751464-5555-498f-8491-cf8d4292eb50 service nova] Acquired lock "refresh_cache-dd4ec7bd-002e-4a71-9314-96c21427af27" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:48:44 user nova-compute[73449]: DEBUG nova.network.neutron [req-aaac601a-c08b-459b-a4b9-016e793998e2 req-b8751464-5555-498f-8491-cf8d4292eb50 service nova] [instance: dd4ec7bd-002e-4a71-9314-96c21427af27] Refreshing network info cache for port 24acbd43-f1af-45d2-953d-53b3e4c24335 {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 11:48:44 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-e41c323a-dc53-4e4d-b531-b7570bde4f8d tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] [instance: dd4ec7bd-002e-4a71-9314-96c21427af27] Start _get_guest_xml network_info=[{"id": "24acbd43-f1af-45d2-953d-53b3e4c24335", "address": "fa:16:3e:20:8e:ea", "network": {"id": "c3e9bf16-545d-4ae8-bbad-5092c0e8f735", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1927778048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbaa73b99e5a498dac668e5307654fd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24acbd43-f1", "ovs_interfaceid": "24acbd43-f1af-45d2-953d-53b3e4c24335", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T11:36:11Z,direct_url=<?>,disk_format='qcow2',id=0a2904ae-083d-41c8-83db-343132b36148,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7a77880136a54ef195c82e018e1939db',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T11:36:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': '0a2904ae-083d-41c8-83db-343132b36148'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 11:48:44 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-e41c323a-dc53-4e4d-b531-b7570bde4f8d tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:48:44 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-e41c323a-dc53-4e4d-b531-b7570bde4f8d tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:48:44 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-e41c323a-dc53-4e4d-b531-b7570bde4f8d tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 11:48:44 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-e41c323a-dc53-4e4d-b531-b7570bde4f8d tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] CPU controller missing on host. {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 11:48:44 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-e41c323a-dc53-4e4d-b531-b7570bde4f8d tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 11:48:44 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-e41c323a-dc53-4e4d-b531-b7570bde4f8d tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] CPU controller found on host. {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 11:48:44 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-e41c323a-dc53-4e4d-b531-b7570bde4f8d tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73449) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 11:48:44 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-e41c323a-dc53-4e4d-b531-b7570bde4f8d tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T11:35:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T11:36:11Z,direct_url=<?>,disk_format='qcow2',id=0a2904ae-083d-41c8-83db-343132b36148,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7a77880136a54ef195c82e018e1939db',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T11:36:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 11:48:44 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-e41c323a-dc53-4e4d-b531-b7570bde4f8d tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Flavor limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 11:48:44 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-e41c323a-dc53-4e4d-b531-b7570bde4f8d tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Image limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 11:48:44 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-e41c323a-dc53-4e4d-b531-b7570bde4f8d tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Flavor pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 11:48:44 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-e41c323a-dc53-4e4d-b531-b7570bde4f8d tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Image pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 11:48:44 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-e41c323a-dc53-4e4d-b531-b7570bde4f8d tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 11:48:44 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-e41c323a-dc53-4e4d-b531-b7570bde4f8d tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 11:48:44 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-e41c323a-dc53-4e4d-b531-b7570bde4f8d tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 11:48:44 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-e41c323a-dc53-4e4d-b531-b7570bde4f8d tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Got 1 possible topologies {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 11:48:44 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-e41c323a-dc53-4e4d-b531-b7570bde4f8d tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 11:48:44 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-e41c323a-dc53-4e4d-b531-b7570bde4f8d tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 11:48:44 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-e41c323a-dc53-4e4d-b531-b7570bde4f8d tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:48:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2005116148',display_name='tempest-ServersNegativeTestJSON-server-2005116148',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2005116148',id=24,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cbaa73b99e5a498dac668e5307654fd2',ramdisk_id='',reservation_id='r-0tzatvx0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-132584909',owner_user_name='tempest-ServersNegativeTestJSON-132584909-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T11:48:42Z,user_data=None,user_id='56d7fd2eae7c4e62a7cc0e917287f03f',uuid=dd4ec7bd-002e-4a71-9314-96c21427af27,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "24acbd43-f1af-45d2-953d-53b3e4c24335", "address": "fa:16:3e:20:8e:ea", "network": {"id": "c3e9bf16-545d-4ae8-bbad-5092c0e8f735", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1927778048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbaa73b99e5a498dac668e5307654fd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24acbd43-f1", "ovs_interfaceid": "24acbd43-f1af-45d2-953d-53b3e4c24335", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73449) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 11:48:44 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-e41c323a-dc53-4e4d-b531-b7570bde4f8d tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Converting VIF {"id": "24acbd43-f1af-45d2-953d-53b3e4c24335", "address": "fa:16:3e:20:8e:ea", "network": {"id": "c3e9bf16-545d-4ae8-bbad-5092c0e8f735", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1927778048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbaa73b99e5a498dac668e5307654fd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24acbd43-f1", "ovs_interfaceid": "24acbd43-f1af-45d2-953d-53b3e4c24335", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:48:44 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-e41c323a-dc53-4e4d-b531-b7570bde4f8d tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:8e:ea,bridge_name='br-int',has_traffic_filtering=True,id=24acbd43-f1af-45d2-953d-53b3e4c24335,network=Network(c3e9bf16-545d-4ae8-bbad-5092c0e8f735),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24acbd43-f1') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:48:44 user nova-compute[73449]: DEBUG nova.objects.instance [None req-e41c323a-dc53-4e4d-b531-b7570bde4f8d tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Lazy-loading 'pci_devices' on Instance uuid dd4ec7bd-002e-4a71-9314-96c21427af27 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:48:44 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-e41c323a-dc53-4e4d-b531-b7570bde4f8d tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] [instance: dd4ec7bd-002e-4a71-9314-96c21427af27] End _get_guest_xml xml=<domain type="kvm">
Aug 17 11:48:44 user nova-compute[73449]:   <uuid>dd4ec7bd-002e-4a71-9314-96c21427af27</uuid>
Aug 17 11:48:44 user nova-compute[73449]:   <name>instance-00000018</name>
Aug 17 11:48:44 user nova-compute[73449]:   <memory>524288</memory>
Aug 17 11:48:44 user nova-compute[73449]:   <vcpu>1</vcpu>
Aug 17 11:48:44 user nova-compute[73449]:   <metadata>
Aug 17 11:48:44 user nova-compute[73449]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 11:48:44 user nova-compute[73449]:       <nova:package version="0.0.0"/>
Aug 17 11:48:44 user nova-compute[73449]:       <nova:name>tempest-ServersNegativeTestJSON-server-2005116148</nova:name>
Aug 17 11:48:44 user nova-compute[73449]:       <nova:creationTime>2023-08-17 11:48:44</nova:creationTime>
Aug 17 11:48:44 user nova-compute[73449]:       <nova:flavor name="m1.tiny">
Aug 17 11:48:44 user nova-compute[73449]:         <nova:memory>512</nova:memory>
Aug 17 11:48:44 user nova-compute[73449]:         <nova:disk>1</nova:disk>
Aug 17 11:48:44 user nova-compute[73449]:         <nova:swap>0</nova:swap>
Aug 17 11:48:44 user nova-compute[73449]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 11:48:44 user nova-compute[73449]:         <nova:vcpus>1</nova:vcpus>
Aug 17 11:48:44 user nova-compute[73449]:       </nova:flavor>
Aug 17 11:48:44 user nova-compute[73449]:       <nova:owner>
Aug 17 11:48:44 user nova-compute[73449]:         <nova:user uuid="56d7fd2eae7c4e62a7cc0e917287f03f">tempest-ServersNegativeTestJSON-132584909-project-member</nova:user>
Aug 17 11:48:44 user nova-compute[73449]:         <nova:project uuid="cbaa73b99e5a498dac668e5307654fd2">tempest-ServersNegativeTestJSON-132584909</nova:project>
Aug 17 11:48:44 user nova-compute[73449]:       </nova:owner>
Aug 17 11:48:44 user nova-compute[73449]:       <nova:root type="image" uuid="0a2904ae-083d-41c8-83db-343132b36148"/>
Aug 17 11:48:44 user nova-compute[73449]:       <nova:ports>
Aug 17 11:48:44 user nova-compute[73449]:         <nova:port uuid="24acbd43-f1af-45d2-953d-53b3e4c24335">
Aug 17 11:48:44 user nova-compute[73449]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 17 11:48:44 user nova-compute[73449]:         </nova:port>
Aug 17 11:48:44 user nova-compute[73449]:       </nova:ports>
Aug 17 11:48:44 user nova-compute[73449]:     </nova:instance>
Aug 17 11:48:44 user nova-compute[73449]:   </metadata>
Aug 17 11:48:44 user nova-compute[73449]:   <sysinfo type="smbios">
Aug 17 11:48:44 user nova-compute[73449]:     <system>
Aug 17 11:48:44 user nova-compute[73449]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 11:48:44 user nova-compute[73449]:       <entry name="product">OpenStack Nova</entry>
Aug 17 11:48:44 user nova-compute[73449]:       <entry name="version">0.0.0</entry>
Aug 17 11:48:44 user nova-compute[73449]:       <entry name="serial">dd4ec7bd-002e-4a71-9314-96c21427af27</entry>
Aug 17 11:48:44 user nova-compute[73449]:       <entry name="uuid">dd4ec7bd-002e-4a71-9314-96c21427af27</entry>
Aug 17 11:48:44 user nova-compute[73449]:       <entry name="family">Virtual Machine</entry>
Aug 17 11:48:44 user nova-compute[73449]:     </system>
Aug 17 11:48:44 user nova-compute[73449]:   </sysinfo>
Aug 17 11:48:44 user nova-compute[73449]:   <os>
Aug 17 11:48:44 user nova-compute[73449]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 11:48:44 user nova-compute[73449]:     <boot dev="hd"/>
Aug 17 11:48:44 user nova-compute[73449]:     <smbios mode="sysinfo"/>
Aug 17 11:48:44 user nova-compute[73449]:   </os>
Aug 17 11:48:44 user nova-compute[73449]:   <features>
Aug 17 11:48:44 user nova-compute[73449]:     <acpi/>
Aug 17 11:48:44 user nova-compute[73449]:     <apic/>
Aug 17 11:48:44 user nova-compute[73449]:     <vmcoreinfo/>
Aug 17 11:48:44 user nova-compute[73449]:   </features>
Aug 17 11:48:44 user nova-compute[73449]:   <clock offset="utc">
Aug 17 11:48:44 user nova-compute[73449]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 11:48:44 user nova-compute[73449]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 11:48:44 user nova-compute[73449]:     <timer name="hpet" present="no"/>
Aug 17 11:48:44 user nova-compute[73449]:   </clock>
Aug 17 11:48:44 user nova-compute[73449]:   <cpu mode="custom" match="exact">
Aug 17 11:48:44 user nova-compute[73449]:     <model>Nehalem</model>
Aug 17 11:48:44 user nova-compute[73449]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 11:48:44 user nova-compute[73449]:   </cpu>
Aug 17 11:48:44 user nova-compute[73449]:   <devices>
Aug 17 11:48:44 user nova-compute[73449]:     <disk type="file" device="disk">
Aug 17 11:48:44 user nova-compute[73449]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 11:48:44 user nova-compute[73449]:       <source file="/opt/stack/data/nova/instances/dd4ec7bd-002e-4a71-9314-96c21427af27/disk"/>
Aug 17 11:48:44 user nova-compute[73449]:       <target dev="vda" bus="virtio"/>
Aug 17 11:48:44 user nova-compute[73449]:     </disk>
Aug 17 11:48:44 user nova-compute[73449]:     <interface type="ethernet">
Aug 17 11:48:44 user nova-compute[73449]:       <mac address="fa:16:3e:20:8e:ea"/>
Aug 17 11:48:44 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 11:48:44 user nova-compute[73449]:       <mtu size="1442"/>
Aug 17 11:48:44 user nova-compute[73449]:       <target dev="tap24acbd43-f1"/>
Aug 17 11:48:44 user nova-compute[73449]:     </interface>
Aug 17 11:48:44 user nova-compute[73449]:     <serial type="pty">
Aug 17 11:48:44 user nova-compute[73449]:       <log file="/opt/stack/data/nova/instances/dd4ec7bd-002e-4a71-9314-96c21427af27/console.log" append="off"/>
Aug 17 11:48:44 user nova-compute[73449]:     </serial>
Aug 17 11:48:44 user nova-compute[73449]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 11:48:44 user nova-compute[73449]:     <video>
Aug 17 11:48:44 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 11:48:44 user nova-compute[73449]:     </video>
Aug 17 11:48:44 user nova-compute[73449]:     <rng model="virtio">
Aug 17 11:48:44 user nova-compute[73449]:       <backend model="random">/dev/urandom</backend>
Aug 17 11:48:44 user nova-compute[73449]:     </rng>
Aug 17 11:48:44 user nova-compute[73449]:     <controller type="usb" index="0" model="none"/>
Aug 17 11:48:44 user nova-compute[73449]:     <memballoon model="virtio">
Aug 17 11:48:44 user nova-compute[73449]:       <stats period="10"/>
Aug 17 11:48:44 user nova-compute[73449]:     </memballoon>
Aug 17 11:48:44 user nova-compute[73449]:   </devices>
Aug 17 11:48:44 user nova-compute[73449]: </domain>
Aug 17 11:48:44 user nova-compute[73449]:  {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 11:48:44 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-e41c323a-dc53-4e4d-b531-b7570bde4f8d tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:48:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2005116148',display_name='tempest-ServersNegativeTestJSON-server-2005116148',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2005116148',id=24,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cbaa73b99e5a498dac668e5307654fd2',ramdisk_id='',reservation_id='r-0tzatvx0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-132584909',owner_user_name='tempest-ServersNegativeTestJSON-132584909-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T11:48:42Z,user_data=None,user_id='56d7fd2eae7c4e62a7cc0e917287f03f',uuid=dd4ec7bd-002e-4a71-9314-96c21427af27,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "24acbd43-f1af-45d2-953d-53b3e4c24335", "address": "fa:16:3e:20:8e:ea", "network": {"id": "c3e9bf16-545d-4ae8-bbad-5092c0e8f735", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1927778048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbaa73b99e5a498dac668e5307654fd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24acbd43-f1", "ovs_interfaceid": "24acbd43-f1af-45d2-953d-53b3e4c24335", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 11:48:44 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-e41c323a-dc53-4e4d-b531-b7570bde4f8d tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Converting VIF {"id": "24acbd43-f1af-45d2-953d-53b3e4c24335", "address": "fa:16:3e:20:8e:ea", "network": {"id": "c3e9bf16-545d-4ae8-bbad-5092c0e8f735", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1927778048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbaa73b99e5a498dac668e5307654fd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24acbd43-f1", "ovs_interfaceid": "24acbd43-f1af-45d2-953d-53b3e4c24335", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:48:44 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-e41c323a-dc53-4e4d-b531-b7570bde4f8d tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:8e:ea,bridge_name='br-int',has_traffic_filtering=True,id=24acbd43-f1af-45d2-953d-53b3e4c24335,network=Network(c3e9bf16-545d-4ae8-bbad-5092c0e8f735),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24acbd43-f1') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:48:44 user nova-compute[73449]: DEBUG os_vif [None req-e41c323a-dc53-4e4d-b531-b7570bde4f8d tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:8e:ea,bridge_name='br-int',has_traffic_filtering=True,id=24acbd43-f1af-45d2-953d-53b3e4c24335,network=Network(c3e9bf16-545d-4ae8-bbad-5092c0e8f735),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24acbd43-f1') {{(pid=73449) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 11:48:44 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:48:44 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:48:44 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 11:48:44 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:48:44 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap24acbd43-f1, may_exist=True, interface_attrs={}) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:48:44 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap24acbd43-f1, col_values=(('external_ids', {'iface-id': '24acbd43-f1af-45d2-953d-53b3e4c24335', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:20:8e:ea', 'vm-uuid': 'dd4ec7bd-002e-4a71-9314-96c21427af27'}),), if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:48:44 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:48:44 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:48:44 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:48:44 user nova-compute[73449]: INFO os_vif [None req-e41c323a-dc53-4e4d-b531-b7570bde4f8d tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:8e:ea,bridge_name='br-int',has_traffic_filtering=True,id=24acbd43-f1af-45d2-953d-53b3e4c24335,network=Network(c3e9bf16-545d-4ae8-bbad-5092c0e8f735),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24acbd43-f1')
Aug 17 11:48:44 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-e41c323a-dc53-4e4d-b531-b7570bde4f8d tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] No BDM found with device name vda, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 11:48:44 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-e41c323a-dc53-4e4d-b531-b7570bde4f8d tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] No VIF found with MAC fa:16:3e:20:8e:ea, not building metadata {{(pid=73449) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 11:48:45 user nova-compute[73449]: DEBUG nova.network.neutron [req-aaac601a-c08b-459b-a4b9-016e793998e2 req-b8751464-5555-498f-8491-cf8d4292eb50 service nova] [instance: dd4ec7bd-002e-4a71-9314-96c21427af27] Updated VIF entry in instance network info cache for port 24acbd43-f1af-45d2-953d-53b3e4c24335. {{(pid=73449) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 11:48:45 user nova-compute[73449]: DEBUG nova.network.neutron [req-aaac601a-c08b-459b-a4b9-016e793998e2 req-b8751464-5555-498f-8491-cf8d4292eb50 service nova] [instance: dd4ec7bd-002e-4a71-9314-96c21427af27] Updating instance_info_cache with network_info: [{"id": "24acbd43-f1af-45d2-953d-53b3e4c24335", "address": "fa:16:3e:20:8e:ea", "network": {"id": "c3e9bf16-545d-4ae8-bbad-5092c0e8f735", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1927778048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbaa73b99e5a498dac668e5307654fd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24acbd43-f1", "ovs_interfaceid": "24acbd43-f1af-45d2-953d-53b3e4c24335", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:48:45 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-aaac601a-c08b-459b-a4b9-016e793998e2 req-b8751464-5555-498f-8491-cf8d4292eb50 service nova] Releasing lock "refresh_cache-dd4ec7bd-002e-4a71-9314-96c21427af27" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:48:46 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:48:46 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:48:46 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:48:46 user nova-compute[73449]: DEBUG nova.compute.manager [req-37a8120a-2033-4c3f-bd1f-962972b95bc8 req-da2d4622-2503-4cb2-aa00-0172ae82dcbe service nova] [instance: dd4ec7bd-002e-4a71-9314-96c21427af27] Received event network-vif-plugged-24acbd43-f1af-45d2-953d-53b3e4c24335 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:48:46 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-37a8120a-2033-4c3f-bd1f-962972b95bc8 req-da2d4622-2503-4cb2-aa00-0172ae82dcbe service nova] Acquiring lock "dd4ec7bd-002e-4a71-9314-96c21427af27-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:48:46 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-37a8120a-2033-4c3f-bd1f-962972b95bc8 req-da2d4622-2503-4cb2-aa00-0172ae82dcbe service nova] Lock "dd4ec7bd-002e-4a71-9314-96c21427af27-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:48:46 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-37a8120a-2033-4c3f-bd1f-962972b95bc8 req-da2d4622-2503-4cb2-aa00-0172ae82dcbe service nova] Lock "dd4ec7bd-002e-4a71-9314-96c21427af27-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:48:46 user nova-compute[73449]: DEBUG nova.compute.manager [req-37a8120a-2033-4c3f-bd1f-962972b95bc8 req-da2d4622-2503-4cb2-aa00-0172ae82dcbe service nova] [instance: dd4ec7bd-002e-4a71-9314-96c21427af27] No waiting events found dispatching network-vif-plugged-24acbd43-f1af-45d2-953d-53b3e4c24335 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:48:46 user nova-compute[73449]: WARNING nova.compute.manager [req-37a8120a-2033-4c3f-bd1f-962972b95bc8 req-da2d4622-2503-4cb2-aa00-0172ae82dcbe service nova] [instance: dd4ec7bd-002e-4a71-9314-96c21427af27] Received unexpected event network-vif-plugged-24acbd43-f1af-45d2-953d-53b3e4c24335 for instance with vm_state building and task_state spawning.
Aug 17 11:48:46 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:48:46 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:48:48 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:48:48 user nova-compute[73449]: DEBUG nova.compute.manager [req-14273129-054d-4ec9-b472-91c862e5ae0f req-2e0aabe3-064c-4137-a238-0a07576b9864 service nova] [instance: dd4ec7bd-002e-4a71-9314-96c21427af27] Received event network-vif-plugged-24acbd43-f1af-45d2-953d-53b3e4c24335 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:48:48 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-14273129-054d-4ec9-b472-91c862e5ae0f req-2e0aabe3-064c-4137-a238-0a07576b9864 service nova] Acquiring lock "dd4ec7bd-002e-4a71-9314-96c21427af27-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:48:48 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-14273129-054d-4ec9-b472-91c862e5ae0f req-2e0aabe3-064c-4137-a238-0a07576b9864 service nova] Lock "dd4ec7bd-002e-4a71-9314-96c21427af27-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:48:48 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-14273129-054d-4ec9-b472-91c862e5ae0f req-2e0aabe3-064c-4137-a238-0a07576b9864 service nova] Lock "dd4ec7bd-002e-4a71-9314-96c21427af27-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:48:48 user nova-compute[73449]: DEBUG nova.compute.manager [req-14273129-054d-4ec9-b472-91c862e5ae0f req-2e0aabe3-064c-4137-a238-0a07576b9864 service nova] [instance: dd4ec7bd-002e-4a71-9314-96c21427af27] No waiting events found dispatching network-vif-plugged-24acbd43-f1af-45d2-953d-53b3e4c24335 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:48:48 user nova-compute[73449]: WARNING nova.compute.manager [req-14273129-054d-4ec9-b472-91c862e5ae0f req-2e0aabe3-064c-4137-a238-0a07576b9864 service nova] [instance: dd4ec7bd-002e-4a71-9314-96c21427af27] Received unexpected event network-vif-plugged-24acbd43-f1af-45d2-953d-53b3e4c24335 for instance with vm_state building and task_state spawning.
Aug 17 11:48:48 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:48:49 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692272929.0176802, dd4ec7bd-002e-4a71-9314-96c21427af27 => Resumed> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:48:49 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: dd4ec7bd-002e-4a71-9314-96c21427af27] VM Resumed (Lifecycle Event)
Aug 17 11:48:49 user nova-compute[73449]: DEBUG nova.compute.manager [None req-e41c323a-dc53-4e4d-b531-b7570bde4f8d tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] [instance: dd4ec7bd-002e-4a71-9314-96c21427af27] Instance event wait completed in 0 seconds for  {{(pid=73449) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 11:48:49 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-e41c323a-dc53-4e4d-b531-b7570bde4f8d tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] [instance: dd4ec7bd-002e-4a71-9314-96c21427af27] Guest created on hypervisor {{(pid=73449) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 11:48:49 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: dd4ec7bd-002e-4a71-9314-96c21427af27] Instance spawned successfully.
Aug 17 11:48:49 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-e41c323a-dc53-4e4d-b531-b7570bde4f8d tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] [instance: dd4ec7bd-002e-4a71-9314-96c21427af27] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 11:48:49 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: dd4ec7bd-002e-4a71-9314-96c21427af27] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:48:49 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: dd4ec7bd-002e-4a71-9314-96c21427af27] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 11:48:49 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-e41c323a-dc53-4e4d-b531-b7570bde4f8d tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] [instance: dd4ec7bd-002e-4a71-9314-96c21427af27] Found default for hw_cdrom_bus of ide {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:48:49 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-e41c323a-dc53-4e4d-b531-b7570bde4f8d tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] [instance: dd4ec7bd-002e-4a71-9314-96c21427af27] Found default for hw_disk_bus of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:48:49 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-e41c323a-dc53-4e4d-b531-b7570bde4f8d tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] [instance: dd4ec7bd-002e-4a71-9314-96c21427af27] Found default for hw_input_bus of None {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:48:49 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-e41c323a-dc53-4e4d-b531-b7570bde4f8d tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] [instance: dd4ec7bd-002e-4a71-9314-96c21427af27] Found default for hw_pointer_model of None {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:48:49 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-e41c323a-dc53-4e4d-b531-b7570bde4f8d tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] [instance: dd4ec7bd-002e-4a71-9314-96c21427af27] Found default for hw_video_model of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:48:49 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-e41c323a-dc53-4e4d-b531-b7570bde4f8d tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] [instance: dd4ec7bd-002e-4a71-9314-96c21427af27] Found default for hw_vif_model of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:48:49 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: dd4ec7bd-002e-4a71-9314-96c21427af27] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 11:48:49 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692272929.022236, dd4ec7bd-002e-4a71-9314-96c21427af27 => Started> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:48:49 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: dd4ec7bd-002e-4a71-9314-96c21427af27] VM Started (Lifecycle Event)
Aug 17 11:48:49 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: dd4ec7bd-002e-4a71-9314-96c21427af27] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:48:49 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: dd4ec7bd-002e-4a71-9314-96c21427af27] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 11:48:49 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: dd4ec7bd-002e-4a71-9314-96c21427af27] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 11:48:49 user nova-compute[73449]: INFO nova.compute.manager [None req-e41c323a-dc53-4e4d-b531-b7570bde4f8d tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] [instance: dd4ec7bd-002e-4a71-9314-96c21427af27] Took 6.75 seconds to spawn the instance on the hypervisor.
Aug 17 11:48:49 user nova-compute[73449]: DEBUG nova.compute.manager [None req-e41c323a-dc53-4e4d-b531-b7570bde4f8d tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] [instance: dd4ec7bd-002e-4a71-9314-96c21427af27] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:48:49 user nova-compute[73449]: INFO nova.compute.manager [None req-e41c323a-dc53-4e4d-b531-b7570bde4f8d tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] [instance: dd4ec7bd-002e-4a71-9314-96c21427af27] Took 7.59 seconds to build instance.
Aug 17 11:48:49 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-e41c323a-dc53-4e4d-b531-b7570bde4f8d tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Lock "dd4ec7bd-002e-4a71-9314-96c21427af27" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.707s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:48:49 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:48:49 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:48:50 user nova-compute[73449]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692272915.2786307, 5612f7d1-a901-4bdd-a24a-faf9a980cd04 => Stopped> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:48:50 user nova-compute[73449]: INFO nova.compute.manager [-] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] VM Stopped (Lifecycle Event)
Aug 17 11:48:50 user nova-compute[73449]: DEBUG nova.compute.manager [None req-ba1fb96b-2c82-4b6d-97e3-ba7df464c57f None None] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:48:50 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:48:50 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:48:50 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:48:51 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:48:51 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:48:51 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73449) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 11:48:52 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-d6457748-e9e0-4e39-bec6-c443e162edf7 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Acquiring lock "f35b7f2b-2f88-4b09-86ac-cb5a78a94584" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:48:52 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-d6457748-e9e0-4e39-bec6-c443e162edf7 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Lock "f35b7f2b-2f88-4b09-86ac-cb5a78a94584" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:48:52 user nova-compute[73449]: INFO nova.compute.manager [None req-d6457748-e9e0-4e39-bec6-c443e162edf7 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] Detaching volume 0254b152-714d-470d-bfac-2bb7b2761466
Aug 17 11:48:52 user nova-compute[73449]: INFO nova.virt.block_device [None req-d6457748-e9e0-4e39-bec6-c443e162edf7 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] Attempting to driver detach volume 0254b152-714d-470d-bfac-2bb7b2761466 from mountpoint /dev/vdb
Aug 17 11:48:52 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-d6457748-e9e0-4e39-bec6-c443e162edf7 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Attempting to detach device vdb from instance f35b7f2b-2f88-4b09-86ac-cb5a78a94584 from the persistent domain config. {{(pid=73449) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 11:48:52 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-d6457748-e9e0-4e39-bec6-c443e162edf7 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 11:48:52 user nova-compute[73449]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 11:48:52 user nova-compute[73449]:   <source dev="/dev/sdd"/>
Aug 17 11:48:52 user nova-compute[73449]:   <target dev="vdb" bus="virtio"/>
Aug 17 11:48:52 user nova-compute[73449]:   <serial>0254b152-714d-470d-bfac-2bb7b2761466</serial>
Aug 17 11:48:52 user nova-compute[73449]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 17 11:48:52 user nova-compute[73449]: </disk>
Aug 17 11:48:52 user nova-compute[73449]:  {{(pid=73449) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 11:48:52 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-d6457748-e9e0-4e39-bec6-c443e162edf7 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Successfully detached device vdb from instance f35b7f2b-2f88-4b09-86ac-cb5a78a94584 from the persistent domain config.
Aug 17 11:48:52 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-d6457748-e9e0-4e39-bec6-c443e162edf7 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f35b7f2b-2f88-4b09-86ac-cb5a78a94584 from the live domain config. {{(pid=73449) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 11:48:52 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-d6457748-e9e0-4e39-bec6-c443e162edf7 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 11:48:52 user nova-compute[73449]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 11:48:52 user nova-compute[73449]:   <source dev="/dev/sdd"/>
Aug 17 11:48:52 user nova-compute[73449]:   <target dev="vdb" bus="virtio"/>
Aug 17 11:48:52 user nova-compute[73449]:   <serial>0254b152-714d-470d-bfac-2bb7b2761466</serial>
Aug 17 11:48:52 user nova-compute[73449]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 17 11:48:52 user nova-compute[73449]: </disk>
Aug 17 11:48:52 user nova-compute[73449]:  {{(pid=73449) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 11:48:52 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:48:53 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:48:53 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Received event <DeviceRemovedEvent: 1692272933.279076, f35b7f2b-2f88-4b09-86ac-cb5a78a94584 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73449) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 11:48:53 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-d6457748-e9e0-4e39-bec6-c443e162edf7 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f35b7f2b-2f88-4b09-86ac-cb5a78a94584 {{(pid=73449) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 11:48:53 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-d6457748-e9e0-4e39-bec6-c443e162edf7 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Successfully detached device vdb from instance f35b7f2b-2f88-4b09-86ac-cb5a78a94584 from the live domain config.
Aug 17 11:48:53 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6457748-e9e0-4e39-bec6-c443e162edf7 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] calling os-brick to detach iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 11:48:53 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6457748-e9e0-4e39-bec6-c443e162edf7 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, {'target_iqns': ['iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sIVNXdDt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 11:48:53 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-d6457748-e9e0-4e39-bec6-c443e162edf7 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 11:48:53 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-d6457748-e9e0-4e39-bec6-c443e162edf7 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:48:53 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-d6457748-e9e0-4e39-bec6-c443e162edf7 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:48:53 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6457748-e9e0-4e39-bec6-c443e162edf7 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466', 0)] {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 11:48:53 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:48:53 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:48:53 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[59de527c-35d4-44c8-b825-ba718f6317bf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:48:53 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:48:53 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:48:53 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[9666ecc8-de44-46f8-8285-4d2647833a63]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:48:53 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6457748-e9e0-4e39-bec6-c443e162edf7 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466 (non-flash)
Aug 17 11:48:53 user nova-compute[73449]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c (non-flash)
Aug 17 11:48:53 user nova-compute[73449]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed (non-flash)
Aug 17 11:48:53 user nova-compute[73449]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe (non-flash)
Aug 17 11:48:53 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:48:53 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6457748-e9e0-4e39-bec6-c443e162edf7 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466 (non-flash)
Aug 17 11:48:53 user nova-compute[73449]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c (non-flash)
Aug 17 11:48:53 user nova-compute[73449]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed (non-flash)
Aug 17 11:48:53 user nova-compute[73449]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe (non-flash)
Aug 17 11:48:53 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:48:53 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6457748-e9e0-4e39-bec6-c443e162edf7 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe75811eb90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466'): ({'sdd'}, set())}) {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 11:48:53 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-d6457748-e9e0-4e39-bec6-c443e162edf7 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Removing single pathed devices sdd {{(pid=73449) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 11:48:53 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:48:53 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.035s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:48:53 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[34d959e8-ad72-47b7-9216-cde84ffdd732]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:48:53 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:48:53 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:48:53 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[157cec68-4299-4e0f-b8ca-0058864468f9]: (4, ('ok\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:48:53 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-d6457748-e9e0-4e39-bec6-c443e162edf7 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Flushing IO for device /dev/sdd {{(pid=73449) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 11:48:53 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:48:53 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:48:53 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3e566d5-7e54-47b8-87b6-34766fc67c07]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:48:53 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-d6457748-e9e0-4e39-bec6-c443e162edf7 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73449) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 11:48:53 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:48:53 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.054s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:48:53 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c44f0e9-2697-4577-8ac2-d706352654d8]: (4, ('1', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:48:53 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-d6457748-e9e0-4e39-bec6-c443e162edf7 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73449) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 11:48:53 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-d6457748-e9e0-4e39-bec6-c443e162edf7 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] SCSI volumes sdd have been removed. {{(pid=73449) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 11:48:53 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6457748-e9e0-4e39-bec6-c443e162edf7 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466')] {{(pid=73449) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 11:48:53 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:48:53 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:48:53 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0228e46-963e-4e2e-9ed3-d8e6010afcc4]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:48:53 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6457748-e9e0-4e39-bec6-c443e162edf7 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:48:53 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466 -p 172.16.0.220:3260 --logout {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:48:53 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:48:53 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[e97c5555-af90-44f4-9b44-72caf6d06c4b]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:48:53 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6457748-e9e0-4e39-bec6-c443e162edf7 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466, portal: 172.16.0.220,3260]
Aug 17 11:48:53 user nova-compute[73449]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466, portal: 172.16.0.220,3260] successful.
Aug 17 11:48:53 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:48:53 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466 -p 172.16.0.220:3260 --op delete {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:48:53 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0254b152-714d-470d-bfac-2bb7b2761466 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:48:53 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[7acf085c-c726-4020-84a8-fa11d44dd08e]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:48:53 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6457748-e9e0-4e39-bec6-c443e162edf7 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:48:53 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-d6457748-e9e0-4e39-bec6-c443e162edf7 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.354s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:48:53 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6457748-e9e0-4e39-bec6-c443e162edf7 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] <== disconnect_volume: return (356ms) None {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 11:48:53 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6457748-e9e0-4e39-bec6-c443e162edf7 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] Disconnected iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 11:48:54 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b182b846-081c-415a-869f-14aec45b2269 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Acquiring lock "fea9f81c-a848-4a65-863e-e09dddf65bcf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:48:54 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b182b846-081c-415a-869f-14aec45b2269 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Lock "fea9f81c-a848-4a65-863e-e09dddf65bcf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:48:54 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b182b846-081c-415a-869f-14aec45b2269 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Starting instance... {{(pid=73449) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 11:48:54 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b182b846-081c-415a-869f-14aec45b2269 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:48:54 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b182b846-081c-415a-869f-14aec45b2269 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:48:54 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-b182b846-081c-415a-869f-14aec45b2269 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73449) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 11:48:54 user nova-compute[73449]: INFO nova.compute.claims [None req-b182b846-081c-415a-869f-14aec45b2269 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Claim successful on node user
Aug 17 11:48:54 user nova-compute[73449]: DEBUG nova.objects.instance [None req-d6457748-e9e0-4e39-bec6-c443e162edf7 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Lazy-loading 'flavor' on Instance uuid f35b7f2b-2f88-4b09-86ac-cb5a78a94584 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:48:54 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-d6457748-e9e0-4e39-bec6-c443e162edf7 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Lock "f35b7f2b-2f88-4b09-86ac-cb5a78a94584" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.918s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:48:54 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-b182b846-081c-415a-869f-14aec45b2269 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 11:48:54 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:48:54 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-b182b846-081c-415a-869f-14aec45b2269 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 11:48:54 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b182b846-081c-415a-869f-14aec45b2269 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.420s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:48:54 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b182b846-081c-415a-869f-14aec45b2269 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Start building networks asynchronously for instance. {{(pid=73449) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 11:48:54 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b182b846-081c-415a-869f-14aec45b2269 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Allocating IP information in the background. {{(pid=73449) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 11:48:54 user nova-compute[73449]: DEBUG nova.network.neutron [None req-b182b846-081c-415a-869f-14aec45b2269 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] allocate_for_instance() {{(pid=73449) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 11:48:54 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-b182b846-081c-415a-869f-14aec45b2269 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 11:48:54 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b182b846-081c-415a-869f-14aec45b2269 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Start building block device mappings for instance. {{(pid=73449) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 11:48:54 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:48:54 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Starting heal instance info cache {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 11:48:54 user nova-compute[73449]: DEBUG nova.policy [None req-b182b846-081c-415a-869f-14aec45b2269 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '17ee7be9cdb14c5ca211a6b0bb80ccc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe7b5fee01a042bb90e40b18a84c82c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73449) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 11:48:55 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b182b846-081c-415a-869f-14aec45b2269 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Start spawning the instance on the hypervisor. {{(pid=73449) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 11:48:55 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b182b846-081c-415a-869f-14aec45b2269 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Creating instance directory {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 11:48:55 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-b182b846-081c-415a-869f-14aec45b2269 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Creating image(s)
Aug 17 11:48:55 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b182b846-081c-415a-869f-14aec45b2269 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Acquiring lock "/opt/stack/data/nova/instances/fea9f81c-a848-4a65-863e-e09dddf65bcf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:48:55 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b182b846-081c-415a-869f-14aec45b2269 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Lock "/opt/stack/data/nova/instances/fea9f81c-a848-4a65-863e-e09dddf65bcf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:48:55 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b182b846-081c-415a-869f-14aec45b2269 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Lock "/opt/stack/data/nova/instances/fea9f81c-a848-4a65-863e-e09dddf65bcf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:48:55 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-b182b846-081c-415a-869f-14aec45b2269 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:48:55 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "refresh_cache-de5084e1-5a5e-48d2-a3ef-7f29898d1d2d" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:48:55 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquired lock "refresh_cache-de5084e1-5a5e-48d2-a3ef-7f29898d1d2d" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:48:55 user nova-compute[73449]: DEBUG nova.network.neutron [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] Forcefully refreshing network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 11:48:55 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-b182b846-081c-415a-869f-14aec45b2269 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json" returned: 0 in 0.192s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:48:55 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b182b846-081c-415a-869f-14aec45b2269 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Acquiring lock "7e267a577c062ee862e95ede6b48cfd5632f3ea3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:48:55 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b182b846-081c-415a-869f-14aec45b2269 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Lock "7e267a577c062ee862e95ede6b48cfd5632f3ea3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:48:55 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-b182b846-081c-415a-869f-14aec45b2269 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:48:55 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-b182b846-081c-415a-869f-14aec45b2269 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json" returned: 0 in 0.193s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:48:55 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-b182b846-081c-415a-869f-14aec45b2269 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3,backing_fmt=raw /opt/stack/data/nova/instances/fea9f81c-a848-4a65-863e-e09dddf65bcf/disk 1073741824 {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:48:55 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-b182b846-081c-415a-869f-14aec45b2269 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3,backing_fmt=raw /opt/stack/data/nova/instances/fea9f81c-a848-4a65-863e-e09dddf65bcf/disk 1073741824" returned: 0 in 0.057s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:48:55 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b182b846-081c-415a-869f-14aec45b2269 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Lock "7e267a577c062ee862e95ede6b48cfd5632f3ea3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:48:55 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-b182b846-081c-415a-869f-14aec45b2269 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:48:55 user nova-compute[73449]: DEBUG nova.network.neutron [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] Updating instance_info_cache with network_info: [{"id": "e2af7fce-7442-48b4-8611-da3171b0672b", "address": "fa:16:3e:c0:c8:a6", "network": {"id": "ff73f5c3-bae6-46cc-bcb8-bbd5be1b478d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1229197917-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5ba3ebf47bd4b999e68c74a5c0ab060", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2af7fce-74", "ovs_interfaceid": "e2af7fce-7442-48b4-8611-da3171b0672b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:48:55 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-b182b846-081c-415a-869f-14aec45b2269 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json" returned: 0 in 0.219s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:48:55 user nova-compute[73449]: DEBUG nova.virt.disk.api [None req-b182b846-081c-415a-869f-14aec45b2269 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fea9f81c-a848-4a65-863e-e09dddf65bcf/disk. size=1073741824 {{(pid=73449) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 11:48:55 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-b182b846-081c-415a-869f-14aec45b2269 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fea9f81c-a848-4a65-863e-e09dddf65bcf/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:48:55 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Releasing lock "refresh_cache-de5084e1-5a5e-48d2-a3ef-7f29898d1d2d" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:48:55 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] Updated the network info_cache for instance {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 11:48:55 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-b182b846-081c-415a-869f-14aec45b2269 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fea9f81c-a848-4a65-863e-e09dddf65bcf/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:48:55 user nova-compute[73449]: DEBUG nova.virt.disk.api [None req-b182b846-081c-415a-869f-14aec45b2269 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Cannot resize image /opt/stack/data/nova/instances/fea9f81c-a848-4a65-863e-e09dddf65bcf/disk to a smaller size. {{(pid=73449) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 11:48:55 user nova-compute[73449]: DEBUG nova.objects.instance [None req-b182b846-081c-415a-869f-14aec45b2269 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Lazy-loading 'migration_context' on Instance uuid fea9f81c-a848-4a65-863e-e09dddf65bcf {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:48:55 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b182b846-081c-415a-869f-14aec45b2269 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Created local disks {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 11:48:55 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b182b846-081c-415a-869f-14aec45b2269 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Ensure instance console log exists: /opt/stack/data/nova/instances/fea9f81c-a848-4a65-863e-e09dddf65bcf/console.log {{(pid=73449) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 11:48:55 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b182b846-081c-415a-869f-14aec45b2269 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:48:55 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b182b846-081c-415a-869f-14aec45b2269 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:48:55 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b182b846-081c-415a-869f-14aec45b2269 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:48:55 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-2bd84e8d-3e0d-4f81-9d32-b576b0658a1e tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Acquiring lock "a5836f8c-079b-4437-ab51-6878f0a4a7f8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:48:55 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-2bd84e8d-3e0d-4f81-9d32-b576b0658a1e tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Lock "a5836f8c-079b-4437-ab51-6878f0a4a7f8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:48:55 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-2bd84e8d-3e0d-4f81-9d32-b576b0658a1e tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Acquiring lock "a5836f8c-079b-4437-ab51-6878f0a4a7f8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:48:55 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-2bd84e8d-3e0d-4f81-9d32-b576b0658a1e tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Lock "a5836f8c-079b-4437-ab51-6878f0a4a7f8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:48:55 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-2bd84e8d-3e0d-4f81-9d32-b576b0658a1e tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Lock "a5836f8c-079b-4437-ab51-6878f0a4a7f8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:48:55 user nova-compute[73449]: INFO nova.compute.manager [None req-2bd84e8d-3e0d-4f81-9d32-b576b0658a1e tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] [instance: a5836f8c-079b-4437-ab51-6878f0a4a7f8] Terminating instance
Aug 17 11:48:55 user nova-compute[73449]: DEBUG nova.compute.manager [None req-2bd84e8d-3e0d-4f81-9d32-b576b0658a1e tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] [instance: a5836f8c-079b-4437-ab51-6878f0a4a7f8] Start destroying the instance on the hypervisor. {{(pid=73449) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 11:48:56 user nova-compute[73449]: DEBUG nova.network.neutron [None req-b182b846-081c-415a-869f-14aec45b2269 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Successfully created port: 5db97a8e-3943-4259-ae41-cec1946c33f8 {{(pid=73449) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 11:48:56 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:48:56 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:48:56 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:48:56 user nova-compute[73449]: DEBUG nova.compute.manager [req-24e3990a-008f-4a0c-8a35-d4ccc869cf47 req-fb50b5db-c390-4fc3-9b2a-2bf673980888 service nova] [instance: a5836f8c-079b-4437-ab51-6878f0a4a7f8] Received event network-vif-unplugged-452715bd-2291-4c3c-b6e8-a692dc72d1ac {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:48:56 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-24e3990a-008f-4a0c-8a35-d4ccc869cf47 req-fb50b5db-c390-4fc3-9b2a-2bf673980888 service nova] Acquiring lock "a5836f8c-079b-4437-ab51-6878f0a4a7f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:48:56 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-24e3990a-008f-4a0c-8a35-d4ccc869cf47 req-fb50b5db-c390-4fc3-9b2a-2bf673980888 service nova] Lock "a5836f8c-079b-4437-ab51-6878f0a4a7f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:48:56 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-24e3990a-008f-4a0c-8a35-d4ccc869cf47 req-fb50b5db-c390-4fc3-9b2a-2bf673980888 service nova] Lock "a5836f8c-079b-4437-ab51-6878f0a4a7f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:48:56 user nova-compute[73449]: DEBUG nova.compute.manager [req-24e3990a-008f-4a0c-8a35-d4ccc869cf47 req-fb50b5db-c390-4fc3-9b2a-2bf673980888 service nova] [instance: a5836f8c-079b-4437-ab51-6878f0a4a7f8] No waiting events found dispatching network-vif-unplugged-452715bd-2291-4c3c-b6e8-a692dc72d1ac {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:48:56 user nova-compute[73449]: DEBUG nova.compute.manager [req-24e3990a-008f-4a0c-8a35-d4ccc869cf47 req-fb50b5db-c390-4fc3-9b2a-2bf673980888 service nova] [instance: a5836f8c-079b-4437-ab51-6878f0a4a7f8] Received event network-vif-unplugged-452715bd-2291-4c3c-b6e8-a692dc72d1ac for instance with task_state deleting. {{(pid=73449) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 11:48:56 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: a5836f8c-079b-4437-ab51-6878f0a4a7f8] Instance destroyed successfully.
Aug 17 11:48:56 user nova-compute[73449]: DEBUG nova.objects.instance [None req-2bd84e8d-3e0d-4f81-9d32-b576b0658a1e tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Lazy-loading 'resources' on Instance uuid a5836f8c-079b-4437-ab51-6878f0a4a7f8 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:48:56 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-2bd84e8d-3e0d-4f81-9d32-b576b0658a1e tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:47:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1497429960',display_name='tempest-VolumesActionsTest-instance-1497429960',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1497429960',id=22,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T11:47:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='54b447696c4a49e5838ae21456bc60e3',ramdisk_id='',reservation_id='r-pg6f2cf2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-407682915',owner_user_name='tempest-VolumesActionsTest-407682915-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T11:47:12Z,user_data=None,user_id='652d1ea975dc454aa4c72d74ddd8af68',uuid=a5836f8c-079b-4437-ab51-6878f0a4a7f8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "452715bd-2291-4c3c-b6e8-a692dc72d1ac", "address": "fa:16:3e:75:d1:04", "network": {"id": "76705db8-2e7f-449c-b512-6747bad0c324", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1601912422-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54b447696c4a49e5838ae21456bc60e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap452715bd-22", "ovs_interfaceid": "452715bd-2291-4c3c-b6e8-a692dc72d1ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 11:48:56 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-2bd84e8d-3e0d-4f81-9d32-b576b0658a1e tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Converting VIF {"id": "452715bd-2291-4c3c-b6e8-a692dc72d1ac", "address": "fa:16:3e:75:d1:04", "network": {"id": "76705db8-2e7f-449c-b512-6747bad0c324", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1601912422-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54b447696c4a49e5838ae21456bc60e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap452715bd-22", "ovs_interfaceid": "452715bd-2291-4c3c-b6e8-a692dc72d1ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:48:56 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-2bd84e8d-3e0d-4f81-9d32-b576b0658a1e tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:d1:04,bridge_name='br-int',has_traffic_filtering=True,id=452715bd-2291-4c3c-b6e8-a692dc72d1ac,network=Network(76705db8-2e7f-449c-b512-6747bad0c324),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap452715bd-22') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:48:56 user nova-compute[73449]: DEBUG os_vif [None req-2bd84e8d-3e0d-4f81-9d32-b576b0658a1e tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:d1:04,bridge_name='br-int',has_traffic_filtering=True,id=452715bd-2291-4c3c-b6e8-a692dc72d1ac,network=Network(76705db8-2e7f-449c-b512-6747bad0c324),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap452715bd-22') {{(pid=73449) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 11:48:56 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:48:56 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap452715bd-22, bridge=br-int, if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:48:56 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:48:56 user nova-compute[73449]: DEBUG nova.network.neutron [None req-b182b846-081c-415a-869f-14aec45b2269 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Successfully updated port: 5db97a8e-3943-4259-ae41-cec1946c33f8 {{(pid=73449) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 11:48:56 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:48:56 user nova-compute[73449]: INFO os_vif [None req-2bd84e8d-3e0d-4f81-9d32-b576b0658a1e tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:d1:04,bridge_name='br-int',has_traffic_filtering=True,id=452715bd-2291-4c3c-b6e8-a692dc72d1ac,network=Network(76705db8-2e7f-449c-b512-6747bad0c324),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap452715bd-22')
Aug 17 11:48:56 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-2bd84e8d-3e0d-4f81-9d32-b576b0658a1e tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] [instance: a5836f8c-079b-4437-ab51-6878f0a4a7f8] Deleting instance files /opt/stack/data/nova/instances/a5836f8c-079b-4437-ab51-6878f0a4a7f8_del
Aug 17 11:48:56 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-2bd84e8d-3e0d-4f81-9d32-b576b0658a1e tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] [instance: a5836f8c-079b-4437-ab51-6878f0a4a7f8] Deletion of /opt/stack/data/nova/instances/a5836f8c-079b-4437-ab51-6878f0a4a7f8_del complete
Aug 17 11:48:56 user nova-compute[73449]: DEBUG nova.compute.manager [req-46b9a194-a761-4773-bc8d-d451e8bce07d req-e3f05ca9-04f6-4ca5-a58c-6ca9af0d5edb service nova] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Received event network-changed-5db97a8e-3943-4259-ae41-cec1946c33f8 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:48:56 user nova-compute[73449]: DEBUG nova.compute.manager [req-46b9a194-a761-4773-bc8d-d451e8bce07d req-e3f05ca9-04f6-4ca5-a58c-6ca9af0d5edb service nova] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Refreshing instance network info cache due to event network-changed-5db97a8e-3943-4259-ae41-cec1946c33f8. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 11:48:56 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-46b9a194-a761-4773-bc8d-d451e8bce07d req-e3f05ca9-04f6-4ca5-a58c-6ca9af0d5edb service nova] Acquiring lock "refresh_cache-fea9f81c-a848-4a65-863e-e09dddf65bcf" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:48:56 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-46b9a194-a761-4773-bc8d-d451e8bce07d req-e3f05ca9-04f6-4ca5-a58c-6ca9af0d5edb service nova] Acquired lock "refresh_cache-fea9f81c-a848-4a65-863e-e09dddf65bcf" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:48:56 user nova-compute[73449]: DEBUG nova.network.neutron [req-46b9a194-a761-4773-bc8d-d451e8bce07d req-e3f05ca9-04f6-4ca5-a58c-6ca9af0d5edb service nova] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Refreshing network info cache for port 5db97a8e-3943-4259-ae41-cec1946c33f8 {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 11:48:56 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:48:56 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:48:56 user nova-compute[73449]: DEBUG nova.network.neutron [req-46b9a194-a761-4773-bc8d-d451e8bce07d req-e3f05ca9-04f6-4ca5-a58c-6ca9af0d5edb service nova] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Instance cache missing network info. {{(pid=73449) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 11:48:56 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:48:56 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:48:56 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:48:56 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=73449) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 11:48:56 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b182b846-081c-415a-869f-14aec45b2269 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Acquiring lock "refresh_cache-fea9f81c-a848-4a65-863e-e09dddf65bcf" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:48:57 user nova-compute[73449]: INFO nova.compute.manager [None req-2bd84e8d-3e0d-4f81-9d32-b576b0658a1e tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] [instance: a5836f8c-079b-4437-ab51-6878f0a4a7f8] Took 1.09 seconds to destroy the instance on the hypervisor.
Aug 17 11:48:57 user nova-compute[73449]: DEBUG oslo.service.loopingcall [None req-2bd84e8d-3e0d-4f81-9d32-b576b0658a1e tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73449) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 11:48:57 user nova-compute[73449]: DEBUG nova.compute.manager [-] [instance: a5836f8c-079b-4437-ab51-6878f0a4a7f8] Deallocating network for instance {{(pid=73449) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 11:48:57 user nova-compute[73449]: DEBUG nova.network.neutron [-] [instance: a5836f8c-079b-4437-ab51-6878f0a4a7f8] deallocate_for_instance() {{(pid=73449) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 11:48:57 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd4ec7bd-002e-4a71-9314-96c21427af27/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:48:57 user nova-compute[73449]: DEBUG nova.network.neutron [req-46b9a194-a761-4773-bc8d-d451e8bce07d req-e3f05ca9-04f6-4ca5-a58c-6ca9af0d5edb service nova] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Updating instance_info_cache with network_info: [] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:48:57 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-46b9a194-a761-4773-bc8d-d451e8bce07d req-e3f05ca9-04f6-4ca5-a58c-6ca9af0d5edb service nova] Releasing lock "refresh_cache-fea9f81c-a848-4a65-863e-e09dddf65bcf" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:48:57 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b182b846-081c-415a-869f-14aec45b2269 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Acquired lock "refresh_cache-fea9f81c-a848-4a65-863e-e09dddf65bcf" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:48:57 user nova-compute[73449]: DEBUG nova.network.neutron [None req-b182b846-081c-415a-869f-14aec45b2269 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Building network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 11:48:57 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd4ec7bd-002e-4a71-9314-96c21427af27/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:48:57 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd4ec7bd-002e-4a71-9314-96c21427af27/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:48:57 user nova-compute[73449]: DEBUG nova.network.neutron [None req-b182b846-081c-415a-869f-14aec45b2269 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Instance cache missing network info. {{(pid=73449) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 11:48:57 user nova-compute[73449]: DEBUG nova.network.neutron [-] [instance: a5836f8c-079b-4437-ab51-6878f0a4a7f8] Updating instance_info_cache with network_info: [] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:48:57 user nova-compute[73449]: DEBUG nova.compute.manager [req-75aad799-9688-4e84-a91f-a0c75c958470 req-62cba022-e264-43d5-93b2-a389bd8fd760 service nova] [instance: a5836f8c-079b-4437-ab51-6878f0a4a7f8] Received event network-vif-deleted-452715bd-2291-4c3c-b6e8-a692dc72d1ac {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:48:57 user nova-compute[73449]: INFO nova.compute.manager [req-75aad799-9688-4e84-a91f-a0c75c958470 req-62cba022-e264-43d5-93b2-a389bd8fd760 service nova] [instance: a5836f8c-079b-4437-ab51-6878f0a4a7f8] Neutron deleted interface 452715bd-2291-4c3c-b6e8-a692dc72d1ac; detaching it from the instance and deleting it from the info cache
Aug 17 11:48:57 user nova-compute[73449]: DEBUG nova.network.neutron [req-75aad799-9688-4e84-a91f-a0c75c958470 req-62cba022-e264-43d5-93b2-a389bd8fd760 service nova] [instance: a5836f8c-079b-4437-ab51-6878f0a4a7f8] Updating instance_info_cache with network_info: [] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:48:57 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd4ec7bd-002e-4a71-9314-96c21427af27/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:48:57 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=73449) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 11:48:57 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a9e8ad2-19db-4975-87e4-2efce603a7d7/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:48:57 user nova-compute[73449]: INFO nova.compute.manager [-] [instance: a5836f8c-079b-4437-ab51-6878f0a4a7f8] Took 0.56 seconds to deallocate network for instance.
Aug 17 11:48:57 user nova-compute[73449]: DEBUG nova.compute.manager [req-75aad799-9688-4e84-a91f-a0c75c958470 req-62cba022-e264-43d5-93b2-a389bd8fd760 service nova] [instance: a5836f8c-079b-4437-ab51-6878f0a4a7f8] Detach interface failed, port_id=452715bd-2291-4c3c-b6e8-a692dc72d1ac, reason: Instance a5836f8c-079b-4437-ab51-6878f0a4a7f8 could not be found. {{(pid=73449) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 11:48:57 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-2bd84e8d-3e0d-4f81-9d32-b576b0658a1e tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:48:57 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-2bd84e8d-3e0d-4f81-9d32-b576b0658a1e tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:48:57 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a9e8ad2-19db-4975-87e4-2efce603a7d7/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:48:57 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a9e8ad2-19db-4975-87e4-2efce603a7d7/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:48:57 user nova-compute[73449]: DEBUG nova.network.neutron [None req-b182b846-081c-415a-869f-14aec45b2269 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Updating instance_info_cache with network_info: [{"id": "5db97a8e-3943-4259-ae41-cec1946c33f8", "address": "fa:16:3e:c2:f3:5a", "network": {"id": "d56bc428-6be6-4aa9-b43c-9d4a0f1dd83b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-791364634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe7b5fee01a042bb90e40b18a84c82c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5db97a8e-39", "ovs_interfaceid": "5db97a8e-3943-4259-ae41-cec1946c33f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:48:57 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b182b846-081c-415a-869f-14aec45b2269 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Releasing lock "refresh_cache-fea9f81c-a848-4a65-863e-e09dddf65bcf" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:48:57 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b182b846-081c-415a-869f-14aec45b2269 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Instance network_info: |[{"id": "5db97a8e-3943-4259-ae41-cec1946c33f8", "address": "fa:16:3e:c2:f3:5a", "network": {"id": "d56bc428-6be6-4aa9-b43c-9d4a0f1dd83b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-791364634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe7b5fee01a042bb90e40b18a84c82c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5db97a8e-39", "ovs_interfaceid": "5db97a8e-3943-4259-ae41-cec1946c33f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73449) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 11:48:57 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b182b846-081c-415a-869f-14aec45b2269 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Start _get_guest_xml network_info=[{"id": "5db97a8e-3943-4259-ae41-cec1946c33f8", "address": "fa:16:3e:c2:f3:5a", "network": {"id": "d56bc428-6be6-4aa9-b43c-9d4a0f1dd83b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-791364634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe7b5fee01a042bb90e40b18a84c82c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5db97a8e-39", "ovs_interfaceid": "5db97a8e-3943-4259-ae41-cec1946c33f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T11:36:11Z,direct_url=<?>,disk_format='qcow2',id=0a2904ae-083d-41c8-83db-343132b36148,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7a77880136a54ef195c82e018e1939db',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T11:36:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': '0a2904ae-083d-41c8-83db-343132b36148'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 11:48:57 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-b182b846-081c-415a-869f-14aec45b2269 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:48:57 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-b182b846-081c-415a-869f-14aec45b2269 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:48:57 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-b182b846-081c-415a-869f-14aec45b2269 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 11:48:57 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-b182b846-081c-415a-869f-14aec45b2269 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] CPU controller missing on host. {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 11:48:57 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-b182b846-081c-415a-869f-14aec45b2269 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 11:48:57 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-b182b846-081c-415a-869f-14aec45b2269 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] CPU controller found on host. {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 11:48:57 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b182b846-081c-415a-869f-14aec45b2269 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73449) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 11:48:57 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-b182b846-081c-415a-869f-14aec45b2269 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T11:35:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T11:36:11Z,direct_url=<?>,disk_format='qcow2',id=0a2904ae-083d-41c8-83db-343132b36148,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7a77880136a54ef195c82e018e1939db',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T11:36:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 11:48:57 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-b182b846-081c-415a-869f-14aec45b2269 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Flavor limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 11:48:57 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-b182b846-081c-415a-869f-14aec45b2269 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Image limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 11:48:57 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-b182b846-081c-415a-869f-14aec45b2269 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Flavor pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 11:48:57 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-b182b846-081c-415a-869f-14aec45b2269 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Image pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 11:48:57 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-b182b846-081c-415a-869f-14aec45b2269 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 11:48:57 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-b182b846-081c-415a-869f-14aec45b2269 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 11:48:57 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-b182b846-081c-415a-869f-14aec45b2269 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 11:48:57 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-b182b846-081c-415a-869f-14aec45b2269 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Got 1 possible topologies {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 11:48:57 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-b182b846-081c-415a-869f-14aec45b2269 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 11:48:57 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-b182b846-081c-415a-869f-14aec45b2269 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 11:48:57 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-b182b846-081c-415a-869f-14aec45b2269 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:48:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2040756698',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2040756698',id=25,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFsRrS9Xoo8KEw47nic0apSNQihcGy2Dprwqysq5E8j0+8vyBEoJLy8MhfPnxnP5okmD+FgMjuWZuCPCrJvPG1PVoQ0IYOfI1fBkLBwSfjKGYTzfWWEpJ31p7U2edN/zYw==',key_name='tempest-keypair-553309548',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fe7b5fee01a042bb90e40b18a84c82c0',ramdisk_id='',reservation_id='r-bo9d1umq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-2080997856',owner_user_name='tempest-AttachVolumeShelveTestJSON-2080997856-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T11:48:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='17ee7be9cdb14c5ca211a6b0bb80ccc1',uuid=fea9f81c-a848-4a65-863e-e09dddf65bcf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5db97a8e-3943-4259-ae41-cec1946c33f8", "address": "fa:16:3e:c2:f3:5a", "network": {"id": "d56bc428-6be6-4aa9-b43c-9d4a0f1dd83b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-791364634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe7b5fee01a042bb90e40b18a84c82c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5db97a8e-39", "ovs_interfaceid": "5db97a8e-3943-4259-ae41-cec1946c33f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73449) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 11:48:57 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-b182b846-081c-415a-869f-14aec45b2269 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Converting VIF {"id": "5db97a8e-3943-4259-ae41-cec1946c33f8", "address": "fa:16:3e:c2:f3:5a", "network": {"id": "d56bc428-6be6-4aa9-b43c-9d4a0f1dd83b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-791364634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe7b5fee01a042bb90e40b18a84c82c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5db97a8e-39", "ovs_interfaceid": "5db97a8e-3943-4259-ae41-cec1946c33f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:48:57 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-b182b846-081c-415a-869f-14aec45b2269 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:f3:5a,bridge_name='br-int',has_traffic_filtering=True,id=5db97a8e-3943-4259-ae41-cec1946c33f8,network=Network(d56bc428-6be6-4aa9-b43c-9d4a0f1dd83b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5db97a8e-39') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:48:57 user nova-compute[73449]: DEBUG nova.objects.instance [None req-b182b846-081c-415a-869f-14aec45b2269 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Lazy-loading 'pci_devices' on Instance uuid fea9f81c-a848-4a65-863e-e09dddf65bcf {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:48:57 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b182b846-081c-415a-869f-14aec45b2269 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] End _get_guest_xml xml=<domain type="kvm">
Aug 17 11:48:57 user nova-compute[73449]:   <uuid>fea9f81c-a848-4a65-863e-e09dddf65bcf</uuid>
Aug 17 11:48:57 user nova-compute[73449]:   <name>instance-00000019</name>
Aug 17 11:48:57 user nova-compute[73449]:   <memory>524288</memory>
Aug 17 11:48:57 user nova-compute[73449]:   <vcpu>1</vcpu>
Aug 17 11:48:57 user nova-compute[73449]:   <metadata>
Aug 17 11:48:57 user nova-compute[73449]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 11:48:57 user nova-compute[73449]:       <nova:package version="0.0.0"/>
Aug 17 11:48:57 user nova-compute[73449]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-2040756698</nova:name>
Aug 17 11:48:57 user nova-compute[73449]:       <nova:creationTime>2023-08-17 11:48:57</nova:creationTime>
Aug 17 11:48:57 user nova-compute[73449]:       <nova:flavor name="m1.tiny">
Aug 17 11:48:57 user nova-compute[73449]:         <nova:memory>512</nova:memory>
Aug 17 11:48:57 user nova-compute[73449]:         <nova:disk>1</nova:disk>
Aug 17 11:48:57 user nova-compute[73449]:         <nova:swap>0</nova:swap>
Aug 17 11:48:57 user nova-compute[73449]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 11:48:57 user nova-compute[73449]:         <nova:vcpus>1</nova:vcpus>
Aug 17 11:48:57 user nova-compute[73449]:       </nova:flavor>
Aug 17 11:48:57 user nova-compute[73449]:       <nova:owner>
Aug 17 11:48:57 user nova-compute[73449]:         <nova:user uuid="17ee7be9cdb14c5ca211a6b0bb80ccc1">tempest-AttachVolumeShelveTestJSON-2080997856-project-member</nova:user>
Aug 17 11:48:57 user nova-compute[73449]:         <nova:project uuid="fe7b5fee01a042bb90e40b18a84c82c0">tempest-AttachVolumeShelveTestJSON-2080997856</nova:project>
Aug 17 11:48:57 user nova-compute[73449]:       </nova:owner>
Aug 17 11:48:57 user nova-compute[73449]:       <nova:root type="image" uuid="0a2904ae-083d-41c8-83db-343132b36148"/>
Aug 17 11:48:57 user nova-compute[73449]:       <nova:ports>
Aug 17 11:48:57 user nova-compute[73449]:         <nova:port uuid="5db97a8e-3943-4259-ae41-cec1946c33f8">
Aug 17 11:48:57 user nova-compute[73449]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 17 11:48:57 user nova-compute[73449]:         </nova:port>
Aug 17 11:48:57 user nova-compute[73449]:       </nova:ports>
Aug 17 11:48:57 user nova-compute[73449]:     </nova:instance>
Aug 17 11:48:57 user nova-compute[73449]:   </metadata>
Aug 17 11:48:57 user nova-compute[73449]:   <sysinfo type="smbios">
Aug 17 11:48:57 user nova-compute[73449]:     <system>
Aug 17 11:48:57 user nova-compute[73449]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 11:48:57 user nova-compute[73449]:       <entry name="product">OpenStack Nova</entry>
Aug 17 11:48:57 user nova-compute[73449]:       <entry name="version">0.0.0</entry>
Aug 17 11:48:57 user nova-compute[73449]:       <entry name="serial">fea9f81c-a848-4a65-863e-e09dddf65bcf</entry>
Aug 17 11:48:57 user nova-compute[73449]:       <entry name="uuid">fea9f81c-a848-4a65-863e-e09dddf65bcf</entry>
Aug 17 11:48:57 user nova-compute[73449]:       <entry name="family">Virtual Machine</entry>
Aug 17 11:48:57 user nova-compute[73449]:     </system>
Aug 17 11:48:57 user nova-compute[73449]:   </sysinfo>
Aug 17 11:48:57 user nova-compute[73449]:   <os>
Aug 17 11:48:57 user nova-compute[73449]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 11:48:57 user nova-compute[73449]:     <boot dev="hd"/>
Aug 17 11:48:57 user nova-compute[73449]:     <smbios mode="sysinfo"/>
Aug 17 11:48:57 user nova-compute[73449]:   </os>
Aug 17 11:48:57 user nova-compute[73449]:   <features>
Aug 17 11:48:57 user nova-compute[73449]:     <acpi/>
Aug 17 11:48:57 user nova-compute[73449]:     <apic/>
Aug 17 11:48:57 user nova-compute[73449]:     <vmcoreinfo/>
Aug 17 11:48:57 user nova-compute[73449]:   </features>
Aug 17 11:48:57 user nova-compute[73449]:   <clock offset="utc">
Aug 17 11:48:57 user nova-compute[73449]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 11:48:57 user nova-compute[73449]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 11:48:57 user nova-compute[73449]:     <timer name="hpet" present="no"/>
Aug 17 11:48:57 user nova-compute[73449]:   </clock>
Aug 17 11:48:57 user nova-compute[73449]:   <cpu mode="custom" match="exact">
Aug 17 11:48:57 user nova-compute[73449]:     <model>Nehalem</model>
Aug 17 11:48:57 user nova-compute[73449]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 11:48:57 user nova-compute[73449]:   </cpu>
Aug 17 11:48:57 user nova-compute[73449]:   <devices>
Aug 17 11:48:57 user nova-compute[73449]:     <disk type="file" device="disk">
Aug 17 11:48:57 user nova-compute[73449]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 11:48:57 user nova-compute[73449]:       <source file="/opt/stack/data/nova/instances/fea9f81c-a848-4a65-863e-e09dddf65bcf/disk"/>
Aug 17 11:48:57 user nova-compute[73449]:       <target dev="vda" bus="virtio"/>
Aug 17 11:48:57 user nova-compute[73449]:     </disk>
Aug 17 11:48:57 user nova-compute[73449]:     <interface type="ethernet">
Aug 17 11:48:57 user nova-compute[73449]:       <mac address="fa:16:3e:c2:f3:5a"/>
Aug 17 11:48:57 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 11:48:57 user nova-compute[73449]:       <mtu size="1442"/>
Aug 17 11:48:57 user nova-compute[73449]:       <target dev="tap5db97a8e-39"/>
Aug 17 11:48:57 user nova-compute[73449]:     </interface>
Aug 17 11:48:57 user nova-compute[73449]:     <serial type="pty">
Aug 17 11:48:57 user nova-compute[73449]:       <log file="/opt/stack/data/nova/instances/fea9f81c-a848-4a65-863e-e09dddf65bcf/console.log" append="off"/>
Aug 17 11:48:57 user nova-compute[73449]:     </serial>
Aug 17 11:48:57 user nova-compute[73449]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 11:48:57 user nova-compute[73449]:     <video>
Aug 17 11:48:57 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 11:48:57 user nova-compute[73449]:     </video>
Aug 17 11:48:57 user nova-compute[73449]:     <rng model="virtio">
Aug 17 11:48:57 user nova-compute[73449]:       <backend model="random">/dev/urandom</backend>
Aug 17 11:48:57 user nova-compute[73449]:     </rng>
Aug 17 11:48:57 user nova-compute[73449]:     <controller type="usb" index="0" model="none"/>
Aug 17 11:48:57 user nova-compute[73449]:     <memballoon model="virtio">
Aug 17 11:48:57 user nova-compute[73449]:       <stats period="10"/>
Aug 17 11:48:57 user nova-compute[73449]:     </memballoon>
Aug 17 11:48:57 user nova-compute[73449]:   </devices>
Aug 17 11:48:57 user nova-compute[73449]: </domain>
Aug 17 11:48:57 user nova-compute[73449]:  {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 11:48:57 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-b182b846-081c-415a-869f-14aec45b2269 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:48:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2040756698',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2040756698',id=25,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFsRrS9Xoo8KEw47nic0apSNQihcGy2Dprwqysq5E8j0+8vyBEoJLy8MhfPnxnP5okmD+FgMjuWZuCPCrJvPG1PVoQ0IYOfI1fBkLBwSfjKGYTzfWWEpJ31p7U2edN/zYw==',key_name='tempest-keypair-553309548',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fe7b5fee01a042bb90e40b18a84c82c0',ramdisk_id='',reservation_id='r-bo9d1umq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-2080997856',owner_user_name='tempest-AttachVolumeShelveTestJSON-2080997856-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T11:48:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='17ee7be9cdb14c5ca211a6b0bb80ccc1',uuid=fea9f81c-a848-4a65-863e-e09dddf65bcf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5db97a8e-3943-4259-ae41-cec1946c33f8", "address": "fa:16:3e:c2:f3:5a", "network": {"id": "d56bc428-6be6-4aa9-b43c-9d4a0f1dd83b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-791364634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe7b5fee01a042bb90e40b18a84c82c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5db97a8e-39", "ovs_interfaceid": "5db97a8e-3943-4259-ae41-cec1946c33f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 11:48:57 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-b182b846-081c-415a-869f-14aec45b2269 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Converting VIF {"id": "5db97a8e-3943-4259-ae41-cec1946c33f8", "address": "fa:16:3e:c2:f3:5a", "network": {"id": "d56bc428-6be6-4aa9-b43c-9d4a0f1dd83b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-791364634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe7b5fee01a042bb90e40b18a84c82c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5db97a8e-39", "ovs_interfaceid": "5db97a8e-3943-4259-ae41-cec1946c33f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:48:57 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-b182b846-081c-415a-869f-14aec45b2269 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:f3:5a,bridge_name='br-int',has_traffic_filtering=True,id=5db97a8e-3943-4259-ae41-cec1946c33f8,network=Network(d56bc428-6be6-4aa9-b43c-9d4a0f1dd83b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5db97a8e-39') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:48:57 user nova-compute[73449]: DEBUG os_vif [None req-b182b846-081c-415a-869f-14aec45b2269 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:f3:5a,bridge_name='br-int',has_traffic_filtering=True,id=5db97a8e-3943-4259-ae41-cec1946c33f8,network=Network(d56bc428-6be6-4aa9-b43c-9d4a0f1dd83b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5db97a8e-39') {{(pid=73449) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 11:48:57 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:48:57 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:48:57 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 11:48:57 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a9e8ad2-19db-4975-87e4-2efce603a7d7/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:48:57 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:48:57 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5db97a8e-39, may_exist=True, interface_attrs={}) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:48:57 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5db97a8e-39, col_values=(('external_ids', {'iface-id': '5db97a8e-3943-4259-ae41-cec1946c33f8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c2:f3:5a', 'vm-uuid': 'fea9f81c-a848-4a65-863e-e09dddf65bcf'}),), if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:48:57 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:48:57 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:48:57 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:48:57 user nova-compute[73449]: INFO os_vif [None req-b182b846-081c-415a-869f-14aec45b2269 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:f3:5a,bridge_name='br-int',has_traffic_filtering=True,id=5db97a8e-3943-4259-ae41-cec1946c33f8,network=Network(d56bc428-6be6-4aa9-b43c-9d4a0f1dd83b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5db97a8e-39')
Aug 17 11:48:57 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk.rescue --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:48:58 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:48:58 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b182b846-081c-415a-869f-14aec45b2269 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] No BDM found with device name vda, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 11:48:58 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b182b846-081c-415a-869f-14aec45b2269 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] No VIF found with MAC fa:16:3e:c2:f3:5a, not building metadata {{(pid=73449) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 11:48:58 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-2bd84e8d-3e0d-4f81-9d32-b576b0658a1e tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 11:48:58 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-2bd84e8d-3e0d-4f81-9d32-b576b0658a1e tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 11:48:58 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:48:58 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk.rescue --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:48:58 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-2bd84e8d-3e0d-4f81-9d32-b576b0658a1e tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.511s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:48:58 user nova-compute[73449]: INFO nova.scheduler.client.report [None req-2bd84e8d-3e0d-4f81-9d32-b576b0658a1e tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Deleted allocations for instance a5836f8c-079b-4437-ab51-6878f0a4a7f8
Aug 17 11:48:58 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-2bd84e8d-3e0d-4f81-9d32-b576b0658a1e tempest-VolumesActionsTest-407682915 tempest-VolumesActionsTest-407682915-project-member] Lock "a5836f8c-079b-4437-ab51-6878f0a4a7f8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.360s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:48:58 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:48:58 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:48:58 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:48:58 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:48:58 user nova-compute[73449]: DEBUG nova.compute.manager [req-0e60381c-91c5-4035-af06-434be922cf51 req-bd46168d-3c62-4029-bce2-dc9c6df57c24 service nova] [instance: a5836f8c-079b-4437-ab51-6878f0a4a7f8] Received event network-vif-plugged-452715bd-2291-4c3c-b6e8-a692dc72d1ac {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:48:58 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-0e60381c-91c5-4035-af06-434be922cf51 req-bd46168d-3c62-4029-bce2-dc9c6df57c24 service nova] Acquiring lock "a5836f8c-079b-4437-ab51-6878f0a4a7f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:48:58 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-0e60381c-91c5-4035-af06-434be922cf51 req-bd46168d-3c62-4029-bce2-dc9c6df57c24 service nova] Lock "a5836f8c-079b-4437-ab51-6878f0a4a7f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:48:58 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-0e60381c-91c5-4035-af06-434be922cf51 req-bd46168d-3c62-4029-bce2-dc9c6df57c24 service nova] Lock "a5836f8c-079b-4437-ab51-6878f0a4a7f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:48:58 user nova-compute[73449]: DEBUG nova.compute.manager [req-0e60381c-91c5-4035-af06-434be922cf51 req-bd46168d-3c62-4029-bce2-dc9c6df57c24 service nova] [instance: a5836f8c-079b-4437-ab51-6878f0a4a7f8] No waiting events found dispatching network-vif-plugged-452715bd-2291-4c3c-b6e8-a692dc72d1ac {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:48:58 user nova-compute[73449]: WARNING nova.compute.manager [req-0e60381c-91c5-4035-af06-434be922cf51 req-bd46168d-3c62-4029-bce2-dc9c6df57c24 service nova] [instance: a5836f8c-079b-4437-ab51-6878f0a4a7f8] Received unexpected event network-vif-plugged-452715bd-2291-4c3c-b6e8-a692dc72d1ac for instance with vm_state deleted and task_state None.
Aug 17 11:48:58 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:48:58 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de5084e1-5a5e-48d2-a3ef-7f29898d1d2d/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:48:58 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de5084e1-5a5e-48d2-a3ef-7f29898d1d2d/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:48:58 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de5084e1-5a5e-48d2-a3ef-7f29898d1d2d/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:48:59 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de5084e1-5a5e-48d2-a3ef-7f29898d1d2d/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:48:59 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73449) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 11:48:59 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73449) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 11:48:59 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d74c8f6-fb4e-4460-b722-674a8a1e2d25/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:48:59 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d74c8f6-fb4e-4460-b722-674a8a1e2d25/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:48:59 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d74c8f6-fb4e-4460-b722-674a8a1e2d25/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:48:59 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:48:59 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:48:59 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d74c8f6-fb4e-4460-b722-674a8a1e2d25/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:48:59 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f35b7f2b-2f88-4b09-86ac-cb5a78a94584/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:48:59 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f35b7f2b-2f88-4b09-86ac-cb5a78a94584/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:48:59 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f35b7f2b-2f88-4b09-86ac-cb5a78a94584/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:48:59 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f35b7f2b-2f88-4b09-86ac-cb5a78a94584/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:48:59 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d468854-6182-49c8-acb7-0641df2d5219/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:48:59 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:49:00 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:49:00 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d468854-6182-49c8-acb7-0641df2d5219/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:49:00 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d468854-6182-49c8-acb7-0641df2d5219/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:49:00 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d468854-6182-49c8-acb7-0641df2d5219/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:49:01 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692272941.4869878, fea9f81c-a848-4a65-863e-e09dddf65bcf => Resumed> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:49:01 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] VM Resumed (Lifecycle Event)
Aug 17 11:49:01 user nova-compute[73449]: DEBUG nova.compute.manager [req-7d94a614-3ddb-47b9-bea9-901af9e08063 req-4d7d9e27-72a0-4c0b-9871-d293c4857de6 service nova] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Received event network-vif-plugged-5db97a8e-3943-4259-ae41-cec1946c33f8 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:49:01 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-7d94a614-3ddb-47b9-bea9-901af9e08063 req-4d7d9e27-72a0-4c0b-9871-d293c4857de6 service nova] Acquiring lock "fea9f81c-a848-4a65-863e-e09dddf65bcf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:49:01 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-7d94a614-3ddb-47b9-bea9-901af9e08063 req-4d7d9e27-72a0-4c0b-9871-d293c4857de6 service nova] Lock "fea9f81c-a848-4a65-863e-e09dddf65bcf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:49:01 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-7d94a614-3ddb-47b9-bea9-901af9e08063 req-4d7d9e27-72a0-4c0b-9871-d293c4857de6 service nova] Lock "fea9f81c-a848-4a65-863e-e09dddf65bcf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:49:01 user nova-compute[73449]: DEBUG nova.compute.manager [req-7d94a614-3ddb-47b9-bea9-901af9e08063 req-4d7d9e27-72a0-4c0b-9871-d293c4857de6 service nova] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] No waiting events found dispatching network-vif-plugged-5db97a8e-3943-4259-ae41-cec1946c33f8 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:49:01 user nova-compute[73449]: WARNING nova.compute.manager [req-7d94a614-3ddb-47b9-bea9-901af9e08063 req-4d7d9e27-72a0-4c0b-9871-d293c4857de6 service nova] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Received unexpected event network-vif-plugged-5db97a8e-3943-4259-ae41-cec1946c33f8 for instance with vm_state building and task_state spawning.
Aug 17 11:49:01 user nova-compute[73449]: DEBUG nova.compute.manager [req-7d94a614-3ddb-47b9-bea9-901af9e08063 req-4d7d9e27-72a0-4c0b-9871-d293c4857de6 service nova] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Received event network-vif-plugged-5db97a8e-3943-4259-ae41-cec1946c33f8 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:49:01 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-7d94a614-3ddb-47b9-bea9-901af9e08063 req-4d7d9e27-72a0-4c0b-9871-d293c4857de6 service nova] Acquiring lock "fea9f81c-a848-4a65-863e-e09dddf65bcf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:49:01 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-7d94a614-3ddb-47b9-bea9-901af9e08063 req-4d7d9e27-72a0-4c0b-9871-d293c4857de6 service nova] Lock "fea9f81c-a848-4a65-863e-e09dddf65bcf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:49:01 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-7d94a614-3ddb-47b9-bea9-901af9e08063 req-4d7d9e27-72a0-4c0b-9871-d293c4857de6 service nova] Lock "fea9f81c-a848-4a65-863e-e09dddf65bcf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:49:01 user nova-compute[73449]: DEBUG nova.compute.manager [req-7d94a614-3ddb-47b9-bea9-901af9e08063 req-4d7d9e27-72a0-4c0b-9871-d293c4857de6 service nova] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] No waiting events found dispatching network-vif-plugged-5db97a8e-3943-4259-ae41-cec1946c33f8 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:49:01 user nova-compute[73449]: WARNING nova.compute.manager [req-7d94a614-3ddb-47b9-bea9-901af9e08063 req-4d7d9e27-72a0-4c0b-9871-d293c4857de6 service nova] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Received unexpected event network-vif-plugged-5db97a8e-3943-4259-ae41-cec1946c33f8 for instance with vm_state building and task_state spawning.
Aug 17 11:49:01 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b182b846-081c-415a-869f-14aec45b2269 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Instance event wait completed in 0 seconds for  {{(pid=73449) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 11:49:01 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b182b846-081c-415a-869f-14aec45b2269 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Guest created on hypervisor {{(pid=73449) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 11:49:01 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Instance spawned successfully.
Aug 17 11:49:01 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b182b846-081c-415a-869f-14aec45b2269 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 11:49:01 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:49:01 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:49:01 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Hypervisor/Node resource view: name=user free_ram=7159MB free_disk=25.39000701904297GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73449) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 11:49:01 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:49:01 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:49:01 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:49:01 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 11:49:01 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b182b846-081c-415a-869f-14aec45b2269 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Found default for hw_cdrom_bus of ide {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:49:01 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b182b846-081c-415a-869f-14aec45b2269 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Found default for hw_disk_bus of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:49:01 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b182b846-081c-415a-869f-14aec45b2269 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Found default for hw_input_bus of None {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:49:01 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b182b846-081c-415a-869f-14aec45b2269 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Found default for hw_pointer_model of None {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:49:01 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b182b846-081c-415a-869f-14aec45b2269 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Found default for hw_video_model of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:49:01 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b182b846-081c-415a-869f-14aec45b2269 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Found default for hw_vif_model of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:49:01 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 11:49:01 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692272941.487732, fea9f81c-a848-4a65-863e-e09dddf65bcf => Started> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:49:01 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] VM Started (Lifecycle Event)
Aug 17 11:49:02 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:49:02 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 11:49:02 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 11:49:02 user nova-compute[73449]: INFO nova.compute.manager [None req-b182b846-081c-415a-869f-14aec45b2269 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Took 7.05 seconds to spawn the instance on the hypervisor.
Aug 17 11:49:02 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b182b846-081c-415a-869f-14aec45b2269 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:49:02 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 4a9e8ad2-19db-4975-87e4-2efce603a7d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:49:02 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance f35b7f2b-2f88-4b09-86ac-cb5a78a94584 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:49:02 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance de5084e1-5a5e-48d2-a3ef-7f29898d1d2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:49:02 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance e8e7d9aa-150f-424a-b3af-be149ee421c3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:49:02 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 3d74c8f6-fb4e-4460-b722-674a8a1e2d25 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:49:02 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance ae75d334-431a-4008-8b3d-f2a727d92417 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:49:02 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 3d468854-6182-49c8-acb7-0641df2d5219 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:49:02 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:49:02 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance dd4ec7bd-002e-4a71-9314-96c21427af27 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:49:02 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance fea9f81c-a848-4a65-863e-e09dddf65bcf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:49:02 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73449) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 11:49:02 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73449) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 11:49:02 user nova-compute[73449]: INFO nova.compute.manager [None req-b182b846-081c-415a-869f-14aec45b2269 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Took 7.85 seconds to build instance.
Aug 17 11:49:02 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b182b846-081c-415a-869f-14aec45b2269 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Lock "fea9f81c-a848-4a65-863e-e09dddf65bcf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.941s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:49:02 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 11:49:02 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 11:49:02 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Compute_service record updated for user:user {{(pid=73449) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 11:49:02 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.469s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:49:02 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:49:03 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:49:07 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:49:08 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:49:11 user nova-compute[73449]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692272936.7997813, a5836f8c-079b-4437-ab51-6878f0a4a7f8 => Stopped> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:49:11 user nova-compute[73449]: INFO nova.compute.manager [-] [instance: a5836f8c-079b-4437-ab51-6878f0a4a7f8] VM Stopped (Lifecycle Event)
Aug 17 11:49:11 user nova-compute[73449]: DEBUG nova.compute.manager [None req-9b5052f7-4366-4bee-94b4-c9e593af80c5 None None] [instance: a5836f8c-079b-4437-ab51-6878f0a4a7f8] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:49:12 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:49:13 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:49:17 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-836b6682-3511-4387-ac28-2ef43d9e9f22 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Acquiring lock "e8e7d9aa-150f-424a-b3af-be149ee421c3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:49:17 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-836b6682-3511-4387-ac28-2ef43d9e9f22 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Lock "e8e7d9aa-150f-424a-b3af-be149ee421c3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:49:17 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-836b6682-3511-4387-ac28-2ef43d9e9f22 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Acquiring lock "e8e7d9aa-150f-424a-b3af-be149ee421c3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:49:17 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-836b6682-3511-4387-ac28-2ef43d9e9f22 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Lock "e8e7d9aa-150f-424a-b3af-be149ee421c3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:49:17 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-836b6682-3511-4387-ac28-2ef43d9e9f22 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Lock "e8e7d9aa-150f-424a-b3af-be149ee421c3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:49:17 user nova-compute[73449]: INFO nova.compute.manager [None req-836b6682-3511-4387-ac28-2ef43d9e9f22 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] Terminating instance
Aug 17 11:49:17 user nova-compute[73449]: DEBUG nova.compute.manager [None req-836b6682-3511-4387-ac28-2ef43d9e9f22 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] Start destroying the instance on the hypervisor. {{(pid=73449) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 11:49:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:49:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:49:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:49:18 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:49:18 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:49:18 user nova-compute[73449]: DEBUG nova.compute.manager [req-0c39bd63-ee83-4340-86ff-7527c4b41bb0 req-e8b2b04e-7d31-4ef9-acaf-a0958b6c9276 service nova] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] Received event network-vif-unplugged-460de6e4-4651-4b83-93bd-fbb5db34bcfa {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:49:18 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-0c39bd63-ee83-4340-86ff-7527c4b41bb0 req-e8b2b04e-7d31-4ef9-acaf-a0958b6c9276 service nova] Acquiring lock "e8e7d9aa-150f-424a-b3af-be149ee421c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:49:18 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-0c39bd63-ee83-4340-86ff-7527c4b41bb0 req-e8b2b04e-7d31-4ef9-acaf-a0958b6c9276 service nova] Lock "e8e7d9aa-150f-424a-b3af-be149ee421c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:49:18 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-0c39bd63-ee83-4340-86ff-7527c4b41bb0 req-e8b2b04e-7d31-4ef9-acaf-a0958b6c9276 service nova] Lock "e8e7d9aa-150f-424a-b3af-be149ee421c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:49:18 user nova-compute[73449]: DEBUG nova.compute.manager [req-0c39bd63-ee83-4340-86ff-7527c4b41bb0 req-e8b2b04e-7d31-4ef9-acaf-a0958b6c9276 service nova] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] No waiting events found dispatching network-vif-unplugged-460de6e4-4651-4b83-93bd-fbb5db34bcfa {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:49:18 user nova-compute[73449]: DEBUG nova.compute.manager [req-0c39bd63-ee83-4340-86ff-7527c4b41bb0 req-e8b2b04e-7d31-4ef9-acaf-a0958b6c9276 service nova] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] Received event network-vif-unplugged-460de6e4-4651-4b83-93bd-fbb5db34bcfa for instance with task_state deleting. {{(pid=73449) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 11:49:18 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:49:18 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:49:18 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] Instance destroyed successfully.
Aug 17 11:49:18 user nova-compute[73449]: DEBUG nova.objects.instance [None req-836b6682-3511-4387-ac28-2ef43d9e9f22 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Lazy-loading 'resources' on Instance uuid e8e7d9aa-150f-424a-b3af-be149ee421c3 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:49:18 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-836b6682-3511-4387-ac28-2ef43d9e9f22 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T11:45:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-966756449',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1049115068',id=17,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP+u1MgbCgptDidYv18wcR/3nbMgBF04KyJdujQocUddcCZfAdpmYsBffqoFwPxl9btx5HmOLcrmmkZwWw4EsmmDOWNMZubobpCSM0EcykYa0gcYe9cSWHyIH4n+5UjBLw==',key_name='tempest-keypair-100521889',keypairs=<?>,launch_index=0,launched_at=2023-08-17T11:48:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e6a0323f43b04829a3b1e81266986cbf',ramdisk_id='',reservation_id='r-syt2v71c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1991725074',owner_user_name='tempest-ServerActionsV293TestJSON-1991725074-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T11:48:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cae6f48da3304f37a5d5010f3cbd7698',uuid=e8e7d9aa-150f-424a-b3af-be149ee421c3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "460de6e4-4651-4b83-93bd-fbb5db34bcfa", "address": "fa:16:3e:59:e7:ee", "network": {"id": "d4fc5f62-8de4-4df1-9e12-0f192a793f5f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1016129651-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a0323f43b04829a3b1e81266986cbf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap460de6e4-46", "ovs_interfaceid": "460de6e4-4651-4b83-93bd-fbb5db34bcfa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 11:49:18 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-836b6682-3511-4387-ac28-2ef43d9e9f22 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Converting VIF {"id": "460de6e4-4651-4b83-93bd-fbb5db34bcfa", "address": "fa:16:3e:59:e7:ee", "network": {"id": "d4fc5f62-8de4-4df1-9e12-0f192a793f5f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1016129651-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a0323f43b04829a3b1e81266986cbf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap460de6e4-46", "ovs_interfaceid": "460de6e4-4651-4b83-93bd-fbb5db34bcfa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:49:18 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-836b6682-3511-4387-ac28-2ef43d9e9f22 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:59:e7:ee,bridge_name='br-int',has_traffic_filtering=True,id=460de6e4-4651-4b83-93bd-fbb5db34bcfa,network=Network(d4fc5f62-8de4-4df1-9e12-0f192a793f5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap460de6e4-46') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:49:18 user nova-compute[73449]: DEBUG os_vif [None req-836b6682-3511-4387-ac28-2ef43d9e9f22 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:e7:ee,bridge_name='br-int',has_traffic_filtering=True,id=460de6e4-4651-4b83-93bd-fbb5db34bcfa,network=Network(d4fc5f62-8de4-4df1-9e12-0f192a793f5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap460de6e4-46') {{(pid=73449) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 11:49:18 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:49:18 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap460de6e4-46, bridge=br-int, if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:49:18 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:49:18 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:49:18 user nova-compute[73449]: INFO os_vif [None req-836b6682-3511-4387-ac28-2ef43d9e9f22 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:e7:ee,bridge_name='br-int',has_traffic_filtering=True,id=460de6e4-4651-4b83-93bd-fbb5db34bcfa,network=Network(d4fc5f62-8de4-4df1-9e12-0f192a793f5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap460de6e4-46')
Aug 17 11:49:18 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-836b6682-3511-4387-ac28-2ef43d9e9f22 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] calling os-brick to detach iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 11:49:18 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-836b6682-3511-4387-ac28-2ef43d9e9f22 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, {'target_iqns': ['iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XGrhlpAM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 11:49:18 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-836b6682-3511-4387-ac28-2ef43d9e9f22 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 11:49:18 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-836b6682-3511-4387-ac28-2ef43d9e9f22 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:49:18 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-836b6682-3511-4387-ac28-2ef43d9e9f22 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:49:18 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-836b6682-3511-4387-ac28-2ef43d9e9f22 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed', 0)] {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 11:49:18 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:49:18 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:49:18 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[afb77957-005d-42cc-bbdc-8f52d1dbb0f5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:49:18 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:49:18 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:49:18 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[80be55e7-b0f6-4945-9d06-dbf35c082ce8]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:49:18 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-836b6682-3511-4387-ac28-2ef43d9e9f22 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c (non-flash)
Aug 17 11:49:18 user nova-compute[73449]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed (non-flash)
Aug 17 11:49:18 user nova-compute[73449]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe (non-flash)
Aug 17 11:49:18 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:49:18 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-836b6682-3511-4387-ac28-2ef43d9e9f22 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c (non-flash)
Aug 17 11:49:18 user nova-compute[73449]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed (non-flash)
Aug 17 11:49:18 user nova-compute[73449]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe (non-flash)
Aug 17 11:49:18 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:49:18 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-836b6682-3511-4387-ac28-2ef43d9e9f22 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe7587e72e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed'): ({'sdc'}, set())}) {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 11:49:18 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-836b6682-3511-4387-ac28-2ef43d9e9f22 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Removing single pathed devices sdc {{(pid=73449) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 11:49:18 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:49:18 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:49:18 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[11e70f03-700f-423f-9f46-40892f4c34fa]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:49:18 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:49:18 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:49:18 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bc53d5c-d94a-4e38-ae03-75b2ab84a7a4]: (4, ('ok\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:49:18 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-836b6682-3511-4387-ac28-2ef43d9e9f22 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Flushing IO for device /dev/sdc {{(pid=73449) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 11:49:18 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:49:18 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.021s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:49:18 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[30cefb17-c708-497b-9803-ceb53cd69cd5]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:49:18 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-836b6682-3511-4387-ac28-2ef43d9e9f22 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73449) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 11:49:18 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:49:18 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.051s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:49:18 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[d89ce945-f846-4ec3-99c9-5ff5d9a17005]: (4, ('1', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:49:18 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-836b6682-3511-4387-ac28-2ef43d9e9f22 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73449) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 11:49:18 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-836b6682-3511-4387-ac28-2ef43d9e9f22 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] SCSI volumes sdc have been removed. {{(pid=73449) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 11:49:18 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-836b6682-3511-4387-ac28-2ef43d9e9f22 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed')] {{(pid=73449) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 11:49:18 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:49:18 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:49:18 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d7bd5e7-60e7-48b8-ad2d-a7fb7bff130a]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:49:18 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-836b6682-3511-4387-ac28-2ef43d9e9f22 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:49:18 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed -p 172.16.0.220:3260 --logout {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:49:18 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:49:18 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bfcb790-439d-4c2c-8b95-a13a9d370052]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:49:18 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-836b6682-3511-4387-ac28-2ef43d9e9f22 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed, portal: 172.16.0.220,3260]
Aug 17 11:49:18 user nova-compute[73449]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed, portal: 172.16.0.220,3260] successful.
Aug 17 11:49:18 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:49:18 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed -p 172.16.0.220:3260 --op delete {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:49:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71f6919a-6a55-4d8f-ae84-7bb40d59f4ed -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:49:19 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[03437d0f-75eb-4986-a1ed-d11a7bb0b1fd]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:49:19 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-836b6682-3511-4387-ac28-2ef43d9e9f22 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:49:19 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-836b6682-3511-4387-ac28-2ef43d9e9f22 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.336s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:49:19 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-836b6682-3511-4387-ac28-2ef43d9e9f22 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] <== disconnect_volume: return (338ms) None {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 11:49:19 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-836b6682-3511-4387-ac28-2ef43d9e9f22 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] Disconnected iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 11:49:19 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-836b6682-3511-4387-ac28-2ef43d9e9f22 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] Deleting instance files /opt/stack/data/nova/instances/e8e7d9aa-150f-424a-b3af-be149ee421c3_del
Aug 17 11:49:19 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-836b6682-3511-4387-ac28-2ef43d9e9f22 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] Deletion of /opt/stack/data/nova/instances/e8e7d9aa-150f-424a-b3af-be149ee421c3_del complete
Aug 17 11:49:19 user nova-compute[73449]: INFO nova.compute.manager [None req-836b6682-3511-4387-ac28-2ef43d9e9f22 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] Took 1.25 seconds to destroy the instance on the hypervisor.
Aug 17 11:49:19 user nova-compute[73449]: DEBUG oslo.service.loopingcall [None req-836b6682-3511-4387-ac28-2ef43d9e9f22 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73449) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 11:49:19 user nova-compute[73449]: DEBUG nova.compute.manager [-] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] Deallocating network for instance {{(pid=73449) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 11:49:19 user nova-compute[73449]: DEBUG nova.network.neutron [-] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] deallocate_for_instance() {{(pid=73449) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 11:49:20 user nova-compute[73449]: DEBUG nova.network.neutron [-] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] Updating instance_info_cache with network_info: [] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:49:20 user nova-compute[73449]: INFO nova.compute.manager [-] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] Took 1.18 seconds to deallocate network for instance.
Aug 17 11:49:20 user nova-compute[73449]: DEBUG nova.compute.manager [req-3aa88fed-6704-44a5-9704-0ed4fd4ac040 req-ce77c0a8-17c5-4f3a-b957-933ae7164d00 service nova] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] Received event network-vif-plugged-460de6e4-4651-4b83-93bd-fbb5db34bcfa {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:49:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-3aa88fed-6704-44a5-9704-0ed4fd4ac040 req-ce77c0a8-17c5-4f3a-b957-933ae7164d00 service nova] Acquiring lock "e8e7d9aa-150f-424a-b3af-be149ee421c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:49:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-3aa88fed-6704-44a5-9704-0ed4fd4ac040 req-ce77c0a8-17c5-4f3a-b957-933ae7164d00 service nova] Lock "e8e7d9aa-150f-424a-b3af-be149ee421c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:49:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-3aa88fed-6704-44a5-9704-0ed4fd4ac040 req-ce77c0a8-17c5-4f3a-b957-933ae7164d00 service nova] Lock "e8e7d9aa-150f-424a-b3af-be149ee421c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:49:20 user nova-compute[73449]: DEBUG nova.compute.manager [req-3aa88fed-6704-44a5-9704-0ed4fd4ac040 req-ce77c0a8-17c5-4f3a-b957-933ae7164d00 service nova] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] No waiting events found dispatching network-vif-plugged-460de6e4-4651-4b83-93bd-fbb5db34bcfa {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:49:20 user nova-compute[73449]: WARNING nova.compute.manager [req-3aa88fed-6704-44a5-9704-0ed4fd4ac040 req-ce77c0a8-17c5-4f3a-b957-933ae7164d00 service nova] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] Received unexpected event network-vif-plugged-460de6e4-4651-4b83-93bd-fbb5db34bcfa for instance with vm_state active and task_state deleting.
Aug 17 11:49:20 user nova-compute[73449]: DEBUG nova.compute.manager [req-3aa88fed-6704-44a5-9704-0ed4fd4ac040 req-ce77c0a8-17c5-4f3a-b957-933ae7164d00 service nova] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] Received event network-vif-deleted-460de6e4-4651-4b83-93bd-fbb5db34bcfa {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:49:21 user nova-compute[73449]: INFO nova.compute.manager [None req-836b6682-3511-4387-ac28-2ef43d9e9f22 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] Took 0.78 seconds to detach 1 volumes for instance.
Aug 17 11:49:21 user nova-compute[73449]: DEBUG nova.compute.manager [None req-836b6682-3511-4387-ac28-2ef43d9e9f22 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] Deleting volume: 71f6919a-6a55-4d8f-ae84-7bb40d59f4ed {{(pid=73449) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 17 11:49:21 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-836b6682-3511-4387-ac28-2ef43d9e9f22 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:49:21 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-836b6682-3511-4387-ac28-2ef43d9e9f22 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:49:21 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-836b6682-3511-4387-ac28-2ef43d9e9f22 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 11:49:21 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-836b6682-3511-4387-ac28-2ef43d9e9f22 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 11:49:21 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-836b6682-3511-4387-ac28-2ef43d9e9f22 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.331s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:49:21 user nova-compute[73449]: INFO nova.scheduler.client.report [None req-836b6682-3511-4387-ac28-2ef43d9e9f22 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Deleted allocations for instance e8e7d9aa-150f-424a-b3af-be149ee421c3
Aug 17 11:49:21 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-836b6682-3511-4387-ac28-2ef43d9e9f22 tempest-ServerActionsV293TestJSON-1991725074 tempest-ServerActionsV293TestJSON-1991725074-project-member] Lock "e8e7d9aa-150f-424a-b3af-be149ee421c3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.795s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:49:23 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:49:23 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:49:28 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:49:28 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:49:33 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:49:33 user nova-compute[73449]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692272958.609504, e8e7d9aa-150f-424a-b3af-be149ee421c3 => Stopped> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:49:33 user nova-compute[73449]: INFO nova.compute.manager [-] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] VM Stopped (Lifecycle Event)
Aug 17 11:49:33 user nova-compute[73449]: DEBUG nova.compute.manager [None req-938c020f-099b-4f86-8f01-612f0e31c50e None None] [instance: e8e7d9aa-150f-424a-b3af-be149ee421c3] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:49:33 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:49:35 user nova-compute[73449]: DEBUG nova.compute.manager [req-f81fd63b-8766-4608-aa52-4cea0fdcd410 req-3eed2d47-3121-4d88-b3d5-f6de902f9c58 service nova] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] Received event network-changed-e2af7fce-7442-48b4-8611-da3171b0672b {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:49:35 user nova-compute[73449]: DEBUG nova.compute.manager [req-f81fd63b-8766-4608-aa52-4cea0fdcd410 req-3eed2d47-3121-4d88-b3d5-f6de902f9c58 service nova] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] Refreshing instance network info cache due to event network-changed-e2af7fce-7442-48b4-8611-da3171b0672b. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 11:49:35 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-f81fd63b-8766-4608-aa52-4cea0fdcd410 req-3eed2d47-3121-4d88-b3d5-f6de902f9c58 service nova] Acquiring lock "refresh_cache-de5084e1-5a5e-48d2-a3ef-7f29898d1d2d" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:49:35 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-f81fd63b-8766-4608-aa52-4cea0fdcd410 req-3eed2d47-3121-4d88-b3d5-f6de902f9c58 service nova] Acquired lock "refresh_cache-de5084e1-5a5e-48d2-a3ef-7f29898d1d2d" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:49:35 user nova-compute[73449]: DEBUG nova.network.neutron [req-f81fd63b-8766-4608-aa52-4cea0fdcd410 req-3eed2d47-3121-4d88-b3d5-f6de902f9c58 service nova] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] Refreshing network info cache for port e2af7fce-7442-48b4-8611-da3171b0672b {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 11:49:35 user nova-compute[73449]: DEBUG nova.network.neutron [req-f81fd63b-8766-4608-aa52-4cea0fdcd410 req-3eed2d47-3121-4d88-b3d5-f6de902f9c58 service nova] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] Updated VIF entry in instance network info cache for port e2af7fce-7442-48b4-8611-da3171b0672b. {{(pid=73449) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 11:49:35 user nova-compute[73449]: DEBUG nova.network.neutron [req-f81fd63b-8766-4608-aa52-4cea0fdcd410 req-3eed2d47-3121-4d88-b3d5-f6de902f9c58 service nova] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] Updating instance_info_cache with network_info: [{"id": "e2af7fce-7442-48b4-8611-da3171b0672b", "address": "fa:16:3e:c0:c8:a6", "network": {"id": "ff73f5c3-bae6-46cc-bcb8-bbd5be1b478d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1229197917-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5ba3ebf47bd4b999e68c74a5c0ab060", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2af7fce-74", "ovs_interfaceid": "e2af7fce-7442-48b4-8611-da3171b0672b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:49:35 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-f81fd63b-8766-4608-aa52-4cea0fdcd410 req-3eed2d47-3121-4d88-b3d5-f6de902f9c58 service nova] Releasing lock "refresh_cache-de5084e1-5a5e-48d2-a3ef-7f29898d1d2d" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:49:36 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:49:36 user nova-compute[73449]: DEBUG nova.compute.manager [req-70fca398-c77b-48d0-a1c0-4dd517362caa req-23834aa8-eb7d-4d83-88c9-924e4f4ca9b6 service nova] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] Received event network-changed-e2af7fce-7442-48b4-8611-da3171b0672b {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:49:36 user nova-compute[73449]: DEBUG nova.compute.manager [req-70fca398-c77b-48d0-a1c0-4dd517362caa req-23834aa8-eb7d-4d83-88c9-924e4f4ca9b6 service nova] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] Refreshing instance network info cache due to event network-changed-e2af7fce-7442-48b4-8611-da3171b0672b. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 11:49:36 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-70fca398-c77b-48d0-a1c0-4dd517362caa req-23834aa8-eb7d-4d83-88c9-924e4f4ca9b6 service nova] Acquiring lock "refresh_cache-de5084e1-5a5e-48d2-a3ef-7f29898d1d2d" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:49:36 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-70fca398-c77b-48d0-a1c0-4dd517362caa req-23834aa8-eb7d-4d83-88c9-924e4f4ca9b6 service nova] Acquired lock "refresh_cache-de5084e1-5a5e-48d2-a3ef-7f29898d1d2d" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:49:36 user nova-compute[73449]: DEBUG nova.network.neutron [req-70fca398-c77b-48d0-a1c0-4dd517362caa req-23834aa8-eb7d-4d83-88c9-924e4f4ca9b6 service nova] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] Refreshing network info cache for port e2af7fce-7442-48b4-8611-da3171b0672b {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 11:49:37 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-1ddc9166-26e8-4aa5-b695-906eb0cfe828 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Acquiring lock "de5084e1-5a5e-48d2-a3ef-7f29898d1d2d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:49:37 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-1ddc9166-26e8-4aa5-b695-906eb0cfe828 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Lock "de5084e1-5a5e-48d2-a3ef-7f29898d1d2d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:49:37 user nova-compute[73449]: INFO nova.compute.manager [None req-1ddc9166-26e8-4aa5-b695-906eb0cfe828 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] Detaching volume 365e93f2-f46d-4b14-b207-f56656bc918c
Aug 17 11:49:37 user nova-compute[73449]: INFO nova.virt.block_device [None req-1ddc9166-26e8-4aa5-b695-906eb0cfe828 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] Attempting to driver detach volume 365e93f2-f46d-4b14-b207-f56656bc918c from mountpoint /dev/vdb
Aug 17 11:49:37 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-1ddc9166-26e8-4aa5-b695-906eb0cfe828 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Attempting to detach device vdb from instance de5084e1-5a5e-48d2-a3ef-7f29898d1d2d from the persistent domain config. {{(pid=73449) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 11:49:37 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-1ddc9166-26e8-4aa5-b695-906eb0cfe828 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 11:49:37 user nova-compute[73449]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 11:49:37 user nova-compute[73449]:   <source dev="/dev/sde"/>
Aug 17 11:49:37 user nova-compute[73449]:   <target dev="vdb" bus="virtio"/>
Aug 17 11:49:37 user nova-compute[73449]:   <serial>365e93f2-f46d-4b14-b207-f56656bc918c</serial>
Aug 17 11:49:37 user nova-compute[73449]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 17 11:49:37 user nova-compute[73449]: </disk>
Aug 17 11:49:37 user nova-compute[73449]:  {{(pid=73449) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 11:49:37 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-1ddc9166-26e8-4aa5-b695-906eb0cfe828 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Successfully detached device vdb from instance de5084e1-5a5e-48d2-a3ef-7f29898d1d2d from the persistent domain config.
Aug 17 11:49:37 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-1ddc9166-26e8-4aa5-b695-906eb0cfe828 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance de5084e1-5a5e-48d2-a3ef-7f29898d1d2d from the live domain config. {{(pid=73449) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 11:49:37 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-1ddc9166-26e8-4aa5-b695-906eb0cfe828 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 11:49:37 user nova-compute[73449]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 11:49:37 user nova-compute[73449]:   <source dev="/dev/sde"/>
Aug 17 11:49:37 user nova-compute[73449]:   <target dev="vdb" bus="virtio"/>
Aug 17 11:49:37 user nova-compute[73449]:   <serial>365e93f2-f46d-4b14-b207-f56656bc918c</serial>
Aug 17 11:49:37 user nova-compute[73449]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 17 11:49:37 user nova-compute[73449]: </disk>
Aug 17 11:49:37 user nova-compute[73449]:  {{(pid=73449) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 11:49:37 user nova-compute[73449]: DEBUG nova.network.neutron [req-70fca398-c77b-48d0-a1c0-4dd517362caa req-23834aa8-eb7d-4d83-88c9-924e4f4ca9b6 service nova] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] Updated VIF entry in instance network info cache for port e2af7fce-7442-48b4-8611-da3171b0672b. {{(pid=73449) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 11:49:37 user nova-compute[73449]: DEBUG nova.network.neutron [req-70fca398-c77b-48d0-a1c0-4dd517362caa req-23834aa8-eb7d-4d83-88c9-924e4f4ca9b6 service nova] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] Updating instance_info_cache with network_info: [{"id": "e2af7fce-7442-48b4-8611-da3171b0672b", "address": "fa:16:3e:c0:c8:a6", "network": {"id": "ff73f5c3-bae6-46cc-bcb8-bbd5be1b478d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1229197917-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5ba3ebf47bd4b999e68c74a5c0ab060", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2af7fce-74", "ovs_interfaceid": "e2af7fce-7442-48b4-8611-da3171b0672b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:49:37 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-70fca398-c77b-48d0-a1c0-4dd517362caa req-23834aa8-eb7d-4d83-88c9-924e4f4ca9b6 service nova] Releasing lock "refresh_cache-de5084e1-5a5e-48d2-a3ef-7f29898d1d2d" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:49:37 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Received event <DeviceRemovedEvent: 1692272977.5806925, de5084e1-5a5e-48d2-a3ef-7f29898d1d2d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73449) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 11:49:37 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-1ddc9166-26e8-4aa5-b695-906eb0cfe828 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance de5084e1-5a5e-48d2-a3ef-7f29898d1d2d {{(pid=73449) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 11:49:37 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-1ddc9166-26e8-4aa5-b695-906eb0cfe828 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Successfully detached device vdb from instance de5084e1-5a5e-48d2-a3ef-7f29898d1d2d from the live domain config.
Aug 17 11:49:37 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ddc9166-26e8-4aa5-b695-906eb0cfe828 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] calling os-brick to detach iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 11:49:37 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ddc9166-26e8-4aa5-b695-906eb0cfe828 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, {'target_iqns': ['iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gcRoTASv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 11:49:37 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-1ddc9166-26e8-4aa5-b695-906eb0cfe828 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 11:49:37 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-1ddc9166-26e8-4aa5-b695-906eb0cfe828 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:49:37 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-1ddc9166-26e8-4aa5-b695-906eb0cfe828 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:49:37 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ddc9166-26e8-4aa5-b695-906eb0cfe828 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c', 0)] {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 11:49:37 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:49:37 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:49:37 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c3c4df7-b709-4fc7-8b77-30ec2525f5ce]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:49:37 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:49:37 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:49:37 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d9df38b-11c8-4bd5-a1fc-9ebdbc1d35f0]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:49:37 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ddc9166-26e8-4aa5-b695-906eb0cfe828 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c (non-flash)
Aug 17 11:49:37 user nova-compute[73449]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe (non-flash)
Aug 17 11:49:37 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:49:37 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ddc9166-26e8-4aa5-b695-906eb0cfe828 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c (non-flash)
Aug 17 11:49:37 user nova-compute[73449]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe (non-flash)
Aug 17 11:49:37 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:49:37 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ddc9166-26e8-4aa5-b695-906eb0cfe828 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe7586e91b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c'): ({'sde'}, set())}) {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 11:49:37 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-1ddc9166-26e8-4aa5-b695-906eb0cfe828 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Removing single pathed devices sde {{(pid=73449) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 11:49:37 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:49:37 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:49:37 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fc2166e-bb60-41fd-8b32-76e521d9340b]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:49:37 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:49:37 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:49:37 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[a46aab1a-3a89-4f4e-b122-50bb53c3f30e]: (4, ('ok\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:49:37 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-1ddc9166-26e8-4aa5-b695-906eb0cfe828 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Flushing IO for device /dev/sde {{(pid=73449) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 11:49:37 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:49:37 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:49:37 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[468890ad-d64e-4e7a-bc1f-48862267430a]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:49:37 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-1ddc9166-26e8-4aa5-b695-906eb0cfe828 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73449) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 11:49:37 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:49:37 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.036s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:49:37 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[98c4a417-5ab3-4217-b1b7-0064fcd11611]: (4, ('1', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:49:37 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-1ddc9166-26e8-4aa5-b695-906eb0cfe828 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73449) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 11:49:37 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-1ddc9166-26e8-4aa5-b695-906eb0cfe828 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] SCSI volumes sde have been removed. {{(pid=73449) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 11:49:37 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ddc9166-26e8-4aa5-b695-906eb0cfe828 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c')] {{(pid=73449) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 11:49:37 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:49:37 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:49:37 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[591e743a-e7cb-46d5-bcc0-06a0503d4ee0]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:49:37 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ddc9166-26e8-4aa5-b695-906eb0cfe828 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:49:37 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c -p 172.16.0.220:3260 --logout {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:49:37 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:49:37 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[12475eb8-c434-4f5d-bd22-1e18b90555f7]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:49:37 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ddc9166-26e8-4aa5-b695-906eb0cfe828 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c, portal: 172.16.0.220,3260]
Aug 17 11:49:37 user nova-compute[73449]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c, portal: 172.16.0.220,3260] successful.
Aug 17 11:49:37 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:49:37 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c -p 172.16.0.220:3260 --op delete {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:49:37 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:365e93f2-f46d-4b14-b207-f56656bc918c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:49:37 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d6a70d0-c872-4d7f-a6e4-e14050d65845]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:49:37 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ddc9166-26e8-4aa5-b695-906eb0cfe828 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:49:37 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-1ddc9166-26e8-4aa5-b695-906eb0cfe828 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.253s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:49:37 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ddc9166-26e8-4aa5-b695-906eb0cfe828 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] <== disconnect_volume: return (254ms) None {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 11:49:37 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ddc9166-26e8-4aa5-b695-906eb0cfe828 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] Disconnected iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 11:49:38 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:49:38 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:49:38 user nova-compute[73449]: DEBUG nova.objects.instance [None req-1ddc9166-26e8-4aa5-b695-906eb0cfe828 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Lazy-loading 'flavor' on Instance uuid de5084e1-5a5e-48d2-a3ef-7f29898d1d2d {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:49:38 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-1ddc9166-26e8-4aa5-b695-906eb0cfe828 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Lock "de5084e1-5a5e-48d2-a3ef-7f29898d1d2d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.684s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:49:43 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-00d82507-85ab-4b72-88fd-484bcecaccfc tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Acquiring lock "f35b7f2b-2f88-4b09-86ac-cb5a78a94584" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:49:43 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-00d82507-85ab-4b72-88fd-484bcecaccfc tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Lock "f35b7f2b-2f88-4b09-86ac-cb5a78a94584" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:49:43 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-00d82507-85ab-4b72-88fd-484bcecaccfc tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Acquiring lock "f35b7f2b-2f88-4b09-86ac-cb5a78a94584-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:49:43 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-00d82507-85ab-4b72-88fd-484bcecaccfc tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Lock "f35b7f2b-2f88-4b09-86ac-cb5a78a94584-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:49:43 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-00d82507-85ab-4b72-88fd-484bcecaccfc tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Lock "f35b7f2b-2f88-4b09-86ac-cb5a78a94584-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:49:43 user nova-compute[73449]: INFO nova.compute.manager [None req-00d82507-85ab-4b72-88fd-484bcecaccfc tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] Terminating instance
Aug 17 11:49:43 user nova-compute[73449]: DEBUG nova.compute.manager [None req-00d82507-85ab-4b72-88fd-484bcecaccfc tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] Start destroying the instance on the hypervisor. {{(pid=73449) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 11:49:43 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:49:43 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:49:43 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:49:43 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:49:43 user nova-compute[73449]: DEBUG nova.compute.manager [req-5b5aedf7-d05d-4f3b-9c96-049510ef9197 req-a24ff6f7-1bab-4f55-a3ff-fbd3aeb064d1 service nova] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] Received event network-vif-unplugged-e86f2a61-e64f-49ea-83ad-386755b33e00 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:49:43 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-5b5aedf7-d05d-4f3b-9c96-049510ef9197 req-a24ff6f7-1bab-4f55-a3ff-fbd3aeb064d1 service nova] Acquiring lock "f35b7f2b-2f88-4b09-86ac-cb5a78a94584-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:49:43 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-5b5aedf7-d05d-4f3b-9c96-049510ef9197 req-a24ff6f7-1bab-4f55-a3ff-fbd3aeb064d1 service nova] Lock "f35b7f2b-2f88-4b09-86ac-cb5a78a94584-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:49:43 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-5b5aedf7-d05d-4f3b-9c96-049510ef9197 req-a24ff6f7-1bab-4f55-a3ff-fbd3aeb064d1 service nova] Lock "f35b7f2b-2f88-4b09-86ac-cb5a78a94584-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:49:43 user nova-compute[73449]: DEBUG nova.compute.manager [req-5b5aedf7-d05d-4f3b-9c96-049510ef9197 req-a24ff6f7-1bab-4f55-a3ff-fbd3aeb064d1 service nova] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] No waiting events found dispatching network-vif-unplugged-e86f2a61-e64f-49ea-83ad-386755b33e00 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:49:43 user nova-compute[73449]: DEBUG nova.compute.manager [req-5b5aedf7-d05d-4f3b-9c96-049510ef9197 req-a24ff6f7-1bab-4f55-a3ff-fbd3aeb064d1 service nova] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] Received event network-vif-unplugged-e86f2a61-e64f-49ea-83ad-386755b33e00 for instance with task_state deleting. {{(pid=73449) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 11:49:43 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:49:43 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] Instance destroyed successfully.
Aug 17 11:49:43 user nova-compute[73449]: DEBUG nova.objects.instance [None req-00d82507-85ab-4b72-88fd-484bcecaccfc tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Lazy-loading 'resources' on Instance uuid f35b7f2b-2f88-4b09-86ac-cb5a78a94584 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:49:43 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-00d82507-85ab-4b72-88fd-484bcecaccfc tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T11:43:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-2119051174',display_name='tempest-ServerActionsTestOtherA-server-1113411740',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-2119051174',id=12,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBslNxfjqeXy15++V9lUN1dUPSj0u5ix1Nnljk5AjIrZhZF+tQog/IhoD1HSXnZkSrwagPwVC/Uewn/Q/J6AkryzpFNZdKWZ4r8749mZJ2bXrxgJUs51emgx4vTQbsCJiQ==',key_name='tempest-keypair-1878071127',keypairs=<?>,launch_index=0,launched_at=2023-08-17T11:46:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='068c5270255744a18208a0ad9b35f168',ramdisk_id='',reservation_id='r-raxmup83',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-303961666',owner_user_name='tempest-ServerActionsTestOtherA-303961666-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T11:46:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e44f6d8893da4d95a8ebe95180355c04',uuid=f35b7f2b-2f88-4b09-86ac-cb5a78a94584,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e86f2a61-e64f-49ea-83ad-386755b33e00", "address": "fa:16:3e:4e:54:ff", "network": {"id": "72c50a42-688f-4868-8e19-c40b103a49cd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1792423641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "068c5270255744a18208a0ad9b35f168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape86f2a61-e6", "ovs_interfaceid": "e86f2a61-e64f-49ea-83ad-386755b33e00", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 11:49:43 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-00d82507-85ab-4b72-88fd-484bcecaccfc tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Converting VIF {"id": "e86f2a61-e64f-49ea-83ad-386755b33e00", "address": "fa:16:3e:4e:54:ff", "network": {"id": "72c50a42-688f-4868-8e19-c40b103a49cd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1792423641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "068c5270255744a18208a0ad9b35f168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape86f2a61-e6", "ovs_interfaceid": "e86f2a61-e64f-49ea-83ad-386755b33e00", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:49:43 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-00d82507-85ab-4b72-88fd-484bcecaccfc tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4e:54:ff,bridge_name='br-int',has_traffic_filtering=True,id=e86f2a61-e64f-49ea-83ad-386755b33e00,network=Network(72c50a42-688f-4868-8e19-c40b103a49cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape86f2a61-e6') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:49:43 user nova-compute[73449]: DEBUG os_vif [None req-00d82507-85ab-4b72-88fd-484bcecaccfc tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4e:54:ff,bridge_name='br-int',has_traffic_filtering=True,id=e86f2a61-e64f-49ea-83ad-386755b33e00,network=Network(72c50a42-688f-4868-8e19-c40b103a49cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape86f2a61-e6') {{(pid=73449) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 11:49:43 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:49:43 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape86f2a61-e6, bridge=br-int, if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:49:43 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:49:43 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:49:43 user nova-compute[73449]: INFO os_vif [None req-00d82507-85ab-4b72-88fd-484bcecaccfc tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4e:54:ff,bridge_name='br-int',has_traffic_filtering=True,id=e86f2a61-e64f-49ea-83ad-386755b33e00,network=Network(72c50a42-688f-4868-8e19-c40b103a49cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape86f2a61-e6')
Aug 17 11:49:43 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-00d82507-85ab-4b72-88fd-484bcecaccfc tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] Deleting instance files /opt/stack/data/nova/instances/f35b7f2b-2f88-4b09-86ac-cb5a78a94584_del
Aug 17 11:49:43 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-00d82507-85ab-4b72-88fd-484bcecaccfc tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] Deletion of /opt/stack/data/nova/instances/f35b7f2b-2f88-4b09-86ac-cb5a78a94584_del complete
Aug 17 11:49:43 user nova-compute[73449]: INFO nova.compute.manager [None req-00d82507-85ab-4b72-88fd-484bcecaccfc tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 17 11:49:43 user nova-compute[73449]: DEBUG oslo.service.loopingcall [None req-00d82507-85ab-4b72-88fd-484bcecaccfc tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73449) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 11:49:43 user nova-compute[73449]: DEBUG nova.compute.manager [-] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] Deallocating network for instance {{(pid=73449) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 11:49:43 user nova-compute[73449]: DEBUG nova.network.neutron [-] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] deallocate_for_instance() {{(pid=73449) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 11:49:45 user nova-compute[73449]: DEBUG nova.network.neutron [-] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] Updating instance_info_cache with network_info: [] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:49:45 user nova-compute[73449]: INFO nova.compute.manager [-] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] Took 1.25 seconds to deallocate network for instance.
Aug 17 11:49:45 user nova-compute[73449]: DEBUG nova.compute.manager [req-656a83b6-b168-4331-9984-adfbaae08a0e req-a05e3e3b-d503-43c0-aac7-75e02ff780ae service nova] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] Received event network-vif-deleted-e86f2a61-e64f-49ea-83ad-386755b33e00 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:49:45 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-00d82507-85ab-4b72-88fd-484bcecaccfc tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:49:45 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-00d82507-85ab-4b72-88fd-484bcecaccfc tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:49:45 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-00d82507-85ab-4b72-88fd-484bcecaccfc tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 11:49:45 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-00d82507-85ab-4b72-88fd-484bcecaccfc tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 11:49:45 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-00d82507-85ab-4b72-88fd-484bcecaccfc tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.295s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:49:45 user nova-compute[73449]: DEBUG nova.compute.manager [req-bec094f5-f916-431b-8b55-525b3ac7da82 req-4b0d90e5-bcf1-4dd5-93bf-6b4cae1923a0 service nova] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] Received event network-vif-plugged-e86f2a61-e64f-49ea-83ad-386755b33e00 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:49:45 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-bec094f5-f916-431b-8b55-525b3ac7da82 req-4b0d90e5-bcf1-4dd5-93bf-6b4cae1923a0 service nova] Acquiring lock "f35b7f2b-2f88-4b09-86ac-cb5a78a94584-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:49:45 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-bec094f5-f916-431b-8b55-525b3ac7da82 req-4b0d90e5-bcf1-4dd5-93bf-6b4cae1923a0 service nova] Lock "f35b7f2b-2f88-4b09-86ac-cb5a78a94584-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:49:45 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-bec094f5-f916-431b-8b55-525b3ac7da82 req-4b0d90e5-bcf1-4dd5-93bf-6b4cae1923a0 service nova] Lock "f35b7f2b-2f88-4b09-86ac-cb5a78a94584-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:49:45 user nova-compute[73449]: DEBUG nova.compute.manager [req-bec094f5-f916-431b-8b55-525b3ac7da82 req-4b0d90e5-bcf1-4dd5-93bf-6b4cae1923a0 service nova] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] No waiting events found dispatching network-vif-plugged-e86f2a61-e64f-49ea-83ad-386755b33e00 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:49:45 user nova-compute[73449]: WARNING nova.compute.manager [req-bec094f5-f916-431b-8b55-525b3ac7da82 req-4b0d90e5-bcf1-4dd5-93bf-6b4cae1923a0 service nova] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] Received unexpected event network-vif-plugged-e86f2a61-e64f-49ea-83ad-386755b33e00 for instance with vm_state deleted and task_state None.
Aug 17 11:49:45 user nova-compute[73449]: INFO nova.scheduler.client.report [None req-00d82507-85ab-4b72-88fd-484bcecaccfc tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Deleted allocations for instance f35b7f2b-2f88-4b09-86ac-cb5a78a94584
Aug 17 11:49:45 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-00d82507-85ab-4b72-88fd-484bcecaccfc tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Lock "f35b7f2b-2f88-4b09-86ac-cb5a78a94584" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.619s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:49:48 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:49:53 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:49:56 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:49:56 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:49:56 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:49:56 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:49:56 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:49:56 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:49:56 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:49:56 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73449) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 11:49:56 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:49:56 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Starting heal instance info cache {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 11:49:56 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Didn't find any instances for network info cache update. {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 11:49:57 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:49:58 user nova-compute[73449]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692272983.8265097, f35b7f2b-2f88-4b09-86ac-cb5a78a94584 => Stopped> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:49:58 user nova-compute[73449]: INFO nova.compute.manager [-] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] VM Stopped (Lifecycle Event)
Aug 17 11:49:58 user nova-compute[73449]: DEBUG nova.compute.manager [None req-39c89c06-cdb5-4518-98d8-425d146aa430 None None] [instance: f35b7f2b-2f88-4b09-86ac-cb5a78a94584] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:49:58 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:49:58 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:49:58 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73449) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 11:49:58 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 11:49:58 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 11:49:58 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:49:58 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:49:58 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:49:58 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:49:58 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:49:58 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=73449) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 11:49:59 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd4ec7bd-002e-4a71-9314-96c21427af27/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:49:59 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd4ec7bd-002e-4a71-9314-96c21427af27/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:49:59 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd4ec7bd-002e-4a71-9314-96c21427af27/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:49:59 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd4ec7bd-002e-4a71-9314-96c21427af27/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:49:59 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fea9f81c-a848-4a65-863e-e09dddf65bcf/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:49:59 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fea9f81c-a848-4a65-863e-e09dddf65bcf/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:49:59 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fea9f81c-a848-4a65-863e-e09dddf65bcf/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:49:59 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fea9f81c-a848-4a65-863e-e09dddf65bcf/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:49:59 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=73449) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 11:49:59 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a9e8ad2-19db-4975-87e4-2efce603a7d7/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:50:00 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a9e8ad2-19db-4975-87e4-2efce603a7d7/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:50:00 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a9e8ad2-19db-4975-87e4-2efce603a7d7/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:50:00 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a9e8ad2-19db-4975-87e4-2efce603a7d7/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:50:00 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk.rescue --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:50:00 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:50:00 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk.rescue --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:50:00 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk.rescue --force-share --output=json" returned: 0 in 0.200s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:50:00 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:50:00 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:50:00 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:50:01 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:50:01 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de5084e1-5a5e-48d2-a3ef-7f29898d1d2d/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:50:01 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de5084e1-5a5e-48d2-a3ef-7f29898d1d2d/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:50:01 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de5084e1-5a5e-48d2-a3ef-7f29898d1d2d/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:50:01 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de5084e1-5a5e-48d2-a3ef-7f29898d1d2d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:50:01 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d74c8f6-fb4e-4460-b722-674a8a1e2d25/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:50:01 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d74c8f6-fb4e-4460-b722-674a8a1e2d25/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:50:01 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d74c8f6-fb4e-4460-b722-674a8a1e2d25/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:50:01 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d74c8f6-fb4e-4460-b722-674a8a1e2d25/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:50:01 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d468854-6182-49c8-acb7-0641df2d5219/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:50:02 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d468854-6182-49c8-acb7-0641df2d5219/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:50:02 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d468854-6182-49c8-acb7-0641df2d5219/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:50:02 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d468854-6182-49c8-acb7-0641df2d5219/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:50:02 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:50:02 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:50:02 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Hypervisor/Node resource view: name=user free_ram=7368MB free_disk=25.35095977783203GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73449) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 11:50:02 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:50:02 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:50:03 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 4a9e8ad2-19db-4975-87e4-2efce603a7d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:50:03 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance de5084e1-5a5e-48d2-a3ef-7f29898d1d2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:50:03 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 3d74c8f6-fb4e-4460-b722-674a8a1e2d25 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:50:03 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance ae75d334-431a-4008-8b3d-f2a727d92417 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:50:03 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 3d468854-6182-49c8-acb7-0641df2d5219 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:50:03 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:50:03 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance dd4ec7bd-002e-4a71-9314-96c21427af27 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:50:03 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance fea9f81c-a848-4a65-863e-e09dddf65bcf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:50:03 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=73449) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 11:50:03 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=73449) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 11:50:03 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 11:50:03 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 11:50:03 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Compute_service record updated for user:user {{(pid=73449) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 11:50:03 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.638s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:50:03 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:50:04 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-082a5514-5afe-4ca5-9549-73332a01f255 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Acquiring lock "3d468854-6182-49c8-acb7-0641df2d5219" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:50:04 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-082a5514-5afe-4ca5-9549-73332a01f255 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Lock "3d468854-6182-49c8-acb7-0641df2d5219" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:50:04 user nova-compute[73449]: DEBUG nova.objects.instance [None req-082a5514-5afe-4ca5-9549-73332a01f255 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Lazy-loading 'flavor' on Instance uuid 3d468854-6182-49c8-acb7-0641df2d5219 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:50:04 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-082a5514-5afe-4ca5-9549-73332a01f255 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Lock "3d468854-6182-49c8-acb7-0641df2d5219" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:50:04 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-082a5514-5afe-4ca5-9549-73332a01f255 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Acquiring lock "3d468854-6182-49c8-acb7-0641df2d5219" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:50:04 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-082a5514-5afe-4ca5-9549-73332a01f255 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Lock "3d468854-6182-49c8-acb7-0641df2d5219" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:50:04 user nova-compute[73449]: INFO nova.compute.manager [None req-082a5514-5afe-4ca5-9549-73332a01f255 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Attaching volume 040e2bc9-cd90-4010-9fdf-b7cc92b1c061 to /dev/vdb
Aug 17 11:50:05 user nova-compute[73449]: DEBUG os_brick.utils [None req-082a5514-5afe-4ca5-9549-73332a01f255 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 11:50:05 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:50:05 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:50:05 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[842b86b9-fafa-47f8-a972-e69dd664712f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4d3924302012\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:50:05 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:50:05 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:50:05 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e06b926-9ee3-48d1-b65f-65895649e2b2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:50:05 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:50:05 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:50:05 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bcf57fb-06f9-4cc5-a8c1-b0cdaa356a3f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:50:05 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bd0c070-88a0-44cd-b4b1-44672086e945]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:50:05 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-082a5514-5afe-4ca5-9549-73332a01f255 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Running cmd (subprocess): nvme version {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:50:05 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-082a5514-5afe-4ca5-9549-73332a01f255 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] 'nvme version' failed. Not Retrying. {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 11:50:05 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.nvmeof [None req-082a5514-5afe-4ca5-9549-73332a01f255 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] nvme not present on system {{(pid=73449) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 11:50:05 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:50:05 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 11:50:05 user nova-compute[73449]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 11:50:05 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[53ae0263-c66c-4d1d-baaf-fc2f2fbe138f]: (4, '') {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:50:05 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-082a5514-5afe-4ca5-9549-73332a01f255 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73449) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 11:50:05 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-082a5514-5afe-4ca5-9549-73332a01f255 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73449) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 11:50:05 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-082a5514-5afe-4ca5-9549-73332a01f255 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] LIGHTOS: no hostnqn found. {{(pid=73449) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 11:50:05 user nova-compute[73449]: DEBUG os_brick.utils [None req-082a5514-5afe-4ca5-9549-73332a01f255 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4d3924302012', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 11:50:05 user nova-compute[73449]: DEBUG nova.virt.block_device [None req-082a5514-5afe-4ca5-9549-73332a01f255 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Updating existing volume attachment record: 414160a1-6002-4762-8c0d-0d45c8c757c5 {{(pid=73449) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 11:50:08 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:50:13 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:50:14 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:50:14 user nova-compute[73449]: DEBUG nova.compute.manager [req-689e2995-72f6-4ac9-a463-7e770a2ea3d3 req-8d2944bd-d688-4c33-8a57-02efa2e64326 service nova] [instance: dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9] Received event network-changed-3fce3b24-0ebe-4f5d-b673-767f2b24a77a {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:50:14 user nova-compute[73449]: DEBUG nova.compute.manager [req-689e2995-72f6-4ac9-a463-7e770a2ea3d3 req-8d2944bd-d688-4c33-8a57-02efa2e64326 service nova] [instance: dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9] Refreshing instance network info cache due to event network-changed-3fce3b24-0ebe-4f5d-b673-767f2b24a77a. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 11:50:14 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-689e2995-72f6-4ac9-a463-7e770a2ea3d3 req-8d2944bd-d688-4c33-8a57-02efa2e64326 service nova] Acquiring lock "refresh_cache-dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:50:14 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-689e2995-72f6-4ac9-a463-7e770a2ea3d3 req-8d2944bd-d688-4c33-8a57-02efa2e64326 service nova] Acquired lock "refresh_cache-dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:50:14 user nova-compute[73449]: DEBUG nova.network.neutron [req-689e2995-72f6-4ac9-a463-7e770a2ea3d3 req-8d2944bd-d688-4c33-8a57-02efa2e64326 service nova] [instance: dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9] Refreshing network info cache for port 3fce3b24-0ebe-4f5d-b673-767f2b24a77a {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 11:50:16 user nova-compute[73449]: DEBUG nova.network.neutron [req-689e2995-72f6-4ac9-a463-7e770a2ea3d3 req-8d2944bd-d688-4c33-8a57-02efa2e64326 service nova] [instance: dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9] Updated VIF entry in instance network info cache for port 3fce3b24-0ebe-4f5d-b673-767f2b24a77a. {{(pid=73449) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 11:50:16 user nova-compute[73449]: DEBUG nova.network.neutron [req-689e2995-72f6-4ac9-a463-7e770a2ea3d3 req-8d2944bd-d688-4c33-8a57-02efa2e64326 service nova] [instance: dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9] Updating instance_info_cache with network_info: [{"id": "3fce3b24-0ebe-4f5d-b673-767f2b24a77a", "address": "fa:16:3e:18:5e:2c", "network": {"id": "a9e8fcd6-4152-466b-99ad-44b85db05a05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-920564935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bd46cdaff7a4b40955f7c8a12c55452", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fce3b24-0e", "ovs_interfaceid": "3fce3b24-0ebe-4f5d-b673-767f2b24a77a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:50:16 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-689e2995-72f6-4ac9-a463-7e770a2ea3d3 req-8d2944bd-d688-4c33-8a57-02efa2e64326 service nova] Releasing lock "refresh_cache-dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:50:16 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-082a5514-5afe-4ca5-9549-73332a01f255 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Calling os-brick to attach iSCSI Volume {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 11:50:16 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-082a5514-5afe-4ca5-9549-73332a01f255 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZpYgxHvU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 11:50:16 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-082a5514-5afe-4ca5-9549-73332a01f255 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 11:50:16 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-082a5514-5afe-4ca5-9549-73332a01f255 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:50:16 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-082a5514-5afe-4ca5-9549-73332a01f255 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:50:16 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-082a5514-5afe-4ca5-9549-73332a01f255 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 11:50:16 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-082a5514-5afe-4ca5-9549-73332a01f255 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:50:16 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-082a5514-5afe-4ca5-9549-73332a01f255 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:50:16 user nova-compute[73449]: INFO os_brick.initiator.connectors.iscsi [None req-082a5514-5afe-4ca5-9549-73332a01f255 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 11:50:16 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 -p 172.16.0.220:3260 {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:50:16 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 -p 172.16.0.220:3260" returned: 21 in 0.044s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:50:16 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[939cb898-6857-424c-b562-ff868bc25182]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:50:16 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-082a5514-5afe-4ca5-9549-73332a01f255 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 11:50:16 user nova-compute[73449]:  {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:50:16 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 -p 172.16.0.220:3260 --interface default --op new {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:50:16 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:50:16 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d60285b-755c-488f-bd39-a54636b8a010]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061] added\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:50:16 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-082a5514-5afe-4ca5-9549-73332a01f255 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061] added
Aug 17 11:50:16 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:50:16 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:50:17 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:50:17 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[b60765f8-612b-4384-a7ac-5df91c40998c]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:50:17 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-082a5514-5afe-4ca5-9549-73332a01f255 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:50:17 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:50:17 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:50:17 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbe94781-825a-45ea-9325-951c77338d7b]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:50:17 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-082a5514-5afe-4ca5-9549-73332a01f255 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:50:17 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZpYgxHvU {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:50:17 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZpYgxHvU" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:50:17 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a90c007-6767-4b08-bfd6-7ca38b0fe93f]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:50:17 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-082a5514-5afe-4ca5-9549-73332a01f255 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZpYgxHvU'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:50:17 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:50:17 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:50:17 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c0e34c-f34a-48ce-b598-97544c0a5f58]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:50:17 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-082a5514-5afe-4ca5-9549-73332a01f255 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:50:17 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:50:17 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:50:17 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[4960b17c-3571-4d87-a1df-2324bfa78a96]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f165bba-9f72-4a33-84cc-4f73733a7a7a (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:50:17 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-082a5514-5afe-4ca5-9549-73332a01f255 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe (non-flash)
Aug 17 11:50:17 user nova-compute[73449]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f165bba-9f72-4a33-84cc-4f73733a7a7a (non-flash)
Aug 17 11:50:17 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:50:17 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-082a5514-5afe-4ca5-9549-73332a01f255 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe (non-flash)
Aug 17 11:50:17 user nova-compute[73449]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f165bba-9f72-4a33-84cc-4f73733a7a7a (non-flash)
Aug 17 11:50:17 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:50:17 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 -p 172.16.0.220:3260 --login {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:50:17 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:50:17 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d0d1493-0758-4f21-960c-12c0713dc431]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:50:17 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-082a5514-5afe-4ca5-9549-73332a01f255 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061, portal: 172.16.0.220,3260]
Aug 17 11:50:17 user nova-compute[73449]: Login to [iface: default, target: iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061, portal: 172.16.0.220,3260] successful.
Aug 17 11:50:17 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:50:17 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:50:17 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:50:17 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[449d4e8a-f522-4d66-946d-21be14a96314]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:50:17 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-082a5514-5afe-4ca5-9549-73332a01f255 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:50:17 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:50:17 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:50:17 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b570b30-8003-4e86-a626-7895598cd993]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f165bba-9f72-4a33-84cc-4f73733a7a7a (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:50:17 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-082a5514-5afe-4ca5-9549-73332a01f255 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe (non-flash)
Aug 17 11:50:17 user nova-compute[73449]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f165bba-9f72-4a33-84cc-4f73733a7a7a (non-flash)
Aug 17 11:50:17 user nova-compute[73449]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 (non-flash)
Aug 17 11:50:17 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:50:17 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-082a5514-5afe-4ca5-9549-73332a01f255 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe (non-flash)
Aug 17 11:50:17 user nova-compute[73449]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f165bba-9f72-4a33-84cc-4f73733a7a7a (non-flash)
Aug 17 11:50:17 user nova-compute[73449]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 (non-flash)
Aug 17 11:50:17 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:50:17 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-082a5514-5afe-4ca5-9549-73332a01f255 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.320s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:50:17 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-082a5514-5afe-4ca5-9549-73332a01f255 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Connected to 172.16.0.220:3260 {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 11:50:17 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-082a5514-5afe-4ca5-9549-73332a01f255 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] HCTL ('34', '-', '-', 0) found on session 28 with lun 0 {{(pid=73449) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 11:50:17 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-082a5514-5afe-4ca5-9549-73332a01f255 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73449) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 11:50:17 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:50:17 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.026s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:50:17 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0bc268f-4b27-4622-95f8-a8bbd300eec1]: (4, ('- - 0', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:50:17 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-082a5514-5afe-4ca5-9549-73332a01f255 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Searching for a device in session 28 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73449) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 11:50:17 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-082a5514-5afe-4ca5-9549-73332a01f255 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZpYgxHvU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 11:50:18 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:50:18 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-082a5514-5afe-4ca5-9549-73332a01f255 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.381s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:50:18 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-082a5514-5afe-4ca5-9549-73332a01f255 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] <== connect_volume: return (1383ms) {'type': 'block', 'scsi_wwn': '26134303632396639', 'path': '/dev/sdc'} {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 11:50:18 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-082a5514-5afe-4ca5-9549-73332a01f255 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26134303632396639', 'path': '/dev/sdc'} {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 11:50:18 user nova-compute[73449]: DEBUG nova.objects.instance [None req-082a5514-5afe-4ca5-9549-73332a01f255 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Lazy-loading 'flavor' on Instance uuid 3d468854-6182-49c8-acb7-0641df2d5219 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:50:18 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-082a5514-5afe-4ca5-9549-73332a01f255 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 11:50:18 user nova-compute[73449]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 11:50:18 user nova-compute[73449]:   <source dev="/dev/sdc"/>
Aug 17 11:50:18 user nova-compute[73449]:   <target dev="vdb" bus="virtio"/>
Aug 17 11:50:18 user nova-compute[73449]:   <serial>040e2bc9-cd90-4010-9fdf-b7cc92b1c061</serial>
Aug 17 11:50:18 user nova-compute[73449]: </disk>
Aug 17 11:50:18 user nova-compute[73449]:  {{(pid=73449) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 11:50:18 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:50:18 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-082a5514-5afe-4ca5-9549-73332a01f255 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] No BDM found with device name vda, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 11:50:18 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-082a5514-5afe-4ca5-9549-73332a01f255 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 11:50:18 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-082a5514-5afe-4ca5-9549-73332a01f255 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] No VIF found with MAC fa:16:3e:8d:35:49, not building metadata {{(pid=73449) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 11:50:19 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-082a5514-5afe-4ca5-9549-73332a01f255 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Lock "3d468854-6182-49c8-acb7-0641df2d5219" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.181s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:50:21 user nova-compute[73449]: DEBUG nova.compute.manager [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Stashing vm_state: active {{(pid=73449) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 17 11:50:21 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:50:21 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:50:21 user nova-compute[73449]: DEBUG nova.objects.instance [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Lazy-loading 'pci_requests' on Instance uuid 3d468854-6182-49c8-acb7-0641df2d5219 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:50:21 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73449) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 11:50:21 user nova-compute[73449]: INFO nova.compute.claims [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Claim successful on node user
Aug 17 11:50:21 user nova-compute[73449]: DEBUG nova.objects.instance [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Lazy-loading 'resources' on Instance uuid 3d468854-6182-49c8-acb7-0641df2d5219 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:50:21 user nova-compute[73449]: DEBUG nova.objects.instance [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Lazy-loading 'pci_devices' on Instance uuid 3d468854-6182-49c8-acb7-0641df2d5219 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:50:21 user nova-compute[73449]: INFO nova.compute.resource_tracker [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Updating resource usage from migration 8bca2c78-a7cb-4f23-ae39-18f96e45b9f4
Aug 17 11:50:22 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 11:50:22 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 11:50:22 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.548s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:50:22 user nova-compute[73449]: INFO nova.compute.manager [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Migrating
Aug 17 11:50:22 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:50:22 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Acquired lock "compute-rpcapi-router" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:50:22 user nova-compute[73449]: INFO nova.compute.rpcapi [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Aug 17 11:50:22 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Releasing lock "compute-rpcapi-router" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:50:22 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Acquiring lock "refresh_cache-3d468854-6182-49c8-acb7-0641df2d5219" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:50:22 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Acquired lock "refresh_cache-3d468854-6182-49c8-acb7-0641df2d5219" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:50:22 user nova-compute[73449]: DEBUG nova.network.neutron [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Building network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 11:50:22 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:50:23 user nova-compute[73449]: DEBUG nova.network.neutron [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Updating instance_info_cache with network_info: [{"id": "1ec58d7f-18a4-4ddb-a137-2b72c5221621", "address": "fa:16:3e:8d:35:49", "network": {"id": "870c4b80-1ae0-4a10-89b8-ec734c66c244", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2050219794-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d6856b60c404a34b6355b5fd6dd7bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec58d7f-18", "ovs_interfaceid": "1ec58d7f-18a4-4ddb-a137-2b72c5221621", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:50:23 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Releasing lock "refresh_cache-3d468854-6182-49c8-acb7-0641df2d5219" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:50:23 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:50:23 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Starting migrate_disk_and_power_off {{(pid=73449) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 17 11:50:23 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:50:23 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:50:23 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:50:23 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:50:23 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:50:23 user nova-compute[73449]: DEBUG nova.compute.manager [req-24b48a5f-271b-419c-ab1c-56e06128cef6 req-b56b7136-1d43-4a05-9dbd-ee2d0b2f78b5 service nova] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Received event network-vif-unplugged-1ec58d7f-18a4-4ddb-a137-2b72c5221621 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:50:23 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-24b48a5f-271b-419c-ab1c-56e06128cef6 req-b56b7136-1d43-4a05-9dbd-ee2d0b2f78b5 service nova] Acquiring lock "3d468854-6182-49c8-acb7-0641df2d5219-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:50:23 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-24b48a5f-271b-419c-ab1c-56e06128cef6 req-b56b7136-1d43-4a05-9dbd-ee2d0b2f78b5 service nova] Lock "3d468854-6182-49c8-acb7-0641df2d5219-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:50:23 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-24b48a5f-271b-419c-ab1c-56e06128cef6 req-b56b7136-1d43-4a05-9dbd-ee2d0b2f78b5 service nova] Lock "3d468854-6182-49c8-acb7-0641df2d5219-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:50:23 user nova-compute[73449]: DEBUG nova.compute.manager [req-24b48a5f-271b-419c-ab1c-56e06128cef6 req-b56b7136-1d43-4a05-9dbd-ee2d0b2f78b5 service nova] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] No waiting events found dispatching network-vif-unplugged-1ec58d7f-18a4-4ddb-a137-2b72c5221621 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:50:23 user nova-compute[73449]: WARNING nova.compute.manager [req-24b48a5f-271b-419c-ab1c-56e06128cef6 req-b56b7136-1d43-4a05-9dbd-ee2d0b2f78b5 service nova] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Received unexpected event network-vif-unplugged-1ec58d7f-18a4-4ddb-a137-2b72c5221621 for instance with vm_state active and task_state resize_migrating.
Aug 17 11:50:23 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:50:23 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Instance destroyed successfully.
Aug 17 11:50:23 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:46:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1456627687',display_name='tempest-ServerActionsTestOtherB-server-1456627687',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1456627687',id=20,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNxG3No2zUVrbEXbRYCvyFo5zdmNWjUQ1w9Et6I/UYTR5GdEjRnJlmF8yAFQAym8G0hKrThB6Qoa83CCIr+oCSIdRZoU+FBKHtl3+QzEAuOyPVMVYrkASnAypoGWlwjgpQ==',key_name='tempest-keypair-1350250606',keypairs=<?>,launch_index=0,launched_at=2023-08-17T11:46:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4d6856b60c404a34b6355b5fd6dd7bb8',ramdisk_id='',reservation_id='r-2byzpdg1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-108358124',owner_user_name='tempest-ServerActionsTestOtherB-108358124-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T11:50:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2791de1444c2428f9120cc907529cfcf',uuid=3d468854-6182-49c8-acb7-0641df2d5219,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1ec58d7f-18a4-4ddb-a137-2b72c5221621", "address": "fa:16:3e:8d:35:49", "network": {"id": "870c4b80-1ae0-4a10-89b8-ec734c66c244", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2050219794-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2050219794-network", "vif_mac": "fa:16:3e:8d:35:49"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d6856b60c404a34b6355b5fd6dd7bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec58d7f-18", "ovs_interfaceid": "1ec58d7f-18a4-4ddb-a137-2b72c5221621", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 11:50:24 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Converting VIF {"id": "1ec58d7f-18a4-4ddb-a137-2b72c5221621", "address": "fa:16:3e:8d:35:49", "network": {"id": "870c4b80-1ae0-4a10-89b8-ec734c66c244", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2050219794-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2050219794-network", "vif_mac": "fa:16:3e:8d:35:49"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d6856b60c404a34b6355b5fd6dd7bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec58d7f-18", "ovs_interfaceid": "1ec58d7f-18a4-4ddb-a137-2b72c5221621", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:50:24 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8d:35:49,bridge_name='br-int',has_traffic_filtering=True,id=1ec58d7f-18a4-4ddb-a137-2b72c5221621,network=Network(870c4b80-1ae0-4a10-89b8-ec734c66c244),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ec58d7f-18') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:50:24 user nova-compute[73449]: DEBUG os_vif [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8d:35:49,bridge_name='br-int',has_traffic_filtering=True,id=1ec58d7f-18a4-4ddb-a137-2b72c5221621,network=Network(870c4b80-1ae0-4a10-89b8-ec734c66c244),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ec58d7f-18') {{(pid=73449) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 11:50:24 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:50:24 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1ec58d7f-18, bridge=br-int, if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:50:24 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:50:24 user nova-compute[73449]: INFO os_vif [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8d:35:49,bridge_name='br-int',has_traffic_filtering=True,id=1ec58d7f-18a4-4ddb-a137-2b72c5221621,network=Network(870c4b80-1ae0-4a10-89b8-ec734c66c244),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ec58d7f-18')
Aug 17 11:50:24 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] calling os-brick to detach iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 11:50:24 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, {'target_iqns': ['iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZpYgxHvU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 11:50:24 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 11:50:24 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:50:24 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:50:24 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061', 0)] {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 11:50:24 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:50:24 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:50:24 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[64a97012-16b8-4dd2-918b-1df9e689f956]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:50:24 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:50:24 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:50:24 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[88a0b80b-9890-4c28-9c94-3f1579fd4239]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:50:24 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe (non-flash)
Aug 17 11:50:24 user nova-compute[73449]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 (non-flash)
Aug 17 11:50:24 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:50:24 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe (non-flash)
Aug 17 11:50:24 user nova-compute[73449]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 (non-flash)
Aug 17 11:50:24 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:50:24 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe7582d9e10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061'): ({'sdc'}, set())}) {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 11:50:24 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Removing single pathed devices sdc {{(pid=73449) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 11:50:24 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:50:24 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:50:24 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e43aead-6421-4f2f-bc5d-405f3bf92e72]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:50:24 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:50:24 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:50:24 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[750ff97c-66e7-4412-b83f-7c36e039e1c5]: (4, ('ok\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:50:24 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Flushing IO for device /dev/sdc {{(pid=73449) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 11:50:24 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:50:24 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:50:24 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[2266b7df-f632-4524-9929-d6713cfd985b]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:50:24 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73449) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 11:50:24 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:50:24 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:50:24 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[730b335b-ebf6-4781-90c6-573519d5daf5]: (4, ('1', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:50:24 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73449) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 11:50:24 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] SCSI volumes sdc have been removed. {{(pid=73449) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 11:50:24 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061')] {{(pid=73449) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 11:50:24 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:50:24 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:50:24 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[816c52ed-5323-4f3c-9bbd-c7a1fa5611c7]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:50:24 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:50:24 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 -p 172.16.0.220:3260 --logout {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:50:24 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:50:24 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc0756d5-87e9-43aa-bd35-66167f47dff9]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:50:24 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061, portal: 172.16.0.220,3260]
Aug 17 11:50:24 user nova-compute[73449]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061, portal: 172.16.0.220,3260] successful.
Aug 17 11:50:24 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:50:24 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 -p 172.16.0.220:3260 --op delete {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:50:24 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:50:24 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[697c4d24-53f2-48ae-b687-ac650f44820f]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:50:24 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:50:24 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:50:24 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] <== disconnect_volume: return (302ms) None {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 11:50:24 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Disconnected iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 11:50:24 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d468854-6182-49c8-acb7-0641df2d5219/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:50:24 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d468854-6182-49c8-acb7-0641df2d5219/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:50:24 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d468854-6182-49c8-acb7-0641df2d5219/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:50:24 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d468854-6182-49c8-acb7-0641df2d5219/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:50:24 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73449) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 11:50:24 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/3d468854-6182-49c8-acb7-0641df2d5219_resize/disk /opt/stack/data/nova/instances/3d468854-6182-49c8-acb7-0641df2d5219/disk {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:50:25 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] CMD "cp -r /opt/stack/data/nova/instances/3d468854-6182-49c8-acb7-0641df2d5219_resize/disk /opt/stack/data/nova/instances/3d468854-6182-49c8-acb7-0641df2d5219/disk" returned: 0 in 0.407s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:50:25 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/3d468854-6182-49c8-acb7-0641df2d5219_resize/disk.info /opt/stack/data/nova/instances/3d468854-6182-49c8-acb7-0641df2d5219/disk.info {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:50:25 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] CMD "cp -r /opt/stack/data/nova/instances/3d468854-6182-49c8-acb7-0641df2d5219_resize/disk.info /opt/stack/data/nova/instances/3d468854-6182-49c8-acb7-0641df2d5219/disk.info" returned: 0 in 0.036s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:50:25 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:50:25 user nova-compute[73449]: DEBUG nova.compute.manager [req-f5064eed-1269-4e98-8b96-312e04207b95 req-4a8bbf32-33cc-466a-adda-34f179cdf461 service nova] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Received event network-vif-plugged-1ec58d7f-18a4-4ddb-a137-2b72c5221621 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:50:25 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-f5064eed-1269-4e98-8b96-312e04207b95 req-4a8bbf32-33cc-466a-adda-34f179cdf461 service nova] Acquiring lock "3d468854-6182-49c8-acb7-0641df2d5219-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:50:25 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-f5064eed-1269-4e98-8b96-312e04207b95 req-4a8bbf32-33cc-466a-adda-34f179cdf461 service nova] Lock "3d468854-6182-49c8-acb7-0641df2d5219-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:50:25 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-f5064eed-1269-4e98-8b96-312e04207b95 req-4a8bbf32-33cc-466a-adda-34f179cdf461 service nova] Lock "3d468854-6182-49c8-acb7-0641df2d5219-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:50:25 user nova-compute[73449]: DEBUG nova.compute.manager [req-f5064eed-1269-4e98-8b96-312e04207b95 req-4a8bbf32-33cc-466a-adda-34f179cdf461 service nova] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] No waiting events found dispatching network-vif-plugged-1ec58d7f-18a4-4ddb-a137-2b72c5221621 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:50:25 user nova-compute[73449]: WARNING nova.compute.manager [req-f5064eed-1269-4e98-8b96-312e04207b95 req-4a8bbf32-33cc-466a-adda-34f179cdf461 service nova] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Received unexpected event network-vif-plugged-1ec58d7f-18a4-4ddb-a137-2b72c5221621 for instance with vm_state active and task_state resize_migrating.
Aug 17 11:50:26 user nova-compute[73449]: DEBUG nova.network.neutron [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Port 1ec58d7f-18a4-4ddb-a137-2b72c5221621 binding to destination host user is already ACTIVE {{(pid=73449) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 17 11:50:26 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Acquiring lock "3d468854-6182-49c8-acb7-0641df2d5219-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:50:26 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Lock "3d468854-6182-49c8-acb7-0641df2d5219-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:50:26 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Lock "3d468854-6182-49c8-acb7-0641df2d5219-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:50:26 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-678756a8-0736-4c0f-9805-864bcd3ae646 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Acquiring lock "5612f7d1-a901-4bdd-a24a-faf9a980cd04" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:50:26 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-678756a8-0736-4c0f-9805-864bcd3ae646 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Lock "5612f7d1-a901-4bdd-a24a-faf9a980cd04" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:50:26 user nova-compute[73449]: INFO nova.compute.manager [None req-678756a8-0736-4c0f-9805-864bcd3ae646 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Unshelving
Aug 17 11:50:26 user nova-compute[73449]: INFO nova.virt.block_device [None req-678756a8-0736-4c0f-9805-864bcd3ae646 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Booting with volume fc3c38dd-5692-448f-b1fc-b8fe08052611 at /dev/vda
Aug 17 11:50:26 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Acquiring lock "refresh_cache-3d468854-6182-49c8-acb7-0641df2d5219" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:50:26 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Acquired lock "refresh_cache-3d468854-6182-49c8-acb7-0641df2d5219" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:50:26 user nova-compute[73449]: DEBUG nova.network.neutron [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Building network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 11:50:26 user nova-compute[73449]: DEBUG os_brick.utils [None req-678756a8-0736-4c0f-9805-864bcd3ae646 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 11:50:26 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:50:26 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:50:26 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f889cf4-0c3a-4aef-b7dc-314f937f0ad9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4d3924302012\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:50:26 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:50:26 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:50:26 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[47048f3a-a9a0-47ab-990e-1124436200f2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:50:26 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:50:26 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:50:26 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[0da05113-c769-4c14-8221-e908a7f43044]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:50:26 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed0b9bc6-5d7f-4e54-a8d8-cdbc51dc531b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:50:26 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-678756a8-0736-4c0f-9805-864bcd3ae646 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Running cmd (subprocess): nvme version {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:50:26 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-678756a8-0736-4c0f-9805-864bcd3ae646 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] 'nvme version' failed. Not Retrying. {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 11:50:26 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.nvmeof [None req-678756a8-0736-4c0f-9805-864bcd3ae646 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] nvme not present on system {{(pid=73449) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 11:50:26 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:50:26 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 11:50:26 user nova-compute[73449]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 11:50:26 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[09fa330d-640b-44f9-bba7-a892773c7539]: (4, '') {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:50:26 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-678756a8-0736-4c0f-9805-864bcd3ae646 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73449) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 11:50:26 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-678756a8-0736-4c0f-9805-864bcd3ae646 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73449) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 11:50:26 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-678756a8-0736-4c0f-9805-864bcd3ae646 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] LIGHTOS: no hostnqn found. {{(pid=73449) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 11:50:26 user nova-compute[73449]: DEBUG os_brick.utils [None req-678756a8-0736-4c0f-9805-864bcd3ae646 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] <== get_connector_properties: return (156ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4d3924302012', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 11:50:26 user nova-compute[73449]: DEBUG nova.virt.block_device [None req-678756a8-0736-4c0f-9805-864bcd3ae646 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Updating existing volume attachment record: 0ba2b424-652a-40be-827a-6ba0b6fc384f {{(pid=73449) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 11:50:27 user nova-compute[73449]: DEBUG nova.network.neutron [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Updating instance_info_cache with network_info: [{"id": "1ec58d7f-18a4-4ddb-a137-2b72c5221621", "address": "fa:16:3e:8d:35:49", "network": {"id": "870c4b80-1ae0-4a10-89b8-ec734c66c244", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2050219794-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d6856b60c404a34b6355b5fd6dd7bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec58d7f-18", "ovs_interfaceid": "1ec58d7f-18a4-4ddb-a137-2b72c5221621", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:50:27 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Releasing lock "refresh_cache-3d468854-6182-49c8-acb7-0641df2d5219" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:50:27 user nova-compute[73449]: DEBUG os_brick.utils [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 11:50:27 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:50:27 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:50:27 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[b48cab0f-7049-463b-922f-94ceec9b636a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4d3924302012\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:50:27 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:50:27 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:50:27 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dfb14ef-2ca5-4de2-89a3-9b617bcffb94]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:50:27 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:50:27 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:50:27 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb3288e2-3600-45f3-9863-6de3a4db729a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:50:27 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[b92c5ce4-76af-4bd5-ba8a-98a06a24edca]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:50:27 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Running cmd (subprocess): nvme version {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:50:27 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] 'nvme version' failed. Not Retrying. {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 11:50:27 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.nvmeof [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] nvme not present on system {{(pid=73449) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 11:50:27 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:50:27 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 11:50:27 user nova-compute[73449]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 11:50:27 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[72225bab-6478-418f-8337-3132a245fbe6]: (4, '') {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:50:27 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73449) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 11:50:27 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73449) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 11:50:27 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] LIGHTOS: no hostnqn found. {{(pid=73449) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 11:50:27 user nova-compute[73449]: DEBUG os_brick.utils [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4d3924302012', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 11:50:27 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b807c0b0-533d-4a38-bab5-9a2bf8ca6ddf tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Acquiring lock "89440604-1daf-4e7a-a524-2f9c21a9cb96" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:50:27 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b807c0b0-533d-4a38-bab5-9a2bf8ca6ddf tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Lock "89440604-1daf-4e7a-a524-2f9c21a9cb96" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:50:27 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b807c0b0-533d-4a38-bab5-9a2bf8ca6ddf tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 89440604-1daf-4e7a-a524-2f9c21a9cb96] Starting instance... {{(pid=73449) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 11:50:28 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b807c0b0-533d-4a38-bab5-9a2bf8ca6ddf tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:50:28 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b807c0b0-533d-4a38-bab5-9a2bf8ca6ddf tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:50:28 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-b807c0b0-533d-4a38-bab5-9a2bf8ca6ddf tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73449) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 11:50:28 user nova-compute[73449]: INFO nova.compute.claims [None req-b807c0b0-533d-4a38-bab5-9a2bf8ca6ddf tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 89440604-1daf-4e7a-a524-2f9c21a9cb96] Claim successful on node user
Aug 17 11:50:28 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:50:28 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-b807c0b0-533d-4a38-bab5-9a2bf8ca6ddf tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 11:50:28 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-b807c0b0-533d-4a38-bab5-9a2bf8ca6ddf tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 11:50:28 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b807c0b0-533d-4a38-bab5-9a2bf8ca6ddf tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.614s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:50:28 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b807c0b0-533d-4a38-bab5-9a2bf8ca6ddf tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 89440604-1daf-4e7a-a524-2f9c21a9cb96] Start building networks asynchronously for instance. {{(pid=73449) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 11:50:28 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b807c0b0-533d-4a38-bab5-9a2bf8ca6ddf tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 89440604-1daf-4e7a-a524-2f9c21a9cb96] Allocating IP information in the background. {{(pid=73449) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 11:50:28 user nova-compute[73449]: DEBUG nova.network.neutron [None req-b807c0b0-533d-4a38-bab5-9a2bf8ca6ddf tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 89440604-1daf-4e7a-a524-2f9c21a9cb96] allocate_for_instance() {{(pid=73449) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 11:50:28 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-b807c0b0-533d-4a38-bab5-9a2bf8ca6ddf tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 89440604-1daf-4e7a-a524-2f9c21a9cb96] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 11:50:28 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b807c0b0-533d-4a38-bab5-9a2bf8ca6ddf tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 89440604-1daf-4e7a-a524-2f9c21a9cb96] Start building block device mappings for instance. {{(pid=73449) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 11:50:28 user nova-compute[73449]: DEBUG nova.policy [None req-b807c0b0-533d-4a38-bab5-9a2bf8ca6ddf tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '14eb3826311a4f8f91d8264e87f7b866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec3b0b72e47448ebe99f9fc64119c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73449) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 11:50:28 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b807c0b0-533d-4a38-bab5-9a2bf8ca6ddf tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 89440604-1daf-4e7a-a524-2f9c21a9cb96] Start spawning the instance on the hypervisor. {{(pid=73449) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 11:50:28 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b807c0b0-533d-4a38-bab5-9a2bf8ca6ddf tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 89440604-1daf-4e7a-a524-2f9c21a9cb96] Creating instance directory {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 11:50:28 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-b807c0b0-533d-4a38-bab5-9a2bf8ca6ddf tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 89440604-1daf-4e7a-a524-2f9c21a9cb96] Creating image(s)
Aug 17 11:50:28 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b807c0b0-533d-4a38-bab5-9a2bf8ca6ddf tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Acquiring lock "/opt/stack/data/nova/instances/89440604-1daf-4e7a-a524-2f9c21a9cb96/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:50:28 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b807c0b0-533d-4a38-bab5-9a2bf8ca6ddf tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Lock "/opt/stack/data/nova/instances/89440604-1daf-4e7a-a524-2f9c21a9cb96/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:50:28 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b807c0b0-533d-4a38-bab5-9a2bf8ca6ddf tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Lock "/opt/stack/data/nova/instances/89440604-1daf-4e7a-a524-2f9c21a9cb96/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:50:28 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-b807c0b0-533d-4a38-bab5-9a2bf8ca6ddf tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:50:29 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:50:29 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-b807c0b0-533d-4a38-bab5-9a2bf8ca6ddf tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json" returned: 0 in 0.194s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:50:29 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b807c0b0-533d-4a38-bab5-9a2bf8ca6ddf tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Acquiring lock "7e267a577c062ee862e95ede6b48cfd5632f3ea3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:50:29 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b807c0b0-533d-4a38-bab5-9a2bf8ca6ddf tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Lock "7e267a577c062ee862e95ede6b48cfd5632f3ea3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:50:29 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-b807c0b0-533d-4a38-bab5-9a2bf8ca6ddf tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:50:29 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-b807c0b0-533d-4a38-bab5-9a2bf8ca6ddf tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json" returned: 0 in 0.212s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:50:29 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-b807c0b0-533d-4a38-bab5-9a2bf8ca6ddf tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3,backing_fmt=raw /opt/stack/data/nova/instances/89440604-1daf-4e7a-a524-2f9c21a9cb96/disk 1073741824 {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:50:29 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-b807c0b0-533d-4a38-bab5-9a2bf8ca6ddf tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3,backing_fmt=raw /opt/stack/data/nova/instances/89440604-1daf-4e7a-a524-2f9c21a9cb96/disk 1073741824" returned: 0 in 0.081s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:50:29 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b807c0b0-533d-4a38-bab5-9a2bf8ca6ddf tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Lock "7e267a577c062ee862e95ede6b48cfd5632f3ea3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.302s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:50:29 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-b807c0b0-533d-4a38-bab5-9a2bf8ca6ddf tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:50:29 user nova-compute[73449]: DEBUG nova.network.neutron [None req-b807c0b0-533d-4a38-bab5-9a2bf8ca6ddf tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 89440604-1daf-4e7a-a524-2f9c21a9cb96] Successfully created port: 7ebcec20-01ec-4807-876d-d95bff0a8a77 {{(pid=73449) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 11:50:29 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-77a78fca-afaa-45a1-9fc8-969a4d5f7b0f tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Acquiring lock "ec622bf0-4531-4892-b637-0ef564cf453b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:50:29 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-77a78fca-afaa-45a1-9fc8-969a4d5f7b0f tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Lock "ec622bf0-4531-4892-b637-0ef564cf453b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:50:29 user nova-compute[73449]: DEBUG nova.compute.manager [None req-77a78fca-afaa-45a1-9fc8-969a4d5f7b0f tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: ec622bf0-4531-4892-b637-0ef564cf453b] Starting instance... {{(pid=73449) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 11:50:29 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-77a78fca-afaa-45a1-9fc8-969a4d5f7b0f tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:50:29 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-77a78fca-afaa-45a1-9fc8-969a4d5f7b0f tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:50:29 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-77a78fca-afaa-45a1-9fc8-969a4d5f7b0f tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73449) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 11:50:29 user nova-compute[73449]: INFO nova.compute.claims [None req-77a78fca-afaa-45a1-9fc8-969a4d5f7b0f tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: ec622bf0-4531-4892-b637-0ef564cf453b] Claim successful on node user
Aug 17 11:50:29 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-b807c0b0-533d-4a38-bab5-9a2bf8ca6ddf tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json" returned: 0 in 0.247s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:50:29 user nova-compute[73449]: DEBUG nova.virt.disk.api [None req-b807c0b0-533d-4a38-bab5-9a2bf8ca6ddf tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Checking if we can resize image /opt/stack/data/nova/instances/89440604-1daf-4e7a-a524-2f9c21a9cb96/disk. size=1073741824 {{(pid=73449) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 11:50:29 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-b807c0b0-533d-4a38-bab5-9a2bf8ca6ddf tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89440604-1daf-4e7a-a524-2f9c21a9cb96/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:50:29 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-b807c0b0-533d-4a38-bab5-9a2bf8ca6ddf tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89440604-1daf-4e7a-a524-2f9c21a9cb96/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:50:29 user nova-compute[73449]: DEBUG nova.virt.disk.api [None req-b807c0b0-533d-4a38-bab5-9a2bf8ca6ddf tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Cannot resize image /opt/stack/data/nova/instances/89440604-1daf-4e7a-a524-2f9c21a9cb96/disk to a smaller size. {{(pid=73449) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 11:50:29 user nova-compute[73449]: DEBUG nova.objects.instance [None req-b807c0b0-533d-4a38-bab5-9a2bf8ca6ddf tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Lazy-loading 'migration_context' on Instance uuid 89440604-1daf-4e7a-a524-2f9c21a9cb96 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:50:29 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b807c0b0-533d-4a38-bab5-9a2bf8ca6ddf tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 89440604-1daf-4e7a-a524-2f9c21a9cb96] Created local disks {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 11:50:29 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b807c0b0-533d-4a38-bab5-9a2bf8ca6ddf tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 89440604-1daf-4e7a-a524-2f9c21a9cb96] Ensure instance console log exists: /opt/stack/data/nova/instances/89440604-1daf-4e7a-a524-2f9c21a9cb96/console.log {{(pid=73449) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 11:50:29 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b807c0b0-533d-4a38-bab5-9a2bf8ca6ddf tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:50:29 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b807c0b0-533d-4a38-bab5-9a2bf8ca6ddf tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:50:29 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b807c0b0-533d-4a38-bab5-9a2bf8ca6ddf tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:50:30 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-77a78fca-afaa-45a1-9fc8-969a4d5f7b0f tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 11:50:30 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-77a78fca-afaa-45a1-9fc8-969a4d5f7b0f tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 11:50:30 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-77a78fca-afaa-45a1-9fc8-969a4d5f7b0f tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.651s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:50:30 user nova-compute[73449]: DEBUG nova.compute.manager [None req-77a78fca-afaa-45a1-9fc8-969a4d5f7b0f tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: ec622bf0-4531-4892-b637-0ef564cf453b] Start building networks asynchronously for instance. {{(pid=73449) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 11:50:30 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-77a78fca-afaa-45a1-9fc8-969a4d5f7b0f tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: ec622bf0-4531-4892-b637-0ef564cf453b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 11:50:30 user nova-compute[73449]: DEBUG nova.compute.manager [None req-77a78fca-afaa-45a1-9fc8-969a4d5f7b0f tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: ec622bf0-4531-4892-b637-0ef564cf453b] Allocating IP information in the background. {{(pid=73449) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 11:50:30 user nova-compute[73449]: DEBUG nova.network.neutron [None req-77a78fca-afaa-45a1-9fc8-969a4d5f7b0f tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: ec622bf0-4531-4892-b637-0ef564cf453b] allocate_for_instance() {{(pid=73449) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 11:50:30 user nova-compute[73449]: DEBUG nova.compute.manager [None req-77a78fca-afaa-45a1-9fc8-969a4d5f7b0f tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: ec622bf0-4531-4892-b637-0ef564cf453b] Start building block device mappings for instance. {{(pid=73449) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 11:50:30 user nova-compute[73449]: DEBUG nova.network.neutron [None req-b807c0b0-533d-4a38-bab5-9a2bf8ca6ddf tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 89440604-1daf-4e7a-a524-2f9c21a9cb96] Successfully updated port: 7ebcec20-01ec-4807-876d-d95bff0a8a77 {{(pid=73449) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 11:50:30 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b807c0b0-533d-4a38-bab5-9a2bf8ca6ddf tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Acquiring lock "refresh_cache-89440604-1daf-4e7a-a524-2f9c21a9cb96" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:50:30 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b807c0b0-533d-4a38-bab5-9a2bf8ca6ddf tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Acquired lock "refresh_cache-89440604-1daf-4e7a-a524-2f9c21a9cb96" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:50:30 user nova-compute[73449]: DEBUG nova.network.neutron [None req-b807c0b0-533d-4a38-bab5-9a2bf8ca6ddf tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 89440604-1daf-4e7a-a524-2f9c21a9cb96] Building network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 11:50:30 user nova-compute[73449]: DEBUG nova.compute.manager [req-a9baf28f-135d-4d81-a365-32e36c418637 req-c02d25a9-5b84-4710-9ef7-b7469d85cb4b service nova] [instance: 89440604-1daf-4e7a-a524-2f9c21a9cb96] Received event network-changed-7ebcec20-01ec-4807-876d-d95bff0a8a77 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:50:30 user nova-compute[73449]: DEBUG nova.compute.manager [req-a9baf28f-135d-4d81-a365-32e36c418637 req-c02d25a9-5b84-4710-9ef7-b7469d85cb4b service nova] [instance: 89440604-1daf-4e7a-a524-2f9c21a9cb96] Refreshing instance network info cache due to event network-changed-7ebcec20-01ec-4807-876d-d95bff0a8a77. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 11:50:30 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-a9baf28f-135d-4d81-a365-32e36c418637 req-c02d25a9-5b84-4710-9ef7-b7469d85cb4b service nova] Acquiring lock "refresh_cache-89440604-1daf-4e7a-a524-2f9c21a9cb96" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:50:30 user nova-compute[73449]: INFO nova.virt.block_device [None req-77a78fca-afaa-45a1-9fc8-969a4d5f7b0f tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: ec622bf0-4531-4892-b637-0ef564cf453b] Booting with volume snapshot 915bd243-53da-4f28-a1d2-4bf9a282a0b6 at /dev/vda
Aug 17 11:50:30 user nova-compute[73449]: DEBUG nova.network.neutron [None req-b807c0b0-533d-4a38-bab5-9a2bf8ca6ddf tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 89440604-1daf-4e7a-a524-2f9c21a9cb96] Instance cache missing network info. {{(pid=73449) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 11:50:30 user nova-compute[73449]: DEBUG nova.policy [None req-77a78fca-afaa-45a1-9fc8-969a4d5f7b0f tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '804ccb0440fb46a4a4c0ae65c3893296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd46cdaff7a4b40955f7c8a12c55452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73449) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 11:50:30 user nova-compute[73449]: DEBUG nova.network.neutron [None req-b807c0b0-533d-4a38-bab5-9a2bf8ca6ddf tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 89440604-1daf-4e7a-a524-2f9c21a9cb96] Updating instance_info_cache with network_info: [{"id": "7ebcec20-01ec-4807-876d-d95bff0a8a77", "address": "fa:16:3e:52:45:6e", "network": {"id": "9455bb75-f75a-41ff-8f6f-49f55aa738f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-425274599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec3b0b72e47448ebe99f9fc64119c1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ebcec20-01", "ovs_interfaceid": "7ebcec20-01ec-4807-876d-d95bff0a8a77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:50:30 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b807c0b0-533d-4a38-bab5-9a2bf8ca6ddf tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Releasing lock "refresh_cache-89440604-1daf-4e7a-a524-2f9c21a9cb96" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:50:30 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b807c0b0-533d-4a38-bab5-9a2bf8ca6ddf tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 89440604-1daf-4e7a-a524-2f9c21a9cb96] Instance network_info: |[{"id": "7ebcec20-01ec-4807-876d-d95bff0a8a77", "address": "fa:16:3e:52:45:6e", "network": {"id": "9455bb75-f75a-41ff-8f6f-49f55aa738f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-425274599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec3b0b72e47448ebe99f9fc64119c1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ebcec20-01", "ovs_interfaceid": "7ebcec20-01ec-4807-876d-d95bff0a8a77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73449) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 11:50:30 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-a9baf28f-135d-4d81-a365-32e36c418637 req-c02d25a9-5b84-4710-9ef7-b7469d85cb4b service nova] Acquired lock "refresh_cache-89440604-1daf-4e7a-a524-2f9c21a9cb96" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:50:30 user nova-compute[73449]: DEBUG nova.network.neutron [req-a9baf28f-135d-4d81-a365-32e36c418637 req-c02d25a9-5b84-4710-9ef7-b7469d85cb4b service nova] [instance: 89440604-1daf-4e7a-a524-2f9c21a9cb96] Refreshing network info cache for port 7ebcec20-01ec-4807-876d-d95bff0a8a77 {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 11:50:30 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b807c0b0-533d-4a38-bab5-9a2bf8ca6ddf tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 89440604-1daf-4e7a-a524-2f9c21a9cb96] Start _get_guest_xml network_info=[{"id": "7ebcec20-01ec-4807-876d-d95bff0a8a77", "address": "fa:16:3e:52:45:6e", "network": {"id": "9455bb75-f75a-41ff-8f6f-49f55aa738f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-425274599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec3b0b72e47448ebe99f9fc64119c1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ebcec20-01", "ovs_interfaceid": "7ebcec20-01ec-4807-876d-d95bff0a8a77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T11:36:11Z,direct_url=<?>,disk_format='qcow2',id=0a2904ae-083d-41c8-83db-343132b36148,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7a77880136a54ef195c82e018e1939db',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T11:36:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': '0a2904ae-083d-41c8-83db-343132b36148'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 11:50:30 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-b807c0b0-533d-4a38-bab5-9a2bf8ca6ddf tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:50:30 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-b807c0b0-533d-4a38-bab5-9a2bf8ca6ddf tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:50:30 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-b807c0b0-533d-4a38-bab5-9a2bf8ca6ddf tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 11:50:30 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-b807c0b0-533d-4a38-bab5-9a2bf8ca6ddf tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] CPU controller missing on host. {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 11:50:30 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-b807c0b0-533d-4a38-bab5-9a2bf8ca6ddf tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 11:50:30 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-b807c0b0-533d-4a38-bab5-9a2bf8ca6ddf tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] CPU controller found on host. {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 11:50:30 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b807c0b0-533d-4a38-bab5-9a2bf8ca6ddf tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73449) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 11:50:30 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-b807c0b0-533d-4a38-bab5-9a2bf8ca6ddf tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T11:35:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T11:36:11Z,direct_url=<?>,disk_format='qcow2',id=0a2904ae-083d-41c8-83db-343132b36148,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7a77880136a54ef195c82e018e1939db',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T11:36:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 11:50:30 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-b807c0b0-533d-4a38-bab5-9a2bf8ca6ddf tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Flavor limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 11:50:30 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-b807c0b0-533d-4a38-bab5-9a2bf8ca6ddf tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Image limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 11:50:30 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-b807c0b0-533d-4a38-bab5-9a2bf8ca6ddf tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Flavor pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 11:50:30 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-b807c0b0-533d-4a38-bab5-9a2bf8ca6ddf tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Image pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 11:50:30 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-b807c0b0-533d-4a38-bab5-9a2bf8ca6ddf tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 11:50:30 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-b807c0b0-533d-4a38-bab5-9a2bf8ca6ddf tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 11:50:30 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-b807c0b0-533d-4a38-bab5-9a2bf8ca6ddf tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 11:50:30 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-b807c0b0-533d-4a38-bab5-9a2bf8ca6ddf tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Got 1 possible topologies {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 11:50:30 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-b807c0b0-533d-4a38-bab5-9a2bf8ca6ddf tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 11:50:30 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-b807c0b0-533d-4a38-bab5-9a2bf8ca6ddf tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 11:50:30 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-b807c0b0-533d-4a38-bab5-9a2bf8ca6ddf tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:50:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2138348058',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2138348058',id=26,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ec3b0b72e47448ebe99f9fc64119c1c',ramdisk_id='',reservation_id='r-uvhfpgje',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1818019421',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T11:50:29Z,user_data=None,user_id='14eb3826311a4f8f91d8264e87f7b866',uuid=89440604-1daf-4e7a-a524-2f9c21a9cb96,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7ebcec20-01ec-4807-876d-d95bff0a8a77", "address": "fa:16:3e:52:45:6e", "network": {"id": "9455bb75-f75a-41ff-8f6f-49f55aa738f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-425274599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec3b0b72e47448ebe99f9fc64119c1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ebcec20-01", "ovs_interfaceid": "7ebcec20-01ec-4807-876d-d95bff0a8a77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73449) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 11:50:30 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-b807c0b0-533d-4a38-bab5-9a2bf8ca6ddf tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Converting VIF {"id": "7ebcec20-01ec-4807-876d-d95bff0a8a77", "address": "fa:16:3e:52:45:6e", "network": {"id": "9455bb75-f75a-41ff-8f6f-49f55aa738f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-425274599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec3b0b72e47448ebe99f9fc64119c1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ebcec20-01", "ovs_interfaceid": "7ebcec20-01ec-4807-876d-d95bff0a8a77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:50:30 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-b807c0b0-533d-4a38-bab5-9a2bf8ca6ddf tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:45:6e,bridge_name='br-int',has_traffic_filtering=True,id=7ebcec20-01ec-4807-876d-d95bff0a8a77,network=Network(9455bb75-f75a-41ff-8f6f-49f55aa738f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ebcec20-01') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:50:30 user nova-compute[73449]: DEBUG nova.objects.instance [None req-b807c0b0-533d-4a38-bab5-9a2bf8ca6ddf tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Lazy-loading 'pci_devices' on Instance uuid 89440604-1daf-4e7a-a524-2f9c21a9cb96 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:50:30 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b807c0b0-533d-4a38-bab5-9a2bf8ca6ddf tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 89440604-1daf-4e7a-a524-2f9c21a9cb96] End _get_guest_xml xml=<domain type="kvm">
Aug 17 11:50:30 user nova-compute[73449]:   <uuid>89440604-1daf-4e7a-a524-2f9c21a9cb96</uuid>
Aug 17 11:50:30 user nova-compute[73449]:   <name>instance-0000001a</name>
Aug 17 11:50:30 user nova-compute[73449]:   <memory>524288</memory>
Aug 17 11:50:30 user nova-compute[73449]:   <vcpu>1</vcpu>
Aug 17 11:50:30 user nova-compute[73449]:   <metadata>
Aug 17 11:50:30 user nova-compute[73449]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 11:50:30 user nova-compute[73449]:       <nova:package version="0.0.0"/>
Aug 17 11:50:30 user nova-compute[73449]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2138348058</nova:name>
Aug 17 11:50:30 user nova-compute[73449]:       <nova:creationTime>2023-08-17 11:50:30</nova:creationTime>
Aug 17 11:50:30 user nova-compute[73449]:       <nova:flavor name="m1.tiny">
Aug 17 11:50:30 user nova-compute[73449]:         <nova:memory>512</nova:memory>
Aug 17 11:50:30 user nova-compute[73449]:         <nova:disk>1</nova:disk>
Aug 17 11:50:30 user nova-compute[73449]:         <nova:swap>0</nova:swap>
Aug 17 11:50:30 user nova-compute[73449]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 11:50:30 user nova-compute[73449]:         <nova:vcpus>1</nova:vcpus>
Aug 17 11:50:30 user nova-compute[73449]:       </nova:flavor>
Aug 17 11:50:30 user nova-compute[73449]:       <nova:owner>
Aug 17 11:50:30 user nova-compute[73449]:         <nova:user uuid="14eb3826311a4f8f91d8264e87f7b866">tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member</nova:user>
Aug 17 11:50:30 user nova-compute[73449]:         <nova:project uuid="4ec3b0b72e47448ebe99f9fc64119c1c">tempest-ServerBootFromVolumeStableRescueTest-1818019421</nova:project>
Aug 17 11:50:30 user nova-compute[73449]:       </nova:owner>
Aug 17 11:50:30 user nova-compute[73449]:       <nova:root type="image" uuid="0a2904ae-083d-41c8-83db-343132b36148"/>
Aug 17 11:50:30 user nova-compute[73449]:       <nova:ports>
Aug 17 11:50:30 user nova-compute[73449]:         <nova:port uuid="7ebcec20-01ec-4807-876d-d95bff0a8a77">
Aug 17 11:50:30 user nova-compute[73449]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 17 11:50:30 user nova-compute[73449]:         </nova:port>
Aug 17 11:50:30 user nova-compute[73449]:       </nova:ports>
Aug 17 11:50:30 user nova-compute[73449]:     </nova:instance>
Aug 17 11:50:30 user nova-compute[73449]:   </metadata>
Aug 17 11:50:30 user nova-compute[73449]:   <sysinfo type="smbios">
Aug 17 11:50:30 user nova-compute[73449]:     <system>
Aug 17 11:50:30 user nova-compute[73449]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 11:50:30 user nova-compute[73449]:       <entry name="product">OpenStack Nova</entry>
Aug 17 11:50:30 user nova-compute[73449]:       <entry name="version">0.0.0</entry>
Aug 17 11:50:30 user nova-compute[73449]:       <entry name="serial">89440604-1daf-4e7a-a524-2f9c21a9cb96</entry>
Aug 17 11:50:30 user nova-compute[73449]:       <entry name="uuid">89440604-1daf-4e7a-a524-2f9c21a9cb96</entry>
Aug 17 11:50:30 user nova-compute[73449]:       <entry name="family">Virtual Machine</entry>
Aug 17 11:50:30 user nova-compute[73449]:     </system>
Aug 17 11:50:30 user nova-compute[73449]:   </sysinfo>
Aug 17 11:50:30 user nova-compute[73449]:   <os>
Aug 17 11:50:30 user nova-compute[73449]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 11:50:30 user nova-compute[73449]:     <boot dev="hd"/>
Aug 17 11:50:30 user nova-compute[73449]:     <smbios mode="sysinfo"/>
Aug 17 11:50:30 user nova-compute[73449]:   </os>
Aug 17 11:50:30 user nova-compute[73449]:   <features>
Aug 17 11:50:30 user nova-compute[73449]:     <acpi/>
Aug 17 11:50:30 user nova-compute[73449]:     <apic/>
Aug 17 11:50:30 user nova-compute[73449]:     <vmcoreinfo/>
Aug 17 11:50:30 user nova-compute[73449]:   </features>
Aug 17 11:50:30 user nova-compute[73449]:   <clock offset="utc">
Aug 17 11:50:30 user nova-compute[73449]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 11:50:30 user nova-compute[73449]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 11:50:30 user nova-compute[73449]:     <timer name="hpet" present="no"/>
Aug 17 11:50:30 user nova-compute[73449]:   </clock>
Aug 17 11:50:30 user nova-compute[73449]:   <cpu mode="custom" match="exact">
Aug 17 11:50:30 user nova-compute[73449]:     <model>Nehalem</model>
Aug 17 11:50:30 user nova-compute[73449]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 11:50:30 user nova-compute[73449]:   </cpu>
Aug 17 11:50:30 user nova-compute[73449]:   <devices>
Aug 17 11:50:30 user nova-compute[73449]:     <disk type="file" device="disk">
Aug 17 11:50:30 user nova-compute[73449]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 11:50:30 user nova-compute[73449]:       <source file="/opt/stack/data/nova/instances/89440604-1daf-4e7a-a524-2f9c21a9cb96/disk"/>
Aug 17 11:50:30 user nova-compute[73449]:       <target dev="vda" bus="virtio"/>
Aug 17 11:50:30 user nova-compute[73449]:     </disk>
Aug 17 11:50:30 user nova-compute[73449]:     <interface type="ethernet">
Aug 17 11:50:30 user nova-compute[73449]:       <mac address="fa:16:3e:52:45:6e"/>
Aug 17 11:50:30 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 11:50:30 user nova-compute[73449]:       <mtu size="1442"/>
Aug 17 11:50:30 user nova-compute[73449]:       <target dev="tap7ebcec20-01"/>
Aug 17 11:50:30 user nova-compute[73449]:     </interface>
Aug 17 11:50:30 user nova-compute[73449]:     <serial type="pty">
Aug 17 11:50:30 user nova-compute[73449]:       <log file="/opt/stack/data/nova/instances/89440604-1daf-4e7a-a524-2f9c21a9cb96/console.log" append="off"/>
Aug 17 11:50:30 user nova-compute[73449]:     </serial>
Aug 17 11:50:30 user nova-compute[73449]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 11:50:30 user nova-compute[73449]:     <video>
Aug 17 11:50:30 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 11:50:30 user nova-compute[73449]:     </video>
Aug 17 11:50:30 user nova-compute[73449]:     <rng model="virtio">
Aug 17 11:50:30 user nova-compute[73449]:       <backend model="random">/dev/urandom</backend>
Aug 17 11:50:30 user nova-compute[73449]:     </rng>
Aug 17 11:50:30 user nova-compute[73449]:     <controller type="usb" index="0" model="none"/>
Aug 17 11:50:30 user nova-compute[73449]:     <memballoon model="virtio">
Aug 17 11:50:30 user nova-compute[73449]:       <stats period="10"/>
Aug 17 11:50:30 user nova-compute[73449]:     </memballoon>
Aug 17 11:50:30 user nova-compute[73449]:   </devices>
Aug 17 11:50:30 user nova-compute[73449]: </domain>
Aug 17 11:50:30 user nova-compute[73449]:  {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 11:50:30 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-b807c0b0-533d-4a38-bab5-9a2bf8ca6ddf tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:50:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2138348058',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2138348058',id=26,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ec3b0b72e47448ebe99f9fc64119c1c',ramdisk_id='',reservation_id='r-uvhfpgje',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1818019421',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T11:50:29Z,user_data=None,user_id='14eb3826311a4f8f91d8264e87f7b866',uuid=89440604-1daf-4e7a-a524-2f9c21a9cb96,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7ebcec20-01ec-4807-876d-d95bff0a8a77", "address": "fa:16:3e:52:45:6e", "network": {"id": "9455bb75-f75a-41ff-8f6f-49f55aa738f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-425274599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec3b0b72e47448ebe99f9fc64119c1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ebcec20-01", "ovs_interfaceid": "7ebcec20-01ec-4807-876d-d95bff0a8a77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 11:50:30 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-b807c0b0-533d-4a38-bab5-9a2bf8ca6ddf tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Converting VIF {"id": "7ebcec20-01ec-4807-876d-d95bff0a8a77", "address": "fa:16:3e:52:45:6e", "network": {"id": "9455bb75-f75a-41ff-8f6f-49f55aa738f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-425274599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec3b0b72e47448ebe99f9fc64119c1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ebcec20-01", "ovs_interfaceid": "7ebcec20-01ec-4807-876d-d95bff0a8a77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:50:30 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-b807c0b0-533d-4a38-bab5-9a2bf8ca6ddf tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:45:6e,bridge_name='br-int',has_traffic_filtering=True,id=7ebcec20-01ec-4807-876d-d95bff0a8a77,network=Network(9455bb75-f75a-41ff-8f6f-49f55aa738f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ebcec20-01') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:50:30 user nova-compute[73449]: DEBUG os_vif [None req-b807c0b0-533d-4a38-bab5-9a2bf8ca6ddf tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:45:6e,bridge_name='br-int',has_traffic_filtering=True,id=7ebcec20-01ec-4807-876d-d95bff0a8a77,network=Network(9455bb75-f75a-41ff-8f6f-49f55aa738f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ebcec20-01') {{(pid=73449) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 11:50:30 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:50:30 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:50:30 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 11:50:30 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:50:31 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7ebcec20-01, may_exist=True, interface_attrs={}) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:50:31 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7ebcec20-01, col_values=(('external_ids', {'iface-id': '7ebcec20-01ec-4807-876d-d95bff0a8a77', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:52:45:6e', 'vm-uuid': '89440604-1daf-4e7a-a524-2f9c21a9cb96'}),), if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:50:31 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:50:31 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:50:31 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:50:31 user nova-compute[73449]: INFO os_vif [None req-b807c0b0-533d-4a38-bab5-9a2bf8ca6ddf tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:45:6e,bridge_name='br-int',has_traffic_filtering=True,id=7ebcec20-01ec-4807-876d-d95bff0a8a77,network=Network(9455bb75-f75a-41ff-8f6f-49f55aa738f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ebcec20-01')
Aug 17 11:50:31 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b807c0b0-533d-4a38-bab5-9a2bf8ca6ddf tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] No BDM found with device name vda, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 11:50:31 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b807c0b0-533d-4a38-bab5-9a2bf8ca6ddf tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] No VIF found with MAC fa:16:3e:52:45:6e, not building metadata {{(pid=73449) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 11:50:31 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:50:31 user nova-compute[73449]: DEBUG nova.network.neutron [req-a9baf28f-135d-4d81-a365-32e36c418637 req-c02d25a9-5b84-4710-9ef7-b7469d85cb4b service nova] [instance: 89440604-1daf-4e7a-a524-2f9c21a9cb96] Updated VIF entry in instance network info cache for port 7ebcec20-01ec-4807-876d-d95bff0a8a77. {{(pid=73449) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 11:50:31 user nova-compute[73449]: DEBUG nova.network.neutron [req-a9baf28f-135d-4d81-a365-32e36c418637 req-c02d25a9-5b84-4710-9ef7-b7469d85cb4b service nova] [instance: 89440604-1daf-4e7a-a524-2f9c21a9cb96] Updating instance_info_cache with network_info: [{"id": "7ebcec20-01ec-4807-876d-d95bff0a8a77", "address": "fa:16:3e:52:45:6e", "network": {"id": "9455bb75-f75a-41ff-8f6f-49f55aa738f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-425274599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec3b0b72e47448ebe99f9fc64119c1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ebcec20-01", "ovs_interfaceid": "7ebcec20-01ec-4807-876d-d95bff0a8a77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:50:31 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-a9baf28f-135d-4d81-a365-32e36c418637 req-c02d25a9-5b84-4710-9ef7-b7469d85cb4b service nova] Releasing lock "refresh_cache-89440604-1daf-4e7a-a524-2f9c21a9cb96" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:50:32 user nova-compute[73449]: DEBUG nova.network.neutron [None req-77a78fca-afaa-45a1-9fc8-969a4d5f7b0f tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: ec622bf0-4531-4892-b637-0ef564cf453b] Successfully created port: 9171abbc-1b7e-4008-93f4-3075f6b9b898 {{(pid=73449) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 11:50:32 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:50:32 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:50:32 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:50:33 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:50:33 user nova-compute[73449]: DEBUG nova.compute.manager [req-88b57694-f44f-411f-9bab-3e014b44a108 req-0abfe5ac-600a-4372-8913-98eed98f5d25 service nova] [instance: 89440604-1daf-4e7a-a524-2f9c21a9cb96] Received event network-vif-plugged-7ebcec20-01ec-4807-876d-d95bff0a8a77 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:50:33 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-88b57694-f44f-411f-9bab-3e014b44a108 req-0abfe5ac-600a-4372-8913-98eed98f5d25 service nova] Acquiring lock "89440604-1daf-4e7a-a524-2f9c21a9cb96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:50:33 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-88b57694-f44f-411f-9bab-3e014b44a108 req-0abfe5ac-600a-4372-8913-98eed98f5d25 service nova] Lock "89440604-1daf-4e7a-a524-2f9c21a9cb96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:50:33 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-88b57694-f44f-411f-9bab-3e014b44a108 req-0abfe5ac-600a-4372-8913-98eed98f5d25 service nova] Lock "89440604-1daf-4e7a-a524-2f9c21a9cb96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:50:33 user nova-compute[73449]: DEBUG nova.compute.manager [req-88b57694-f44f-411f-9bab-3e014b44a108 req-0abfe5ac-600a-4372-8913-98eed98f5d25 service nova] [instance: 89440604-1daf-4e7a-a524-2f9c21a9cb96] No waiting events found dispatching network-vif-plugged-7ebcec20-01ec-4807-876d-d95bff0a8a77 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:50:33 user nova-compute[73449]: WARNING nova.compute.manager [req-88b57694-f44f-411f-9bab-3e014b44a108 req-0abfe5ac-600a-4372-8913-98eed98f5d25 service nova] [instance: 89440604-1daf-4e7a-a524-2f9c21a9cb96] Received unexpected event network-vif-plugged-7ebcec20-01ec-4807-876d-d95bff0a8a77 for instance with vm_state building and task_state spawning.
Aug 17 11:50:33 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:50:33 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:50:33 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:50:33 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-d332e30c-85e1-4130-a57c-2bcdddecf531 tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Acquiring lock "23ab9ffc-226d-4caa-8caa-9458de06a1c9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:50:33 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-d332e30c-85e1-4130-a57c-2bcdddecf531 tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Lock "23ab9ffc-226d-4caa-8caa-9458de06a1c9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:50:33 user nova-compute[73449]: DEBUG nova.compute.manager [None req-d332e30c-85e1-4130-a57c-2bcdddecf531 tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] [instance: 23ab9ffc-226d-4caa-8caa-9458de06a1c9] Starting instance... {{(pid=73449) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 11:50:33 user nova-compute[73449]: DEBUG nova.network.neutron [None req-77a78fca-afaa-45a1-9fc8-969a4d5f7b0f tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: ec622bf0-4531-4892-b637-0ef564cf453b] Successfully updated port: 9171abbc-1b7e-4008-93f4-3075f6b9b898 {{(pid=73449) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 11:50:33 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-77a78fca-afaa-45a1-9fc8-969a4d5f7b0f tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Acquiring lock "refresh_cache-ec622bf0-4531-4892-b637-0ef564cf453b" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:50:33 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-77a78fca-afaa-45a1-9fc8-969a4d5f7b0f tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Acquired lock "refresh_cache-ec622bf0-4531-4892-b637-0ef564cf453b" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:50:33 user nova-compute[73449]: DEBUG nova.network.neutron [None req-77a78fca-afaa-45a1-9fc8-969a4d5f7b0f tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: ec622bf0-4531-4892-b637-0ef564cf453b] Building network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 11:50:33 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-d332e30c-85e1-4130-a57c-2bcdddecf531 tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:50:33 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-d332e30c-85e1-4130-a57c-2bcdddecf531 tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:50:33 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-d332e30c-85e1-4130-a57c-2bcdddecf531 tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73449) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 11:50:33 user nova-compute[73449]: INFO nova.compute.claims [None req-d332e30c-85e1-4130-a57c-2bcdddecf531 tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] [instance: 23ab9ffc-226d-4caa-8caa-9458de06a1c9] Claim successful on node user
Aug 17 11:50:33 user nova-compute[73449]: DEBUG nova.compute.manager [req-bac54bf0-78b9-4585-9a31-b25edb43d3f6 req-376b2792-7eb4-4f8f-8158-4f80af4bd306 service nova] [instance: ec622bf0-4531-4892-b637-0ef564cf453b] Received event network-changed-9171abbc-1b7e-4008-93f4-3075f6b9b898 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:50:33 user nova-compute[73449]: DEBUG nova.compute.manager [req-bac54bf0-78b9-4585-9a31-b25edb43d3f6 req-376b2792-7eb4-4f8f-8158-4f80af4bd306 service nova] [instance: ec622bf0-4531-4892-b637-0ef564cf453b] Refreshing instance network info cache due to event network-changed-9171abbc-1b7e-4008-93f4-3075f6b9b898. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 11:50:33 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-bac54bf0-78b9-4585-9a31-b25edb43d3f6 req-376b2792-7eb4-4f8f-8158-4f80af4bd306 service nova] Acquiring lock "refresh_cache-ec622bf0-4531-4892-b637-0ef564cf453b" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:50:34 user nova-compute[73449]: DEBUG nova.network.neutron [None req-77a78fca-afaa-45a1-9fc8-969a4d5f7b0f tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: ec622bf0-4531-4892-b637-0ef564cf453b] Instance cache missing network info. {{(pid=73449) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 11:50:34 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-d332e30c-85e1-4130-a57c-2bcdddecf531 tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 11:50:34 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-d332e30c-85e1-4130-a57c-2bcdddecf531 tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 11:50:34 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-d332e30c-85e1-4130-a57c-2bcdddecf531 tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.617s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:50:34 user nova-compute[73449]: DEBUG nova.compute.manager [None req-d332e30c-85e1-4130-a57c-2bcdddecf531 tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] [instance: 23ab9ffc-226d-4caa-8caa-9458de06a1c9] Start building networks asynchronously for instance. {{(pid=73449) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 11:50:34 user nova-compute[73449]: DEBUG nova.network.neutron [None req-77a78fca-afaa-45a1-9fc8-969a4d5f7b0f tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: ec622bf0-4531-4892-b637-0ef564cf453b] Updating instance_info_cache with network_info: [{"id": "9171abbc-1b7e-4008-93f4-3075f6b9b898", "address": "fa:16:3e:04:f1:e3", "network": {"id": "a9e8fcd6-4152-466b-99ad-44b85db05a05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-920564935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bd46cdaff7a4b40955f7c8a12c55452", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9171abbc-1b", "ovs_interfaceid": "9171abbc-1b7e-4008-93f4-3075f6b9b898", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:50:34 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-77a78fca-afaa-45a1-9fc8-969a4d5f7b0f tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Releasing lock "refresh_cache-ec622bf0-4531-4892-b637-0ef564cf453b" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:50:34 user nova-compute[73449]: DEBUG nova.compute.manager [None req-77a78fca-afaa-45a1-9fc8-969a4d5f7b0f tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: ec622bf0-4531-4892-b637-0ef564cf453b] Instance network_info: |[{"id": "9171abbc-1b7e-4008-93f4-3075f6b9b898", "address": "fa:16:3e:04:f1:e3", "network": {"id": "a9e8fcd6-4152-466b-99ad-44b85db05a05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-920564935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bd46cdaff7a4b40955f7c8a12c55452", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9171abbc-1b", "ovs_interfaceid": "9171abbc-1b7e-4008-93f4-3075f6b9b898", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73449) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 11:50:34 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-bac54bf0-78b9-4585-9a31-b25edb43d3f6 req-376b2792-7eb4-4f8f-8158-4f80af4bd306 service nova] Acquired lock "refresh_cache-ec622bf0-4531-4892-b637-0ef564cf453b" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:50:34 user nova-compute[73449]: DEBUG nova.network.neutron [req-bac54bf0-78b9-4585-9a31-b25edb43d3f6 req-376b2792-7eb4-4f8f-8158-4f80af4bd306 service nova] [instance: ec622bf0-4531-4892-b637-0ef564cf453b] Refreshing network info cache for port 9171abbc-1b7e-4008-93f4-3075f6b9b898 {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 11:50:34 user nova-compute[73449]: DEBUG nova.compute.manager [None req-d332e30c-85e1-4130-a57c-2bcdddecf531 tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] [instance: 23ab9ffc-226d-4caa-8caa-9458de06a1c9] Allocating IP information in the background. {{(pid=73449) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 11:50:34 user nova-compute[73449]: DEBUG nova.network.neutron [None req-d332e30c-85e1-4130-a57c-2bcdddecf531 tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] [instance: 23ab9ffc-226d-4caa-8caa-9458de06a1c9] allocate_for_instance() {{(pid=73449) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 11:50:34 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-d332e30c-85e1-4130-a57c-2bcdddecf531 tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] [instance: 23ab9ffc-226d-4caa-8caa-9458de06a1c9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 11:50:34 user nova-compute[73449]: DEBUG nova.compute.manager [None req-d332e30c-85e1-4130-a57c-2bcdddecf531 tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] [instance: 23ab9ffc-226d-4caa-8caa-9458de06a1c9] Start building block device mappings for instance. {{(pid=73449) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 11:50:34 user nova-compute[73449]: DEBUG nova.policy [None req-d332e30c-85e1-4130-a57c-2bcdddecf531 tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '56d7fd2eae7c4e62a7cc0e917287f03f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbaa73b99e5a498dac668e5307654fd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73449) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 11:50:34 user nova-compute[73449]: DEBUG nova.compute.manager [None req-d332e30c-85e1-4130-a57c-2bcdddecf531 tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] [instance: 23ab9ffc-226d-4caa-8caa-9458de06a1c9] Start spawning the instance on the hypervisor. {{(pid=73449) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 11:50:34 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-d332e30c-85e1-4130-a57c-2bcdddecf531 tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] [instance: 23ab9ffc-226d-4caa-8caa-9458de06a1c9] Creating instance directory {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 11:50:34 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-d332e30c-85e1-4130-a57c-2bcdddecf531 tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] [instance: 23ab9ffc-226d-4caa-8caa-9458de06a1c9] Creating image(s)
Aug 17 11:50:34 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-d332e30c-85e1-4130-a57c-2bcdddecf531 tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Acquiring lock "/opt/stack/data/nova/instances/23ab9ffc-226d-4caa-8caa-9458de06a1c9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:50:34 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-d332e30c-85e1-4130-a57c-2bcdddecf531 tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Lock "/opt/stack/data/nova/instances/23ab9ffc-226d-4caa-8caa-9458de06a1c9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:50:34 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-d332e30c-85e1-4130-a57c-2bcdddecf531 tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Lock "/opt/stack/data/nova/instances/23ab9ffc-226d-4caa-8caa-9458de06a1c9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:50:34 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-d332e30c-85e1-4130-a57c-2bcdddecf531 tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:50:35 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-d332e30c-85e1-4130-a57c-2bcdddecf531 tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json" returned: 0 in 0.217s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:50:35 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-d332e30c-85e1-4130-a57c-2bcdddecf531 tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Acquiring lock "7e267a577c062ee862e95ede6b48cfd5632f3ea3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:50:35 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-d332e30c-85e1-4130-a57c-2bcdddecf531 tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Lock "7e267a577c062ee862e95ede6b48cfd5632f3ea3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:50:35 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-d332e30c-85e1-4130-a57c-2bcdddecf531 tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:50:35 user nova-compute[73449]: DEBUG nova.compute.manager [req-81bad3ac-b9bf-4622-9366-77ed7afea1a9 req-5de6edbb-d16b-4242-9b8a-c18702879567 service nova] [instance: 89440604-1daf-4e7a-a524-2f9c21a9cb96] Received event network-vif-plugged-7ebcec20-01ec-4807-876d-d95bff0a8a77 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:50:35 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-81bad3ac-b9bf-4622-9366-77ed7afea1a9 req-5de6edbb-d16b-4242-9b8a-c18702879567 service nova] Acquiring lock "89440604-1daf-4e7a-a524-2f9c21a9cb96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:50:35 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-81bad3ac-b9bf-4622-9366-77ed7afea1a9 req-5de6edbb-d16b-4242-9b8a-c18702879567 service nova] Lock "89440604-1daf-4e7a-a524-2f9c21a9cb96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:50:35 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-81bad3ac-b9bf-4622-9366-77ed7afea1a9 req-5de6edbb-d16b-4242-9b8a-c18702879567 service nova] Lock "89440604-1daf-4e7a-a524-2f9c21a9cb96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:50:35 user nova-compute[73449]: DEBUG nova.compute.manager [req-81bad3ac-b9bf-4622-9366-77ed7afea1a9 req-5de6edbb-d16b-4242-9b8a-c18702879567 service nova] [instance: 89440604-1daf-4e7a-a524-2f9c21a9cb96] No waiting events found dispatching network-vif-plugged-7ebcec20-01ec-4807-876d-d95bff0a8a77 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:50:35 user nova-compute[73449]: WARNING nova.compute.manager [req-81bad3ac-b9bf-4622-9366-77ed7afea1a9 req-5de6edbb-d16b-4242-9b8a-c18702879567 service nova] [instance: 89440604-1daf-4e7a-a524-2f9c21a9cb96] Received unexpected event network-vif-plugged-7ebcec20-01ec-4807-876d-d95bff0a8a77 for instance with vm_state building and task_state spawning.
Aug 17 11:50:35 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692273035.310054, 89440604-1daf-4e7a-a524-2f9c21a9cb96 => Resumed> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:50:35 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 89440604-1daf-4e7a-a524-2f9c21a9cb96] VM Resumed (Lifecycle Event)
Aug 17 11:50:35 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b807c0b0-533d-4a38-bab5-9a2bf8ca6ddf tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 89440604-1daf-4e7a-a524-2f9c21a9cb96] Instance event wait completed in 0 seconds for  {{(pid=73449) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 11:50:35 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b807c0b0-533d-4a38-bab5-9a2bf8ca6ddf tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 89440604-1daf-4e7a-a524-2f9c21a9cb96] Guest created on hypervisor {{(pid=73449) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 11:50:35 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: 89440604-1daf-4e7a-a524-2f9c21a9cb96] Instance spawned successfully.
Aug 17 11:50:35 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b807c0b0-533d-4a38-bab5-9a2bf8ca6ddf tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 89440604-1daf-4e7a-a524-2f9c21a9cb96] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 11:50:35 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-d332e30c-85e1-4130-a57c-2bcdddecf531 tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json" returned: 0 in 0.200s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:50:35 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-d332e30c-85e1-4130-a57c-2bcdddecf531 tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3,backing_fmt=raw /opt/stack/data/nova/instances/23ab9ffc-226d-4caa-8caa-9458de06a1c9/disk 1073741824 {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:50:35 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 89440604-1daf-4e7a-a524-2f9c21a9cb96] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:50:35 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-d332e30c-85e1-4130-a57c-2bcdddecf531 tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3,backing_fmt=raw /opt/stack/data/nova/instances/23ab9ffc-226d-4caa-8caa-9458de06a1c9/disk 1073741824" returned: 0 in 0.082s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:50:35 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-d332e30c-85e1-4130-a57c-2bcdddecf531 tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Lock "7e267a577c062ee862e95ede6b48cfd5632f3ea3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.288s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:50:35 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-d332e30c-85e1-4130-a57c-2bcdddecf531 tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:50:35 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 89440604-1daf-4e7a-a524-2f9c21a9cb96] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 11:50:35 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b807c0b0-533d-4a38-bab5-9a2bf8ca6ddf tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 89440604-1daf-4e7a-a524-2f9c21a9cb96] Found default for hw_cdrom_bus of ide {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:50:35 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b807c0b0-533d-4a38-bab5-9a2bf8ca6ddf tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 89440604-1daf-4e7a-a524-2f9c21a9cb96] Found default for hw_disk_bus of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:50:35 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b807c0b0-533d-4a38-bab5-9a2bf8ca6ddf tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 89440604-1daf-4e7a-a524-2f9c21a9cb96] Found default for hw_input_bus of None {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:50:35 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b807c0b0-533d-4a38-bab5-9a2bf8ca6ddf tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 89440604-1daf-4e7a-a524-2f9c21a9cb96] Found default for hw_pointer_model of None {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:50:35 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b807c0b0-533d-4a38-bab5-9a2bf8ca6ddf tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 89440604-1daf-4e7a-a524-2f9c21a9cb96] Found default for hw_video_model of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:50:35 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b807c0b0-533d-4a38-bab5-9a2bf8ca6ddf tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 89440604-1daf-4e7a-a524-2f9c21a9cb96] Found default for hw_vif_model of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:50:35 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 89440604-1daf-4e7a-a524-2f9c21a9cb96] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 11:50:35 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692273035.3127975, 89440604-1daf-4e7a-a524-2f9c21a9cb96 => Started> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:50:35 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 89440604-1daf-4e7a-a524-2f9c21a9cb96] VM Started (Lifecycle Event)
Aug 17 11:50:35 user nova-compute[73449]: DEBUG nova.network.neutron [None req-d332e30c-85e1-4130-a57c-2bcdddecf531 tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] [instance: 23ab9ffc-226d-4caa-8caa-9458de06a1c9] Successfully created port: 96f9e0d7-29e1-46b0-81e6-1d00c8b35ec2 {{(pid=73449) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 11:50:35 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 89440604-1daf-4e7a-a524-2f9c21a9cb96] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:50:35 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 89440604-1daf-4e7a-a524-2f9c21a9cb96] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 11:50:35 user nova-compute[73449]: INFO nova.compute.manager [None req-b807c0b0-533d-4a38-bab5-9a2bf8ca6ddf tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 89440604-1daf-4e7a-a524-2f9c21a9cb96] Took 6.68 seconds to spawn the instance on the hypervisor.
Aug 17 11:50:35 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b807c0b0-533d-4a38-bab5-9a2bf8ca6ddf tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 89440604-1daf-4e7a-a524-2f9c21a9cb96] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:50:35 user nova-compute[73449]: DEBUG nova.network.neutron [req-bac54bf0-78b9-4585-9a31-b25edb43d3f6 req-376b2792-7eb4-4f8f-8158-4f80af4bd306 service nova] [instance: ec622bf0-4531-4892-b637-0ef564cf453b] Updated VIF entry in instance network info cache for port 9171abbc-1b7e-4008-93f4-3075f6b9b898. {{(pid=73449) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 11:50:35 user nova-compute[73449]: DEBUG nova.network.neutron [req-bac54bf0-78b9-4585-9a31-b25edb43d3f6 req-376b2792-7eb4-4f8f-8158-4f80af4bd306 service nova] [instance: ec622bf0-4531-4892-b637-0ef564cf453b] Updating instance_info_cache with network_info: [{"id": "9171abbc-1b7e-4008-93f4-3075f6b9b898", "address": "fa:16:3e:04:f1:e3", "network": {"id": "a9e8fcd6-4152-466b-99ad-44b85db05a05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-920564935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bd46cdaff7a4b40955f7c8a12c55452", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9171abbc-1b", "ovs_interfaceid": "9171abbc-1b7e-4008-93f4-3075f6b9b898", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:50:35 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 89440604-1daf-4e7a-a524-2f9c21a9cb96] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 11:50:35 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-bac54bf0-78b9-4585-9a31-b25edb43d3f6 req-376b2792-7eb4-4f8f-8158-4f80af4bd306 service nova] Releasing lock "refresh_cache-ec622bf0-4531-4892-b637-0ef564cf453b" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:50:35 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-d332e30c-85e1-4130-a57c-2bcdddecf531 tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json" returned: 0 in 0.232s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:50:35 user nova-compute[73449]: DEBUG nova.virt.disk.api [None req-d332e30c-85e1-4130-a57c-2bcdddecf531 tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Checking if we can resize image /opt/stack/data/nova/instances/23ab9ffc-226d-4caa-8caa-9458de06a1c9/disk. size=1073741824 {{(pid=73449) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 11:50:35 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-d332e30c-85e1-4130-a57c-2bcdddecf531 tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23ab9ffc-226d-4caa-8caa-9458de06a1c9/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:50:35 user nova-compute[73449]: INFO nova.compute.manager [None req-b807c0b0-533d-4a38-bab5-9a2bf8ca6ddf tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 89440604-1daf-4e7a-a524-2f9c21a9cb96] Took 7.92 seconds to build instance.
Aug 17 11:50:35 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b807c0b0-533d-4a38-bab5-9a2bf8ca6ddf tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Lock "89440604-1daf-4e7a-a524-2f9c21a9cb96" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.056s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:50:35 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-d332e30c-85e1-4130-a57c-2bcdddecf531 tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23ab9ffc-226d-4caa-8caa-9458de06a1c9/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:50:35 user nova-compute[73449]: DEBUG nova.virt.disk.api [None req-d332e30c-85e1-4130-a57c-2bcdddecf531 tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Cannot resize image /opt/stack/data/nova/instances/23ab9ffc-226d-4caa-8caa-9458de06a1c9/disk to a smaller size. {{(pid=73449) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 11:50:35 user nova-compute[73449]: DEBUG nova.objects.instance [None req-d332e30c-85e1-4130-a57c-2bcdddecf531 tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Lazy-loading 'migration_context' on Instance uuid 23ab9ffc-226d-4caa-8caa-9458de06a1c9 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:50:35 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-d332e30c-85e1-4130-a57c-2bcdddecf531 tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] [instance: 23ab9ffc-226d-4caa-8caa-9458de06a1c9] Created local disks {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 11:50:35 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-d332e30c-85e1-4130-a57c-2bcdddecf531 tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] [instance: 23ab9ffc-226d-4caa-8caa-9458de06a1c9] Ensure instance console log exists: /opt/stack/data/nova/instances/23ab9ffc-226d-4caa-8caa-9458de06a1c9/console.log {{(pid=73449) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 11:50:35 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-d332e30c-85e1-4130-a57c-2bcdddecf531 tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:50:35 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-d332e30c-85e1-4130-a57c-2bcdddecf531 tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:50:35 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-d332e30c-85e1-4130-a57c-2bcdddecf531 tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:50:36 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:50:36 user nova-compute[73449]: DEBUG os_brick.utils [None req-77a78fca-afaa-45a1-9fc8-969a4d5f7b0f tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 11:50:36 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:50:36 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:50:36 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[82035f36-1a85-4c5f-bcf4-749a33904a9d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4d3924302012\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:50:36 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:50:36 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:50:36 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e0d7a60-1cfc-49ae-9571-9c842f8636a0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:50:36 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:50:36 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:50:36 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[fff74569-c601-4ca8-bc3e-994a39ca2903]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:50:36 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2186cc2-75b7-44aa-92dd-b6da0e0027fa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:50:36 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-77a78fca-afaa-45a1-9fc8-969a4d5f7b0f tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Running cmd (subprocess): nvme version {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:50:36 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-77a78fca-afaa-45a1-9fc8-969a4d5f7b0f tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] 'nvme version' failed. Not Retrying. {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 11:50:36 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.nvmeof [None req-77a78fca-afaa-45a1-9fc8-969a4d5f7b0f tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] nvme not present on system {{(pid=73449) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 11:50:36 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:50:36 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 11:50:36 user nova-compute[73449]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 11:50:36 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[af6b0324-2826-4296-b251-96afd283baa0]: (4, '') {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:50:36 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-77a78fca-afaa-45a1-9fc8-969a4d5f7b0f tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73449) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 11:50:36 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-77a78fca-afaa-45a1-9fc8-969a4d5f7b0f tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73449) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 11:50:36 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-77a78fca-afaa-45a1-9fc8-969a4d5f7b0f tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] LIGHTOS: no hostnqn found. {{(pid=73449) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 11:50:36 user nova-compute[73449]: DEBUG os_brick.utils [None req-77a78fca-afaa-45a1-9fc8-969a4d5f7b0f tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4d3924302012', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 11:50:36 user nova-compute[73449]: DEBUG nova.virt.block_device [None req-77a78fca-afaa-45a1-9fc8-969a4d5f7b0f tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: ec622bf0-4531-4892-b637-0ef564cf453b] Updating existing volume attachment record: 0b7f608c-6c73-4c89-92f3-800e5632af4b {{(pid=73449) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 11:50:36 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:50:36 user nova-compute[73449]: DEBUG nova.network.neutron [None req-d332e30c-85e1-4130-a57c-2bcdddecf531 tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] [instance: 23ab9ffc-226d-4caa-8caa-9458de06a1c9] Successfully updated port: 96f9e0d7-29e1-46b0-81e6-1d00c8b35ec2 {{(pid=73449) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 11:50:36 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-d332e30c-85e1-4130-a57c-2bcdddecf531 tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Acquiring lock "refresh_cache-23ab9ffc-226d-4caa-8caa-9458de06a1c9" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:50:36 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-d332e30c-85e1-4130-a57c-2bcdddecf531 tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Acquired lock "refresh_cache-23ab9ffc-226d-4caa-8caa-9458de06a1c9" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:50:36 user nova-compute[73449]: DEBUG nova.network.neutron [None req-d332e30c-85e1-4130-a57c-2bcdddecf531 tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] [instance: 23ab9ffc-226d-4caa-8caa-9458de06a1c9] Building network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 11:50:36 user nova-compute[73449]: DEBUG nova.compute.manager [req-a4072e84-a9df-4b18-9bc6-d978e736905a req-a251def9-759b-450f-ac7e-ed8a483054c1 service nova] [instance: 23ab9ffc-226d-4caa-8caa-9458de06a1c9] Received event network-changed-96f9e0d7-29e1-46b0-81e6-1d00c8b35ec2 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:50:36 user nova-compute[73449]: DEBUG nova.compute.manager [req-a4072e84-a9df-4b18-9bc6-d978e736905a req-a251def9-759b-450f-ac7e-ed8a483054c1 service nova] [instance: 23ab9ffc-226d-4caa-8caa-9458de06a1c9] Refreshing instance network info cache due to event network-changed-96f9e0d7-29e1-46b0-81e6-1d00c8b35ec2. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 11:50:36 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-a4072e84-a9df-4b18-9bc6-d978e736905a req-a251def9-759b-450f-ac7e-ed8a483054c1 service nova] Acquiring lock "refresh_cache-23ab9ffc-226d-4caa-8caa-9458de06a1c9" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:50:37 user nova-compute[73449]: DEBUG nova.network.neutron [None req-d332e30c-85e1-4130-a57c-2bcdddecf531 tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] [instance: 23ab9ffc-226d-4caa-8caa-9458de06a1c9] Instance cache missing network info. {{(pid=73449) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 11:50:37 user nova-compute[73449]: DEBUG nova.network.neutron [None req-d332e30c-85e1-4130-a57c-2bcdddecf531 tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] [instance: 23ab9ffc-226d-4caa-8caa-9458de06a1c9] Updating instance_info_cache with network_info: [{"id": "96f9e0d7-29e1-46b0-81e6-1d00c8b35ec2", "address": "fa:16:3e:82:7e:7d", "network": {"id": "c3e9bf16-545d-4ae8-bbad-5092c0e8f735", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1927778048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbaa73b99e5a498dac668e5307654fd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96f9e0d7-29", "ovs_interfaceid": "96f9e0d7-29e1-46b0-81e6-1d00c8b35ec2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:50:37 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-d332e30c-85e1-4130-a57c-2bcdddecf531 tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Releasing lock "refresh_cache-23ab9ffc-226d-4caa-8caa-9458de06a1c9" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:50:37 user nova-compute[73449]: DEBUG nova.compute.manager [None req-d332e30c-85e1-4130-a57c-2bcdddecf531 tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] [instance: 23ab9ffc-226d-4caa-8caa-9458de06a1c9] Instance network_info: |[{"id": "96f9e0d7-29e1-46b0-81e6-1d00c8b35ec2", "address": "fa:16:3e:82:7e:7d", "network": {"id": "c3e9bf16-545d-4ae8-bbad-5092c0e8f735", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1927778048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbaa73b99e5a498dac668e5307654fd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96f9e0d7-29", "ovs_interfaceid": "96f9e0d7-29e1-46b0-81e6-1d00c8b35ec2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73449) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 11:50:37 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-a4072e84-a9df-4b18-9bc6-d978e736905a req-a251def9-759b-450f-ac7e-ed8a483054c1 service nova] Acquired lock "refresh_cache-23ab9ffc-226d-4caa-8caa-9458de06a1c9" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:50:37 user nova-compute[73449]: DEBUG nova.network.neutron [req-a4072e84-a9df-4b18-9bc6-d978e736905a req-a251def9-759b-450f-ac7e-ed8a483054c1 service nova] [instance: 23ab9ffc-226d-4caa-8caa-9458de06a1c9] Refreshing network info cache for port 96f9e0d7-29e1-46b0-81e6-1d00c8b35ec2 {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 11:50:37 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-d332e30c-85e1-4130-a57c-2bcdddecf531 tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] [instance: 23ab9ffc-226d-4caa-8caa-9458de06a1c9] Start _get_guest_xml network_info=[{"id": "96f9e0d7-29e1-46b0-81e6-1d00c8b35ec2", "address": "fa:16:3e:82:7e:7d", "network": {"id": "c3e9bf16-545d-4ae8-bbad-5092c0e8f735", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1927778048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbaa73b99e5a498dac668e5307654fd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96f9e0d7-29", "ovs_interfaceid": "96f9e0d7-29e1-46b0-81e6-1d00c8b35ec2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T11:36:11Z,direct_url=<?>,disk_format='qcow2',id=0a2904ae-083d-41c8-83db-343132b36148,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7a77880136a54ef195c82e018e1939db',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T11:36:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': '0a2904ae-083d-41c8-83db-343132b36148'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 11:50:37 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-d332e30c-85e1-4130-a57c-2bcdddecf531 tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:50:37 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-d332e30c-85e1-4130-a57c-2bcdddecf531 tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:50:37 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-d332e30c-85e1-4130-a57c-2bcdddecf531 tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 11:50:37 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-d332e30c-85e1-4130-a57c-2bcdddecf531 tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] CPU controller missing on host. {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 11:50:37 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-d332e30c-85e1-4130-a57c-2bcdddecf531 tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 11:50:37 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-d332e30c-85e1-4130-a57c-2bcdddecf531 tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] CPU controller found on host. {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 11:50:37 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-d332e30c-85e1-4130-a57c-2bcdddecf531 tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73449) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 11:50:37 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-d332e30c-85e1-4130-a57c-2bcdddecf531 tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T11:35:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T11:36:11Z,direct_url=<?>,disk_format='qcow2',id=0a2904ae-083d-41c8-83db-343132b36148,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7a77880136a54ef195c82e018e1939db',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T11:36:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 11:50:37 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-d332e30c-85e1-4130-a57c-2bcdddecf531 tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Flavor limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 11:50:37 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-d332e30c-85e1-4130-a57c-2bcdddecf531 tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Image limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 11:50:37 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-d332e30c-85e1-4130-a57c-2bcdddecf531 tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Flavor pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 11:50:37 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-d332e30c-85e1-4130-a57c-2bcdddecf531 tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Image pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 11:50:37 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-d332e30c-85e1-4130-a57c-2bcdddecf531 tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 11:50:37 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-d332e30c-85e1-4130-a57c-2bcdddecf531 tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 11:50:37 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-d332e30c-85e1-4130-a57c-2bcdddecf531 tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 11:50:37 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-d332e30c-85e1-4130-a57c-2bcdddecf531 tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Got 1 possible topologies {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 11:50:37 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-d332e30c-85e1-4130-a57c-2bcdddecf531 tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 11:50:37 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-d332e30c-85e1-4130-a57c-2bcdddecf531 tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 11:50:37 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-d332e30c-85e1-4130-a57c-2bcdddecf531 tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:50:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-667733895',display_name='tempest-ServersNegativeTestJSON-server-667733895',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-667733895',id=28,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cbaa73b99e5a498dac668e5307654fd2',ramdisk_id='',reservation_id='r-1bcsbsjo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-132584909',owner_user_name='tempest-ServersNegativeTestJSON-132584909-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T11:50:35Z,user_data=None,user_id='56d7fd2eae7c4e62a7cc0e917287f03f',uuid=23ab9ffc-226d-4caa-8caa-9458de06a1c9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "96f9e0d7-29e1-46b0-81e6-1d00c8b35ec2", "address": "fa:16:3e:82:7e:7d", "network": {"id": "c3e9bf16-545d-4ae8-bbad-5092c0e8f735", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1927778048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbaa73b99e5a498dac668e5307654fd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96f9e0d7-29", "ovs_interfaceid": "96f9e0d7-29e1-46b0-81e6-1d00c8b35ec2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73449) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 11:50:37 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-d332e30c-85e1-4130-a57c-2bcdddecf531 tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Converting VIF {"id": "96f9e0d7-29e1-46b0-81e6-1d00c8b35ec2", "address": "fa:16:3e:82:7e:7d", "network": {"id": "c3e9bf16-545d-4ae8-bbad-5092c0e8f735", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1927778048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbaa73b99e5a498dac668e5307654fd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96f9e0d7-29", "ovs_interfaceid": "96f9e0d7-29e1-46b0-81e6-1d00c8b35ec2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:50:37 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-d332e30c-85e1-4130-a57c-2bcdddecf531 tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:7e:7d,bridge_name='br-int',has_traffic_filtering=True,id=96f9e0d7-29e1-46b0-81e6-1d00c8b35ec2,network=Network(c3e9bf16-545d-4ae8-bbad-5092c0e8f735),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96f9e0d7-29') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:50:37 user nova-compute[73449]: DEBUG nova.objects.instance [None req-d332e30c-85e1-4130-a57c-2bcdddecf531 tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Lazy-loading 'pci_devices' on Instance uuid 23ab9ffc-226d-4caa-8caa-9458de06a1c9 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:50:37 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-d332e30c-85e1-4130-a57c-2bcdddecf531 tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] [instance: 23ab9ffc-226d-4caa-8caa-9458de06a1c9] End _get_guest_xml xml=<domain type="kvm">
Aug 17 11:50:37 user nova-compute[73449]:   <uuid>23ab9ffc-226d-4caa-8caa-9458de06a1c9</uuid>
Aug 17 11:50:37 user nova-compute[73449]:   <name>instance-0000001c</name>
Aug 17 11:50:37 user nova-compute[73449]:   <memory>524288</memory>
Aug 17 11:50:37 user nova-compute[73449]:   <vcpu>1</vcpu>
Aug 17 11:50:37 user nova-compute[73449]:   <metadata>
Aug 17 11:50:37 user nova-compute[73449]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 11:50:37 user nova-compute[73449]:       <nova:package version="0.0.0"/>
Aug 17 11:50:37 user nova-compute[73449]:       <nova:name>tempest-ServersNegativeTestJSON-server-667733895</nova:name>
Aug 17 11:50:37 user nova-compute[73449]:       <nova:creationTime>2023-08-17 11:50:37</nova:creationTime>
Aug 17 11:50:37 user nova-compute[73449]:       <nova:flavor name="m1.tiny">
Aug 17 11:50:37 user nova-compute[73449]:         <nova:memory>512</nova:memory>
Aug 17 11:50:37 user nova-compute[73449]:         <nova:disk>1</nova:disk>
Aug 17 11:50:37 user nova-compute[73449]:         <nova:swap>0</nova:swap>
Aug 17 11:50:37 user nova-compute[73449]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 11:50:37 user nova-compute[73449]:         <nova:vcpus>1</nova:vcpus>
Aug 17 11:50:37 user nova-compute[73449]:       </nova:flavor>
Aug 17 11:50:37 user nova-compute[73449]:       <nova:owner>
Aug 17 11:50:37 user nova-compute[73449]:         <nova:user uuid="56d7fd2eae7c4e62a7cc0e917287f03f">tempest-ServersNegativeTestJSON-132584909-project-member</nova:user>
Aug 17 11:50:37 user nova-compute[73449]:         <nova:project uuid="cbaa73b99e5a498dac668e5307654fd2">tempest-ServersNegativeTestJSON-132584909</nova:project>
Aug 17 11:50:37 user nova-compute[73449]:       </nova:owner>
Aug 17 11:50:37 user nova-compute[73449]:       <nova:root type="image" uuid="0a2904ae-083d-41c8-83db-343132b36148"/>
Aug 17 11:50:37 user nova-compute[73449]:       <nova:ports>
Aug 17 11:50:37 user nova-compute[73449]:         <nova:port uuid="96f9e0d7-29e1-46b0-81e6-1d00c8b35ec2">
Aug 17 11:50:37 user nova-compute[73449]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 17 11:50:37 user nova-compute[73449]:         </nova:port>
Aug 17 11:50:37 user nova-compute[73449]:       </nova:ports>
Aug 17 11:50:37 user nova-compute[73449]:     </nova:instance>
Aug 17 11:50:37 user nova-compute[73449]:   </metadata>
Aug 17 11:50:37 user nova-compute[73449]:   <sysinfo type="smbios">
Aug 17 11:50:37 user nova-compute[73449]:     <system>
Aug 17 11:50:37 user nova-compute[73449]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 11:50:37 user nova-compute[73449]:       <entry name="product">OpenStack Nova</entry>
Aug 17 11:50:37 user nova-compute[73449]:       <entry name="version">0.0.0</entry>
Aug 17 11:50:37 user nova-compute[73449]:       <entry name="serial">23ab9ffc-226d-4caa-8caa-9458de06a1c9</entry>
Aug 17 11:50:37 user nova-compute[73449]:       <entry name="uuid">23ab9ffc-226d-4caa-8caa-9458de06a1c9</entry>
Aug 17 11:50:37 user nova-compute[73449]:       <entry name="family">Virtual Machine</entry>
Aug 17 11:50:37 user nova-compute[73449]:     </system>
Aug 17 11:50:37 user nova-compute[73449]:   </sysinfo>
Aug 17 11:50:37 user nova-compute[73449]:   <os>
Aug 17 11:50:37 user nova-compute[73449]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 11:50:37 user nova-compute[73449]:     <boot dev="hd"/>
Aug 17 11:50:37 user nova-compute[73449]:     <smbios mode="sysinfo"/>
Aug 17 11:50:37 user nova-compute[73449]:   </os>
Aug 17 11:50:37 user nova-compute[73449]:   <features>
Aug 17 11:50:37 user nova-compute[73449]:     <acpi/>
Aug 17 11:50:37 user nova-compute[73449]:     <apic/>
Aug 17 11:50:37 user nova-compute[73449]:     <vmcoreinfo/>
Aug 17 11:50:37 user nova-compute[73449]:   </features>
Aug 17 11:50:37 user nova-compute[73449]:   <clock offset="utc">
Aug 17 11:50:37 user nova-compute[73449]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 11:50:37 user nova-compute[73449]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 11:50:37 user nova-compute[73449]:     <timer name="hpet" present="no"/>
Aug 17 11:50:37 user nova-compute[73449]:   </clock>
Aug 17 11:50:37 user nova-compute[73449]:   <cpu mode="custom" match="exact">
Aug 17 11:50:37 user nova-compute[73449]:     <model>Nehalem</model>
Aug 17 11:50:37 user nova-compute[73449]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 11:50:37 user nova-compute[73449]:   </cpu>
Aug 17 11:50:37 user nova-compute[73449]:   <devices>
Aug 17 11:50:37 user nova-compute[73449]:     <disk type="file" device="disk">
Aug 17 11:50:37 user nova-compute[73449]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 11:50:37 user nova-compute[73449]:       <source file="/opt/stack/data/nova/instances/23ab9ffc-226d-4caa-8caa-9458de06a1c9/disk"/>
Aug 17 11:50:37 user nova-compute[73449]:       <target dev="vda" bus="virtio"/>
Aug 17 11:50:37 user nova-compute[73449]:     </disk>
Aug 17 11:50:37 user nova-compute[73449]:     <interface type="ethernet">
Aug 17 11:50:37 user nova-compute[73449]:       <mac address="fa:16:3e:82:7e:7d"/>
Aug 17 11:50:37 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 11:50:37 user nova-compute[73449]:       <mtu size="1442"/>
Aug 17 11:50:37 user nova-compute[73449]:       <target dev="tap96f9e0d7-29"/>
Aug 17 11:50:37 user nova-compute[73449]:     </interface>
Aug 17 11:50:37 user nova-compute[73449]:     <serial type="pty">
Aug 17 11:50:37 user nova-compute[73449]:       <log file="/opt/stack/data/nova/instances/23ab9ffc-226d-4caa-8caa-9458de06a1c9/console.log" append="off"/>
Aug 17 11:50:37 user nova-compute[73449]:     </serial>
Aug 17 11:50:37 user nova-compute[73449]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 11:50:37 user nova-compute[73449]:     <video>
Aug 17 11:50:37 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 11:50:37 user nova-compute[73449]:     </video>
Aug 17 11:50:37 user nova-compute[73449]:     <rng model="virtio">
Aug 17 11:50:37 user nova-compute[73449]:       <backend model="random">/dev/urandom</backend>
Aug 17 11:50:37 user nova-compute[73449]:     </rng>
Aug 17 11:50:37 user nova-compute[73449]:     <controller type="usb" index="0" model="none"/>
Aug 17 11:50:37 user nova-compute[73449]:     <memballoon model="virtio">
Aug 17 11:50:37 user nova-compute[73449]:       <stats period="10"/>
Aug 17 11:50:37 user nova-compute[73449]:     </memballoon>
Aug 17 11:50:37 user nova-compute[73449]:   </devices>
Aug 17 11:50:37 user nova-compute[73449]: </domain>
Aug 17 11:50:37 user nova-compute[73449]:  {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 11:50:37 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-d332e30c-85e1-4130-a57c-2bcdddecf531 tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:50:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-667733895',display_name='tempest-ServersNegativeTestJSON-server-667733895',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-667733895',id=28,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cbaa73b99e5a498dac668e5307654fd2',ramdisk_id='',reservation_id='r-1bcsbsjo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-132584909',owner_user_name='tempest-ServersNegativeTestJSON-132584909-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T11:50:35Z,user_data=None,user_id='56d7fd2eae7c4e62a7cc0e917287f03f',uuid=23ab9ffc-226d-4caa-8caa-9458de06a1c9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "96f9e0d7-29e1-46b0-81e6-1d00c8b35ec2", "address": "fa:16:3e:82:7e:7d", "network": {"id": "c3e9bf16-545d-4ae8-bbad-5092c0e8f735", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1927778048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbaa73b99e5a498dac668e5307654fd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96f9e0d7-29", "ovs_interfaceid": "96f9e0d7-29e1-46b0-81e6-1d00c8b35ec2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 11:50:37 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-d332e30c-85e1-4130-a57c-2bcdddecf531 tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Converting VIF {"id": "96f9e0d7-29e1-46b0-81e6-1d00c8b35ec2", "address": "fa:16:3e:82:7e:7d", "network": {"id": "c3e9bf16-545d-4ae8-bbad-5092c0e8f735", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1927778048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbaa73b99e5a498dac668e5307654fd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96f9e0d7-29", "ovs_interfaceid": "96f9e0d7-29e1-46b0-81e6-1d00c8b35ec2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:50:37 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-d332e30c-85e1-4130-a57c-2bcdddecf531 tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:7e:7d,bridge_name='br-int',has_traffic_filtering=True,id=96f9e0d7-29e1-46b0-81e6-1d00c8b35ec2,network=Network(c3e9bf16-545d-4ae8-bbad-5092c0e8f735),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96f9e0d7-29') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:50:37 user nova-compute[73449]: DEBUG os_vif [None req-d332e30c-85e1-4130-a57c-2bcdddecf531 tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:7e:7d,bridge_name='br-int',has_traffic_filtering=True,id=96f9e0d7-29e1-46b0-81e6-1d00c8b35ec2,network=Network(c3e9bf16-545d-4ae8-bbad-5092c0e8f735),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96f9e0d7-29') {{(pid=73449) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 11:50:37 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:50:37 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:50:37 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 11:50:37 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:50:37 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap96f9e0d7-29, may_exist=True, interface_attrs={}) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:50:37 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap96f9e0d7-29, col_values=(('external_ids', {'iface-id': '96f9e0d7-29e1-46b0-81e6-1d00c8b35ec2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:82:7e:7d', 'vm-uuid': '23ab9ffc-226d-4caa-8caa-9458de06a1c9'}),), if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:50:37 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:50:37 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:50:37 user nova-compute[73449]: INFO os_vif [None req-d332e30c-85e1-4130-a57c-2bcdddecf531 tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:7e:7d,bridge_name='br-int',has_traffic_filtering=True,id=96f9e0d7-29e1-46b0-81e6-1d00c8b35ec2,network=Network(c3e9bf16-545d-4ae8-bbad-5092c0e8f735),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96f9e0d7-29')
Aug 17 11:50:37 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-d332e30c-85e1-4130-a57c-2bcdddecf531 tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] No BDM found with device name vda, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 11:50:37 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-d332e30c-85e1-4130-a57c-2bcdddecf531 tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] No VIF found with MAC fa:16:3e:82:7e:7d, not building metadata {{(pid=73449) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 11:50:38 user nova-compute[73449]: DEBUG nova.network.neutron [req-a4072e84-a9df-4b18-9bc6-d978e736905a req-a251def9-759b-450f-ac7e-ed8a483054c1 service nova] [instance: 23ab9ffc-226d-4caa-8caa-9458de06a1c9] Updated VIF entry in instance network info cache for port 96f9e0d7-29e1-46b0-81e6-1d00c8b35ec2. {{(pid=73449) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 11:50:38 user nova-compute[73449]: DEBUG nova.network.neutron [req-a4072e84-a9df-4b18-9bc6-d978e736905a req-a251def9-759b-450f-ac7e-ed8a483054c1 service nova] [instance: 23ab9ffc-226d-4caa-8caa-9458de06a1c9] Updating instance_info_cache with network_info: [{"id": "96f9e0d7-29e1-46b0-81e6-1d00c8b35ec2", "address": "fa:16:3e:82:7e:7d", "network": {"id": "c3e9bf16-545d-4ae8-bbad-5092c0e8f735", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1927778048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbaa73b99e5a498dac668e5307654fd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96f9e0d7-29", "ovs_interfaceid": "96f9e0d7-29e1-46b0-81e6-1d00c8b35ec2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:50:38 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-a4072e84-a9df-4b18-9bc6-d978e736905a req-a251def9-759b-450f-ac7e-ed8a483054c1 service nova] Releasing lock "refresh_cache-23ab9ffc-226d-4caa-8caa-9458de06a1c9" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:50:38 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:50:38 user nova-compute[73449]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692273023.9892504, 3d468854-6182-49c8-acb7-0641df2d5219 => Stopped> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:50:38 user nova-compute[73449]: INFO nova.compute.manager [-] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] VM Stopped (Lifecycle Event)
Aug 17 11:50:39 user nova-compute[73449]: DEBUG nova.compute.manager [None req-15c8c2fd-4267-4bd6-9031-1e622c1db1ef None None] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:50:39 user nova-compute[73449]: DEBUG nova.compute.manager [None req-15c8c2fd-4267-4bd6-9031-1e622c1db1ef None None] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 11:50:39 user nova-compute[73449]: INFO nova.compute.manager [None req-15c8c2fd-4267-4bd6-9031-1e622c1db1ef None None] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 17 11:50:39 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:50:39 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:50:39 user nova-compute[73449]: INFO nova.compute.manager [None req-35ff9193-0246-4b11-b39e-7856569c1a38 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] Rescuing
Aug 17 11:50:39 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-35ff9193-0246-4b11-b39e-7856569c1a38 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Acquiring lock "refresh_cache-3d74c8f6-fb4e-4460-b722-674a8a1e2d25" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:50:39 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-35ff9193-0246-4b11-b39e-7856569c1a38 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Acquired lock "refresh_cache-3d74c8f6-fb4e-4460-b722-674a8a1e2d25" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:50:39 user nova-compute[73449]: DEBUG nova.network.neutron [None req-35ff9193-0246-4b11-b39e-7856569c1a38 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] Building network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 11:50:39 user nova-compute[73449]: DEBUG nova.compute.manager [req-358f84f8-32f6-41ac-bead-eb4ec4e30613 req-658c7de5-58f1-4569-b09c-c0a7ff2db7a7 service nova] [instance: 23ab9ffc-226d-4caa-8caa-9458de06a1c9] Received event network-vif-plugged-96f9e0d7-29e1-46b0-81e6-1d00c8b35ec2 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:50:39 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-358f84f8-32f6-41ac-bead-eb4ec4e30613 req-658c7de5-58f1-4569-b09c-c0a7ff2db7a7 service nova] Acquiring lock "23ab9ffc-226d-4caa-8caa-9458de06a1c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:50:39 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-358f84f8-32f6-41ac-bead-eb4ec4e30613 req-658c7de5-58f1-4569-b09c-c0a7ff2db7a7 service nova] Lock "23ab9ffc-226d-4caa-8caa-9458de06a1c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:50:39 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-358f84f8-32f6-41ac-bead-eb4ec4e30613 req-658c7de5-58f1-4569-b09c-c0a7ff2db7a7 service nova] Lock "23ab9ffc-226d-4caa-8caa-9458de06a1c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:50:39 user nova-compute[73449]: DEBUG nova.compute.manager [req-358f84f8-32f6-41ac-bead-eb4ec4e30613 req-658c7de5-58f1-4569-b09c-c0a7ff2db7a7 service nova] [instance: 23ab9ffc-226d-4caa-8caa-9458de06a1c9] No waiting events found dispatching network-vif-plugged-96f9e0d7-29e1-46b0-81e6-1d00c8b35ec2 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:50:39 user nova-compute[73449]: WARNING nova.compute.manager [req-358f84f8-32f6-41ac-bead-eb4ec4e30613 req-658c7de5-58f1-4569-b09c-c0a7ff2db7a7 service nova] [instance: 23ab9ffc-226d-4caa-8caa-9458de06a1c9] Received unexpected event network-vif-plugged-96f9e0d7-29e1-46b0-81e6-1d00c8b35ec2 for instance with vm_state building and task_state spawning.
Aug 17 11:50:39 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:50:39 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:50:39 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-678756a8-0736-4c0f-9805-864bcd3ae646 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:50:39 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-678756a8-0736-4c0f-9805-864bcd3ae646 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:50:39 user nova-compute[73449]: DEBUG nova.objects.instance [None req-678756a8-0736-4c0f-9805-864bcd3ae646 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Lazy-loading 'pci_requests' on Instance uuid 5612f7d1-a901-4bdd-a24a-faf9a980cd04 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:50:39 user nova-compute[73449]: DEBUG nova.objects.instance [None req-678756a8-0736-4c0f-9805-864bcd3ae646 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Lazy-loading 'numa_topology' on Instance uuid 5612f7d1-a901-4bdd-a24a-faf9a980cd04 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:50:39 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-678756a8-0736-4c0f-9805-864bcd3ae646 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73449) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 11:50:39 user nova-compute[73449]: INFO nova.compute.claims [None req-678756a8-0736-4c0f-9805-864bcd3ae646 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Claim successful on node user
Aug 17 11:50:39 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:50:40 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Starting finish_migration {{(pid=73449) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 17 11:50:40 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Instance directory exists: not creating {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 17 11:50:40 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Creating image(s)
Aug 17 11:50:40 user nova-compute[73449]: DEBUG nova.objects.instance [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Lazy-loading 'trusted_certs' on Instance uuid 3d468854-6182-49c8-acb7-0641df2d5219 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:50:40 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:50:40 user nova-compute[73449]: DEBUG nova.network.neutron [None req-35ff9193-0246-4b11-b39e-7856569c1a38 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] Updating instance_info_cache with network_info: [{"id": "a0e89b76-95af-4e50-a972-b223cc5b3cab", "address": "fa:16:3e:5c:ab:e7", "network": {"id": "f7298070-baaa-4842-b3b2-d9fe1058d3b6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1715911399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8722edee53ed4a9188366c38f3b8b52f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0e89b76-95", "ovs_interfaceid": "a0e89b76-95af-4e50-a972-b223cc5b3cab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:50:40 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-35ff9193-0246-4b11-b39e-7856569c1a38 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Releasing lock "refresh_cache-3d74c8f6-fb4e-4460-b722-674a8a1e2d25" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:50:40 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json" returned: 0 in 0.281s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:50:40 user nova-compute[73449]: DEBUG nova.virt.disk.api [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3d468854-6182-49c8-acb7-0641df2d5219/disk. size=21474836480 {{(pid=73449) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 11:50:40 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d468854-6182-49c8-acb7-0641df2d5219/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:50:40 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:50:40 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:50:40 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-678756a8-0736-4c0f-9805-864bcd3ae646 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 11:50:40 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-678756a8-0736-4c0f-9805-864bcd3ae646 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 11:50:40 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d468854-6182-49c8-acb7-0641df2d5219/disk --force-share --output=json" returned: 0 in 0.268s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:50:40 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/3d468854-6182-49c8-acb7-0641df2d5219/disk 21474836480 {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:50:40 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-678756a8-0736-4c0f-9805-864bcd3ae646 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.927s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:50:40 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/3d468854-6182-49c8-acb7-0641df2d5219/disk 21474836480" returned: 0 in 0.084s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:50:40 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Did not create local disks {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 11:50:40 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Ensure instance console log exists: /opt/stack/data/nova/instances/3d468854-6182-49c8-acb7-0641df2d5219/console.log {{(pid=73449) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 11:50:40 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:50:40 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:50:40 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:50:40 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Start _get_guest_xml network_info=[{"id": "1ec58d7f-18a4-4ddb-a137-2b72c5221621", "address": "fa:16:3e:8d:35:49", "network": {"id": "870c4b80-1ae0-4a10-89b8-ec734c66c244", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2050219794-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2050219794-network", "vif_mac": "fa:16:3e:8d:35:49"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d6856b60c404a34b6355b5fd6dd7bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec58d7f-18", "ovs_interfaceid": "1ec58d7f-18a4-4ddb-a137-2b72c5221621", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T11:36:11Z,direct_url=<?>,disk_format='qcow2',id=0a2904ae-083d-41c8-83db-343132b36148,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7a77880136a54ef195c82e018e1939db',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T11:36:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': '0a2904ae-083d-41c8-83db-343132b36148'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'attachment_id': '43823ea9-1580-410f-9551-50a96e421d44', 'boot_index': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZpYgxHvU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '3d468854-6182-49c8-acb7-0641df2d5219', 'attached_at': '2023-08-17T11:50:40.000000', 'detached_at': '', 'volume_id': '040e2bc9-cd90-4010-9fdf-b7cc92b1c061', 'serial': '040e2bc9-cd90-4010-9fdf-b7cc92b1c061'}, 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 11:50:40 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:50:40 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:50:40 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 11:50:40 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] CPU controller missing on host. {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 11:50:40 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 11:50:40 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] CPU controller found on host. {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 11:50:40 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73449) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 11:50:40 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T11:36:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T11:36:11Z,direct_url=<?>,disk_format='qcow2',id=0a2904ae-083d-41c8-83db-343132b36148,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7a77880136a54ef195c82e018e1939db',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T11:36:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 11:50:40 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Flavor limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 11:50:40 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Image limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 11:50:40 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Flavor pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 11:50:40 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Image pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 11:50:40 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 11:50:40 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 11:50:40 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 11:50:40 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Got 1 possible topologies {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 11:50:40 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 11:50:40 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 11:50:40 user nova-compute[73449]: DEBUG nova.objects.instance [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3d468854-6182-49c8-acb7-0641df2d5219 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:50:41 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:50:41 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:50:41 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Calling os-brick to attach iSCSI Volume {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 11:50:41 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZpYgxHvU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 11:50:41 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 11:50:41 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:50:41 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:50:41 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 11:50:41 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:50:41 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:50:41 user nova-compute[73449]: INFO os_brick.initiator.connectors.iscsi [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 11:50:41 user nova-compute[73449]: INFO nova.network.neutron [None req-678756a8-0736-4c0f-9805-864bcd3ae646 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Updating port 599e177a-d05b-4d24-8c89-8a868182940c with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 17 11:50:41 user nova-compute[73449]: DEBUG nova.compute.manager [req-a7c5dd34-a10e-43be-8183-9f2f073ba50f req-746f90ac-f24f-48a2-b3cc-5874a296869a service nova] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] Received event network-vif-unplugged-a0e89b76-95af-4e50-a972-b223cc5b3cab {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:50:41 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-a7c5dd34-a10e-43be-8183-9f2f073ba50f req-746f90ac-f24f-48a2-b3cc-5874a296869a service nova] Acquiring lock "3d74c8f6-fb4e-4460-b722-674a8a1e2d25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:50:41 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-a7c5dd34-a10e-43be-8183-9f2f073ba50f req-746f90ac-f24f-48a2-b3cc-5874a296869a service nova] Lock "3d74c8f6-fb4e-4460-b722-674a8a1e2d25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:50:41 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-a7c5dd34-a10e-43be-8183-9f2f073ba50f req-746f90ac-f24f-48a2-b3cc-5874a296869a service nova] Lock "3d74c8f6-fb4e-4460-b722-674a8a1e2d25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:50:41 user nova-compute[73449]: DEBUG nova.compute.manager [req-a7c5dd34-a10e-43be-8183-9f2f073ba50f req-746f90ac-f24f-48a2-b3cc-5874a296869a service nova] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] No waiting events found dispatching network-vif-unplugged-a0e89b76-95af-4e50-a972-b223cc5b3cab {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:50:41 user nova-compute[73449]: WARNING nova.compute.manager [req-a7c5dd34-a10e-43be-8183-9f2f073ba50f req-746f90ac-f24f-48a2-b3cc-5874a296869a service nova] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] Received unexpected event network-vif-unplugged-a0e89b76-95af-4e50-a972-b223cc5b3cab for instance with vm_state active and task_state rescuing.
Aug 17 11:50:41 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 -p 172.16.0.220:3260 {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:50:41 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:50:41 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff99bcdf-8d63-44b5-98e5-93c73087ae1d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:50:41 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 11:50:41 user nova-compute[73449]:  {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:50:41 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 -p 172.16.0.220:3260 --interface default --op new {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:50:41 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.030s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:50:41 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f54a0da-9033-4755-a059-dd59afb4d6e4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061] added\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:50:41 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061] added
Aug 17 11:50:41 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:50:41 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:50:41 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:50:41 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[2492d031-782e-4a7a-b773-b0d9cbdb788a]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:50:41 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:50:41 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:50:41 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:50:41 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f3c48c2-78de-48ad-85db-e3569e3f3fe9]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:50:41 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:50:41 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZpYgxHvU {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:50:41 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZpYgxHvU" returned: 0 in 0.023s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:50:41 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef5869e-4e5a-4731-a2bb-357f25974829]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:50:41 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZpYgxHvU'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:50:41 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:50:41 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.032s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:50:41 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce0e375f-5e68-4941-91c6-a5e25bbd7414]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:50:41 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:50:41 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] Instance destroyed successfully.
Aug 17 11:50:41 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:50:41 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-35ff9193-0246-4b11-b39e-7856569c1a38 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] Attempting rescue
Aug 17 11:50:41 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-35ff9193-0246-4b11-b39e-7856569c1a38 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73449) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 17 11:50:41 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-35ff9193-0246-4b11-b39e-7856569c1a38 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] Instance directory exists: not creating {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 17 11:50:41 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-35ff9193-0246-4b11-b39e-7856569c1a38 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] Creating image(s)
Aug 17 11:50:41 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-35ff9193-0246-4b11-b39e-7856569c1a38 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Acquiring lock "/opt/stack/data/nova/instances/3d74c8f6-fb4e-4460-b722-674a8a1e2d25/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:50:41 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-35ff9193-0246-4b11-b39e-7856569c1a38 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Lock "/opt/stack/data/nova/instances/3d74c8f6-fb4e-4460-b722-674a8a1e2d25/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:50:41 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-35ff9193-0246-4b11-b39e-7856569c1a38 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Lock "/opt/stack/data/nova/instances/3d74c8f6-fb4e-4460-b722-674a8a1e2d25/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:50:41 user nova-compute[73449]: DEBUG nova.objects.instance [None req-35ff9193-0246-4b11-b39e-7856569c1a38 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Lazy-loading 'trusted_certs' on Instance uuid 3d74c8f6-fb4e-4460-b722-674a8a1e2d25 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:50:41 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:50:41 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[0148a8e1-17e3-466b-ba9a-0a5c937850ec]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:50:41 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe (non-flash)
Aug 17 11:50:41 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:50:41 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe (non-flash)
Aug 17 11:50:41 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:50:41 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 -p 172.16.0.220:3260 --login {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:50:41 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-35ff9193-0246-4b11-b39e-7856569c1a38 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Acquiring lock "7e267a577c062ee862e95ede6b48cfd5632f3ea3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:50:41 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-35ff9193-0246-4b11-b39e-7856569c1a38 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Lock "7e267a577c062ee862e95ede6b48cfd5632f3ea3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:50:41 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-35ff9193-0246-4b11-b39e-7856569c1a38 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:50:41 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:50:41 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[6654e60b-9dfc-4d18-a7a8-14130b911201]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:50:41 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061, portal: 172.16.0.220,3260]
Aug 17 11:50:41 user nova-compute[73449]: Login to [iface: default, target: iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061, portal: 172.16.0.220,3260] successful.
Aug 17 11:50:41 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:50:41 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:50:41 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.032s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:50:41 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[003b7519-bae9-4ff2-84a7-144ae54d7f40]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:50:41 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:50:41 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:50:41 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:50:41 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[03cab651-0796-49e4-b82e-4da5fb94fa9a]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:50:41 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe (non-flash)
Aug 17 11:50:41 user nova-compute[73449]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 (non-flash)
Aug 17 11:50:41 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:50:41 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe (non-flash)
Aug 17 11:50:41 user nova-compute[73449]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 (non-flash)
Aug 17 11:50:41 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:50:41 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.395s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:50:41 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Connected to 172.16.0.220:3260 {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 11:50:41 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] HCTL ('33', '-', '-', 0) found on session 29 with lun 0 {{(pid=73449) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 11:50:41 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73449) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 11:50:41 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:50:41 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:50:41 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cfaab62-32e0-402f-bb93-00e8a333ba2c]: (4, ('- - 0', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:50:41 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Searching for a device in session 29 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73449) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 11:50:41 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZpYgxHvU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 11:50:41 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-35ff9193-0246-4b11-b39e-7856569c1a38 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json" returned: 0 in 0.224s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:50:41 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-35ff9193-0246-4b11-b39e-7856569c1a38 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3,backing_fmt=raw /opt/stack/data/nova/instances/3d74c8f6-fb4e-4460-b722-674a8a1e2d25/disk.rescue {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:50:41 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-35ff9193-0246-4b11-b39e-7856569c1a38 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3,backing_fmt=raw /opt/stack/data/nova/instances/3d74c8f6-fb4e-4460-b722-674a8a1e2d25/disk.rescue" returned: 0 in 0.078s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:50:41 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-35ff9193-0246-4b11-b39e-7856569c1a38 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Lock "7e267a577c062ee862e95ede6b48cfd5632f3ea3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.311s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:50:41 user nova-compute[73449]: DEBUG nova.objects.instance [None req-35ff9193-0246-4b11-b39e-7856569c1a38 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Lazy-loading 'migration_context' on Instance uuid 3d74c8f6-fb4e-4460-b722-674a8a1e2d25 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:50:41 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-35ff9193-0246-4b11-b39e-7856569c1a38 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] Created local disks {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 11:50:41 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-35ff9193-0246-4b11-b39e-7856569c1a38 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] Start _get_guest_xml network_info=[{"id": "a0e89b76-95af-4e50-a972-b223cc5b3cab", "address": "fa:16:3e:5c:ab:e7", "network": {"id": "f7298070-baaa-4842-b3b2-d9fe1058d3b6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1715911399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1715911399-network", "vif_mac": "fa:16:3e:5c:ab:e7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8722edee53ed4a9188366c38f3b8b52f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0e89b76-95", "ovs_interfaceid": "a0e89b76-95af-4e50-a972-b223cc5b3cab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T11:36:11Z,direct_url=<?>,disk_format='qcow2',id=0a2904ae-083d-41c8-83db-343132b36148,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7a77880136a54ef195c82e018e1939db',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T11:36:13Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '0a2904ae-083d-41c8-83db-343132b36148', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 11:50:41 user nova-compute[73449]: DEBUG nova.objects.instance [None req-35ff9193-0246-4b11-b39e-7856569c1a38 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Lazy-loading 'resources' on Instance uuid 3d74c8f6-fb4e-4460-b722-674a8a1e2d25 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:50:41 user nova-compute[73449]: DEBUG nova.compute.manager [req-a243cb0a-39eb-443d-a071-02db2eb37f02 req-6a1f178f-5375-438e-acc9-535dcdfdb521 service nova] [instance: 23ab9ffc-226d-4caa-8caa-9458de06a1c9] Received event network-vif-plugged-96f9e0d7-29e1-46b0-81e6-1d00c8b35ec2 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:50:41 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-a243cb0a-39eb-443d-a071-02db2eb37f02 req-6a1f178f-5375-438e-acc9-535dcdfdb521 service nova] Acquiring lock "23ab9ffc-226d-4caa-8caa-9458de06a1c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:50:41 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-a243cb0a-39eb-443d-a071-02db2eb37f02 req-6a1f178f-5375-438e-acc9-535dcdfdb521 service nova] Lock "23ab9ffc-226d-4caa-8caa-9458de06a1c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:50:41 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-a243cb0a-39eb-443d-a071-02db2eb37f02 req-6a1f178f-5375-438e-acc9-535dcdfdb521 service nova] Lock "23ab9ffc-226d-4caa-8caa-9458de06a1c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:50:41 user nova-compute[73449]: DEBUG nova.compute.manager [req-a243cb0a-39eb-443d-a071-02db2eb37f02 req-6a1f178f-5375-438e-acc9-535dcdfdb521 service nova] [instance: 23ab9ffc-226d-4caa-8caa-9458de06a1c9] No waiting events found dispatching network-vif-plugged-96f9e0d7-29e1-46b0-81e6-1d00c8b35ec2 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:50:41 user nova-compute[73449]: WARNING nova.compute.manager [req-a243cb0a-39eb-443d-a071-02db2eb37f02 req-6a1f178f-5375-438e-acc9-535dcdfdb521 service nova] [instance: 23ab9ffc-226d-4caa-8caa-9458de06a1c9] Received unexpected event network-vif-plugged-96f9e0d7-29e1-46b0-81e6-1d00c8b35ec2 for instance with vm_state building and task_state spawning.
Aug 17 11:50:41 user nova-compute[73449]: DEBUG nova.objects.instance [None req-35ff9193-0246-4b11-b39e-7856569c1a38 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Lazy-loading 'numa_topology' on Instance uuid 3d74c8f6-fb4e-4460-b722-674a8a1e2d25 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:50:41 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-35ff9193-0246-4b11-b39e-7856569c1a38 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:50:41 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-35ff9193-0246-4b11-b39e-7856569c1a38 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:50:41 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-35ff9193-0246-4b11-b39e-7856569c1a38 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 11:50:41 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-35ff9193-0246-4b11-b39e-7856569c1a38 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] CPU controller missing on host. {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 11:50:41 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-35ff9193-0246-4b11-b39e-7856569c1a38 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 11:50:41 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-35ff9193-0246-4b11-b39e-7856569c1a38 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] CPU controller found on host. {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 11:50:41 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-35ff9193-0246-4b11-b39e-7856569c1a38 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73449) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 11:50:41 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-35ff9193-0246-4b11-b39e-7856569c1a38 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T11:35:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T11:36:11Z,direct_url=<?>,disk_format='qcow2',id=0a2904ae-083d-41c8-83db-343132b36148,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7a77880136a54ef195c82e018e1939db',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T11:36:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 11:50:41 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-35ff9193-0246-4b11-b39e-7856569c1a38 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Flavor limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 11:50:41 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-35ff9193-0246-4b11-b39e-7856569c1a38 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Image limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 11:50:41 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-35ff9193-0246-4b11-b39e-7856569c1a38 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Flavor pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 11:50:41 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-35ff9193-0246-4b11-b39e-7856569c1a38 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Image pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 11:50:41 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-35ff9193-0246-4b11-b39e-7856569c1a38 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 11:50:41 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-35ff9193-0246-4b11-b39e-7856569c1a38 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 11:50:41 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-35ff9193-0246-4b11-b39e-7856569c1a38 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 11:50:41 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-35ff9193-0246-4b11-b39e-7856569c1a38 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Got 1 possible topologies {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 11:50:41 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-35ff9193-0246-4b11-b39e-7856569c1a38 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 11:50:41 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-35ff9193-0246-4b11-b39e-7856569c1a38 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 11:50:41 user nova-compute[73449]: DEBUG nova.objects.instance [None req-35ff9193-0246-4b11-b39e-7856569c1a38 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3d74c8f6-fb4e-4460-b722-674a8a1e2d25 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:50:41 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-35ff9193-0246-4b11-b39e-7856569c1a38 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:45:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-232739498',display_name='tempest-ServerRescueNegativeTestJSON-server-232739498',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-232739498',id=18,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T11:46:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8722edee53ed4a9188366c38f3b8b52f',ramdisk_id='',reservation_id='r-yxd32tyb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1458167730',owner_user_name='tempest-ServerRescueNegativeTestJSON-1458167730-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T11:46:02Z,user_data=None,user_id='7ccb76bc93f84e0897da59b8d5928238',uuid=3d74c8f6-fb4e-4460-b722-674a8a1e2d25,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a0e89b76-95af-4e50-a972-b223cc5b3cab", "address": "fa:16:3e:5c:ab:e7", "network": {"id": "f7298070-baaa-4842-b3b2-d9fe1058d3b6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1715911399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1715911399-network", "vif_mac": "fa:16:3e:5c:ab:e7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8722edee53ed4a9188366c38f3b8b52f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0e89b76-95", "ovs_interfaceid": "a0e89b76-95af-4e50-a972-b223cc5b3cab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73449) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 11:50:41 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-35ff9193-0246-4b11-b39e-7856569c1a38 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Converting VIF {"id": "a0e89b76-95af-4e50-a972-b223cc5b3cab", "address": "fa:16:3e:5c:ab:e7", "network": {"id": "f7298070-baaa-4842-b3b2-d9fe1058d3b6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1715911399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1715911399-network", "vif_mac": "fa:16:3e:5c:ab:e7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8722edee53ed4a9188366c38f3b8b52f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0e89b76-95", "ovs_interfaceid": "a0e89b76-95af-4e50-a972-b223cc5b3cab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:50:41 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-35ff9193-0246-4b11-b39e-7856569c1a38 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5c:ab:e7,bridge_name='br-int',has_traffic_filtering=True,id=a0e89b76-95af-4e50-a972-b223cc5b3cab,network=Network(f7298070-baaa-4842-b3b2-d9fe1058d3b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0e89b76-95') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:50:41 user nova-compute[73449]: DEBUG nova.objects.instance [None req-35ff9193-0246-4b11-b39e-7856569c1a38 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Lazy-loading 'pci_devices' on Instance uuid 3d74c8f6-fb4e-4460-b722-674a8a1e2d25 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:50:41 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-35ff9193-0246-4b11-b39e-7856569c1a38 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] End _get_guest_xml xml=<domain type="kvm">
Aug 17 11:50:41 user nova-compute[73449]:   <uuid>3d74c8f6-fb4e-4460-b722-674a8a1e2d25</uuid>
Aug 17 11:50:41 user nova-compute[73449]:   <name>instance-00000012</name>
Aug 17 11:50:41 user nova-compute[73449]:   <memory>524288</memory>
Aug 17 11:50:41 user nova-compute[73449]:   <vcpu>1</vcpu>
Aug 17 11:50:41 user nova-compute[73449]:   <metadata>
Aug 17 11:50:41 user nova-compute[73449]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 11:50:41 user nova-compute[73449]:       <nova:package version="0.0.0"/>
Aug 17 11:50:41 user nova-compute[73449]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-232739498</nova:name>
Aug 17 11:50:41 user nova-compute[73449]:       <nova:creationTime>2023-08-17 11:50:41</nova:creationTime>
Aug 17 11:50:41 user nova-compute[73449]:       <nova:flavor name="m1.tiny">
Aug 17 11:50:41 user nova-compute[73449]:         <nova:memory>512</nova:memory>
Aug 17 11:50:41 user nova-compute[73449]:         <nova:disk>1</nova:disk>
Aug 17 11:50:41 user nova-compute[73449]:         <nova:swap>0</nova:swap>
Aug 17 11:50:41 user nova-compute[73449]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 11:50:41 user nova-compute[73449]:         <nova:vcpus>1</nova:vcpus>
Aug 17 11:50:41 user nova-compute[73449]:       </nova:flavor>
Aug 17 11:50:41 user nova-compute[73449]:       <nova:owner>
Aug 17 11:50:41 user nova-compute[73449]:         <nova:user uuid="7ccb76bc93f84e0897da59b8d5928238">tempest-ServerRescueNegativeTestJSON-1458167730-project-member</nova:user>
Aug 17 11:50:41 user nova-compute[73449]:         <nova:project uuid="8722edee53ed4a9188366c38f3b8b52f">tempest-ServerRescueNegativeTestJSON-1458167730</nova:project>
Aug 17 11:50:41 user nova-compute[73449]:       </nova:owner>
Aug 17 11:50:41 user nova-compute[73449]:       <nova:root type="image" uuid="0a2904ae-083d-41c8-83db-343132b36148"/>
Aug 17 11:50:41 user nova-compute[73449]:       <nova:ports>
Aug 17 11:50:41 user nova-compute[73449]:         <nova:port uuid="a0e89b76-95af-4e50-a972-b223cc5b3cab">
Aug 17 11:50:41 user nova-compute[73449]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 17 11:50:41 user nova-compute[73449]:         </nova:port>
Aug 17 11:50:41 user nova-compute[73449]:       </nova:ports>
Aug 17 11:50:41 user nova-compute[73449]:     </nova:instance>
Aug 17 11:50:41 user nova-compute[73449]:   </metadata>
Aug 17 11:50:41 user nova-compute[73449]:   <sysinfo type="smbios">
Aug 17 11:50:41 user nova-compute[73449]:     <system>
Aug 17 11:50:41 user nova-compute[73449]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 11:50:41 user nova-compute[73449]:       <entry name="product">OpenStack Nova</entry>
Aug 17 11:50:41 user nova-compute[73449]:       <entry name="version">0.0.0</entry>
Aug 17 11:50:41 user nova-compute[73449]:       <entry name="serial">3d74c8f6-fb4e-4460-b722-674a8a1e2d25</entry>
Aug 17 11:50:41 user nova-compute[73449]:       <entry name="uuid">3d74c8f6-fb4e-4460-b722-674a8a1e2d25</entry>
Aug 17 11:50:41 user nova-compute[73449]:       <entry name="family">Virtual Machine</entry>
Aug 17 11:50:41 user nova-compute[73449]:     </system>
Aug 17 11:50:41 user nova-compute[73449]:   </sysinfo>
Aug 17 11:50:41 user nova-compute[73449]:   <os>
Aug 17 11:50:41 user nova-compute[73449]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 11:50:41 user nova-compute[73449]:     <smbios mode="sysinfo"/>
Aug 17 11:50:41 user nova-compute[73449]:   </os>
Aug 17 11:50:41 user nova-compute[73449]:   <features>
Aug 17 11:50:41 user nova-compute[73449]:     <acpi/>
Aug 17 11:50:41 user nova-compute[73449]:     <apic/>
Aug 17 11:50:41 user nova-compute[73449]:     <vmcoreinfo/>
Aug 17 11:50:41 user nova-compute[73449]:   </features>
Aug 17 11:50:41 user nova-compute[73449]:   <clock offset="utc">
Aug 17 11:50:41 user nova-compute[73449]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 11:50:41 user nova-compute[73449]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 11:50:41 user nova-compute[73449]:     <timer name="hpet" present="no"/>
Aug 17 11:50:41 user nova-compute[73449]:   </clock>
Aug 17 11:50:41 user nova-compute[73449]:   <cpu mode="custom" match="exact">
Aug 17 11:50:41 user nova-compute[73449]:     <model>Nehalem</model>
Aug 17 11:50:41 user nova-compute[73449]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 11:50:41 user nova-compute[73449]:   </cpu>
Aug 17 11:50:41 user nova-compute[73449]:   <devices>
Aug 17 11:50:41 user nova-compute[73449]:     <disk type="file" device="disk">
Aug 17 11:50:41 user nova-compute[73449]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 11:50:41 user nova-compute[73449]:       <source file="/opt/stack/data/nova/instances/3d74c8f6-fb4e-4460-b722-674a8a1e2d25/disk.rescue"/>
Aug 17 11:50:41 user nova-compute[73449]:       <target dev="vda" bus="virtio"/>
Aug 17 11:50:41 user nova-compute[73449]:     </disk>
Aug 17 11:50:41 user nova-compute[73449]:     <disk type="file" device="disk">
Aug 17 11:50:41 user nova-compute[73449]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 11:50:41 user nova-compute[73449]:       <source file="/opt/stack/data/nova/instances/3d74c8f6-fb4e-4460-b722-674a8a1e2d25/disk"/>
Aug 17 11:50:41 user nova-compute[73449]:       <target dev="vdb" bus="virtio"/>
Aug 17 11:50:41 user nova-compute[73449]:     </disk>
Aug 17 11:50:41 user nova-compute[73449]:     <interface type="ethernet">
Aug 17 11:50:41 user nova-compute[73449]:       <mac address="fa:16:3e:5c:ab:e7"/>
Aug 17 11:50:41 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 11:50:41 user nova-compute[73449]:       <mtu size="1442"/>
Aug 17 11:50:41 user nova-compute[73449]:       <target dev="tapa0e89b76-95"/>
Aug 17 11:50:41 user nova-compute[73449]:     </interface>
Aug 17 11:50:41 user nova-compute[73449]:     <serial type="pty">
Aug 17 11:50:41 user nova-compute[73449]:       <log file="/opt/stack/data/nova/instances/3d74c8f6-fb4e-4460-b722-674a8a1e2d25/console.log" append="off"/>
Aug 17 11:50:41 user nova-compute[73449]:     </serial>
Aug 17 11:50:41 user nova-compute[73449]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 11:50:41 user nova-compute[73449]:     <video>
Aug 17 11:50:41 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 11:50:41 user nova-compute[73449]:     </video>
Aug 17 11:50:41 user nova-compute[73449]:     <rng model="virtio">
Aug 17 11:50:41 user nova-compute[73449]:       <backend model="random">/dev/urandom</backend>
Aug 17 11:50:41 user nova-compute[73449]:     </rng>
Aug 17 11:50:41 user nova-compute[73449]:     <controller type="usb" index="0" model="none"/>
Aug 17 11:50:41 user nova-compute[73449]:     <memballoon model="virtio">
Aug 17 11:50:41 user nova-compute[73449]:       <stats period="10"/>
Aug 17 11:50:41 user nova-compute[73449]:     </memballoon>
Aug 17 11:50:41 user nova-compute[73449]:   </devices>
Aug 17 11:50:41 user nova-compute[73449]: </domain>
Aug 17 11:50:41 user nova-compute[73449]:  {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 11:50:41 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] Instance destroyed successfully.
Aug 17 11:50:42 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-35ff9193-0246-4b11-b39e-7856569c1a38 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] No BDM found with device name vda, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 11:50:42 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-35ff9193-0246-4b11-b39e-7856569c1a38 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 11:50:42 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-35ff9193-0246-4b11-b39e-7856569c1a38 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] No VIF found with MAC fa:16:3e:5c:ab:e7, not building metadata {{(pid=73449) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 11:50:42 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692273042.0926068, 23ab9ffc-226d-4caa-8caa-9458de06a1c9 => Resumed> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:50:42 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 23ab9ffc-226d-4caa-8caa-9458de06a1c9] VM Resumed (Lifecycle Event)
Aug 17 11:50:42 user nova-compute[73449]: DEBUG nova.compute.manager [None req-d332e30c-85e1-4130-a57c-2bcdddecf531 tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] [instance: 23ab9ffc-226d-4caa-8caa-9458de06a1c9] Instance event wait completed in 0 seconds for  {{(pid=73449) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 11:50:42 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-d332e30c-85e1-4130-a57c-2bcdddecf531 tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] [instance: 23ab9ffc-226d-4caa-8caa-9458de06a1c9] Guest created on hypervisor {{(pid=73449) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 11:50:42 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: 23ab9ffc-226d-4caa-8caa-9458de06a1c9] Instance spawned successfully.
Aug 17 11:50:42 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-d332e30c-85e1-4130-a57c-2bcdddecf531 tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] [instance: 23ab9ffc-226d-4caa-8caa-9458de06a1c9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 11:50:42 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 23ab9ffc-226d-4caa-8caa-9458de06a1c9] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:50:42 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 23ab9ffc-226d-4caa-8caa-9458de06a1c9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 11:50:42 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-d332e30c-85e1-4130-a57c-2bcdddecf531 tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] [instance: 23ab9ffc-226d-4caa-8caa-9458de06a1c9] Found default for hw_cdrom_bus of ide {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:50:42 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-d332e30c-85e1-4130-a57c-2bcdddecf531 tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] [instance: 23ab9ffc-226d-4caa-8caa-9458de06a1c9] Found default for hw_disk_bus of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:50:42 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-d332e30c-85e1-4130-a57c-2bcdddecf531 tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] [instance: 23ab9ffc-226d-4caa-8caa-9458de06a1c9] Found default for hw_input_bus of None {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:50:42 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-d332e30c-85e1-4130-a57c-2bcdddecf531 tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] [instance: 23ab9ffc-226d-4caa-8caa-9458de06a1c9] Found default for hw_pointer_model of None {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:50:42 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-d332e30c-85e1-4130-a57c-2bcdddecf531 tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] [instance: 23ab9ffc-226d-4caa-8caa-9458de06a1c9] Found default for hw_video_model of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:50:42 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-d332e30c-85e1-4130-a57c-2bcdddecf531 tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] [instance: 23ab9ffc-226d-4caa-8caa-9458de06a1c9] Found default for hw_vif_model of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:50:42 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 23ab9ffc-226d-4caa-8caa-9458de06a1c9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 11:50:42 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692273042.0954807, 23ab9ffc-226d-4caa-8caa-9458de06a1c9 => Started> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:50:42 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 23ab9ffc-226d-4caa-8caa-9458de06a1c9] VM Started (Lifecycle Event)
Aug 17 11:50:42 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 23ab9ffc-226d-4caa-8caa-9458de06a1c9] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:50:42 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 23ab9ffc-226d-4caa-8caa-9458de06a1c9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 11:50:42 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 23ab9ffc-226d-4caa-8caa-9458de06a1c9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 11:50:42 user nova-compute[73449]: INFO nova.compute.manager [None req-d332e30c-85e1-4130-a57c-2bcdddecf531 tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] [instance: 23ab9ffc-226d-4caa-8caa-9458de06a1c9] Took 7.36 seconds to spawn the instance on the hypervisor.
Aug 17 11:50:42 user nova-compute[73449]: DEBUG nova.compute.manager [None req-d332e30c-85e1-4130-a57c-2bcdddecf531 tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] [instance: 23ab9ffc-226d-4caa-8caa-9458de06a1c9] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:50:42 user nova-compute[73449]: INFO nova.compute.manager [None req-d332e30c-85e1-4130-a57c-2bcdddecf531 tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] [instance: 23ab9ffc-226d-4caa-8caa-9458de06a1c9] Took 8.61 seconds to build instance.
Aug 17 11:50:42 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-d332e30c-85e1-4130-a57c-2bcdddecf531 tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Lock "23ab9ffc-226d-4caa-8caa-9458de06a1c9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.749s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:50:42 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.441s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:50:42 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] <== connect_volume: return (1444ms) {'type': 'block', 'scsi_wwn': '26134303632396639', 'path': '/dev/sdb'} {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 11:50:42 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26134303632396639', 'path': '/dev/sdb'} {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 11:50:42 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:46:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1456627687',display_name='tempest-ServerActionsTestOtherB-server-1456627687',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1456627687',id=20,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNxG3No2zUVrbEXbRYCvyFo5zdmNWjUQ1w9Et6I/UYTR5GdEjRnJlmF8yAFQAym8G0hKrThB6Qoa83CCIr+oCSIdRZoU+FBKHtl3+QzEAuOyPVMVYrkASnAypoGWlwjgpQ==',key_name='tempest-keypair-1350250606',keypairs=<?>,launch_index=0,launched_at=2023-08-17T11:46:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4d6856b60c404a34b6355b5fd6dd7bb8',ramdisk_id='',reservation_id='r-2byzpdg1',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-108358124',owner_user_name='tempest-ServerActionsTestOtherB-108358124-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T11:50:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2791de1444c2428f9120cc907529cfcf',uuid=3d468854-6182-49c8-acb7-0641df2d5219,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1ec58d7f-18a4-4ddb-a137-2b72c5221621", "address": "fa:16:3e:8d:35:49", "network": {"id": "870c4b80-1ae0-4a10-89b8-ec734c66c244", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2050219794-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2050219794-network", "vif_mac": "fa:16:3e:8d:35:49"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d6856b60c404a34b6355b5fd6dd7bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec58d7f-18", "ovs_interfaceid": "1ec58d7f-18a4-4ddb-a137-2b72c5221621", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73449) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 11:50:42 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Converting VIF {"id": "1ec58d7f-18a4-4ddb-a137-2b72c5221621", "address": "fa:16:3e:8d:35:49", "network": {"id": "870c4b80-1ae0-4a10-89b8-ec734c66c244", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2050219794-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2050219794-network", "vif_mac": "fa:16:3e:8d:35:49"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d6856b60c404a34b6355b5fd6dd7bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec58d7f-18", "ovs_interfaceid": "1ec58d7f-18a4-4ddb-a137-2b72c5221621", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:50:42 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:35:49,bridge_name='br-int',has_traffic_filtering=True,id=1ec58d7f-18a4-4ddb-a137-2b72c5221621,network=Network(870c4b80-1ae0-4a10-89b8-ec734c66c244),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ec58d7f-18') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:50:42 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] End _get_guest_xml xml=<domain type="kvm">
Aug 17 11:50:42 user nova-compute[73449]:   <uuid>3d468854-6182-49c8-acb7-0641df2d5219</uuid>
Aug 17 11:50:42 user nova-compute[73449]:   <name>instance-00000014</name>
Aug 17 11:50:42 user nova-compute[73449]:   <memory>2097152</memory>
Aug 17 11:50:42 user nova-compute[73449]:   <vcpu>1</vcpu>
Aug 17 11:50:42 user nova-compute[73449]:   <metadata>
Aug 17 11:50:42 user nova-compute[73449]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 11:50:42 user nova-compute[73449]:       <nova:package version="0.0.0"/>
Aug 17 11:50:42 user nova-compute[73449]:       <nova:name>tempest-ServerActionsTestOtherB-server-1456627687</nova:name>
Aug 17 11:50:42 user nova-compute[73449]:       <nova:creationTime>2023-08-17 11:50:40</nova:creationTime>
Aug 17 11:50:42 user nova-compute[73449]:       <nova:flavor name="m1.small">
Aug 17 11:50:42 user nova-compute[73449]:         <nova:memory>2048</nova:memory>
Aug 17 11:50:42 user nova-compute[73449]:         <nova:disk>20</nova:disk>
Aug 17 11:50:42 user nova-compute[73449]:         <nova:swap>0</nova:swap>
Aug 17 11:50:42 user nova-compute[73449]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 11:50:42 user nova-compute[73449]:         <nova:vcpus>1</nova:vcpus>
Aug 17 11:50:42 user nova-compute[73449]:       </nova:flavor>
Aug 17 11:50:42 user nova-compute[73449]:       <nova:owner>
Aug 17 11:50:42 user nova-compute[73449]:         <nova:user uuid="2791de1444c2428f9120cc907529cfcf">tempest-ServerActionsTestOtherB-108358124-project-member</nova:user>
Aug 17 11:50:42 user nova-compute[73449]:         <nova:project uuid="4d6856b60c404a34b6355b5fd6dd7bb8">tempest-ServerActionsTestOtherB-108358124</nova:project>
Aug 17 11:50:42 user nova-compute[73449]:       </nova:owner>
Aug 17 11:50:42 user nova-compute[73449]:       <nova:root type="image" uuid="0a2904ae-083d-41c8-83db-343132b36148"/>
Aug 17 11:50:42 user nova-compute[73449]:       <nova:ports>
Aug 17 11:50:42 user nova-compute[73449]:         <nova:port uuid="1ec58d7f-18a4-4ddb-a137-2b72c5221621">
Aug 17 11:50:42 user nova-compute[73449]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 17 11:50:42 user nova-compute[73449]:         </nova:port>
Aug 17 11:50:42 user nova-compute[73449]:       </nova:ports>
Aug 17 11:50:42 user nova-compute[73449]:     </nova:instance>
Aug 17 11:50:42 user nova-compute[73449]:   </metadata>
Aug 17 11:50:42 user nova-compute[73449]:   <sysinfo type="smbios">
Aug 17 11:50:42 user nova-compute[73449]:     <system>
Aug 17 11:50:42 user nova-compute[73449]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 11:50:42 user nova-compute[73449]:       <entry name="product">OpenStack Nova</entry>
Aug 17 11:50:42 user nova-compute[73449]:       <entry name="version">0.0.0</entry>
Aug 17 11:50:42 user nova-compute[73449]:       <entry name="serial">3d468854-6182-49c8-acb7-0641df2d5219</entry>
Aug 17 11:50:42 user nova-compute[73449]:       <entry name="uuid">3d468854-6182-49c8-acb7-0641df2d5219</entry>
Aug 17 11:50:42 user nova-compute[73449]:       <entry name="family">Virtual Machine</entry>
Aug 17 11:50:42 user nova-compute[73449]:     </system>
Aug 17 11:50:42 user nova-compute[73449]:   </sysinfo>
Aug 17 11:50:42 user nova-compute[73449]:   <os>
Aug 17 11:50:42 user nova-compute[73449]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 11:50:42 user nova-compute[73449]:     <boot dev="hd"/>
Aug 17 11:50:42 user nova-compute[73449]:     <smbios mode="sysinfo"/>
Aug 17 11:50:42 user nova-compute[73449]:   </os>
Aug 17 11:50:42 user nova-compute[73449]:   <features>
Aug 17 11:50:42 user nova-compute[73449]:     <acpi/>
Aug 17 11:50:42 user nova-compute[73449]:     <apic/>
Aug 17 11:50:42 user nova-compute[73449]:     <vmcoreinfo/>
Aug 17 11:50:42 user nova-compute[73449]:   </features>
Aug 17 11:50:42 user nova-compute[73449]:   <clock offset="utc">
Aug 17 11:50:42 user nova-compute[73449]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 11:50:42 user nova-compute[73449]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 11:50:42 user nova-compute[73449]:     <timer name="hpet" present="no"/>
Aug 17 11:50:42 user nova-compute[73449]:   </clock>
Aug 17 11:50:42 user nova-compute[73449]:   <cpu mode="custom" match="exact">
Aug 17 11:50:42 user nova-compute[73449]:     <model>Nehalem</model>
Aug 17 11:50:42 user nova-compute[73449]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 11:50:42 user nova-compute[73449]:   </cpu>
Aug 17 11:50:42 user nova-compute[73449]:   <devices>
Aug 17 11:50:42 user nova-compute[73449]:     <disk type="file" device="disk">
Aug 17 11:50:42 user nova-compute[73449]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 11:50:42 user nova-compute[73449]:       <source file="/opt/stack/data/nova/instances/3d468854-6182-49c8-acb7-0641df2d5219/disk"/>
Aug 17 11:50:42 user nova-compute[73449]:       <target dev="vda" bus="virtio"/>
Aug 17 11:50:42 user nova-compute[73449]:     </disk>
Aug 17 11:50:42 user nova-compute[73449]:     <disk type="block" device="disk">
Aug 17 11:50:42 user nova-compute[73449]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 11:50:42 user nova-compute[73449]:       <source dev="/dev/sdb"/>
Aug 17 11:50:42 user nova-compute[73449]:       <target dev="vdb" bus="virtio"/>
Aug 17 11:50:42 user nova-compute[73449]:       <serial>040e2bc9-cd90-4010-9fdf-b7cc92b1c061</serial>
Aug 17 11:50:42 user nova-compute[73449]:     </disk>
Aug 17 11:50:42 user nova-compute[73449]:     <interface type="ethernet">
Aug 17 11:50:42 user nova-compute[73449]:       <mac address="fa:16:3e:8d:35:49"/>
Aug 17 11:50:42 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 11:50:42 user nova-compute[73449]:       <mtu size="1442"/>
Aug 17 11:50:42 user nova-compute[73449]:       <target dev="tap1ec58d7f-18"/>
Aug 17 11:50:42 user nova-compute[73449]:     </interface>
Aug 17 11:50:42 user nova-compute[73449]:     <serial type="pty">
Aug 17 11:50:42 user nova-compute[73449]:       <log file="/opt/stack/data/nova/instances/3d468854-6182-49c8-acb7-0641df2d5219/console.log" append="off"/>
Aug 17 11:50:42 user nova-compute[73449]:     </serial>
Aug 17 11:50:42 user nova-compute[73449]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 11:50:42 user nova-compute[73449]:     <video>
Aug 17 11:50:42 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 11:50:42 user nova-compute[73449]:     </video>
Aug 17 11:50:42 user nova-compute[73449]:     <rng model="virtio">
Aug 17 11:50:42 user nova-compute[73449]:       <backend model="random">/dev/urandom</backend>
Aug 17 11:50:42 user nova-compute[73449]:     </rng>
Aug 17 11:50:42 user nova-compute[73449]:     <controller type="usb" index="0" model="none"/>
Aug 17 11:50:42 user nova-compute[73449]:     <memballoon model="virtio">
Aug 17 11:50:42 user nova-compute[73449]:       <stats period="10"/>
Aug 17 11:50:42 user nova-compute[73449]:     </memballoon>
Aug 17 11:50:42 user nova-compute[73449]:   </devices>
Aug 17 11:50:42 user nova-compute[73449]: </domain>
Aug 17 11:50:42 user nova-compute[73449]:  {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 11:50:42 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:46:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1456627687',display_name='tempest-ServerActionsTestOtherB-server-1456627687',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1456627687',id=20,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNxG3No2zUVrbEXbRYCvyFo5zdmNWjUQ1w9Et6I/UYTR5GdEjRnJlmF8yAFQAym8G0hKrThB6Qoa83CCIr+oCSIdRZoU+FBKHtl3+QzEAuOyPVMVYrkASnAypoGWlwjgpQ==',key_name='tempest-keypair-1350250606',keypairs=<?>,launch_index=0,launched_at=2023-08-17T11:46:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4d6856b60c404a34b6355b5fd6dd7bb8',ramdisk_id='',reservation_id='r-2byzpdg1',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-108358124',owner_user_name='tempest-ServerActionsTestOtherB-108358124-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T11:50:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2791de1444c2428f9120cc907529cfcf',uuid=3d468854-6182-49c8-acb7-0641df2d5219,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1ec58d7f-18a4-4ddb-a137-2b72c5221621", "address": "fa:16:3e:8d:35:49", "network": {"id": "870c4b80-1ae0-4a10-89b8-ec734c66c244", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2050219794-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2050219794-network", "vif_mac": "fa:16:3e:8d:35:49"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d6856b60c404a34b6355b5fd6dd7bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec58d7f-18", "ovs_interfaceid": "1ec58d7f-18a4-4ddb-a137-2b72c5221621", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 11:50:42 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Converting VIF {"id": "1ec58d7f-18a4-4ddb-a137-2b72c5221621", "address": "fa:16:3e:8d:35:49", "network": {"id": "870c4b80-1ae0-4a10-89b8-ec734c66c244", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2050219794-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2050219794-network", "vif_mac": "fa:16:3e:8d:35:49"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d6856b60c404a34b6355b5fd6dd7bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec58d7f-18", "ovs_interfaceid": "1ec58d7f-18a4-4ddb-a137-2b72c5221621", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:50:42 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:35:49,bridge_name='br-int',has_traffic_filtering=True,id=1ec58d7f-18a4-4ddb-a137-2b72c5221621,network=Network(870c4b80-1ae0-4a10-89b8-ec734c66c244),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ec58d7f-18') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:50:42 user nova-compute[73449]: DEBUG os_vif [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:35:49,bridge_name='br-int',has_traffic_filtering=True,id=1ec58d7f-18a4-4ddb-a137-2b72c5221621,network=Network(870c4b80-1ae0-4a10-89b8-ec734c66c244),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ec58d7f-18') {{(pid=73449) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 11:50:42 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:50:42 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:50:42 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 11:50:42 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:50:42 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1ec58d7f-18, may_exist=True, interface_attrs={}) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:50:42 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1ec58d7f-18, col_values=(('external_ids', {'iface-id': '1ec58d7f-18a4-4ddb-a137-2b72c5221621', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8d:35:49', 'vm-uuid': '3d468854-6182-49c8-acb7-0641df2d5219'}),), if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:50:42 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:50:42 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:50:42 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:50:42 user nova-compute[73449]: INFO os_vif [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:35:49,bridge_name='br-int',has_traffic_filtering=True,id=1ec58d7f-18a4-4ddb-a137-2b72c5221621,network=Network(870c4b80-1ae0-4a10-89b8-ec734c66c244),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ec58d7f-18')
Aug 17 11:50:42 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] No BDM found with device name vda, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 11:50:42 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 11:50:42 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] No VIF found with MAC fa:16:3e:8d:35:49, not building metadata {{(pid=73449) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 11:50:43 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:50:43 user nova-compute[73449]: DEBUG nova.compute.manager [req-d5b18add-2242-47d5-b815-783450108fbe req-1813a6d8-8dd5-4bdc-a9e7-2bae2f0c860a service nova] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] Received event network-vif-plugged-a0e89b76-95af-4e50-a972-b223cc5b3cab {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:50:43 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-d5b18add-2242-47d5-b815-783450108fbe req-1813a6d8-8dd5-4bdc-a9e7-2bae2f0c860a service nova] Acquiring lock "3d74c8f6-fb4e-4460-b722-674a8a1e2d25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:50:43 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-d5b18add-2242-47d5-b815-783450108fbe req-1813a6d8-8dd5-4bdc-a9e7-2bae2f0c860a service nova] Lock "3d74c8f6-fb4e-4460-b722-674a8a1e2d25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:50:43 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-d5b18add-2242-47d5-b815-783450108fbe req-1813a6d8-8dd5-4bdc-a9e7-2bae2f0c860a service nova] Lock "3d74c8f6-fb4e-4460-b722-674a8a1e2d25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:50:43 user nova-compute[73449]: DEBUG nova.compute.manager [req-d5b18add-2242-47d5-b815-783450108fbe req-1813a6d8-8dd5-4bdc-a9e7-2bae2f0c860a service nova] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] No waiting events found dispatching network-vif-plugged-a0e89b76-95af-4e50-a972-b223cc5b3cab {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:50:43 user nova-compute[73449]: WARNING nova.compute.manager [req-d5b18add-2242-47d5-b815-783450108fbe req-1813a6d8-8dd5-4bdc-a9e7-2bae2f0c860a service nova] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] Received unexpected event network-vif-plugged-a0e89b76-95af-4e50-a972-b223cc5b3cab for instance with vm_state active and task_state rescuing.
Aug 17 11:50:43 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-678756a8-0736-4c0f-9805-864bcd3ae646 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Acquiring lock "refresh_cache-5612f7d1-a901-4bdd-a24a-faf9a980cd04" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:50:43 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-678756a8-0736-4c0f-9805-864bcd3ae646 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Acquired lock "refresh_cache-5612f7d1-a901-4bdd-a24a-faf9a980cd04" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:50:43 user nova-compute[73449]: DEBUG nova.network.neutron [None req-678756a8-0736-4c0f-9805-864bcd3ae646 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Building network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 11:50:43 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:50:44 user nova-compute[73449]: DEBUG nova.network.neutron [None req-678756a8-0736-4c0f-9805-864bcd3ae646 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Updating instance_info_cache with network_info: [{"id": "599e177a-d05b-4d24-8c89-8a868182940c", "address": "fa:16:3e:8d:36:ef", "network": {"id": "41adee44-4e1c-4cc6-aa63-8054da5d97b4", "bridge": "br-int", "label": "tempest-TestShelveInstance-1953236522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b906d3cc3acb46818cd2c9583f351893", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap599e177a-d0", "ovs_interfaceid": "599e177a-d05b-4d24-8c89-8a868182940c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:50:44 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-678756a8-0736-4c0f-9805-864bcd3ae646 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Releasing lock "refresh_cache-5612f7d1-a901-4bdd-a24a-faf9a980cd04" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:50:44 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-678756a8-0736-4c0f-9805-864bcd3ae646 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Creating instance directory {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 11:50:44 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-678756a8-0736-4c0f-9805-864bcd3ae646 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Creating image(s)
Aug 17 11:50:44 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-678756a8-0736-4c0f-9805-864bcd3ae646 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Did not create local disks {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 11:50:44 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-678756a8-0736-4c0f-9805-864bcd3ae646 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Ensure instance console log exists: /opt/stack/data/nova/instances/5612f7d1-a901-4bdd-a24a-faf9a980cd04/console.log {{(pid=73449) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 11:50:44 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-678756a8-0736-4c0f-9805-864bcd3ae646 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:50:44 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-678756a8-0736-4c0f-9805-864bcd3ae646 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:50:44 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-678756a8-0736-4c0f-9805-864bcd3ae646 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:50:44 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-678756a8-0736-4c0f-9805-864bcd3ae646 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Start _get_guest_xml network_info=[{"id": "599e177a-d05b-4d24-8c89-8a868182940c", "address": "fa:16:3e:8d:36:ef", "network": {"id": "41adee44-4e1c-4cc6-aa63-8054da5d97b4", "bridge": "br-int", "label": "tempest-TestShelveInstance-1953236522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b906d3cc3acb46818cd2c9583f351893", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap599e177a-d0", "ovs_interfaceid": "599e177a-d05b-4d24-8c89-8a868182940c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'attachment_id': '0ba2b424-652a-40be-827a-6ba0b6fc384f', 'boot_index': 0, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zWFHJgbD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5612f7d1-a901-4bdd-a24a-faf9a980cd04', 'attached_at': '', 'detached_at': '', 'volume_id': 'fc3c38dd-5692-448f-b1fc-b8fe08052611', 'serial': 'fc3c38dd-5692-448f-b1fc-b8fe08052611'}, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 11:50:44 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-678756a8-0736-4c0f-9805-864bcd3ae646 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:50:44 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-678756a8-0736-4c0f-9805-864bcd3ae646 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:50:44 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-678756a8-0736-4c0f-9805-864bcd3ae646 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 11:50:44 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-678756a8-0736-4c0f-9805-864bcd3ae646 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] CPU controller missing on host. {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 11:50:44 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-678756a8-0736-4c0f-9805-864bcd3ae646 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 11:50:44 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-678756a8-0736-4c0f-9805-864bcd3ae646 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] CPU controller found on host. {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 11:50:44 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-678756a8-0736-4c0f-9805-864bcd3ae646 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73449) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 11:50:44 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-678756a8-0736-4c0f-9805-864bcd3ae646 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T11:35:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 11:50:44 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-678756a8-0736-4c0f-9805-864bcd3ae646 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Flavor limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 11:50:44 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-678756a8-0736-4c0f-9805-864bcd3ae646 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Image limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 11:50:44 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-678756a8-0736-4c0f-9805-864bcd3ae646 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Flavor pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 11:50:44 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-678756a8-0736-4c0f-9805-864bcd3ae646 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Image pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 11:50:44 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-678756a8-0736-4c0f-9805-864bcd3ae646 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 11:50:44 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-678756a8-0736-4c0f-9805-864bcd3ae646 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 11:50:44 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-678756a8-0736-4c0f-9805-864bcd3ae646 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 11:50:44 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-678756a8-0736-4c0f-9805-864bcd3ae646 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Got 1 possible topologies {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 11:50:44 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-678756a8-0736-4c0f-9805-864bcd3ae646 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 11:50:44 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-678756a8-0736-4c0f-9805-864bcd3ae646 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 11:50:44 user nova-compute[73449]: DEBUG nova.objects.instance [None req-678756a8-0736-4c0f-9805-864bcd3ae646 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5612f7d1-a901-4bdd-a24a-faf9a980cd04 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:50:44 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-678756a8-0736-4c0f-9805-864bcd3ae646 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Calling os-brick to attach iSCSI Volume {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 11:50:44 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-678756a8-0736-4c0f-9805-864bcd3ae646 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zWFHJgbD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 11:50:44 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-678756a8-0736-4c0f-9805-864bcd3ae646 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 11:50:44 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-678756a8-0736-4c0f-9805-864bcd3ae646 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:50:44 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-678756a8-0736-4c0f-9805-864bcd3ae646 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:50:44 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-678756a8-0736-4c0f-9805-864bcd3ae646 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 11:50:44 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-678756a8-0736-4c0f-9805-864bcd3ae646 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:50:44 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-678756a8-0736-4c0f-9805-864bcd3ae646 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:50:44 user nova-compute[73449]: INFO os_brick.initiator.connectors.iscsi [None req-678756a8-0736-4c0f-9805-864bcd3ae646 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 11:50:44 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611 -p 172.16.0.220:3260 {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:50:44 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:50:44 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c54a67a-9ac4-4436-9628-7722af796475]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:50:44 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-678756a8-0736-4c0f-9805-864bcd3ae646 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 11:50:44 user nova-compute[73449]:  {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:50:44 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611 -p 172.16.0.220:3260 --interface default --op new {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:50:44 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.045s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:50:44 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3604d49-1722-47c0-bae8-4e629a7d39fa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611] added\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:50:44 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-678756a8-0736-4c0f-9805-864bcd3ae646 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611] added
Aug 17 11:50:44 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:50:44 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:50:44 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:50:44 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[12954d79-3d8e-43a1-827e-e110ba2b5f79]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:50:44 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-678756a8-0736-4c0f-9805-864bcd3ae646 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:50:44 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:50:44 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:50:44 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[db170c3a-0587-42ee-b75c-c2c48b962b37]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:50:44 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-678756a8-0736-4c0f-9805-864bcd3ae646 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:50:44 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zWFHJgbD {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:50:44 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zWFHJgbD" returned: 0 in 0.028s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:50:44 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c4c5180-4657-4d54-a79a-83a5264d83ff]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:50:44 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-678756a8-0736-4c0f-9805-864bcd3ae646 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zWFHJgbD'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:50:44 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:50:44 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:50:44 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[34b9e5f4-9092-4e8d-ba8e-70cf9590249a]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:50:44 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-678756a8-0736-4c0f-9805-864bcd3ae646 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:50:44 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:50:44 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:50:44 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[d40930f0-97aa-44c2-b4de-d274230383be]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:50:44 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-678756a8-0736-4c0f-9805-864bcd3ae646 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe (non-flash)
Aug 17 11:50:44 user nova-compute[73449]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 (non-flash)
Aug 17 11:50:44 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:50:44 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-678756a8-0736-4c0f-9805-864bcd3ae646 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe (non-flash)
Aug 17 11:50:44 user nova-compute[73449]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 (non-flash)
Aug 17 11:50:44 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:50:44 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611 -p 172.16.0.220:3260 --login {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:50:44 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:50:44 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:50:44 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611 -p 172.16.0.220:3260 --login" returned: 0 in 0.108s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:50:44 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[a85a4a5e-2a56-487f-9cd6-0901c841a85d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:50:44 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-678756a8-0736-4c0f-9805-864bcd3ae646 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611, portal: 172.16.0.220,3260]
Aug 17 11:50:44 user nova-compute[73449]: Login to [iface: default, target: iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611, portal: 172.16.0.220,3260] successful.
Aug 17 11:50:44 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:50:44 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:50:44 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:50:44 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:50:44 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.035s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:50:44 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca99d67b-28cf-4ad9-b980-acadb59ab8d4]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:50:44 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-678756a8-0736-4c0f-9805-864bcd3ae646 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:50:44 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:50:45 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:50:45 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[f225fedd-51eb-4e9f-a4fb-685cdc4e3292]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611 (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:50:45 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-678756a8-0736-4c0f-9805-864bcd3ae646 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe (non-flash)
Aug 17 11:50:45 user nova-compute[73449]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 (non-flash)
Aug 17 11:50:45 user nova-compute[73449]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611 (non-flash)
Aug 17 11:50:45 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:50:45 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-678756a8-0736-4c0f-9805-864bcd3ae646 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe (non-flash)
Aug 17 11:50:45 user nova-compute[73449]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 (non-flash)
Aug 17 11:50:45 user nova-compute[73449]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611 (non-flash)
Aug 17 11:50:45 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:50:45 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-678756a8-0736-4c0f-9805-864bcd3ae646 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.456s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:50:45 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-678756a8-0736-4c0f-9805-864bcd3ae646 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Connected to 172.16.0.220:3260 {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 11:50:45 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-678756a8-0736-4c0f-9805-864bcd3ae646 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] HCTL ('34', '-', '-', 0) found on session 30 with lun 0 {{(pid=73449) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 11:50:45 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-678756a8-0736-4c0f-9805-864bcd3ae646 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73449) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 11:50:45 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:50:45 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.029s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:50:45 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[77ddf67e-4f65-4209-b0c7-942ef0ce7e4f]: (4, ('- - 0', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:50:45 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-678756a8-0736-4c0f-9805-864bcd3ae646 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Searching for a device in session 30 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73449) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 11:50:45 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-678756a8-0736-4c0f-9805-864bcd3ae646 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zWFHJgbD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 11:50:45 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:50:45 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:50:45 user nova-compute[73449]: DEBUG nova.compute.manager [req-f2860daf-9d83-4b2c-964d-c1da5d483a3c req-175e7790-236b-4190-a8e7-c7ee480639c4 service nova] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Received event network-changed-599e177a-d05b-4d24-8c89-8a868182940c {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:50:45 user nova-compute[73449]: DEBUG nova.compute.manager [req-f2860daf-9d83-4b2c-964d-c1da5d483a3c req-175e7790-236b-4190-a8e7-c7ee480639c4 service nova] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Refreshing instance network info cache due to event network-changed-599e177a-d05b-4d24-8c89-8a868182940c. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 11:50:45 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-f2860daf-9d83-4b2c-964d-c1da5d483a3c req-175e7790-236b-4190-a8e7-c7ee480639c4 service nova] Acquiring lock "refresh_cache-5612f7d1-a901-4bdd-a24a-faf9a980cd04" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:50:45 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-f2860daf-9d83-4b2c-964d-c1da5d483a3c req-175e7790-236b-4190-a8e7-c7ee480639c4 service nova] Acquired lock "refresh_cache-5612f7d1-a901-4bdd-a24a-faf9a980cd04" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:50:45 user nova-compute[73449]: DEBUG nova.network.neutron [req-f2860daf-9d83-4b2c-964d-c1da5d483a3c req-175e7790-236b-4190-a8e7-c7ee480639c4 service nova] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Refreshing network info cache for port 599e177a-d05b-4d24-8c89-8a868182940c {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 11:50:45 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:50:45 user nova-compute[73449]: DEBUG nova.compute.manager [req-424e867e-f8e3-40d5-a60d-8584646116c0 req-ceb34606-945e-4da2-9623-3d8e793a0c53 service nova] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Received event network-vif-plugged-1ec58d7f-18a4-4ddb-a137-2b72c5221621 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:50:45 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-424e867e-f8e3-40d5-a60d-8584646116c0 req-ceb34606-945e-4da2-9623-3d8e793a0c53 service nova] Acquiring lock "3d468854-6182-49c8-acb7-0641df2d5219-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:50:45 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-424e867e-f8e3-40d5-a60d-8584646116c0 req-ceb34606-945e-4da2-9623-3d8e793a0c53 service nova] Lock "3d468854-6182-49c8-acb7-0641df2d5219-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:50:45 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-424e867e-f8e3-40d5-a60d-8584646116c0 req-ceb34606-945e-4da2-9623-3d8e793a0c53 service nova] Lock "3d468854-6182-49c8-acb7-0641df2d5219-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:50:45 user nova-compute[73449]: DEBUG nova.compute.manager [req-424e867e-f8e3-40d5-a60d-8584646116c0 req-ceb34606-945e-4da2-9623-3d8e793a0c53 service nova] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] No waiting events found dispatching network-vif-plugged-1ec58d7f-18a4-4ddb-a137-2b72c5221621 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:50:45 user nova-compute[73449]: WARNING nova.compute.manager [req-424e867e-f8e3-40d5-a60d-8584646116c0 req-ceb34606-945e-4da2-9623-3d8e793a0c53 service nova] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Received unexpected event network-vif-plugged-1ec58d7f-18a4-4ddb-a137-2b72c5221621 for instance with vm_state active and task_state resize_finish.
Aug 17 11:50:46 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-678756a8-0736-4c0f-9805-864bcd3ae646 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.515s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:50:46 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-678756a8-0736-4c0f-9805-864bcd3ae646 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] <== connect_volume: return (1517ms) {'type': 'block', 'scsi_wwn': '23738386630383739', 'path': '/dev/sdc'} {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 11:50:46 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-678756a8-0736-4c0f-9805-864bcd3ae646 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23738386630383739', 'path': '/dev/sdc'} {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 11:50:46 user nova-compute[73449]: DEBUG nova.network.neutron [req-f2860daf-9d83-4b2c-964d-c1da5d483a3c req-175e7790-236b-4190-a8e7-c7ee480639c4 service nova] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Updated VIF entry in instance network info cache for port 599e177a-d05b-4d24-8c89-8a868182940c. {{(pid=73449) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 11:50:46 user nova-compute[73449]: DEBUG nova.network.neutron [req-f2860daf-9d83-4b2c-964d-c1da5d483a3c req-175e7790-236b-4190-a8e7-c7ee480639c4 service nova] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Updating instance_info_cache with network_info: [{"id": "599e177a-d05b-4d24-8c89-8a868182940c", "address": "fa:16:3e:8d:36:ef", "network": {"id": "41adee44-4e1c-4cc6-aa63-8054da5d97b4", "bridge": "br-int", "label": "tempest-TestShelveInstance-1953236522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b906d3cc3acb46818cd2c9583f351893", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap599e177a-d0", "ovs_interfaceid": "599e177a-d05b-4d24-8c89-8a868182940c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:50:46 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-678756a8-0736-4c0f-9805-864bcd3ae646 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T11:46:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1849786392',display_name='tempest-TestShelveInstance-server-1849786392',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1849786392',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1460867700',keypairs=<?>,launch_index=0,launched_at=2023-08-17T11:46:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='b906d3cc3acb46818cd2c9583f351893',ramdisk_id='',reservation_id='r-6d1v12wz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-917557205',owner_user_name='tempest-TestShelveInstance-917557205-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T11:50:27Z,user_data=None,user_id='db7e0b2abd4b4df3b2e7886ddc3840c0',uuid=5612f7d1-a901-4bdd-a24a-faf9a980cd04,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "599e177a-d05b-4d24-8c89-8a868182940c", "address": "fa:16:3e:8d:36:ef", "network": {"id": "41adee44-4e1c-4cc6-aa63-8054da5d97b4", "bridge": "br-int", "label": "tempest-TestShelveInstance-1953236522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b906d3cc3acb46818cd2c9583f351893", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap599e177a-d0", "ovs_interfaceid": "599e177a-d05b-4d24-8c89-8a868182940c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73449) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 11:50:46 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-678756a8-0736-4c0f-9805-864bcd3ae646 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Converting VIF {"id": "599e177a-d05b-4d24-8c89-8a868182940c", "address": "fa:16:3e:8d:36:ef", "network": {"id": "41adee44-4e1c-4cc6-aa63-8054da5d97b4", "bridge": "br-int", "label": "tempest-TestShelveInstance-1953236522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b906d3cc3acb46818cd2c9583f351893", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap599e177a-d0", "ovs_interfaceid": "599e177a-d05b-4d24-8c89-8a868182940c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:50:46 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-678756a8-0736-4c0f-9805-864bcd3ae646 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:36:ef,bridge_name='br-int',has_traffic_filtering=True,id=599e177a-d05b-4d24-8c89-8a868182940c,network=Network(41adee44-4e1c-4cc6-aa63-8054da5d97b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap599e177a-d0') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:50:46 user nova-compute[73449]: DEBUG nova.objects.instance [None req-678756a8-0736-4c0f-9805-864bcd3ae646 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Lazy-loading 'pci_devices' on Instance uuid 5612f7d1-a901-4bdd-a24a-faf9a980cd04 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:50:46 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-f2860daf-9d83-4b2c-964d-c1da5d483a3c req-175e7790-236b-4190-a8e7-c7ee480639c4 service nova] Releasing lock "refresh_cache-5612f7d1-a901-4bdd-a24a-faf9a980cd04" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:50:46 user nova-compute[73449]: DEBUG nova.compute.manager [req-f2860daf-9d83-4b2c-964d-c1da5d483a3c req-175e7790-236b-4190-a8e7-c7ee480639c4 service nova] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] Received event network-vif-plugged-a0e89b76-95af-4e50-a972-b223cc5b3cab {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:50:46 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-f2860daf-9d83-4b2c-964d-c1da5d483a3c req-175e7790-236b-4190-a8e7-c7ee480639c4 service nova] Acquiring lock "3d74c8f6-fb4e-4460-b722-674a8a1e2d25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:50:46 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-f2860daf-9d83-4b2c-964d-c1da5d483a3c req-175e7790-236b-4190-a8e7-c7ee480639c4 service nova] Lock "3d74c8f6-fb4e-4460-b722-674a8a1e2d25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:50:46 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-f2860daf-9d83-4b2c-964d-c1da5d483a3c req-175e7790-236b-4190-a8e7-c7ee480639c4 service nova] Lock "3d74c8f6-fb4e-4460-b722-674a8a1e2d25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:50:46 user nova-compute[73449]: DEBUG nova.compute.manager [req-f2860daf-9d83-4b2c-964d-c1da5d483a3c req-175e7790-236b-4190-a8e7-c7ee480639c4 service nova] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] No waiting events found dispatching network-vif-plugged-a0e89b76-95af-4e50-a972-b223cc5b3cab {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:50:46 user nova-compute[73449]: WARNING nova.compute.manager [req-f2860daf-9d83-4b2c-964d-c1da5d483a3c req-175e7790-236b-4190-a8e7-c7ee480639c4 service nova] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] Received unexpected event network-vif-plugged-a0e89b76-95af-4e50-a972-b223cc5b3cab for instance with vm_state active and task_state rescuing.
Aug 17 11:50:46 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-678756a8-0736-4c0f-9805-864bcd3ae646 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] End _get_guest_xml xml=<domain type="kvm">
Aug 17 11:50:46 user nova-compute[73449]:   <uuid>5612f7d1-a901-4bdd-a24a-faf9a980cd04</uuid>
Aug 17 11:50:46 user nova-compute[73449]:   <name>instance-00000015</name>
Aug 17 11:50:46 user nova-compute[73449]:   <memory>524288</memory>
Aug 17 11:50:46 user nova-compute[73449]:   <vcpu>1</vcpu>
Aug 17 11:50:46 user nova-compute[73449]:   <metadata>
Aug 17 11:50:46 user nova-compute[73449]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 11:50:46 user nova-compute[73449]:       <nova:package version="0.0.0"/>
Aug 17 11:50:46 user nova-compute[73449]:       <nova:name>tempest-TestShelveInstance-server-1849786392</nova:name>
Aug 17 11:50:46 user nova-compute[73449]:       <nova:creationTime>2023-08-17 11:50:44</nova:creationTime>
Aug 17 11:50:46 user nova-compute[73449]:       <nova:flavor name="m1.tiny">
Aug 17 11:50:46 user nova-compute[73449]:         <nova:memory>512</nova:memory>
Aug 17 11:50:46 user nova-compute[73449]:         <nova:disk>1</nova:disk>
Aug 17 11:50:46 user nova-compute[73449]:         <nova:swap>0</nova:swap>
Aug 17 11:50:46 user nova-compute[73449]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 11:50:46 user nova-compute[73449]:         <nova:vcpus>1</nova:vcpus>
Aug 17 11:50:46 user nova-compute[73449]:       </nova:flavor>
Aug 17 11:50:46 user nova-compute[73449]:       <nova:owner>
Aug 17 11:50:46 user nova-compute[73449]:         <nova:user uuid="db7e0b2abd4b4df3b2e7886ddc3840c0">tempest-TestShelveInstance-917557205-project-member</nova:user>
Aug 17 11:50:46 user nova-compute[73449]:         <nova:project uuid="b906d3cc3acb46818cd2c9583f351893">tempest-TestShelveInstance-917557205</nova:project>
Aug 17 11:50:46 user nova-compute[73449]:       </nova:owner>
Aug 17 11:50:46 user nova-compute[73449]:       <nova:ports>
Aug 17 11:50:46 user nova-compute[73449]:         <nova:port uuid="599e177a-d05b-4d24-8c89-8a868182940c">
Aug 17 11:50:46 user nova-compute[73449]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 17 11:50:46 user nova-compute[73449]:         </nova:port>
Aug 17 11:50:46 user nova-compute[73449]:       </nova:ports>
Aug 17 11:50:46 user nova-compute[73449]:     </nova:instance>
Aug 17 11:50:46 user nova-compute[73449]:   </metadata>
Aug 17 11:50:46 user nova-compute[73449]:   <sysinfo type="smbios">
Aug 17 11:50:46 user nova-compute[73449]:     <system>
Aug 17 11:50:46 user nova-compute[73449]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 11:50:46 user nova-compute[73449]:       <entry name="product">OpenStack Nova</entry>
Aug 17 11:50:46 user nova-compute[73449]:       <entry name="version">0.0.0</entry>
Aug 17 11:50:46 user nova-compute[73449]:       <entry name="serial">5612f7d1-a901-4bdd-a24a-faf9a980cd04</entry>
Aug 17 11:50:46 user nova-compute[73449]:       <entry name="uuid">5612f7d1-a901-4bdd-a24a-faf9a980cd04</entry>
Aug 17 11:50:46 user nova-compute[73449]:       <entry name="family">Virtual Machine</entry>
Aug 17 11:50:46 user nova-compute[73449]:     </system>
Aug 17 11:50:46 user nova-compute[73449]:   </sysinfo>
Aug 17 11:50:46 user nova-compute[73449]:   <os>
Aug 17 11:50:46 user nova-compute[73449]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 11:50:46 user nova-compute[73449]:     <boot dev="hd"/>
Aug 17 11:50:46 user nova-compute[73449]:     <smbios mode="sysinfo"/>
Aug 17 11:50:46 user nova-compute[73449]:   </os>
Aug 17 11:50:46 user nova-compute[73449]:   <features>
Aug 17 11:50:46 user nova-compute[73449]:     <acpi/>
Aug 17 11:50:46 user nova-compute[73449]:     <apic/>
Aug 17 11:50:46 user nova-compute[73449]:     <vmcoreinfo/>
Aug 17 11:50:46 user nova-compute[73449]:   </features>
Aug 17 11:50:46 user nova-compute[73449]:   <clock offset="utc">
Aug 17 11:50:46 user nova-compute[73449]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 11:50:46 user nova-compute[73449]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 11:50:46 user nova-compute[73449]:     <timer name="hpet" present="no"/>
Aug 17 11:50:46 user nova-compute[73449]:   </clock>
Aug 17 11:50:46 user nova-compute[73449]:   <cpu mode="custom" match="exact">
Aug 17 11:50:46 user nova-compute[73449]:     <model>Nehalem</model>
Aug 17 11:50:46 user nova-compute[73449]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 11:50:46 user nova-compute[73449]:   </cpu>
Aug 17 11:50:46 user nova-compute[73449]:   <devices>
Aug 17 11:50:46 user nova-compute[73449]:     <disk type="block" device="disk">
Aug 17 11:50:46 user nova-compute[73449]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 11:50:46 user nova-compute[73449]:       <source dev="/dev/sdc"/>
Aug 17 11:50:46 user nova-compute[73449]:       <target dev="vda" bus="virtio"/>
Aug 17 11:50:46 user nova-compute[73449]:       <serial>fc3c38dd-5692-448f-b1fc-b8fe08052611</serial>
Aug 17 11:50:46 user nova-compute[73449]:     </disk>
Aug 17 11:50:46 user nova-compute[73449]:     <interface type="ethernet">
Aug 17 11:50:46 user nova-compute[73449]:       <mac address="fa:16:3e:8d:36:ef"/>
Aug 17 11:50:46 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 11:50:46 user nova-compute[73449]:       <mtu size="1442"/>
Aug 17 11:50:46 user nova-compute[73449]:       <target dev="tap599e177a-d0"/>
Aug 17 11:50:46 user nova-compute[73449]:     </interface>
Aug 17 11:50:46 user nova-compute[73449]:     <serial type="pty">
Aug 17 11:50:46 user nova-compute[73449]:       <log file="/opt/stack/data/nova/instances/5612f7d1-a901-4bdd-a24a-faf9a980cd04/console.log" append="off"/>
Aug 17 11:50:46 user nova-compute[73449]:     </serial>
Aug 17 11:50:46 user nova-compute[73449]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 11:50:46 user nova-compute[73449]:     <video>
Aug 17 11:50:46 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 11:50:46 user nova-compute[73449]:     </video>
Aug 17 11:50:46 user nova-compute[73449]:     <rng model="virtio">
Aug 17 11:50:46 user nova-compute[73449]:       <backend model="random">/dev/urandom</backend>
Aug 17 11:50:46 user nova-compute[73449]:     </rng>
Aug 17 11:50:46 user nova-compute[73449]:     <controller type="usb" index="0" model="none"/>
Aug 17 11:50:46 user nova-compute[73449]:     <memballoon model="virtio">
Aug 17 11:50:46 user nova-compute[73449]:       <stats period="10"/>
Aug 17 11:50:46 user nova-compute[73449]:     </memballoon>
Aug 17 11:50:46 user nova-compute[73449]:   </devices>
Aug 17 11:50:46 user nova-compute[73449]: </domain>
Aug 17 11:50:46 user nova-compute[73449]:  {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 11:50:46 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-678756a8-0736-4c0f-9805-864bcd3ae646 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T11:46:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1849786392',display_name='tempest-TestShelveInstance-server-1849786392',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1849786392',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1460867700',keypairs=<?>,launch_index=0,launched_at=2023-08-17T11:46:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='b906d3cc3acb46818cd2c9583f351893',ramdisk_id='',reservation_id='r-6d1v12wz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-917557205',owner_user_name='tempest-TestShelveInstance-917557205-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T11:50:27Z,user_data=None,user_id='db7e0b2abd4b4df3b2e7886ddc3840c0',uuid=5612f7d1-a901-4bdd-a24a-faf9a980cd04,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "599e177a-d05b-4d24-8c89-8a868182940c", "address": "fa:16:3e:8d:36:ef", "network": {"id": "41adee44-4e1c-4cc6-aa63-8054da5d97b4", "bridge": "br-int", "label": "tempest-TestShelveInstance-1953236522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b906d3cc3acb46818cd2c9583f351893", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap599e177a-d0", "ovs_interfaceid": "599e177a-d05b-4d24-8c89-8a868182940c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 11:50:46 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-678756a8-0736-4c0f-9805-864bcd3ae646 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Converting VIF {"id": "599e177a-d05b-4d24-8c89-8a868182940c", "address": "fa:16:3e:8d:36:ef", "network": {"id": "41adee44-4e1c-4cc6-aa63-8054da5d97b4", "bridge": "br-int", "label": "tempest-TestShelveInstance-1953236522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b906d3cc3acb46818cd2c9583f351893", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap599e177a-d0", "ovs_interfaceid": "599e177a-d05b-4d24-8c89-8a868182940c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:50:46 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-678756a8-0736-4c0f-9805-864bcd3ae646 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:36:ef,bridge_name='br-int',has_traffic_filtering=True,id=599e177a-d05b-4d24-8c89-8a868182940c,network=Network(41adee44-4e1c-4cc6-aa63-8054da5d97b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap599e177a-d0') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:50:46 user nova-compute[73449]: DEBUG os_vif [None req-678756a8-0736-4c0f-9805-864bcd3ae646 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:36:ef,bridge_name='br-int',has_traffic_filtering=True,id=599e177a-d05b-4d24-8c89-8a868182940c,network=Network(41adee44-4e1c-4cc6-aa63-8054da5d97b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap599e177a-d0') {{(pid=73449) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 11:50:46 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:50:46 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:50:46 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 11:50:46 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:50:46 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap599e177a-d0, may_exist=True, interface_attrs={}) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:50:46 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap599e177a-d0, col_values=(('external_ids', {'iface-id': '599e177a-d05b-4d24-8c89-8a868182940c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8d:36:ef', 'vm-uuid': '5612f7d1-a901-4bdd-a24a-faf9a980cd04'}),), if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:50:46 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:50:46 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:50:46 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:50:46 user nova-compute[73449]: INFO os_vif [None req-678756a8-0736-4c0f-9805-864bcd3ae646 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:36:ef,bridge_name='br-int',has_traffic_filtering=True,id=599e177a-d05b-4d24-8c89-8a868182940c,network=Network(41adee44-4e1c-4cc6-aa63-8054da5d97b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap599e177a-d0')
Aug 17 11:50:46 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-678756a8-0736-4c0f-9805-864bcd3ae646 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] No BDM found with device name vda, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 11:50:46 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-678756a8-0736-4c0f-9805-864bcd3ae646 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] No VIF found with MAC fa:16:3e:8d:36:ef, not building metadata {{(pid=73449) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 11:50:46 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:50:46 user nova-compute[73449]: DEBUG nova.compute.manager [req-080243f4-39f0-4241-9607-c9dc34f6cbb1 req-d33ee04f-00f1-4589-a590-3cfdf854bd87 service nova] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Received event network-changed-5db97a8e-3943-4259-ae41-cec1946c33f8 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:50:46 user nova-compute[73449]: DEBUG nova.compute.manager [req-080243f4-39f0-4241-9607-c9dc34f6cbb1 req-d33ee04f-00f1-4589-a590-3cfdf854bd87 service nova] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Refreshing instance network info cache due to event network-changed-5db97a8e-3943-4259-ae41-cec1946c33f8. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 11:50:46 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-080243f4-39f0-4241-9607-c9dc34f6cbb1 req-d33ee04f-00f1-4589-a590-3cfdf854bd87 service nova] Acquiring lock "refresh_cache-fea9f81c-a848-4a65-863e-e09dddf65bcf" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:50:46 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-080243f4-39f0-4241-9607-c9dc34f6cbb1 req-d33ee04f-00f1-4589-a590-3cfdf854bd87 service nova] Acquired lock "refresh_cache-fea9f81c-a848-4a65-863e-e09dddf65bcf" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:50:46 user nova-compute[73449]: DEBUG nova.network.neutron [req-080243f4-39f0-4241-9607-c9dc34f6cbb1 req-d33ee04f-00f1-4589-a590-3cfdf854bd87 service nova] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Refreshing network info cache for port 5db97a8e-3943-4259-ae41-cec1946c33f8 {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 11:50:46 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:50:46 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:50:46 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:50:47 user nova-compute[73449]: DEBUG nova.network.neutron [req-080243f4-39f0-4241-9607-c9dc34f6cbb1 req-d33ee04f-00f1-4589-a590-3cfdf854bd87 service nova] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Updated VIF entry in instance network info cache for port 5db97a8e-3943-4259-ae41-cec1946c33f8. {{(pid=73449) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 11:50:47 user nova-compute[73449]: DEBUG nova.network.neutron [req-080243f4-39f0-4241-9607-c9dc34f6cbb1 req-d33ee04f-00f1-4589-a590-3cfdf854bd87 service nova] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Updating instance_info_cache with network_info: [{"id": "5db97a8e-3943-4259-ae41-cec1946c33f8", "address": "fa:16:3e:c2:f3:5a", "network": {"id": "d56bc428-6be6-4aa9-b43c-9d4a0f1dd83b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-791364634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe7b5fee01a042bb90e40b18a84c82c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5db97a8e-39", "ovs_interfaceid": "5db97a8e-3943-4259-ae41-cec1946c33f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:50:47 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-afb62bff-8fe7-4f27-b60d-d10c524c6e92 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Acquiring lock "de5084e1-5a5e-48d2-a3ef-7f29898d1d2d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:50:47 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-afb62bff-8fe7-4f27-b60d-d10c524c6e92 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Lock "de5084e1-5a5e-48d2-a3ef-7f29898d1d2d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:50:47 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-afb62bff-8fe7-4f27-b60d-d10c524c6e92 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Acquiring lock "de5084e1-5a5e-48d2-a3ef-7f29898d1d2d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:50:47 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-afb62bff-8fe7-4f27-b60d-d10c524c6e92 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Lock "de5084e1-5a5e-48d2-a3ef-7f29898d1d2d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:50:47 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-afb62bff-8fe7-4f27-b60d-d10c524c6e92 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Lock "de5084e1-5a5e-48d2-a3ef-7f29898d1d2d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:50:47 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-080243f4-39f0-4241-9607-c9dc34f6cbb1 req-d33ee04f-00f1-4589-a590-3cfdf854bd87 service nova] Releasing lock "refresh_cache-fea9f81c-a848-4a65-863e-e09dddf65bcf" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:50:47 user nova-compute[73449]: INFO nova.compute.manager [None req-afb62bff-8fe7-4f27-b60d-d10c524c6e92 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] Terminating instance
Aug 17 11:50:47 user nova-compute[73449]: DEBUG nova.compute.manager [None req-afb62bff-8fe7-4f27-b60d-d10c524c6e92 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] Start destroying the instance on the hypervisor. {{(pid=73449) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 11:50:47 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:50:47 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:50:47 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:50:47 user nova-compute[73449]: DEBUG nova.compute.manager [req-a1e2a44e-13b9-4f71-a59e-29944e559b9b req-5f7b90b4-8073-4acc-849b-db4ac552a0b7 service nova] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] Received event network-vif-plugged-a0e89b76-95af-4e50-a972-b223cc5b3cab {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:50:47 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-a1e2a44e-13b9-4f71-a59e-29944e559b9b req-5f7b90b4-8073-4acc-849b-db4ac552a0b7 service nova] Acquiring lock "3d74c8f6-fb4e-4460-b722-674a8a1e2d25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:50:47 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-a1e2a44e-13b9-4f71-a59e-29944e559b9b req-5f7b90b4-8073-4acc-849b-db4ac552a0b7 service nova] Lock "3d74c8f6-fb4e-4460-b722-674a8a1e2d25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:50:47 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-a1e2a44e-13b9-4f71-a59e-29944e559b9b req-5f7b90b4-8073-4acc-849b-db4ac552a0b7 service nova] Lock "3d74c8f6-fb4e-4460-b722-674a8a1e2d25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:50:47 user nova-compute[73449]: DEBUG nova.compute.manager [req-a1e2a44e-13b9-4f71-a59e-29944e559b9b req-5f7b90b4-8073-4acc-849b-db4ac552a0b7 service nova] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] No waiting events found dispatching network-vif-plugged-a0e89b76-95af-4e50-a972-b223cc5b3cab {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:50:47 user nova-compute[73449]: WARNING nova.compute.manager [req-a1e2a44e-13b9-4f71-a59e-29944e559b9b req-5f7b90b4-8073-4acc-849b-db4ac552a0b7 service nova] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] Received unexpected event network-vif-plugged-a0e89b76-95af-4e50-a972-b223cc5b3cab for instance with vm_state active and task_state rescuing.
Aug 17 11:50:47 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:50:47 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:50:47 user nova-compute[73449]: DEBUG nova.compute.manager [req-9068ee1a-882a-4606-87ac-aac01ce77876 req-f92f0a8d-eee4-4e7b-bafc-d8962905d732 service nova] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Received event network-vif-plugged-1ec58d7f-18a4-4ddb-a137-2b72c5221621 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:50:47 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-9068ee1a-882a-4606-87ac-aac01ce77876 req-f92f0a8d-eee4-4e7b-bafc-d8962905d732 service nova] Acquiring lock "3d468854-6182-49c8-acb7-0641df2d5219-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:50:47 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-9068ee1a-882a-4606-87ac-aac01ce77876 req-f92f0a8d-eee4-4e7b-bafc-d8962905d732 service nova] Lock "3d468854-6182-49c8-acb7-0641df2d5219-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.006s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:50:47 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-9068ee1a-882a-4606-87ac-aac01ce77876 req-f92f0a8d-eee4-4e7b-bafc-d8962905d732 service nova] Lock "3d468854-6182-49c8-acb7-0641df2d5219-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:50:47 user nova-compute[73449]: DEBUG nova.compute.manager [req-9068ee1a-882a-4606-87ac-aac01ce77876 req-f92f0a8d-eee4-4e7b-bafc-d8962905d732 service nova] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] No waiting events found dispatching network-vif-plugged-1ec58d7f-18a4-4ddb-a137-2b72c5221621 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:50:47 user nova-compute[73449]: WARNING nova.compute.manager [req-9068ee1a-882a-4606-87ac-aac01ce77876 req-f92f0a8d-eee4-4e7b-bafc-d8962905d732 service nova] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Received unexpected event network-vif-plugged-1ec58d7f-18a4-4ddb-a137-2b72c5221621 for instance with vm_state active and task_state resize_finish.
Aug 17 11:50:47 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:50:48 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:50:48 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:50:48 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:50:48 user nova-compute[73449]: DEBUG nova.compute.manager [req-44224532-ec8e-4e30-a0b1-8c95c824a99e req-1733b402-8412-4119-9a51-af004e215900 service nova] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Received event network-vif-plugged-599e177a-d05b-4d24-8c89-8a868182940c {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:50:48 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-44224532-ec8e-4e30-a0b1-8c95c824a99e req-1733b402-8412-4119-9a51-af004e215900 service nova] Acquiring lock "5612f7d1-a901-4bdd-a24a-faf9a980cd04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:50:48 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-44224532-ec8e-4e30-a0b1-8c95c824a99e req-1733b402-8412-4119-9a51-af004e215900 service nova] Lock "5612f7d1-a901-4bdd-a24a-faf9a980cd04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:50:48 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-44224532-ec8e-4e30-a0b1-8c95c824a99e req-1733b402-8412-4119-9a51-af004e215900 service nova] Lock "5612f7d1-a901-4bdd-a24a-faf9a980cd04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:50:48 user nova-compute[73449]: DEBUG nova.compute.manager [req-44224532-ec8e-4e30-a0b1-8c95c824a99e req-1733b402-8412-4119-9a51-af004e215900 service nova] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] No waiting events found dispatching network-vif-plugged-599e177a-d05b-4d24-8c89-8a868182940c {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:50:48 user nova-compute[73449]: WARNING nova.compute.manager [req-44224532-ec8e-4e30-a0b1-8c95c824a99e req-1733b402-8412-4119-9a51-af004e215900 service nova] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Received unexpected event network-vif-plugged-599e177a-d05b-4d24-8c89-8a868182940c for instance with vm_state shelved_offloaded and task_state spawning.
Aug 17 11:50:48 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] Instance destroyed successfully.
Aug 17 11:50:48 user nova-compute[73449]: DEBUG nova.objects.instance [None req-afb62bff-8fe7-4f27-b60d-d10c524c6e92 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Lazy-loading 'resources' on Instance uuid de5084e1-5a5e-48d2-a3ef-7f29898d1d2d {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:50:48 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-afb62bff-8fe7-4f27-b60d-d10c524c6e92 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:45:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1351274734',display_name='tempest-TestMinimumBasicScenario-server-1351274734',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1351274734',id=15,image_ref='fb1d2645-7169-4a0c-a0b3-f384ea3ca6ee',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK6F1KbqG2L7a63s8u4cdTuNvzTcmprfe52KFjhIPaxJjtgOgScs7eLTzZK2UKsaCKRsFSlnWB9z6cQbolaXqixSV5LaBk/UTgveylZJ3QdcXGKc0GT695r/cb4yrtsjUA==',key_name='tempest-TestMinimumBasicScenario-1748788689',keypairs=<?>,launch_index=0,launched_at=2023-08-17T11:45:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b5ba3ebf47bd4b999e68c74a5c0ab060',ramdisk_id='',reservation_id='r-yy0x01ti',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fb1d2645-7169-4a0c-a0b3-f384ea3ca6ee',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1063498076',owner_user_name='tempest-TestMinimumBasicScenario-1063498076-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T11:47:51Z,user_data=None,user_id='a388f1f7e6254e8cace000ec1249d6c6',uuid=de5084e1-5a5e-48d2-a3ef-7f29898d1d2d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e2af7fce-7442-48b4-8611-da3171b0672b", "address": "fa:16:3e:c0:c8:a6", "network": {"id": "ff73f5c3-bae6-46cc-bcb8-bbd5be1b478d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1229197917-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5ba3ebf47bd4b999e68c74a5c0ab060", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2af7fce-74", "ovs_interfaceid": "e2af7fce-7442-48b4-8611-da3171b0672b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 11:50:48 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-afb62bff-8fe7-4f27-b60d-d10c524c6e92 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Converting VIF {"id": "e2af7fce-7442-48b4-8611-da3171b0672b", "address": "fa:16:3e:c0:c8:a6", "network": {"id": "ff73f5c3-bae6-46cc-bcb8-bbd5be1b478d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1229197917-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5ba3ebf47bd4b999e68c74a5c0ab060", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2af7fce-74", "ovs_interfaceid": "e2af7fce-7442-48b4-8611-da3171b0672b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:50:48 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-afb62bff-8fe7-4f27-b60d-d10c524c6e92 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c0:c8:a6,bridge_name='br-int',has_traffic_filtering=True,id=e2af7fce-7442-48b4-8611-da3171b0672b,network=Network(ff73f5c3-bae6-46cc-bcb8-bbd5be1b478d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2af7fce-74') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:50:48 user nova-compute[73449]: DEBUG os_vif [None req-afb62bff-8fe7-4f27-b60d-d10c524c6e92 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c0:c8:a6,bridge_name='br-int',has_traffic_filtering=True,id=e2af7fce-7442-48b4-8611-da3171b0672b,network=Network(ff73f5c3-bae6-46cc-bcb8-bbd5be1b478d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2af7fce-74') {{(pid=73449) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 11:50:48 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:50:48 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape2af7fce-74, bridge=br-int, if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:50:48 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:50:48 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:50:48 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:50:48 user nova-compute[73449]: INFO os_vif [None req-afb62bff-8fe7-4f27-b60d-d10c524c6e92 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c0:c8:a6,bridge_name='br-int',has_traffic_filtering=True,id=e2af7fce-7442-48b4-8611-da3171b0672b,network=Network(ff73f5c3-bae6-46cc-bcb8-bbd5be1b478d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2af7fce-74')
Aug 17 11:50:48 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-afb62bff-8fe7-4f27-b60d-d10c524c6e92 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] Deleting instance files /opt/stack/data/nova/instances/de5084e1-5a5e-48d2-a3ef-7f29898d1d2d_del
Aug 17 11:50:48 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-afb62bff-8fe7-4f27-b60d-d10c524c6e92 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] Deletion of /opt/stack/data/nova/instances/de5084e1-5a5e-48d2-a3ef-7f29898d1d2d_del complete
Aug 17 11:50:49 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Removed pending event for 3d74c8f6-fb4e-4460-b722-674a8a1e2d25 due to event {{(pid=73449) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 17 11:50:49 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692273049.0098555, 3d74c8f6-fb4e-4460-b722-674a8a1e2d25 => Resumed> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:50:49 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] VM Resumed (Lifecycle Event)
Aug 17 11:50:49 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:50:49 user nova-compute[73449]: DEBUG nova.compute.manager [None req-35ff9193-0246-4b11-b39e-7856569c1a38 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:50:49 user nova-compute[73449]: INFO nova.compute.manager [None req-afb62bff-8fe7-4f27-b60d-d10c524c6e92 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] Took 1.86 seconds to destroy the instance on the hypervisor.
Aug 17 11:50:49 user nova-compute[73449]: DEBUG oslo.service.loopingcall [None req-afb62bff-8fe7-4f27-b60d-d10c524c6e92 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73449) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 11:50:49 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:50:49 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:50:49 user nova-compute[73449]: DEBUG nova.compute.manager [-] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] Deallocating network for instance {{(pid=73449) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 11:50:49 user nova-compute[73449]: DEBUG nova.network.neutron [-] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] deallocate_for_instance() {{(pid=73449) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 11:50:49 user nova-compute[73449]: DEBUG nova.compute.manager [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Instance event wait completed in 0 seconds for  {{(pid=73449) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 11:50:49 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 11:50:49 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Instance running successfully.
Aug 17 11:50:49 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Failed to set time: agent not configured {{(pid=73449) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 17 11:50:49 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-45e839de-c730-49ed-9b71-03a9d8a455b5 tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] finish_migration finished successfully. {{(pid=73449) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 17 11:50:49 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 17 11:50:49 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692273049.0102112, 3d74c8f6-fb4e-4460-b722-674a8a1e2d25 => Started> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:50:49 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] VM Started (Lifecycle Event)
Aug 17 11:50:49 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:50:49 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 11:50:49 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692273049.1117468, 3d468854-6182-49c8-acb7-0641df2d5219 => Resumed> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:50:49 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] VM Resumed (Lifecycle Event)
Aug 17 11:50:49 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:50:49 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 11:50:49 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 17 11:50:49 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692273049.1119344, 3d468854-6182-49c8-acb7-0641df2d5219 => Started> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:50:49 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] VM Started (Lifecycle Event)
Aug 17 11:50:49 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:50:49 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 11:50:49 user nova-compute[73449]: DEBUG nova.compute.manager [req-1c6d935f-e188-4cdf-a57e-52fbb789d549 req-1259aac3-3cbe-4fa0-8b4a-65b0525c63f0 service nova] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] Received event network-vif-unplugged-e2af7fce-7442-48b4-8611-da3171b0672b {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:50:49 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-1c6d935f-e188-4cdf-a57e-52fbb789d549 req-1259aac3-3cbe-4fa0-8b4a-65b0525c63f0 service nova] Acquiring lock "de5084e1-5a5e-48d2-a3ef-7f29898d1d2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:50:49 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-1c6d935f-e188-4cdf-a57e-52fbb789d549 req-1259aac3-3cbe-4fa0-8b4a-65b0525c63f0 service nova] Lock "de5084e1-5a5e-48d2-a3ef-7f29898d1d2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:50:49 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-1c6d935f-e188-4cdf-a57e-52fbb789d549 req-1259aac3-3cbe-4fa0-8b4a-65b0525c63f0 service nova] Lock "de5084e1-5a5e-48d2-a3ef-7f29898d1d2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:50:49 user nova-compute[73449]: DEBUG nova.compute.manager [req-1c6d935f-e188-4cdf-a57e-52fbb789d549 req-1259aac3-3cbe-4fa0-8b4a-65b0525c63f0 service nova] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] No waiting events found dispatching network-vif-unplugged-e2af7fce-7442-48b4-8611-da3171b0672b {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:50:49 user nova-compute[73449]: DEBUG nova.compute.manager [req-1c6d935f-e188-4cdf-a57e-52fbb789d549 req-1259aac3-3cbe-4fa0-8b4a-65b0525c63f0 service nova] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] Received event network-vif-unplugged-e2af7fce-7442-48b4-8611-da3171b0672b for instance with task_state deleting. {{(pid=73449) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 11:50:49 user nova-compute[73449]: DEBUG nova.compute.manager [req-1c6d935f-e188-4cdf-a57e-52fbb789d549 req-1259aac3-3cbe-4fa0-8b4a-65b0525c63f0 service nova] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] Received event network-vif-plugged-e2af7fce-7442-48b4-8611-da3171b0672b {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:50:49 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-1c6d935f-e188-4cdf-a57e-52fbb789d549 req-1259aac3-3cbe-4fa0-8b4a-65b0525c63f0 service nova] Acquiring lock "de5084e1-5a5e-48d2-a3ef-7f29898d1d2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:50:49 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-1c6d935f-e188-4cdf-a57e-52fbb789d549 req-1259aac3-3cbe-4fa0-8b4a-65b0525c63f0 service nova] Lock "de5084e1-5a5e-48d2-a3ef-7f29898d1d2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:50:49 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-1c6d935f-e188-4cdf-a57e-52fbb789d549 req-1259aac3-3cbe-4fa0-8b4a-65b0525c63f0 service nova] Lock "de5084e1-5a5e-48d2-a3ef-7f29898d1d2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:50:49 user nova-compute[73449]: DEBUG nova.compute.manager [req-1c6d935f-e188-4cdf-a57e-52fbb789d549 req-1259aac3-3cbe-4fa0-8b4a-65b0525c63f0 service nova] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] No waiting events found dispatching network-vif-plugged-e2af7fce-7442-48b4-8611-da3171b0672b {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:50:49 user nova-compute[73449]: WARNING nova.compute.manager [req-1c6d935f-e188-4cdf-a57e-52fbb789d549 req-1259aac3-3cbe-4fa0-8b4a-65b0525c63f0 service nova] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] Received unexpected event network-vif-plugged-e2af7fce-7442-48b4-8611-da3171b0672b for instance with vm_state active and task_state deleting.
Aug 17 11:50:49 user nova-compute[73449]: DEBUG nova.network.neutron [-] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] Updating instance_info_cache with network_info: [] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:50:49 user nova-compute[73449]: INFO nova.compute.manager [-] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] Took 0.88 seconds to deallocate network for instance.
Aug 17 11:50:50 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-afb62bff-8fe7-4f27-b60d-d10c524c6e92 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:50:50 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-afb62bff-8fe7-4f27-b60d-d10c524c6e92 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:50:50 user nova-compute[73449]: DEBUG nova.compute.manager [req-5f529220-0bfe-4f99-8d7a-515902a8a2f3 req-90d0011a-e4ff-482a-876f-198b39efb28c service nova] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Received event network-vif-plugged-599e177a-d05b-4d24-8c89-8a868182940c {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:50:50 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-5f529220-0bfe-4f99-8d7a-515902a8a2f3 req-90d0011a-e4ff-482a-876f-198b39efb28c service nova] Acquiring lock "5612f7d1-a901-4bdd-a24a-faf9a980cd04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:50:50 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-5f529220-0bfe-4f99-8d7a-515902a8a2f3 req-90d0011a-e4ff-482a-876f-198b39efb28c service nova] Lock "5612f7d1-a901-4bdd-a24a-faf9a980cd04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:50:50 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-5f529220-0bfe-4f99-8d7a-515902a8a2f3 req-90d0011a-e4ff-482a-876f-198b39efb28c service nova] Lock "5612f7d1-a901-4bdd-a24a-faf9a980cd04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:50:50 user nova-compute[73449]: DEBUG nova.compute.manager [req-5f529220-0bfe-4f99-8d7a-515902a8a2f3 req-90d0011a-e4ff-482a-876f-198b39efb28c service nova] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] No waiting events found dispatching network-vif-plugged-599e177a-d05b-4d24-8c89-8a868182940c {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:50:50 user nova-compute[73449]: WARNING nova.compute.manager [req-5f529220-0bfe-4f99-8d7a-515902a8a2f3 req-90d0011a-e4ff-482a-876f-198b39efb28c service nova] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Received unexpected event network-vif-plugged-599e177a-d05b-4d24-8c89-8a868182940c for instance with vm_state shelved_offloaded and task_state spawning.
Aug 17 11:50:50 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-afb62bff-8fe7-4f27-b60d-d10c524c6e92 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 11:50:50 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-afb62bff-8fe7-4f27-b60d-d10c524c6e92 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 11:50:50 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-afb62bff-8fe7-4f27-b60d-d10c524c6e92 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.742s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:50:50 user nova-compute[73449]: INFO nova.scheduler.client.report [None req-afb62bff-8fe7-4f27-b60d-d10c524c6e92 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Deleted allocations for instance de5084e1-5a5e-48d2-a3ef-7f29898d1d2d
Aug 17 11:50:50 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:50:50 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Cleaning up deleted instances {{(pid=73449) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 17 11:50:50 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-afb62bff-8fe7-4f27-b60d-d10c524c6e92 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Lock "de5084e1-5a5e-48d2-a3ef-7f29898d1d2d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.773s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:50:50 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] There are 0 instances to clean {{(pid=73449) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 17 11:50:51 user nova-compute[73449]: DEBUG nova.compute.manager [req-5ef4c546-6fc4-4423-8740-68ff83e12482 req-cf664120-0f71-4cd3-91d2-29d3b80fee41 service nova] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] Received event network-vif-deleted-e2af7fce-7442-48b4-8611-da3171b0672b {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:50:52 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692273051.9778736, 5612f7d1-a901-4bdd-a24a-faf9a980cd04 => Resumed> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:50:52 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] VM Resumed (Lifecycle Event)
Aug 17 11:50:52 user nova-compute[73449]: DEBUG nova.compute.manager [None req-678756a8-0736-4c0f-9805-864bcd3ae646 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Instance event wait completed in 0 seconds for  {{(pid=73449) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 11:50:52 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-678756a8-0736-4c0f-9805-864bcd3ae646 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Guest created on hypervisor {{(pid=73449) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 11:50:52 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Instance spawned successfully.
Aug 17 11:50:52 user nova-compute[73449]: DEBUG nova.compute.manager [None req-678756a8-0736-4c0f-9805-864bcd3ae646 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:50:52 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:50:52 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:50:52 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73449) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 11:50:52 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:50:52 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 11:50:52 user nova-compute[73449]: DEBUG nova.compute.manager [None req-77a78fca-afaa-45a1-9fc8-969a4d5f7b0f tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: ec622bf0-4531-4892-b637-0ef564cf453b] Start spawning the instance on the hypervisor. {{(pid=73449) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 11:50:52 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-77a78fca-afaa-45a1-9fc8-969a4d5f7b0f tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: ec622bf0-4531-4892-b637-0ef564cf453b] Creating instance directory {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 11:50:52 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-77a78fca-afaa-45a1-9fc8-969a4d5f7b0f tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: ec622bf0-4531-4892-b637-0ef564cf453b] Creating image(s)
Aug 17 11:50:52 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-77a78fca-afaa-45a1-9fc8-969a4d5f7b0f tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: ec622bf0-4531-4892-b637-0ef564cf453b] Did not create local disks {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 11:50:52 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-77a78fca-afaa-45a1-9fc8-969a4d5f7b0f tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: ec622bf0-4531-4892-b637-0ef564cf453b] Ensure instance console log exists: /opt/stack/data/nova/instances/ec622bf0-4531-4892-b637-0ef564cf453b/console.log {{(pid=73449) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 11:50:52 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-77a78fca-afaa-45a1-9fc8-969a4d5f7b0f tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:50:52 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-77a78fca-afaa-45a1-9fc8-969a4d5f7b0f tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:50:52 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-77a78fca-afaa-45a1-9fc8-969a4d5f7b0f tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:50:52 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-77a78fca-afaa-45a1-9fc8-969a4d5f7b0f tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: ec622bf0-4531-4892-b637-0ef564cf453b] Start _get_guest_xml network_info=[{"id": "9171abbc-1b7e-4008-93f4-3075f6b9b898", "address": "fa:16:3e:04:f1:e3", "network": {"id": "a9e8fcd6-4152-466b-99ad-44b85db05a05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-920564935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bd46cdaff7a4b40955f7c8a12c55452", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9171abbc-1b", "ovs_interfaceid": "9171abbc-1b7e-4008-93f4-3075f6b9b898", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-17T11:50:17Z,direct_url=<?>,disk_format='qcow2',id=ef9117da-c36b-4ccd-99e6-5c467d02bc51,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1888267634',owner='4bd46cdaff7a4b40955f7c8a12c55452',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-17T11:50:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'attachment_id': '0b7f608c-6c73-4c89-92f3-800e5632af4b', 'boot_index': 0, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:b6b06606-4920-4dce-bae0-3101c8b7dc6a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CpYaeiIy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ec622bf0-4531-4892-b637-0ef564cf453b', 'attached_at': '', 'detached_at': '', 'volume_id': 'b6b06606-4920-4dce-bae0-3101c8b7dc6a', 'serial': 'b6b06606-4920-4dce-bae0-3101c8b7dc6a'}, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 11:50:52 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-77a78fca-afaa-45a1-9fc8-969a4d5f7b0f tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:50:52 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-77a78fca-afaa-45a1-9fc8-969a4d5f7b0f tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:50:52 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-77a78fca-afaa-45a1-9fc8-969a4d5f7b0f tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 11:50:52 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-77a78fca-afaa-45a1-9fc8-969a4d5f7b0f tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] CPU controller missing on host. {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 11:50:52 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-77a78fca-afaa-45a1-9fc8-969a4d5f7b0f tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 11:50:52 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-77a78fca-afaa-45a1-9fc8-969a4d5f7b0f tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] CPU controller found on host. {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 11:50:52 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-77a78fca-afaa-45a1-9fc8-969a4d5f7b0f tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73449) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 11:50:52 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-77a78fca-afaa-45a1-9fc8-969a4d5f7b0f tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T11:35:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-17T11:50:17Z,direct_url=<?>,disk_format='qcow2',id=ef9117da-c36b-4ccd-99e6-5c467d02bc51,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1888267634',owner='4bd46cdaff7a4b40955f7c8a12c55452',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-17T11:50:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 11:50:52 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-77a78fca-afaa-45a1-9fc8-969a4d5f7b0f tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Flavor limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 11:50:52 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-77a78fca-afaa-45a1-9fc8-969a4d5f7b0f tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Image limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 11:50:52 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-77a78fca-afaa-45a1-9fc8-969a4d5f7b0f tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Flavor pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 11:50:52 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-77a78fca-afaa-45a1-9fc8-969a4d5f7b0f tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Image pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 11:50:52 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-77a78fca-afaa-45a1-9fc8-969a4d5f7b0f tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 11:50:52 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-77a78fca-afaa-45a1-9fc8-969a4d5f7b0f tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 11:50:52 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-77a78fca-afaa-45a1-9fc8-969a4d5f7b0f tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 11:50:52 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-77a78fca-afaa-45a1-9fc8-969a4d5f7b0f tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Got 1 possible topologies {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 11:50:52 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-77a78fca-afaa-45a1-9fc8-969a4d5f7b0f tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 11:50:52 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-77a78fca-afaa-45a1-9fc8-969a4d5f7b0f tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 11:50:52 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77a78fca-afaa-45a1-9fc8-969a4d5f7b0f tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: ec622bf0-4531-4892-b637-0ef564cf453b] Calling os-brick to attach iSCSI Volume {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 11:50:52 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-77a78fca-afaa-45a1-9fc8-969a4d5f7b0f tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b6b06606-4920-4dce-bae0-3101c8b7dc6a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CpYaeiIy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 11:50:52 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-77a78fca-afaa-45a1-9fc8-969a4d5f7b0f tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 11:50:52 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-77a78fca-afaa-45a1-9fc8-969a4d5f7b0f tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:50:52 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-77a78fca-afaa-45a1-9fc8-969a4d5f7b0f tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:50:52 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-77a78fca-afaa-45a1-9fc8-969a4d5f7b0f tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 11:50:52 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-77a78fca-afaa-45a1-9fc8-969a4d5f7b0f tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b6b06606-4920-4dce-bae0-3101c8b7dc6a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:50:52 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-77a78fca-afaa-45a1-9fc8-969a4d5f7b0f tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b6b06606-4920-4dce-bae0-3101c8b7dc6a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:50:52 user nova-compute[73449]: INFO os_brick.initiator.connectors.iscsi [None req-77a78fca-afaa-45a1-9fc8-969a4d5f7b0f tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 11:50:52 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 11:50:52 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692273051.9829743, 5612f7d1-a901-4bdd-a24a-faf9a980cd04 => Started> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:50:52 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] VM Started (Lifecycle Event)
Aug 17 11:50:52 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6b06606-4920-4dce-bae0-3101c8b7dc6a -p 172.16.0.220:3260 {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:50:52 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-678756a8-0736-4c0f-9805-864bcd3ae646 tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Lock "5612f7d1-a901-4bdd-a24a-faf9a980cd04" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 25.725s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:50:52 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:50:52 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 11:50:52 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6b06606-4920-4dce-bae0-3101c8b7dc6a -p 172.16.0.220:3260" returned: 21 in 0.040s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:50:52 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[e40afdda-5fdc-4fe2-99b9-a59f73c89fad]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:50:52 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-77a78fca-afaa-45a1-9fc8-969a4d5f7b0f tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 11:50:52 user nova-compute[73449]:  {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:50:52 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6b06606-4920-4dce-bae0-3101c8b7dc6a -p 172.16.0.220:3260 --interface default --op new {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:50:52 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6b06606-4920-4dce-bae0-3101c8b7dc6a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:50:52 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e57a0b6-a47b-4b79-921e-10b3d9addb3b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b6b06606-4920-4dce-bae0-3101c8b7dc6a] added\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:50:52 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-77a78fca-afaa-45a1-9fc8-969a4d5f7b0f tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b6b06606-4920-4dce-bae0-3101c8b7dc6a] added
Aug 17 11:50:52 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:50:52 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6b06606-4920-4dce-bae0-3101c8b7dc6a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:50:52 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6b06606-4920-4dce-bae0-3101c8b7dc6a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.043s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:50:52 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[44ba2c2f-812e-49f8-a2a7-6bd6ed36490d]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:50:52 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-77a78fca-afaa-45a1-9fc8-969a4d5f7b0f tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:50:52 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6b06606-4920-4dce-bae0-3101c8b7dc6a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:50:52 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6b06606-4920-4dce-bae0-3101c8b7dc6a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:50:52 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[21dc5c8e-1d69-407c-b68f-6598a8d8ccab]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:50:52 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-77a78fca-afaa-45a1-9fc8-969a4d5f7b0f tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:50:52 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6b06606-4920-4dce-bae0-3101c8b7dc6a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CpYaeiIy {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:50:52 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6b06606-4920-4dce-bae0-3101c8b7dc6a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CpYaeiIy" returned: 0 in 0.024s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:50:52 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[4deb35a9-ab8c-4c6d-afc4-860774e3f86b]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:50:52 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-77a78fca-afaa-45a1-9fc8-969a4d5f7b0f tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CpYaeiIy'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:50:52 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6b06606-4920-4dce-bae0-3101c8b7dc6a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:50:52 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6b06606-4920-4dce-bae0-3101c8b7dc6a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:50:52 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea492a89-c87b-4af0-a3cf-9b769fca2ca3]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:50:52 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-77a78fca-afaa-45a1-9fc8-969a4d5f7b0f tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:50:52 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:50:52 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:50:52 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5ec4b03-0762-4844-9ee2-02958baab61f]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611 (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:50:52 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-77a78fca-afaa-45a1-9fc8-969a4d5f7b0f tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe (non-flash)
Aug 17 11:50:52 user nova-compute[73449]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 (non-flash)
Aug 17 11:50:52 user nova-compute[73449]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611 (non-flash)
Aug 17 11:50:52 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:50:52 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-77a78fca-afaa-45a1-9fc8-969a4d5f7b0f tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe (non-flash)
Aug 17 11:50:52 user nova-compute[73449]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 (non-flash)
Aug 17 11:50:52 user nova-compute[73449]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611 (non-flash)
Aug 17 11:50:52 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:50:52 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6b06606-4920-4dce-bae0-3101c8b7dc6a -p 172.16.0.220:3260 --login {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:50:52 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6b06606-4920-4dce-bae0-3101c8b7dc6a -p 172.16.0.220:3260 --login" returned: 0 in 0.093s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:50:52 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[1074d906-e3f2-4479-8fa8-800ff88cc650]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b6b06606-4920-4dce-bae0-3101c8b7dc6a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b6b06606-4920-4dce-bae0-3101c8b7dc6a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:50:52 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-77a78fca-afaa-45a1-9fc8-969a4d5f7b0f tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b6b06606-4920-4dce-bae0-3101c8b7dc6a, portal: 172.16.0.220,3260]
Aug 17 11:50:52 user nova-compute[73449]: Login to [iface: default, target: iqn.2010-10.org.openstack:b6b06606-4920-4dce-bae0-3101c8b7dc6a, portal: 172.16.0.220,3260] successful.
Aug 17 11:50:52 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:50:52 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6b06606-4920-4dce-bae0-3101c8b7dc6a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:50:52 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6b06606-4920-4dce-bae0-3101c8b7dc6a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:50:52 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[efdb21e5-f10d-43e2-a216-4c6ada27b365]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:50:52 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-77a78fca-afaa-45a1-9fc8-969a4d5f7b0f tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:50:52 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:50:52 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:50:52 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[33801a2d-5c73-466b-a1fa-20513ce6008c]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6b06606-4920-4dce-bae0-3101c8b7dc6a (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:50:52 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-77a78fca-afaa-45a1-9fc8-969a4d5f7b0f tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe (non-flash)
Aug 17 11:50:52 user nova-compute[73449]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 (non-flash)
Aug 17 11:50:52 user nova-compute[73449]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611 (non-flash)
Aug 17 11:50:52 user nova-compute[73449]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6b06606-4920-4dce-bae0-3101c8b7dc6a (non-flash)
Aug 17 11:50:52 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:50:52 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-77a78fca-afaa-45a1-9fc8-969a4d5f7b0f tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe (non-flash)
Aug 17 11:50:52 user nova-compute[73449]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 (non-flash)
Aug 17 11:50:52 user nova-compute[73449]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611 (non-flash)
Aug 17 11:50:52 user nova-compute[73449]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6b06606-4920-4dce-bae0-3101c8b7dc6a (non-flash)
Aug 17 11:50:52 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:50:52 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-77a78fca-afaa-45a1-9fc8-969a4d5f7b0f tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b6b06606-4920-4dce-bae0-3101c8b7dc6a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.460s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:50:52 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-77a78fca-afaa-45a1-9fc8-969a4d5f7b0f tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Connected to 172.16.0.220:3260 {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 11:50:52 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-77a78fca-afaa-45a1-9fc8-969a4d5f7b0f tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] HCTL ('35', '-', '-', 0) found on session 31 with lun 0 {{(pid=73449) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 11:50:52 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-77a78fca-afaa-45a1-9fc8-969a4d5f7b0f tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73449) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 11:50:52 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:50:52 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.026s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:50:52 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c8e6a03-f90b-4e0d-b9e1-6554e2618daf]: (4, ('- - 0', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:50:52 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-77a78fca-afaa-45a1-9fc8-969a4d5f7b0f tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Searching for a device in session 31 and hctl ['35', '*', '*', 0] yield: None {{(pid=73449) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 11:50:52 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:50:52 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:50:53 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:50:53 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-46e35214-09c1-4ac3-b2cc-f7adfbb5620a tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Acquiring lock "fea9f81c-a848-4a65-863e-e09dddf65bcf" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:50:53 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-46e35214-09c1-4ac3-b2cc-f7adfbb5620a tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Lock "fea9f81c-a848-4a65-863e-e09dddf65bcf" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:50:53 user nova-compute[73449]: INFO nova.compute.manager [None req-46e35214-09c1-4ac3-b2cc-f7adfbb5620a tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Shelving
Aug 17 11:50:53 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-77a78fca-afaa-45a1-9fc8-969a4d5f7b0f tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Searching for a device in session 31 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73449) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 11:50:53 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-77a78fca-afaa-45a1-9fc8-969a4d5f7b0f tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CpYaeiIy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 11:50:53 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-77a78fca-afaa-45a1-9fc8-969a4d5f7b0f tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.505s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:50:53 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-77a78fca-afaa-45a1-9fc8-969a4d5f7b0f tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] <== connect_volume: return (1507ms) {'type': 'block', 'scsi_wwn': '23433353837303666', 'path': '/dev/sdd'} {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 11:50:53 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77a78fca-afaa-45a1-9fc8-969a4d5f7b0f tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: ec622bf0-4531-4892-b637-0ef564cf453b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23433353837303666', 'path': '/dev/sdd'} {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 11:50:53 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-77a78fca-afaa-45a1-9fc8-969a4d5f7b0f tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:50:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-629435938',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-629435938',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-629435938',id=27,image_ref='ef9117da-c36b-4ccd-99e6-5c467d02bc51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOK2OcMVVxjoiwv87EfFOwpDnVEUDpgnzjxdcAiMqg1Zd0jvED64BC7imQYzwdEI0TXX9FTXnHG36rHuOKJNhaM46tSbU4IvcWp6xK0GF1HveevStf9H+zYjkwzSz9mVrA==',key_name='tempest-keypair-180394528',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4bd46cdaff7a4b40955f7c8a12c55452',ramdisk_id='',reservation_id='r-ycfl4grz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-813872552',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-813872552-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-813872552',owner_user_name='tempest-TestVolumeBootPattern-813872552-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T11:50:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='804ccb0440fb46a4a4c0ae65c3893296',uuid=ec622bf0-4531-4892-b637-0ef564cf453b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9171abbc-1b7e-4008-93f4-3075f6b9b898", "address": "fa:16:3e:04:f1:e3", "network": {"id": "a9e8fcd6-4152-466b-99ad-44b85db05a05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-920564935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bd46cdaff7a4b40955f7c8a12c55452", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9171abbc-1b", "ovs_interfaceid": "9171abbc-1b7e-4008-93f4-3075f6b9b898", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73449) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 11:50:53 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-77a78fca-afaa-45a1-9fc8-969a4d5f7b0f tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Converting VIF {"id": "9171abbc-1b7e-4008-93f4-3075f6b9b898", "address": "fa:16:3e:04:f1:e3", "network": {"id": "a9e8fcd6-4152-466b-99ad-44b85db05a05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-920564935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bd46cdaff7a4b40955f7c8a12c55452", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9171abbc-1b", "ovs_interfaceid": "9171abbc-1b7e-4008-93f4-3075f6b9b898", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:50:53 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-77a78fca-afaa-45a1-9fc8-969a4d5f7b0f tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:f1:e3,bridge_name='br-int',has_traffic_filtering=True,id=9171abbc-1b7e-4008-93f4-3075f6b9b898,network=Network(a9e8fcd6-4152-466b-99ad-44b85db05a05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9171abbc-1b') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:50:53 user nova-compute[73449]: DEBUG nova.objects.instance [None req-77a78fca-afaa-45a1-9fc8-969a4d5f7b0f tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Lazy-loading 'pci_devices' on Instance uuid ec622bf0-4531-4892-b637-0ef564cf453b {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:50:53 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-77a78fca-afaa-45a1-9fc8-969a4d5f7b0f tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: ec622bf0-4531-4892-b637-0ef564cf453b] End _get_guest_xml xml=<domain type="kvm">
Aug 17 11:50:53 user nova-compute[73449]:   <uuid>ec622bf0-4531-4892-b637-0ef564cf453b</uuid>
Aug 17 11:50:53 user nova-compute[73449]:   <name>instance-0000001b</name>
Aug 17 11:50:53 user nova-compute[73449]:   <memory>524288</memory>
Aug 17 11:50:53 user nova-compute[73449]:   <vcpu>1</vcpu>
Aug 17 11:50:53 user nova-compute[73449]:   <metadata>
Aug 17 11:50:53 user nova-compute[73449]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 11:50:53 user nova-compute[73449]:       <nova:package version="0.0.0"/>
Aug 17 11:50:53 user nova-compute[73449]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-629435938</nova:name>
Aug 17 11:50:53 user nova-compute[73449]:       <nova:creationTime>2023-08-17 11:50:52</nova:creationTime>
Aug 17 11:50:53 user nova-compute[73449]:       <nova:flavor name="m1.tiny">
Aug 17 11:50:53 user nova-compute[73449]:         <nova:memory>512</nova:memory>
Aug 17 11:50:53 user nova-compute[73449]:         <nova:disk>1</nova:disk>
Aug 17 11:50:53 user nova-compute[73449]:         <nova:swap>0</nova:swap>
Aug 17 11:50:53 user nova-compute[73449]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 11:50:53 user nova-compute[73449]:         <nova:vcpus>1</nova:vcpus>
Aug 17 11:50:53 user nova-compute[73449]:       </nova:flavor>
Aug 17 11:50:53 user nova-compute[73449]:       <nova:owner>
Aug 17 11:50:53 user nova-compute[73449]:         <nova:user uuid="804ccb0440fb46a4a4c0ae65c3893296">tempest-TestVolumeBootPattern-813872552-project-member</nova:user>
Aug 17 11:50:53 user nova-compute[73449]:         <nova:project uuid="4bd46cdaff7a4b40955f7c8a12c55452">tempest-TestVolumeBootPattern-813872552</nova:project>
Aug 17 11:50:53 user nova-compute[73449]:       </nova:owner>
Aug 17 11:50:53 user nova-compute[73449]:       <nova:root type="image" uuid="ef9117da-c36b-4ccd-99e6-5c467d02bc51"/>
Aug 17 11:50:53 user nova-compute[73449]:       <nova:ports>
Aug 17 11:50:53 user nova-compute[73449]:         <nova:port uuid="9171abbc-1b7e-4008-93f4-3075f6b9b898">
Aug 17 11:50:53 user nova-compute[73449]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 17 11:50:53 user nova-compute[73449]:         </nova:port>
Aug 17 11:50:53 user nova-compute[73449]:       </nova:ports>
Aug 17 11:50:53 user nova-compute[73449]:     </nova:instance>
Aug 17 11:50:53 user nova-compute[73449]:   </metadata>
Aug 17 11:50:53 user nova-compute[73449]:   <sysinfo type="smbios">
Aug 17 11:50:53 user nova-compute[73449]:     <system>
Aug 17 11:50:53 user nova-compute[73449]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 11:50:53 user nova-compute[73449]:       <entry name="product">OpenStack Nova</entry>
Aug 17 11:50:53 user nova-compute[73449]:       <entry name="version">0.0.0</entry>
Aug 17 11:50:53 user nova-compute[73449]:       <entry name="serial">ec622bf0-4531-4892-b637-0ef564cf453b</entry>
Aug 17 11:50:53 user nova-compute[73449]:       <entry name="uuid">ec622bf0-4531-4892-b637-0ef564cf453b</entry>
Aug 17 11:50:53 user nova-compute[73449]:       <entry name="family">Virtual Machine</entry>
Aug 17 11:50:53 user nova-compute[73449]:     </system>
Aug 17 11:50:53 user nova-compute[73449]:   </sysinfo>
Aug 17 11:50:53 user nova-compute[73449]:   <os>
Aug 17 11:50:53 user nova-compute[73449]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 11:50:53 user nova-compute[73449]:     <boot dev="hd"/>
Aug 17 11:50:53 user nova-compute[73449]:     <smbios mode="sysinfo"/>
Aug 17 11:50:53 user nova-compute[73449]:   </os>
Aug 17 11:50:53 user nova-compute[73449]:   <features>
Aug 17 11:50:53 user nova-compute[73449]:     <acpi/>
Aug 17 11:50:53 user nova-compute[73449]:     <apic/>
Aug 17 11:50:53 user nova-compute[73449]:     <vmcoreinfo/>
Aug 17 11:50:53 user nova-compute[73449]:   </features>
Aug 17 11:50:53 user nova-compute[73449]:   <clock offset="utc">
Aug 17 11:50:53 user nova-compute[73449]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 11:50:53 user nova-compute[73449]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 11:50:53 user nova-compute[73449]:     <timer name="hpet" present="no"/>
Aug 17 11:50:53 user nova-compute[73449]:   </clock>
Aug 17 11:50:53 user nova-compute[73449]:   <cpu mode="custom" match="exact">
Aug 17 11:50:53 user nova-compute[73449]:     <model>Nehalem</model>
Aug 17 11:50:53 user nova-compute[73449]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 11:50:53 user nova-compute[73449]:   </cpu>
Aug 17 11:50:53 user nova-compute[73449]:   <devices>
Aug 17 11:50:53 user nova-compute[73449]:     <disk type="block" device="disk">
Aug 17 11:50:53 user nova-compute[73449]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 11:50:53 user nova-compute[73449]:       <source dev="/dev/sdd"/>
Aug 17 11:50:53 user nova-compute[73449]:       <target dev="vda" bus="virtio"/>
Aug 17 11:50:53 user nova-compute[73449]:       <serial>b6b06606-4920-4dce-bae0-3101c8b7dc6a</serial>
Aug 17 11:50:53 user nova-compute[73449]:     </disk>
Aug 17 11:50:53 user nova-compute[73449]:     <interface type="ethernet">
Aug 17 11:50:53 user nova-compute[73449]:       <mac address="fa:16:3e:04:f1:e3"/>
Aug 17 11:50:53 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 11:50:53 user nova-compute[73449]:       <mtu size="1442"/>
Aug 17 11:50:53 user nova-compute[73449]:       <target dev="tap9171abbc-1b"/>
Aug 17 11:50:53 user nova-compute[73449]:     </interface>
Aug 17 11:50:53 user nova-compute[73449]:     <serial type="pty">
Aug 17 11:50:53 user nova-compute[73449]:       <log file="/opt/stack/data/nova/instances/ec622bf0-4531-4892-b637-0ef564cf453b/console.log" append="off"/>
Aug 17 11:50:53 user nova-compute[73449]:     </serial>
Aug 17 11:50:53 user nova-compute[73449]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 11:50:53 user nova-compute[73449]:     <video>
Aug 17 11:50:53 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 11:50:53 user nova-compute[73449]:     </video>
Aug 17 11:50:53 user nova-compute[73449]:     <rng model="virtio">
Aug 17 11:50:53 user nova-compute[73449]:       <backend model="random">/dev/urandom</backend>
Aug 17 11:50:53 user nova-compute[73449]:     </rng>
Aug 17 11:50:53 user nova-compute[73449]:     <controller type="usb" index="0" model="none"/>
Aug 17 11:50:53 user nova-compute[73449]:     <memballoon model="virtio">
Aug 17 11:50:53 user nova-compute[73449]:       <stats period="10"/>
Aug 17 11:50:53 user nova-compute[73449]:     </memballoon>
Aug 17 11:50:53 user nova-compute[73449]:   </devices>
Aug 17 11:50:53 user nova-compute[73449]: </domain>
Aug 17 11:50:53 user nova-compute[73449]:  {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 11:50:53 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-77a78fca-afaa-45a1-9fc8-969a4d5f7b0f tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:50:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-629435938',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-629435938',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-629435938',id=27,image_ref='ef9117da-c36b-4ccd-99e6-5c467d02bc51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOK2OcMVVxjoiwv87EfFOwpDnVEUDpgnzjxdcAiMqg1Zd0jvED64BC7imQYzwdEI0TXX9FTXnHG36rHuOKJNhaM46tSbU4IvcWp6xK0GF1HveevStf9H+zYjkwzSz9mVrA==',key_name='tempest-keypair-180394528',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4bd46cdaff7a4b40955f7c8a12c55452',ramdisk_id='',reservation_id='r-ycfl4grz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-813872552',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-813872552-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-813872552',owner_user_name='tempest-TestVolumeBootPattern-813872552-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T11:50:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='804ccb0440fb46a4a4c0ae65c3893296',uuid=ec622bf0-4531-4892-b637-0ef564cf453b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9171abbc-1b7e-4008-93f4-3075f6b9b898", "address": "fa:16:3e:04:f1:e3", "network": {"id": "a9e8fcd6-4152-466b-99ad-44b85db05a05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-920564935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bd46cdaff7a4b40955f7c8a12c55452", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9171abbc-1b", "ovs_interfaceid": "9171abbc-1b7e-4008-93f4-3075f6b9b898", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 11:50:53 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-77a78fca-afaa-45a1-9fc8-969a4d5f7b0f tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Converting VIF {"id": "9171abbc-1b7e-4008-93f4-3075f6b9b898", "address": "fa:16:3e:04:f1:e3", "network": {"id": "a9e8fcd6-4152-466b-99ad-44b85db05a05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-920564935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bd46cdaff7a4b40955f7c8a12c55452", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9171abbc-1b", "ovs_interfaceid": "9171abbc-1b7e-4008-93f4-3075f6b9b898", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:50:53 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-77a78fca-afaa-45a1-9fc8-969a4d5f7b0f tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:f1:e3,bridge_name='br-int',has_traffic_filtering=True,id=9171abbc-1b7e-4008-93f4-3075f6b9b898,network=Network(a9e8fcd6-4152-466b-99ad-44b85db05a05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9171abbc-1b') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:50:53 user nova-compute[73449]: DEBUG os_vif [None req-77a78fca-afaa-45a1-9fc8-969a4d5f7b0f tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:f1:e3,bridge_name='br-int',has_traffic_filtering=True,id=9171abbc-1b7e-4008-93f4-3075f6b9b898,network=Network(a9e8fcd6-4152-466b-99ad-44b85db05a05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9171abbc-1b') {{(pid=73449) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 11:50:53 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:50:53 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:50:53 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 11:50:53 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:50:53 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9171abbc-1b, may_exist=True, interface_attrs={}) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:50:53 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9171abbc-1b, col_values=(('external_ids', {'iface-id': '9171abbc-1b7e-4008-93f4-3075f6b9b898', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:04:f1:e3', 'vm-uuid': 'ec622bf0-4531-4892-b637-0ef564cf453b'}),), if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:50:53 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:50:53 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:50:53 user nova-compute[73449]: INFO os_vif [None req-77a78fca-afaa-45a1-9fc8-969a4d5f7b0f tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:f1:e3,bridge_name='br-int',has_traffic_filtering=True,id=9171abbc-1b7e-4008-93f4-3075f6b9b898,network=Network(a9e8fcd6-4152-466b-99ad-44b85db05a05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9171abbc-1b')
Aug 17 11:50:53 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:50:53 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:50:53 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:50:53 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-77a78fca-afaa-45a1-9fc8-969a4d5f7b0f tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] No BDM found with device name vda, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 11:50:53 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-77a78fca-afaa-45a1-9fc8-969a4d5f7b0f tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] No VIF found with MAC fa:16:3e:04:f1:e3, not building metadata {{(pid=73449) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 11:50:54 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:50:54 user nova-compute[73449]: DEBUG nova.compute.manager [req-b425cc2e-9b03-478f-b483-af8e7935fcc7 req-bed8c2af-c5dc-45e1-8686-7d7acdefc0c4 service nova] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Received event network-vif-unplugged-5db97a8e-3943-4259-ae41-cec1946c33f8 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:50:54 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-b425cc2e-9b03-478f-b483-af8e7935fcc7 req-bed8c2af-c5dc-45e1-8686-7d7acdefc0c4 service nova] Acquiring lock "fea9f81c-a848-4a65-863e-e09dddf65bcf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:50:54 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-b425cc2e-9b03-478f-b483-af8e7935fcc7 req-bed8c2af-c5dc-45e1-8686-7d7acdefc0c4 service nova] Lock "fea9f81c-a848-4a65-863e-e09dddf65bcf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:50:54 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-b425cc2e-9b03-478f-b483-af8e7935fcc7 req-bed8c2af-c5dc-45e1-8686-7d7acdefc0c4 service nova] Lock "fea9f81c-a848-4a65-863e-e09dddf65bcf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:50:54 user nova-compute[73449]: DEBUG nova.compute.manager [req-b425cc2e-9b03-478f-b483-af8e7935fcc7 req-bed8c2af-c5dc-45e1-8686-7d7acdefc0c4 service nova] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] No waiting events found dispatching network-vif-unplugged-5db97a8e-3943-4259-ae41-cec1946c33f8 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:50:54 user nova-compute[73449]: WARNING nova.compute.manager [req-b425cc2e-9b03-478f-b483-af8e7935fcc7 req-bed8c2af-c5dc-45e1-8686-7d7acdefc0c4 service nova] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Received unexpected event network-vif-unplugged-5db97a8e-3943-4259-ae41-cec1946c33f8 for instance with vm_state active and task_state shelving.
Aug 17 11:50:54 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:50:54 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:50:54 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:50:54 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:50:54 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:50:55 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:50:55 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Instance destroyed successfully.
Aug 17 11:50:55 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-46e35214-09c1-4ac3-b2cc-f7adfbb5620a tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Beginning cold snapshot process
Aug 17 11:50:55 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:50:55 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:50:55 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:50:55 user nova-compute[73449]: DEBUG nova.privsep.utils [None req-46e35214-09c1-4ac3-b2cc-f7adfbb5620a tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73449) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 11:50:55 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-46e35214-09c1-4ac3-b2cc-f7adfbb5620a tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/fea9f81c-a848-4a65-863e-e09dddf65bcf/disk /opt/stack/data/nova/instances/snapshots/tmpm2_6nl3a/32ff495d837e48eba342598020dd311b {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:50:55 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:50:55 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:50:55 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73449) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 17 11:50:56 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:50:56 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:50:56 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:50:56 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:50:56 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:50:56 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:50:56 user nova-compute[73449]: DEBUG nova.compute.manager [req-db526cbe-b210-4c2e-8939-ebc797727f3a req-9791957b-9afc-44b2-a98e-fd07979a62ab service nova] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Received event network-vif-plugged-5db97a8e-3943-4259-ae41-cec1946c33f8 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:50:56 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-db526cbe-b210-4c2e-8939-ebc797727f3a req-9791957b-9afc-44b2-a98e-fd07979a62ab service nova] Acquiring lock "fea9f81c-a848-4a65-863e-e09dddf65bcf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:50:56 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-db526cbe-b210-4c2e-8939-ebc797727f3a req-9791957b-9afc-44b2-a98e-fd07979a62ab service nova] Lock "fea9f81c-a848-4a65-863e-e09dddf65bcf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:50:56 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-db526cbe-b210-4c2e-8939-ebc797727f3a req-9791957b-9afc-44b2-a98e-fd07979a62ab service nova] Lock "fea9f81c-a848-4a65-863e-e09dddf65bcf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:50:56 user nova-compute[73449]: DEBUG nova.compute.manager [req-db526cbe-b210-4c2e-8939-ebc797727f3a req-9791957b-9afc-44b2-a98e-fd07979a62ab service nova] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] No waiting events found dispatching network-vif-plugged-5db97a8e-3943-4259-ae41-cec1946c33f8 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:50:56 user nova-compute[73449]: WARNING nova.compute.manager [req-db526cbe-b210-4c2e-8939-ebc797727f3a req-9791957b-9afc-44b2-a98e-fd07979a62ab service nova] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Received unexpected event network-vif-plugged-5db97a8e-3943-4259-ae41-cec1946c33f8 for instance with vm_state active and task_state shelving_image_pending_upload.
Aug 17 11:50:56 user nova-compute[73449]: DEBUG nova.compute.manager [req-db526cbe-b210-4c2e-8939-ebc797727f3a req-9791957b-9afc-44b2-a98e-fd07979a62ab service nova] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Received event network-vif-plugged-5db97a8e-3943-4259-ae41-cec1946c33f8 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:50:56 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-db526cbe-b210-4c2e-8939-ebc797727f3a req-9791957b-9afc-44b2-a98e-fd07979a62ab service nova] Acquiring lock "fea9f81c-a848-4a65-863e-e09dddf65bcf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:50:56 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-db526cbe-b210-4c2e-8939-ebc797727f3a req-9791957b-9afc-44b2-a98e-fd07979a62ab service nova] Lock "fea9f81c-a848-4a65-863e-e09dddf65bcf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:50:56 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-db526cbe-b210-4c2e-8939-ebc797727f3a req-9791957b-9afc-44b2-a98e-fd07979a62ab service nova] Lock "fea9f81c-a848-4a65-863e-e09dddf65bcf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:50:56 user nova-compute[73449]: DEBUG nova.compute.manager [req-db526cbe-b210-4c2e-8939-ebc797727f3a req-9791957b-9afc-44b2-a98e-fd07979a62ab service nova] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] No waiting events found dispatching network-vif-plugged-5db97a8e-3943-4259-ae41-cec1946c33f8 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:50:56 user nova-compute[73449]: WARNING nova.compute.manager [req-db526cbe-b210-4c2e-8939-ebc797727f3a req-9791957b-9afc-44b2-a98e-fd07979a62ab service nova] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Received unexpected event network-vif-plugged-5db97a8e-3943-4259-ae41-cec1946c33f8 for instance with vm_state active and task_state shelving_image_pending_upload.
Aug 17 11:50:56 user nova-compute[73449]: DEBUG nova.compute.manager [req-db526cbe-b210-4c2e-8939-ebc797727f3a req-9791957b-9afc-44b2-a98e-fd07979a62ab service nova] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Received event network-vif-plugged-5db97a8e-3943-4259-ae41-cec1946c33f8 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:50:56 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-db526cbe-b210-4c2e-8939-ebc797727f3a req-9791957b-9afc-44b2-a98e-fd07979a62ab service nova] Acquiring lock "fea9f81c-a848-4a65-863e-e09dddf65bcf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:50:56 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-db526cbe-b210-4c2e-8939-ebc797727f3a req-9791957b-9afc-44b2-a98e-fd07979a62ab service nova] Lock "fea9f81c-a848-4a65-863e-e09dddf65bcf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:50:56 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-db526cbe-b210-4c2e-8939-ebc797727f3a req-9791957b-9afc-44b2-a98e-fd07979a62ab service nova] Lock "fea9f81c-a848-4a65-863e-e09dddf65bcf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:50:56 user nova-compute[73449]: DEBUG nova.compute.manager [req-db526cbe-b210-4c2e-8939-ebc797727f3a req-9791957b-9afc-44b2-a98e-fd07979a62ab service nova] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] No waiting events found dispatching network-vif-plugged-5db97a8e-3943-4259-ae41-cec1946c33f8 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:50:56 user nova-compute[73449]: WARNING nova.compute.manager [req-db526cbe-b210-4c2e-8939-ebc797727f3a req-9791957b-9afc-44b2-a98e-fd07979a62ab service nova] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Received unexpected event network-vif-plugged-5db97a8e-3943-4259-ae41-cec1946c33f8 for instance with vm_state active and task_state shelving_image_pending_upload.
Aug 17 11:50:56 user nova-compute[73449]: DEBUG nova.compute.manager [req-db526cbe-b210-4c2e-8939-ebc797727f3a req-9791957b-9afc-44b2-a98e-fd07979a62ab service nova] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Received event network-vif-unplugged-5db97a8e-3943-4259-ae41-cec1946c33f8 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:50:56 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-db526cbe-b210-4c2e-8939-ebc797727f3a req-9791957b-9afc-44b2-a98e-fd07979a62ab service nova] Acquiring lock "fea9f81c-a848-4a65-863e-e09dddf65bcf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:50:56 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-db526cbe-b210-4c2e-8939-ebc797727f3a req-9791957b-9afc-44b2-a98e-fd07979a62ab service nova] Lock "fea9f81c-a848-4a65-863e-e09dddf65bcf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:50:56 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-db526cbe-b210-4c2e-8939-ebc797727f3a req-9791957b-9afc-44b2-a98e-fd07979a62ab service nova] Lock "fea9f81c-a848-4a65-863e-e09dddf65bcf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:50:56 user nova-compute[73449]: DEBUG nova.compute.manager [req-db526cbe-b210-4c2e-8939-ebc797727f3a req-9791957b-9afc-44b2-a98e-fd07979a62ab service nova] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] No waiting events found dispatching network-vif-unplugged-5db97a8e-3943-4259-ae41-cec1946c33f8 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:50:56 user nova-compute[73449]: WARNING nova.compute.manager [req-db526cbe-b210-4c2e-8939-ebc797727f3a req-9791957b-9afc-44b2-a98e-fd07979a62ab service nova] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Received unexpected event network-vif-unplugged-5db97a8e-3943-4259-ae41-cec1946c33f8 for instance with vm_state active and task_state shelving_image_pending_upload.
Aug 17 11:50:56 user nova-compute[73449]: DEBUG nova.compute.manager [req-db526cbe-b210-4c2e-8939-ebc797727f3a req-9791957b-9afc-44b2-a98e-fd07979a62ab service nova] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Received event network-vif-plugged-5db97a8e-3943-4259-ae41-cec1946c33f8 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:50:56 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-db526cbe-b210-4c2e-8939-ebc797727f3a req-9791957b-9afc-44b2-a98e-fd07979a62ab service nova] Acquiring lock "fea9f81c-a848-4a65-863e-e09dddf65bcf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:50:56 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-db526cbe-b210-4c2e-8939-ebc797727f3a req-9791957b-9afc-44b2-a98e-fd07979a62ab service nova] Lock "fea9f81c-a848-4a65-863e-e09dddf65bcf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:50:56 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-db526cbe-b210-4c2e-8939-ebc797727f3a req-9791957b-9afc-44b2-a98e-fd07979a62ab service nova] Lock "fea9f81c-a848-4a65-863e-e09dddf65bcf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:50:56 user nova-compute[73449]: DEBUG nova.compute.manager [req-db526cbe-b210-4c2e-8939-ebc797727f3a req-9791957b-9afc-44b2-a98e-fd07979a62ab service nova] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] No waiting events found dispatching network-vif-plugged-5db97a8e-3943-4259-ae41-cec1946c33f8 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:50:56 user nova-compute[73449]: WARNING nova.compute.manager [req-db526cbe-b210-4c2e-8939-ebc797727f3a req-9791957b-9afc-44b2-a98e-fd07979a62ab service nova] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Received unexpected event network-vif-plugged-5db97a8e-3943-4259-ae41-cec1946c33f8 for instance with vm_state active and task_state shelving_image_pending_upload.
Aug 17 11:50:56 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:50:56 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:50:57 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-46e35214-09c1-4ac3-b2cc-f7adfbb5620a tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/fea9f81c-a848-4a65-863e-e09dddf65bcf/disk /opt/stack/data/nova/instances/snapshots/tmpm2_6nl3a/32ff495d837e48eba342598020dd311b" returned: 0 in 1.310s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:50:57 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-46e35214-09c1-4ac3-b2cc-f7adfbb5620a tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Snapshot extracted, beginning image upload
Aug 17 11:50:57 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:50:58 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:50:58 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:50:58 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:50:58 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Starting heal instance info cache {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 11:50:58 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Rebuilding the list of instances to heal {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 11:50:58 user nova-compute[73449]: DEBUG nova.compute.manager [req-eb07aabe-89a5-4c33-941d-3723f999cbea req-5972201e-c069-4b40-9050-d18fdd3de6bc service nova] [instance: ec622bf0-4531-4892-b637-0ef564cf453b] Received event network-vif-plugged-9171abbc-1b7e-4008-93f4-3075f6b9b898 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:50:58 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-eb07aabe-89a5-4c33-941d-3723f999cbea req-5972201e-c069-4b40-9050-d18fdd3de6bc service nova] Acquiring lock "ec622bf0-4531-4892-b637-0ef564cf453b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:50:58 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-eb07aabe-89a5-4c33-941d-3723f999cbea req-5972201e-c069-4b40-9050-d18fdd3de6bc service nova] Lock "ec622bf0-4531-4892-b637-0ef564cf453b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:50:58 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-eb07aabe-89a5-4c33-941d-3723f999cbea req-5972201e-c069-4b40-9050-d18fdd3de6bc service nova] Lock "ec622bf0-4531-4892-b637-0ef564cf453b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:50:58 user nova-compute[73449]: DEBUG nova.compute.manager [req-eb07aabe-89a5-4c33-941d-3723f999cbea req-5972201e-c069-4b40-9050-d18fdd3de6bc service nova] [instance: ec622bf0-4531-4892-b637-0ef564cf453b] No waiting events found dispatching network-vif-plugged-9171abbc-1b7e-4008-93f4-3075f6b9b898 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:50:58 user nova-compute[73449]: WARNING nova.compute.manager [req-eb07aabe-89a5-4c33-941d-3723f999cbea req-5972201e-c069-4b40-9050-d18fdd3de6bc service nova] [instance: ec622bf0-4531-4892-b637-0ef564cf453b] Received unexpected event network-vif-plugged-9171abbc-1b7e-4008-93f4-3075f6b9b898 for instance with vm_state building and task_state spawning.
Aug 17 11:50:58 user nova-compute[73449]: DEBUG nova.compute.manager [req-eb07aabe-89a5-4c33-941d-3723f999cbea req-5972201e-c069-4b40-9050-d18fdd3de6bc service nova] [instance: ec622bf0-4531-4892-b637-0ef564cf453b] Received event network-vif-plugged-9171abbc-1b7e-4008-93f4-3075f6b9b898 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:50:58 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-eb07aabe-89a5-4c33-941d-3723f999cbea req-5972201e-c069-4b40-9050-d18fdd3de6bc service nova] Acquiring lock "ec622bf0-4531-4892-b637-0ef564cf453b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:50:58 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-eb07aabe-89a5-4c33-941d-3723f999cbea req-5972201e-c069-4b40-9050-d18fdd3de6bc service nova] Lock "ec622bf0-4531-4892-b637-0ef564cf453b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:50:58 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-eb07aabe-89a5-4c33-941d-3723f999cbea req-5972201e-c069-4b40-9050-d18fdd3de6bc service nova] Lock "ec622bf0-4531-4892-b637-0ef564cf453b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:50:58 user nova-compute[73449]: DEBUG nova.compute.manager [req-eb07aabe-89a5-4c33-941d-3723f999cbea req-5972201e-c069-4b40-9050-d18fdd3de6bc service nova] [instance: ec622bf0-4531-4892-b637-0ef564cf453b] No waiting events found dispatching network-vif-plugged-9171abbc-1b7e-4008-93f4-3075f6b9b898 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:50:58 user nova-compute[73449]: WARNING nova.compute.manager [req-eb07aabe-89a5-4c33-941d-3723f999cbea req-5972201e-c069-4b40-9050-d18fdd3de6bc service nova] [instance: ec622bf0-4531-4892-b637-0ef564cf453b] Received unexpected event network-vif-plugged-9171abbc-1b7e-4008-93f4-3075f6b9b898 for instance with vm_state building and task_state spawning.
Aug 17 11:50:59 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: ec622bf0-4531-4892-b637-0ef564cf453b] Skipping network cache update for instance because it is Building. {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 17 11:50:59 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "refresh_cache-4a9e8ad2-19db-4975-87e4-2efce603a7d7" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:50:59 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquired lock "refresh_cache-4a9e8ad2-19db-4975-87e4-2efce603a7d7" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:50:59 user nova-compute[73449]: DEBUG nova.network.neutron [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: 4a9e8ad2-19db-4975-87e4-2efce603a7d7] Forcefully refreshing network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 11:50:59 user nova-compute[73449]: DEBUG nova.objects.instance [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lazy-loading 'info_cache' on Instance uuid 4a9e8ad2-19db-4975-87e4-2efce603a7d7 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:50:59 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692273059.5599606, ec622bf0-4531-4892-b637-0ef564cf453b => Resumed> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:50:59 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: ec622bf0-4531-4892-b637-0ef564cf453b] VM Resumed (Lifecycle Event)
Aug 17 11:50:59 user nova-compute[73449]: DEBUG nova.compute.manager [None req-77a78fca-afaa-45a1-9fc8-969a4d5f7b0f tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: ec622bf0-4531-4892-b637-0ef564cf453b] Instance event wait completed in 0 seconds for  {{(pid=73449) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 11:50:59 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-77a78fca-afaa-45a1-9fc8-969a4d5f7b0f tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: ec622bf0-4531-4892-b637-0ef564cf453b] Guest created on hypervisor {{(pid=73449) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 11:50:59 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: ec622bf0-4531-4892-b637-0ef564cf453b] Instance spawned successfully.
Aug 17 11:50:59 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-77a78fca-afaa-45a1-9fc8-969a4d5f7b0f tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: ec622bf0-4531-4892-b637-0ef564cf453b] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 11:50:59 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-77a78fca-afaa-45a1-9fc8-969a4d5f7b0f tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: ec622bf0-4531-4892-b637-0ef564cf453b] Found default for hw_input_bus of None {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:50:59 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-77a78fca-afaa-45a1-9fc8-969a4d5f7b0f tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: ec622bf0-4531-4892-b637-0ef564cf453b] Found default for hw_pointer_model of None {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:50:59 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: ec622bf0-4531-4892-b637-0ef564cf453b] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:50:59 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: ec622bf0-4531-4892-b637-0ef564cf453b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 11:50:59 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: ec622bf0-4531-4892-b637-0ef564cf453b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 11:50:59 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692273059.5621352, ec622bf0-4531-4892-b637-0ef564cf453b => Started> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:50:59 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: ec622bf0-4531-4892-b637-0ef564cf453b] VM Started (Lifecycle Event)
Aug 17 11:50:59 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: ec622bf0-4531-4892-b637-0ef564cf453b] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:50:59 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: ec622bf0-4531-4892-b637-0ef564cf453b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 11:50:59 user nova-compute[73449]: INFO nova.compute.manager [None req-77a78fca-afaa-45a1-9fc8-969a4d5f7b0f tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: ec622bf0-4531-4892-b637-0ef564cf453b] Took 7.62 seconds to spawn the instance on the hypervisor.
Aug 17 11:50:59 user nova-compute[73449]: DEBUG nova.compute.manager [None req-77a78fca-afaa-45a1-9fc8-969a4d5f7b0f tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: ec622bf0-4531-4892-b637-0ef564cf453b] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:50:59 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: ec622bf0-4531-4892-b637-0ef564cf453b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 11:50:59 user nova-compute[73449]: DEBUG nova.network.neutron [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: 4a9e8ad2-19db-4975-87e4-2efce603a7d7] Updating instance_info_cache with network_info: [{"id": "3c5f8e97-0654-42f0-9575-eab6d833283a", "address": "fa:16:3e:c8:b7:51", "network": {"id": "72c50a42-688f-4868-8e19-c40b103a49cd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1792423641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "068c5270255744a18208a0ad9b35f168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c5f8e97-06", "ovs_interfaceid": "3c5f8e97-0654-42f0-9575-eab6d833283a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:50:59 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Releasing lock "refresh_cache-4a9e8ad2-19db-4975-87e4-2efce603a7d7" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:50:59 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: 4a9e8ad2-19db-4975-87e4-2efce603a7d7] Updated the network info_cache for instance {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 11:50:59 user nova-compute[73449]: INFO nova.compute.manager [None req-77a78fca-afaa-45a1-9fc8-969a4d5f7b0f tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: ec622bf0-4531-4892-b637-0ef564cf453b] Took 30.37 seconds to build instance.
Aug 17 11:51:00 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-77a78fca-afaa-45a1-9fc8-969a4d5f7b0f tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Lock "ec622bf0-4531-4892-b637-0ef564cf453b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 30.491s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:51:00 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-46e35214-09c1-4ac3-b2cc-f7adfbb5620a tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Snapshot image upload complete
Aug 17 11:51:00 user nova-compute[73449]: DEBUG nova.compute.manager [None req-46e35214-09c1-4ac3-b2cc-f7adfbb5620a tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:51:00 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:51:00 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:51:01 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:51:01 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:51:01 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=73449) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 11:51:01 user nova-compute[73449]: INFO nova.compute.manager [None req-46e35214-09c1-4ac3-b2cc-f7adfbb5620a tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Shelve offloading
Aug 17 11:51:01 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Instance destroyed successfully.
Aug 17 11:51:01 user nova-compute[73449]: DEBUG nova.compute.manager [None req-46e35214-09c1-4ac3-b2cc-f7adfbb5620a tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:51:01 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-46e35214-09c1-4ac3-b2cc-f7adfbb5620a tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Acquiring lock "refresh_cache-fea9f81c-a848-4a65-863e-e09dddf65bcf" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:51:01 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-46e35214-09c1-4ac3-b2cc-f7adfbb5620a tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Acquired lock "refresh_cache-fea9f81c-a848-4a65-863e-e09dddf65bcf" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:51:01 user nova-compute[73449]: DEBUG nova.network.neutron [None req-46e35214-09c1-4ac3-b2cc-f7adfbb5620a tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Building network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 11:51:01 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd4ec7bd-002e-4a71-9314-96c21427af27/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:51:01 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd4ec7bd-002e-4a71-9314-96c21427af27/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:51:01 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd4ec7bd-002e-4a71-9314-96c21427af27/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:51:01 user nova-compute[73449]: DEBUG nova.network.neutron [None req-46e35214-09c1-4ac3-b2cc-f7adfbb5620a tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Updating instance_info_cache with network_info: [{"id": "5db97a8e-3943-4259-ae41-cec1946c33f8", "address": "fa:16:3e:c2:f3:5a", "network": {"id": "d56bc428-6be6-4aa9-b43c-9d4a0f1dd83b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-791364634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe7b5fee01a042bb90e40b18a84c82c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5db97a8e-39", "ovs_interfaceid": "5db97a8e-3943-4259-ae41-cec1946c33f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:51:01 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-46e35214-09c1-4ac3-b2cc-f7adfbb5620a tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Releasing lock "refresh_cache-fea9f81c-a848-4a65-863e-e09dddf65bcf" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:51:01 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd4ec7bd-002e-4a71-9314-96c21427af27/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:51:01 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fea9f81c-a848-4a65-863e-e09dddf65bcf/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:51:01 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fea9f81c-a848-4a65-863e-e09dddf65bcf/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:51:02 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fea9f81c-a848-4a65-863e-e09dddf65bcf/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:51:02 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fea9f81c-a848-4a65-863e-e09dddf65bcf/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:51:02 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=73449) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 11:51:02 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73449) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 11:51:02 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a9e8ad2-19db-4975-87e4-2efce603a7d7/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:51:02 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a9e8ad2-19db-4975-87e4-2efce603a7d7/disk --force-share --output=json" returned: 0 in 0.350s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:51:02 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a9e8ad2-19db-4975-87e4-2efce603a7d7/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:51:02 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Instance destroyed successfully.
Aug 17 11:51:02 user nova-compute[73449]: DEBUG nova.objects.instance [None req-46e35214-09c1-4ac3-b2cc-f7adfbb5620a tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Lazy-loading 'resources' on Instance uuid fea9f81c-a848-4a65-863e-e09dddf65bcf {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:51:02 user nova-compute[73449]: DEBUG nova.compute.manager [req-b1b7ea5c-37c2-4f1d-a1d5-0decfd2ba560 req-bb8e7395-ce64-4f76-b096-8f84bb10a87a service nova] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Received event network-changed-5db97a8e-3943-4259-ae41-cec1946c33f8 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:51:02 user nova-compute[73449]: DEBUG nova.compute.manager [req-b1b7ea5c-37c2-4f1d-a1d5-0decfd2ba560 req-bb8e7395-ce64-4f76-b096-8f84bb10a87a service nova] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Refreshing instance network info cache due to event network-changed-5db97a8e-3943-4259-ae41-cec1946c33f8. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 11:51:02 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-b1b7ea5c-37c2-4f1d-a1d5-0decfd2ba560 req-bb8e7395-ce64-4f76-b096-8f84bb10a87a service nova] Acquiring lock "refresh_cache-fea9f81c-a848-4a65-863e-e09dddf65bcf" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:51:02 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-b1b7ea5c-37c2-4f1d-a1d5-0decfd2ba560 req-bb8e7395-ce64-4f76-b096-8f84bb10a87a service nova] Acquired lock "refresh_cache-fea9f81c-a848-4a65-863e-e09dddf65bcf" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:51:02 user nova-compute[73449]: DEBUG nova.network.neutron [req-b1b7ea5c-37c2-4f1d-a1d5-0decfd2ba560 req-bb8e7395-ce64-4f76-b096-8f84bb10a87a service nova] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Refreshing network info cache for port 5db97a8e-3943-4259-ae41-cec1946c33f8 {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 11:51:02 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-46e35214-09c1-4ac3-b2cc-f7adfbb5620a tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:48:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2040756698',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2040756698',id=25,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFsRrS9Xoo8KEw47nic0apSNQihcGy2Dprwqysq5E8j0+8vyBEoJLy8MhfPnxnP5okmD+FgMjuWZuCPCrJvPG1PVoQ0IYOfI1fBkLBwSfjKGYTzfWWEpJ31p7U2edN/zYw==',key_name='tempest-keypair-553309548',keypairs=<?>,launch_index=0,launched_at=2023-08-17T11:49:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='fe7b5fee01a042bb90e40b18a84c82c0',ramdisk_id='',reservation_id='r-bo9d1umq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2080997856',owner_user_name='tempest-AttachVolumeShelveTestJSON-2080997856-project-member',shelved_at='2023-08-17T11:51:00.870118',shelved_host='user',shelved_image_id='b7edcc07-4d64-47f5-b9e4-97e581adba97'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T11:50:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='17ee7be9cdb14c5ca211a6b0bb80ccc1',uuid=fea9f81c-a848-4a65-863e-e09dddf65bcf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "5db97a8e-3943-4259-ae41-cec1946c33f8", "address": "fa:16:3e:c2:f3:5a", "network": {"id": "d56bc428-6be6-4aa9-b43c-9d4a0f1dd83b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-791364634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe7b5fee01a042bb90e40b18a84c82c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5db97a8e-39", "ovs_interfaceid": "5db97a8e-3943-4259-ae41-cec1946c33f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 11:51:02 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-46e35214-09c1-4ac3-b2cc-f7adfbb5620a tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Converting VIF {"id": "5db97a8e-3943-4259-ae41-cec1946c33f8", "address": "fa:16:3e:c2:f3:5a", "network": {"id": "d56bc428-6be6-4aa9-b43c-9d4a0f1dd83b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-791364634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe7b5fee01a042bb90e40b18a84c82c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5db97a8e-39", "ovs_interfaceid": "5db97a8e-3943-4259-ae41-cec1946c33f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:51:02 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-46e35214-09c1-4ac3-b2cc-f7adfbb5620a tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:f3:5a,bridge_name='br-int',has_traffic_filtering=True,id=5db97a8e-3943-4259-ae41-cec1946c33f8,network=Network(d56bc428-6be6-4aa9-b43c-9d4a0f1dd83b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5db97a8e-39') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:51:02 user nova-compute[73449]: DEBUG os_vif [None req-46e35214-09c1-4ac3-b2cc-f7adfbb5620a tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:f3:5a,bridge_name='br-int',has_traffic_filtering=True,id=5db97a8e-3943-4259-ae41-cec1946c33f8,network=Network(d56bc428-6be6-4aa9-b43c-9d4a0f1dd83b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5db97a8e-39') {{(pid=73449) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 11:51:02 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:51:02 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5db97a8e-39, bridge=br-int, if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:51:02 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:51:02 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:51:02 user nova-compute[73449]: INFO os_vif [None req-46e35214-09c1-4ac3-b2cc-f7adfbb5620a tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:f3:5a,bridge_name='br-int',has_traffic_filtering=True,id=5db97a8e-3943-4259-ae41-cec1946c33f8,network=Network(d56bc428-6be6-4aa9-b43c-9d4a0f1dd83b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5db97a8e-39')
Aug 17 11:51:02 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-46e35214-09c1-4ac3-b2cc-f7adfbb5620a tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Deleting instance files /opt/stack/data/nova/instances/fea9f81c-a848-4a65-863e-e09dddf65bcf_del
Aug 17 11:51:02 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-46e35214-09c1-4ac3-b2cc-f7adfbb5620a tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Deletion of /opt/stack/data/nova/instances/fea9f81c-a848-4a65-863e-e09dddf65bcf_del complete
Aug 17 11:51:02 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a9e8ad2-19db-4975-87e4-2efce603a7d7/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:51:02 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk.rescue --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:51:03 user nova-compute[73449]: INFO nova.scheduler.client.report [None req-46e35214-09c1-4ac3-b2cc-f7adfbb5620a tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Deleted allocations for instance fea9f81c-a848-4a65-863e-e09dddf65bcf
Aug 17 11:51:03 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-46e35214-09c1-4ac3-b2cc-f7adfbb5620a tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:51:03 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-46e35214-09c1-4ac3-b2cc-f7adfbb5620a tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:51:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk.rescue --force-share --output=json" returned: 0 in 0.266s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:51:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk.rescue --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:51:03 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:51:03 user nova-compute[73449]: DEBUG nova.objects.instance [None req-46e35214-09c1-4ac3-b2cc-f7adfbb5620a tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Lazy-loading 'numa_topology' on Instance uuid fea9f81c-a848-4a65-863e-e09dddf65bcf {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:51:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk.rescue --force-share --output=json" returned: 0 in 0.208s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:51:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:51:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:51:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:51:03 user nova-compute[73449]: DEBUG nova.network.neutron [req-b1b7ea5c-37c2-4f1d-a1d5-0decfd2ba560 req-bb8e7395-ce64-4f76-b096-8f84bb10a87a service nova] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Updated VIF entry in instance network info cache for port 5db97a8e-3943-4259-ae41-cec1946c33f8. {{(pid=73449) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 11:51:03 user nova-compute[73449]: DEBUG nova.network.neutron [req-b1b7ea5c-37c2-4f1d-a1d5-0decfd2ba560 req-bb8e7395-ce64-4f76-b096-8f84bb10a87a service nova] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Updating instance_info_cache with network_info: [{"id": "5db97a8e-3943-4259-ae41-cec1946c33f8", "address": "fa:16:3e:c2:f3:5a", "network": {"id": "d56bc428-6be6-4aa9-b43c-9d4a0f1dd83b", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-791364634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe7b5fee01a042bb90e40b18a84c82c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap5db97a8e-39", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:51:03 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-b1b7ea5c-37c2-4f1d-a1d5-0decfd2ba560 req-bb8e7395-ce64-4f76-b096-8f84bb10a87a service nova] Releasing lock "refresh_cache-fea9f81c-a848-4a65-863e-e09dddf65bcf" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:51:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:51:03 user nova-compute[73449]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692273048.832958, de5084e1-5a5e-48d2-a3ef-7f29898d1d2d => Stopped> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:51:03 user nova-compute[73449]: INFO nova.compute.manager [-] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] VM Stopped (Lifecycle Event)
Aug 17 11:51:03 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73449) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 11:51:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23ab9ffc-226d-4caa-8caa-9458de06a1c9/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:51:03 user nova-compute[73449]: DEBUG nova.compute.manager [None req-ba37165d-fa48-4221-a061-204c97f64e88 None None] [instance: de5084e1-5a5e-48d2-a3ef-7f29898d1d2d] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:51:03 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-46e35214-09c1-4ac3-b2cc-f7adfbb5620a tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 11:51:03 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-46e35214-09c1-4ac3-b2cc-f7adfbb5620a tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 11:51:04 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-46e35214-09c1-4ac3-b2cc-f7adfbb5620a tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.846s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:51:04 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23ab9ffc-226d-4caa-8caa-9458de06a1c9/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:51:04 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23ab9ffc-226d-4caa-8caa-9458de06a1c9/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:51:04 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-46e35214-09c1-4ac3-b2cc-f7adfbb5620a tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Lock "fea9f81c-a848-4a65-863e-e09dddf65bcf" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 10.672s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:51:04 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23ab9ffc-226d-4caa-8caa-9458de06a1c9/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:51:04 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d74c8f6-fb4e-4460-b722-674a8a1e2d25/disk.rescue --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:51:04 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d74c8f6-fb4e-4460-b722-674a8a1e2d25/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:51:04 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d74c8f6-fb4e-4460-b722-674a8a1e2d25/disk.rescue --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:51:04 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d74c8f6-fb4e-4460-b722-674a8a1e2d25/disk.rescue --force-share --output=json" returned: 0 in 0.227s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:51:04 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d74c8f6-fb4e-4460-b722-674a8a1e2d25/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:51:04 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d74c8f6-fb4e-4460-b722-674a8a1e2d25/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:51:04 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d74c8f6-fb4e-4460-b722-674a8a1e2d25/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:51:05 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d74c8f6-fb4e-4460-b722-674a8a1e2d25/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:51:05 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89440604-1daf-4e7a-a524-2f9c21a9cb96/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:51:05 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89440604-1daf-4e7a-a524-2f9c21a9cb96/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:51:05 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89440604-1daf-4e7a-a524-2f9c21a9cb96/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:51:05 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-f6e9766f-8f49-4c32-b87f-f48447d3b216 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Acquiring lock "9e689bc9-6625-46b7-90d0-52c50f9b73e6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:51:05 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-f6e9766f-8f49-4c32-b87f-f48447d3b216 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Lock "9e689bc9-6625-46b7-90d0-52c50f9b73e6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:51:05 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89440604-1daf-4e7a-a524-2f9c21a9cb96/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:51:05 user nova-compute[73449]: DEBUG nova.compute.manager [None req-f6e9766f-8f49-4c32-b87f-f48447d3b216 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] [instance: 9e689bc9-6625-46b7-90d0-52c50f9b73e6] Starting instance... {{(pid=73449) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 11:51:05 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d468854-6182-49c8-acb7-0641df2d5219/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:51:05 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-f6e9766f-8f49-4c32-b87f-f48447d3b216 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:51:05 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-f6e9766f-8f49-4c32-b87f-f48447d3b216 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:51:05 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-f6e9766f-8f49-4c32-b87f-f48447d3b216 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73449) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 11:51:05 user nova-compute[73449]: INFO nova.compute.claims [None req-f6e9766f-8f49-4c32-b87f-f48447d3b216 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] [instance: 9e689bc9-6625-46b7-90d0-52c50f9b73e6] Claim successful on node user
Aug 17 11:51:06 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d468854-6182-49c8-acb7-0641df2d5219/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:51:06 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d468854-6182-49c8-acb7-0641df2d5219/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:51:06 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d468854-6182-49c8-acb7-0641df2d5219/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:51:06 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73449) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 11:51:06 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:51:06 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:51:06 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Hypervisor/Node resource view: name=user free_ram=7184MB free_disk=25.230209350585938GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73449) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 11:51:06 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:51:07 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-f6e9766f-8f49-4c32-b87f-f48447d3b216 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 11:51:07 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-f6e9766f-8f49-4c32-b87f-f48447d3b216 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 11:51:07 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-f6e9766f-8f49-4c32-b87f-f48447d3b216 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.209s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:51:07 user nova-compute[73449]: DEBUG nova.compute.manager [None req-f6e9766f-8f49-4c32-b87f-f48447d3b216 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] [instance: 9e689bc9-6625-46b7-90d0-52c50f9b73e6] Start building networks asynchronously for instance. {{(pid=73449) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 11:51:07 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.274s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:51:07 user nova-compute[73449]: DEBUG nova.compute.manager [None req-f6e9766f-8f49-4c32-b87f-f48447d3b216 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] [instance: 9e689bc9-6625-46b7-90d0-52c50f9b73e6] Allocating IP information in the background. {{(pid=73449) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 11:51:07 user nova-compute[73449]: DEBUG nova.network.neutron [None req-f6e9766f-8f49-4c32-b87f-f48447d3b216 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] [instance: 9e689bc9-6625-46b7-90d0-52c50f9b73e6] allocate_for_instance() {{(pid=73449) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 11:51:07 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-f6e9766f-8f49-4c32-b87f-f48447d3b216 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] [instance: 9e689bc9-6625-46b7-90d0-52c50f9b73e6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 11:51:07 user nova-compute[73449]: DEBUG nova.compute.manager [None req-f6e9766f-8f49-4c32-b87f-f48447d3b216 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] [instance: 9e689bc9-6625-46b7-90d0-52c50f9b73e6] Start building block device mappings for instance. {{(pid=73449) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 11:51:07 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Applying migration context for instance 3d468854-6182-49c8-acb7-0641df2d5219 as it has an incoming, in-progress migration 8bca2c78-a7cb-4f23-ae39-18f96e45b9f4. Migration status is finished {{(pid=73449) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 17 11:51:07 user nova-compute[73449]: INFO nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Updating resource usage from migration 8bca2c78-a7cb-4f23-ae39-18f96e45b9f4
Aug 17 11:51:07 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 4a9e8ad2-19db-4975-87e4-2efce603a7d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:51:07 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 3d74c8f6-fb4e-4460-b722-674a8a1e2d25 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:51:07 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance ae75d334-431a-4008-8b3d-f2a727d92417 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:51:07 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:51:07 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance dd4ec7bd-002e-4a71-9314-96c21427af27 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:51:07 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Migration 8bca2c78-a7cb-4f23-ae39-18f96e45b9f4 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 17 11:51:07 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 3d468854-6182-49c8-acb7-0641df2d5219 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:51:07 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 5612f7d1-a901-4bdd-a24a-faf9a980cd04 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:51:07 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 89440604-1daf-4e7a-a524-2f9c21a9cb96 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:51:07 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance ec622bf0-4531-4892-b637-0ef564cf453b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:51:07 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 23ab9ffc-226d-4caa-8caa-9458de06a1c9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:51:07 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 9e689bc9-6625-46b7-90d0-52c50f9b73e6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:51:07 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=73449) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 11:51:07 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=28GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=73449) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 11:51:07 user nova-compute[73449]: DEBUG nova.policy [None req-f6e9766f-8f49-4c32-b87f-f48447d3b216 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '24c0eff502f744ad8eb6359e320852d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348b0a78aaf940b98f91655ddd6d4d6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73449) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 11:51:07 user nova-compute[73449]: DEBUG nova.compute.manager [None req-f6e9766f-8f49-4c32-b87f-f48447d3b216 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] [instance: 9e689bc9-6625-46b7-90d0-52c50f9b73e6] Start spawning the instance on the hypervisor. {{(pid=73449) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 11:51:07 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-f6e9766f-8f49-4c32-b87f-f48447d3b216 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] [instance: 9e689bc9-6625-46b7-90d0-52c50f9b73e6] Creating instance directory {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 11:51:07 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-f6e9766f-8f49-4c32-b87f-f48447d3b216 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] [instance: 9e689bc9-6625-46b7-90d0-52c50f9b73e6] Creating image(s)
Aug 17 11:51:07 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-f6e9766f-8f49-4c32-b87f-f48447d3b216 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Acquiring lock "/opt/stack/data/nova/instances/9e689bc9-6625-46b7-90d0-52c50f9b73e6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:51:07 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-f6e9766f-8f49-4c32-b87f-f48447d3b216 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Lock "/opt/stack/data/nova/instances/9e689bc9-6625-46b7-90d0-52c50f9b73e6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:51:07 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-f6e9766f-8f49-4c32-b87f-f48447d3b216 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Lock "/opt/stack/data/nova/instances/9e689bc9-6625-46b7-90d0-52c50f9b73e6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:51:07 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-f6e9766f-8f49-4c32-b87f-f48447d3b216 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:51:07 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-f6e9766f-8f49-4c32-b87f-f48447d3b216 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json" returned: 0 in 0.236s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:51:07 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-f6e9766f-8f49-4c32-b87f-f48447d3b216 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Acquiring lock "7e267a577c062ee862e95ede6b48cfd5632f3ea3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:51:07 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-f6e9766f-8f49-4c32-b87f-f48447d3b216 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Lock "7e267a577c062ee862e95ede6b48cfd5632f3ea3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:51:07 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-f6e9766f-8f49-4c32-b87f-f48447d3b216 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:51:07 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:51:07 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 11:51:07 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 11:51:07 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-f6e9766f-8f49-4c32-b87f-f48447d3b216 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json" returned: 0 in 0.197s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:51:07 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-f6e9766f-8f49-4c32-b87f-f48447d3b216 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3,backing_fmt=raw /opt/stack/data/nova/instances/9e689bc9-6625-46b7-90d0-52c50f9b73e6/disk 1073741824 {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:51:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-f6e9766f-8f49-4c32-b87f-f48447d3b216 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3,backing_fmt=raw /opt/stack/data/nova/instances/9e689bc9-6625-46b7-90d0-52c50f9b73e6/disk 1073741824" returned: 0 in 0.110s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:51:08 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-f6e9766f-8f49-4c32-b87f-f48447d3b216 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Lock "7e267a577c062ee862e95ede6b48cfd5632f3ea3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.314s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:51:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-f6e9766f-8f49-4c32-b87f-f48447d3b216 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:51:08 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:51:08 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Compute_service record updated for user:user {{(pid=73449) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 11:51:08 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.119s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:51:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-f6e9766f-8f49-4c32-b87f-f48447d3b216 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json" returned: 0 in 0.312s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:51:08 user nova-compute[73449]: DEBUG nova.virt.disk.api [None req-f6e9766f-8f49-4c32-b87f-f48447d3b216 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9e689bc9-6625-46b7-90d0-52c50f9b73e6/disk. size=1073741824 {{(pid=73449) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 11:51:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-f6e9766f-8f49-4c32-b87f-f48447d3b216 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e689bc9-6625-46b7-90d0-52c50f9b73e6/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:51:08 user nova-compute[73449]: DEBUG nova.network.neutron [None req-f6e9766f-8f49-4c32-b87f-f48447d3b216 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] [instance: 9e689bc9-6625-46b7-90d0-52c50f9b73e6] Successfully created port: 7de7b2c0-d9e0-4e1a-bf74-2a477c16b514 {{(pid=73449) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 11:51:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-f6e9766f-8f49-4c32-b87f-f48447d3b216 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e689bc9-6625-46b7-90d0-52c50f9b73e6/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:51:08 user nova-compute[73449]: DEBUG nova.virt.disk.api [None req-f6e9766f-8f49-4c32-b87f-f48447d3b216 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Cannot resize image /opt/stack/data/nova/instances/9e689bc9-6625-46b7-90d0-52c50f9b73e6/disk to a smaller size. {{(pid=73449) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 11:51:08 user nova-compute[73449]: DEBUG nova.objects.instance [None req-f6e9766f-8f49-4c32-b87f-f48447d3b216 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Lazy-loading 'migration_context' on Instance uuid 9e689bc9-6625-46b7-90d0-52c50f9b73e6 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:51:08 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-f6e9766f-8f49-4c32-b87f-f48447d3b216 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] [instance: 9e689bc9-6625-46b7-90d0-52c50f9b73e6] Created local disks {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 11:51:08 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-f6e9766f-8f49-4c32-b87f-f48447d3b216 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] [instance: 9e689bc9-6625-46b7-90d0-52c50f9b73e6] Ensure instance console log exists: /opt/stack/data/nova/instances/9e689bc9-6625-46b7-90d0-52c50f9b73e6/console.log {{(pid=73449) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 11:51:08 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-f6e9766f-8f49-4c32-b87f-f48447d3b216 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:51:08 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-f6e9766f-8f49-4c32-b87f-f48447d3b216 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:51:08 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-f6e9766f-8f49-4c32-b87f-f48447d3b216 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:51:09 user nova-compute[73449]: DEBUG nova.network.neutron [None req-f6e9766f-8f49-4c32-b87f-f48447d3b216 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] [instance: 9e689bc9-6625-46b7-90d0-52c50f9b73e6] Successfully updated port: 7de7b2c0-d9e0-4e1a-bf74-2a477c16b514 {{(pid=73449) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 11:51:09 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-f6e9766f-8f49-4c32-b87f-f48447d3b216 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Acquiring lock "refresh_cache-9e689bc9-6625-46b7-90d0-52c50f9b73e6" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:51:09 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-f6e9766f-8f49-4c32-b87f-f48447d3b216 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Acquired lock "refresh_cache-9e689bc9-6625-46b7-90d0-52c50f9b73e6" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:51:09 user nova-compute[73449]: DEBUG nova.network.neutron [None req-f6e9766f-8f49-4c32-b87f-f48447d3b216 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] [instance: 9e689bc9-6625-46b7-90d0-52c50f9b73e6] Building network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 11:51:09 user nova-compute[73449]: DEBUG nova.compute.manager [req-27f8509e-83de-4bdf-b2a2-f43d4cd1cf3c req-e6bc0653-9982-4a3e-897d-09addd8f7f45 service nova] [instance: 9e689bc9-6625-46b7-90d0-52c50f9b73e6] Received event network-changed-7de7b2c0-d9e0-4e1a-bf74-2a477c16b514 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:51:09 user nova-compute[73449]: DEBUG nova.compute.manager [req-27f8509e-83de-4bdf-b2a2-f43d4cd1cf3c req-e6bc0653-9982-4a3e-897d-09addd8f7f45 service nova] [instance: 9e689bc9-6625-46b7-90d0-52c50f9b73e6] Refreshing instance network info cache due to event network-changed-7de7b2c0-d9e0-4e1a-bf74-2a477c16b514. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 11:51:09 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-27f8509e-83de-4bdf-b2a2-f43d4cd1cf3c req-e6bc0653-9982-4a3e-897d-09addd8f7f45 service nova] Acquiring lock "refresh_cache-9e689bc9-6625-46b7-90d0-52c50f9b73e6" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:51:09 user nova-compute[73449]: DEBUG nova.network.neutron [None req-f6e9766f-8f49-4c32-b87f-f48447d3b216 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] [instance: 9e689bc9-6625-46b7-90d0-52c50f9b73e6] Instance cache missing network info. {{(pid=73449) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 11:51:09 user nova-compute[73449]: DEBUG nova.network.neutron [None req-f6e9766f-8f49-4c32-b87f-f48447d3b216 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] [instance: 9e689bc9-6625-46b7-90d0-52c50f9b73e6] Updating instance_info_cache with network_info: [{"id": "7de7b2c0-d9e0-4e1a-bf74-2a477c16b514", "address": "fa:16:3e:08:89:a4", "network": {"id": "bae20193-cae3-45f8-8881-68020cd853e9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-459774400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "348b0a78aaf940b98f91655ddd6d4d6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7de7b2c0-d9", "ovs_interfaceid": "7de7b2c0-d9e0-4e1a-bf74-2a477c16b514", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:51:09 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-f6e9766f-8f49-4c32-b87f-f48447d3b216 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Releasing lock "refresh_cache-9e689bc9-6625-46b7-90d0-52c50f9b73e6" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:51:09 user nova-compute[73449]: DEBUG nova.compute.manager [None req-f6e9766f-8f49-4c32-b87f-f48447d3b216 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] [instance: 9e689bc9-6625-46b7-90d0-52c50f9b73e6] Instance network_info: |[{"id": "7de7b2c0-d9e0-4e1a-bf74-2a477c16b514", "address": "fa:16:3e:08:89:a4", "network": {"id": "bae20193-cae3-45f8-8881-68020cd853e9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-459774400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "348b0a78aaf940b98f91655ddd6d4d6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7de7b2c0-d9", "ovs_interfaceid": "7de7b2c0-d9e0-4e1a-bf74-2a477c16b514", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73449) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 11:51:09 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-27f8509e-83de-4bdf-b2a2-f43d4cd1cf3c req-e6bc0653-9982-4a3e-897d-09addd8f7f45 service nova] Acquired lock "refresh_cache-9e689bc9-6625-46b7-90d0-52c50f9b73e6" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:51:09 user nova-compute[73449]: DEBUG nova.network.neutron [req-27f8509e-83de-4bdf-b2a2-f43d4cd1cf3c req-e6bc0653-9982-4a3e-897d-09addd8f7f45 service nova] [instance: 9e689bc9-6625-46b7-90d0-52c50f9b73e6] Refreshing network info cache for port 7de7b2c0-d9e0-4e1a-bf74-2a477c16b514 {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 11:51:09 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-f6e9766f-8f49-4c32-b87f-f48447d3b216 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] [instance: 9e689bc9-6625-46b7-90d0-52c50f9b73e6] Start _get_guest_xml network_info=[{"id": "7de7b2c0-d9e0-4e1a-bf74-2a477c16b514", "address": "fa:16:3e:08:89:a4", "network": {"id": "bae20193-cae3-45f8-8881-68020cd853e9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-459774400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "348b0a78aaf940b98f91655ddd6d4d6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7de7b2c0-d9", "ovs_interfaceid": "7de7b2c0-d9e0-4e1a-bf74-2a477c16b514", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T11:36:11Z,direct_url=<?>,disk_format='qcow2',id=0a2904ae-083d-41c8-83db-343132b36148,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7a77880136a54ef195c82e018e1939db',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T11:36:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': '0a2904ae-083d-41c8-83db-343132b36148'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 11:51:09 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-f6e9766f-8f49-4c32-b87f-f48447d3b216 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:51:09 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-f6e9766f-8f49-4c32-b87f-f48447d3b216 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:51:09 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-f6e9766f-8f49-4c32-b87f-f48447d3b216 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 11:51:09 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-f6e9766f-8f49-4c32-b87f-f48447d3b216 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] CPU controller missing on host. {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 11:51:09 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-f6e9766f-8f49-4c32-b87f-f48447d3b216 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 11:51:09 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-f6e9766f-8f49-4c32-b87f-f48447d3b216 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] CPU controller found on host. {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 11:51:09 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-f6e9766f-8f49-4c32-b87f-f48447d3b216 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73449) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 11:51:09 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-f6e9766f-8f49-4c32-b87f-f48447d3b216 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T11:35:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T11:36:11Z,direct_url=<?>,disk_format='qcow2',id=0a2904ae-083d-41c8-83db-343132b36148,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7a77880136a54ef195c82e018e1939db',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T11:36:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 11:51:09 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-f6e9766f-8f49-4c32-b87f-f48447d3b216 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Flavor limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 11:51:09 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-f6e9766f-8f49-4c32-b87f-f48447d3b216 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Image limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 11:51:09 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-f6e9766f-8f49-4c32-b87f-f48447d3b216 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Flavor pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 11:51:09 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-f6e9766f-8f49-4c32-b87f-f48447d3b216 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Image pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 11:51:09 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-f6e9766f-8f49-4c32-b87f-f48447d3b216 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 11:51:09 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-f6e9766f-8f49-4c32-b87f-f48447d3b216 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 11:51:09 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-f6e9766f-8f49-4c32-b87f-f48447d3b216 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 11:51:09 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-f6e9766f-8f49-4c32-b87f-f48447d3b216 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Got 1 possible topologies {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 11:51:09 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-f6e9766f-8f49-4c32-b87f-f48447d3b216 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 11:51:09 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-f6e9766f-8f49-4c32-b87f-f48447d3b216 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 11:51:09 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-f6e9766f-8f49-4c32-b87f-f48447d3b216 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:51:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1399464348',display_name='tempest-VolumesSnapshotTestJSON-instance-1399464348',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1399464348',id=29,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPmavZYYqznf3Yd/qhYLmK2E1i3d9bVWspYCaKhSmEwiuWpwC0dL6Va7IUZ+OY5YCQy+ngJfPupmVDo/Hvga1LgbFxTILMHuFleJawMfA7RHUiTElw0JRF+ztS3k9us+xw==',key_name='tempest-keypair-1459240909',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='348b0a78aaf940b98f91655ddd6d4d6d',ramdisk_id='',reservation_id='r-4a5860fs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-363415870',owner_user_name='tempest-VolumesSnapshotTestJSON-363415870-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T11:51:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='24c0eff502f744ad8eb6359e320852d4',uuid=9e689bc9-6625-46b7-90d0-52c50f9b73e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7de7b2c0-d9e0-4e1a-bf74-2a477c16b514", "address": "fa:16:3e:08:89:a4", "network": {"id": "bae20193-cae3-45f8-8881-68020cd853e9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-459774400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "348b0a78aaf940b98f91655ddd6d4d6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7de7b2c0-d9", "ovs_interfaceid": "7de7b2c0-d9e0-4e1a-bf74-2a477c16b514", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73449) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 11:51:09 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-f6e9766f-8f49-4c32-b87f-f48447d3b216 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Converting VIF {"id": "7de7b2c0-d9e0-4e1a-bf74-2a477c16b514", "address": "fa:16:3e:08:89:a4", "network": {"id": "bae20193-cae3-45f8-8881-68020cd853e9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-459774400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "348b0a78aaf940b98f91655ddd6d4d6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7de7b2c0-d9", "ovs_interfaceid": "7de7b2c0-d9e0-4e1a-bf74-2a477c16b514", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:51:09 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-f6e9766f-8f49-4c32-b87f-f48447d3b216 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:89:a4,bridge_name='br-int',has_traffic_filtering=True,id=7de7b2c0-d9e0-4e1a-bf74-2a477c16b514,network=Network(bae20193-cae3-45f8-8881-68020cd853e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7de7b2c0-d9') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:51:09 user nova-compute[73449]: DEBUG nova.objects.instance [None req-f6e9766f-8f49-4c32-b87f-f48447d3b216 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Lazy-loading 'pci_devices' on Instance uuid 9e689bc9-6625-46b7-90d0-52c50f9b73e6 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:51:09 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-f6e9766f-8f49-4c32-b87f-f48447d3b216 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] [instance: 9e689bc9-6625-46b7-90d0-52c50f9b73e6] End _get_guest_xml xml=<domain type="kvm">
Aug 17 11:51:09 user nova-compute[73449]:   <uuid>9e689bc9-6625-46b7-90d0-52c50f9b73e6</uuid>
Aug 17 11:51:09 user nova-compute[73449]:   <name>instance-0000001d</name>
Aug 17 11:51:09 user nova-compute[73449]:   <memory>524288</memory>
Aug 17 11:51:09 user nova-compute[73449]:   <vcpu>1</vcpu>
Aug 17 11:51:09 user nova-compute[73449]:   <metadata>
Aug 17 11:51:09 user nova-compute[73449]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 11:51:09 user nova-compute[73449]:       <nova:package version="0.0.0"/>
Aug 17 11:51:09 user nova-compute[73449]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1399464348</nova:name>
Aug 17 11:51:09 user nova-compute[73449]:       <nova:creationTime>2023-08-17 11:51:09</nova:creationTime>
Aug 17 11:51:09 user nova-compute[73449]:       <nova:flavor name="m1.tiny">
Aug 17 11:51:09 user nova-compute[73449]:         <nova:memory>512</nova:memory>
Aug 17 11:51:09 user nova-compute[73449]:         <nova:disk>1</nova:disk>
Aug 17 11:51:09 user nova-compute[73449]:         <nova:swap>0</nova:swap>
Aug 17 11:51:09 user nova-compute[73449]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 11:51:09 user nova-compute[73449]:         <nova:vcpus>1</nova:vcpus>
Aug 17 11:51:09 user nova-compute[73449]:       </nova:flavor>
Aug 17 11:51:09 user nova-compute[73449]:       <nova:owner>
Aug 17 11:51:09 user nova-compute[73449]:         <nova:user uuid="24c0eff502f744ad8eb6359e320852d4">tempest-VolumesSnapshotTestJSON-363415870-project-member</nova:user>
Aug 17 11:51:09 user nova-compute[73449]:         <nova:project uuid="348b0a78aaf940b98f91655ddd6d4d6d">tempest-VolumesSnapshotTestJSON-363415870</nova:project>
Aug 17 11:51:09 user nova-compute[73449]:       </nova:owner>
Aug 17 11:51:09 user nova-compute[73449]:       <nova:root type="image" uuid="0a2904ae-083d-41c8-83db-343132b36148"/>
Aug 17 11:51:09 user nova-compute[73449]:       <nova:ports>
Aug 17 11:51:09 user nova-compute[73449]:         <nova:port uuid="7de7b2c0-d9e0-4e1a-bf74-2a477c16b514">
Aug 17 11:51:09 user nova-compute[73449]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 17 11:51:09 user nova-compute[73449]:         </nova:port>
Aug 17 11:51:09 user nova-compute[73449]:       </nova:ports>
Aug 17 11:51:09 user nova-compute[73449]:     </nova:instance>
Aug 17 11:51:09 user nova-compute[73449]:   </metadata>
Aug 17 11:51:09 user nova-compute[73449]:   <sysinfo type="smbios">
Aug 17 11:51:09 user nova-compute[73449]:     <system>
Aug 17 11:51:09 user nova-compute[73449]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 11:51:09 user nova-compute[73449]:       <entry name="product">OpenStack Nova</entry>
Aug 17 11:51:09 user nova-compute[73449]:       <entry name="version">0.0.0</entry>
Aug 17 11:51:09 user nova-compute[73449]:       <entry name="serial">9e689bc9-6625-46b7-90d0-52c50f9b73e6</entry>
Aug 17 11:51:09 user nova-compute[73449]:       <entry name="uuid">9e689bc9-6625-46b7-90d0-52c50f9b73e6</entry>
Aug 17 11:51:09 user nova-compute[73449]:       <entry name="family">Virtual Machine</entry>
Aug 17 11:51:09 user nova-compute[73449]:     </system>
Aug 17 11:51:09 user nova-compute[73449]:   </sysinfo>
Aug 17 11:51:09 user nova-compute[73449]:   <os>
Aug 17 11:51:09 user nova-compute[73449]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 11:51:09 user nova-compute[73449]:     <boot dev="hd"/>
Aug 17 11:51:09 user nova-compute[73449]:     <smbios mode="sysinfo"/>
Aug 17 11:51:09 user nova-compute[73449]:   </os>
Aug 17 11:51:09 user nova-compute[73449]:   <features>
Aug 17 11:51:09 user nova-compute[73449]:     <acpi/>
Aug 17 11:51:09 user nova-compute[73449]:     <apic/>
Aug 17 11:51:09 user nova-compute[73449]:     <vmcoreinfo/>
Aug 17 11:51:09 user nova-compute[73449]:   </features>
Aug 17 11:51:09 user nova-compute[73449]:   <clock offset="utc">
Aug 17 11:51:09 user nova-compute[73449]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 11:51:09 user nova-compute[73449]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 11:51:09 user nova-compute[73449]:     <timer name="hpet" present="no"/>
Aug 17 11:51:09 user nova-compute[73449]:   </clock>
Aug 17 11:51:09 user nova-compute[73449]:   <cpu mode="custom" match="exact">
Aug 17 11:51:09 user nova-compute[73449]:     <model>Nehalem</model>
Aug 17 11:51:09 user nova-compute[73449]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 11:51:09 user nova-compute[73449]:   </cpu>
Aug 17 11:51:09 user nova-compute[73449]:   <devices>
Aug 17 11:51:09 user nova-compute[73449]:     <disk type="file" device="disk">
Aug 17 11:51:09 user nova-compute[73449]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 11:51:09 user nova-compute[73449]:       <source file="/opt/stack/data/nova/instances/9e689bc9-6625-46b7-90d0-52c50f9b73e6/disk"/>
Aug 17 11:51:09 user nova-compute[73449]:       <target dev="vda" bus="virtio"/>
Aug 17 11:51:09 user nova-compute[73449]:     </disk>
Aug 17 11:51:09 user nova-compute[73449]:     <interface type="ethernet">
Aug 17 11:51:09 user nova-compute[73449]:       <mac address="fa:16:3e:08:89:a4"/>
Aug 17 11:51:09 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 11:51:09 user nova-compute[73449]:       <mtu size="1442"/>
Aug 17 11:51:09 user nova-compute[73449]:       <target dev="tap7de7b2c0-d9"/>
Aug 17 11:51:09 user nova-compute[73449]:     </interface>
Aug 17 11:51:09 user nova-compute[73449]:     <serial type="pty">
Aug 17 11:51:09 user nova-compute[73449]:       <log file="/opt/stack/data/nova/instances/9e689bc9-6625-46b7-90d0-52c50f9b73e6/console.log" append="off"/>
Aug 17 11:51:09 user nova-compute[73449]:     </serial>
Aug 17 11:51:09 user nova-compute[73449]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 11:51:09 user nova-compute[73449]:     <video>
Aug 17 11:51:09 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 11:51:09 user nova-compute[73449]:     </video>
Aug 17 11:51:09 user nova-compute[73449]:     <rng model="virtio">
Aug 17 11:51:09 user nova-compute[73449]:       <backend model="random">/dev/urandom</backend>
Aug 17 11:51:09 user nova-compute[73449]:     </rng>
Aug 17 11:51:09 user nova-compute[73449]:     <controller type="usb" index="0" model="none"/>
Aug 17 11:51:09 user nova-compute[73449]:     <memballoon model="virtio">
Aug 17 11:51:09 user nova-compute[73449]:       <stats period="10"/>
Aug 17 11:51:09 user nova-compute[73449]:     </memballoon>
Aug 17 11:51:09 user nova-compute[73449]:   </devices>
Aug 17 11:51:09 user nova-compute[73449]: </domain>
Aug 17 11:51:09 user nova-compute[73449]:  {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 11:51:09 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-f6e9766f-8f49-4c32-b87f-f48447d3b216 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:51:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1399464348',display_name='tempest-VolumesSnapshotTestJSON-instance-1399464348',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1399464348',id=29,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPmavZYYqznf3Yd/qhYLmK2E1i3d9bVWspYCaKhSmEwiuWpwC0dL6Va7IUZ+OY5YCQy+ngJfPupmVDo/Hvga1LgbFxTILMHuFleJawMfA7RHUiTElw0JRF+ztS3k9us+xw==',key_name='tempest-keypair-1459240909',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='348b0a78aaf940b98f91655ddd6d4d6d',ramdisk_id='',reservation_id='r-4a5860fs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-363415870',owner_user_name='tempest-VolumesSnapshotTestJSON-363415870-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T11:51:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='24c0eff502f744ad8eb6359e320852d4',uuid=9e689bc9-6625-46b7-90d0-52c50f9b73e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7de7b2c0-d9e0-4e1a-bf74-2a477c16b514", "address": "fa:16:3e:08:89:a4", "network": {"id": "bae20193-cae3-45f8-8881-68020cd853e9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-459774400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "348b0a78aaf940b98f91655ddd6d4d6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7de7b2c0-d9", "ovs_interfaceid": "7de7b2c0-d9e0-4e1a-bf74-2a477c16b514", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 11:51:09 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-f6e9766f-8f49-4c32-b87f-f48447d3b216 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Converting VIF {"id": "7de7b2c0-d9e0-4e1a-bf74-2a477c16b514", "address": "fa:16:3e:08:89:a4", "network": {"id": "bae20193-cae3-45f8-8881-68020cd853e9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-459774400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "348b0a78aaf940b98f91655ddd6d4d6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7de7b2c0-d9", "ovs_interfaceid": "7de7b2c0-d9e0-4e1a-bf74-2a477c16b514", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:51:09 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-f6e9766f-8f49-4c32-b87f-f48447d3b216 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:89:a4,bridge_name='br-int',has_traffic_filtering=True,id=7de7b2c0-d9e0-4e1a-bf74-2a477c16b514,network=Network(bae20193-cae3-45f8-8881-68020cd853e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7de7b2c0-d9') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:51:09 user nova-compute[73449]: DEBUG os_vif [None req-f6e9766f-8f49-4c32-b87f-f48447d3b216 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:89:a4,bridge_name='br-int',has_traffic_filtering=True,id=7de7b2c0-d9e0-4e1a-bf74-2a477c16b514,network=Network(bae20193-cae3-45f8-8881-68020cd853e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7de7b2c0-d9') {{(pid=73449) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 11:51:09 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:51:09 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:51:09 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 11:51:09 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:51:09 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7de7b2c0-d9, may_exist=True, interface_attrs={}) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:51:09 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7de7b2c0-d9, col_values=(('external_ids', {'iface-id': '7de7b2c0-d9e0-4e1a-bf74-2a477c16b514', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:08:89:a4', 'vm-uuid': '9e689bc9-6625-46b7-90d0-52c50f9b73e6'}),), if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:51:09 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:51:09 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:51:09 user nova-compute[73449]: INFO os_vif [None req-f6e9766f-8f49-4c32-b87f-f48447d3b216 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:89:a4,bridge_name='br-int',has_traffic_filtering=True,id=7de7b2c0-d9e0-4e1a-bf74-2a477c16b514,network=Network(bae20193-cae3-45f8-8881-68020cd853e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7de7b2c0-d9')
Aug 17 11:51:09 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-f6e9766f-8f49-4c32-b87f-f48447d3b216 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] No BDM found with device name vda, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 11:51:09 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-f6e9766f-8f49-4c32-b87f-f48447d3b216 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] No VIF found with MAC fa:16:3e:08:89:a4, not building metadata {{(pid=73449) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 11:51:10 user nova-compute[73449]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692273055.4027982, fea9f81c-a848-4a65-863e-e09dddf65bcf => Stopped> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:51:10 user nova-compute[73449]: INFO nova.compute.manager [-] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] VM Stopped (Lifecycle Event)
Aug 17 11:51:10 user nova-compute[73449]: DEBUG nova.compute.manager [None req-1f23127c-cc5d-4703-b204-d484566687f0 None None] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:51:10 user nova-compute[73449]: DEBUG nova.network.neutron [req-27f8509e-83de-4bdf-b2a2-f43d4cd1cf3c req-e6bc0653-9982-4a3e-897d-09addd8f7f45 service nova] [instance: 9e689bc9-6625-46b7-90d0-52c50f9b73e6] Updated VIF entry in instance network info cache for port 7de7b2c0-d9e0-4e1a-bf74-2a477c16b514. {{(pid=73449) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 11:51:10 user nova-compute[73449]: DEBUG nova.network.neutron [req-27f8509e-83de-4bdf-b2a2-f43d4cd1cf3c req-e6bc0653-9982-4a3e-897d-09addd8f7f45 service nova] [instance: 9e689bc9-6625-46b7-90d0-52c50f9b73e6] Updating instance_info_cache with network_info: [{"id": "7de7b2c0-d9e0-4e1a-bf74-2a477c16b514", "address": "fa:16:3e:08:89:a4", "network": {"id": "bae20193-cae3-45f8-8881-68020cd853e9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-459774400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "348b0a78aaf940b98f91655ddd6d4d6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7de7b2c0-d9", "ovs_interfaceid": "7de7b2c0-d9e0-4e1a-bf74-2a477c16b514", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:51:10 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-27f8509e-83de-4bdf-b2a2-f43d4cd1cf3c req-e6bc0653-9982-4a3e-897d-09addd8f7f45 service nova] Releasing lock "refresh_cache-9e689bc9-6625-46b7-90d0-52c50f9b73e6" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:51:11 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:51:11 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:51:11 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:51:11 user nova-compute[73449]: DEBUG nova.compute.manager [req-ff744ba1-70c5-49d5-bee3-4d4f37cff0f7 req-b0fb4ec9-7765-4318-9a4c-4cc6df0e927c service nova] [instance: 9e689bc9-6625-46b7-90d0-52c50f9b73e6] Received event network-vif-plugged-7de7b2c0-d9e0-4e1a-bf74-2a477c16b514 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:51:11 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-ff744ba1-70c5-49d5-bee3-4d4f37cff0f7 req-b0fb4ec9-7765-4318-9a4c-4cc6df0e927c service nova] Acquiring lock "9e689bc9-6625-46b7-90d0-52c50f9b73e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:51:11 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-ff744ba1-70c5-49d5-bee3-4d4f37cff0f7 req-b0fb4ec9-7765-4318-9a4c-4cc6df0e927c service nova] Lock "9e689bc9-6625-46b7-90d0-52c50f9b73e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:51:11 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-ff744ba1-70c5-49d5-bee3-4d4f37cff0f7 req-b0fb4ec9-7765-4318-9a4c-4cc6df0e927c service nova] Lock "9e689bc9-6625-46b7-90d0-52c50f9b73e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:51:11 user nova-compute[73449]: DEBUG nova.compute.manager [req-ff744ba1-70c5-49d5-bee3-4d4f37cff0f7 req-b0fb4ec9-7765-4318-9a4c-4cc6df0e927c service nova] [instance: 9e689bc9-6625-46b7-90d0-52c50f9b73e6] No waiting events found dispatching network-vif-plugged-7de7b2c0-d9e0-4e1a-bf74-2a477c16b514 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:51:11 user nova-compute[73449]: WARNING nova.compute.manager [req-ff744ba1-70c5-49d5-bee3-4d4f37cff0f7 req-b0fb4ec9-7765-4318-9a4c-4cc6df0e927c service nova] [instance: 9e689bc9-6625-46b7-90d0-52c50f9b73e6] Received unexpected event network-vif-plugged-7de7b2c0-d9e0-4e1a-bf74-2a477c16b514 for instance with vm_state building and task_state spawning.
Aug 17 11:51:11 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:51:11 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:51:11 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:51:11 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:51:13 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:51:13 user nova-compute[73449]: DEBUG nova.compute.manager [req-1a55acbf-8fa1-41e3-847f-567087caa890 req-306053a6-f716-446b-a9cd-cb6540f76e85 service nova] [instance: 9e689bc9-6625-46b7-90d0-52c50f9b73e6] Received event network-vif-plugged-7de7b2c0-d9e0-4e1a-bf74-2a477c16b514 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:51:13 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-1a55acbf-8fa1-41e3-847f-567087caa890 req-306053a6-f716-446b-a9cd-cb6540f76e85 service nova] Acquiring lock "9e689bc9-6625-46b7-90d0-52c50f9b73e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:51:13 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-1a55acbf-8fa1-41e3-847f-567087caa890 req-306053a6-f716-446b-a9cd-cb6540f76e85 service nova] Lock "9e689bc9-6625-46b7-90d0-52c50f9b73e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:51:13 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-1a55acbf-8fa1-41e3-847f-567087caa890 req-306053a6-f716-446b-a9cd-cb6540f76e85 service nova] Lock "9e689bc9-6625-46b7-90d0-52c50f9b73e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:51:13 user nova-compute[73449]: DEBUG nova.compute.manager [req-1a55acbf-8fa1-41e3-847f-567087caa890 req-306053a6-f716-446b-a9cd-cb6540f76e85 service nova] [instance: 9e689bc9-6625-46b7-90d0-52c50f9b73e6] No waiting events found dispatching network-vif-plugged-7de7b2c0-d9e0-4e1a-bf74-2a477c16b514 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:51:13 user nova-compute[73449]: WARNING nova.compute.manager [req-1a55acbf-8fa1-41e3-847f-567087caa890 req-306053a6-f716-446b-a9cd-cb6540f76e85 service nova] [instance: 9e689bc9-6625-46b7-90d0-52c50f9b73e6] Received unexpected event network-vif-plugged-7de7b2c0-d9e0-4e1a-bf74-2a477c16b514 for instance with vm_state building and task_state spawning.
Aug 17 11:51:13 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692273073.6129072, 9e689bc9-6625-46b7-90d0-52c50f9b73e6 => Resumed> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:51:13 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 9e689bc9-6625-46b7-90d0-52c50f9b73e6] VM Resumed (Lifecycle Event)
Aug 17 11:51:13 user nova-compute[73449]: DEBUG nova.compute.manager [None req-f6e9766f-8f49-4c32-b87f-f48447d3b216 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] [instance: 9e689bc9-6625-46b7-90d0-52c50f9b73e6] Instance event wait completed in 0 seconds for  {{(pid=73449) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 11:51:13 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-f6e9766f-8f49-4c32-b87f-f48447d3b216 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] [instance: 9e689bc9-6625-46b7-90d0-52c50f9b73e6] Guest created on hypervisor {{(pid=73449) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 11:51:13 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: 9e689bc9-6625-46b7-90d0-52c50f9b73e6] Instance spawned successfully.
Aug 17 11:51:13 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-f6e9766f-8f49-4c32-b87f-f48447d3b216 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] [instance: 9e689bc9-6625-46b7-90d0-52c50f9b73e6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 11:51:13 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 9e689bc9-6625-46b7-90d0-52c50f9b73e6] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:51:13 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 9e689bc9-6625-46b7-90d0-52c50f9b73e6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 11:51:13 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-f6e9766f-8f49-4c32-b87f-f48447d3b216 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] [instance: 9e689bc9-6625-46b7-90d0-52c50f9b73e6] Found default for hw_cdrom_bus of ide {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:51:13 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-f6e9766f-8f49-4c32-b87f-f48447d3b216 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] [instance: 9e689bc9-6625-46b7-90d0-52c50f9b73e6] Found default for hw_disk_bus of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:51:13 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-f6e9766f-8f49-4c32-b87f-f48447d3b216 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] [instance: 9e689bc9-6625-46b7-90d0-52c50f9b73e6] Found default for hw_input_bus of None {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:51:13 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-f6e9766f-8f49-4c32-b87f-f48447d3b216 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] [instance: 9e689bc9-6625-46b7-90d0-52c50f9b73e6] Found default for hw_pointer_model of None {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:51:13 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-f6e9766f-8f49-4c32-b87f-f48447d3b216 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] [instance: 9e689bc9-6625-46b7-90d0-52c50f9b73e6] Found default for hw_video_model of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:51:13 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-f6e9766f-8f49-4c32-b87f-f48447d3b216 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] [instance: 9e689bc9-6625-46b7-90d0-52c50f9b73e6] Found default for hw_vif_model of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:51:13 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 9e689bc9-6625-46b7-90d0-52c50f9b73e6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 11:51:13 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692273073.613985, 9e689bc9-6625-46b7-90d0-52c50f9b73e6 => Started> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:51:13 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 9e689bc9-6625-46b7-90d0-52c50f9b73e6] VM Started (Lifecycle Event)
Aug 17 11:51:13 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 9e689bc9-6625-46b7-90d0-52c50f9b73e6] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:51:13 user nova-compute[73449]: INFO nova.compute.manager [None req-f6e9766f-8f49-4c32-b87f-f48447d3b216 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] [instance: 9e689bc9-6625-46b7-90d0-52c50f9b73e6] Took 6.35 seconds to spawn the instance on the hypervisor.
Aug 17 11:51:13 user nova-compute[73449]: DEBUG nova.compute.manager [None req-f6e9766f-8f49-4c32-b87f-f48447d3b216 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] [instance: 9e689bc9-6625-46b7-90d0-52c50f9b73e6] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:51:13 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 9e689bc9-6625-46b7-90d0-52c50f9b73e6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 11:51:13 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 9e689bc9-6625-46b7-90d0-52c50f9b73e6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 11:51:13 user nova-compute[73449]: INFO nova.compute.manager [None req-f6e9766f-8f49-4c32-b87f-f48447d3b216 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] [instance: 9e689bc9-6625-46b7-90d0-52c50f9b73e6] Took 8.03 seconds to build instance.
Aug 17 11:51:13 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-f6e9766f-8f49-4c32-b87f-f48447d3b216 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Lock "9e689bc9-6625-46b7-90d0-52c50f9b73e6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.193s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:51:14 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:51:18 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:51:19 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:51:23 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:51:24 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:51:28 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:51:29 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:51:33 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:51:34 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:51:38 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:51:39 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:51:41 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a9b7ccfe-563f-4459-af39-6bf7b2015d24 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Acquiring lock "01ef4274-dfa1-4f7d-a24c-a1686b692f70" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:51:41 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a9b7ccfe-563f-4459-af39-6bf7b2015d24 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Lock "01ef4274-dfa1-4f7d-a24c-a1686b692f70" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:51:41 user nova-compute[73449]: DEBUG nova.compute.manager [None req-a9b7ccfe-563f-4459-af39-6bf7b2015d24 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] Starting instance... {{(pid=73449) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 11:51:41 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a9b7ccfe-563f-4459-af39-6bf7b2015d24 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:51:41 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a9b7ccfe-563f-4459-af39-6bf7b2015d24 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:51:41 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-a9b7ccfe-563f-4459-af39-6bf7b2015d24 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73449) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 11:51:41 user nova-compute[73449]: INFO nova.compute.claims [None req-a9b7ccfe-563f-4459-af39-6bf7b2015d24 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] Claim successful on node user
Aug 17 11:51:41 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-a9b7ccfe-563f-4459-af39-6bf7b2015d24 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Refreshing inventories for resource provider 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 17 11:51:41 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-a9b7ccfe-563f-4459-af39-6bf7b2015d24 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Updating ProviderTree inventory for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 17 11:51:41 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-a9b7ccfe-563f-4459-af39-6bf7b2015d24 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Updating inventory in ProviderTree for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 11:51:41 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-a9b7ccfe-563f-4459-af39-6bf7b2015d24 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Refreshing aggregate associations for resource provider 20986bee-3f54-4b89-bec1-f8387ef700c4, aggregates: None {{(pid=73449) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 17 11:51:41 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-a9b7ccfe-563f-4459-af39-6bf7b2015d24 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Refreshing trait associations for resource provider 20986bee-3f54-4b89-bec1-f8387ef700c4, traits: COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NODE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE42,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSSE3,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_ISO {{(pid=73449) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 17 11:51:42 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-a9b7ccfe-563f-4459-af39-6bf7b2015d24 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 11:51:42 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-a9b7ccfe-563f-4459-af39-6bf7b2015d24 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 11:51:42 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a9b7ccfe-563f-4459-af39-6bf7b2015d24 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.642s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:51:42 user nova-compute[73449]: DEBUG nova.compute.manager [None req-a9b7ccfe-563f-4459-af39-6bf7b2015d24 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] Start building networks asynchronously for instance. {{(pid=73449) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 11:51:42 user nova-compute[73449]: DEBUG nova.compute.manager [None req-a9b7ccfe-563f-4459-af39-6bf7b2015d24 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] Allocating IP information in the background. {{(pid=73449) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 11:51:42 user nova-compute[73449]: DEBUG nova.network.neutron [None req-a9b7ccfe-563f-4459-af39-6bf7b2015d24 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] allocate_for_instance() {{(pid=73449) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 11:51:42 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-a9b7ccfe-563f-4459-af39-6bf7b2015d24 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 11:51:42 user nova-compute[73449]: DEBUG nova.compute.manager [None req-a9b7ccfe-563f-4459-af39-6bf7b2015d24 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] Start building block device mappings for instance. {{(pid=73449) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 11:51:42 user nova-compute[73449]: DEBUG nova.policy [None req-a9b7ccfe-563f-4459-af39-6bf7b2015d24 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a388f1f7e6254e8cace000ec1249d6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ba3ebf47bd4b999e68c74a5c0ab060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73449) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 11:51:42 user nova-compute[73449]: DEBUG nova.compute.manager [None req-a9b7ccfe-563f-4459-af39-6bf7b2015d24 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] Start spawning the instance on the hypervisor. {{(pid=73449) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 11:51:42 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-a9b7ccfe-563f-4459-af39-6bf7b2015d24 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] Creating instance directory {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 11:51:42 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-a9b7ccfe-563f-4459-af39-6bf7b2015d24 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] Creating image(s)
Aug 17 11:51:42 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a9b7ccfe-563f-4459-af39-6bf7b2015d24 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Acquiring lock "/opt/stack/data/nova/instances/01ef4274-dfa1-4f7d-a24c-a1686b692f70/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:51:42 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a9b7ccfe-563f-4459-af39-6bf7b2015d24 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Lock "/opt/stack/data/nova/instances/01ef4274-dfa1-4f7d-a24c-a1686b692f70/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:51:42 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a9b7ccfe-563f-4459-af39-6bf7b2015d24 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Lock "/opt/stack/data/nova/instances/01ef4274-dfa1-4f7d-a24c-a1686b692f70/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:51:42 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a9b7ccfe-563f-4459-af39-6bf7b2015d24 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Acquiring lock "aad674915ef11385b52ed3c606275cc7ae0cdb56" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:51:42 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a9b7ccfe-563f-4459-af39-6bf7b2015d24 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Lock "aad674915ef11385b52ed3c606275cc7ae0cdb56" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:51:43 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-a9b7ccfe-563f-4459-af39-6bf7b2015d24 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aad674915ef11385b52ed3c606275cc7ae0cdb56.part --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:51:43 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:51:43 user nova-compute[73449]: DEBUG nova.network.neutron [None req-a9b7ccfe-563f-4459-af39-6bf7b2015d24 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] Successfully created port: e1cb1992-df66-4253-ba1f-3c30647c61de {{(pid=73449) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 11:51:43 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:51:43 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-a9b7ccfe-563f-4459-af39-6bf7b2015d24 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aad674915ef11385b52ed3c606275cc7ae0cdb56.part --force-share --output=json" returned: 0 in 0.235s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:51:43 user nova-compute[73449]: DEBUG nova.virt.images [None req-a9b7ccfe-563f-4459-af39-6bf7b2015d24 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] 6f8e20a1-db10-4cf8-9988-c16f01e25ee6 was qcow2, converting to raw {{(pid=73449) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 17 11:51:43 user nova-compute[73449]: DEBUG nova.privsep.utils [None req-a9b7ccfe-563f-4459-af39-6bf7b2015d24 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73449) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 11:51:43 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-a9b7ccfe-563f-4459-af39-6bf7b2015d24 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/aad674915ef11385b52ed3c606275cc7ae0cdb56.part /opt/stack/data/nova/instances/_base/aad674915ef11385b52ed3c606275cc7ae0cdb56.converted {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:51:43 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-a9b7ccfe-563f-4459-af39-6bf7b2015d24 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/aad674915ef11385b52ed3c606275cc7ae0cdb56.part /opt/stack/data/nova/instances/_base/aad674915ef11385b52ed3c606275cc7ae0cdb56.converted" returned: 0 in 0.291s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:51:43 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-a9b7ccfe-563f-4459-af39-6bf7b2015d24 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aad674915ef11385b52ed3c606275cc7ae0cdb56.converted --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:51:44 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-a9b7ccfe-563f-4459-af39-6bf7b2015d24 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aad674915ef11385b52ed3c606275cc7ae0cdb56.converted --force-share --output=json" returned: 0 in 0.259s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:51:44 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a9b7ccfe-563f-4459-af39-6bf7b2015d24 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Lock "aad674915ef11385b52ed3c606275cc7ae0cdb56" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.595s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:51:44 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-a9b7ccfe-563f-4459-af39-6bf7b2015d24 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aad674915ef11385b52ed3c606275cc7ae0cdb56 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:51:44 user nova-compute[73449]: DEBUG nova.network.neutron [None req-a9b7ccfe-563f-4459-af39-6bf7b2015d24 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] Successfully updated port: e1cb1992-df66-4253-ba1f-3c30647c61de {{(pid=73449) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 11:51:44 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a9b7ccfe-563f-4459-af39-6bf7b2015d24 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Acquiring lock "refresh_cache-01ef4274-dfa1-4f7d-a24c-a1686b692f70" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:51:44 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a9b7ccfe-563f-4459-af39-6bf7b2015d24 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Acquired lock "refresh_cache-01ef4274-dfa1-4f7d-a24c-a1686b692f70" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:51:44 user nova-compute[73449]: DEBUG nova.network.neutron [None req-a9b7ccfe-563f-4459-af39-6bf7b2015d24 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] Building network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 11:51:44 user nova-compute[73449]: DEBUG nova.compute.manager [req-39c5edcd-1360-4fd5-a9c2-02f877045e1b req-77d728a9-18a9-4941-b07a-fe2db2a86c20 service nova] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] Received event network-changed-e1cb1992-df66-4253-ba1f-3c30647c61de {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:51:44 user nova-compute[73449]: DEBUG nova.compute.manager [req-39c5edcd-1360-4fd5-a9c2-02f877045e1b req-77d728a9-18a9-4941-b07a-fe2db2a86c20 service nova] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] Refreshing instance network info cache due to event network-changed-e1cb1992-df66-4253-ba1f-3c30647c61de. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 11:51:44 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-39c5edcd-1360-4fd5-a9c2-02f877045e1b req-77d728a9-18a9-4941-b07a-fe2db2a86c20 service nova] Acquiring lock "refresh_cache-01ef4274-dfa1-4f7d-a24c-a1686b692f70" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:51:44 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-a9b7ccfe-563f-4459-af39-6bf7b2015d24 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aad674915ef11385b52ed3c606275cc7ae0cdb56 --force-share --output=json" returned: 0 in 0.185s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:51:44 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a9b7ccfe-563f-4459-af39-6bf7b2015d24 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Acquiring lock "aad674915ef11385b52ed3c606275cc7ae0cdb56" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:51:44 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a9b7ccfe-563f-4459-af39-6bf7b2015d24 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Lock "aad674915ef11385b52ed3c606275cc7ae0cdb56" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:51:44 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-a9b7ccfe-563f-4459-af39-6bf7b2015d24 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aad674915ef11385b52ed3c606275cc7ae0cdb56 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:51:44 user nova-compute[73449]: DEBUG nova.network.neutron [None req-a9b7ccfe-563f-4459-af39-6bf7b2015d24 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] Instance cache missing network info. {{(pid=73449) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 11:51:44 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-a9b7ccfe-563f-4459-af39-6bf7b2015d24 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aad674915ef11385b52ed3c606275cc7ae0cdb56 --force-share --output=json" returned: 0 in 0.182s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:51:44 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-a9b7ccfe-563f-4459-af39-6bf7b2015d24 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aad674915ef11385b52ed3c606275cc7ae0cdb56,backing_fmt=raw /opt/stack/data/nova/instances/01ef4274-dfa1-4f7d-a24c-a1686b692f70/disk 1073741824 {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:51:44 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-a9b7ccfe-563f-4459-af39-6bf7b2015d24 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aad674915ef11385b52ed3c606275cc7ae0cdb56,backing_fmt=raw /opt/stack/data/nova/instances/01ef4274-dfa1-4f7d-a24c-a1686b692f70/disk 1073741824" returned: 0 in 0.049s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:51:44 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a9b7ccfe-563f-4459-af39-6bf7b2015d24 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Lock "aad674915ef11385b52ed3c606275cc7ae0cdb56" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:51:44 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-a9b7ccfe-563f-4459-af39-6bf7b2015d24 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aad674915ef11385b52ed3c606275cc7ae0cdb56 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:51:44 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-a9b7ccfe-563f-4459-af39-6bf7b2015d24 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aad674915ef11385b52ed3c606275cc7ae0cdb56 --force-share --output=json" returned: 0 in 0.178s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:51:44 user nova-compute[73449]: DEBUG nova.virt.disk.api [None req-a9b7ccfe-563f-4459-af39-6bf7b2015d24 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Checking if we can resize image /opt/stack/data/nova/instances/01ef4274-dfa1-4f7d-a24c-a1686b692f70/disk. size=1073741824 {{(pid=73449) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 11:51:44 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-a9b7ccfe-563f-4459-af39-6bf7b2015d24 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef4274-dfa1-4f7d-a24c-a1686b692f70/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:51:44 user nova-compute[73449]: DEBUG nova.network.neutron [None req-a9b7ccfe-563f-4459-af39-6bf7b2015d24 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] Updating instance_info_cache with network_info: [{"id": "e1cb1992-df66-4253-ba1f-3c30647c61de", "address": "fa:16:3e:b9:37:67", "network": {"id": "ff73f5c3-bae6-46cc-bcb8-bbd5be1b478d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1229197917-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5ba3ebf47bd4b999e68c74a5c0ab060", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1cb1992-df", "ovs_interfaceid": "e1cb1992-df66-4253-ba1f-3c30647c61de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:51:44 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a9b7ccfe-563f-4459-af39-6bf7b2015d24 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Releasing lock "refresh_cache-01ef4274-dfa1-4f7d-a24c-a1686b692f70" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:51:44 user nova-compute[73449]: DEBUG nova.compute.manager [None req-a9b7ccfe-563f-4459-af39-6bf7b2015d24 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] Instance network_info: |[{"id": "e1cb1992-df66-4253-ba1f-3c30647c61de", "address": "fa:16:3e:b9:37:67", "network": {"id": "ff73f5c3-bae6-46cc-bcb8-bbd5be1b478d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1229197917-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5ba3ebf47bd4b999e68c74a5c0ab060", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1cb1992-df", "ovs_interfaceid": "e1cb1992-df66-4253-ba1f-3c30647c61de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73449) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 11:51:44 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-39c5edcd-1360-4fd5-a9c2-02f877045e1b req-77d728a9-18a9-4941-b07a-fe2db2a86c20 service nova] Acquired lock "refresh_cache-01ef4274-dfa1-4f7d-a24c-a1686b692f70" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:51:44 user nova-compute[73449]: DEBUG nova.network.neutron [req-39c5edcd-1360-4fd5-a9c2-02f877045e1b req-77d728a9-18a9-4941-b07a-fe2db2a86c20 service nova] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] Refreshing network info cache for port e1cb1992-df66-4253-ba1f-3c30647c61de {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 11:51:44 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:51:44 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-a9b7ccfe-563f-4459-af39-6bf7b2015d24 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef4274-dfa1-4f7d-a24c-a1686b692f70/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:51:44 user nova-compute[73449]: DEBUG nova.virt.disk.api [None req-a9b7ccfe-563f-4459-af39-6bf7b2015d24 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Cannot resize image /opt/stack/data/nova/instances/01ef4274-dfa1-4f7d-a24c-a1686b692f70/disk to a smaller size. {{(pid=73449) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 11:51:44 user nova-compute[73449]: DEBUG nova.objects.instance [None req-a9b7ccfe-563f-4459-af39-6bf7b2015d24 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Lazy-loading 'migration_context' on Instance uuid 01ef4274-dfa1-4f7d-a24c-a1686b692f70 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:51:44 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-a9b7ccfe-563f-4459-af39-6bf7b2015d24 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] Created local disks {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 11:51:44 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-a9b7ccfe-563f-4459-af39-6bf7b2015d24 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] Ensure instance console log exists: /opt/stack/data/nova/instances/01ef4274-dfa1-4f7d-a24c-a1686b692f70/console.log {{(pid=73449) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 11:51:44 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a9b7ccfe-563f-4459-af39-6bf7b2015d24 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:51:44 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a9b7ccfe-563f-4459-af39-6bf7b2015d24 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:51:44 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a9b7ccfe-563f-4459-af39-6bf7b2015d24 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:51:44 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-a9b7ccfe-563f-4459-af39-6bf7b2015d24 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] Start _get_guest_xml network_info=[{"id": "e1cb1992-df66-4253-ba1f-3c30647c61de", "address": "fa:16:3e:b9:37:67", "network": {"id": "ff73f5c3-bae6-46cc-bcb8-bbd5be1b478d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1229197917-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5ba3ebf47bd4b999e68c74a5c0ab060", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1cb1992-df", "ovs_interfaceid": "e1cb1992-df66-4253-ba1f-3c30647c61de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T11:51:39Z,direct_url=<?>,disk_format='qcow2',id=6f8e20a1-db10-4cf8-9988-c16f01e25ee6,min_disk=0,min_ram=0,name='tempest-scenario-img--1318413715',owner='b5ba3ebf47bd4b999e68c74a5c0ab060',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T11:51:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': '6f8e20a1-db10-4cf8-9988-c16f01e25ee6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 11:51:44 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-a9b7ccfe-563f-4459-af39-6bf7b2015d24 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:51:44 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-a9b7ccfe-563f-4459-af39-6bf7b2015d24 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:51:44 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-a9b7ccfe-563f-4459-af39-6bf7b2015d24 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 11:51:44 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-a9b7ccfe-563f-4459-af39-6bf7b2015d24 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] CPU controller missing on host. {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 11:51:44 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-a9b7ccfe-563f-4459-af39-6bf7b2015d24 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 11:51:44 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-a9b7ccfe-563f-4459-af39-6bf7b2015d24 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] CPU controller found on host. {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 11:51:44 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-a9b7ccfe-563f-4459-af39-6bf7b2015d24 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73449) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 11:51:44 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-a9b7ccfe-563f-4459-af39-6bf7b2015d24 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T11:35:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T11:51:39Z,direct_url=<?>,disk_format='qcow2',id=6f8e20a1-db10-4cf8-9988-c16f01e25ee6,min_disk=0,min_ram=0,name='tempest-scenario-img--1318413715',owner='b5ba3ebf47bd4b999e68c74a5c0ab060',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T11:51:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 11:51:44 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-a9b7ccfe-563f-4459-af39-6bf7b2015d24 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Flavor limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 11:51:44 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-a9b7ccfe-563f-4459-af39-6bf7b2015d24 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Image limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 11:51:44 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-a9b7ccfe-563f-4459-af39-6bf7b2015d24 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Flavor pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 11:51:44 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-a9b7ccfe-563f-4459-af39-6bf7b2015d24 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Image pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 11:51:44 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-a9b7ccfe-563f-4459-af39-6bf7b2015d24 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 11:51:44 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-a9b7ccfe-563f-4459-af39-6bf7b2015d24 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 11:51:44 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-a9b7ccfe-563f-4459-af39-6bf7b2015d24 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 11:51:44 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-a9b7ccfe-563f-4459-af39-6bf7b2015d24 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Got 1 possible topologies {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 11:51:44 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-a9b7ccfe-563f-4459-af39-6bf7b2015d24 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 11:51:44 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-a9b7ccfe-563f-4459-af39-6bf7b2015d24 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 11:51:44 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-a9b7ccfe-563f-4459-af39-6bf7b2015d24 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:51:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1932160359',display_name='tempest-TestMinimumBasicScenario-server-1932160359',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1932160359',id=30,image_ref='6f8e20a1-db10-4cf8-9988-c16f01e25ee6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGq85eXabfFwL2RCeJ0KFYDsljWNHRqKUonIj+5b53rjzVA/YI9pb8YOAJpN21dgx0wtftVXB8cBCpqucDzGZn90zvZmHTr/jT5YZG/AyiEoEikCQlMKTOFVlw6SGxDaaw==',key_name='tempest-TestMinimumBasicScenario-1715363026',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b5ba3ebf47bd4b999e68c74a5c0ab060',ramdisk_id='',reservation_id='r-vqpcy8b2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6f8e20a1-db10-4cf8-9988-c16f01e25ee6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1063498076',owner_user_name='tempest-TestMinimumBasicScenario-1063498076-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T11:51:42Z,user_data=None,user_id='a388f1f7e6254e8cace000ec1249d6c6',uuid=01ef4274-dfa1-4f7d-a24c-a1686b692f70,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e1cb1992-df66-4253-ba1f-3c30647c61de", "address": "fa:16:3e:b9:37:67", "network": {"id": "ff73f5c3-bae6-46cc-bcb8-bbd5be1b478d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1229197917-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5ba3ebf47bd4b999e68c74a5c0ab060", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1cb1992-df", "ovs_interfaceid": "e1cb1992-df66-4253-ba1f-3c30647c61de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73449) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 11:51:44 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-a9b7ccfe-563f-4459-af39-6bf7b2015d24 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Converting VIF {"id": "e1cb1992-df66-4253-ba1f-3c30647c61de", "address": "fa:16:3e:b9:37:67", "network": {"id": "ff73f5c3-bae6-46cc-bcb8-bbd5be1b478d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1229197917-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5ba3ebf47bd4b999e68c74a5c0ab060", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1cb1992-df", "ovs_interfaceid": "e1cb1992-df66-4253-ba1f-3c30647c61de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:51:44 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-a9b7ccfe-563f-4459-af39-6bf7b2015d24 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:37:67,bridge_name='br-int',has_traffic_filtering=True,id=e1cb1992-df66-4253-ba1f-3c30647c61de,network=Network(ff73f5c3-bae6-46cc-bcb8-bbd5be1b478d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1cb1992-df') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:51:44 user nova-compute[73449]: DEBUG nova.objects.instance [None req-a9b7ccfe-563f-4459-af39-6bf7b2015d24 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Lazy-loading 'pci_devices' on Instance uuid 01ef4274-dfa1-4f7d-a24c-a1686b692f70 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:51:45 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-a9b7ccfe-563f-4459-af39-6bf7b2015d24 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] End _get_guest_xml xml=<domain type="kvm">
Aug 17 11:51:45 user nova-compute[73449]:   <uuid>01ef4274-dfa1-4f7d-a24c-a1686b692f70</uuid>
Aug 17 11:51:45 user nova-compute[73449]:   <name>instance-0000001e</name>
Aug 17 11:51:45 user nova-compute[73449]:   <memory>524288</memory>
Aug 17 11:51:45 user nova-compute[73449]:   <vcpu>1</vcpu>
Aug 17 11:51:45 user nova-compute[73449]:   <metadata>
Aug 17 11:51:45 user nova-compute[73449]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 11:51:45 user nova-compute[73449]:       <nova:package version="0.0.0"/>
Aug 17 11:51:45 user nova-compute[73449]:       <nova:name>tempest-TestMinimumBasicScenario-server-1932160359</nova:name>
Aug 17 11:51:45 user nova-compute[73449]:       <nova:creationTime>2023-08-17 11:51:44</nova:creationTime>
Aug 17 11:51:45 user nova-compute[73449]:       <nova:flavor name="m1.tiny">
Aug 17 11:51:45 user nova-compute[73449]:         <nova:memory>512</nova:memory>
Aug 17 11:51:45 user nova-compute[73449]:         <nova:disk>1</nova:disk>
Aug 17 11:51:45 user nova-compute[73449]:         <nova:swap>0</nova:swap>
Aug 17 11:51:45 user nova-compute[73449]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 11:51:45 user nova-compute[73449]:         <nova:vcpus>1</nova:vcpus>
Aug 17 11:51:45 user nova-compute[73449]:       </nova:flavor>
Aug 17 11:51:45 user nova-compute[73449]:       <nova:owner>
Aug 17 11:51:45 user nova-compute[73449]:         <nova:user uuid="a388f1f7e6254e8cace000ec1249d6c6">tempest-TestMinimumBasicScenario-1063498076-project-member</nova:user>
Aug 17 11:51:45 user nova-compute[73449]:         <nova:project uuid="b5ba3ebf47bd4b999e68c74a5c0ab060">tempest-TestMinimumBasicScenario-1063498076</nova:project>
Aug 17 11:51:45 user nova-compute[73449]:       </nova:owner>
Aug 17 11:51:45 user nova-compute[73449]:       <nova:root type="image" uuid="6f8e20a1-db10-4cf8-9988-c16f01e25ee6"/>
Aug 17 11:51:45 user nova-compute[73449]:       <nova:ports>
Aug 17 11:51:45 user nova-compute[73449]:         <nova:port uuid="e1cb1992-df66-4253-ba1f-3c30647c61de">
Aug 17 11:51:45 user nova-compute[73449]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 17 11:51:45 user nova-compute[73449]:         </nova:port>
Aug 17 11:51:45 user nova-compute[73449]:       </nova:ports>
Aug 17 11:51:45 user nova-compute[73449]:     </nova:instance>
Aug 17 11:51:45 user nova-compute[73449]:   </metadata>
Aug 17 11:51:45 user nova-compute[73449]:   <sysinfo type="smbios">
Aug 17 11:51:45 user nova-compute[73449]:     <system>
Aug 17 11:51:45 user nova-compute[73449]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 11:51:45 user nova-compute[73449]:       <entry name="product">OpenStack Nova</entry>
Aug 17 11:51:45 user nova-compute[73449]:       <entry name="version">0.0.0</entry>
Aug 17 11:51:45 user nova-compute[73449]:       <entry name="serial">01ef4274-dfa1-4f7d-a24c-a1686b692f70</entry>
Aug 17 11:51:45 user nova-compute[73449]:       <entry name="uuid">01ef4274-dfa1-4f7d-a24c-a1686b692f70</entry>
Aug 17 11:51:45 user nova-compute[73449]:       <entry name="family">Virtual Machine</entry>
Aug 17 11:51:45 user nova-compute[73449]:     </system>
Aug 17 11:51:45 user nova-compute[73449]:   </sysinfo>
Aug 17 11:51:45 user nova-compute[73449]:   <os>
Aug 17 11:51:45 user nova-compute[73449]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 11:51:45 user nova-compute[73449]:     <boot dev="hd"/>
Aug 17 11:51:45 user nova-compute[73449]:     <smbios mode="sysinfo"/>
Aug 17 11:51:45 user nova-compute[73449]:   </os>
Aug 17 11:51:45 user nova-compute[73449]:   <features>
Aug 17 11:51:45 user nova-compute[73449]:     <acpi/>
Aug 17 11:51:45 user nova-compute[73449]:     <apic/>
Aug 17 11:51:45 user nova-compute[73449]:     <vmcoreinfo/>
Aug 17 11:51:45 user nova-compute[73449]:   </features>
Aug 17 11:51:45 user nova-compute[73449]:   <clock offset="utc">
Aug 17 11:51:45 user nova-compute[73449]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 11:51:45 user nova-compute[73449]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 11:51:45 user nova-compute[73449]:     <timer name="hpet" present="no"/>
Aug 17 11:51:45 user nova-compute[73449]:   </clock>
Aug 17 11:51:45 user nova-compute[73449]:   <cpu mode="custom" match="exact">
Aug 17 11:51:45 user nova-compute[73449]:     <model>Nehalem</model>
Aug 17 11:51:45 user nova-compute[73449]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 11:51:45 user nova-compute[73449]:   </cpu>
Aug 17 11:51:45 user nova-compute[73449]:   <devices>
Aug 17 11:51:45 user nova-compute[73449]:     <disk type="file" device="disk">
Aug 17 11:51:45 user nova-compute[73449]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 11:51:45 user nova-compute[73449]:       <source file="/opt/stack/data/nova/instances/01ef4274-dfa1-4f7d-a24c-a1686b692f70/disk"/>
Aug 17 11:51:45 user nova-compute[73449]:       <target dev="vda" bus="virtio"/>
Aug 17 11:51:45 user nova-compute[73449]:     </disk>
Aug 17 11:51:45 user nova-compute[73449]:     <interface type="ethernet">
Aug 17 11:51:45 user nova-compute[73449]:       <mac address="fa:16:3e:b9:37:67"/>
Aug 17 11:51:45 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 11:51:45 user nova-compute[73449]:       <mtu size="1442"/>
Aug 17 11:51:45 user nova-compute[73449]:       <target dev="tape1cb1992-df"/>
Aug 17 11:51:45 user nova-compute[73449]:     </interface>
Aug 17 11:51:45 user nova-compute[73449]:     <serial type="pty">
Aug 17 11:51:45 user nova-compute[73449]:       <log file="/opt/stack/data/nova/instances/01ef4274-dfa1-4f7d-a24c-a1686b692f70/console.log" append="off"/>
Aug 17 11:51:45 user nova-compute[73449]:     </serial>
Aug 17 11:51:45 user nova-compute[73449]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 11:51:45 user nova-compute[73449]:     <video>
Aug 17 11:51:45 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 11:51:45 user nova-compute[73449]:     </video>
Aug 17 11:51:45 user nova-compute[73449]:     <rng model="virtio">
Aug 17 11:51:45 user nova-compute[73449]:       <backend model="random">/dev/urandom</backend>
Aug 17 11:51:45 user nova-compute[73449]:     </rng>
Aug 17 11:51:45 user nova-compute[73449]:     <controller type="usb" index="0" model="none"/>
Aug 17 11:51:45 user nova-compute[73449]:     <memballoon model="virtio">
Aug 17 11:51:45 user nova-compute[73449]:       <stats period="10"/>
Aug 17 11:51:45 user nova-compute[73449]:     </memballoon>
Aug 17 11:51:45 user nova-compute[73449]:   </devices>
Aug 17 11:51:45 user nova-compute[73449]: </domain>
Aug 17 11:51:45 user nova-compute[73449]:  {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 11:51:45 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-a9b7ccfe-563f-4459-af39-6bf7b2015d24 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:51:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1932160359',display_name='tempest-TestMinimumBasicScenario-server-1932160359',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1932160359',id=30,image_ref='6f8e20a1-db10-4cf8-9988-c16f01e25ee6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGq85eXabfFwL2RCeJ0KFYDsljWNHRqKUonIj+5b53rjzVA/YI9pb8YOAJpN21dgx0wtftVXB8cBCpqucDzGZn90zvZmHTr/jT5YZG/AyiEoEikCQlMKTOFVlw6SGxDaaw==',key_name='tempest-TestMinimumBasicScenario-1715363026',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b5ba3ebf47bd4b999e68c74a5c0ab060',ramdisk_id='',reservation_id='r-vqpcy8b2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6f8e20a1-db10-4cf8-9988-c16f01e25ee6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1063498076',owner_user_name='tempest-TestMinimumBasicScenario-1063498076-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T11:51:42Z,user_data=None,user_id='a388f1f7e6254e8cace000ec1249d6c6',uuid=01ef4274-dfa1-4f7d-a24c-a1686b692f70,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e1cb1992-df66-4253-ba1f-3c30647c61de", "address": "fa:16:3e:b9:37:67", "network": {"id": "ff73f5c3-bae6-46cc-bcb8-bbd5be1b478d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1229197917-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5ba3ebf47bd4b999e68c74a5c0ab060", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1cb1992-df", "ovs_interfaceid": "e1cb1992-df66-4253-ba1f-3c30647c61de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 11:51:45 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-a9b7ccfe-563f-4459-af39-6bf7b2015d24 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Converting VIF {"id": "e1cb1992-df66-4253-ba1f-3c30647c61de", "address": "fa:16:3e:b9:37:67", "network": {"id": "ff73f5c3-bae6-46cc-bcb8-bbd5be1b478d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1229197917-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5ba3ebf47bd4b999e68c74a5c0ab060", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1cb1992-df", "ovs_interfaceid": "e1cb1992-df66-4253-ba1f-3c30647c61de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:51:45 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-a9b7ccfe-563f-4459-af39-6bf7b2015d24 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:37:67,bridge_name='br-int',has_traffic_filtering=True,id=e1cb1992-df66-4253-ba1f-3c30647c61de,network=Network(ff73f5c3-bae6-46cc-bcb8-bbd5be1b478d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1cb1992-df') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:51:45 user nova-compute[73449]: DEBUG os_vif [None req-a9b7ccfe-563f-4459-af39-6bf7b2015d24 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:37:67,bridge_name='br-int',has_traffic_filtering=True,id=e1cb1992-df66-4253-ba1f-3c30647c61de,network=Network(ff73f5c3-bae6-46cc-bcb8-bbd5be1b478d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1cb1992-df') {{(pid=73449) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 11:51:45 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:51:45 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:51:45 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 11:51:45 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:51:45 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape1cb1992-df, may_exist=True, interface_attrs={}) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:51:45 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape1cb1992-df, col_values=(('external_ids', {'iface-id': 'e1cb1992-df66-4253-ba1f-3c30647c61de', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b9:37:67', 'vm-uuid': '01ef4274-dfa1-4f7d-a24c-a1686b692f70'}),), if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:51:45 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:51:45 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:51:45 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:51:45 user nova-compute[73449]: INFO os_vif [None req-a9b7ccfe-563f-4459-af39-6bf7b2015d24 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:37:67,bridge_name='br-int',has_traffic_filtering=True,id=e1cb1992-df66-4253-ba1f-3c30647c61de,network=Network(ff73f5c3-bae6-46cc-bcb8-bbd5be1b478d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1cb1992-df')
Aug 17 11:51:45 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-a9b7ccfe-563f-4459-af39-6bf7b2015d24 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] No BDM found with device name vda, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 11:51:45 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-a9b7ccfe-563f-4459-af39-6bf7b2015d24 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] No VIF found with MAC fa:16:3e:b9:37:67, not building metadata {{(pid=73449) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 11:51:45 user nova-compute[73449]: DEBUG nova.network.neutron [req-39c5edcd-1360-4fd5-a9c2-02f877045e1b req-77d728a9-18a9-4941-b07a-fe2db2a86c20 service nova] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] Updated VIF entry in instance network info cache for port e1cb1992-df66-4253-ba1f-3c30647c61de. {{(pid=73449) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 11:51:45 user nova-compute[73449]: DEBUG nova.network.neutron [req-39c5edcd-1360-4fd5-a9c2-02f877045e1b req-77d728a9-18a9-4941-b07a-fe2db2a86c20 service nova] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] Updating instance_info_cache with network_info: [{"id": "e1cb1992-df66-4253-ba1f-3c30647c61de", "address": "fa:16:3e:b9:37:67", "network": {"id": "ff73f5c3-bae6-46cc-bcb8-bbd5be1b478d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1229197917-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5ba3ebf47bd4b999e68c74a5c0ab060", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1cb1992-df", "ovs_interfaceid": "e1cb1992-df66-4253-ba1f-3c30647c61de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:51:45 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-39c5edcd-1360-4fd5-a9c2-02f877045e1b req-77d728a9-18a9-4941-b07a-fe2db2a86c20 service nova] Releasing lock "refresh_cache-01ef4274-dfa1-4f7d-a24c-a1686b692f70" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:51:46 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:51:46 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:51:46 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:51:47 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:51:47 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:51:47 user nova-compute[73449]: DEBUG nova.compute.manager [req-4d81afc3-b749-4def-89d8-aa9c8e91ff62 req-adcd6f3c-58fb-4baa-843f-d7a3af612324 service nova] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] Received event network-vif-plugged-e1cb1992-df66-4253-ba1f-3c30647c61de {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:51:47 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-4d81afc3-b749-4def-89d8-aa9c8e91ff62 req-adcd6f3c-58fb-4baa-843f-d7a3af612324 service nova] Acquiring lock "01ef4274-dfa1-4f7d-a24c-a1686b692f70-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:51:47 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-4d81afc3-b749-4def-89d8-aa9c8e91ff62 req-adcd6f3c-58fb-4baa-843f-d7a3af612324 service nova] Lock "01ef4274-dfa1-4f7d-a24c-a1686b692f70-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:51:47 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-4d81afc3-b749-4def-89d8-aa9c8e91ff62 req-adcd6f3c-58fb-4baa-843f-d7a3af612324 service nova] Lock "01ef4274-dfa1-4f7d-a24c-a1686b692f70-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:51:47 user nova-compute[73449]: DEBUG nova.compute.manager [req-4d81afc3-b749-4def-89d8-aa9c8e91ff62 req-adcd6f3c-58fb-4baa-843f-d7a3af612324 service nova] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] No waiting events found dispatching network-vif-plugged-e1cb1992-df66-4253-ba1f-3c30647c61de {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:51:47 user nova-compute[73449]: WARNING nova.compute.manager [req-4d81afc3-b749-4def-89d8-aa9c8e91ff62 req-adcd6f3c-58fb-4baa-843f-d7a3af612324 service nova] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] Received unexpected event network-vif-plugged-e1cb1992-df66-4253-ba1f-3c30647c61de for instance with vm_state building and task_state spawning.
Aug 17 11:51:47 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:51:48 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-caa85b69-42e9-459f-9b45-a6c85c602a9c tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Acquiring lock "b32df06e-0b5a-4384-946b-64d64aeeb07e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:51:48 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-caa85b69-42e9-459f-9b45-a6c85c602a9c tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Lock "b32df06e-0b5a-4384-946b-64d64aeeb07e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:51:48 user nova-compute[73449]: DEBUG nova.compute.manager [None req-caa85b69-42e9-459f-9b45-a6c85c602a9c tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] Starting instance... {{(pid=73449) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 11:51:48 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:51:48 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-caa85b69-42e9-459f-9b45-a6c85c602a9c tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:51:48 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-caa85b69-42e9-459f-9b45-a6c85c602a9c tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:51:48 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-caa85b69-42e9-459f-9b45-a6c85c602a9c tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73449) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 11:51:48 user nova-compute[73449]: INFO nova.compute.claims [None req-caa85b69-42e9-459f-9b45-a6c85c602a9c tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] Claim successful on node user
Aug 17 11:51:48 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-caa85b69-42e9-459f-9b45-a6c85c602a9c tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 11:51:48 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-caa85b69-42e9-459f-9b45-a6c85c602a9c tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 11:51:48 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-caa85b69-42e9-459f-9b45-a6c85c602a9c tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.567s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:51:48 user nova-compute[73449]: DEBUG nova.compute.manager [None req-caa85b69-42e9-459f-9b45-a6c85c602a9c tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] Start building networks asynchronously for instance. {{(pid=73449) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 11:51:48 user nova-compute[73449]: DEBUG nova.compute.manager [None req-caa85b69-42e9-459f-9b45-a6c85c602a9c tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] Allocating IP information in the background. {{(pid=73449) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 11:51:48 user nova-compute[73449]: DEBUG nova.network.neutron [None req-caa85b69-42e9-459f-9b45-a6c85c602a9c tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] allocate_for_instance() {{(pid=73449) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 11:51:49 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-caa85b69-42e9-459f-9b45-a6c85c602a9c tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 11:51:49 user nova-compute[73449]: DEBUG nova.compute.manager [None req-caa85b69-42e9-459f-9b45-a6c85c602a9c tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] Start building block device mappings for instance. {{(pid=73449) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 11:51:49 user nova-compute[73449]: DEBUG nova.policy [None req-caa85b69-42e9-459f-9b45-a6c85c602a9c tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e44f6d8893da4d95a8ebe95180355c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '068c5270255744a18208a0ad9b35f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73449) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 11:51:49 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692273109.076254, 01ef4274-dfa1-4f7d-a24c-a1686b692f70 => Resumed> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:51:49 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] VM Resumed (Lifecycle Event)
Aug 17 11:51:49 user nova-compute[73449]: INFO nova.virt.block_device [None req-caa85b69-42e9-459f-9b45-a6c85c602a9c tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] Booting with volume 3724ddd1-6668-4637-a4f2-175cf033a0f7 at /dev/vda
Aug 17 11:51:49 user nova-compute[73449]: DEBUG nova.compute.manager [None req-a9b7ccfe-563f-4459-af39-6bf7b2015d24 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] Instance event wait completed in 0 seconds for  {{(pid=73449) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 11:51:49 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-a9b7ccfe-563f-4459-af39-6bf7b2015d24 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] Guest created on hypervisor {{(pid=73449) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 11:51:49 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] Instance spawned successfully.
Aug 17 11:51:49 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-a9b7ccfe-563f-4459-af39-6bf7b2015d24 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 11:51:49 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:51:49 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 11:51:49 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 11:51:49 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692273109.0798225, 01ef4274-dfa1-4f7d-a24c-a1686b692f70 => Started> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:51:49 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] VM Started (Lifecycle Event)
Aug 17 11:51:49 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-a9b7ccfe-563f-4459-af39-6bf7b2015d24 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] Found default for hw_cdrom_bus of ide {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:51:49 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-a9b7ccfe-563f-4459-af39-6bf7b2015d24 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] Found default for hw_disk_bus of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:51:49 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-a9b7ccfe-563f-4459-af39-6bf7b2015d24 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] Found default for hw_input_bus of None {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:51:49 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-a9b7ccfe-563f-4459-af39-6bf7b2015d24 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] Found default for hw_pointer_model of None {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:51:49 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-a9b7ccfe-563f-4459-af39-6bf7b2015d24 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] Found default for hw_video_model of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:51:49 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-a9b7ccfe-563f-4459-af39-6bf7b2015d24 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] Found default for hw_vif_model of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:51:49 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:51:49 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 11:51:49 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 11:51:49 user nova-compute[73449]: DEBUG os_brick.utils [None req-caa85b69-42e9-459f-9b45-a6c85c602a9c tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 11:51:49 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:51:49 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:51:49 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7d17b4b-bf25-4a02-8086-4da5ce840b4b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4d3924302012\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:51:49 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:51:49 user nova-compute[73449]: INFO nova.compute.manager [None req-a9b7ccfe-563f-4459-af39-6bf7b2015d24 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] Took 6.79 seconds to spawn the instance on the hypervisor.
Aug 17 11:51:49 user nova-compute[73449]: DEBUG nova.compute.manager [None req-a9b7ccfe-563f-4459-af39-6bf7b2015d24 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:51:49 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:51:49 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8ab0e1f-94d3-4b67-bcce-92a3104ec197]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:51:49 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:51:49 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:51:49 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1b968e5-d2b7-4fc0-b5c2-87897e6e1d4c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:51:49 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c044f18-94de-4cd1-a3e2-719048778301]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:51:49 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-caa85b69-42e9-459f-9b45-a6c85c602a9c tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Running cmd (subprocess): nvme version {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:51:49 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-caa85b69-42e9-459f-9b45-a6c85c602a9c tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] 'nvme version' failed. Not Retrying. {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 11:51:49 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.nvmeof [None req-caa85b69-42e9-459f-9b45-a6c85c602a9c tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] nvme not present on system {{(pid=73449) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 11:51:49 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:51:49 user nova-compute[73449]: INFO nova.compute.manager [None req-a9b7ccfe-563f-4459-af39-6bf7b2015d24 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] Took 7.96 seconds to build instance.
Aug 17 11:51:49 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 11:51:49 user nova-compute[73449]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 11:51:49 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9b56852-33cf-4131-a371-49da1ab7717e]: (4, '') {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:51:49 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-caa85b69-42e9-459f-9b45-a6c85c602a9c tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73449) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 11:51:49 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-caa85b69-42e9-459f-9b45-a6c85c602a9c tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73449) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 11:51:49 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-caa85b69-42e9-459f-9b45-a6c85c602a9c tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] LIGHTOS: no hostnqn found. {{(pid=73449) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 11:51:49 user nova-compute[73449]: DEBUG os_brick.utils [None req-caa85b69-42e9-459f-9b45-a6c85c602a9c tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] <== get_connector_properties: return (160ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4d3924302012', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 11:51:49 user nova-compute[73449]: DEBUG nova.virt.block_device [None req-caa85b69-42e9-459f-9b45-a6c85c602a9c tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] Updating existing volume attachment record: 34525487-49ee-49e9-83a7-875a288a868a {{(pid=73449) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 11:51:49 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a9b7ccfe-563f-4459-af39-6bf7b2015d24 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Lock "01ef4274-dfa1-4f7d-a24c-a1686b692f70" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.088s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:51:49 user nova-compute[73449]: DEBUG nova.compute.manager [req-224d9ebc-d602-4e94-8286-59204e36691f req-12a470bc-7e6d-4399-aa85-b779ddea445e service nova] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] Received event network-vif-plugged-e1cb1992-df66-4253-ba1f-3c30647c61de {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:51:49 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-224d9ebc-d602-4e94-8286-59204e36691f req-12a470bc-7e6d-4399-aa85-b779ddea445e service nova] Acquiring lock "01ef4274-dfa1-4f7d-a24c-a1686b692f70-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:51:49 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-224d9ebc-d602-4e94-8286-59204e36691f req-12a470bc-7e6d-4399-aa85-b779ddea445e service nova] Lock "01ef4274-dfa1-4f7d-a24c-a1686b692f70-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:51:49 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-224d9ebc-d602-4e94-8286-59204e36691f req-12a470bc-7e6d-4399-aa85-b779ddea445e service nova] Lock "01ef4274-dfa1-4f7d-a24c-a1686b692f70-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:51:49 user nova-compute[73449]: DEBUG nova.compute.manager [req-224d9ebc-d602-4e94-8286-59204e36691f req-12a470bc-7e6d-4399-aa85-b779ddea445e service nova] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] No waiting events found dispatching network-vif-plugged-e1cb1992-df66-4253-ba1f-3c30647c61de {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:51:49 user nova-compute[73449]: WARNING nova.compute.manager [req-224d9ebc-d602-4e94-8286-59204e36691f req-12a470bc-7e6d-4399-aa85-b779ddea445e service nova] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] Received unexpected event network-vif-plugged-e1cb1992-df66-4253-ba1f-3c30647c61de for instance with vm_state active and task_state None.
Aug 17 11:51:49 user nova-compute[73449]: DEBUG nova.network.neutron [None req-caa85b69-42e9-459f-9b45-a6c85c602a9c tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] Successfully created port: 4a57c385-a0c8-454a-acbf-d1f783ff3131 {{(pid=73449) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 11:51:50 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:51:50 user nova-compute[73449]: DEBUG nova.network.neutron [None req-caa85b69-42e9-459f-9b45-a6c85c602a9c tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] Successfully updated port: 4a57c385-a0c8-454a-acbf-d1f783ff3131 {{(pid=73449) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 11:51:50 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-caa85b69-42e9-459f-9b45-a6c85c602a9c tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Acquiring lock "refresh_cache-b32df06e-0b5a-4384-946b-64d64aeeb07e" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:51:50 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-caa85b69-42e9-459f-9b45-a6c85c602a9c tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Acquired lock "refresh_cache-b32df06e-0b5a-4384-946b-64d64aeeb07e" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:51:50 user nova-compute[73449]: DEBUG nova.network.neutron [None req-caa85b69-42e9-459f-9b45-a6c85c602a9c tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] Building network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 11:51:50 user nova-compute[73449]: DEBUG nova.compute.manager [req-cc40d258-a64d-4547-9b7c-350057e3fdd1 req-52ea9d73-cc78-43f7-8456-8e243a09e6c4 service nova] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] Received event network-changed-4a57c385-a0c8-454a-acbf-d1f783ff3131 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:51:50 user nova-compute[73449]: DEBUG nova.compute.manager [req-cc40d258-a64d-4547-9b7c-350057e3fdd1 req-52ea9d73-cc78-43f7-8456-8e243a09e6c4 service nova] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] Refreshing instance network info cache due to event network-changed-4a57c385-a0c8-454a-acbf-d1f783ff3131. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 11:51:50 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-cc40d258-a64d-4547-9b7c-350057e3fdd1 req-52ea9d73-cc78-43f7-8456-8e243a09e6c4 service nova] Acquiring lock "refresh_cache-b32df06e-0b5a-4384-946b-64d64aeeb07e" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:51:50 user nova-compute[73449]: DEBUG nova.network.neutron [None req-caa85b69-42e9-459f-9b45-a6c85c602a9c tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] Instance cache missing network info. {{(pid=73449) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 11:51:51 user nova-compute[73449]: DEBUG nova.network.neutron [None req-caa85b69-42e9-459f-9b45-a6c85c602a9c tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] Updating instance_info_cache with network_info: [{"id": "4a57c385-a0c8-454a-acbf-d1f783ff3131", "address": "fa:16:3e:be:34:a2", "network": {"id": "72c50a42-688f-4868-8e19-c40b103a49cd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1792423641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "068c5270255744a18208a0ad9b35f168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a57c385-a0", "ovs_interfaceid": "4a57c385-a0c8-454a-acbf-d1f783ff3131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:51:51 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-caa85b69-42e9-459f-9b45-a6c85c602a9c tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Releasing lock "refresh_cache-b32df06e-0b5a-4384-946b-64d64aeeb07e" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:51:51 user nova-compute[73449]: DEBUG nova.compute.manager [None req-caa85b69-42e9-459f-9b45-a6c85c602a9c tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] Instance network_info: |[{"id": "4a57c385-a0c8-454a-acbf-d1f783ff3131", "address": "fa:16:3e:be:34:a2", "network": {"id": "72c50a42-688f-4868-8e19-c40b103a49cd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1792423641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "068c5270255744a18208a0ad9b35f168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a57c385-a0", "ovs_interfaceid": "4a57c385-a0c8-454a-acbf-d1f783ff3131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73449) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 11:51:51 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-cc40d258-a64d-4547-9b7c-350057e3fdd1 req-52ea9d73-cc78-43f7-8456-8e243a09e6c4 service nova] Acquired lock "refresh_cache-b32df06e-0b5a-4384-946b-64d64aeeb07e" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:51:51 user nova-compute[73449]: DEBUG nova.network.neutron [req-cc40d258-a64d-4547-9b7c-350057e3fdd1 req-52ea9d73-cc78-43f7-8456-8e243a09e6c4 service nova] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] Refreshing network info cache for port 4a57c385-a0c8-454a-acbf-d1f783ff3131 {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 11:51:51 user nova-compute[73449]: DEBUG nova.network.neutron [req-cc40d258-a64d-4547-9b7c-350057e3fdd1 req-52ea9d73-cc78-43f7-8456-8e243a09e6c4 service nova] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] Updated VIF entry in instance network info cache for port 4a57c385-a0c8-454a-acbf-d1f783ff3131. {{(pid=73449) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 11:51:51 user nova-compute[73449]: DEBUG nova.network.neutron [req-cc40d258-a64d-4547-9b7c-350057e3fdd1 req-52ea9d73-cc78-43f7-8456-8e243a09e6c4 service nova] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] Updating instance_info_cache with network_info: [{"id": "4a57c385-a0c8-454a-acbf-d1f783ff3131", "address": "fa:16:3e:be:34:a2", "network": {"id": "72c50a42-688f-4868-8e19-c40b103a49cd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1792423641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "068c5270255744a18208a0ad9b35f168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a57c385-a0", "ovs_interfaceid": "4a57c385-a0c8-454a-acbf-d1f783ff3131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:51:51 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-cc40d258-a64d-4547-9b7c-350057e3fdd1 req-52ea9d73-cc78-43f7-8456-8e243a09e6c4 service nova] Releasing lock "refresh_cache-b32df06e-0b5a-4384-946b-64d64aeeb07e" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:51:53 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:51:55 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:52:00 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:52:00 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:52:00 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:52:00 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Starting heal instance info cache {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 11:52:00 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:52:00 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:52:00 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73449) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 11:52:00 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 11:52:00 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 11:52:00 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:52:00 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "refresh_cache-3d74c8f6-fb4e-4460-b722-674a8a1e2d25" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:52:00 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquired lock "refresh_cache-3d74c8f6-fb4e-4460-b722-674a8a1e2d25" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:52:00 user nova-compute[73449]: DEBUG nova.network.neutron [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] Forcefully refreshing network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 11:52:00 user nova-compute[73449]: DEBUG nova.network.neutron [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] Updating instance_info_cache with network_info: [{"id": "a0e89b76-95af-4e50-a972-b223cc5b3cab", "address": "fa:16:3e:5c:ab:e7", "network": {"id": "f7298070-baaa-4842-b3b2-d9fe1058d3b6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1715911399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8722edee53ed4a9188366c38f3b8b52f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0e89b76-95", "ovs_interfaceid": "a0e89b76-95af-4e50-a972-b223cc5b3cab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:52:00 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Releasing lock "refresh_cache-3d74c8f6-fb4e-4460-b722-674a8a1e2d25" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:52:00 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] Updated the network info_cache for instance {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 11:52:00 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:52:00 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:52:00 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:52:00 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:52:00 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:52:00 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:52:00 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73449) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 11:52:00 user nova-compute[73449]: DEBUG nova.compute.manager [None req-caa85b69-42e9-459f-9b45-a6c85c602a9c tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] Start spawning the instance on the hypervisor. {{(pid=73449) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 11:52:00 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-caa85b69-42e9-459f-9b45-a6c85c602a9c tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] Creating instance directory {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 11:52:00 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-caa85b69-42e9-459f-9b45-a6c85c602a9c tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] Creating image(s)
Aug 17 11:52:00 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-caa85b69-42e9-459f-9b45-a6c85c602a9c tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] Did not create local disks {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 11:52:00 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-caa85b69-42e9-459f-9b45-a6c85c602a9c tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] Ensure instance console log exists: /opt/stack/data/nova/instances/b32df06e-0b5a-4384-946b-64d64aeeb07e/console.log {{(pid=73449) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 11:52:00 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-caa85b69-42e9-459f-9b45-a6c85c602a9c tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:52:00 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-caa85b69-42e9-459f-9b45-a6c85c602a9c tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:52:00 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-caa85b69-42e9-459f-9b45-a6c85c602a9c tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:52:00 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-caa85b69-42e9-459f-9b45-a6c85c602a9c tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] Start _get_guest_xml network_info=[{"id": "4a57c385-a0c8-454a-acbf-d1f783ff3131", "address": "fa:16:3e:be:34:a2", "network": {"id": "72c50a42-688f-4868-8e19-c40b103a49cd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1792423641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "068c5270255744a18208a0ad9b35f168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a57c385-a0", "ovs_interfaceid": "4a57c385-a0c8-454a-acbf-d1f783ff3131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'attachment_id': '34525487-49ee-49e9-83a7-875a288a868a', 'boot_index': 0, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ktosaVNw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b32df06e-0b5a-4384-946b-64d64aeeb07e', 'attached_at': '', 'detached_at': '', 'volume_id': '3724ddd1-6668-4637-a4f2-175cf033a0f7', 'serial': '3724ddd1-6668-4637-a4f2-175cf033a0f7'}, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 11:52:00 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-caa85b69-42e9-459f-9b45-a6c85c602a9c tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:52:00 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-caa85b69-42e9-459f-9b45-a6c85c602a9c tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:52:00 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-caa85b69-42e9-459f-9b45-a6c85c602a9c tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 11:52:00 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-caa85b69-42e9-459f-9b45-a6c85c602a9c tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] CPU controller missing on host. {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 11:52:00 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-caa85b69-42e9-459f-9b45-a6c85c602a9c tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 11:52:00 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-caa85b69-42e9-459f-9b45-a6c85c602a9c tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] CPU controller found on host. {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 11:52:00 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-caa85b69-42e9-459f-9b45-a6c85c602a9c tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73449) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 11:52:00 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-caa85b69-42e9-459f-9b45-a6c85c602a9c tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T11:35:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 11:52:00 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-caa85b69-42e9-459f-9b45-a6c85c602a9c tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Flavor limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 11:52:00 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-caa85b69-42e9-459f-9b45-a6c85c602a9c tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Image limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 11:52:00 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-caa85b69-42e9-459f-9b45-a6c85c602a9c tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Flavor pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 11:52:00 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-caa85b69-42e9-459f-9b45-a6c85c602a9c tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Image pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 11:52:00 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-caa85b69-42e9-459f-9b45-a6c85c602a9c tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 11:52:00 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-caa85b69-42e9-459f-9b45-a6c85c602a9c tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 11:52:00 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-caa85b69-42e9-459f-9b45-a6c85c602a9c tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 11:52:00 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-caa85b69-42e9-459f-9b45-a6c85c602a9c tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Got 1 possible topologies {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 11:52:00 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-caa85b69-42e9-459f-9b45-a6c85c602a9c tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 11:52:00 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-caa85b69-42e9-459f-9b45-a6c85c602a9c tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 11:52:01 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-caa85b69-42e9-459f-9b45-a6c85c602a9c tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] Calling os-brick to attach iSCSI Volume {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 11:52:01 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa85b69-42e9-459f-9b45-a6c85c602a9c tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ktosaVNw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 11:52:01 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-caa85b69-42e9-459f-9b45-a6c85c602a9c tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 11:52:01 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-caa85b69-42e9-459f-9b45-a6c85c602a9c tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:52:01 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-caa85b69-42e9-459f-9b45-a6c85c602a9c tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:52:01 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-caa85b69-42e9-459f-9b45-a6c85c602a9c tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 11:52:01 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-caa85b69-42e9-459f-9b45-a6c85c602a9c tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:52:01 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-caa85b69-42e9-459f-9b45-a6c85c602a9c tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:52:01 user nova-compute[73449]: INFO os_brick.initiator.connectors.iscsi [None req-caa85b69-42e9-459f-9b45-a6c85c602a9c tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 11:52:01 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 -p 172.16.0.220:3260 {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:52:01 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:52:01 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[65f788a8-98f8-43d0-a88c-6387c8826cf0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:52:01 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa85b69-42e9-459f-9b45-a6c85c602a9c tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 11:52:01 user nova-compute[73449]:  {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:52:01 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 -p 172.16.0.220:3260 --interface default --op new {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:52:01 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:52:01 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa97baf5-e2b9-48e9-83b0-26222c93eeb7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7] added\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:52:01 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa85b69-42e9-459f-9b45-a6c85c602a9c tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7] added
Aug 17 11:52:01 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:52:01 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:52:01 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:52:01 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eb46773-19d3-48bd-8b0a-607e5a7d1cb5]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:52:01 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa85b69-42e9-459f-9b45-a6c85c602a9c tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:52:01 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:52:01 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:52:01 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f2e8082-a8dd-437c-8293-7b31c9c79243]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:52:01 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa85b69-42e9-459f-9b45-a6c85c602a9c tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:52:01 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ktosaVNw {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:52:01 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ktosaVNw" returned: 0 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:52:01 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[cec6fe0f-762f-4474-a550-78d160e786a7]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:52:01 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa85b69-42e9-459f-9b45-a6c85c602a9c tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ktosaVNw'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:52:01 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:52:01 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:52:01 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[b94bfb3a-237b-4488-9d16-9d2e53f7527a]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:52:01 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa85b69-42e9-459f-9b45-a6c85c602a9c tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:52:01 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:52:01 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:52:01 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[7191ca79-3827-4a35-8cda-d1cd95cddbef]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6b06606-4920-4dce-bae0-3101c8b7dc6a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:323f4327-bf84-45fb-9261-d62b431ac90b (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:52:01 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa85b69-42e9-459f-9b45-a6c85c602a9c tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe (non-flash)
Aug 17 11:52:01 user nova-compute[73449]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 (non-flash)
Aug 17 11:52:01 user nova-compute[73449]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611 (non-flash)
Aug 17 11:52:01 user nova-compute[73449]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6b06606-4920-4dce-bae0-3101c8b7dc6a (non-flash)
Aug 17 11:52:01 user nova-compute[73449]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:323f4327-bf84-45fb-9261-d62b431ac90b (non-flash)
Aug 17 11:52:01 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:52:01 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa85b69-42e9-459f-9b45-a6c85c602a9c tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe (non-flash)
Aug 17 11:52:01 user nova-compute[73449]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 (non-flash)
Aug 17 11:52:01 user nova-compute[73449]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611 (non-flash)
Aug 17 11:52:01 user nova-compute[73449]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6b06606-4920-4dce-bae0-3101c8b7dc6a (non-flash)
Aug 17 11:52:01 user nova-compute[73449]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:323f4327-bf84-45fb-9261-d62b431ac90b (non-flash)
Aug 17 11:52:01 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:52:01 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 -p 172.16.0.220:3260 --login {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:52:01 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 -p 172.16.0.220:3260 --login" returned: 0 in 0.088s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:52:01 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c535e2-1107-4f7a-b05a-d691950ec4c2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:52:01 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa85b69-42e9-459f-9b45-a6c85c602a9c tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7, portal: 172.16.0.220,3260]
Aug 17 11:52:01 user nova-compute[73449]: Login to [iface: default, target: iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7, portal: 172.16.0.220,3260] successful.
Aug 17 11:52:01 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:52:01 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:52:01 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:52:01 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c1f5559-49d3-4808-90b0-9a40e5b796de]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:52:01 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa85b69-42e9-459f-9b45-a6c85c602a9c tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:52:01 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:52:01 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:52:01 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bb73817-0772-496a-90d7-5b0ba0caac1c]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6b06606-4920-4dce-bae0-3101c8b7dc6a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:323f4327-bf84-45fb-9261-d62b431ac90b (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:52:01 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa85b69-42e9-459f-9b45-a6c85c602a9c tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe (non-flash)
Aug 17 11:52:01 user nova-compute[73449]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 (non-flash)
Aug 17 11:52:01 user nova-compute[73449]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611 (non-flash)
Aug 17 11:52:01 user nova-compute[73449]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6b06606-4920-4dce-bae0-3101c8b7dc6a (non-flash)
Aug 17 11:52:01 user nova-compute[73449]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:323f4327-bf84-45fb-9261-d62b431ac90b (non-flash)
Aug 17 11:52:01 user nova-compute[73449]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 (non-flash)
Aug 17 11:52:01 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:52:01 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa85b69-42e9-459f-9b45-a6c85c602a9c tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe (non-flash)
Aug 17 11:52:01 user nova-compute[73449]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 (non-flash)
Aug 17 11:52:01 user nova-compute[73449]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611 (non-flash)
Aug 17 11:52:01 user nova-compute[73449]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6b06606-4920-4dce-bae0-3101c8b7dc6a (non-flash)
Aug 17 11:52:01 user nova-compute[73449]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:323f4327-bf84-45fb-9261-d62b431ac90b (non-flash)
Aug 17 11:52:01 user nova-compute[73449]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 (non-flash)
Aug 17 11:52:01 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:52:01 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-caa85b69-42e9-459f-9b45-a6c85c602a9c tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.331s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:52:01 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa85b69-42e9-459f-9b45-a6c85c602a9c tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Connected to 172.16.0.220:3260 {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 11:52:01 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-caa85b69-42e9-459f-9b45-a6c85c602a9c tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] HCTL ('38', '-', '-', 0) found on session 33 with lun 0 {{(pid=73449) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 11:52:01 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-caa85b69-42e9-459f-9b45-a6c85c602a9c tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=73449) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 11:52:01 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:52:01 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.016s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:52:01 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[404881b6-cfd5-4395-b71a-5315ca1dc0a3]: (4, ('- - 0', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:52:01 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-caa85b69-42e9-459f-9b45-a6c85c602a9c tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Searching for a device in session 33 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=73449) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 11:52:01 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa85b69-42e9-459f-9b45-a6c85c602a9c tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ktosaVNw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 11:52:02 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-caa85b69-42e9-459f-9b45-a6c85c602a9c tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.366s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:52:02 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa85b69-42e9-459f-9b45-a6c85c602a9c tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] <== connect_volume: return (1368ms) {'type': 'block', 'scsi_wwn': '26133656162363930', 'path': '/dev/sdg'} {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 11:52:02 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-caa85b69-42e9-459f-9b45-a6c85c602a9c tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26133656162363930', 'path': '/dev/sdg'} {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 11:52:02 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-caa85b69-42e9-459f-9b45-a6c85c602a9c tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:51:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1060578378',display_name='tempest-ServerActionsTestOtherA-server-1060578378',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1060578378',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCjLihiqnR89DD+L9AvKMPg4aJ24FTEbroZyaBsKATQAbGhLg8fsSlSGdiYIhidGfsmIAOo7d+B78UcRA6oBB5kBwNop43IFNlD0zoDm7uS+jBpAFARKuZg2/qBioB0EGg==',key_name='tempest-keypair-71173965',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='068c5270255744a18208a0ad9b35f168',ramdisk_id='',reservation_id='r-ycvaidk7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-303961666',owner_user_name='tempest-ServerActionsTestOtherA-303961666-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T11:51:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e44f6d8893da4d95a8ebe95180355c04',uuid=b32df06e-0b5a-4384-946b-64d64aeeb07e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4a57c385-a0c8-454a-acbf-d1f783ff3131", "address": "fa:16:3e:be:34:a2", "network": {"id": "72c50a42-688f-4868-8e19-c40b103a49cd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1792423641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "068c5270255744a18208a0ad9b35f168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a57c385-a0", "ovs_interfaceid": "4a57c385-a0c8-454a-acbf-d1f783ff3131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73449) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 11:52:02 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-caa85b69-42e9-459f-9b45-a6c85c602a9c tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Converting VIF {"id": "4a57c385-a0c8-454a-acbf-d1f783ff3131", "address": "fa:16:3e:be:34:a2", "network": {"id": "72c50a42-688f-4868-8e19-c40b103a49cd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1792423641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "068c5270255744a18208a0ad9b35f168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a57c385-a0", "ovs_interfaceid": "4a57c385-a0c8-454a-acbf-d1f783ff3131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:52:02 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-caa85b69-42e9-459f-9b45-a6c85c602a9c tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:34:a2,bridge_name='br-int',has_traffic_filtering=True,id=4a57c385-a0c8-454a-acbf-d1f783ff3131,network=Network(72c50a42-688f-4868-8e19-c40b103a49cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a57c385-a0') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:52:02 user nova-compute[73449]: DEBUG nova.objects.instance [None req-caa85b69-42e9-459f-9b45-a6c85c602a9c tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Lazy-loading 'pci_devices' on Instance uuid b32df06e-0b5a-4384-946b-64d64aeeb07e {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:52:02 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-caa85b69-42e9-459f-9b45-a6c85c602a9c tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] End _get_guest_xml xml=<domain type="kvm">
Aug 17 11:52:02 user nova-compute[73449]:   <uuid>b32df06e-0b5a-4384-946b-64d64aeeb07e</uuid>
Aug 17 11:52:02 user nova-compute[73449]:   <name>instance-0000001f</name>
Aug 17 11:52:02 user nova-compute[73449]:   <memory>524288</memory>
Aug 17 11:52:02 user nova-compute[73449]:   <vcpu>1</vcpu>
Aug 17 11:52:02 user nova-compute[73449]:   <metadata>
Aug 17 11:52:02 user nova-compute[73449]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 11:52:02 user nova-compute[73449]:       <nova:package version="0.0.0"/>
Aug 17 11:52:02 user nova-compute[73449]:       <nova:name>tempest-ServerActionsTestOtherA-server-1060578378</nova:name>
Aug 17 11:52:02 user nova-compute[73449]:       <nova:creationTime>2023-08-17 11:52:00</nova:creationTime>
Aug 17 11:52:02 user nova-compute[73449]:       <nova:flavor name="m1.tiny">
Aug 17 11:52:02 user nova-compute[73449]:         <nova:memory>512</nova:memory>
Aug 17 11:52:02 user nova-compute[73449]:         <nova:disk>1</nova:disk>
Aug 17 11:52:02 user nova-compute[73449]:         <nova:swap>0</nova:swap>
Aug 17 11:52:02 user nova-compute[73449]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 11:52:02 user nova-compute[73449]:         <nova:vcpus>1</nova:vcpus>
Aug 17 11:52:02 user nova-compute[73449]:       </nova:flavor>
Aug 17 11:52:02 user nova-compute[73449]:       <nova:owner>
Aug 17 11:52:02 user nova-compute[73449]:         <nova:user uuid="e44f6d8893da4d95a8ebe95180355c04">tempest-ServerActionsTestOtherA-303961666-project-member</nova:user>
Aug 17 11:52:02 user nova-compute[73449]:         <nova:project uuid="068c5270255744a18208a0ad9b35f168">tempest-ServerActionsTestOtherA-303961666</nova:project>
Aug 17 11:52:02 user nova-compute[73449]:       </nova:owner>
Aug 17 11:52:02 user nova-compute[73449]:       <nova:ports>
Aug 17 11:52:02 user nova-compute[73449]:         <nova:port uuid="4a57c385-a0c8-454a-acbf-d1f783ff3131">
Aug 17 11:52:02 user nova-compute[73449]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 17 11:52:02 user nova-compute[73449]:         </nova:port>
Aug 17 11:52:02 user nova-compute[73449]:       </nova:ports>
Aug 17 11:52:02 user nova-compute[73449]:     </nova:instance>
Aug 17 11:52:02 user nova-compute[73449]:   </metadata>
Aug 17 11:52:02 user nova-compute[73449]:   <sysinfo type="smbios">
Aug 17 11:52:02 user nova-compute[73449]:     <system>
Aug 17 11:52:02 user nova-compute[73449]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 11:52:02 user nova-compute[73449]:       <entry name="product">OpenStack Nova</entry>
Aug 17 11:52:02 user nova-compute[73449]:       <entry name="version">0.0.0</entry>
Aug 17 11:52:02 user nova-compute[73449]:       <entry name="serial">b32df06e-0b5a-4384-946b-64d64aeeb07e</entry>
Aug 17 11:52:02 user nova-compute[73449]:       <entry name="uuid">b32df06e-0b5a-4384-946b-64d64aeeb07e</entry>
Aug 17 11:52:02 user nova-compute[73449]:       <entry name="family">Virtual Machine</entry>
Aug 17 11:52:02 user nova-compute[73449]:     </system>
Aug 17 11:52:02 user nova-compute[73449]:   </sysinfo>
Aug 17 11:52:02 user nova-compute[73449]:   <os>
Aug 17 11:52:02 user nova-compute[73449]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 11:52:02 user nova-compute[73449]:     <boot dev="hd"/>
Aug 17 11:52:02 user nova-compute[73449]:     <smbios mode="sysinfo"/>
Aug 17 11:52:02 user nova-compute[73449]:   </os>
Aug 17 11:52:02 user nova-compute[73449]:   <features>
Aug 17 11:52:02 user nova-compute[73449]:     <acpi/>
Aug 17 11:52:02 user nova-compute[73449]:     <apic/>
Aug 17 11:52:02 user nova-compute[73449]:     <vmcoreinfo/>
Aug 17 11:52:02 user nova-compute[73449]:   </features>
Aug 17 11:52:02 user nova-compute[73449]:   <clock offset="utc">
Aug 17 11:52:02 user nova-compute[73449]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 11:52:02 user nova-compute[73449]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 11:52:02 user nova-compute[73449]:     <timer name="hpet" present="no"/>
Aug 17 11:52:02 user nova-compute[73449]:   </clock>
Aug 17 11:52:02 user nova-compute[73449]:   <cpu mode="custom" match="exact">
Aug 17 11:52:02 user nova-compute[73449]:     <model>Nehalem</model>
Aug 17 11:52:02 user nova-compute[73449]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 11:52:02 user nova-compute[73449]:   </cpu>
Aug 17 11:52:02 user nova-compute[73449]:   <devices>
Aug 17 11:52:02 user nova-compute[73449]:     <disk type="block" device="disk">
Aug 17 11:52:02 user nova-compute[73449]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 11:52:02 user nova-compute[73449]:       <source dev="/dev/sdg"/>
Aug 17 11:52:02 user nova-compute[73449]:       <target dev="vda" bus="virtio"/>
Aug 17 11:52:02 user nova-compute[73449]:       <serial>3724ddd1-6668-4637-a4f2-175cf033a0f7</serial>
Aug 17 11:52:02 user nova-compute[73449]:     </disk>
Aug 17 11:52:02 user nova-compute[73449]:     <interface type="ethernet">
Aug 17 11:52:02 user nova-compute[73449]:       <mac address="fa:16:3e:be:34:a2"/>
Aug 17 11:52:02 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 11:52:02 user nova-compute[73449]:       <mtu size="1442"/>
Aug 17 11:52:02 user nova-compute[73449]:       <target dev="tap4a57c385-a0"/>
Aug 17 11:52:02 user nova-compute[73449]:     </interface>
Aug 17 11:52:02 user nova-compute[73449]:     <serial type="pty">
Aug 17 11:52:02 user nova-compute[73449]:       <log file="/opt/stack/data/nova/instances/b32df06e-0b5a-4384-946b-64d64aeeb07e/console.log" append="off"/>
Aug 17 11:52:02 user nova-compute[73449]:     </serial>
Aug 17 11:52:02 user nova-compute[73449]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 11:52:02 user nova-compute[73449]:     <video>
Aug 17 11:52:02 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 11:52:02 user nova-compute[73449]:     </video>
Aug 17 11:52:02 user nova-compute[73449]:     <rng model="virtio">
Aug 17 11:52:02 user nova-compute[73449]:       <backend model="random">/dev/urandom</backend>
Aug 17 11:52:02 user nova-compute[73449]:     </rng>
Aug 17 11:52:02 user nova-compute[73449]:     <controller type="usb" index="0" model="none"/>
Aug 17 11:52:02 user nova-compute[73449]:     <memballoon model="virtio">
Aug 17 11:52:02 user nova-compute[73449]:       <stats period="10"/>
Aug 17 11:52:02 user nova-compute[73449]:     </memballoon>
Aug 17 11:52:02 user nova-compute[73449]:   </devices>
Aug 17 11:52:02 user nova-compute[73449]: </domain>
Aug 17 11:52:02 user nova-compute[73449]:  {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 11:52:02 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-caa85b69-42e9-459f-9b45-a6c85c602a9c tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:51:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1060578378',display_name='tempest-ServerActionsTestOtherA-server-1060578378',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1060578378',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCjLihiqnR89DD+L9AvKMPg4aJ24FTEbroZyaBsKATQAbGhLg8fsSlSGdiYIhidGfsmIAOo7d+B78UcRA6oBB5kBwNop43IFNlD0zoDm7uS+jBpAFARKuZg2/qBioB0EGg==',key_name='tempest-keypair-71173965',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='068c5270255744a18208a0ad9b35f168',ramdisk_id='',reservation_id='r-ycvaidk7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-303961666',owner_user_name='tempest-ServerActionsTestOtherA-303961666-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T11:51:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e44f6d8893da4d95a8ebe95180355c04',uuid=b32df06e-0b5a-4384-946b-64d64aeeb07e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4a57c385-a0c8-454a-acbf-d1f783ff3131", "address": "fa:16:3e:be:34:a2", "network": {"id": "72c50a42-688f-4868-8e19-c40b103a49cd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1792423641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "068c5270255744a18208a0ad9b35f168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a57c385-a0", "ovs_interfaceid": "4a57c385-a0c8-454a-acbf-d1f783ff3131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 11:52:02 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-caa85b69-42e9-459f-9b45-a6c85c602a9c tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Converting VIF {"id": "4a57c385-a0c8-454a-acbf-d1f783ff3131", "address": "fa:16:3e:be:34:a2", "network": {"id": "72c50a42-688f-4868-8e19-c40b103a49cd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1792423641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "068c5270255744a18208a0ad9b35f168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a57c385-a0", "ovs_interfaceid": "4a57c385-a0c8-454a-acbf-d1f783ff3131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:52:02 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-caa85b69-42e9-459f-9b45-a6c85c602a9c tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:34:a2,bridge_name='br-int',has_traffic_filtering=True,id=4a57c385-a0c8-454a-acbf-d1f783ff3131,network=Network(72c50a42-688f-4868-8e19-c40b103a49cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a57c385-a0') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:52:02 user nova-compute[73449]: DEBUG os_vif [None req-caa85b69-42e9-459f-9b45-a6c85c602a9c tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:34:a2,bridge_name='br-int',has_traffic_filtering=True,id=4a57c385-a0c8-454a-acbf-d1f783ff3131,network=Network(72c50a42-688f-4868-8e19-c40b103a49cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a57c385-a0') {{(pid=73449) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 11:52:02 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:52:02 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:52:02 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 11:52:02 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:52:02 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4a57c385-a0, may_exist=True, interface_attrs={}) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:52:02 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4a57c385-a0, col_values=(('external_ids', {'iface-id': '4a57c385-a0c8-454a-acbf-d1f783ff3131', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:be:34:a2', 'vm-uuid': 'b32df06e-0b5a-4384-946b-64d64aeeb07e'}),), if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:52:02 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:52:02 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:52:02 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:52:02 user nova-compute[73449]: INFO os_vif [None req-caa85b69-42e9-459f-9b45-a6c85c602a9c tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:34:a2,bridge_name='br-int',has_traffic_filtering=True,id=4a57c385-a0c8-454a-acbf-d1f783ff3131,network=Network(72c50a42-688f-4868-8e19-c40b103a49cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a57c385-a0')
Aug 17 11:52:02 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-caa85b69-42e9-459f-9b45-a6c85c602a9c tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] No BDM found with device name vda, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 11:52:02 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-caa85b69-42e9-459f-9b45-a6c85c602a9c tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] No VIF found with MAC fa:16:3e:be:34:a2, not building metadata {{(pid=73449) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 11:52:02 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:52:02 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:52:02 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:52:02 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:52:02 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=73449) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 11:52:03 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:52:03 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:52:03 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:52:03 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:52:04 user nova-compute[73449]: DEBUG nova.compute.manager [req-a84f8f48-1df5-47db-85f5-d457d28fc901 req-d8470b79-b3c9-40a1-80d5-3ac98fe0b8f5 service nova] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] Received event network-vif-plugged-4a57c385-a0c8-454a-acbf-d1f783ff3131 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:52:04 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-a84f8f48-1df5-47db-85f5-d457d28fc901 req-d8470b79-b3c9-40a1-80d5-3ac98fe0b8f5 service nova] Acquiring lock "b32df06e-0b5a-4384-946b-64d64aeeb07e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:52:04 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-a84f8f48-1df5-47db-85f5-d457d28fc901 req-d8470b79-b3c9-40a1-80d5-3ac98fe0b8f5 service nova] Lock "b32df06e-0b5a-4384-946b-64d64aeeb07e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:52:04 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-a84f8f48-1df5-47db-85f5-d457d28fc901 req-d8470b79-b3c9-40a1-80d5-3ac98fe0b8f5 service nova] Lock "b32df06e-0b5a-4384-946b-64d64aeeb07e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:52:04 user nova-compute[73449]: DEBUG nova.compute.manager [req-a84f8f48-1df5-47db-85f5-d457d28fc901 req-d8470b79-b3c9-40a1-80d5-3ac98fe0b8f5 service nova] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] No waiting events found dispatching network-vif-plugged-4a57c385-a0c8-454a-acbf-d1f783ff3131 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:52:04 user nova-compute[73449]: WARNING nova.compute.manager [req-a84f8f48-1df5-47db-85f5-d457d28fc901 req-d8470b79-b3c9-40a1-80d5-3ac98fe0b8f5 service nova] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] Received unexpected event network-vif-plugged-4a57c385-a0c8-454a-acbf-d1f783ff3131 for instance with vm_state building and task_state spawning.
Aug 17 11:52:04 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:52:04 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:52:05 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692273125.8397539, b32df06e-0b5a-4384-946b-64d64aeeb07e => Resumed> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:52:05 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] VM Resumed (Lifecycle Event)
Aug 17 11:52:05 user nova-compute[73449]: DEBUG nova.compute.manager [None req-caa85b69-42e9-459f-9b45-a6c85c602a9c tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] Instance event wait completed in 0 seconds for  {{(pid=73449) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 11:52:05 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-caa85b69-42e9-459f-9b45-a6c85c602a9c tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] Guest created on hypervisor {{(pid=73449) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 11:52:05 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] Instance spawned successfully.
Aug 17 11:52:05 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-caa85b69-42e9-459f-9b45-a6c85c602a9c tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 11:52:05 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:52:05 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 11:52:05 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-caa85b69-42e9-459f-9b45-a6c85c602a9c tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] Found default for hw_cdrom_bus of ide {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:52:05 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-caa85b69-42e9-459f-9b45-a6c85c602a9c tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] Found default for hw_disk_bus of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:52:05 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-caa85b69-42e9-459f-9b45-a6c85c602a9c tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] Found default for hw_input_bus of None {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:52:05 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-caa85b69-42e9-459f-9b45-a6c85c602a9c tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] Found default for hw_pointer_model of None {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:52:05 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-caa85b69-42e9-459f-9b45-a6c85c602a9c tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] Found default for hw_video_model of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:52:05 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-caa85b69-42e9-459f-9b45-a6c85c602a9c tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] Found default for hw_vif_model of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:52:05 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 11:52:05 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692273125.8412797, b32df06e-0b5a-4384-946b-64d64aeeb07e => Started> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:52:05 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] VM Started (Lifecycle Event)
Aug 17 11:52:05 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:52:05 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 11:52:05 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 11:52:05 user nova-compute[73449]: INFO nova.compute.manager [None req-caa85b69-42e9-459f-9b45-a6c85c602a9c tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] Took 5.01 seconds to spawn the instance on the hypervisor.
Aug 17 11:52:05 user nova-compute[73449]: DEBUG nova.compute.manager [None req-caa85b69-42e9-459f-9b45-a6c85c602a9c tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:52:06 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd4ec7bd-002e-4a71-9314-96c21427af27/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:52:06 user nova-compute[73449]: INFO nova.compute.manager [None req-caa85b69-42e9-459f-9b45-a6c85c602a9c tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] Took 17.79 seconds to build instance.
Aug 17 11:52:06 user nova-compute[73449]: DEBUG nova.compute.manager [req-7c745c56-edaf-48f7-935e-a2a6b35187b8 req-1e2d7c83-5bcd-45c7-8a9d-5c49eebbdd8f service nova] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] Received event network-vif-plugged-4a57c385-a0c8-454a-acbf-d1f783ff3131 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:52:06 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-7c745c56-edaf-48f7-935e-a2a6b35187b8 req-1e2d7c83-5bcd-45c7-8a9d-5c49eebbdd8f service nova] Acquiring lock "b32df06e-0b5a-4384-946b-64d64aeeb07e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:52:06 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-7c745c56-edaf-48f7-935e-a2a6b35187b8 req-1e2d7c83-5bcd-45c7-8a9d-5c49eebbdd8f service nova] Lock "b32df06e-0b5a-4384-946b-64d64aeeb07e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:52:06 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-7c745c56-edaf-48f7-935e-a2a6b35187b8 req-1e2d7c83-5bcd-45c7-8a9d-5c49eebbdd8f service nova] Lock "b32df06e-0b5a-4384-946b-64d64aeeb07e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:52:06 user nova-compute[73449]: DEBUG nova.compute.manager [req-7c745c56-edaf-48f7-935e-a2a6b35187b8 req-1e2d7c83-5bcd-45c7-8a9d-5c49eebbdd8f service nova] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] No waiting events found dispatching network-vif-plugged-4a57c385-a0c8-454a-acbf-d1f783ff3131 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:52:06 user nova-compute[73449]: WARNING nova.compute.manager [req-7c745c56-edaf-48f7-935e-a2a6b35187b8 req-1e2d7c83-5bcd-45c7-8a9d-5c49eebbdd8f service nova] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] Received unexpected event network-vif-plugged-4a57c385-a0c8-454a-acbf-d1f783ff3131 for instance with vm_state active and task_state None.
Aug 17 11:52:06 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-caa85b69-42e9-459f-9b45-a6c85c602a9c tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Lock "b32df06e-0b5a-4384-946b-64d64aeeb07e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.889s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:52:06 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd4ec7bd-002e-4a71-9314-96c21427af27/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:52:06 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd4ec7bd-002e-4a71-9314-96c21427af27/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:52:06 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd4ec7bd-002e-4a71-9314-96c21427af27/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:52:06 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73449) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 11:52:06 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=73449) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 11:52:06 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a9e8ad2-19db-4975-87e4-2efce603a7d7/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:52:06 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a9e8ad2-19db-4975-87e4-2efce603a7d7/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:52:06 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a9e8ad2-19db-4975-87e4-2efce603a7d7/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:52:06 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a9e8ad2-19db-4975-87e4-2efce603a7d7/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:52:06 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk.rescue --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:52:06 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:52:06 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk.rescue --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:52:07 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:52:07 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:52:07 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:52:07 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:52:07 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:52:07 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:52:07 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73449) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 11:52:07 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=73449) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 11:52:07 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef4274-dfa1-4f7d-a24c-a1686b692f70/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:52:07 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef4274-dfa1-4f7d-a24c-a1686b692f70/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:52:07 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef4274-dfa1-4f7d-a24c-a1686b692f70/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:52:07 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef4274-dfa1-4f7d-a24c-a1686b692f70/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:52:07 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23ab9ffc-226d-4caa-8caa-9458de06a1c9/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:52:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23ab9ffc-226d-4caa-8caa-9458de06a1c9/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:52:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23ab9ffc-226d-4caa-8caa-9458de06a1c9/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:52:08 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:52:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23ab9ffc-226d-4caa-8caa-9458de06a1c9/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:52:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d74c8f6-fb4e-4460-b722-674a8a1e2d25/disk.rescue --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:52:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d74c8f6-fb4e-4460-b722-674a8a1e2d25/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:52:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d74c8f6-fb4e-4460-b722-674a8a1e2d25/disk.rescue --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:52:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d74c8f6-fb4e-4460-b722-674a8a1e2d25/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:52:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d74c8f6-fb4e-4460-b722-674a8a1e2d25/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:52:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d74c8f6-fb4e-4460-b722-674a8a1e2d25/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:52:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d74c8f6-fb4e-4460-b722-674a8a1e2d25/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:52:09 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d74c8f6-fb4e-4460-b722-674a8a1e2d25/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:52:09 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89440604-1daf-4e7a-a524-2f9c21a9cb96/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:52:09 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89440604-1daf-4e7a-a524-2f9c21a9cb96/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:52:09 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89440604-1daf-4e7a-a524-2f9c21a9cb96/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:52:09 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89440604-1daf-4e7a-a524-2f9c21a9cb96/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:52:09 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d468854-6182-49c8-acb7-0641df2d5219/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:52:09 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d468854-6182-49c8-acb7-0641df2d5219/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:52:09 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d468854-6182-49c8-acb7-0641df2d5219/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:52:09 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d468854-6182-49c8-acb7-0641df2d5219/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:52:09 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73449) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 11:52:09 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e689bc9-6625-46b7-90d0-52c50f9b73e6/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:52:10 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e689bc9-6625-46b7-90d0-52c50f9b73e6/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:52:10 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e689bc9-6625-46b7-90d0-52c50f9b73e6/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:52:10 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e689bc9-6625-46b7-90d0-52c50f9b73e6/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:52:11 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:52:11 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:52:11 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Hypervisor/Node resource view: name=user free_ram=6651MB free_disk=25.166786193847656GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73449) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 11:52:11 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:52:11 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:52:11 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Applying migration context for instance 3d468854-6182-49c8-acb7-0641df2d5219 as it has an incoming, in-progress migration 8bca2c78-a7cb-4f23-ae39-18f96e45b9f4. Migration status is reverting {{(pid=73449) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 17 11:52:11 user nova-compute[73449]: INFO nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Updating resource usage from migration 8bca2c78-a7cb-4f23-ae39-18f96e45b9f4
Aug 17 11:52:11 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 4a9e8ad2-19db-4975-87e4-2efce603a7d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:52:11 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 3d74c8f6-fb4e-4460-b722-674a8a1e2d25 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:52:11 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance ae75d334-431a-4008-8b3d-f2a727d92417 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:52:11 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:52:11 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance dd4ec7bd-002e-4a71-9314-96c21427af27 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:52:11 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Migration 8bca2c78-a7cb-4f23-ae39-18f96e45b9f4 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 17 11:52:11 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 3d468854-6182-49c8-acb7-0641df2d5219 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:52:11 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 5612f7d1-a901-4bdd-a24a-faf9a980cd04 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:52:11 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 89440604-1daf-4e7a-a524-2f9c21a9cb96 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:52:11 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance ec622bf0-4531-4892-b637-0ef564cf453b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:52:11 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 23ab9ffc-226d-4caa-8caa-9458de06a1c9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:52:11 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 9e689bc9-6625-46b7-90d0-52c50f9b73e6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:52:11 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 01ef4274-dfa1-4f7d-a24c-a1686b692f70 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:52:11 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance b32df06e-0b5a-4384-946b-64d64aeeb07e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:52:11 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=73449) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 11:52:11 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=9216MB phys_disk=40GB used_disk=29GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=73449) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 11:52:11 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 11:52:11 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 11:52:11 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Compute_service record updated for user:user {{(pid=73449) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 11:52:11 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.638s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:52:12 user nova-compute[73449]: DEBUG nova.network.neutron [None req-58f56c4c-1f88-4630-8a73-714380a05c9d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Port 1ec58d7f-18a4-4ddb-a137-2b72c5221621 binding to destination host user is already ACTIVE {{(pid=73449) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 17 11:52:12 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-58f56c4c-1f88-4630-8a73-714380a05c9d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Acquiring lock "refresh_cache-3d468854-6182-49c8-acb7-0641df2d5219" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:52:12 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-58f56c4c-1f88-4630-8a73-714380a05c9d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Acquired lock "refresh_cache-3d468854-6182-49c8-acb7-0641df2d5219" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:52:12 user nova-compute[73449]: DEBUG nova.network.neutron [None req-58f56c4c-1f88-4630-8a73-714380a05c9d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Building network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 11:52:12 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:52:12 user nova-compute[73449]: DEBUG nova.network.neutron [None req-58f56c4c-1f88-4630-8a73-714380a05c9d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Updating instance_info_cache with network_info: [{"id": "1ec58d7f-18a4-4ddb-a137-2b72c5221621", "address": "fa:16:3e:8d:35:49", "network": {"id": "870c4b80-1ae0-4a10-89b8-ec734c66c244", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2050219794-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d6856b60c404a34b6355b5fd6dd7bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec58d7f-18", "ovs_interfaceid": "1ec58d7f-18a4-4ddb-a137-2b72c5221621", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:52:12 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-58f56c4c-1f88-4630-8a73-714380a05c9d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Releasing lock "refresh_cache-3d468854-6182-49c8-acb7-0641df2d5219" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:52:12 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-58f56c4c-1f88-4630-8a73-714380a05c9d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Creating tmpfile /opt/stack/data/nova/instances/3d468854-6182-49c8-acb7-0641df2d5219/tmpjw9z1l88 to verify with other compute node that the instance is on the same shared storage. {{(pid=73449) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9622}}
Aug 17 11:52:12 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:52:12 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:52:12 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:52:12 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:52:12 user nova-compute[73449]: DEBUG nova.compute.manager [req-ea14d0cd-1ed1-41ca-b228-c1e0770ab53c req-0b9bea64-021d-4baa-96e4-37a845e201a7 service nova] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Received event network-vif-unplugged-1ec58d7f-18a4-4ddb-a137-2b72c5221621 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:52:12 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-ea14d0cd-1ed1-41ca-b228-c1e0770ab53c req-0b9bea64-021d-4baa-96e4-37a845e201a7 service nova] Acquiring lock "3d468854-6182-49c8-acb7-0641df2d5219-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:52:12 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-ea14d0cd-1ed1-41ca-b228-c1e0770ab53c req-0b9bea64-021d-4baa-96e4-37a845e201a7 service nova] Lock "3d468854-6182-49c8-acb7-0641df2d5219-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:52:12 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-ea14d0cd-1ed1-41ca-b228-c1e0770ab53c req-0b9bea64-021d-4baa-96e4-37a845e201a7 service nova] Lock "3d468854-6182-49c8-acb7-0641df2d5219-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:52:12 user nova-compute[73449]: DEBUG nova.compute.manager [req-ea14d0cd-1ed1-41ca-b228-c1e0770ab53c req-0b9bea64-021d-4baa-96e4-37a845e201a7 service nova] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] No waiting events found dispatching network-vif-unplugged-1ec58d7f-18a4-4ddb-a137-2b72c5221621 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:52:12 user nova-compute[73449]: WARNING nova.compute.manager [req-ea14d0cd-1ed1-41ca-b228-c1e0770ab53c req-0b9bea64-021d-4baa-96e4-37a845e201a7 service nova] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Received unexpected event network-vif-unplugged-1ec58d7f-18a4-4ddb-a137-2b72c5221621 for instance with vm_state resized and task_state resize_reverting.
Aug 17 11:52:13 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:52:13 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Instance destroyed successfully.
Aug 17 11:52:13 user nova-compute[73449]: DEBUG nova.objects.instance [None req-58f56c4c-1f88-4630-8a73-714380a05c9d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Lazy-loading 'resources' on Instance uuid 3d468854-6182-49c8-acb7-0641df2d5219 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:52:13 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-58f56c4c-1f88-4630-8a73-714380a05c9d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:46:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1456627687',display_name='tempest-ServerActionsTestOtherB-server-1456627687',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1456627687',id=20,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNxG3No2zUVrbEXbRYCvyFo5zdmNWjUQ1w9Et6I/UYTR5GdEjRnJlmF8yAFQAym8G0hKrThB6Qoa83CCIr+oCSIdRZoU+FBKHtl3+QzEAuOyPVMVYrkASnAypoGWlwjgpQ==',key_name='tempest-keypair-1350250606',keypairs=<?>,launch_index=0,launched_at=2023-08-17T11:50:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4d6856b60c404a34b6355b5fd6dd7bb8',ramdisk_id='',reservation_id='r-2byzpdg1',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-108358124',owner_user_name='tempest-ServerActionsTestOtherB-108358124-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T11:50:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2791de1444c2428f9120cc907529cfcf',uuid=3d468854-6182-49c8-acb7-0641df2d5219,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "1ec58d7f-18a4-4ddb-a137-2b72c5221621", "address": "fa:16:3e:8d:35:49", "network": {"id": "870c4b80-1ae0-4a10-89b8-ec734c66c244", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2050219794-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d6856b60c404a34b6355b5fd6dd7bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec58d7f-18", "ovs_interfaceid": "1ec58d7f-18a4-4ddb-a137-2b72c5221621", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 11:52:13 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-58f56c4c-1f88-4630-8a73-714380a05c9d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Converting VIF {"id": "1ec58d7f-18a4-4ddb-a137-2b72c5221621", "address": "fa:16:3e:8d:35:49", "network": {"id": "870c4b80-1ae0-4a10-89b8-ec734c66c244", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2050219794-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d6856b60c404a34b6355b5fd6dd7bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec58d7f-18", "ovs_interfaceid": "1ec58d7f-18a4-4ddb-a137-2b72c5221621", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:52:13 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-58f56c4c-1f88-4630-8a73-714380a05c9d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8d:35:49,bridge_name='br-int',has_traffic_filtering=True,id=1ec58d7f-18a4-4ddb-a137-2b72c5221621,network=Network(870c4b80-1ae0-4a10-89b8-ec734c66c244),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ec58d7f-18') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:52:13 user nova-compute[73449]: DEBUG os_vif [None req-58f56c4c-1f88-4630-8a73-714380a05c9d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8d:35:49,bridge_name='br-int',has_traffic_filtering=True,id=1ec58d7f-18a4-4ddb-a137-2b72c5221621,network=Network(870c4b80-1ae0-4a10-89b8-ec734c66c244),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ec58d7f-18') {{(pid=73449) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 11:52:13 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:52:13 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1ec58d7f-18, bridge=br-int, if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:52:13 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:52:13 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:52:13 user nova-compute[73449]: INFO os_vif [None req-58f56c4c-1f88-4630-8a73-714380a05c9d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8d:35:49,bridge_name='br-int',has_traffic_filtering=True,id=1ec58d7f-18a4-4ddb-a137-2b72c5221621,network=Network(870c4b80-1ae0-4a10-89b8-ec734c66c244),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ec58d7f-18')
Aug 17 11:52:13 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58f56c4c-1f88-4630-8a73-714380a05c9d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] calling os-brick to detach iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 11:52:13 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f56c4c-1f88-4630-8a73-714380a05c9d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, {'target_iqns': ['iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZpYgxHvU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 11:52:13 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-58f56c4c-1f88-4630-8a73-714380a05c9d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 11:52:13 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-58f56c4c-1f88-4630-8a73-714380a05c9d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:52:13 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-58f56c4c-1f88-4630-8a73-714380a05c9d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:52:13 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f56c4c-1f88-4630-8a73-714380a05c9d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061', 0)] {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 11:52:13 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:52:13 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:52:13 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bb8bdd9-7845-4b9b-939e-99c297f0290c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:323f4327-bf84-45fb-9261-d62b431ac90b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b6b06606-4920-4dce-bae0-3101c8b7dc6a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eed14a5f-179e-4bc7-b05e-9f9f62eaf8cf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:52:13 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:52:13 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:52:13 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[c50a2975-08c4-484c-946b-adeefea7b8d7]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6b06606-4920-4dce-bae0-3101c8b7dc6a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:323f4327-bf84-45fb-9261-d62b431ac90b (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:52:13 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f56c4c-1f88-4630-8a73-714380a05c9d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe (non-flash)
Aug 17 11:52:13 user nova-compute[73449]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 (non-flash)
Aug 17 11:52:13 user nova-compute[73449]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611 (non-flash)
Aug 17 11:52:13 user nova-compute[73449]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6b06606-4920-4dce-bae0-3101c8b7dc6a (non-flash)
Aug 17 11:52:13 user nova-compute[73449]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:323f4327-bf84-45fb-9261-d62b431ac90b (non-flash)
Aug 17 11:52:13 user nova-compute[73449]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 (non-flash)
Aug 17 11:52:13 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:52:13 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f56c4c-1f88-4630-8a73-714380a05c9d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe (non-flash)
Aug 17 11:52:13 user nova-compute[73449]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 (non-flash)
Aug 17 11:52:13 user nova-compute[73449]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611 (non-flash)
Aug 17 11:52:13 user nova-compute[73449]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6b06606-4920-4dce-bae0-3101c8b7dc6a (non-flash)
Aug 17 11:52:13 user nova-compute[73449]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:323f4327-bf84-45fb-9261-d62b431ac90b (non-flash)
Aug 17 11:52:13 user nova-compute[73449]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 (non-flash)
Aug 17 11:52:13 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:52:13 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f56c4c-1f88-4630-8a73-714380a05c9d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe7581063b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061'): ({'sdb'}, set())}) {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 11:52:13 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-58f56c4c-1f88-4630-8a73-714380a05c9d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Removing single pathed devices sdb {{(pid=73449) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 11:52:13 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:52:13 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:52:13 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fcf6201-9293-4c48-a850-5e26b9a98a53]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:52:13 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:52:13 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:52:13 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[6db3cc21-e27b-4b14-997e-973c3fa71309]: (4, ('ok\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:52:13 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-58f56c4c-1f88-4630-8a73-714380a05c9d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Flushing IO for device /dev/sdb {{(pid=73449) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 11:52:13 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:52:13 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:52:13 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[34d8d18e-fbbc-4e73-b16c-a28f5499fe1e]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:52:13 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-58f56c4c-1f88-4630-8a73-714380a05c9d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73449) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 11:52:13 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:52:13 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:52:13 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[d62bdc13-a593-4605-b4c4-4392a7e20a74]: (4, ('1', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:52:13 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-58f56c4c-1f88-4630-8a73-714380a05c9d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73449) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 11:52:13 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-58f56c4c-1f88-4630-8a73-714380a05c9d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] SCSI volumes sdb have been removed. {{(pid=73449) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 11:52:13 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f56c4c-1f88-4630-8a73-714380a05c9d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061')] {{(pid=73449) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 11:52:13 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:52:13 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:52:13 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bc91f22-176f-4411-9996-157fdebee364]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:52:13 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f56c4c-1f88-4630-8a73-714380a05c9d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:52:13 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 -p 172.16.0.220:3260 --logout {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:52:13 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:52:13 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[db92b6ad-60fb-4cd0-97bf-883b1397ad00]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:52:13 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f56c4c-1f88-4630-8a73-714380a05c9d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061, portal: 172.16.0.220,3260]
Aug 17 11:52:13 user nova-compute[73449]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061, portal: 172.16.0.220,3260] successful.
Aug 17 11:52:13 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:52:13 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 -p 172.16.0.220:3260 --op delete {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:52:13 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:52:13 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5bcff93-a615-41d8-a888-cc2b0673b8f0]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:52:13 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f56c4c-1f88-4630-8a73-714380a05c9d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:52:13 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-58f56c4c-1f88-4630-8a73-714380a05c9d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:52:13 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f56c4c-1f88-4630-8a73-714380a05c9d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] <== disconnect_volume: return (333ms) None {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 11:52:13 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58f56c4c-1f88-4630-8a73-714380a05c9d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Disconnected iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 11:52:14 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-58f56c4c-1f88-4630-8a73-714380a05c9d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:52:14 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-58f56c4c-1f88-4630-8a73-714380a05c9d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:52:14 user nova-compute[73449]: DEBUG nova.objects.instance [None req-58f56c4c-1f88-4630-8a73-714380a05c9d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Lazy-loading 'migration_context' on Instance uuid 3d468854-6182-49c8-acb7-0641df2d5219 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:52:15 user nova-compute[73449]: DEBUG nova.compute.manager [req-e4fe175a-beb8-41fa-86e9-4032851be876 req-b1678bf5-beaa-4ee7-95fa-e152c7f05ce2 service nova] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Received event network-vif-plugged-1ec58d7f-18a4-4ddb-a137-2b72c5221621 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:52:15 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-e4fe175a-beb8-41fa-86e9-4032851be876 req-b1678bf5-beaa-4ee7-95fa-e152c7f05ce2 service nova] Acquiring lock "3d468854-6182-49c8-acb7-0641df2d5219-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:52:15 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-e4fe175a-beb8-41fa-86e9-4032851be876 req-b1678bf5-beaa-4ee7-95fa-e152c7f05ce2 service nova] Lock "3d468854-6182-49c8-acb7-0641df2d5219-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:52:15 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-e4fe175a-beb8-41fa-86e9-4032851be876 req-b1678bf5-beaa-4ee7-95fa-e152c7f05ce2 service nova] Lock "3d468854-6182-49c8-acb7-0641df2d5219-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:52:15 user nova-compute[73449]: DEBUG nova.compute.manager [req-e4fe175a-beb8-41fa-86e9-4032851be876 req-b1678bf5-beaa-4ee7-95fa-e152c7f05ce2 service nova] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] No waiting events found dispatching network-vif-plugged-1ec58d7f-18a4-4ddb-a137-2b72c5221621 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:52:15 user nova-compute[73449]: WARNING nova.compute.manager [req-e4fe175a-beb8-41fa-86e9-4032851be876 req-b1678bf5-beaa-4ee7-95fa-e152c7f05ce2 service nova] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Received unexpected event network-vif-plugged-1ec58d7f-18a4-4ddb-a137-2b72c5221621 for instance with vm_state resized and task_state resize_reverting.
Aug 17 11:52:15 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-58f56c4c-1f88-4630-8a73-714380a05c9d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 11:52:15 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-58f56c4c-1f88-4630-8a73-714380a05c9d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 11:52:15 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-58f56c4c-1f88-4630-8a73-714380a05c9d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.481s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:52:15 user nova-compute[73449]: INFO nova.compute.manager [None req-58f56c4c-1f88-4630-8a73-714380a05c9d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Swapping old allocation on dict_keys(['20986bee-3f54-4b89-bec1-f8387ef700c4']) held by migration 8bca2c78-a7cb-4f23-ae39-18f96e45b9f4 for instance
Aug 17 11:52:15 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-58f56c4c-1f88-4630-8a73-714380a05c9d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Overwriting current allocation {'allocations': {'20986bee-3f54-4b89-bec1-f8387ef700c4': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 36}}, 'project_id': '4d6856b60c404a34b6355b5fd6dd7bb8', 'user_id': '2791de1444c2428f9120cc907529cfcf', 'consumer_generation': 1} on consumer 3d468854-6182-49c8-acb7-0641df2d5219 {{(pid=73449) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Aug 17 11:52:15 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-58f56c4c-1f88-4630-8a73-714380a05c9d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Acquiring lock "refresh_cache-3d468854-6182-49c8-acb7-0641df2d5219" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:52:15 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-58f56c4c-1f88-4630-8a73-714380a05c9d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Acquired lock "refresh_cache-3d468854-6182-49c8-acb7-0641df2d5219" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:52:15 user nova-compute[73449]: DEBUG nova.network.neutron [None req-58f56c4c-1f88-4630-8a73-714380a05c9d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Building network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 11:52:16 user nova-compute[73449]: DEBUG nova.network.neutron [None req-58f56c4c-1f88-4630-8a73-714380a05c9d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Updating instance_info_cache with network_info: [{"id": "1ec58d7f-18a4-4ddb-a137-2b72c5221621", "address": "fa:16:3e:8d:35:49", "network": {"id": "870c4b80-1ae0-4a10-89b8-ec734c66c244", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2050219794-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d6856b60c404a34b6355b5fd6dd7bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec58d7f-18", "ovs_interfaceid": "1ec58d7f-18a4-4ddb-a137-2b72c5221621", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:52:16 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-58f56c4c-1f88-4630-8a73-714380a05c9d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Releasing lock "refresh_cache-3d468854-6182-49c8-acb7-0641df2d5219" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:52:16 user nova-compute[73449]: DEBUG os_brick.utils [None req-58f56c4c-1f88-4630-8a73-714380a05c9d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 11:52:16 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:52:16 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:52:16 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[e44978d6-6ae3-4c38-97b3-f543ba03c9f2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4d3924302012\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:52:16 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:52:16 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:52:16 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbfba9ce-5abd-4bbc-9b8a-d74ea5a78ec5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:52:16 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:52:16 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:52:16 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[63e10d18-d51a-45d7-a19f-f4b7b2f4f403]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:52:16 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f617461-5d93-43fa-81e2-6926947b207a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:52:16 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-58f56c4c-1f88-4630-8a73-714380a05c9d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Running cmd (subprocess): nvme version {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:52:16 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-58f56c4c-1f88-4630-8a73-714380a05c9d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] 'nvme version' failed. Not Retrying. {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 11:52:16 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.nvmeof [None req-58f56c4c-1f88-4630-8a73-714380a05c9d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] nvme not present on system {{(pid=73449) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 11:52:16 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:52:16 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 11:52:16 user nova-compute[73449]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 11:52:16 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[51e9e42b-a17b-4e51-9239-f5a99ad61860]: (4, '') {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:52:16 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-58f56c4c-1f88-4630-8a73-714380a05c9d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73449) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 11:52:16 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-58f56c4c-1f88-4630-8a73-714380a05c9d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73449) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 11:52:16 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-58f56c4c-1f88-4630-8a73-714380a05c9d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] LIGHTOS: no hostnqn found. {{(pid=73449) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 11:52:16 user nova-compute[73449]: DEBUG os_brick.utils [None req-58f56c4c-1f88-4630-8a73-714380a05c9d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4d3924302012', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 11:52:17 user nova-compute[73449]: DEBUG nova.compute.manager [req-31bf02ed-e50f-4d99-9c8a-35207c6a4e08 req-7a0af954-91a4-419a-ab19-e4cce8d586d7 service nova] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Received event network-changed-599e177a-d05b-4d24-8c89-8a868182940c {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:52:17 user nova-compute[73449]: DEBUG nova.compute.manager [req-31bf02ed-e50f-4d99-9c8a-35207c6a4e08 req-7a0af954-91a4-419a-ab19-e4cce8d586d7 service nova] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Refreshing instance network info cache due to event network-changed-599e177a-d05b-4d24-8c89-8a868182940c. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 11:52:17 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-31bf02ed-e50f-4d99-9c8a-35207c6a4e08 req-7a0af954-91a4-419a-ab19-e4cce8d586d7 service nova] Acquiring lock "refresh_cache-5612f7d1-a901-4bdd-a24a-faf9a980cd04" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:52:17 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-31bf02ed-e50f-4d99-9c8a-35207c6a4e08 req-7a0af954-91a4-419a-ab19-e4cce8d586d7 service nova] Acquired lock "refresh_cache-5612f7d1-a901-4bdd-a24a-faf9a980cd04" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:52:17 user nova-compute[73449]: DEBUG nova.network.neutron [req-31bf02ed-e50f-4d99-9c8a-35207c6a4e08 req-7a0af954-91a4-419a-ab19-e4cce8d586d7 service nova] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Refreshing network info cache for port 599e177a-d05b-4d24-8c89-8a868182940c {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 11:52:17 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-986800f6-6a52-4d8b-9c61-a1d0d7e89bbe tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Acquiring lock "5612f7d1-a901-4bdd-a24a-faf9a980cd04" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:52:17 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-986800f6-6a52-4d8b-9c61-a1d0d7e89bbe tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Lock "5612f7d1-a901-4bdd-a24a-faf9a980cd04" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:52:17 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-986800f6-6a52-4d8b-9c61-a1d0d7e89bbe tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Acquiring lock "5612f7d1-a901-4bdd-a24a-faf9a980cd04-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:52:17 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-986800f6-6a52-4d8b-9c61-a1d0d7e89bbe tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Lock "5612f7d1-a901-4bdd-a24a-faf9a980cd04-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:52:17 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-986800f6-6a52-4d8b-9c61-a1d0d7e89bbe tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Lock "5612f7d1-a901-4bdd-a24a-faf9a980cd04-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:52:17 user nova-compute[73449]: INFO nova.compute.manager [None req-986800f6-6a52-4d8b-9c61-a1d0d7e89bbe tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Terminating instance
Aug 17 11:52:17 user nova-compute[73449]: DEBUG nova.compute.manager [None req-986800f6-6a52-4d8b-9c61-a1d0d7e89bbe tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Start destroying the instance on the hypervisor. {{(pid=73449) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 11:52:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:52:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:52:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:52:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:52:17 user nova-compute[73449]: DEBUG nova.compute.manager [req-10f319ad-5a8f-450d-9d01-a0821af6fead req-22dc27df-bc33-42ae-a346-1d2a7216af42 service nova] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Received event network-vif-unplugged-599e177a-d05b-4d24-8c89-8a868182940c {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:52:17 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-10f319ad-5a8f-450d-9d01-a0821af6fead req-22dc27df-bc33-42ae-a346-1d2a7216af42 service nova] Acquiring lock "5612f7d1-a901-4bdd-a24a-faf9a980cd04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:52:17 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-10f319ad-5a8f-450d-9d01-a0821af6fead req-22dc27df-bc33-42ae-a346-1d2a7216af42 service nova] Lock "5612f7d1-a901-4bdd-a24a-faf9a980cd04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:52:17 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-10f319ad-5a8f-450d-9d01-a0821af6fead req-22dc27df-bc33-42ae-a346-1d2a7216af42 service nova] Lock "5612f7d1-a901-4bdd-a24a-faf9a980cd04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:52:17 user nova-compute[73449]: DEBUG nova.compute.manager [req-10f319ad-5a8f-450d-9d01-a0821af6fead req-22dc27df-bc33-42ae-a346-1d2a7216af42 service nova] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] No waiting events found dispatching network-vif-unplugged-599e177a-d05b-4d24-8c89-8a868182940c {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:52:17 user nova-compute[73449]: DEBUG nova.compute.manager [req-10f319ad-5a8f-450d-9d01-a0821af6fead req-22dc27df-bc33-42ae-a346-1d2a7216af42 service nova] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Received event network-vif-unplugged-599e177a-d05b-4d24-8c89-8a868182940c for instance with task_state deleting. {{(pid=73449) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 11:52:17 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Instance destroyed successfully.
Aug 17 11:52:17 user nova-compute[73449]: DEBUG nova.objects.instance [None req-986800f6-6a52-4d8b-9c61-a1d0d7e89bbe tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Lazy-loading 'resources' on Instance uuid 5612f7d1-a901-4bdd-a24a-faf9a980cd04 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:52:18 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-986800f6-6a52-4d8b-9c61-a1d0d7e89bbe tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T11:46:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1849786392',display_name='tempest-TestShelveInstance-server-1849786392',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1849786392',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA55lazAqHP3vcEkHgxf0GkDCEWKxw301Wqk4UvPSVrCTPIFpM0ItDTNB5vmnGG+ellud4ExTu114P7nZoUxO7bGtJGKBcvDyG2fdaDBOPDuLrsnSKO7Wa6GZ9ttkbdXeA==',key_name='tempest-TestShelveInstance-1460867700',keypairs=<?>,launch_index=0,launched_at=2023-08-17T11:50:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b906d3cc3acb46818cd2c9583f351893',ramdisk_id='',reservation_id='r-6d1v12wz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-917557205',owner_user_name='tempest-TestShelveInstance-917557205-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T11:50:52Z,user_data=None,user_id='db7e0b2abd4b4df3b2e7886ddc3840c0',uuid=5612f7d1-a901-4bdd-a24a-faf9a980cd04,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "599e177a-d05b-4d24-8c89-8a868182940c", "address": "fa:16:3e:8d:36:ef", "network": {"id": "41adee44-4e1c-4cc6-aa63-8054da5d97b4", "bridge": "br-int", "label": "tempest-TestShelveInstance-1953236522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b906d3cc3acb46818cd2c9583f351893", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap599e177a-d0", "ovs_interfaceid": "599e177a-d05b-4d24-8c89-8a868182940c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 11:52:18 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-986800f6-6a52-4d8b-9c61-a1d0d7e89bbe tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Converting VIF {"id": "599e177a-d05b-4d24-8c89-8a868182940c", "address": "fa:16:3e:8d:36:ef", "network": {"id": "41adee44-4e1c-4cc6-aa63-8054da5d97b4", "bridge": "br-int", "label": "tempest-TestShelveInstance-1953236522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b906d3cc3acb46818cd2c9583f351893", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap599e177a-d0", "ovs_interfaceid": "599e177a-d05b-4d24-8c89-8a868182940c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:52:18 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-986800f6-6a52-4d8b-9c61-a1d0d7e89bbe tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:36:ef,bridge_name='br-int',has_traffic_filtering=True,id=599e177a-d05b-4d24-8c89-8a868182940c,network=Network(41adee44-4e1c-4cc6-aa63-8054da5d97b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap599e177a-d0') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:52:18 user nova-compute[73449]: DEBUG os_vif [None req-986800f6-6a52-4d8b-9c61-a1d0d7e89bbe tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:36:ef,bridge_name='br-int',has_traffic_filtering=True,id=599e177a-d05b-4d24-8c89-8a868182940c,network=Network(41adee44-4e1c-4cc6-aa63-8054da5d97b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap599e177a-d0') {{(pid=73449) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 11:52:18 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:52:18 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap599e177a-d0, bridge=br-int, if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:52:18 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:52:18 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:52:18 user nova-compute[73449]: INFO os_vif [None req-986800f6-6a52-4d8b-9c61-a1d0d7e89bbe tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:36:ef,bridge_name='br-int',has_traffic_filtering=True,id=599e177a-d05b-4d24-8c89-8a868182940c,network=Network(41adee44-4e1c-4cc6-aa63-8054da5d97b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap599e177a-d0')
Aug 17 11:52:18 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-986800f6-6a52-4d8b-9c61-a1d0d7e89bbe tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] calling os-brick to detach iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 11:52:18 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-986800f6-6a52-4d8b-9c61-a1d0d7e89bbe tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, {'target_iqns': ['iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zWFHJgbD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 11:52:18 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-986800f6-6a52-4d8b-9c61-a1d0d7e89bbe tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 11:52:18 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-986800f6-6a52-4d8b-9c61-a1d0d7e89bbe tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:52:18 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-986800f6-6a52-4d8b-9c61-a1d0d7e89bbe tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:52:18 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-986800f6-6a52-4d8b-9c61-a1d0d7e89bbe tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611', 0)] {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 11:52:18 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:52:18 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:52:18 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9fcfd04-b1e2-45f0-aae6-399b3903dd4b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:323f4327-bf84-45fb-9261-d62b431ac90b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b6b06606-4920-4dce-bae0-3101c8b7dc6a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eed14a5f-179e-4bc7-b05e-9f9f62eaf8cf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:52:18 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:52:18 user nova-compute[73449]: DEBUG nova.network.neutron [req-31bf02ed-e50f-4d99-9c8a-35207c6a4e08 req-7a0af954-91a4-419a-ab19-e4cce8d586d7 service nova] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Updated VIF entry in instance network info cache for port 599e177a-d05b-4d24-8c89-8a868182940c. {{(pid=73449) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 11:52:18 user nova-compute[73449]: DEBUG nova.network.neutron [req-31bf02ed-e50f-4d99-9c8a-35207c6a4e08 req-7a0af954-91a4-419a-ab19-e4cce8d586d7 service nova] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Updating instance_info_cache with network_info: [{"id": "599e177a-d05b-4d24-8c89-8a868182940c", "address": "fa:16:3e:8d:36:ef", "network": {"id": "41adee44-4e1c-4cc6-aa63-8054da5d97b4", "bridge": "br-int", "label": "tempest-TestShelveInstance-1953236522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b906d3cc3acb46818cd2c9583f351893", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap599e177a-d0", "ovs_interfaceid": "599e177a-d05b-4d24-8c89-8a868182940c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:52:18 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.057s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:52:18 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[218361e1-b954-48d0-8a22-2ffefb7dc22d]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6b06606-4920-4dce-bae0-3101c8b7dc6a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:323f4327-bf84-45fb-9261-d62b431ac90b (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed14a5f-179e-4bc7-b05e-9f9f62eaf8cf (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:52:18 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-986800f6-6a52-4d8b-9c61-a1d0d7e89bbe tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe (non-flash)
Aug 17 11:52:18 user nova-compute[73449]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611 (non-flash)
Aug 17 11:52:18 user nova-compute[73449]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6b06606-4920-4dce-bae0-3101c8b7dc6a (non-flash)
Aug 17 11:52:18 user nova-compute[73449]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:323f4327-bf84-45fb-9261-d62b431ac90b (non-flash)
Aug 17 11:52:18 user nova-compute[73449]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 (non-flash)
Aug 17 11:52:18 user nova-compute[73449]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed14a5f-179e-4bc7-b05e-9f9f62eaf8cf (non-flash)
Aug 17 11:52:18 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:52:18 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-986800f6-6a52-4d8b-9c61-a1d0d7e89bbe tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe (non-flash)
Aug 17 11:52:18 user nova-compute[73449]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611 (non-flash)
Aug 17 11:52:18 user nova-compute[73449]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6b06606-4920-4dce-bae0-3101c8b7dc6a (non-flash)
Aug 17 11:52:18 user nova-compute[73449]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:323f4327-bf84-45fb-9261-d62b431ac90b (non-flash)
Aug 17 11:52:18 user nova-compute[73449]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 (non-flash)
Aug 17 11:52:18 user nova-compute[73449]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed14a5f-179e-4bc7-b05e-9f9f62eaf8cf (non-flash)
Aug 17 11:52:18 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:52:18 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-986800f6-6a52-4d8b-9c61-a1d0d7e89bbe tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe758104310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611'): ({'sdc'}, set())}) {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 11:52:18 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-986800f6-6a52-4d8b-9c61-a1d0d7e89bbe tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Removing single pathed devices sdc {{(pid=73449) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 11:52:18 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:52:18 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-31bf02ed-e50f-4d99-9c8a-35207c6a4e08 req-7a0af954-91a4-419a-ab19-e4cce8d586d7 service nova] Releasing lock "refresh_cache-5612f7d1-a901-4bdd-a24a-faf9a980cd04" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:52:18 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.032s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:52:18 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[84d0abe6-f7a0-4e09-ae11-5fceefac093d]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:52:18 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:52:18 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:52:18 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.034s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:52:18 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3ab31e2-df25-4c75-b068-4ee8c55d52d1]: (4, ('ok\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:52:18 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-986800f6-6a52-4d8b-9c61-a1d0d7e89bbe tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Flushing IO for device /dev/sdc {{(pid=73449) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 11:52:18 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:52:18 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:52:18 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9e2dff8-c939-45f8-90ed-f69c44941a74]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:52:18 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-986800f6-6a52-4d8b-9c61-a1d0d7e89bbe tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73449) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 11:52:18 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:52:18 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:52:18 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[add9f5ca-88d7-40dd-8db8-aa2244a6aab0]: (4, ('1', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:52:18 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-986800f6-6a52-4d8b-9c61-a1d0d7e89bbe tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73449) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 11:52:18 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-986800f6-6a52-4d8b-9c61-a1d0d7e89bbe tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] SCSI volumes sdc have been removed. {{(pid=73449) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 11:52:18 user nova-compute[73449]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO619ca0b7-788f0879686eb656', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_619ca0b7', '/dev/disk/by-id/scsi-23738386630383739') {{(pid=84309) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 17 11:52:18 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[69a4b0b2-e6e8-4caa-834b-92ff19b8ef35]: (4, None) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:52:18 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-986800f6-6a52-4d8b-9c61-a1d0d7e89bbe tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611')] {{(pid=73449) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 11:52:18 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:52:18 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.033s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:52:18 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4a265f5-f041-4363-ae78-eecea551c220]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:52:18 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-986800f6-6a52-4d8b-9c61-a1d0d7e89bbe tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:52:18 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611 -p 172.16.0.220:3260 --logout {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:52:18 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611 -p 172.16.0.220:3260 --logout" returned: 0 in 0.097s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:52:18 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff450de4-b748-4743-821c-746c6cfb427a]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:52:18 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-986800f6-6a52-4d8b-9c61-a1d0d7e89bbe tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611, portal: 172.16.0.220,3260]
Aug 17 11:52:18 user nova-compute[73449]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611, portal: 172.16.0.220,3260] successful.
Aug 17 11:52:18 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:52:18 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611 -p 172.16.0.220:3260 --op delete {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:52:18 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc3c38dd-5692-448f-b1fc-b8fe08052611 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.047s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:52:18 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[e92ae3c9-f060-448e-89af-3b8254a87673]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:52:18 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-986800f6-6a52-4d8b-9c61-a1d0d7e89bbe tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:52:18 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-986800f6-6a52-4d8b-9c61-a1d0d7e89bbe tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.486s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:52:18 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-986800f6-6a52-4d8b-9c61-a1d0d7e89bbe tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] <== disconnect_volume: return (489ms) None {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 11:52:18 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-986800f6-6a52-4d8b-9c61-a1d0d7e89bbe tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Disconnected iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 11:52:18 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-986800f6-6a52-4d8b-9c61-a1d0d7e89bbe tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Deleting instance files /opt/stack/data/nova/instances/5612f7d1-a901-4bdd-a24a-faf9a980cd04_del
Aug 17 11:52:18 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-986800f6-6a52-4d8b-9c61-a1d0d7e89bbe tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Deletion of /opt/stack/data/nova/instances/5612f7d1-a901-4bdd-a24a-faf9a980cd04_del complete
Aug 17 11:52:18 user nova-compute[73449]: INFO nova.compute.manager [None req-986800f6-6a52-4d8b-9c61-a1d0d7e89bbe tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Took 1.33 seconds to destroy the instance on the hypervisor.
Aug 17 11:52:18 user nova-compute[73449]: DEBUG oslo.service.loopingcall [None req-986800f6-6a52-4d8b-9c61-a1d0d7e89bbe tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73449) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 11:52:18 user nova-compute[73449]: DEBUG nova.compute.manager [-] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Deallocating network for instance {{(pid=73449) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 11:52:18 user nova-compute[73449]: DEBUG nova.network.neutron [-] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] deallocate_for_instance() {{(pid=73449) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 11:52:19 user nova-compute[73449]: DEBUG nova.network.neutron [-] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Updating instance_info_cache with network_info: [] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:52:19 user nova-compute[73449]: INFO nova.compute.manager [-] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Took 1.01 seconds to deallocate network for instance.
Aug 17 11:52:19 user nova-compute[73449]: DEBUG nova.compute.manager [req-0dcb3bc7-f0a2-4f06-9ee7-1ed9549a7d51 req-8dd17455-b911-47c8-8fdd-f01f5d081e12 service nova] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Received event network-vif-deleted-599e177a-d05b-4d24-8c89-8a868182940c {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:52:19 user nova-compute[73449]: DEBUG nova.compute.manager [None req-7c41ca8b-a5fc-42ff-a420-d9b23c0bb7de tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 89440604-1daf-4e7a-a524-2f9c21a9cb96] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:52:19 user nova-compute[73449]: DEBUG nova.compute.manager [req-ada752c5-4968-4eef-9854-d346c282b86d req-bdf8cfd1-79bb-4fc0-ab4d-33adfe12631e service nova] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Received event network-vif-plugged-599e177a-d05b-4d24-8c89-8a868182940c {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:52:19 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-ada752c5-4968-4eef-9854-d346c282b86d req-bdf8cfd1-79bb-4fc0-ab4d-33adfe12631e service nova] Acquiring lock "5612f7d1-a901-4bdd-a24a-faf9a980cd04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:52:19 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-ada752c5-4968-4eef-9854-d346c282b86d req-bdf8cfd1-79bb-4fc0-ab4d-33adfe12631e service nova] Lock "5612f7d1-a901-4bdd-a24a-faf9a980cd04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:52:19 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-ada752c5-4968-4eef-9854-d346c282b86d req-bdf8cfd1-79bb-4fc0-ab4d-33adfe12631e service nova] Lock "5612f7d1-a901-4bdd-a24a-faf9a980cd04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:52:19 user nova-compute[73449]: DEBUG nova.compute.manager [req-ada752c5-4968-4eef-9854-d346c282b86d req-bdf8cfd1-79bb-4fc0-ab4d-33adfe12631e service nova] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] No waiting events found dispatching network-vif-plugged-599e177a-d05b-4d24-8c89-8a868182940c {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:52:19 user nova-compute[73449]: WARNING nova.compute.manager [req-ada752c5-4968-4eef-9854-d346c282b86d req-bdf8cfd1-79bb-4fc0-ab4d-33adfe12631e service nova] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Received unexpected event network-vif-plugged-599e177a-d05b-4d24-8c89-8a868182940c for instance with vm_state active and task_state deleting.
Aug 17 11:52:19 user nova-compute[73449]: INFO nova.compute.manager [None req-7c41ca8b-a5fc-42ff-a420-d9b23c0bb7de tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 89440604-1daf-4e7a-a524-2f9c21a9cb96] instance snapshotting
Aug 17 11:52:20 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-7c41ca8b-a5fc-42ff-a420-d9b23c0bb7de tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 89440604-1daf-4e7a-a524-2f9c21a9cb96] Beginning live snapshot process
Aug 17 11:52:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-7c41ca8b-a5fc-42ff-a420-d9b23c0bb7de tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89440604-1daf-4e7a-a524-2f9c21a9cb96/disk --force-share --output=json -f qcow2 {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:52:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-7c41ca8b-a5fc-42ff-a420-d9b23c0bb7de tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89440604-1daf-4e7a-a524-2f9c21a9cb96/disk --force-share --output=json -f qcow2" returned: 0 in 0.248s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:52:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-7c41ca8b-a5fc-42ff-a420-d9b23c0bb7de tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89440604-1daf-4e7a-a524-2f9c21a9cb96/disk --force-share --output=json -f qcow2 {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:52:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-7c41ca8b-a5fc-42ff-a420-d9b23c0bb7de tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89440604-1daf-4e7a-a524-2f9c21a9cb96/disk --force-share --output=json -f qcow2" returned: 0 in 0.226s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:52:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-7c41ca8b-a5fc-42ff-a420-d9b23c0bb7de tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:52:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-7c41ca8b-a5fc-42ff-a420-d9b23c0bb7de tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json" returned: 0 in 0.209s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:52:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-7c41ca8b-a5fc-42ff-a420-d9b23c0bb7de tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp1yvoainr/21d2bbe897974c8380265ad867ca3102.delta 1073741824 {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:52:21 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-7c41ca8b-a5fc-42ff-a420-d9b23c0bb7de tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp1yvoainr/21d2bbe897974c8380265ad867ca3102.delta 1073741824" returned: 0 in 0.066s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:52:21 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-7c41ca8b-a5fc-42ff-a420-d9b23c0bb7de tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 89440604-1daf-4e7a-a524-2f9c21a9cb96] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 17 11:52:21 user nova-compute[73449]: INFO nova.compute.manager [None req-986800f6-6a52-4d8b-9c61-a1d0d7e89bbe tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Took 1.48 seconds to detach 1 volumes for instance.
Aug 17 11:52:21 user nova-compute[73449]: DEBUG nova.compute.manager [None req-986800f6-6a52-4d8b-9c61-a1d0d7e89bbe tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Deleting volume: fc3c38dd-5692-448f-b1fc-b8fe08052611 {{(pid=73449) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 17 11:52:21 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-986800f6-6a52-4d8b-9c61-a1d0d7e89bbe tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:52:21 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-986800f6-6a52-4d8b-9c61-a1d0d7e89bbe tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:52:21 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6db330fc-ee19-40aa-b9e9-fabfb7ccb7ad tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Acquiring lock "ec622bf0-4531-4892-b637-0ef564cf453b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:52:21 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6db330fc-ee19-40aa-b9e9-fabfb7ccb7ad tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Lock "ec622bf0-4531-4892-b637-0ef564cf453b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:52:21 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6db330fc-ee19-40aa-b9e9-fabfb7ccb7ad tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Acquiring lock "ec622bf0-4531-4892-b637-0ef564cf453b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:52:21 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6db330fc-ee19-40aa-b9e9-fabfb7ccb7ad tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Lock "ec622bf0-4531-4892-b637-0ef564cf453b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:52:21 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6db330fc-ee19-40aa-b9e9-fabfb7ccb7ad tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Lock "ec622bf0-4531-4892-b637-0ef564cf453b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:52:21 user nova-compute[73449]: INFO nova.compute.manager [None req-6db330fc-ee19-40aa-b9e9-fabfb7ccb7ad tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: ec622bf0-4531-4892-b637-0ef564cf453b] Terminating instance
Aug 17 11:52:21 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6db330fc-ee19-40aa-b9e9-fabfb7ccb7ad tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: ec622bf0-4531-4892-b637-0ef564cf453b] Start destroying the instance on the hypervisor. {{(pid=73449) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 11:52:21 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:52:21 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:52:21 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-986800f6-6a52-4d8b-9c61-a1d0d7e89bbe tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 11:52:21 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-7c41ca8b-a5fc-42ff-a420-d9b23c0bb7de tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=73449) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 11:52:21 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-986800f6-6a52-4d8b-9c61-a1d0d7e89bbe tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 11:52:22 user nova-compute[73449]: DEBUG nova.compute.manager [req-90a59c12-0c66-4f86-bb82-61dc628888bb req-951df641-3abe-40e4-aee5-d0fcf8da4d41 service nova] [instance: ec622bf0-4531-4892-b637-0ef564cf453b] Received event network-changed-9171abbc-1b7e-4008-93f4-3075f6b9b898 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:52:22 user nova-compute[73449]: DEBUG nova.compute.manager [req-90a59c12-0c66-4f86-bb82-61dc628888bb req-951df641-3abe-40e4-aee5-d0fcf8da4d41 service nova] [instance: ec622bf0-4531-4892-b637-0ef564cf453b] Refreshing instance network info cache due to event network-changed-9171abbc-1b7e-4008-93f4-3075f6b9b898. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 11:52:22 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-90a59c12-0c66-4f86-bb82-61dc628888bb req-951df641-3abe-40e4-aee5-d0fcf8da4d41 service nova] Acquiring lock "refresh_cache-ec622bf0-4531-4892-b637-0ef564cf453b" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:52:22 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-90a59c12-0c66-4f86-bb82-61dc628888bb req-951df641-3abe-40e4-aee5-d0fcf8da4d41 service nova] Acquired lock "refresh_cache-ec622bf0-4531-4892-b637-0ef564cf453b" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:52:22 user nova-compute[73449]: DEBUG nova.network.neutron [req-90a59c12-0c66-4f86-bb82-61dc628888bb req-951df641-3abe-40e4-aee5-d0fcf8da4d41 service nova] [instance: ec622bf0-4531-4892-b637-0ef564cf453b] Refreshing network info cache for port 9171abbc-1b7e-4008-93f4-3075f6b9b898 {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 11:52:22 user nova-compute[73449]: DEBUG nova.compute.manager [req-5fb9f35e-4feb-4f60-9266-b14e5ab723f5 req-21993874-f802-4906-871c-87f939bb733d service nova] [instance: ec622bf0-4531-4892-b637-0ef564cf453b] Received event network-vif-unplugged-9171abbc-1b7e-4008-93f4-3075f6b9b898 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:52:22 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-5fb9f35e-4feb-4f60-9266-b14e5ab723f5 req-21993874-f802-4906-871c-87f939bb733d service nova] Acquiring lock "ec622bf0-4531-4892-b637-0ef564cf453b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:52:22 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-5fb9f35e-4feb-4f60-9266-b14e5ab723f5 req-21993874-f802-4906-871c-87f939bb733d service nova] Lock "ec622bf0-4531-4892-b637-0ef564cf453b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:52:22 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-5fb9f35e-4feb-4f60-9266-b14e5ab723f5 req-21993874-f802-4906-871c-87f939bb733d service nova] Lock "ec622bf0-4531-4892-b637-0ef564cf453b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:52:22 user nova-compute[73449]: DEBUG nova.compute.manager [req-5fb9f35e-4feb-4f60-9266-b14e5ab723f5 req-21993874-f802-4906-871c-87f939bb733d service nova] [instance: ec622bf0-4531-4892-b637-0ef564cf453b] No waiting events found dispatching network-vif-unplugged-9171abbc-1b7e-4008-93f4-3075f6b9b898 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:52:22 user nova-compute[73449]: DEBUG nova.compute.manager [req-5fb9f35e-4feb-4f60-9266-b14e5ab723f5 req-21993874-f802-4906-871c-87f939bb733d service nova] [instance: ec622bf0-4531-4892-b637-0ef564cf453b] Received event network-vif-unplugged-9171abbc-1b7e-4008-93f4-3075f6b9b898 for instance with task_state deleting. {{(pid=73449) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 11:52:22 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:52:22 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:52:22 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-986800f6-6a52-4d8b-9c61-a1d0d7e89bbe tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.733s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:52:22 user nova-compute[73449]: INFO nova.scheduler.client.report [None req-986800f6-6a52-4d8b-9c61-a1d0d7e89bbe tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Deleted allocations for instance 5612f7d1-a901-4bdd-a24a-faf9a980cd04
Aug 17 11:52:22 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-986800f6-6a52-4d8b-9c61-a1d0d7e89bbe tempest-TestShelveInstance-917557205 tempest-TestShelveInstance-917557205-project-member] Lock "5612f7d1-a901-4bdd-a24a-faf9a980cd04" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.947s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:52:22 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-7c41ca8b-a5fc-42ff-a420-d9b23c0bb7de tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=73449) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 11:52:22 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-7c41ca8b-a5fc-42ff-a420-d9b23c0bb7de tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 89440604-1daf-4e7a-a524-2f9c21a9cb96] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 17 11:52:22 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: ec622bf0-4531-4892-b637-0ef564cf453b] Instance destroyed successfully.
Aug 17 11:52:22 user nova-compute[73449]: DEBUG nova.objects.instance [None req-6db330fc-ee19-40aa-b9e9-fabfb7ccb7ad tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Lazy-loading 'resources' on Instance uuid ec622bf0-4531-4892-b637-0ef564cf453b {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:52:22 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-6db330fc-ee19-40aa-b9e9-fabfb7ccb7ad tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:50:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-629435938',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-629435938',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-629435938',id=27,image_ref='ef9117da-c36b-4ccd-99e6-5c467d02bc51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOK2OcMVVxjoiwv87EfFOwpDnVEUDpgnzjxdcAiMqg1Zd0jvED64BC7imQYzwdEI0TXX9FTXnHG36rHuOKJNhaM46tSbU4IvcWp6xK0GF1HveevStf9H+zYjkwzSz9mVrA==',key_name='tempest-keypair-180394528',keypairs=<?>,launch_index=0,launched_at=2023-08-17T11:50:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4bd46cdaff7a4b40955f7c8a12c55452',ramdisk_id='',reservation_id='r-ycfl4grz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-813872552',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-813872552-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-813872552',owner_user_name='tempest-TestVolumeBootPattern-813872552-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T11:51:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='804ccb0440fb46a4a4c0ae65c3893296',uuid=ec622bf0-4531-4892-b637-0ef564cf453b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9171abbc-1b7e-4008-93f4-3075f6b9b898", "address": "fa:16:3e:04:f1:e3", "network": {"id": "a9e8fcd6-4152-466b-99ad-44b85db05a05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-920564935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bd46cdaff7a4b40955f7c8a12c55452", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9171abbc-1b", "ovs_interfaceid": "9171abbc-1b7e-4008-93f4-3075f6b9b898", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 11:52:22 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-6db330fc-ee19-40aa-b9e9-fabfb7ccb7ad tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Converting VIF {"id": "9171abbc-1b7e-4008-93f4-3075f6b9b898", "address": "fa:16:3e:04:f1:e3", "network": {"id": "a9e8fcd6-4152-466b-99ad-44b85db05a05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-920564935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bd46cdaff7a4b40955f7c8a12c55452", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9171abbc-1b", "ovs_interfaceid": "9171abbc-1b7e-4008-93f4-3075f6b9b898", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:52:22 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-6db330fc-ee19-40aa-b9e9-fabfb7ccb7ad tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:f1:e3,bridge_name='br-int',has_traffic_filtering=True,id=9171abbc-1b7e-4008-93f4-3075f6b9b898,network=Network(a9e8fcd6-4152-466b-99ad-44b85db05a05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9171abbc-1b') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:52:22 user nova-compute[73449]: DEBUG os_vif [None req-6db330fc-ee19-40aa-b9e9-fabfb7ccb7ad tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:f1:e3,bridge_name='br-int',has_traffic_filtering=True,id=9171abbc-1b7e-4008-93f4-3075f6b9b898,network=Network(a9e8fcd6-4152-466b-99ad-44b85db05a05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9171abbc-1b') {{(pid=73449) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 11:52:22 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:52:22 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9171abbc-1b, bridge=br-int, if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:52:22 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:52:22 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:52:22 user nova-compute[73449]: INFO os_vif [None req-6db330fc-ee19-40aa-b9e9-fabfb7ccb7ad tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:f1:e3,bridge_name='br-int',has_traffic_filtering=True,id=9171abbc-1b7e-4008-93f4-3075f6b9b898,network=Network(a9e8fcd6-4152-466b-99ad-44b85db05a05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9171abbc-1b')
Aug 17 11:52:22 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6db330fc-ee19-40aa-b9e9-fabfb7ccb7ad tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: ec622bf0-4531-4892-b637-0ef564cf453b] calling os-brick to detach iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 11:52:22 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-6db330fc-ee19-40aa-b9e9-fabfb7ccb7ad tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, {'target_iqns': ['iqn.2010-10.org.openstack:b6b06606-4920-4dce-bae0-3101c8b7dc6a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CpYaeiIy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 11:52:22 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-6db330fc-ee19-40aa-b9e9-fabfb7ccb7ad tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 11:52:22 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-6db330fc-ee19-40aa-b9e9-fabfb7ccb7ad tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:52:22 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-6db330fc-ee19-40aa-b9e9-fabfb7ccb7ad tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:52:22 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-6db330fc-ee19-40aa-b9e9-fabfb7ccb7ad tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b6b06606-4920-4dce-bae0-3101c8b7dc6a', 0)] {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 11:52:22 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:52:22 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:52:22 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[56f96073-8bac-48f7-8c76-7c9b73ef6e2e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:323f4327-bf84-45fb-9261-d62b431ac90b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b6b06606-4920-4dce-bae0-3101c8b7dc6a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eed14a5f-179e-4bc7-b05e-9f9f62eaf8cf\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:52:22 user nova-compute[73449]: DEBUG nova.privsep.utils [None req-7c41ca8b-a5fc-42ff-a420-d9b23c0bb7de tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73449) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 11:52:22 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-7c41ca8b-a5fc-42ff-a420-d9b23c0bb7de tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp1yvoainr/21d2bbe897974c8380265ad867ca3102.delta /opt/stack/data/nova/instances/snapshots/tmp1yvoainr/21d2bbe897974c8380265ad867ca3102 {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:52:22 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:52:22 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:52:22 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1f52759-d230-4616-873e-20ca7ef5924d]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6b06606-4920-4dce-bae0-3101c8b7dc6a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:323f4327-bf84-45fb-9261-d62b431ac90b (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed14a5f-179e-4bc7-b05e-9f9f62eaf8cf (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:52:22 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-6db330fc-ee19-40aa-b9e9-fabfb7ccb7ad tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe (non-flash)
Aug 17 11:52:22 user nova-compute[73449]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6b06606-4920-4dce-bae0-3101c8b7dc6a (non-flash)
Aug 17 11:52:22 user nova-compute[73449]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:323f4327-bf84-45fb-9261-d62b431ac90b (non-flash)
Aug 17 11:52:22 user nova-compute[73449]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 (non-flash)
Aug 17 11:52:22 user nova-compute[73449]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed14a5f-179e-4bc7-b05e-9f9f62eaf8cf (non-flash)
Aug 17 11:52:22 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:52:22 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-6db330fc-ee19-40aa-b9e9-fabfb7ccb7ad tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe (non-flash)
Aug 17 11:52:22 user nova-compute[73449]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6b06606-4920-4dce-bae0-3101c8b7dc6a (non-flash)
Aug 17 11:52:22 user nova-compute[73449]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:323f4327-bf84-45fb-9261-d62b431ac90b (non-flash)
Aug 17 11:52:22 user nova-compute[73449]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 (non-flash)
Aug 17 11:52:22 user nova-compute[73449]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed14a5f-179e-4bc7-b05e-9f9f62eaf8cf (non-flash)
Aug 17 11:52:22 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:52:22 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-6db330fc-ee19-40aa-b9e9-fabfb7ccb7ad tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe7586a8160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b6b06606-4920-4dce-bae0-3101c8b7dc6a'): ({'sdd'}, set())}) {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 11:52:22 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-6db330fc-ee19-40aa-b9e9-fabfb7ccb7ad tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Removing single pathed devices sdd {{(pid=73449) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 11:52:22 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:52:22 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:52:22 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e95811e-edad-41f1-a68d-368c8ae70f18]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:52:22 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:52:22 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.027s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:52:22 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[40d78a78-4394-45db-91ac-8b19ec36914b]: (4, ('ok\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:52:22 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-6db330fc-ee19-40aa-b9e9-fabfb7ccb7ad tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Flushing IO for device /dev/sdd {{(pid=73449) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 11:52:22 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:52:22 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:52:22 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[d362744a-8f68-42ee-bde8-fec67b0a502c]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:52:22 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-6db330fc-ee19-40aa-b9e9-fabfb7ccb7ad tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73449) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 11:52:22 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:52:22 user nova-compute[73449]: DEBUG nova.network.neutron [req-90a59c12-0c66-4f86-bb82-61dc628888bb req-951df641-3abe-40e4-aee5-d0fcf8da4d41 service nova] [instance: ec622bf0-4531-4892-b637-0ef564cf453b] Updated VIF entry in instance network info cache for port 9171abbc-1b7e-4008-93f4-3075f6b9b898. {{(pid=73449) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 11:52:22 user nova-compute[73449]: DEBUG nova.network.neutron [req-90a59c12-0c66-4f86-bb82-61dc628888bb req-951df641-3abe-40e4-aee5-d0fcf8da4d41 service nova] [instance: ec622bf0-4531-4892-b637-0ef564cf453b] Updating instance_info_cache with network_info: [{"id": "9171abbc-1b7e-4008-93f4-3075f6b9b898", "address": "fa:16:3e:04:f1:e3", "network": {"id": "a9e8fcd6-4152-466b-99ad-44b85db05a05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-920564935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bd46cdaff7a4b40955f7c8a12c55452", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9171abbc-1b", "ovs_interfaceid": "9171abbc-1b7e-4008-93f4-3075f6b9b898", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:52:22 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.073s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:52:22 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f71e653-826d-4607-b7f5-4a4ac52c8d25]: (4, ('1', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:52:22 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-6db330fc-ee19-40aa-b9e9-fabfb7ccb7ad tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73449) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 11:52:22 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-6db330fc-ee19-40aa-b9e9-fabfb7ccb7ad tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] SCSI volumes sdd have been removed. {{(pid=73449) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 11:52:22 user nova-compute[73449]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOd276f8d5-4358706f406bc0ff', '/dev/disk/by-id/scsi-23433353837303666', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_d276f8d5') {{(pid=84309) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 17 11:52:22 user nova-compute[73449]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIOd276f8d5-4358706f406bc0ff
Aug 17 11:52:22 user nova-compute[73449]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23433353837303666
Aug 17 11:52:22 user nova-compute[73449]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_d276f8d5
Aug 17 11:52:22 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[3280d84b-4068-4e39-8172-6bf8e7bae272]: (4, None) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:52:22 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-6db330fc-ee19-40aa-b9e9-fabfb7ccb7ad tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b6b06606-4920-4dce-bae0-3101c8b7dc6a')] {{(pid=73449) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 11:52:22 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6b06606-4920-4dce-bae0-3101c8b7dc6a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:52:22 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-90a59c12-0c66-4f86-bb82-61dc628888bb req-951df641-3abe-40e4-aee5-d0fcf8da4d41 service nova] Releasing lock "refresh_cache-ec622bf0-4531-4892-b637-0ef564cf453b" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:52:22 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6b06606-4920-4dce-bae0-3101c8b7dc6a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.032s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:52:22 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ee0a9b1-f9f2-45da-80e3-4565e5c420fb]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:52:22 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-6db330fc-ee19-40aa-b9e9-fabfb7ccb7ad tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:52:22 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6b06606-4920-4dce-bae0-3101c8b7dc6a -p 172.16.0.220:3260 --logout {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:52:23 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6b06606-4920-4dce-bae0-3101c8b7dc6a -p 172.16.0.220:3260 --logout" returned: 0 in 0.126s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:52:23 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[f05b2c7e-fd7c-437d-96ae-4631198b7884]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:b6b06606-4920-4dce-bae0-3101c8b7dc6a, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:b6b06606-4920-4dce-bae0-3101c8b7dc6a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:52:23 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-6db330fc-ee19-40aa-b9e9-fabfb7ccb7ad tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:b6b06606-4920-4dce-bae0-3101c8b7dc6a, portal: 172.16.0.220,3260]
Aug 17 11:52:23 user nova-compute[73449]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:b6b06606-4920-4dce-bae0-3101c8b7dc6a, portal: 172.16.0.220,3260] successful.
Aug 17 11:52:23 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:52:23 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6b06606-4920-4dce-bae0-3101c8b7dc6a -p 172.16.0.220:3260 --op delete {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:52:23 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6b06606-4920-4dce-bae0-3101c8b7dc6a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:52:23 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[146f6fb1-6fc5-4557-bc0a-64c4bd019e35]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:52:23 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-6db330fc-ee19-40aa-b9e9-fabfb7ccb7ad tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:52:23 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-6db330fc-ee19-40aa-b9e9-fabfb7ccb7ad tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.525s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:52:23 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-6db330fc-ee19-40aa-b9e9-fabfb7ccb7ad tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] <== disconnect_volume: return (526ms) None {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 11:52:23 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6db330fc-ee19-40aa-b9e9-fabfb7ccb7ad tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: ec622bf0-4531-4892-b637-0ef564cf453b] Disconnected iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 11:52:23 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-6db330fc-ee19-40aa-b9e9-fabfb7ccb7ad tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: ec622bf0-4531-4892-b637-0ef564cf453b] Deleting instance files /opt/stack/data/nova/instances/ec622bf0-4531-4892-b637-0ef564cf453b_del
Aug 17 11:52:23 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-6db330fc-ee19-40aa-b9e9-fabfb7ccb7ad tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: ec622bf0-4531-4892-b637-0ef564cf453b] Deletion of /opt/stack/data/nova/instances/ec622bf0-4531-4892-b637-0ef564cf453b_del complete
Aug 17 11:52:23 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-7c41ca8b-a5fc-42ff-a420-d9b23c0bb7de tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp1yvoainr/21d2bbe897974c8380265ad867ca3102.delta /opt/stack/data/nova/instances/snapshots/tmp1yvoainr/21d2bbe897974c8380265ad867ca3102" returned: 0 in 0.657s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:52:23 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-7c41ca8b-a5fc-42ff-a420-d9b23c0bb7de tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 89440604-1daf-4e7a-a524-2f9c21a9cb96] Snapshot extracted, beginning image upload
Aug 17 11:52:23 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:52:23 user nova-compute[73449]: INFO nova.compute.manager [None req-6db330fc-ee19-40aa-b9e9-fabfb7ccb7ad tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: ec622bf0-4531-4892-b637-0ef564cf453b] Took 1.66 seconds to destroy the instance on the hypervisor.
Aug 17 11:52:23 user nova-compute[73449]: DEBUG oslo.service.loopingcall [None req-6db330fc-ee19-40aa-b9e9-fabfb7ccb7ad tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73449) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 11:52:23 user nova-compute[73449]: DEBUG nova.compute.manager [-] [instance: ec622bf0-4531-4892-b637-0ef564cf453b] Deallocating network for instance {{(pid=73449) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 11:52:23 user nova-compute[73449]: DEBUG nova.network.neutron [-] [instance: ec622bf0-4531-4892-b637-0ef564cf453b] deallocate_for_instance() {{(pid=73449) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 11:52:23 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a5ac1056-ac3d-491d-ad18-a6c9adf118eb tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Acquiring lock "23ab9ffc-226d-4caa-8caa-9458de06a1c9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:52:23 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a5ac1056-ac3d-491d-ad18-a6c9adf118eb tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Lock "23ab9ffc-226d-4caa-8caa-9458de06a1c9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:52:23 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a5ac1056-ac3d-491d-ad18-a6c9adf118eb tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Acquiring lock "23ab9ffc-226d-4caa-8caa-9458de06a1c9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:52:23 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a5ac1056-ac3d-491d-ad18-a6c9adf118eb tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Lock "23ab9ffc-226d-4caa-8caa-9458de06a1c9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:52:23 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a5ac1056-ac3d-491d-ad18-a6c9adf118eb tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Lock "23ab9ffc-226d-4caa-8caa-9458de06a1c9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:52:23 user nova-compute[73449]: INFO nova.compute.manager [None req-a5ac1056-ac3d-491d-ad18-a6c9adf118eb tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] [instance: 23ab9ffc-226d-4caa-8caa-9458de06a1c9] Terminating instance
Aug 17 11:52:23 user nova-compute[73449]: DEBUG nova.compute.manager [None req-a5ac1056-ac3d-491d-ad18-a6c9adf118eb tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] [instance: 23ab9ffc-226d-4caa-8caa-9458de06a1c9] Start destroying the instance on the hypervisor. {{(pid=73449) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 11:52:23 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:52:23 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:52:24 user nova-compute[73449]: DEBUG nova.compute.manager [req-8a8d26a5-4c3f-4c93-b85c-3a7558d290e2 req-fe084123-fa91-4418-aef2-2fe18957ec4d service nova] [instance: 23ab9ffc-226d-4caa-8caa-9458de06a1c9] Received event network-vif-unplugged-96f9e0d7-29e1-46b0-81e6-1d00c8b35ec2 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:52:24 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-8a8d26a5-4c3f-4c93-b85c-3a7558d290e2 req-fe084123-fa91-4418-aef2-2fe18957ec4d service nova] Acquiring lock "23ab9ffc-226d-4caa-8caa-9458de06a1c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:52:24 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-8a8d26a5-4c3f-4c93-b85c-3a7558d290e2 req-fe084123-fa91-4418-aef2-2fe18957ec4d service nova] Lock "23ab9ffc-226d-4caa-8caa-9458de06a1c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:52:24 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-8a8d26a5-4c3f-4c93-b85c-3a7558d290e2 req-fe084123-fa91-4418-aef2-2fe18957ec4d service nova] Lock "23ab9ffc-226d-4caa-8caa-9458de06a1c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:52:24 user nova-compute[73449]: DEBUG nova.compute.manager [req-8a8d26a5-4c3f-4c93-b85c-3a7558d290e2 req-fe084123-fa91-4418-aef2-2fe18957ec4d service nova] [instance: 23ab9ffc-226d-4caa-8caa-9458de06a1c9] No waiting events found dispatching network-vif-unplugged-96f9e0d7-29e1-46b0-81e6-1d00c8b35ec2 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:52:24 user nova-compute[73449]: DEBUG nova.compute.manager [req-8a8d26a5-4c3f-4c93-b85c-3a7558d290e2 req-fe084123-fa91-4418-aef2-2fe18957ec4d service nova] [instance: 23ab9ffc-226d-4caa-8caa-9458de06a1c9] Received event network-vif-unplugged-96f9e0d7-29e1-46b0-81e6-1d00c8b35ec2 for instance with task_state deleting. {{(pid=73449) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 11:52:24 user nova-compute[73449]: DEBUG nova.compute.manager [req-d2aba219-6746-456a-866d-aae86522dadf req-a7799d6f-773b-4716-a58e-400ca9c6f0ce service nova] [instance: ec622bf0-4531-4892-b637-0ef564cf453b] Received event network-vif-plugged-9171abbc-1b7e-4008-93f4-3075f6b9b898 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:52:24 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-d2aba219-6746-456a-866d-aae86522dadf req-a7799d6f-773b-4716-a58e-400ca9c6f0ce service nova] Acquiring lock "ec622bf0-4531-4892-b637-0ef564cf453b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:52:24 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-d2aba219-6746-456a-866d-aae86522dadf req-a7799d6f-773b-4716-a58e-400ca9c6f0ce service nova] Lock "ec622bf0-4531-4892-b637-0ef564cf453b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:52:24 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-d2aba219-6746-456a-866d-aae86522dadf req-a7799d6f-773b-4716-a58e-400ca9c6f0ce service nova] Lock "ec622bf0-4531-4892-b637-0ef564cf453b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:52:24 user nova-compute[73449]: DEBUG nova.compute.manager [req-d2aba219-6746-456a-866d-aae86522dadf req-a7799d6f-773b-4716-a58e-400ca9c6f0ce service nova] [instance: ec622bf0-4531-4892-b637-0ef564cf453b] No waiting events found dispatching network-vif-plugged-9171abbc-1b7e-4008-93f4-3075f6b9b898 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:52:24 user nova-compute[73449]: WARNING nova.compute.manager [req-d2aba219-6746-456a-866d-aae86522dadf req-a7799d6f-773b-4716-a58e-400ca9c6f0ce service nova] [instance: ec622bf0-4531-4892-b637-0ef564cf453b] Received unexpected event network-vif-plugged-9171abbc-1b7e-4008-93f4-3075f6b9b898 for instance with vm_state active and task_state deleting.
Aug 17 11:52:24 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:52:24 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:52:24 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:52:24 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:52:24 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: 23ab9ffc-226d-4caa-8caa-9458de06a1c9] Instance destroyed successfully.
Aug 17 11:52:24 user nova-compute[73449]: DEBUG nova.objects.instance [None req-a5ac1056-ac3d-491d-ad18-a6c9adf118eb tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Lazy-loading 'resources' on Instance uuid 23ab9ffc-226d-4caa-8caa-9458de06a1c9 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:52:24 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:52:24 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-a5ac1056-ac3d-491d-ad18-a6c9adf118eb tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:50:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-667733895',display_name='tempest-ServersNegativeTestJSON-server-667733895',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-667733895',id=28,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T11:50:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cbaa73b99e5a498dac668e5307654fd2',ramdisk_id='',reservation_id='r-1bcsbsjo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-132584909',owner_user_name='tempest-ServersNegativeTestJSON-132584909-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T11:50:42Z,user_data=None,user_id='56d7fd2eae7c4e62a7cc0e917287f03f',uuid=23ab9ffc-226d-4caa-8caa-9458de06a1c9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "96f9e0d7-29e1-46b0-81e6-1d00c8b35ec2", "address": "fa:16:3e:82:7e:7d", "network": {"id": "c3e9bf16-545d-4ae8-bbad-5092c0e8f735", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1927778048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbaa73b99e5a498dac668e5307654fd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96f9e0d7-29", "ovs_interfaceid": "96f9e0d7-29e1-46b0-81e6-1d00c8b35ec2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 11:52:24 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-a5ac1056-ac3d-491d-ad18-a6c9adf118eb tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Converting VIF {"id": "96f9e0d7-29e1-46b0-81e6-1d00c8b35ec2", "address": "fa:16:3e:82:7e:7d", "network": {"id": "c3e9bf16-545d-4ae8-bbad-5092c0e8f735", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1927778048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbaa73b99e5a498dac668e5307654fd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96f9e0d7-29", "ovs_interfaceid": "96f9e0d7-29e1-46b0-81e6-1d00c8b35ec2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:52:24 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-a5ac1056-ac3d-491d-ad18-a6c9adf118eb tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:7e:7d,bridge_name='br-int',has_traffic_filtering=True,id=96f9e0d7-29e1-46b0-81e6-1d00c8b35ec2,network=Network(c3e9bf16-545d-4ae8-bbad-5092c0e8f735),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96f9e0d7-29') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:52:24 user nova-compute[73449]: DEBUG os_vif [None req-a5ac1056-ac3d-491d-ad18-a6c9adf118eb tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:7e:7d,bridge_name='br-int',has_traffic_filtering=True,id=96f9e0d7-29e1-46b0-81e6-1d00c8b35ec2,network=Network(c3e9bf16-545d-4ae8-bbad-5092c0e8f735),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96f9e0d7-29') {{(pid=73449) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 11:52:24 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:52:24 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap96f9e0d7-29, bridge=br-int, if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:52:24 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:52:24 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:52:24 user nova-compute[73449]: INFO os_vif [None req-a5ac1056-ac3d-491d-ad18-a6c9adf118eb tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:7e:7d,bridge_name='br-int',has_traffic_filtering=True,id=96f9e0d7-29e1-46b0-81e6-1d00c8b35ec2,network=Network(c3e9bf16-545d-4ae8-bbad-5092c0e8f735),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96f9e0d7-29')
Aug 17 11:52:24 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-a5ac1056-ac3d-491d-ad18-a6c9adf118eb tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] [instance: 23ab9ffc-226d-4caa-8caa-9458de06a1c9] Deleting instance files /opt/stack/data/nova/instances/23ab9ffc-226d-4caa-8caa-9458de06a1c9_del
Aug 17 11:52:24 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-a5ac1056-ac3d-491d-ad18-a6c9adf118eb tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] [instance: 23ab9ffc-226d-4caa-8caa-9458de06a1c9] Deletion of /opt/stack/data/nova/instances/23ab9ffc-226d-4caa-8caa-9458de06a1c9_del complete
Aug 17 11:52:24 user nova-compute[73449]: INFO nova.compute.manager [None req-a5ac1056-ac3d-491d-ad18-a6c9adf118eb tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] [instance: 23ab9ffc-226d-4caa-8caa-9458de06a1c9] Took 1.03 seconds to destroy the instance on the hypervisor.
Aug 17 11:52:24 user nova-compute[73449]: DEBUG oslo.service.loopingcall [None req-a5ac1056-ac3d-491d-ad18-a6c9adf118eb tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73449) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 11:52:24 user nova-compute[73449]: DEBUG nova.compute.manager [-] [instance: 23ab9ffc-226d-4caa-8caa-9458de06a1c9] Deallocating network for instance {{(pid=73449) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 11:52:24 user nova-compute[73449]: DEBUG nova.network.neutron [-] [instance: 23ab9ffc-226d-4caa-8caa-9458de06a1c9] deallocate_for_instance() {{(pid=73449) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 11:52:24 user nova-compute[73449]: DEBUG nova.network.neutron [-] [instance: ec622bf0-4531-4892-b637-0ef564cf453b] Updating instance_info_cache with network_info: [] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:52:24 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:52:24 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:52:24 user nova-compute[73449]: DEBUG nova.compute.manager [req-c337aeaa-a601-48f3-8004-441f12bbd192 req-af74ca15-2b5d-42ea-848e-267b8a606403 service nova] [instance: ec622bf0-4531-4892-b637-0ef564cf453b] Received event network-vif-deleted-9171abbc-1b7e-4008-93f4-3075f6b9b898 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:52:24 user nova-compute[73449]: INFO nova.compute.manager [req-c337aeaa-a601-48f3-8004-441f12bbd192 req-af74ca15-2b5d-42ea-848e-267b8a606403 service nova] [instance: ec622bf0-4531-4892-b637-0ef564cf453b] Neutron deleted interface 9171abbc-1b7e-4008-93f4-3075f6b9b898; detaching it from the instance and deleting it from the info cache
Aug 17 11:52:24 user nova-compute[73449]: DEBUG nova.network.neutron [req-c337aeaa-a601-48f3-8004-441f12bbd192 req-af74ca15-2b5d-42ea-848e-267b8a606403 service nova] [instance: ec622bf0-4531-4892-b637-0ef564cf453b] Updating instance_info_cache with network_info: [] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:52:24 user nova-compute[73449]: INFO nova.compute.manager [-] [instance: ec622bf0-4531-4892-b637-0ef564cf453b] Took 1.67 seconds to deallocate network for instance.
Aug 17 11:52:24 user nova-compute[73449]: DEBUG nova.compute.manager [req-c337aeaa-a601-48f3-8004-441f12bbd192 req-af74ca15-2b5d-42ea-848e-267b8a606403 service nova] [instance: ec622bf0-4531-4892-b637-0ef564cf453b] Detach interface failed, port_id=9171abbc-1b7e-4008-93f4-3075f6b9b898, reason: Instance ec622bf0-4531-4892-b637-0ef564cf453b could not be found. {{(pid=73449) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 11:52:25 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:52:25 user nova-compute[73449]: INFO nova.compute.manager [None req-6db330fc-ee19-40aa-b9e9-fabfb7ccb7ad tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: ec622bf0-4531-4892-b637-0ef564cf453b] Took 1.03 seconds to detach 1 volumes for instance.
Aug 17 11:52:25 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6db330fc-ee19-40aa-b9e9-fabfb7ccb7ad tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: ec622bf0-4531-4892-b637-0ef564cf453b] Deleting volume: b6b06606-4920-4dce-bae0-3101c8b7dc6a {{(pid=73449) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 17 11:52:26 user nova-compute[73449]: DEBUG nova.network.neutron [-] [instance: 23ab9ffc-226d-4caa-8caa-9458de06a1c9] Updating instance_info_cache with network_info: [] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:52:26 user nova-compute[73449]: INFO nova.compute.manager [-] [instance: 23ab9ffc-226d-4caa-8caa-9458de06a1c9] Took 1.31 seconds to deallocate network for instance.
Aug 17 11:52:26 user nova-compute[73449]: DEBUG nova.compute.manager [req-a2f6fece-13a8-416c-ac74-adee93f98450 req-6854cf19-ddc9-43db-9668-aa9e67a5e975 service nova] [instance: 23ab9ffc-226d-4caa-8caa-9458de06a1c9] Received event network-vif-plugged-96f9e0d7-29e1-46b0-81e6-1d00c8b35ec2 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:52:26 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-a2f6fece-13a8-416c-ac74-adee93f98450 req-6854cf19-ddc9-43db-9668-aa9e67a5e975 service nova] Acquiring lock "23ab9ffc-226d-4caa-8caa-9458de06a1c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:52:26 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-a2f6fece-13a8-416c-ac74-adee93f98450 req-6854cf19-ddc9-43db-9668-aa9e67a5e975 service nova] Lock "23ab9ffc-226d-4caa-8caa-9458de06a1c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:52:26 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-a2f6fece-13a8-416c-ac74-adee93f98450 req-6854cf19-ddc9-43db-9668-aa9e67a5e975 service nova] Lock "23ab9ffc-226d-4caa-8caa-9458de06a1c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:52:26 user nova-compute[73449]: DEBUG nova.compute.manager [req-a2f6fece-13a8-416c-ac74-adee93f98450 req-6854cf19-ddc9-43db-9668-aa9e67a5e975 service nova] [instance: 23ab9ffc-226d-4caa-8caa-9458de06a1c9] No waiting events found dispatching network-vif-plugged-96f9e0d7-29e1-46b0-81e6-1d00c8b35ec2 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:52:26 user nova-compute[73449]: WARNING nova.compute.manager [req-a2f6fece-13a8-416c-ac74-adee93f98450 req-6854cf19-ddc9-43db-9668-aa9e67a5e975 service nova] [instance: 23ab9ffc-226d-4caa-8caa-9458de06a1c9] Received unexpected event network-vif-plugged-96f9e0d7-29e1-46b0-81e6-1d00c8b35ec2 for instance with vm_state active and task_state deleting.
Aug 17 11:52:26 user nova-compute[73449]: DEBUG nova.compute.manager [req-a2f6fece-13a8-416c-ac74-adee93f98450 req-6854cf19-ddc9-43db-9668-aa9e67a5e975 service nova] [instance: 23ab9ffc-226d-4caa-8caa-9458de06a1c9] Received event network-vif-plugged-96f9e0d7-29e1-46b0-81e6-1d00c8b35ec2 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:52:26 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-a2f6fece-13a8-416c-ac74-adee93f98450 req-6854cf19-ddc9-43db-9668-aa9e67a5e975 service nova] Acquiring lock "23ab9ffc-226d-4caa-8caa-9458de06a1c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:52:26 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-a2f6fece-13a8-416c-ac74-adee93f98450 req-6854cf19-ddc9-43db-9668-aa9e67a5e975 service nova] Lock "23ab9ffc-226d-4caa-8caa-9458de06a1c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:52:26 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-a2f6fece-13a8-416c-ac74-adee93f98450 req-6854cf19-ddc9-43db-9668-aa9e67a5e975 service nova] Lock "23ab9ffc-226d-4caa-8caa-9458de06a1c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:52:26 user nova-compute[73449]: DEBUG nova.compute.manager [req-a2f6fece-13a8-416c-ac74-adee93f98450 req-6854cf19-ddc9-43db-9668-aa9e67a5e975 service nova] [instance: 23ab9ffc-226d-4caa-8caa-9458de06a1c9] No waiting events found dispatching network-vif-plugged-96f9e0d7-29e1-46b0-81e6-1d00c8b35ec2 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:52:26 user nova-compute[73449]: WARNING nova.compute.manager [req-a2f6fece-13a8-416c-ac74-adee93f98450 req-6854cf19-ddc9-43db-9668-aa9e67a5e975 service nova] [instance: 23ab9ffc-226d-4caa-8caa-9458de06a1c9] Received unexpected event network-vif-plugged-96f9e0d7-29e1-46b0-81e6-1d00c8b35ec2 for instance with vm_state active and task_state deleting.
Aug 17 11:52:26 user nova-compute[73449]: DEBUG nova.compute.manager [req-a2f6fece-13a8-416c-ac74-adee93f98450 req-6854cf19-ddc9-43db-9668-aa9e67a5e975 service nova] [instance: 23ab9ffc-226d-4caa-8caa-9458de06a1c9] Received event network-vif-plugged-96f9e0d7-29e1-46b0-81e6-1d00c8b35ec2 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:52:26 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-a2f6fece-13a8-416c-ac74-adee93f98450 req-6854cf19-ddc9-43db-9668-aa9e67a5e975 service nova] Acquiring lock "23ab9ffc-226d-4caa-8caa-9458de06a1c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:52:26 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-a2f6fece-13a8-416c-ac74-adee93f98450 req-6854cf19-ddc9-43db-9668-aa9e67a5e975 service nova] Lock "23ab9ffc-226d-4caa-8caa-9458de06a1c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:52:26 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-a2f6fece-13a8-416c-ac74-adee93f98450 req-6854cf19-ddc9-43db-9668-aa9e67a5e975 service nova] Lock "23ab9ffc-226d-4caa-8caa-9458de06a1c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:52:26 user nova-compute[73449]: DEBUG nova.compute.manager [req-a2f6fece-13a8-416c-ac74-adee93f98450 req-6854cf19-ddc9-43db-9668-aa9e67a5e975 service nova] [instance: 23ab9ffc-226d-4caa-8caa-9458de06a1c9] No waiting events found dispatching network-vif-plugged-96f9e0d7-29e1-46b0-81e6-1d00c8b35ec2 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:52:26 user nova-compute[73449]: WARNING nova.compute.manager [req-a2f6fece-13a8-416c-ac74-adee93f98450 req-6854cf19-ddc9-43db-9668-aa9e67a5e975 service nova] [instance: 23ab9ffc-226d-4caa-8caa-9458de06a1c9] Received unexpected event network-vif-plugged-96f9e0d7-29e1-46b0-81e6-1d00c8b35ec2 for instance with vm_state active and task_state deleting.
Aug 17 11:52:26 user nova-compute[73449]: DEBUG nova.compute.manager [req-a2f6fece-13a8-416c-ac74-adee93f98450 req-6854cf19-ddc9-43db-9668-aa9e67a5e975 service nova] [instance: 23ab9ffc-226d-4caa-8caa-9458de06a1c9] Received event network-vif-plugged-96f9e0d7-29e1-46b0-81e6-1d00c8b35ec2 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:52:26 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-a2f6fece-13a8-416c-ac74-adee93f98450 req-6854cf19-ddc9-43db-9668-aa9e67a5e975 service nova] Acquiring lock "23ab9ffc-226d-4caa-8caa-9458de06a1c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:52:26 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-a2f6fece-13a8-416c-ac74-adee93f98450 req-6854cf19-ddc9-43db-9668-aa9e67a5e975 service nova] Lock "23ab9ffc-226d-4caa-8caa-9458de06a1c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:52:26 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-a2f6fece-13a8-416c-ac74-adee93f98450 req-6854cf19-ddc9-43db-9668-aa9e67a5e975 service nova] Lock "23ab9ffc-226d-4caa-8caa-9458de06a1c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:52:26 user nova-compute[73449]: DEBUG nova.compute.manager [req-a2f6fece-13a8-416c-ac74-adee93f98450 req-6854cf19-ddc9-43db-9668-aa9e67a5e975 service nova] [instance: 23ab9ffc-226d-4caa-8caa-9458de06a1c9] No waiting events found dispatching network-vif-plugged-96f9e0d7-29e1-46b0-81e6-1d00c8b35ec2 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:52:26 user nova-compute[73449]: WARNING nova.compute.manager [req-a2f6fece-13a8-416c-ac74-adee93f98450 req-6854cf19-ddc9-43db-9668-aa9e67a5e975 service nova] [instance: 23ab9ffc-226d-4caa-8caa-9458de06a1c9] Received unexpected event network-vif-plugged-96f9e0d7-29e1-46b0-81e6-1d00c8b35ec2 for instance with vm_state active and task_state deleting.
Aug 17 11:52:26 user nova-compute[73449]: DEBUG nova.compute.manager [req-a2f6fece-13a8-416c-ac74-adee93f98450 req-6854cf19-ddc9-43db-9668-aa9e67a5e975 service nova] [instance: 23ab9ffc-226d-4caa-8caa-9458de06a1c9] Received event network-vif-deleted-96f9e0d7-29e1-46b0-81e6-1d00c8b35ec2 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:52:26 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a5ac1056-ac3d-491d-ad18-a6c9adf118eb tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:52:26 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a5ac1056-ac3d-491d-ad18-a6c9adf118eb tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:52:26 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6db330fc-ee19-40aa-b9e9-fabfb7ccb7ad tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:52:26 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-a5ac1056-ac3d-491d-ad18-a6c9adf118eb tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 11:52:26 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-a5ac1056-ac3d-491d-ad18-a6c9adf118eb tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 11:52:26 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a5ac1056-ac3d-491d-ad18-a6c9adf118eb tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.490s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:52:26 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6db330fc-ee19-40aa-b9e9-fabfb7ccb7ad tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.476s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:52:26 user nova-compute[73449]: INFO nova.scheduler.client.report [None req-a5ac1056-ac3d-491d-ad18-a6c9adf118eb tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Deleted allocations for instance 23ab9ffc-226d-4caa-8caa-9458de06a1c9
Aug 17 11:52:26 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-7c41ca8b-a5fc-42ff-a420-d9b23c0bb7de tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 89440604-1daf-4e7a-a524-2f9c21a9cb96] Snapshot image upload complete
Aug 17 11:52:26 user nova-compute[73449]: INFO nova.compute.manager [None req-7c41ca8b-a5fc-42ff-a420-d9b23c0bb7de tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 89440604-1daf-4e7a-a524-2f9c21a9cb96] Took 6.86 seconds to snapshot the instance on the hypervisor.
Aug 17 11:52:26 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a5ac1056-ac3d-491d-ad18-a6c9adf118eb tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Lock "23ab9ffc-226d-4caa-8caa-9458de06a1c9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.253s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:52:27 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-6db330fc-ee19-40aa-b9e9-fabfb7ccb7ad tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 11:52:27 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-6db330fc-ee19-40aa-b9e9-fabfb7ccb7ad tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 11:52:27 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6db330fc-ee19-40aa-b9e9-fabfb7ccb7ad tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.507s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:52:27 user nova-compute[73449]: INFO nova.scheduler.client.report [None req-6db330fc-ee19-40aa-b9e9-fabfb7ccb7ad tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Deleted allocations for instance ec622bf0-4531-4892-b637-0ef564cf453b
Aug 17 11:52:27 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6db330fc-ee19-40aa-b9e9-fabfb7ccb7ad tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Lock "ec622bf0-4531-4892-b637-0ef564cf453b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.769s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:52:28 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:52:28 user nova-compute[73449]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692273133.4705336, 3d468854-6182-49c8-acb7-0641df2d5219 => Stopped> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:52:28 user nova-compute[73449]: INFO nova.compute.manager [-] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] VM Stopped (Lifecycle Event)
Aug 17 11:52:28 user nova-compute[73449]: DEBUG nova.compute.manager [None req-09649875-5563-4c74-a5ce-100f05c9cb03 None None] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:52:29 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:52:30 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-58f56c4c-1f88-4630-8a73-714380a05c9d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Starting finish_revert_migration {{(pid=73449) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Aug 17 11:52:30 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-58f56c4c-1f88-4630-8a73-714380a05c9d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Start _get_guest_xml network_info=[{"id": "1ec58d7f-18a4-4ddb-a137-2b72c5221621", "address": "fa:16:3e:8d:35:49", "network": {"id": "870c4b80-1ae0-4a10-89b8-ec734c66c244", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2050219794-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d6856b60c404a34b6355b5fd6dd7bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec58d7f-18", "ovs_interfaceid": "1ec58d7f-18a4-4ddb-a137-2b72c5221621", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=0a2904ae-083d-41c8-83db-343132b36148,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': '0a2904ae-083d-41c8-83db-343132b36148'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'attachment_id': '5811d34d-bfff-474a-aca0-510217a06aa7', 'boot_index': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZpYgxHvU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '3d468854-6182-49c8-acb7-0641df2d5219', 'attached_at': '2023-08-17T11:52:30.000000', 'detached_at': '', 'volume_id': '040e2bc9-cd90-4010-9fdf-b7cc92b1c061', 'serial': '040e2bc9-cd90-4010-9fdf-b7cc92b1c061'}, 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 11:52:30 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-58f56c4c-1f88-4630-8a73-714380a05c9d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:52:30 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-58f56c4c-1f88-4630-8a73-714380a05c9d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:52:30 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-58f56c4c-1f88-4630-8a73-714380a05c9d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 11:52:30 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-58f56c4c-1f88-4630-8a73-714380a05c9d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] CPU controller missing on host. {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 11:52:30 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-58f56c4c-1f88-4630-8a73-714380a05c9d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 11:52:30 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-58f56c4c-1f88-4630-8a73-714380a05c9d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] CPU controller found on host. {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 11:52:30 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-58f56c4c-1f88-4630-8a73-714380a05c9d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73449) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 11:52:30 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-58f56c4c-1f88-4630-8a73-714380a05c9d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T11:35:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=0a2904ae-083d-41c8-83db-343132b36148,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 11:52:30 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-58f56c4c-1f88-4630-8a73-714380a05c9d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Flavor limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 11:52:30 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-58f56c4c-1f88-4630-8a73-714380a05c9d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Image limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 11:52:30 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-58f56c4c-1f88-4630-8a73-714380a05c9d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Flavor pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 11:52:30 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-58f56c4c-1f88-4630-8a73-714380a05c9d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Image pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 11:52:30 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-58f56c4c-1f88-4630-8a73-714380a05c9d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 11:52:30 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-58f56c4c-1f88-4630-8a73-714380a05c9d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 11:52:30 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-58f56c4c-1f88-4630-8a73-714380a05c9d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 11:52:30 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-58f56c4c-1f88-4630-8a73-714380a05c9d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Got 1 possible topologies {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 11:52:30 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-58f56c4c-1f88-4630-8a73-714380a05c9d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 11:52:30 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-58f56c4c-1f88-4630-8a73-714380a05c9d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 11:52:30 user nova-compute[73449]: DEBUG nova.objects.instance [None req-58f56c4c-1f88-4630-8a73-714380a05c9d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3d468854-6182-49c8-acb7-0641df2d5219 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:52:30 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58f56c4c-1f88-4630-8a73-714380a05c9d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Calling os-brick to attach iSCSI Volume {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 11:52:30 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f56c4c-1f88-4630-8a73-714380a05c9d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZpYgxHvU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 11:52:30 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-58f56c4c-1f88-4630-8a73-714380a05c9d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 11:52:30 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-58f56c4c-1f88-4630-8a73-714380a05c9d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:52:30 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-58f56c4c-1f88-4630-8a73-714380a05c9d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:52:30 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-58f56c4c-1f88-4630-8a73-714380a05c9d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 11:52:30 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-58f56c4c-1f88-4630-8a73-714380a05c9d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:52:30 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-58f56c4c-1f88-4630-8a73-714380a05c9d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:52:30 user nova-compute[73449]: INFO os_brick.initiator.connectors.iscsi [None req-58f56c4c-1f88-4630-8a73-714380a05c9d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 11:52:30 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 -p 172.16.0.220:3260 {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:52:30 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:52:30 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b7107d0-c80d-4cb7-9811-f8816b826b45]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:52:30 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f56c4c-1f88-4630-8a73-714380a05c9d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 11:52:30 user nova-compute[73449]:  {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:52:30 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 -p 172.16.0.220:3260 --interface default --op new {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:52:30 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:52:30 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[139c132b-d081-4d97-a6be-357d1751f7ef]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061] added\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:52:30 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f56c4c-1f88-4630-8a73-714380a05c9d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061] added
Aug 17 11:52:30 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:52:30 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:52:30 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:52:30 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[72954fbb-30ff-4f0e-b41e-e6e7914fd657]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:52:30 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f56c4c-1f88-4630-8a73-714380a05c9d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:52:30 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:52:30 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:52:30 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5fd5926-0b8a-49a0-81dd-5443afe9bc7e]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:52:30 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f56c4c-1f88-4630-8a73-714380a05c9d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:52:30 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZpYgxHvU {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:52:30 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZpYgxHvU" returned: 0 in 0.022s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:52:30 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aa49e97-ecef-436d-9374-c2c724093b2c]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:52:30 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f56c4c-1f88-4630-8a73-714380a05c9d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZpYgxHvU'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:52:30 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:52:30 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.040s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:52:30 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[6de90b3c-c3e5-47d4-9596-43974b2005fb]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:52:30 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f56c4c-1f88-4630-8a73-714380a05c9d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:52:30 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:52:30 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:52:30 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b588dec-b1ed-4412-8bb4-b18001f1b95f]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:52:30 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f56c4c-1f88-4630-8a73-714380a05c9d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe (non-flash)
Aug 17 11:52:30 user nova-compute[73449]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 (non-flash)
Aug 17 11:52:30 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:52:30 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f56c4c-1f88-4630-8a73-714380a05c9d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe (non-flash)
Aug 17 11:52:30 user nova-compute[73449]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 (non-flash)
Aug 17 11:52:30 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:52:30 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 -p 172.16.0.220:3260 --login {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:52:30 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 -p 172.16.0.220:3260 --login" returned: 0 in 0.108s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:52:31 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[586e3e51-5983-46ac-93a2-9c9dda6e1600]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:52:31 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f56c4c-1f88-4630-8a73-714380a05c9d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061, portal: 172.16.0.220,3260]
Aug 17 11:52:31 user nova-compute[73449]: Login to [iface: default, target: iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061, portal: 172.16.0.220,3260] successful.
Aug 17 11:52:31 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:52:31 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:52:31 user nova-compute[73449]: INFO nova.compute.manager [None req-27fd956e-676d-45a4-bda4-fe531390badc tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] Unrescuing
Aug 17 11:52:31 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-27fd956e-676d-45a4-bda4-fe531390badc tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Acquiring lock "refresh_cache-3d74c8f6-fb4e-4460-b722-674a8a1e2d25" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:52:31 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-27fd956e-676d-45a4-bda4-fe531390badc tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Acquired lock "refresh_cache-3d74c8f6-fb4e-4460-b722-674a8a1e2d25" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:52:31 user nova-compute[73449]: DEBUG nova.network.neutron [None req-27fd956e-676d-45a4-bda4-fe531390badc tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] Building network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 11:52:31 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:52:31 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[70ca7c75-db9f-410b-9fc7-4af9fde0d879]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:52:31 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f56c4c-1f88-4630-8a73-714380a05c9d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:52:31 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:52:31 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:52:31 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f5f8538-66a4-4ef4-b98f-24f5da07bdad]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:52:31 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f56c4c-1f88-4630-8a73-714380a05c9d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe (non-flash)
Aug 17 11:52:31 user nova-compute[73449]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 (non-flash)
Aug 17 11:52:31 user nova-compute[73449]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 (non-flash)
Aug 17 11:52:31 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:52:31 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f56c4c-1f88-4630-8a73-714380a05c9d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe (non-flash)
Aug 17 11:52:31 user nova-compute[73449]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 (non-flash)
Aug 17 11:52:31 user nova-compute[73449]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 (non-flash)
Aug 17 11:52:31 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:52:31 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-58f56c4c-1f88-4630-8a73-714380a05c9d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.407s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:52:31 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f56c4c-1f88-4630-8a73-714380a05c9d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Connected to 172.16.0.220:3260 {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 11:52:31 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-58f56c4c-1f88-4630-8a73-714380a05c9d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] HCTL ('33', '-', '-', 0) found on session 35 with lun 0 {{(pid=73449) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 11:52:31 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-58f56c4c-1f88-4630-8a73-714380a05c9d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73449) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 11:52:31 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:52:31 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:52:31 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[33926b78-be60-495c-9838-25c75327c0ed]: (4, ('- - 0', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:52:31 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-58f56c4c-1f88-4630-8a73-714380a05c9d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Searching for a device in session 35 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73449) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 11:52:31 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f56c4c-1f88-4630-8a73-714380a05c9d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZpYgxHvU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 11:52:31 user nova-compute[73449]: DEBUG nova.network.neutron [None req-27fd956e-676d-45a4-bda4-fe531390badc tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] Updating instance_info_cache with network_info: [{"id": "a0e89b76-95af-4e50-a972-b223cc5b3cab", "address": "fa:16:3e:5c:ab:e7", "network": {"id": "f7298070-baaa-4842-b3b2-d9fe1058d3b6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1715911399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8722edee53ed4a9188366c38f3b8b52f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0e89b76-95", "ovs_interfaceid": "a0e89b76-95af-4e50-a972-b223cc5b3cab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:52:31 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-27fd956e-676d-45a4-bda4-fe531390badc tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Releasing lock "refresh_cache-3d74c8f6-fb4e-4460-b722-674a8a1e2d25" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:52:31 user nova-compute[73449]: DEBUG nova.objects.instance [None req-27fd956e-676d-45a4-bda4-fe531390badc tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Lazy-loading 'flavor' on Instance uuid 3d74c8f6-fb4e-4460-b722-674a8a1e2d25 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:52:31 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:52:31 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:52:31 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:52:31 user nova-compute[73449]: DEBUG nova.compute.manager [req-dd322afe-e353-4b5f-8f3f-b92c9a76fbdc req-7b395f7e-d796-404c-a92c-81835f20605b service nova] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] Received event network-vif-unplugged-a0e89b76-95af-4e50-a972-b223cc5b3cab {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:52:31 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-dd322afe-e353-4b5f-8f3f-b92c9a76fbdc req-7b395f7e-d796-404c-a92c-81835f20605b service nova] Acquiring lock "3d74c8f6-fb4e-4460-b722-674a8a1e2d25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:52:31 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-dd322afe-e353-4b5f-8f3f-b92c9a76fbdc req-7b395f7e-d796-404c-a92c-81835f20605b service nova] Lock "3d74c8f6-fb4e-4460-b722-674a8a1e2d25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:52:31 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-dd322afe-e353-4b5f-8f3f-b92c9a76fbdc req-7b395f7e-d796-404c-a92c-81835f20605b service nova] Lock "3d74c8f6-fb4e-4460-b722-674a8a1e2d25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:52:31 user nova-compute[73449]: DEBUG nova.compute.manager [req-dd322afe-e353-4b5f-8f3f-b92c9a76fbdc req-7b395f7e-d796-404c-a92c-81835f20605b service nova] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] No waiting events found dispatching network-vif-unplugged-a0e89b76-95af-4e50-a972-b223cc5b3cab {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:52:31 user nova-compute[73449]: WARNING nova.compute.manager [req-dd322afe-e353-4b5f-8f3f-b92c9a76fbdc req-7b395f7e-d796-404c-a92c-81835f20605b service nova] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] Received unexpected event network-vif-unplugged-a0e89b76-95af-4e50-a972-b223cc5b3cab for instance with vm_state rescued and task_state unrescuing.
Aug 17 11:52:31 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:52:32 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-58f56c4c-1f88-4630-8a73-714380a05c9d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.453s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:52:32 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f56c4c-1f88-4630-8a73-714380a05c9d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] <== connect_volume: return (1455ms) {'type': 'block', 'scsi_wwn': '26134303632396639', 'path': '/dev/sdb'} {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 11:52:32 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58f56c4c-1f88-4630-8a73-714380a05c9d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26134303632396639', 'path': '/dev/sdb'} {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 11:52:32 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] Instance destroyed successfully.
Aug 17 11:52:32 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-58f56c4c-1f88-4630-8a73-714380a05c9d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:46:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1456627687',display_name='tempest-ServerActionsTestOtherB-server-1456627687',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1456627687',id=20,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNxG3No2zUVrbEXbRYCvyFo5zdmNWjUQ1w9Et6I/UYTR5GdEjRnJlmF8yAFQAym8G0hKrThB6Qoa83CCIr+oCSIdRZoU+FBKHtl3+QzEAuOyPVMVYrkASnAypoGWlwjgpQ==',key_name='tempest-keypair-1350250606',keypairs=<?>,launch_index=0,launched_at=2023-08-17T11:50:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4d6856b60c404a34b6355b5fd6dd7bb8',ramdisk_id='',reservation_id='r-2byzpdg1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-108358124',owner_user_name='tempest-ServerActionsTestOtherB-108358124-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T11:52:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2791de1444c2428f9120cc907529cfcf',uuid=3d468854-6182-49c8-acb7-0641df2d5219,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "1ec58d7f-18a4-4ddb-a137-2b72c5221621", "address": "fa:16:3e:8d:35:49", "network": {"id": "870c4b80-1ae0-4a10-89b8-ec734c66c244", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2050219794-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d6856b60c404a34b6355b5fd6dd7bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec58d7f-18", "ovs_interfaceid": "1ec58d7f-18a4-4ddb-a137-2b72c5221621", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73449) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 11:52:32 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-58f56c4c-1f88-4630-8a73-714380a05c9d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Converting VIF {"id": "1ec58d7f-18a4-4ddb-a137-2b72c5221621", "address": "fa:16:3e:8d:35:49", "network": {"id": "870c4b80-1ae0-4a10-89b8-ec734c66c244", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2050219794-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d6856b60c404a34b6355b5fd6dd7bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec58d7f-18", "ovs_interfaceid": "1ec58d7f-18a4-4ddb-a137-2b72c5221621", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:52:32 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-58f56c4c-1f88-4630-8a73-714380a05c9d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:35:49,bridge_name='br-int',has_traffic_filtering=True,id=1ec58d7f-18a4-4ddb-a137-2b72c5221621,network=Network(870c4b80-1ae0-4a10-89b8-ec734c66c244),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ec58d7f-18') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:52:32 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-58f56c4c-1f88-4630-8a73-714380a05c9d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] End _get_guest_xml xml=<domain type="kvm">
Aug 17 11:52:32 user nova-compute[73449]:   <uuid>3d468854-6182-49c8-acb7-0641df2d5219</uuid>
Aug 17 11:52:32 user nova-compute[73449]:   <name>instance-00000014</name>
Aug 17 11:52:32 user nova-compute[73449]:   <memory>524288</memory>
Aug 17 11:52:32 user nova-compute[73449]:   <vcpu>1</vcpu>
Aug 17 11:52:32 user nova-compute[73449]:   <metadata>
Aug 17 11:52:32 user nova-compute[73449]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 11:52:32 user nova-compute[73449]:       <nova:package version="0.0.0"/>
Aug 17 11:52:32 user nova-compute[73449]:       <nova:name>tempest-ServerActionsTestOtherB-server-1456627687</nova:name>
Aug 17 11:52:32 user nova-compute[73449]:       <nova:creationTime>2023-08-17 11:52:30</nova:creationTime>
Aug 17 11:52:32 user nova-compute[73449]:       <nova:flavor name="m1.tiny">
Aug 17 11:52:32 user nova-compute[73449]:         <nova:memory>512</nova:memory>
Aug 17 11:52:32 user nova-compute[73449]:         <nova:disk>1</nova:disk>
Aug 17 11:52:32 user nova-compute[73449]:         <nova:swap>0</nova:swap>
Aug 17 11:52:32 user nova-compute[73449]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 11:52:32 user nova-compute[73449]:         <nova:vcpus>1</nova:vcpus>
Aug 17 11:52:32 user nova-compute[73449]:       </nova:flavor>
Aug 17 11:52:32 user nova-compute[73449]:       <nova:owner>
Aug 17 11:52:32 user nova-compute[73449]:         <nova:user uuid="2791de1444c2428f9120cc907529cfcf">tempest-ServerActionsTestOtherB-108358124-project-member</nova:user>
Aug 17 11:52:32 user nova-compute[73449]:         <nova:project uuid="4d6856b60c404a34b6355b5fd6dd7bb8">tempest-ServerActionsTestOtherB-108358124</nova:project>
Aug 17 11:52:32 user nova-compute[73449]:       </nova:owner>
Aug 17 11:52:32 user nova-compute[73449]:       <nova:root type="image" uuid="0a2904ae-083d-41c8-83db-343132b36148"/>
Aug 17 11:52:32 user nova-compute[73449]:       <nova:ports>
Aug 17 11:52:32 user nova-compute[73449]:         <nova:port uuid="1ec58d7f-18a4-4ddb-a137-2b72c5221621">
Aug 17 11:52:32 user nova-compute[73449]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 17 11:52:32 user nova-compute[73449]:         </nova:port>
Aug 17 11:52:32 user nova-compute[73449]:       </nova:ports>
Aug 17 11:52:32 user nova-compute[73449]:     </nova:instance>
Aug 17 11:52:32 user nova-compute[73449]:   </metadata>
Aug 17 11:52:32 user nova-compute[73449]:   <sysinfo type="smbios">
Aug 17 11:52:32 user nova-compute[73449]:     <system>
Aug 17 11:52:32 user nova-compute[73449]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 11:52:32 user nova-compute[73449]:       <entry name="product">OpenStack Nova</entry>
Aug 17 11:52:32 user nova-compute[73449]:       <entry name="version">0.0.0</entry>
Aug 17 11:52:32 user nova-compute[73449]:       <entry name="serial">3d468854-6182-49c8-acb7-0641df2d5219</entry>
Aug 17 11:52:32 user nova-compute[73449]:       <entry name="uuid">3d468854-6182-49c8-acb7-0641df2d5219</entry>
Aug 17 11:52:32 user nova-compute[73449]:       <entry name="family">Virtual Machine</entry>
Aug 17 11:52:32 user nova-compute[73449]:     </system>
Aug 17 11:52:32 user nova-compute[73449]:   </sysinfo>
Aug 17 11:52:32 user nova-compute[73449]:   <os>
Aug 17 11:52:32 user nova-compute[73449]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 11:52:32 user nova-compute[73449]:     <boot dev="hd"/>
Aug 17 11:52:32 user nova-compute[73449]:     <smbios mode="sysinfo"/>
Aug 17 11:52:32 user nova-compute[73449]:   </os>
Aug 17 11:52:32 user nova-compute[73449]:   <features>
Aug 17 11:52:32 user nova-compute[73449]:     <acpi/>
Aug 17 11:52:32 user nova-compute[73449]:     <apic/>
Aug 17 11:52:32 user nova-compute[73449]:     <vmcoreinfo/>
Aug 17 11:52:32 user nova-compute[73449]:   </features>
Aug 17 11:52:32 user nova-compute[73449]:   <clock offset="utc">
Aug 17 11:52:32 user nova-compute[73449]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 11:52:32 user nova-compute[73449]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 11:52:32 user nova-compute[73449]:     <timer name="hpet" present="no"/>
Aug 17 11:52:32 user nova-compute[73449]:   </clock>
Aug 17 11:52:32 user nova-compute[73449]:   <cpu mode="custom" match="exact">
Aug 17 11:52:32 user nova-compute[73449]:     <model>Nehalem</model>
Aug 17 11:52:32 user nova-compute[73449]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 11:52:32 user nova-compute[73449]:   </cpu>
Aug 17 11:52:32 user nova-compute[73449]:   <devices>
Aug 17 11:52:32 user nova-compute[73449]:     <disk type="file" device="disk">
Aug 17 11:52:32 user nova-compute[73449]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 11:52:32 user nova-compute[73449]:       <source file="/opt/stack/data/nova/instances/3d468854-6182-49c8-acb7-0641df2d5219/disk"/>
Aug 17 11:52:32 user nova-compute[73449]:       <target dev="vda" bus="virtio"/>
Aug 17 11:52:32 user nova-compute[73449]:     </disk>
Aug 17 11:52:32 user nova-compute[73449]:     <disk type="block" device="disk">
Aug 17 11:52:32 user nova-compute[73449]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 11:52:32 user nova-compute[73449]:       <source dev="/dev/sdb"/>
Aug 17 11:52:32 user nova-compute[73449]:       <target dev="vdb" bus="virtio"/>
Aug 17 11:52:32 user nova-compute[73449]:       <serial>040e2bc9-cd90-4010-9fdf-b7cc92b1c061</serial>
Aug 17 11:52:32 user nova-compute[73449]:     </disk>
Aug 17 11:52:32 user nova-compute[73449]:     <interface type="ethernet">
Aug 17 11:52:32 user nova-compute[73449]:       <mac address="fa:16:3e:8d:35:49"/>
Aug 17 11:52:32 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 11:52:32 user nova-compute[73449]:       <mtu size="1442"/>
Aug 17 11:52:32 user nova-compute[73449]:       <target dev="tap1ec58d7f-18"/>
Aug 17 11:52:32 user nova-compute[73449]:     </interface>
Aug 17 11:52:32 user nova-compute[73449]:     <serial type="pty">
Aug 17 11:52:32 user nova-compute[73449]:       <log file="/opt/stack/data/nova/instances/3d468854-6182-49c8-acb7-0641df2d5219/console.log" append="off"/>
Aug 17 11:52:32 user nova-compute[73449]:     </serial>
Aug 17 11:52:32 user nova-compute[73449]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 11:52:32 user nova-compute[73449]:     <video>
Aug 17 11:52:32 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 11:52:32 user nova-compute[73449]:     </video>
Aug 17 11:52:32 user nova-compute[73449]:     <rng model="virtio">
Aug 17 11:52:32 user nova-compute[73449]:       <backend model="random">/dev/urandom</backend>
Aug 17 11:52:32 user nova-compute[73449]:     </rng>
Aug 17 11:52:32 user nova-compute[73449]:     <controller type="usb" index="0" model="none"/>
Aug 17 11:52:32 user nova-compute[73449]:     <memballoon model="virtio">
Aug 17 11:52:32 user nova-compute[73449]:       <stats period="10"/>
Aug 17 11:52:32 user nova-compute[73449]:     </memballoon>
Aug 17 11:52:32 user nova-compute[73449]:   </devices>
Aug 17 11:52:32 user nova-compute[73449]: </domain>
Aug 17 11:52:32 user nova-compute[73449]:  {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 11:52:32 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-58f56c4c-1f88-4630-8a73-714380a05c9d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:46:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1456627687',display_name='tempest-ServerActionsTestOtherB-server-1456627687',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1456627687',id=20,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNxG3No2zUVrbEXbRYCvyFo5zdmNWjUQ1w9Et6I/UYTR5GdEjRnJlmF8yAFQAym8G0hKrThB6Qoa83CCIr+oCSIdRZoU+FBKHtl3+QzEAuOyPVMVYrkASnAypoGWlwjgpQ==',key_name='tempest-keypair-1350250606',keypairs=<?>,launch_index=0,launched_at=2023-08-17T11:50:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4d6856b60c404a34b6355b5fd6dd7bb8',ramdisk_id='',reservation_id='r-2byzpdg1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-108358124',owner_user_name='tempest-ServerActionsTestOtherB-108358124-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T11:52:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2791de1444c2428f9120cc907529cfcf',uuid=3d468854-6182-49c8-acb7-0641df2d5219,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "1ec58d7f-18a4-4ddb-a137-2b72c5221621", "address": "fa:16:3e:8d:35:49", "network": {"id": "870c4b80-1ae0-4a10-89b8-ec734c66c244", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2050219794-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d6856b60c404a34b6355b5fd6dd7bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec58d7f-18", "ovs_interfaceid": "1ec58d7f-18a4-4ddb-a137-2b72c5221621", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 11:52:32 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-58f56c4c-1f88-4630-8a73-714380a05c9d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Converting VIF {"id": "1ec58d7f-18a4-4ddb-a137-2b72c5221621", "address": "fa:16:3e:8d:35:49", "network": {"id": "870c4b80-1ae0-4a10-89b8-ec734c66c244", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2050219794-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d6856b60c404a34b6355b5fd6dd7bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec58d7f-18", "ovs_interfaceid": "1ec58d7f-18a4-4ddb-a137-2b72c5221621", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:52:32 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-58f56c4c-1f88-4630-8a73-714380a05c9d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:35:49,bridge_name='br-int',has_traffic_filtering=True,id=1ec58d7f-18a4-4ddb-a137-2b72c5221621,network=Network(870c4b80-1ae0-4a10-89b8-ec734c66c244),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ec58d7f-18') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:52:32 user nova-compute[73449]: DEBUG os_vif [None req-58f56c4c-1f88-4630-8a73-714380a05c9d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:35:49,bridge_name='br-int',has_traffic_filtering=True,id=1ec58d7f-18a4-4ddb-a137-2b72c5221621,network=Network(870c4b80-1ae0-4a10-89b8-ec734c66c244),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ec58d7f-18') {{(pid=73449) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 11:52:32 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:52:32 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:52:32 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 11:52:32 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:52:32 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1ec58d7f-18, may_exist=True, interface_attrs={}) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:52:32 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1ec58d7f-18, col_values=(('external_ids', {'iface-id': '1ec58d7f-18a4-4ddb-a137-2b72c5221621', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8d:35:49', 'vm-uuid': '3d468854-6182-49c8-acb7-0641df2d5219'}),), if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:52:32 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:52:32 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:52:32 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:52:32 user nova-compute[73449]: INFO os_vif [None req-58f56c4c-1f88-4630-8a73-714380a05c9d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:35:49,bridge_name='br-int',has_traffic_filtering=True,id=1ec58d7f-18a4-4ddb-a137-2b72c5221621,network=Network(870c4b80-1ae0-4a10-89b8-ec734c66c244),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ec58d7f-18')
Aug 17 11:52:32 user nova-compute[73449]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692273137.9544115, 5612f7d1-a901-4bdd-a24a-faf9a980cd04 => Stopped> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:52:32 user nova-compute[73449]: INFO nova.compute.manager [-] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] VM Stopped (Lifecycle Event)
Aug 17 11:52:32 user nova-compute[73449]: DEBUG nova.compute.manager [None req-9ecb9ea0-d4d1-4562-a72c-edcfb7b8dd1c None None] [instance: 5612f7d1-a901-4bdd-a24a-faf9a980cd04] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:52:33 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:52:33 user nova-compute[73449]: DEBUG nova.compute.manager [req-08d2c519-cc3f-4995-ad14-1ca4bc7fd636 req-0d27554c-c4ae-4911-b442-8c963272eb73 service nova] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] Received event network-vif-plugged-a0e89b76-95af-4e50-a972-b223cc5b3cab {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:52:33 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-08d2c519-cc3f-4995-ad14-1ca4bc7fd636 req-0d27554c-c4ae-4911-b442-8c963272eb73 service nova] Acquiring lock "3d74c8f6-fb4e-4460-b722-674a8a1e2d25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:52:33 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-08d2c519-cc3f-4995-ad14-1ca4bc7fd636 req-0d27554c-c4ae-4911-b442-8c963272eb73 service nova] Lock "3d74c8f6-fb4e-4460-b722-674a8a1e2d25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:52:33 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-08d2c519-cc3f-4995-ad14-1ca4bc7fd636 req-0d27554c-c4ae-4911-b442-8c963272eb73 service nova] Lock "3d74c8f6-fb4e-4460-b722-674a8a1e2d25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:52:33 user nova-compute[73449]: DEBUG nova.compute.manager [req-08d2c519-cc3f-4995-ad14-1ca4bc7fd636 req-0d27554c-c4ae-4911-b442-8c963272eb73 service nova] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] No waiting events found dispatching network-vif-plugged-a0e89b76-95af-4e50-a972-b223cc5b3cab {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:52:33 user nova-compute[73449]: WARNING nova.compute.manager [req-08d2c519-cc3f-4995-ad14-1ca4bc7fd636 req-0d27554c-c4ae-4911-b442-8c963272eb73 service nova] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] Received unexpected event network-vif-plugged-a0e89b76-95af-4e50-a972-b223cc5b3cab for instance with vm_state rescued and task_state unrescuing.
Aug 17 11:52:34 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:52:34 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:52:34 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:52:34 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:52:34 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:52:34 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:52:34 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:52:34 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:52:34 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:52:35 user nova-compute[73449]: DEBUG nova.compute.manager [req-98d9bca6-e150-430d-965e-e9a693bd3a93 req-76bbc1d5-abed-4623-a46d-ee9760d96ea9 service nova] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Received event network-vif-plugged-1ec58d7f-18a4-4ddb-a137-2b72c5221621 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:52:35 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-98d9bca6-e150-430d-965e-e9a693bd3a93 req-76bbc1d5-abed-4623-a46d-ee9760d96ea9 service nova] Acquiring lock "3d468854-6182-49c8-acb7-0641df2d5219-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:52:35 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-98d9bca6-e150-430d-965e-e9a693bd3a93 req-76bbc1d5-abed-4623-a46d-ee9760d96ea9 service nova] Lock "3d468854-6182-49c8-acb7-0641df2d5219-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:52:35 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-98d9bca6-e150-430d-965e-e9a693bd3a93 req-76bbc1d5-abed-4623-a46d-ee9760d96ea9 service nova] Lock "3d468854-6182-49c8-acb7-0641df2d5219-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:52:35 user nova-compute[73449]: DEBUG nova.compute.manager [req-98d9bca6-e150-430d-965e-e9a693bd3a93 req-76bbc1d5-abed-4623-a46d-ee9760d96ea9 service nova] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] No waiting events found dispatching network-vif-plugged-1ec58d7f-18a4-4ddb-a137-2b72c5221621 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:52:35 user nova-compute[73449]: WARNING nova.compute.manager [req-98d9bca6-e150-430d-965e-e9a693bd3a93 req-76bbc1d5-abed-4623-a46d-ee9760d96ea9 service nova] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Received unexpected event network-vif-plugged-1ec58d7f-18a4-4ddb-a137-2b72c5221621 for instance with vm_state resized and task_state resize_reverting.
Aug 17 11:52:35 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:52:35 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:52:35 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:52:36 user nova-compute[73449]: DEBUG nova.compute.manager [req-0ae855a6-7ae0-4aa9-9955-5e989c38ed29 req-ac2a0315-30e5-4dae-9581-1bfb056dde5a service nova] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] Received event network-vif-plugged-a0e89b76-95af-4e50-a972-b223cc5b3cab {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:52:36 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-0ae855a6-7ae0-4aa9-9955-5e989c38ed29 req-ac2a0315-30e5-4dae-9581-1bfb056dde5a service nova] Acquiring lock "3d74c8f6-fb4e-4460-b722-674a8a1e2d25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:52:36 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-0ae855a6-7ae0-4aa9-9955-5e989c38ed29 req-ac2a0315-30e5-4dae-9581-1bfb056dde5a service nova] Lock "3d74c8f6-fb4e-4460-b722-674a8a1e2d25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:52:36 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-0ae855a6-7ae0-4aa9-9955-5e989c38ed29 req-ac2a0315-30e5-4dae-9581-1bfb056dde5a service nova] Lock "3d74c8f6-fb4e-4460-b722-674a8a1e2d25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:52:36 user nova-compute[73449]: DEBUG nova.compute.manager [req-0ae855a6-7ae0-4aa9-9955-5e989c38ed29 req-ac2a0315-30e5-4dae-9581-1bfb056dde5a service nova] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] No waiting events found dispatching network-vif-plugged-a0e89b76-95af-4e50-a972-b223cc5b3cab {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:52:36 user nova-compute[73449]: WARNING nova.compute.manager [req-0ae855a6-7ae0-4aa9-9955-5e989c38ed29 req-ac2a0315-30e5-4dae-9581-1bfb056dde5a service nova] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] Received unexpected event network-vif-plugged-a0e89b76-95af-4e50-a972-b223cc5b3cab for instance with vm_state rescued and task_state unrescuing.
Aug 17 11:52:36 user nova-compute[73449]: DEBUG nova.compute.manager [req-0ae855a6-7ae0-4aa9-9955-5e989c38ed29 req-ac2a0315-30e5-4dae-9581-1bfb056dde5a service nova] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] Received event network-vif-plugged-a0e89b76-95af-4e50-a972-b223cc5b3cab {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:52:36 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-0ae855a6-7ae0-4aa9-9955-5e989c38ed29 req-ac2a0315-30e5-4dae-9581-1bfb056dde5a service nova] Acquiring lock "3d74c8f6-fb4e-4460-b722-674a8a1e2d25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:52:36 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-0ae855a6-7ae0-4aa9-9955-5e989c38ed29 req-ac2a0315-30e5-4dae-9581-1bfb056dde5a service nova] Lock "3d74c8f6-fb4e-4460-b722-674a8a1e2d25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:52:36 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-0ae855a6-7ae0-4aa9-9955-5e989c38ed29 req-ac2a0315-30e5-4dae-9581-1bfb056dde5a service nova] Lock "3d74c8f6-fb4e-4460-b722-674a8a1e2d25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:52:36 user nova-compute[73449]: DEBUG nova.compute.manager [req-0ae855a6-7ae0-4aa9-9955-5e989c38ed29 req-ac2a0315-30e5-4dae-9581-1bfb056dde5a service nova] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] No waiting events found dispatching network-vif-plugged-a0e89b76-95af-4e50-a972-b223cc5b3cab {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:52:36 user nova-compute[73449]: WARNING nova.compute.manager [req-0ae855a6-7ae0-4aa9-9955-5e989c38ed29 req-ac2a0315-30e5-4dae-9581-1bfb056dde5a service nova] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] Received unexpected event network-vif-plugged-a0e89b76-95af-4e50-a972-b223cc5b3cab for instance with vm_state rescued and task_state unrescuing.
Aug 17 11:52:37 user nova-compute[73449]: DEBUG nova.compute.manager [req-0ad97824-d1b1-48aa-a1b6-866c798b693e req-f05942b7-0973-4a74-b504-f4972a0daa68 service nova] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Received event network-vif-plugged-1ec58d7f-18a4-4ddb-a137-2b72c5221621 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:52:37 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-0ad97824-d1b1-48aa-a1b6-866c798b693e req-f05942b7-0973-4a74-b504-f4972a0daa68 service nova] Acquiring lock "3d468854-6182-49c8-acb7-0641df2d5219-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:52:37 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-0ad97824-d1b1-48aa-a1b6-866c798b693e req-f05942b7-0973-4a74-b504-f4972a0daa68 service nova] Lock "3d468854-6182-49c8-acb7-0641df2d5219-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:52:37 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-0ad97824-d1b1-48aa-a1b6-866c798b693e req-f05942b7-0973-4a74-b504-f4972a0daa68 service nova] Lock "3d468854-6182-49c8-acb7-0641df2d5219-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:52:37 user nova-compute[73449]: DEBUG nova.compute.manager [req-0ad97824-d1b1-48aa-a1b6-866c798b693e req-f05942b7-0973-4a74-b504-f4972a0daa68 service nova] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] No waiting events found dispatching network-vif-plugged-1ec58d7f-18a4-4ddb-a137-2b72c5221621 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:52:37 user nova-compute[73449]: WARNING nova.compute.manager [req-0ad97824-d1b1-48aa-a1b6-866c798b693e req-f05942b7-0973-4a74-b504-f4972a0daa68 service nova] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Received unexpected event network-vif-plugged-1ec58d7f-18a4-4ddb-a137-2b72c5221621 for instance with vm_state resized and task_state resize_reverting.
Aug 17 11:52:37 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:52:37 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692273157.2735739, 3d468854-6182-49c8-acb7-0641df2d5219 => Resumed> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:52:37 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] VM Resumed (Lifecycle Event)
Aug 17 11:52:37 user nova-compute[73449]: DEBUG nova.compute.manager [None req-58f56c4c-1f88-4630-8a73-714380a05c9d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Instance event wait completed in 0 seconds for  {{(pid=73449) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 11:52:37 user nova-compute[73449]: DEBUG nova.compute.manager [None req-27fd956e-676d-45a4-bda4-fe531390badc tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:52:37 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Instance running successfully.
Aug 17 11:52:37 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-58f56c4c-1f88-4630-8a73-714380a05c9d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] finish_revert_migration finished successfully. {{(pid=73449) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Aug 17 11:52:37 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:52:37 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 11:52:37 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 17 11:52:37 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692273157.2749062, 3d468854-6182-49c8-acb7-0641df2d5219 => Started> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:52:37 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] VM Started (Lifecycle Event)
Aug 17 11:52:37 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:52:37 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 11:52:37 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 17 11:52:37 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Removed pending event for 3d74c8f6-fb4e-4460-b722-674a8a1e2d25 due to event {{(pid=73449) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 17 11:52:37 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692273157.276667, 3d74c8f6-fb4e-4460-b722-674a8a1e2d25 => Resumed> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:52:37 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] VM Resumed (Lifecycle Event)
Aug 17 11:52:37 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:52:37 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 11:52:37 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692273157.2768316, 3d74c8f6-fb4e-4460-b722-674a8a1e2d25 => Started> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:52:37 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] VM Started (Lifecycle Event)
Aug 17 11:52:37 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:52:37 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 11:52:37 user nova-compute[73449]: INFO nova.compute.manager [None req-58f56c4c-1f88-4630-8a73-714380a05c9d tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Updating instance to original state: 'active'
Aug 17 11:52:37 user nova-compute[73449]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692273142.4750094, ec622bf0-4531-4892-b637-0ef564cf453b => Stopped> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:52:37 user nova-compute[73449]: INFO nova.compute.manager [-] [instance: ec622bf0-4531-4892-b637-0ef564cf453b] VM Stopped (Lifecycle Event)
Aug 17 11:52:37 user nova-compute[73449]: DEBUG nova.compute.manager [None req-2eb55bd7-9513-4685-ad58-c5b58c5bc188 None None] [instance: ec622bf0-4531-4892-b637-0ef564cf453b] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:52:38 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:52:39 user nova-compute[73449]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692273144.5694466, 23ab9ffc-226d-4caa-8caa-9458de06a1c9 => Stopped> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:52:39 user nova-compute[73449]: INFO nova.compute.manager [-] [instance: 23ab9ffc-226d-4caa-8caa-9458de06a1c9] VM Stopped (Lifecycle Event)
Aug 17 11:52:39 user nova-compute[73449]: DEBUG nova.compute.manager [None req-7e9ef109-a6f6-45b3-9494-a2da97b44392 None None] [instance: 23ab9ffc-226d-4caa-8caa-9458de06a1c9] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:52:42 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:52:46 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Acquiring lock "fea9f81c-a848-4a65-863e-e09dddf65bcf" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:52:46 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Lock "fea9f81c-a848-4a65-863e-e09dddf65bcf" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:52:46 user nova-compute[73449]: INFO nova.compute.manager [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Unshelving
Aug 17 11:52:46 user nova-compute[73449]: INFO nova.virt.block_device [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Booting with volume bc855d21-60f9-4798-aecf-44a569bf0a11 at /dev/vdc
Aug 17 11:52:47 user nova-compute[73449]: DEBUG os_brick.utils [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 11:52:47 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:52:47 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:52:47 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1e11338-004f-425d-a461-25a39a19b194]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4d3924302012\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:52:47 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:52:47 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:52:47 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f64c4c3-32c4-44e4-8128-3bdbf0ad60ba]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:52:47 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:52:47 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:52:47 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3084237-527e-4633-b74b-eb7cf3719d27]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:52:47 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9667050-075a-44ea-b604-697f38658246]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:52:47 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Running cmd (subprocess): nvme version {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:52:47 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] 'nvme version' failed. Not Retrying. {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 11:52:47 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] nvme not present on system {{(pid=73449) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 11:52:47 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:52:47 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 11:52:47 user nova-compute[73449]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 11:52:47 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[20b35366-8ca9-4753-b241-d7988da4d46c]: (4, '') {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:52:47 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73449) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 11:52:47 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73449) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 11:52:47 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] LIGHTOS: no hostnqn found. {{(pid=73449) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 11:52:47 user nova-compute[73449]: DEBUG os_brick.utils [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4d3924302012', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 11:52:47 user nova-compute[73449]: DEBUG nova.virt.block_device [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Updating existing volume attachment record: 1cdbacde-657e-4850-96fc-bebb1e9eb3b2 {{(pid=73449) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 11:52:47 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:52:52 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:52:53 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:52:56 user nova-compute[73449]: DEBUG nova.compute.manager [req-96b9a11f-40ee-452d-b62c-b62138bf8aa5 req-bfc7cd29-d12a-4156-909b-1ceccbdd5791 service nova] [instance: 9e689bc9-6625-46b7-90d0-52c50f9b73e6] Received event network-changed-7de7b2c0-d9e0-4e1a-bf74-2a477c16b514 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:52:56 user nova-compute[73449]: DEBUG nova.compute.manager [req-96b9a11f-40ee-452d-b62c-b62138bf8aa5 req-bfc7cd29-d12a-4156-909b-1ceccbdd5791 service nova] [instance: 9e689bc9-6625-46b7-90d0-52c50f9b73e6] Refreshing instance network info cache due to event network-changed-7de7b2c0-d9e0-4e1a-bf74-2a477c16b514. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 11:52:56 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-96b9a11f-40ee-452d-b62c-b62138bf8aa5 req-bfc7cd29-d12a-4156-909b-1ceccbdd5791 service nova] Acquiring lock "refresh_cache-9e689bc9-6625-46b7-90d0-52c50f9b73e6" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:52:56 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-96b9a11f-40ee-452d-b62c-b62138bf8aa5 req-bfc7cd29-d12a-4156-909b-1ceccbdd5791 service nova] Acquired lock "refresh_cache-9e689bc9-6625-46b7-90d0-52c50f9b73e6" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:52:56 user nova-compute[73449]: DEBUG nova.network.neutron [req-96b9a11f-40ee-452d-b62c-b62138bf8aa5 req-bfc7cd29-d12a-4156-909b-1ceccbdd5791 service nova] [instance: 9e689bc9-6625-46b7-90d0-52c50f9b73e6] Refreshing network info cache for port 7de7b2c0-d9e0-4e1a-bf74-2a477c16b514 {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 11:52:57 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-0361fe49-2a70-431c-814e-8fa25b4cae3f tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Acquiring lock "9e689bc9-6625-46b7-90d0-52c50f9b73e6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:52:57 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-0361fe49-2a70-431c-814e-8fa25b4cae3f tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Lock "9e689bc9-6625-46b7-90d0-52c50f9b73e6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:52:57 user nova-compute[73449]: DEBUG nova.objects.instance [None req-0361fe49-2a70-431c-814e-8fa25b4cae3f tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Lazy-loading 'flavor' on Instance uuid 9e689bc9-6625-46b7-90d0-52c50f9b73e6 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:52:57 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-0361fe49-2a70-431c-814e-8fa25b4cae3f tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] [instance: 9e689bc9-6625-46b7-90d0-52c50f9b73e6] Ignoring supplied device name: /dev/vdb
Aug 17 11:52:57 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:52:57 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-0361fe49-2a70-431c-814e-8fa25b4cae3f tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Lock "9e689bc9-6625-46b7-90d0-52c50f9b73e6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:52:57 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-0361fe49-2a70-431c-814e-8fa25b4cae3f tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Acquiring lock "9e689bc9-6625-46b7-90d0-52c50f9b73e6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:52:57 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-0361fe49-2a70-431c-814e-8fa25b4cae3f tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Lock "9e689bc9-6625-46b7-90d0-52c50f9b73e6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:52:57 user nova-compute[73449]: INFO nova.compute.manager [None req-0361fe49-2a70-431c-814e-8fa25b4cae3f tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] [instance: 9e689bc9-6625-46b7-90d0-52c50f9b73e6] Attaching volume 674238ab-cc2c-41a5-a152-8937a50e5526 to /dev/vdb
Aug 17 11:52:57 user nova-compute[73449]: DEBUG os_brick.utils [None req-0361fe49-2a70-431c-814e-8fa25b4cae3f tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 11:52:57 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:52:57 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:52:57 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4e4b07a-6027-41c8-afe6-fa99b2279da4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4d3924302012\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:52:57 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:52:57 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:52:57 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dd94a55-c51b-4e3d-8005-907e013a5342]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:52:57 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:52:57 user nova-compute[73449]: DEBUG nova.network.neutron [req-96b9a11f-40ee-452d-b62c-b62138bf8aa5 req-bfc7cd29-d12a-4156-909b-1ceccbdd5791 service nova] [instance: 9e689bc9-6625-46b7-90d0-52c50f9b73e6] Updated VIF entry in instance network info cache for port 7de7b2c0-d9e0-4e1a-bf74-2a477c16b514. {{(pid=73449) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 11:52:57 user nova-compute[73449]: DEBUG nova.network.neutron [req-96b9a11f-40ee-452d-b62c-b62138bf8aa5 req-bfc7cd29-d12a-4156-909b-1ceccbdd5791 service nova] [instance: 9e689bc9-6625-46b7-90d0-52c50f9b73e6] Updating instance_info_cache with network_info: [{"id": "7de7b2c0-d9e0-4e1a-bf74-2a477c16b514", "address": "fa:16:3e:08:89:a4", "network": {"id": "bae20193-cae3-45f8-8881-68020cd853e9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-459774400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "348b0a78aaf940b98f91655ddd6d4d6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7de7b2c0-d9", "ovs_interfaceid": "7de7b2c0-d9e0-4e1a-bf74-2a477c16b514", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:52:57 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:52:57 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac42361b-c9c9-42e2-bc57-0afd8aa60645]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:52:57 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[26e545e4-590c-4832-8c68-428ae987c4a2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:52:57 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-0361fe49-2a70-431c-814e-8fa25b4cae3f tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Running cmd (subprocess): nvme version {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:52:57 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-0361fe49-2a70-431c-814e-8fa25b4cae3f tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] 'nvme version' failed. Not Retrying. {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 11:52:57 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0361fe49-2a70-431c-814e-8fa25b4cae3f tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] nvme not present on system {{(pid=73449) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 11:52:57 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-96b9a11f-40ee-452d-b62c-b62138bf8aa5 req-bfc7cd29-d12a-4156-909b-1ceccbdd5791 service nova] Releasing lock "refresh_cache-9e689bc9-6625-46b7-90d0-52c50f9b73e6" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:52:57 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:52:57 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 11:52:57 user nova-compute[73449]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 11:52:57 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[03da3af8-b63f-4b55-b208-56195abdce16]: (4, '') {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:52:57 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-0361fe49-2a70-431c-814e-8fa25b4cae3f tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73449) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 11:52:57 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-0361fe49-2a70-431c-814e-8fa25b4cae3f tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73449) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 11:52:57 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-0361fe49-2a70-431c-814e-8fa25b4cae3f tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] LIGHTOS: no hostnqn found. {{(pid=73449) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 11:52:57 user nova-compute[73449]: DEBUG os_brick.utils [None req-0361fe49-2a70-431c-814e-8fa25b4cae3f tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4d3924302012', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 11:52:57 user nova-compute[73449]: DEBUG nova.virt.block_device [None req-0361fe49-2a70-431c-814e-8fa25b4cae3f tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] [instance: 9e689bc9-6625-46b7-90d0-52c50f9b73e6] Updating existing volume attachment record: 8e882bd5-0d2f-41ce-a10c-84fcf4c89bce {{(pid=73449) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 11:52:58 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:52:58 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:52:58 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:52:58 user nova-compute[73449]: DEBUG nova.objects.instance [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Lazy-loading 'pci_requests' on Instance uuid fea9f81c-a848-4a65-863e-e09dddf65bcf {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:52:58 user nova-compute[73449]: DEBUG nova.objects.instance [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Lazy-loading 'numa_topology' on Instance uuid fea9f81c-a848-4a65-863e-e09dddf65bcf {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:52:58 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73449) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 11:52:58 user nova-compute[73449]: INFO nova.compute.claims [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Claim successful on node user
Aug 17 11:52:59 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 11:52:59 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 11:52:59 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.459s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:52:59 user nova-compute[73449]: INFO nova.network.neutron [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Updating port 5db97a8e-3943-4259-ae41-cec1946c33f8 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 17 11:53:00 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Acquiring lock "refresh_cache-fea9f81c-a848-4a65-863e-e09dddf65bcf" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:53:00 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Acquired lock "refresh_cache-fea9f81c-a848-4a65-863e-e09dddf65bcf" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:53:00 user nova-compute[73449]: DEBUG nova.network.neutron [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Building network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 11:53:00 user nova-compute[73449]: DEBUG nova.compute.manager [req-c3b63519-d665-4906-b1e2-9fca3fb456bf req-2af3c889-1803-456e-982e-ca2231de2dbc service nova] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Received event network-changed-5db97a8e-3943-4259-ae41-cec1946c33f8 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:53:00 user nova-compute[73449]: DEBUG nova.compute.manager [req-c3b63519-d665-4906-b1e2-9fca3fb456bf req-2af3c889-1803-456e-982e-ca2231de2dbc service nova] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Refreshing instance network info cache due to event network-changed-5db97a8e-3943-4259-ae41-cec1946c33f8. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 11:53:00 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-c3b63519-d665-4906-b1e2-9fca3fb456bf req-2af3c889-1803-456e-982e-ca2231de2dbc service nova] Acquiring lock "refresh_cache-fea9f81c-a848-4a65-863e-e09dddf65bcf" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:53:00 user nova-compute[73449]: DEBUG nova.network.neutron [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Updating instance_info_cache with network_info: [{"id": "5db97a8e-3943-4259-ae41-cec1946c33f8", "address": "fa:16:3e:c2:f3:5a", "network": {"id": "d56bc428-6be6-4aa9-b43c-9d4a0f1dd83b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-791364634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe7b5fee01a042bb90e40b18a84c82c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5db97a8e-39", "ovs_interfaceid": "5db97a8e-3943-4259-ae41-cec1946c33f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:53:00 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Releasing lock "refresh_cache-fea9f81c-a848-4a65-863e-e09dddf65bcf" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:53:00 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Creating instance directory {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 11:53:00 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Creating image(s)
Aug 17 11:53:00 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Acquiring lock "/opt/stack/data/nova/instances/fea9f81c-a848-4a65-863e-e09dddf65bcf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:53:00 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Lock "/opt/stack/data/nova/instances/fea9f81c-a848-4a65-863e-e09dddf65bcf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:53:00 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Lock "/opt/stack/data/nova/instances/fea9f81c-a848-4a65-863e-e09dddf65bcf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:53:00 user nova-compute[73449]: DEBUG nova.objects.instance [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Lazy-loading 'trusted_certs' on Instance uuid fea9f81c-a848-4a65-863e-e09dddf65bcf {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:53:00 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-c3b63519-d665-4906-b1e2-9fca3fb456bf req-2af3c889-1803-456e-982e-ca2231de2dbc service nova] Acquired lock "refresh_cache-fea9f81c-a848-4a65-863e-e09dddf65bcf" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:53:00 user nova-compute[73449]: DEBUG nova.network.neutron [req-c3b63519-d665-4906-b1e2-9fca3fb456bf req-2af3c889-1803-456e-982e-ca2231de2dbc service nova] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Refreshing network info cache for port 5db97a8e-3943-4259-ae41-cec1946c33f8 {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 11:53:00 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Acquiring lock "c58b584ce4403ce5407e40fcecaa060c5925dfc6" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:53:00 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Lock "c58b584ce4403ce5407e40fcecaa060c5925dfc6" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:53:01 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c58b584ce4403ce5407e40fcecaa060c5925dfc6.part --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:53:01 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:53:01 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:53:01 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Starting heal instance info cache {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 11:53:02 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "refresh_cache-ae75d334-431a-4008-8b3d-f2a727d92417" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:53:02 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquired lock "refresh_cache-ae75d334-431a-4008-8b3d-f2a727d92417" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:53:02 user nova-compute[73449]: DEBUG nova.network.neutron [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: ae75d334-431a-4008-8b3d-f2a727d92417] Forcefully refreshing network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 11:53:02 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c58b584ce4403ce5407e40fcecaa060c5925dfc6.part --force-share --output=json" returned: 0 in 0.187s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:53:02 user nova-compute[73449]: DEBUG nova.virt.images [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] b7edcc07-4d64-47f5-b9e4-97e581adba97 was qcow2, converting to raw {{(pid=73449) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 17 11:53:02 user nova-compute[73449]: DEBUG nova.privsep.utils [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73449) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 11:53:02 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c58b584ce4403ce5407e40fcecaa060c5925dfc6.part /opt/stack/data/nova/instances/_base/c58b584ce4403ce5407e40fcecaa060c5925dfc6.converted {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:53:02 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:53:02 user nova-compute[73449]: DEBUG nova.network.neutron [req-c3b63519-d665-4906-b1e2-9fca3fb456bf req-2af3c889-1803-456e-982e-ca2231de2dbc service nova] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Updated VIF entry in instance network info cache for port 5db97a8e-3943-4259-ae41-cec1946c33f8. {{(pid=73449) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 11:53:02 user nova-compute[73449]: DEBUG nova.network.neutron [req-c3b63519-d665-4906-b1e2-9fca3fb456bf req-2af3c889-1803-456e-982e-ca2231de2dbc service nova] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Updating instance_info_cache with network_info: [{"id": "5db97a8e-3943-4259-ae41-cec1946c33f8", "address": "fa:16:3e:c2:f3:5a", "network": {"id": "d56bc428-6be6-4aa9-b43c-9d4a0f1dd83b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-791364634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe7b5fee01a042bb90e40b18a84c82c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5db97a8e-39", "ovs_interfaceid": "5db97a8e-3943-4259-ae41-cec1946c33f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:53:02 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-c3b63519-d665-4906-b1e2-9fca3fb456bf req-2af3c889-1803-456e-982e-ca2231de2dbc service nova] Releasing lock "refresh_cache-fea9f81c-a848-4a65-863e-e09dddf65bcf" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:53:02 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c58b584ce4403ce5407e40fcecaa060c5925dfc6.part /opt/stack/data/nova/instances/_base/c58b584ce4403ce5407e40fcecaa060c5925dfc6.converted" returned: 0 in 0.699s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:53:02 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c58b584ce4403ce5407e40fcecaa060c5925dfc6.converted --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:53:02 user nova-compute[73449]: DEBUG nova.network.neutron [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: ae75d334-431a-4008-8b3d-f2a727d92417] Updating instance_info_cache with network_info: [{"id": "0cd51063-e3d9-44a8-a1cd-b89bb41a4438", "address": "fa:16:3e:54:1f:e7", "network": {"id": "f7298070-baaa-4842-b3b2-d9fe1058d3b6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1715911399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8722edee53ed4a9188366c38f3b8b52f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cd51063-e3", "ovs_interfaceid": "0cd51063-e3d9-44a8-a1cd-b89bb41a4438", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:53:02 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Releasing lock "refresh_cache-ae75d334-431a-4008-8b3d-f2a727d92417" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:53:02 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: ae75d334-431a-4008-8b3d-f2a727d92417] Updated the network info_cache for instance {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 11:53:02 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:53:02 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:53:02 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:53:02 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:53:02 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:53:02 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:53:02 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73449) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 11:53:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c58b584ce4403ce5407e40fcecaa060c5925dfc6.converted --force-share --output=json" returned: 0 in 0.204s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:53:03 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Lock "c58b584ce4403ce5407e40fcecaa060c5925dfc6" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.123s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:53:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c58b584ce4403ce5407e40fcecaa060c5925dfc6 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:53:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c58b584ce4403ce5407e40fcecaa060c5925dfc6 --force-share --output=json" returned: 0 in 0.177s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:53:03 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Acquiring lock "c58b584ce4403ce5407e40fcecaa060c5925dfc6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:53:03 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Lock "c58b584ce4403ce5407e40fcecaa060c5925dfc6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:53:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c58b584ce4403ce5407e40fcecaa060c5925dfc6 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:53:03 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:53:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c58b584ce4403ce5407e40fcecaa060c5925dfc6 --force-share --output=json" returned: 0 in 0.171s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:53:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c58b584ce4403ce5407e40fcecaa060c5925dfc6,backing_fmt=raw /opt/stack/data/nova/instances/fea9f81c-a848-4a65-863e-e09dddf65bcf/disk 1073741824 {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:53:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c58b584ce4403ce5407e40fcecaa060c5925dfc6,backing_fmt=raw /opt/stack/data/nova/instances/fea9f81c-a848-4a65-863e-e09dddf65bcf/disk 1073741824" returned: 0 in 0.049s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:53:03 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Lock "c58b584ce4403ce5407e40fcecaa060c5925dfc6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.225s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:53:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c58b584ce4403ce5407e40fcecaa060c5925dfc6 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:53:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c58b584ce4403ce5407e40fcecaa060c5925dfc6 --force-share --output=json" returned: 0 in 0.178s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:53:03 user nova-compute[73449]: DEBUG nova.objects.instance [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Lazy-loading 'migration_context' on Instance uuid fea9f81c-a848-4a65-863e-e09dddf65bcf {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:53:03 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Rebasing disk image.
Aug 17 11:53:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:53:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json" returned: 0 in 0.175s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:53:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 -F raw /opt/stack/data/nova/instances/fea9f81c-a848-4a65-863e-e09dddf65bcf/disk {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:53:04 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:53:04 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:53:04 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:53:04 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:53:04 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=73449) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 11:53:05 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd4ec7bd-002e-4a71-9314-96c21427af27/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:53:05 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd4ec7bd-002e-4a71-9314-96c21427af27/disk --force-share --output=json" returned: 0 in 0.317s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:53:05 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd4ec7bd-002e-4a71-9314-96c21427af27/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:53:05 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd4ec7bd-002e-4a71-9314-96c21427af27/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:53:05 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=73449) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 11:53:05 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a9e8ad2-19db-4975-87e4-2efce603a7d7/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:53:05 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a9e8ad2-19db-4975-87e4-2efce603a7d7/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:53:05 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a9e8ad2-19db-4975-87e4-2efce603a7d7/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:53:06 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a9e8ad2-19db-4975-87e4-2efce603a7d7/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:53:06 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk.rescue --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:53:06 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 -F raw /opt/stack/data/nova/instances/fea9f81c-a848-4a65-863e-e09dddf65bcf/disk" returned: 0 in 2.264s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:53:06 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Created local disks {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 11:53:06 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Ensure instance console log exists: /opt/stack/data/nova/instances/fea9f81c-a848-4a65-863e-e09dddf65bcf/console.log {{(pid=73449) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 11:53:06 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:53:06 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:53:06 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:53:06 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Start _get_guest_xml network_info=[{"id": "5db97a8e-3943-4259-ae41-cec1946c33f8", "address": "fa:16:3e:c2:f3:5a", "network": {"id": "d56bc428-6be6-4aa9-b43c-9d4a0f1dd83b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-791364634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe7b5fee01a042bb90e40b18a84c82c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5db97a8e-39", "ovs_interfaceid": "5db97a8e-3943-4259-ae41-cec1946c33f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='20dbe6f7d7d6145428f2137e414154a0',container_format='bare',created_at=2023-08-17T11:50:53Z,direct_url=<?>,disk_format='qcow2',id=b7edcc07-4d64-47f5-b9e4-97e581adba97,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-2040756698-shelved',owner='fe7b5fee01a042bb90e40b18a84c82c0',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-17T11:51:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': '0a2904ae-083d-41c8-83db-343132b36148'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'attachment_id': '1cdbacde-657e-4850-96fc-bebb1e9eb3b2', 'boot_index': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:bc855d21-60f9-4798-aecf-44a569bf0a11'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wMEhRvFJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': 'fea9f81c-a848-4a65-863e-e09dddf65bcf', 'attached_at': '', 'detached_at': '', 'volume_id': 'bc855d21-60f9-4798-aecf-44a569bf0a11', 'serial': 'bc855d21-60f9-4798-aecf-44a569bf0a11'}, 'delete_on_termination': False, 'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 11:53:06 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:53:06 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:53:06 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 11:53:06 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] CPU controller missing on host. {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 11:53:06 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 11:53:06 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] CPU controller found on host. {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 11:53:06 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73449) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 11:53:06 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T11:35:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='20dbe6f7d7d6145428f2137e414154a0',container_format='bare',created_at=2023-08-17T11:50:53Z,direct_url=<?>,disk_format='qcow2',id=b7edcc07-4d64-47f5-b9e4-97e581adba97,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-2040756698-shelved',owner='fe7b5fee01a042bb90e40b18a84c82c0',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-17T11:51:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 11:53:06 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Flavor limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 11:53:06 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Image limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 11:53:06 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Flavor pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 11:53:06 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Image pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 11:53:06 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 11:53:06 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 11:53:06 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 11:53:06 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Got 1 possible topologies {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 11:53:06 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 11:53:06 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 11:53:06 user nova-compute[73449]: DEBUG nova.objects.instance [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Lazy-loading 'vcpu_model' on Instance uuid fea9f81c-a848-4a65-863e-e09dddf65bcf {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:53:06 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Calling os-brick to attach iSCSI Volume {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 11:53:06 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:bc855d21-60f9-4798-aecf-44a569bf0a11'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wMEhRvFJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 11:53:06 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 11:53:06 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:53:06 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:53:06 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 11:53:06 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc855d21-60f9-4798-aecf-44a569bf0a11" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:53:06 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc855d21-60f9-4798-aecf-44a569bf0a11" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:53:06 user nova-compute[73449]: INFO os_brick.initiator.connectors.iscsi [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 11:53:06 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc855d21-60f9-4798-aecf-44a569bf0a11 -p 172.16.0.220:3260 {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:53:06 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc855d21-60f9-4798-aecf-44a569bf0a11 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:53:06 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce6a7649-ff48-42a7-8e35-f65cac7490ad]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:53:06 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 11:53:06 user nova-compute[73449]:  {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:53:06 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc855d21-60f9-4798-aecf-44a569bf0a11 -p 172.16.0.220:3260 --interface default --op new {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:53:06 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc855d21-60f9-4798-aecf-44a569bf0a11 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:53:06 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[720f22ba-6ad3-42ad-8dca-e7665d6b255e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bc855d21-60f9-4798-aecf-44a569bf0a11] added\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:53:06 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bc855d21-60f9-4798-aecf-44a569bf0a11] added
Aug 17 11:53:06 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:53:06 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc855d21-60f9-4798-aecf-44a569bf0a11 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:53:06 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:53:06 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk.rescue --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:53:06 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc855d21-60f9-4798-aecf-44a569bf0a11 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:53:06 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb3295cf-9a0b-4c05-9957-0e4bd19abf82]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:53:06 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:53:06 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc855d21-60f9-4798-aecf-44a569bf0a11 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:53:06 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc855d21-60f9-4798-aecf-44a569bf0a11 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:53:06 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[5da01e1f-2398-40cd-9567-42d46ee94dcf]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:53:06 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:53:06 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc855d21-60f9-4798-aecf-44a569bf0a11 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wMEhRvFJ {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:53:06 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc855d21-60f9-4798-aecf-44a569bf0a11 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wMEhRvFJ" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:53:06 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[dee2c17f-4642-4c56-bd13-ddfb48f32f61]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:53:06 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wMEhRvFJ'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:53:06 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc855d21-60f9-4798-aecf-44a569bf0a11 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:53:06 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc855d21-60f9-4798-aecf-44a569bf0a11 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:53:06 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[64ab4f18-a39c-4307-a89a-f06dca67021f]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:53:06 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:53:06 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:53:06 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:53:06 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d2b4f98-83dc-4412-b32c-9c53e45a8057]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:53:06 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe (non-flash)
Aug 17 11:53:06 user nova-compute[73449]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 (non-flash)
Aug 17 11:53:06 user nova-compute[73449]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 (non-flash)
Aug 17 11:53:06 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:53:06 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe (non-flash)
Aug 17 11:53:06 user nova-compute[73449]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 (non-flash)
Aug 17 11:53:06 user nova-compute[73449]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 (non-flash)
Aug 17 11:53:06 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:53:06 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc855d21-60f9-4798-aecf-44a569bf0a11 -p 172.16.0.220:3260 --login {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:53:06 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc855d21-60f9-4798-aecf-44a569bf0a11 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:53:06 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[c43973d6-54e4-441c-ad41-adac0edece29]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bc855d21-60f9-4798-aecf-44a569bf0a11, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bc855d21-60f9-4798-aecf-44a569bf0a11, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:53:06 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bc855d21-60f9-4798-aecf-44a569bf0a11, portal: 172.16.0.220,3260]
Aug 17 11:53:06 user nova-compute[73449]: Login to [iface: default, target: iqn.2010-10.org.openstack:bc855d21-60f9-4798-aecf-44a569bf0a11, portal: 172.16.0.220,3260] successful.
Aug 17 11:53:06 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:53:06 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc855d21-60f9-4798-aecf-44a569bf0a11 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:53:06 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk.rescue --force-share --output=json" returned: 0 in 0.216s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:53:06 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:53:06 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc855d21-60f9-4798-aecf-44a569bf0a11 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:53:06 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[84ae5d9c-6fb9-4cfa-9b5f-fc0ad9f58349]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:53:06 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:53:06 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:53:06 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:53:06 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[caae0870-ffe0-4f2a-8132-afda1e8c4bd0]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc855d21-60f9-4798-aecf-44a569bf0a11 (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:53:06 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe (non-flash)
Aug 17 11:53:06 user nova-compute[73449]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 (non-flash)
Aug 17 11:53:06 user nova-compute[73449]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 (non-flash)
Aug 17 11:53:06 user nova-compute[73449]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc855d21-60f9-4798-aecf-44a569bf0a11 (non-flash)
Aug 17 11:53:06 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:53:06 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe (non-flash)
Aug 17 11:53:06 user nova-compute[73449]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 (non-flash)
Aug 17 11:53:06 user nova-compute[73449]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 (non-flash)
Aug 17 11:53:06 user nova-compute[73449]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc855d21-60f9-4798-aecf-44a569bf0a11 (non-flash)
Aug 17 11:53:06 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:53:06 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc855d21-60f9-4798-aecf-44a569bf0a11" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.342s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:53:06 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Connected to 172.16.0.220:3260 {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 11:53:06 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] HCTL ('34', '-', '-', 0) found on session 36 with lun 0 {{(pid=73449) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 11:53:06 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73449) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 11:53:06 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:53:06 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:53:06 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec67cf93-3e88-4ab7-a943-ec6f5182828e]: (4, ('- - 0', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:53:06 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Searching for a device in session 36 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73449) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 11:53:06 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wMEhRvFJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 11:53:06 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:53:06 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:53:06 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:53:06 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=73449) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 11:53:06 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef4274-dfa1-4f7d-a24c-a1686b692f70/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:53:07 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef4274-dfa1-4f7d-a24c-a1686b692f70/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:53:07 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef4274-dfa1-4f7d-a24c-a1686b692f70/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:53:07 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef4274-dfa1-4f7d-a24c-a1686b692f70/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:53:07 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d74c8f6-fb4e-4460-b722-674a8a1e2d25/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:53:07 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:53:07 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d74c8f6-fb4e-4460-b722-674a8a1e2d25/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:53:07 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d74c8f6-fb4e-4460-b722-674a8a1e2d25/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:53:07 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d74c8f6-fb4e-4460-b722-674a8a1e2d25/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:53:07 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.380s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:53:07 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] <== connect_volume: return (1382ms) {'type': 'block', 'scsi_wwn': '23038663663393331', 'path': '/dev/sdc'} {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 11:53:07 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23038663663393331', 'path': '/dev/sdc'} {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 11:53:07 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89440604-1daf-4e7a-a524-2f9c21a9cb96/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:53:07 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T11:48:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2040756698',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2040756698',id=25,image_ref='b7edcc07-4d64-47f5-b9e4-97e581adba97',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-553309548',keypairs=<?>,launch_index=0,launched_at=2023-08-17T11:49:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='fe7b5fee01a042bb90e40b18a84c82c0',ramdisk_id='',reservation_id='r-bo9d1umq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2080997856',owner_user_name='tempest-AttachVolumeShelveTestJSON-2080997856-project-member',shelved_at='2023-08-17T11:51:00.870118',shelved_host='user',shelved_image_id='b7edcc07-4d64-47f5-b9e4-97e581adba97'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T11:52:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='17ee7be9cdb14c5ca211a6b0bb80ccc1',uuid=fea9f81c-a848-4a65-863e-e09dddf65bcf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "5db97a8e-3943-4259-ae41-cec1946c33f8", "address": "fa:16:3e:c2:f3:5a", "network": {"id": "d56bc428-6be6-4aa9-b43c-9d4a0f1dd83b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-791364634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe7b5fee01a042bb90e40b18a84c82c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5db97a8e-39", "ovs_interfaceid": "5db97a8e-3943-4259-ae41-cec1946c33f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73449) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 11:53:07 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Converting VIF {"id": "5db97a8e-3943-4259-ae41-cec1946c33f8", "address": "fa:16:3e:c2:f3:5a", "network": {"id": "d56bc428-6be6-4aa9-b43c-9d4a0f1dd83b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-791364634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe7b5fee01a042bb90e40b18a84c82c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5db97a8e-39", "ovs_interfaceid": "5db97a8e-3943-4259-ae41-cec1946c33f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:53:07 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:f3:5a,bridge_name='br-int',has_traffic_filtering=True,id=5db97a8e-3943-4259-ae41-cec1946c33f8,network=Network(d56bc428-6be6-4aa9-b43c-9d4a0f1dd83b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5db97a8e-39') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:53:07 user nova-compute[73449]: DEBUG nova.objects.instance [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Lazy-loading 'pci_devices' on Instance uuid fea9f81c-a848-4a65-863e-e09dddf65bcf {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:53:07 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] End _get_guest_xml xml=<domain type="kvm">
Aug 17 11:53:07 user nova-compute[73449]:   <uuid>fea9f81c-a848-4a65-863e-e09dddf65bcf</uuid>
Aug 17 11:53:07 user nova-compute[73449]:   <name>instance-00000019</name>
Aug 17 11:53:07 user nova-compute[73449]:   <memory>524288</memory>
Aug 17 11:53:07 user nova-compute[73449]:   <vcpu>1</vcpu>
Aug 17 11:53:07 user nova-compute[73449]:   <metadata>
Aug 17 11:53:07 user nova-compute[73449]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 11:53:07 user nova-compute[73449]:       <nova:package version="0.0.0"/>
Aug 17 11:53:07 user nova-compute[73449]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-2040756698</nova:name>
Aug 17 11:53:07 user nova-compute[73449]:       <nova:creationTime>2023-08-17 11:53:06</nova:creationTime>
Aug 17 11:53:07 user nova-compute[73449]:       <nova:flavor name="m1.tiny">
Aug 17 11:53:07 user nova-compute[73449]:         <nova:memory>512</nova:memory>
Aug 17 11:53:07 user nova-compute[73449]:         <nova:disk>1</nova:disk>
Aug 17 11:53:07 user nova-compute[73449]:         <nova:swap>0</nova:swap>
Aug 17 11:53:07 user nova-compute[73449]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 11:53:07 user nova-compute[73449]:         <nova:vcpus>1</nova:vcpus>
Aug 17 11:53:07 user nova-compute[73449]:       </nova:flavor>
Aug 17 11:53:07 user nova-compute[73449]:       <nova:owner>
Aug 17 11:53:07 user nova-compute[73449]:         <nova:user uuid="17ee7be9cdb14c5ca211a6b0bb80ccc1">tempest-AttachVolumeShelveTestJSON-2080997856-project-member</nova:user>
Aug 17 11:53:07 user nova-compute[73449]:         <nova:project uuid="fe7b5fee01a042bb90e40b18a84c82c0">tempest-AttachVolumeShelveTestJSON-2080997856</nova:project>
Aug 17 11:53:07 user nova-compute[73449]:       </nova:owner>
Aug 17 11:53:07 user nova-compute[73449]:       <nova:root type="image" uuid="b7edcc07-4d64-47f5-b9e4-97e581adba97"/>
Aug 17 11:53:07 user nova-compute[73449]:       <nova:ports>
Aug 17 11:53:07 user nova-compute[73449]:         <nova:port uuid="5db97a8e-3943-4259-ae41-cec1946c33f8">
Aug 17 11:53:07 user nova-compute[73449]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 17 11:53:07 user nova-compute[73449]:         </nova:port>
Aug 17 11:53:07 user nova-compute[73449]:       </nova:ports>
Aug 17 11:53:07 user nova-compute[73449]:     </nova:instance>
Aug 17 11:53:07 user nova-compute[73449]:   </metadata>
Aug 17 11:53:07 user nova-compute[73449]:   <sysinfo type="smbios">
Aug 17 11:53:07 user nova-compute[73449]:     <system>
Aug 17 11:53:07 user nova-compute[73449]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 11:53:07 user nova-compute[73449]:       <entry name="product">OpenStack Nova</entry>
Aug 17 11:53:07 user nova-compute[73449]:       <entry name="version">0.0.0</entry>
Aug 17 11:53:07 user nova-compute[73449]:       <entry name="serial">fea9f81c-a848-4a65-863e-e09dddf65bcf</entry>
Aug 17 11:53:07 user nova-compute[73449]:       <entry name="uuid">fea9f81c-a848-4a65-863e-e09dddf65bcf</entry>
Aug 17 11:53:07 user nova-compute[73449]:       <entry name="family">Virtual Machine</entry>
Aug 17 11:53:07 user nova-compute[73449]:     </system>
Aug 17 11:53:07 user nova-compute[73449]:   </sysinfo>
Aug 17 11:53:07 user nova-compute[73449]:   <os>
Aug 17 11:53:07 user nova-compute[73449]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 11:53:07 user nova-compute[73449]:     <boot dev="hd"/>
Aug 17 11:53:07 user nova-compute[73449]:     <smbios mode="sysinfo"/>
Aug 17 11:53:07 user nova-compute[73449]:   </os>
Aug 17 11:53:07 user nova-compute[73449]:   <features>
Aug 17 11:53:07 user nova-compute[73449]:     <acpi/>
Aug 17 11:53:07 user nova-compute[73449]:     <apic/>
Aug 17 11:53:07 user nova-compute[73449]:     <vmcoreinfo/>
Aug 17 11:53:07 user nova-compute[73449]:   </features>
Aug 17 11:53:07 user nova-compute[73449]:   <clock offset="utc">
Aug 17 11:53:07 user nova-compute[73449]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 11:53:07 user nova-compute[73449]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 11:53:07 user nova-compute[73449]:     <timer name="hpet" present="no"/>
Aug 17 11:53:07 user nova-compute[73449]:   </clock>
Aug 17 11:53:07 user nova-compute[73449]:   <cpu mode="custom" match="exact">
Aug 17 11:53:07 user nova-compute[73449]:     <model>Nehalem</model>
Aug 17 11:53:07 user nova-compute[73449]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 11:53:07 user nova-compute[73449]:   </cpu>
Aug 17 11:53:07 user nova-compute[73449]:   <devices>
Aug 17 11:53:07 user nova-compute[73449]:     <disk type="file" device="disk">
Aug 17 11:53:07 user nova-compute[73449]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 11:53:07 user nova-compute[73449]:       <source file="/opt/stack/data/nova/instances/fea9f81c-a848-4a65-863e-e09dddf65bcf/disk"/>
Aug 17 11:53:07 user nova-compute[73449]:       <target dev="vda" bus="virtio"/>
Aug 17 11:53:07 user nova-compute[73449]:     </disk>
Aug 17 11:53:07 user nova-compute[73449]:     <disk type="block" device="disk">
Aug 17 11:53:07 user nova-compute[73449]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 11:53:07 user nova-compute[73449]:       <source dev="/dev/sdc"/>
Aug 17 11:53:07 user nova-compute[73449]:       <target dev="vdc" bus="virtio"/>
Aug 17 11:53:07 user nova-compute[73449]:       <serial>bc855d21-60f9-4798-aecf-44a569bf0a11</serial>
Aug 17 11:53:07 user nova-compute[73449]:     </disk>
Aug 17 11:53:07 user nova-compute[73449]:     <interface type="ethernet">
Aug 17 11:53:07 user nova-compute[73449]:       <mac address="fa:16:3e:c2:f3:5a"/>
Aug 17 11:53:07 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 11:53:07 user nova-compute[73449]:       <mtu size="1442"/>
Aug 17 11:53:07 user nova-compute[73449]:       <target dev="tap5db97a8e-39"/>
Aug 17 11:53:07 user nova-compute[73449]:     </interface>
Aug 17 11:53:07 user nova-compute[73449]:     <serial type="pty">
Aug 17 11:53:07 user nova-compute[73449]:       <log file="/opt/stack/data/nova/instances/fea9f81c-a848-4a65-863e-e09dddf65bcf/console.log" append="off"/>
Aug 17 11:53:07 user nova-compute[73449]:     </serial>
Aug 17 11:53:07 user nova-compute[73449]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 11:53:07 user nova-compute[73449]:     <video>
Aug 17 11:53:07 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 11:53:07 user nova-compute[73449]:     </video>
Aug 17 11:53:07 user nova-compute[73449]:     <rng model="virtio">
Aug 17 11:53:07 user nova-compute[73449]:       <backend model="random">/dev/urandom</backend>
Aug 17 11:53:07 user nova-compute[73449]:     </rng>
Aug 17 11:53:07 user nova-compute[73449]:     <controller type="usb" index="0" model="none"/>
Aug 17 11:53:07 user nova-compute[73449]:     <memballoon model="virtio">
Aug 17 11:53:07 user nova-compute[73449]:       <stats period="10"/>
Aug 17 11:53:07 user nova-compute[73449]:     </memballoon>
Aug 17 11:53:07 user nova-compute[73449]:   </devices>
Aug 17 11:53:07 user nova-compute[73449]: </domain>
Aug 17 11:53:07 user nova-compute[73449]:  {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 11:53:07 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T11:48:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2040756698',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2040756698',id=25,image_ref='b7edcc07-4d64-47f5-b9e4-97e581adba97',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-553309548',keypairs=<?>,launch_index=0,launched_at=2023-08-17T11:49:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='fe7b5fee01a042bb90e40b18a84c82c0',ramdisk_id='',reservation_id='r-bo9d1umq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2080997856',owner_user_name='tempest-AttachVolumeShelveTestJSON-2080997856-project-member',shelved_at='2023-08-17T11:51:00.870118',shelved_host='user',shelved_image_id='b7edcc07-4d64-47f5-b9e4-97e581adba97'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T11:52:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='17ee7be9cdb14c5ca211a6b0bb80ccc1',uuid=fea9f81c-a848-4a65-863e-e09dddf65bcf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "5db97a8e-3943-4259-ae41-cec1946c33f8", "address": "fa:16:3e:c2:f3:5a", "network": {"id": "d56bc428-6be6-4aa9-b43c-9d4a0f1dd83b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-791364634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe7b5fee01a042bb90e40b18a84c82c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5db97a8e-39", "ovs_interfaceid": "5db97a8e-3943-4259-ae41-cec1946c33f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 11:53:07 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Converting VIF {"id": "5db97a8e-3943-4259-ae41-cec1946c33f8", "address": "fa:16:3e:c2:f3:5a", "network": {"id": "d56bc428-6be6-4aa9-b43c-9d4a0f1dd83b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-791364634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe7b5fee01a042bb90e40b18a84c82c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5db97a8e-39", "ovs_interfaceid": "5db97a8e-3943-4259-ae41-cec1946c33f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:53:07 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:f3:5a,bridge_name='br-int',has_traffic_filtering=True,id=5db97a8e-3943-4259-ae41-cec1946c33f8,network=Network(d56bc428-6be6-4aa9-b43c-9d4a0f1dd83b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5db97a8e-39') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:53:07 user nova-compute[73449]: DEBUG os_vif [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:f3:5a,bridge_name='br-int',has_traffic_filtering=True,id=5db97a8e-3943-4259-ae41-cec1946c33f8,network=Network(d56bc428-6be6-4aa9-b43c-9d4a0f1dd83b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5db97a8e-39') {{(pid=73449) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 11:53:07 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:53:07 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:53:07 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 11:53:07 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:53:07 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5db97a8e-39, may_exist=True, interface_attrs={}) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:53:07 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5db97a8e-39, col_values=(('external_ids', {'iface-id': '5db97a8e-3943-4259-ae41-cec1946c33f8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c2:f3:5a', 'vm-uuid': 'fea9f81c-a848-4a65-863e-e09dddf65bcf'}),), if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:53:07 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:53:07 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:53:07 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:53:07 user nova-compute[73449]: INFO os_vif [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:f3:5a,bridge_name='br-int',has_traffic_filtering=True,id=5db97a8e-3943-4259-ae41-cec1946c33f8,network=Network(d56bc428-6be6-4aa9-b43c-9d4a0f1dd83b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5db97a8e-39')
Aug 17 11:53:07 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89440604-1daf-4e7a-a524-2f9c21a9cb96/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:53:07 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89440604-1daf-4e7a-a524-2f9c21a9cb96/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:53:07 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] No BDM found with device name vda, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 11:53:07 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 11:53:07 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] No VIF found with MAC fa:16:3e:c2:f3:5a, not building metadata {{(pid=73449) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 11:53:07 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89440604-1daf-4e7a-a524-2f9c21a9cb96/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:53:07 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d468854-6182-49c8-acb7-0641df2d5219/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:53:08 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:53:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d468854-6182-49c8-acb7-0641df2d5219/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:53:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d468854-6182-49c8-acb7-0641df2d5219/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:53:08 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:53:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d468854-6182-49c8-acb7-0641df2d5219/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:53:08 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73449) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 11:53:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e689bc9-6625-46b7-90d0-52c50f9b73e6/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:53:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e689bc9-6625-46b7-90d0-52c50f9b73e6/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:53:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e689bc9-6625-46b7-90d0-52c50f9b73e6/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:53:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e689bc9-6625-46b7-90d0-52c50f9b73e6/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:53:11 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:53:11 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692273191.5262194, fea9f81c-a848-4a65-863e-e09dddf65bcf => Resumed> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:53:11 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] VM Resumed (Lifecycle Event)
Aug 17 11:53:11 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Instance event wait completed in 0 seconds for  {{(pid=73449) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 11:53:11 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Guest created on hypervisor {{(pid=73449) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 11:53:11 user nova-compute[73449]: DEBUG nova.compute.manager [req-586e66dc-f3ae-4012-a5db-62fe9601a5b8 req-0a46ca51-94c2-4c0a-bfb0-22c1213daf70 service nova] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Received event network-vif-plugged-5db97a8e-3943-4259-ae41-cec1946c33f8 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:53:11 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-586e66dc-f3ae-4012-a5db-62fe9601a5b8 req-0a46ca51-94c2-4c0a-bfb0-22c1213daf70 service nova] Acquiring lock "fea9f81c-a848-4a65-863e-e09dddf65bcf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:53:11 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-586e66dc-f3ae-4012-a5db-62fe9601a5b8 req-0a46ca51-94c2-4c0a-bfb0-22c1213daf70 service nova] Lock "fea9f81c-a848-4a65-863e-e09dddf65bcf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:53:11 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-586e66dc-f3ae-4012-a5db-62fe9601a5b8 req-0a46ca51-94c2-4c0a-bfb0-22c1213daf70 service nova] Lock "fea9f81c-a848-4a65-863e-e09dddf65bcf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:53:11 user nova-compute[73449]: DEBUG nova.compute.manager [req-586e66dc-f3ae-4012-a5db-62fe9601a5b8 req-0a46ca51-94c2-4c0a-bfb0-22c1213daf70 service nova] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] No waiting events found dispatching network-vif-plugged-5db97a8e-3943-4259-ae41-cec1946c33f8 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:53:11 user nova-compute[73449]: WARNING nova.compute.manager [req-586e66dc-f3ae-4012-a5db-62fe9601a5b8 req-0a46ca51-94c2-4c0a-bfb0-22c1213daf70 service nova] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Received unexpected event network-vif-plugged-5db97a8e-3943-4259-ae41-cec1946c33f8 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 17 11:53:11 user nova-compute[73449]: DEBUG nova.compute.manager [req-ccda4e96-63b9-4083-8882-05d88c0a8dce req-6d0b1b32-bbc8-4a78-ad36-001d198a9e9a service nova] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Received event network-vif-plugged-5db97a8e-3943-4259-ae41-cec1946c33f8 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:53:11 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-ccda4e96-63b9-4083-8882-05d88c0a8dce req-6d0b1b32-bbc8-4a78-ad36-001d198a9e9a service nova] Acquiring lock "fea9f81c-a848-4a65-863e-e09dddf65bcf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:53:11 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-ccda4e96-63b9-4083-8882-05d88c0a8dce req-6d0b1b32-bbc8-4a78-ad36-001d198a9e9a service nova] Lock "fea9f81c-a848-4a65-863e-e09dddf65bcf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:53:11 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-ccda4e96-63b9-4083-8882-05d88c0a8dce req-6d0b1b32-bbc8-4a78-ad36-001d198a9e9a service nova] Lock "fea9f81c-a848-4a65-863e-e09dddf65bcf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:53:11 user nova-compute[73449]: DEBUG nova.compute.manager [req-ccda4e96-63b9-4083-8882-05d88c0a8dce req-6d0b1b32-bbc8-4a78-ad36-001d198a9e9a service nova] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] No waiting events found dispatching network-vif-plugged-5db97a8e-3943-4259-ae41-cec1946c33f8 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:53:11 user nova-compute[73449]: WARNING nova.compute.manager [req-ccda4e96-63b9-4083-8882-05d88c0a8dce req-6d0b1b32-bbc8-4a78-ad36-001d198a9e9a service nova] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Received unexpected event network-vif-plugged-5db97a8e-3943-4259-ae41-cec1946c33f8 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 17 11:53:11 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:53:11 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0361fe49-2a70-431c-814e-8fa25b4cae3f tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] [instance: 9e689bc9-6625-46b7-90d0-52c50f9b73e6] Calling os-brick to attach iSCSI Volume {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 11:53:11 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-0361fe49-2a70-431c-814e-8fa25b4cae3f tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:674238ab-cc2c-41a5-a152-8937a50e5526'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cOZitMmv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 11:53:11 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-0361fe49-2a70-431c-814e-8fa25b4cae3f tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 11:53:11 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-0361fe49-2a70-431c-814e-8fa25b4cae3f tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:53:11 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-0361fe49-2a70-431c-814e-8fa25b4cae3f tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:53:11 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-0361fe49-2a70-431c-814e-8fa25b4cae3f tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 11:53:11 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-0361fe49-2a70-431c-814e-8fa25b4cae3f tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:674238ab-cc2c-41a5-a152-8937a50e5526" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:53:11 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-0361fe49-2a70-431c-814e-8fa25b4cae3f tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:674238ab-cc2c-41a5-a152-8937a50e5526" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:53:11 user nova-compute[73449]: INFO os_brick.initiator.connectors.iscsi [None req-0361fe49-2a70-431c-814e-8fa25b4cae3f tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 11:53:11 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:674238ab-cc2c-41a5-a152-8937a50e5526 -p 172.16.0.220:3260 {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:53:11 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 11:53:11 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:53:11 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:53:11 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Hypervisor/Node resource view: name=user free_ram=7066MB free_disk=25.045578002929688GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73449) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 11:53:11 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:53:11 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:53:11 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Instance spawned successfully.
Aug 17 11:53:11 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:674238ab-cc2c-41a5-a152-8937a50e5526 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:53:11 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4c7f822-c9c6-418f-9fa6-c52d577d866b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:53:11 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-0361fe49-2a70-431c-814e-8fa25b4cae3f tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 11:53:11 user nova-compute[73449]:  {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:53:11 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:674238ab-cc2c-41a5-a152-8937a50e5526 -p 172.16.0.220:3260 --interface default --op new {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:53:11 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 11:53:11 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692273191.5266783, fea9f81c-a848-4a65-863e-e09dddf65bcf => Started> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:53:11 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] VM Started (Lifecycle Event)
Aug 17 11:53:11 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:674238ab-cc2c-41a5-a152-8937a50e5526 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:53:11 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[08e85413-4b27-4b7b-b972-de42ff8d3053]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:674238ab-cc2c-41a5-a152-8937a50e5526] added\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:53:11 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-0361fe49-2a70-431c-814e-8fa25b4cae3f tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:674238ab-cc2c-41a5-a152-8937a50e5526] added
Aug 17 11:53:11 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:53:11 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:53:11 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:674238ab-cc2c-41a5-a152-8937a50e5526 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:53:11 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 11:53:11 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:674238ab-cc2c-41a5-a152-8937a50e5526 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:53:11 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e4aea1c-f6ae-4362-89ef-fbb3539366bc]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:53:11 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-0361fe49-2a70-431c-814e-8fa25b4cae3f tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:53:11 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:674238ab-cc2c-41a5-a152-8937a50e5526 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:53:11 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 11:53:11 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:674238ab-cc2c-41a5-a152-8937a50e5526 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:53:11 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[c41e8ff4-d93f-48dc-9a81-6844bef27ecd]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:53:11 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-0361fe49-2a70-431c-814e-8fa25b4cae3f tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:53:11 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:674238ab-cc2c-41a5-a152-8937a50e5526 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cOZitMmv {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:53:11 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:674238ab-cc2c-41a5-a152-8937a50e5526 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cOZitMmv" returned: 0 in 0.034s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:53:11 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[b30768ac-3a02-49b4-9e0d-2068d337f760]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:53:11 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-0361fe49-2a70-431c-814e-8fa25b4cae3f tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cOZitMmv'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:53:11 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:674238ab-cc2c-41a5-a152-8937a50e5526 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:53:11 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 4a9e8ad2-19db-4975-87e4-2efce603a7d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:53:11 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 3d74c8f6-fb4e-4460-b722-674a8a1e2d25 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:53:11 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance ae75d334-431a-4008-8b3d-f2a727d92417 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:53:11 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:53:11 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance dd4ec7bd-002e-4a71-9314-96c21427af27 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:53:11 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 3d468854-6182-49c8-acb7-0641df2d5219 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:53:11 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 89440604-1daf-4e7a-a524-2f9c21a9cb96 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:53:11 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 9e689bc9-6625-46b7-90d0-52c50f9b73e6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:53:11 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 01ef4274-dfa1-4f7d-a24c-a1686b692f70 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:53:11 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance b32df06e-0b5a-4384-946b-64d64aeeb07e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:53:11 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Instance with task_state "spawning" is not being actively managed by this compute host but has allocations referencing this compute node (20986bee-3f54-4b89-bec1-f8387ef700c4): {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. Skipping heal of allocations during the task state transition. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1777}}
Aug 17 11:53:11 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73449) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 11:53:11 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73449) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 11:53:11 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:674238ab-cc2c-41a5-a152-8937a50e5526 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:53:12 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3e6e024-05c9-44c7-bdc5-d77275ef8a96]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:53:12 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-0361fe49-2a70-431c-814e-8fa25b4cae3f tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:53:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:53:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:53:12 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[6027fd42-57d9-445b-9df1-589a8b608c54]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc855d21-60f9-4798-aecf-44a569bf0a11 (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:53:12 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-0361fe49-2a70-431c-814e-8fa25b4cae3f tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe (non-flash)
Aug 17 11:53:12 user nova-compute[73449]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 (non-flash)
Aug 17 11:53:12 user nova-compute[73449]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 (non-flash)
Aug 17 11:53:12 user nova-compute[73449]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc855d21-60f9-4798-aecf-44a569bf0a11 (non-flash)
Aug 17 11:53:12 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:53:12 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-0361fe49-2a70-431c-814e-8fa25b4cae3f tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe (non-flash)
Aug 17 11:53:12 user nova-compute[73449]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 (non-flash)
Aug 17 11:53:12 user nova-compute[73449]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 (non-flash)
Aug 17 11:53:12 user nova-compute[73449]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc855d21-60f9-4798-aecf-44a569bf0a11 (non-flash)
Aug 17 11:53:12 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:53:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:674238ab-cc2c-41a5-a152-8937a50e5526 -p 172.16.0.220:3260 --login {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:53:12 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:53:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:674238ab-cc2c-41a5-a152-8937a50e5526 -p 172.16.0.220:3260 --login" returned: 0 in 0.092s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:53:12 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[24ade3a1-e57b-43aa-a1c2-d23cd6988a32]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:674238ab-cc2c-41a5-a152-8937a50e5526, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:674238ab-cc2c-41a5-a152-8937a50e5526, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:53:12 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-0361fe49-2a70-431c-814e-8fa25b4cae3f tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:674238ab-cc2c-41a5-a152-8937a50e5526, portal: 172.16.0.220,3260]
Aug 17 11:53:12 user nova-compute[73449]: Login to [iface: default, target: iqn.2010-10.org.openstack:674238ab-cc2c-41a5-a152-8937a50e5526, portal: 172.16.0.220,3260] successful.
Aug 17 11:53:12 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:53:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:674238ab-cc2c-41a5-a152-8937a50e5526 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:53:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:674238ab-cc2c-41a5-a152-8937a50e5526 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:53:12 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[d59919bb-4ec4-48a2-bda3-bdb5597812ab]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:53:12 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-0361fe49-2a70-431c-814e-8fa25b4cae3f tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:53:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:53:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:53:12 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[955a5507-b113-42d0-aa11-b6d5f02338ab]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc855d21-60f9-4798-aecf-44a569bf0a11 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674238ab-cc2c-41a5-a152-8937a50e5526 (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:53:12 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-0361fe49-2a70-431c-814e-8fa25b4cae3f tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe (non-flash)
Aug 17 11:53:12 user nova-compute[73449]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 (non-flash)
Aug 17 11:53:12 user nova-compute[73449]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 (non-flash)
Aug 17 11:53:12 user nova-compute[73449]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc855d21-60f9-4798-aecf-44a569bf0a11 (non-flash)
Aug 17 11:53:12 user nova-compute[73449]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674238ab-cc2c-41a5-a152-8937a50e5526 (non-flash)
Aug 17 11:53:12 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:53:12 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-0361fe49-2a70-431c-814e-8fa25b4cae3f tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe (non-flash)
Aug 17 11:53:12 user nova-compute[73449]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 (non-flash)
Aug 17 11:53:12 user nova-compute[73449]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 (non-flash)
Aug 17 11:53:12 user nova-compute[73449]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc855d21-60f9-4798-aecf-44a569bf0a11 (non-flash)
Aug 17 11:53:12 user nova-compute[73449]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674238ab-cc2c-41a5-a152-8937a50e5526 (non-flash)
Aug 17 11:53:12 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:53:12 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-0361fe49-2a70-431c-814e-8fa25b4cae3f tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:674238ab-cc2c-41a5-a152-8937a50e5526" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.444s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:53:12 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-0361fe49-2a70-431c-814e-8fa25b4cae3f tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Connected to 172.16.0.220:3260 {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 11:53:12 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-0361fe49-2a70-431c-814e-8fa25b4cae3f tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] HCTL ('35', '-', '-', 0) found on session 37 with lun 0 {{(pid=73449) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 11:53:12 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-0361fe49-2a70-431c-814e-8fa25b4cae3f tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73449) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 11:53:12 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6f244724-10d7-457b-bd6c-6391c4041642 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Lock "fea9f81c-a848-4a65-863e-e09dddf65bcf" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 25.366s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:53:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:53:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:53:12 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[f96d029d-57c3-44e3-9a14-feb661e4963c]: (4, ('- - 0', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:53:12 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-0361fe49-2a70-431c-814e-8fa25b4cae3f tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Searching for a device in session 37 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73449) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 11:53:12 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-0361fe49-2a70-431c-814e-8fa25b4cae3f tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cOZitMmv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 11:53:12 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 11:53:12 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 11:53:12 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Compute_service record updated for user:user {{(pid=73449) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 11:53:12 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.726s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:53:12 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:53:13 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-0361fe49-2a70-431c-814e-8fa25b4cae3f tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.504s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:53:13 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-0361fe49-2a70-431c-814e-8fa25b4cae3f tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] <== connect_volume: return (1506ms) {'type': 'block', 'scsi_wwn': '26631373637326363', 'path': '/dev/sdd'} {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 11:53:13 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0361fe49-2a70-431c-814e-8fa25b4cae3f tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] [instance: 9e689bc9-6625-46b7-90d0-52c50f9b73e6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26631373637326363', 'path': '/dev/sdd'} {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 11:53:13 user nova-compute[73449]: DEBUG nova.objects.instance [None req-0361fe49-2a70-431c-814e-8fa25b4cae3f tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Lazy-loading 'flavor' on Instance uuid 9e689bc9-6625-46b7-90d0-52c50f9b73e6 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:53:13 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:53:13 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-0361fe49-2a70-431c-814e-8fa25b4cae3f tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 11:53:13 user nova-compute[73449]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 11:53:13 user nova-compute[73449]:   <source dev="/dev/sdd"/>
Aug 17 11:53:13 user nova-compute[73449]:   <target dev="vdb" bus="virtio"/>
Aug 17 11:53:13 user nova-compute[73449]:   <serial>674238ab-cc2c-41a5-a152-8937a50e5526</serial>
Aug 17 11:53:13 user nova-compute[73449]: </disk>
Aug 17 11:53:13 user nova-compute[73449]:  {{(pid=73449) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 11:53:13 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-0361fe49-2a70-431c-814e-8fa25b4cae3f tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] No BDM found with device name vda, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 11:53:13 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-0361fe49-2a70-431c-814e-8fa25b4cae3f tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 11:53:13 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-0361fe49-2a70-431c-814e-8fa25b4cae3f tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] No VIF found with MAC fa:16:3e:08:89:a4, not building metadata {{(pid=73449) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 11:53:13 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-0361fe49-2a70-431c-814e-8fa25b4cae3f tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Lock "9e689bc9-6625-46b7-90d0-52c50f9b73e6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.556s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:53:15 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:53:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:53:19 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-19653391-bbb8-4bcc-994f-474755541422 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Acquiring lock "dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:53:19 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-19653391-bbb8-4bcc-994f-474755541422 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Lock "dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:53:19 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-19653391-bbb8-4bcc-994f-474755541422 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Acquiring lock "dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:53:19 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-19653391-bbb8-4bcc-994f-474755541422 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Lock "dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:53:19 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-19653391-bbb8-4bcc-994f-474755541422 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Lock "dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:53:19 user nova-compute[73449]: INFO nova.compute.manager [None req-19653391-bbb8-4bcc-994f-474755541422 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9] Terminating instance
Aug 17 11:53:19 user nova-compute[73449]: DEBUG nova.compute.manager [None req-19653391-bbb8-4bcc-994f-474755541422 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9] Start destroying the instance on the hypervisor. {{(pid=73449) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 11:53:19 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:53:19 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:53:19 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:53:19 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:53:20 user nova-compute[73449]: DEBUG nova.compute.manager [req-a2829ce1-9109-4bf7-bd99-061118996770 req-fe3f7502-d6be-4e55-9325-703f209cb39f service nova] [instance: dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9] Received event network-vif-unplugged-3fce3b24-0ebe-4f5d-b673-767f2b24a77a {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:53:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-a2829ce1-9109-4bf7-bd99-061118996770 req-fe3f7502-d6be-4e55-9325-703f209cb39f service nova] Acquiring lock "dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:53:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-a2829ce1-9109-4bf7-bd99-061118996770 req-fe3f7502-d6be-4e55-9325-703f209cb39f service nova] Lock "dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:53:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-a2829ce1-9109-4bf7-bd99-061118996770 req-fe3f7502-d6be-4e55-9325-703f209cb39f service nova] Lock "dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:53:20 user nova-compute[73449]: DEBUG nova.compute.manager [req-a2829ce1-9109-4bf7-bd99-061118996770 req-fe3f7502-d6be-4e55-9325-703f209cb39f service nova] [instance: dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9] No waiting events found dispatching network-vif-unplugged-3fce3b24-0ebe-4f5d-b673-767f2b24a77a {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:53:20 user nova-compute[73449]: DEBUG nova.compute.manager [req-a2829ce1-9109-4bf7-bd99-061118996770 req-fe3f7502-d6be-4e55-9325-703f209cb39f service nova] [instance: dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9] Received event network-vif-unplugged-3fce3b24-0ebe-4f5d-b673-767f2b24a77a for instance with task_state deleting. {{(pid=73449) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 11:53:20 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9] Instance destroyed successfully.
Aug 17 11:53:20 user nova-compute[73449]: DEBUG nova.objects.instance [None req-19653391-bbb8-4bcc-994f-474755541422 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Lazy-loading 'resources' on Instance uuid dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:53:20 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-19653391-bbb8-4bcc-994f-474755541422 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:48:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-538737854',display_name='tempest-TestVolumeBootPattern-volume-backed-server-538737854',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-538737854',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNzPlQhING7v8dV05hF/uDvQ8jCwFn8vDgHmZjZJwzbhTkaBSp9WDyXqzLcQEPGYU/mSNpHkWWc8LM7jrYmhuY5UDUYO/eeN/bi9CJ2rti45LOSQpRPbknHrKjG4K5iDIA==',key_name='tempest-keypair-736533808',keypairs=<?>,launch_index=0,launched_at=2023-08-17T11:48:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4bd46cdaff7a4b40955f7c8a12c55452',ramdisk_id='',reservation_id='r-3e83f7w2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-813872552',owner_user_name='tempest-TestVolumeBootPattern-813872552-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T11:48:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='804ccb0440fb46a4a4c0ae65c3893296',uuid=dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3fce3b24-0ebe-4f5d-b673-767f2b24a77a", "address": "fa:16:3e:18:5e:2c", "network": {"id": "a9e8fcd6-4152-466b-99ad-44b85db05a05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-920564935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bd46cdaff7a4b40955f7c8a12c55452", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fce3b24-0e", "ovs_interfaceid": "3fce3b24-0ebe-4f5d-b673-767f2b24a77a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 11:53:20 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-19653391-bbb8-4bcc-994f-474755541422 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Converting VIF {"id": "3fce3b24-0ebe-4f5d-b673-767f2b24a77a", "address": "fa:16:3e:18:5e:2c", "network": {"id": "a9e8fcd6-4152-466b-99ad-44b85db05a05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-920564935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bd46cdaff7a4b40955f7c8a12c55452", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fce3b24-0e", "ovs_interfaceid": "3fce3b24-0ebe-4f5d-b673-767f2b24a77a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:53:20 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-19653391-bbb8-4bcc-994f-474755541422 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:18:5e:2c,bridge_name='br-int',has_traffic_filtering=True,id=3fce3b24-0ebe-4f5d-b673-767f2b24a77a,network=Network(a9e8fcd6-4152-466b-99ad-44b85db05a05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fce3b24-0e') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:53:20 user nova-compute[73449]: DEBUG os_vif [None req-19653391-bbb8-4bcc-994f-474755541422 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:18:5e:2c,bridge_name='br-int',has_traffic_filtering=True,id=3fce3b24-0ebe-4f5d-b673-767f2b24a77a,network=Network(a9e8fcd6-4152-466b-99ad-44b85db05a05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fce3b24-0e') {{(pid=73449) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 11:53:20 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:53:20 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3fce3b24-0e, bridge=br-int, if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:53:20 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:53:20 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:53:20 user nova-compute[73449]: INFO os_vif [None req-19653391-bbb8-4bcc-994f-474755541422 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:18:5e:2c,bridge_name='br-int',has_traffic_filtering=True,id=3fce3b24-0ebe-4f5d-b673-767f2b24a77a,network=Network(a9e8fcd6-4152-466b-99ad-44b85db05a05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fce3b24-0e')
Aug 17 11:53:20 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19653391-bbb8-4bcc-994f-474755541422 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9] calling os-brick to detach iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 11:53:20 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-19653391-bbb8-4bcc-994f-474755541422 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, {'target_iqns': ['iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vwJdqhIz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 11:53:20 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-19653391-bbb8-4bcc-994f-474755541422 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 11:53:20 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-19653391-bbb8-4bcc-994f-474755541422 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:53:20 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-19653391-bbb8-4bcc-994f-474755541422 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:53:20 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-19653391-bbb8-4bcc-994f-474755541422 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe', 0)] {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 11:53:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:53:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.066s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:53:20 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9549be3-c08d-4898-b5ab-2a48b1f133b8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:674238ab-cc2c-41a5-a152-8937a50e5526\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc855d21-60f9-4798-aecf-44a569bf0a11\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:53:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:53:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:53:20 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[92bbdb03-bc7f-44c2-8068-ad6883dd57e3]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc855d21-60f9-4798-aecf-44a569bf0a11 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674238ab-cc2c-41a5-a152-8937a50e5526 (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:53:20 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-19653391-bbb8-4bcc-994f-474755541422 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe (non-flash)
Aug 17 11:53:20 user nova-compute[73449]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 (non-flash)
Aug 17 11:53:20 user nova-compute[73449]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 (non-flash)
Aug 17 11:53:20 user nova-compute[73449]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc855d21-60f9-4798-aecf-44a569bf0a11 (non-flash)
Aug 17 11:53:20 user nova-compute[73449]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674238ab-cc2c-41a5-a152-8937a50e5526 (non-flash)
Aug 17 11:53:20 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:53:20 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-19653391-bbb8-4bcc-994f-474755541422 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe (non-flash)
Aug 17 11:53:20 user nova-compute[73449]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 (non-flash)
Aug 17 11:53:20 user nova-compute[73449]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 (non-flash)
Aug 17 11:53:20 user nova-compute[73449]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc855d21-60f9-4798-aecf-44a569bf0a11 (non-flash)
Aug 17 11:53:20 user nova-compute[73449]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674238ab-cc2c-41a5-a152-8937a50e5526 (non-flash)
Aug 17 11:53:20 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:53:20 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-19653391-bbb8-4bcc-994f-474755541422 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe7782d8430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe'): ({'sdf'}, set())}) {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 11:53:20 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-19653391-bbb8-4bcc-994f-474755541422 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Removing single pathed devices sdf {{(pid=73449) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 11:53:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:53:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.038s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:53:20 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[c55717d3-7cb8-4f2f-8c1f-9712ffaf963a]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:53:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:53:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:53:20 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[c38cfbaa-bd0b-4a29-b0ca-d9d026bfbf8b]: (4, ('ok\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:53:20 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-19653391-bbb8-4bcc-994f-474755541422 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Flushing IO for device /dev/sdf {{(pid=73449) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 11:53:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:53:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.021s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:53:20 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[89692c22-d130-4687-9301-5efe439a36fd]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:53:20 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-19653391-bbb8-4bcc-994f-474755541422 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73449) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 11:53:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:53:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.046s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:53:20 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[94bea991-7800-4119-942f-29c0a709677a]: (4, ('1', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:53:20 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-19653391-bbb8-4bcc-994f-474755541422 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73449) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 11:53:20 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-19653391-bbb8-4bcc-994f-474755541422 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] SCSI volumes sdf have been removed. {{(pid=73449) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 11:53:20 user nova-compute[73449]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_5f9fb7fb', '/dev/disk/by-id/scsi-26535386139313362', '/dev/disk/by-id/scsi-1SCST_BIO5f9fb7fb-e58a913b9e798f8f') {{(pid=84309) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 17 11:53:20 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bf423e0-f28d-4572-b02c-11cb28168b48]: (4, None) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:53:20 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-19653391-bbb8-4bcc-994f-474755541422 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe')] {{(pid=73449) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 11:53:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:53:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:53:20 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6adfda8-1c5b-496c-941f-92087432f505]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:53:20 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-19653391-bbb8-4bcc-994f-474755541422 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:53:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe -p 172.16.0.220:3260 --logout {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:53:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:53:20 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb6af02a-5630-4def-96e2-63bdeb4394d4]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:53:20 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-19653391-bbb8-4bcc-994f-474755541422 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe, portal: 172.16.0.220,3260]
Aug 17 11:53:20 user nova-compute[73449]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe, portal: 172.16.0.220,3260] successful.
Aug 17 11:53:20 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:53:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe -p 172.16.0.220:3260 --op delete {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:53:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e27b229c-be74-4782-b328-51efbb6863fe -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:53:20 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[05f8a059-638e-4806-a23e-a3acaa4b3314]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:53:20 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-19653391-bbb8-4bcc-994f-474755541422 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:53:20 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-19653391-bbb8-4bcc-994f-474755541422 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.399s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:53:20 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-19653391-bbb8-4bcc-994f-474755541422 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] <== disconnect_volume: return (402ms) None {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 11:53:20 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19653391-bbb8-4bcc-994f-474755541422 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9] Disconnected iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 11:53:20 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-19653391-bbb8-4bcc-994f-474755541422 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9] Deleting instance files /opt/stack/data/nova/instances/dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9_del
Aug 17 11:53:20 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-19653391-bbb8-4bcc-994f-474755541422 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9] Deletion of /opt/stack/data/nova/instances/dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9_del complete
Aug 17 11:53:20 user nova-compute[73449]: INFO nova.compute.manager [None req-19653391-bbb8-4bcc-994f-474755541422 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9] Took 1.28 seconds to destroy the instance on the hypervisor.
Aug 17 11:53:20 user nova-compute[73449]: DEBUG oslo.service.loopingcall [None req-19653391-bbb8-4bcc-994f-474755541422 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73449) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 11:53:20 user nova-compute[73449]: DEBUG nova.compute.manager [-] [instance: dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9] Deallocating network for instance {{(pid=73449) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 11:53:20 user nova-compute[73449]: DEBUG nova.network.neutron [-] [instance: dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9] deallocate_for_instance() {{(pid=73449) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 11:53:21 user nova-compute[73449]: DEBUG nova.network.neutron [-] [instance: dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9] Updating instance_info_cache with network_info: [] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:53:21 user nova-compute[73449]: INFO nova.compute.manager [-] [instance: dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9] Took 0.89 seconds to deallocate network for instance.
Aug 17 11:53:22 user nova-compute[73449]: DEBUG nova.compute.manager [req-9243f599-e370-46e8-b515-7460be34cfc3 req-e14b2978-dba3-46f4-8c4e-66c93eb0db40 service nova] [instance: dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9] Received event network-vif-plugged-3fce3b24-0ebe-4f5d-b673-767f2b24a77a {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:53:22 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-9243f599-e370-46e8-b515-7460be34cfc3 req-e14b2978-dba3-46f4-8c4e-66c93eb0db40 service nova] Acquiring lock "dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:53:22 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-9243f599-e370-46e8-b515-7460be34cfc3 req-e14b2978-dba3-46f4-8c4e-66c93eb0db40 service nova] Lock "dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:53:22 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-9243f599-e370-46e8-b515-7460be34cfc3 req-e14b2978-dba3-46f4-8c4e-66c93eb0db40 service nova] Lock "dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:53:22 user nova-compute[73449]: DEBUG nova.compute.manager [req-9243f599-e370-46e8-b515-7460be34cfc3 req-e14b2978-dba3-46f4-8c4e-66c93eb0db40 service nova] [instance: dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9] No waiting events found dispatching network-vif-plugged-3fce3b24-0ebe-4f5d-b673-767f2b24a77a {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:53:22 user nova-compute[73449]: WARNING nova.compute.manager [req-9243f599-e370-46e8-b515-7460be34cfc3 req-e14b2978-dba3-46f4-8c4e-66c93eb0db40 service nova] [instance: dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9] Received unexpected event network-vif-plugged-3fce3b24-0ebe-4f5d-b673-767f2b24a77a for instance with vm_state active and task_state deleting.
Aug 17 11:53:22 user nova-compute[73449]: DEBUG nova.compute.manager [req-9243f599-e370-46e8-b515-7460be34cfc3 req-e14b2978-dba3-46f4-8c4e-66c93eb0db40 service nova] [instance: dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9] Received event network-vif-deleted-3fce3b24-0ebe-4f5d-b673-767f2b24a77a {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:53:22 user nova-compute[73449]: INFO nova.compute.manager [None req-19653391-bbb8-4bcc-994f-474755541422 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9] Took 0.80 seconds to detach 1 volumes for instance.
Aug 17 11:53:22 user nova-compute[73449]: DEBUG nova.compute.manager [None req-19653391-bbb8-4bcc-994f-474755541422 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9] Deleting volume: e27b229c-be74-4782-b328-51efbb6863fe {{(pid=73449) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 17 11:53:22 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-19653391-bbb8-4bcc-994f-474755541422 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:53:22 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-19653391-bbb8-4bcc-994f-474755541422 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:53:23 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-19653391-bbb8-4bcc-994f-474755541422 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 11:53:23 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-19653391-bbb8-4bcc-994f-474755541422 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 11:53:23 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-19653391-bbb8-4bcc-994f-474755541422 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.433s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:53:23 user nova-compute[73449]: INFO nova.scheduler.client.report [None req-19653391-bbb8-4bcc-994f-474755541422 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Deleted allocations for instance dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9
Aug 17 11:53:23 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-19653391-bbb8-4bcc-994f-474755541422 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Lock "dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.706s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:53:25 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:53:28 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:53:28 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-2f88f0b9-46ae-4245-915e-92dc8b608c53 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Acquiring lock "31f5f3d2-41d8-4a26-9eb2-18b891f94734" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:53:28 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-2f88f0b9-46ae-4245-915e-92dc8b608c53 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Lock "31f5f3d2-41d8-4a26-9eb2-18b891f94734" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:53:28 user nova-compute[73449]: DEBUG nova.compute.manager [None req-2f88f0b9-46ae-4245-915e-92dc8b608c53 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] Starting instance... {{(pid=73449) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 11:53:29 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-2f88f0b9-46ae-4245-915e-92dc8b608c53 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:53:29 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-2f88f0b9-46ae-4245-915e-92dc8b608c53 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:53:29 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-2f88f0b9-46ae-4245-915e-92dc8b608c53 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73449) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 11:53:29 user nova-compute[73449]: INFO nova.compute.claims [None req-2f88f0b9-46ae-4245-915e-92dc8b608c53 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] Claim successful on node user
Aug 17 11:53:29 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-2f88f0b9-46ae-4245-915e-92dc8b608c53 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 11:53:29 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-2f88f0b9-46ae-4245-915e-92dc8b608c53 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 11:53:29 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-2f88f0b9-46ae-4245-915e-92dc8b608c53 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.430s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:53:29 user nova-compute[73449]: DEBUG nova.compute.manager [None req-2f88f0b9-46ae-4245-915e-92dc8b608c53 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] Start building networks asynchronously for instance. {{(pid=73449) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 11:53:29 user nova-compute[73449]: DEBUG nova.compute.manager [None req-2f88f0b9-46ae-4245-915e-92dc8b608c53 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] Allocating IP information in the background. {{(pid=73449) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 11:53:29 user nova-compute[73449]: DEBUG nova.network.neutron [None req-2f88f0b9-46ae-4245-915e-92dc8b608c53 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] allocate_for_instance() {{(pid=73449) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 11:53:29 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-2f88f0b9-46ae-4245-915e-92dc8b608c53 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 11:53:29 user nova-compute[73449]: DEBUG nova.compute.manager [None req-2f88f0b9-46ae-4245-915e-92dc8b608c53 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] Start building block device mappings for instance. {{(pid=73449) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 11:53:29 user nova-compute[73449]: DEBUG nova.policy [None req-2f88f0b9-46ae-4245-915e-92dc8b608c53 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '14eb3826311a4f8f91d8264e87f7b866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec3b0b72e47448ebe99f9fc64119c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73449) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 11:53:29 user nova-compute[73449]: INFO nova.virt.block_device [None req-2f88f0b9-46ae-4245-915e-92dc8b608c53 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] Booting with blank volume at /dev/vda
Aug 17 11:53:30 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:53:30 user nova-compute[73449]: DEBUG nova.network.neutron [None req-2f88f0b9-46ae-4245-915e-92dc8b608c53 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] Successfully created port: ea00b08a-3d80-453b-8c1a-9bdc74ac652f {{(pid=73449) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 11:53:31 user nova-compute[73449]: DEBUG nova.network.neutron [None req-2f88f0b9-46ae-4245-915e-92dc8b608c53 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] Successfully updated port: ea00b08a-3d80-453b-8c1a-9bdc74ac652f {{(pid=73449) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 11:53:31 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-2f88f0b9-46ae-4245-915e-92dc8b608c53 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Acquiring lock "refresh_cache-31f5f3d2-41d8-4a26-9eb2-18b891f94734" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:53:31 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-2f88f0b9-46ae-4245-915e-92dc8b608c53 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Acquired lock "refresh_cache-31f5f3d2-41d8-4a26-9eb2-18b891f94734" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:53:31 user nova-compute[73449]: DEBUG nova.network.neutron [None req-2f88f0b9-46ae-4245-915e-92dc8b608c53 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] Building network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 11:53:31 user nova-compute[73449]: DEBUG nova.compute.manager [req-1fad7d2b-5bf6-43a5-903e-5bc4011fb8b6 req-18d95ad2-852e-47b7-88c7-5806a910d7be service nova] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] Received event network-changed-ea00b08a-3d80-453b-8c1a-9bdc74ac652f {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:53:31 user nova-compute[73449]: DEBUG nova.compute.manager [req-1fad7d2b-5bf6-43a5-903e-5bc4011fb8b6 req-18d95ad2-852e-47b7-88c7-5806a910d7be service nova] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] Refreshing instance network info cache due to event network-changed-ea00b08a-3d80-453b-8c1a-9bdc74ac652f. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 11:53:31 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-1fad7d2b-5bf6-43a5-903e-5bc4011fb8b6 req-18d95ad2-852e-47b7-88c7-5806a910d7be service nova] Acquiring lock "refresh_cache-31f5f3d2-41d8-4a26-9eb2-18b891f94734" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:53:31 user nova-compute[73449]: DEBUG nova.network.neutron [None req-2f88f0b9-46ae-4245-915e-92dc8b608c53 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] Instance cache missing network info. {{(pid=73449) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 11:53:31 user nova-compute[73449]: DEBUG nova.network.neutron [None req-2f88f0b9-46ae-4245-915e-92dc8b608c53 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] Updating instance_info_cache with network_info: [{"id": "ea00b08a-3d80-453b-8c1a-9bdc74ac652f", "address": "fa:16:3e:d2:96:e4", "network": {"id": "9455bb75-f75a-41ff-8f6f-49f55aa738f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-425274599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec3b0b72e47448ebe99f9fc64119c1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea00b08a-3d", "ovs_interfaceid": "ea00b08a-3d80-453b-8c1a-9bdc74ac652f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:53:31 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-2f88f0b9-46ae-4245-915e-92dc8b608c53 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Releasing lock "refresh_cache-31f5f3d2-41d8-4a26-9eb2-18b891f94734" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:53:31 user nova-compute[73449]: DEBUG nova.compute.manager [None req-2f88f0b9-46ae-4245-915e-92dc8b608c53 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] Instance network_info: |[{"id": "ea00b08a-3d80-453b-8c1a-9bdc74ac652f", "address": "fa:16:3e:d2:96:e4", "network": {"id": "9455bb75-f75a-41ff-8f6f-49f55aa738f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-425274599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec3b0b72e47448ebe99f9fc64119c1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea00b08a-3d", "ovs_interfaceid": "ea00b08a-3d80-453b-8c1a-9bdc74ac652f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73449) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 11:53:31 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-1fad7d2b-5bf6-43a5-903e-5bc4011fb8b6 req-18d95ad2-852e-47b7-88c7-5806a910d7be service nova] Acquired lock "refresh_cache-31f5f3d2-41d8-4a26-9eb2-18b891f94734" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:53:31 user nova-compute[73449]: DEBUG nova.network.neutron [req-1fad7d2b-5bf6-43a5-903e-5bc4011fb8b6 req-18d95ad2-852e-47b7-88c7-5806a910d7be service nova] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] Refreshing network info cache for port ea00b08a-3d80-453b-8c1a-9bdc74ac652f {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 11:53:32 user nova-compute[73449]: DEBUG nova.network.neutron [req-1fad7d2b-5bf6-43a5-903e-5bc4011fb8b6 req-18d95ad2-852e-47b7-88c7-5806a910d7be service nova] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] Updated VIF entry in instance network info cache for port ea00b08a-3d80-453b-8c1a-9bdc74ac652f. {{(pid=73449) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 11:53:32 user nova-compute[73449]: DEBUG nova.network.neutron [req-1fad7d2b-5bf6-43a5-903e-5bc4011fb8b6 req-18d95ad2-852e-47b7-88c7-5806a910d7be service nova] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] Updating instance_info_cache with network_info: [{"id": "ea00b08a-3d80-453b-8c1a-9bdc74ac652f", "address": "fa:16:3e:d2:96:e4", "network": {"id": "9455bb75-f75a-41ff-8f6f-49f55aa738f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-425274599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec3b0b72e47448ebe99f9fc64119c1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea00b08a-3d", "ovs_interfaceid": "ea00b08a-3d80-453b-8c1a-9bdc74ac652f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:53:32 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-1fad7d2b-5bf6-43a5-903e-5bc4011fb8b6 req-18d95ad2-852e-47b7-88c7-5806a910d7be service nova] Releasing lock "refresh_cache-31f5f3d2-41d8-4a26-9eb2-18b891f94734" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:53:33 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:53:35 user nova-compute[73449]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692273200.4015138, dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9 => Stopped> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:53:35 user nova-compute[73449]: INFO nova.compute.manager [-] [instance: dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9] VM Stopped (Lifecycle Event)
Aug 17 11:53:35 user nova-compute[73449]: DEBUG nova.compute.manager [None req-4b044efb-4081-4041-b4ee-28871449af9b None None] [instance: dfd45b92-5064-4a2a-adeb-cc5d1d14f5b9] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:53:35 user nova-compute[73449]: DEBUG os_brick.utils [None req-2f88f0b9-46ae-4245-915e-92dc8b608c53 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 11:53:35 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:53:35 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:53:35 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:53:35 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d61d314-61f1-4f23-aac6-7b7f1dca7de8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4d3924302012\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:53:35 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:53:35 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:53:35 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[859319a7-d268-4615-af43-c7dc36208e2d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:53:35 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:53:35 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:53:35 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fe1d3f8-4857-4bd0-b6d8-2a9a7deecf1d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:53:35 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[efc95109-f6f6-4dc8-bb8b-1713cac58c9c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:53:35 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-2f88f0b9-46ae-4245-915e-92dc8b608c53 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Running cmd (subprocess): nvme version {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:53:35 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-2f88f0b9-46ae-4245-915e-92dc8b608c53 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] 'nvme version' failed. Not Retrying. {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 11:53:35 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2f88f0b9-46ae-4245-915e-92dc8b608c53 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] nvme not present on system {{(pid=73449) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 11:53:35 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:53:35 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 11:53:35 user nova-compute[73449]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 11:53:35 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dceb1dd-4f9c-4903-b615-b0826322371f]: (4, '') {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:53:35 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-2f88f0b9-46ae-4245-915e-92dc8b608c53 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73449) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 11:53:35 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-2f88f0b9-46ae-4245-915e-92dc8b608c53 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73449) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 11:53:35 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-2f88f0b9-46ae-4245-915e-92dc8b608c53 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] LIGHTOS: no hostnqn found. {{(pid=73449) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 11:53:35 user nova-compute[73449]: DEBUG os_brick.utils [None req-2f88f0b9-46ae-4245-915e-92dc8b608c53 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4d3924302012', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 11:53:35 user nova-compute[73449]: DEBUG nova.virt.block_device [None req-2f88f0b9-46ae-4245-915e-92dc8b608c53 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] Updating existing volume attachment record: cfcf98ce-4cfe-4029-9aa2-c1157cf8ec33 {{(pid=73449) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 11:53:37 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-c14cf909-87e9-405a-ae97-08fb9e6e79d3 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Acquiring lock "01ef4274-dfa1-4f7d-a24c-a1686b692f70" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:53:37 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-c14cf909-87e9-405a-ae97-08fb9e6e79d3 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Lock "01ef4274-dfa1-4f7d-a24c-a1686b692f70" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:53:37 user nova-compute[73449]: DEBUG nova.objects.instance [None req-c14cf909-87e9-405a-ae97-08fb9e6e79d3 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Lazy-loading 'flavor' on Instance uuid 01ef4274-dfa1-4f7d-a24c-a1686b692f70 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:53:37 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-c14cf909-87e9-405a-ae97-08fb9e6e79d3 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Lock "01ef4274-dfa1-4f7d-a24c-a1686b692f70" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.069s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:53:37 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-c14cf909-87e9-405a-ae97-08fb9e6e79d3 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Acquiring lock "01ef4274-dfa1-4f7d-a24c-a1686b692f70" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:53:37 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-c14cf909-87e9-405a-ae97-08fb9e6e79d3 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Lock "01ef4274-dfa1-4f7d-a24c-a1686b692f70" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:53:37 user nova-compute[73449]: INFO nova.compute.manager [None req-c14cf909-87e9-405a-ae97-08fb9e6e79d3 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] Attaching volume 0a382874-91aa-4ff2-aae4-15db10fe5ff2 to /dev/vdb
Aug 17 11:53:37 user nova-compute[73449]: DEBUG os_brick.utils [None req-c14cf909-87e9-405a-ae97-08fb9e6e79d3 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 11:53:37 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:53:37 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:53:37 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9e9363a-b2f8-4e06-b6d8-baeeb1851f1f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4d3924302012\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:53:37 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:53:37 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:53:37 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[80b2cba6-d8bf-4820-bf0b-6b14fb21f68c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:53:37 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:53:37 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:53:37 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[32597e3b-06bc-4224-896a-e1ce3680d0bf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:53:37 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[92e1ef95-df8f-45c0-a10b-87b55aa58faf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:53:37 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-c14cf909-87e9-405a-ae97-08fb9e6e79d3 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Running cmd (subprocess): nvme version {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:53:37 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-c14cf909-87e9-405a-ae97-08fb9e6e79d3 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] 'nvme version' failed. Not Retrying. {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 11:53:37 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c14cf909-87e9-405a-ae97-08fb9e6e79d3 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] nvme not present on system {{(pid=73449) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 11:53:37 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:53:37 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 11:53:37 user nova-compute[73449]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 11:53:37 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[e24e1458-8448-4777-808b-d2c9348f1a74]: (4, '') {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:53:37 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-c14cf909-87e9-405a-ae97-08fb9e6e79d3 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73449) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 11:53:37 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-c14cf909-87e9-405a-ae97-08fb9e6e79d3 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73449) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 11:53:37 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-c14cf909-87e9-405a-ae97-08fb9e6e79d3 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] LIGHTOS: no hostnqn found. {{(pid=73449) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 11:53:37 user nova-compute[73449]: DEBUG os_brick.utils [None req-c14cf909-87e9-405a-ae97-08fb9e6e79d3 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4d3924302012', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 11:53:37 user nova-compute[73449]: DEBUG nova.virt.block_device [None req-c14cf909-87e9-405a-ae97-08fb9e6e79d3 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] Updating existing volume attachment record: ac7f8e12-0d1e-4422-9c30-40cfdbdd3be5 {{(pid=73449) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 11:53:38 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:53:39 user nova-compute[73449]: DEBUG nova.compute.manager [req-15feb88f-df45-410c-bbb5-1d44f5abf978 req-a867bd67-680a-4273-b024-9aac18d6c743 service nova] [instance: 4a9e8ad2-19db-4975-87e4-2efce603a7d7] Received event network-changed-3c5f8e97-0654-42f0-9575-eab6d833283a {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:53:39 user nova-compute[73449]: DEBUG nova.compute.manager [req-15feb88f-df45-410c-bbb5-1d44f5abf978 req-a867bd67-680a-4273-b024-9aac18d6c743 service nova] [instance: 4a9e8ad2-19db-4975-87e4-2efce603a7d7] Refreshing instance network info cache due to event network-changed-3c5f8e97-0654-42f0-9575-eab6d833283a. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 11:53:39 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-15feb88f-df45-410c-bbb5-1d44f5abf978 req-a867bd67-680a-4273-b024-9aac18d6c743 service nova] Acquiring lock "refresh_cache-4a9e8ad2-19db-4975-87e4-2efce603a7d7" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:53:39 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-15feb88f-df45-410c-bbb5-1d44f5abf978 req-a867bd67-680a-4273-b024-9aac18d6c743 service nova] Acquired lock "refresh_cache-4a9e8ad2-19db-4975-87e4-2efce603a7d7" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:53:39 user nova-compute[73449]: DEBUG nova.network.neutron [req-15feb88f-df45-410c-bbb5-1d44f5abf978 req-a867bd67-680a-4273-b024-9aac18d6c743 service nova] [instance: 4a9e8ad2-19db-4975-87e4-2efce603a7d7] Refreshing network info cache for port 3c5f8e97-0654-42f0-9575-eab6d833283a {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 11:53:40 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:53:40 user nova-compute[73449]: DEBUG nova.network.neutron [req-15feb88f-df45-410c-bbb5-1d44f5abf978 req-a867bd67-680a-4273-b024-9aac18d6c743 service nova] [instance: 4a9e8ad2-19db-4975-87e4-2efce603a7d7] Updated VIF entry in instance network info cache for port 3c5f8e97-0654-42f0-9575-eab6d833283a. {{(pid=73449) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 11:53:40 user nova-compute[73449]: DEBUG nova.network.neutron [req-15feb88f-df45-410c-bbb5-1d44f5abf978 req-a867bd67-680a-4273-b024-9aac18d6c743 service nova] [instance: 4a9e8ad2-19db-4975-87e4-2efce603a7d7] Updating instance_info_cache with network_info: [{"id": "3c5f8e97-0654-42f0-9575-eab6d833283a", "address": "fa:16:3e:c8:b7:51", "network": {"id": "72c50a42-688f-4868-8e19-c40b103a49cd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1792423641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "068c5270255744a18208a0ad9b35f168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c5f8e97-06", "ovs_interfaceid": "3c5f8e97-0654-42f0-9575-eab6d833283a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:53:40 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-15feb88f-df45-410c-bbb5-1d44f5abf978 req-a867bd67-680a-4273-b024-9aac18d6c743 service nova] Releasing lock "refresh_cache-4a9e8ad2-19db-4975-87e4-2efce603a7d7" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:53:41 user nova-compute[73449]: DEBUG nova.compute.manager [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] Stashing vm_state: active {{(pid=73449) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 17 11:53:41 user nova-compute[73449]: DEBUG nova.compute.manager [req-26f6f14e-4aae-4097-aeaa-b039080f9aa4 req-461eb928-a02d-4ad7-9645-13791c58c575 service nova] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] Received event network-changed-4a57c385-a0c8-454a-acbf-d1f783ff3131 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:53:41 user nova-compute[73449]: DEBUG nova.compute.manager [req-26f6f14e-4aae-4097-aeaa-b039080f9aa4 req-461eb928-a02d-4ad7-9645-13791c58c575 service nova] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] Refreshing instance network info cache due to event network-changed-4a57c385-a0c8-454a-acbf-d1f783ff3131. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 11:53:41 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-26f6f14e-4aae-4097-aeaa-b039080f9aa4 req-461eb928-a02d-4ad7-9645-13791c58c575 service nova] Acquiring lock "refresh_cache-b32df06e-0b5a-4384-946b-64d64aeeb07e" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:53:41 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-26f6f14e-4aae-4097-aeaa-b039080f9aa4 req-461eb928-a02d-4ad7-9645-13791c58c575 service nova] Acquired lock "refresh_cache-b32df06e-0b5a-4384-946b-64d64aeeb07e" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:53:41 user nova-compute[73449]: DEBUG nova.network.neutron [req-26f6f14e-4aae-4097-aeaa-b039080f9aa4 req-461eb928-a02d-4ad7-9645-13791c58c575 service nova] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] Refreshing network info cache for port 4a57c385-a0c8-454a-acbf-d1f783ff3131 {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 11:53:41 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:53:41 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:53:41 user nova-compute[73449]: DEBUG nova.objects.instance [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Lazy-loading 'pci_requests' on Instance uuid b32df06e-0b5a-4384-946b-64d64aeeb07e {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:53:41 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73449) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 11:53:41 user nova-compute[73449]: INFO nova.compute.claims [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] Claim successful on node user
Aug 17 11:53:41 user nova-compute[73449]: DEBUG nova.objects.instance [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Lazy-loading 'resources' on Instance uuid b32df06e-0b5a-4384-946b-64d64aeeb07e {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:53:41 user nova-compute[73449]: DEBUG nova.objects.instance [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Lazy-loading 'pci_devices' on Instance uuid b32df06e-0b5a-4384-946b-64d64aeeb07e {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:53:41 user nova-compute[73449]: INFO nova.compute.resource_tracker [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] Updating resource usage from migration 8d1d7b16-326c-47fe-bda2-d62bf19a18af
Aug 17 11:53:42 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 11:53:42 user nova-compute[73449]: DEBUG nova.network.neutron [req-26f6f14e-4aae-4097-aeaa-b039080f9aa4 req-461eb928-a02d-4ad7-9645-13791c58c575 service nova] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] Updated VIF entry in instance network info cache for port 4a57c385-a0c8-454a-acbf-d1f783ff3131. {{(pid=73449) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 11:53:42 user nova-compute[73449]: DEBUG nova.network.neutron [req-26f6f14e-4aae-4097-aeaa-b039080f9aa4 req-461eb928-a02d-4ad7-9645-13791c58c575 service nova] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] Updating instance_info_cache with network_info: [{"id": "4a57c385-a0c8-454a-acbf-d1f783ff3131", "address": "fa:16:3e:be:34:a2", "network": {"id": "72c50a42-688f-4868-8e19-c40b103a49cd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1792423641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "068c5270255744a18208a0ad9b35f168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a57c385-a0", "ovs_interfaceid": "4a57c385-a0c8-454a-acbf-d1f783ff3131", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:53:42 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 11:53:42 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-26f6f14e-4aae-4097-aeaa-b039080f9aa4 req-461eb928-a02d-4ad7-9645-13791c58c575 service nova] Releasing lock "refresh_cache-b32df06e-0b5a-4384-946b-64d64aeeb07e" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:53:42 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.514s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:53:42 user nova-compute[73449]: INFO nova.compute.manager [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] Migrating
Aug 17 11:53:42 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Acquiring lock "refresh_cache-b32df06e-0b5a-4384-946b-64d64aeeb07e" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:53:42 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Acquired lock "refresh_cache-b32df06e-0b5a-4384-946b-64d64aeeb07e" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:53:42 user nova-compute[73449]: DEBUG nova.network.neutron [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] Building network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 11:53:42 user nova-compute[73449]: DEBUG nova.network.neutron [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] Updating instance_info_cache with network_info: [{"id": "4a57c385-a0c8-454a-acbf-d1f783ff3131", "address": "fa:16:3e:be:34:a2", "network": {"id": "72c50a42-688f-4868-8e19-c40b103a49cd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1792423641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "068c5270255744a18208a0ad9b35f168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a57c385-a0", "ovs_interfaceid": "4a57c385-a0c8-454a-acbf-d1f783ff3131", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:53:42 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Releasing lock "refresh_cache-b32df06e-0b5a-4384-946b-64d64aeeb07e" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:53:43 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] Starting migrate_disk_and_power_off {{(pid=73449) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 17 11:53:43 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:53:43 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:53:43 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:53:43 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:53:43 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:53:43 user nova-compute[73449]: DEBUG nova.compute.manager [req-8dfd0b79-3273-4803-8eac-06f19eabb171 req-17a733a6-4094-4a12-a6c1-2917f0e96e72 service nova] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] Received event network-vif-unplugged-4a57c385-a0c8-454a-acbf-d1f783ff3131 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:53:43 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-8dfd0b79-3273-4803-8eac-06f19eabb171 req-17a733a6-4094-4a12-a6c1-2917f0e96e72 service nova] Acquiring lock "b32df06e-0b5a-4384-946b-64d64aeeb07e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:53:43 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-8dfd0b79-3273-4803-8eac-06f19eabb171 req-17a733a6-4094-4a12-a6c1-2917f0e96e72 service nova] Lock "b32df06e-0b5a-4384-946b-64d64aeeb07e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:53:43 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-8dfd0b79-3273-4803-8eac-06f19eabb171 req-17a733a6-4094-4a12-a6c1-2917f0e96e72 service nova] Lock "b32df06e-0b5a-4384-946b-64d64aeeb07e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:53:43 user nova-compute[73449]: DEBUG nova.compute.manager [req-8dfd0b79-3273-4803-8eac-06f19eabb171 req-17a733a6-4094-4a12-a6c1-2917f0e96e72 service nova] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] No waiting events found dispatching network-vif-unplugged-4a57c385-a0c8-454a-acbf-d1f783ff3131 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:53:43 user nova-compute[73449]: WARNING nova.compute.manager [req-8dfd0b79-3273-4803-8eac-06f19eabb171 req-17a733a6-4094-4a12-a6c1-2917f0e96e72 service nova] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] Received unexpected event network-vif-unplugged-4a57c385-a0c8-454a-acbf-d1f783ff3131 for instance with vm_state active and task_state resize_migrating.
Aug 17 11:53:43 user nova-compute[73449]: DEBUG nova.compute.manager [req-8dfd0b79-3273-4803-8eac-06f19eabb171 req-17a733a6-4094-4a12-a6c1-2917f0e96e72 service nova] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] Received event network-vif-plugged-4a57c385-a0c8-454a-acbf-d1f783ff3131 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:53:43 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-8dfd0b79-3273-4803-8eac-06f19eabb171 req-17a733a6-4094-4a12-a6c1-2917f0e96e72 service nova] Acquiring lock "b32df06e-0b5a-4384-946b-64d64aeeb07e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:53:43 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-8dfd0b79-3273-4803-8eac-06f19eabb171 req-17a733a6-4094-4a12-a6c1-2917f0e96e72 service nova] Lock "b32df06e-0b5a-4384-946b-64d64aeeb07e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:53:43 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-8dfd0b79-3273-4803-8eac-06f19eabb171 req-17a733a6-4094-4a12-a6c1-2917f0e96e72 service nova] Lock "b32df06e-0b5a-4384-946b-64d64aeeb07e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:53:43 user nova-compute[73449]: DEBUG nova.compute.manager [req-8dfd0b79-3273-4803-8eac-06f19eabb171 req-17a733a6-4094-4a12-a6c1-2917f0e96e72 service nova] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] No waiting events found dispatching network-vif-plugged-4a57c385-a0c8-454a-acbf-d1f783ff3131 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:53:43 user nova-compute[73449]: WARNING nova.compute.manager [req-8dfd0b79-3273-4803-8eac-06f19eabb171 req-17a733a6-4094-4a12-a6c1-2917f0e96e72 service nova] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] Received unexpected event network-vif-plugged-4a57c385-a0c8-454a-acbf-d1f783ff3131 for instance with vm_state active and task_state resize_migrating.
Aug 17 11:53:43 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] Instance destroyed successfully.
Aug 17 11:53:43 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:51:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1060578378',display_name='tempest-ServerActionsTestOtherA-server-1060578378',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1060578378',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCjLihiqnR89DD+L9AvKMPg4aJ24FTEbroZyaBsKATQAbGhLg8fsSlSGdiYIhidGfsmIAOo7d+B78UcRA6oBB5kBwNop43IFNlD0zoDm7uS+jBpAFARKuZg2/qBioB0EGg==',key_name='tempest-keypair-71173965',keypairs=<?>,launch_index=0,launched_at=2023-08-17T11:52:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='068c5270255744a18208a0ad9b35f168',ramdisk_id='',reservation_id='r-ycvaidk7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-303961666',owner_user_name='tempest-ServerActionsTestOtherA-303961666-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T11:53:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e44f6d8893da4d95a8ebe95180355c04',uuid=b32df06e-0b5a-4384-946b-64d64aeeb07e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4a57c385-a0c8-454a-acbf-d1f783ff3131", "address": "fa:16:3e:be:34:a2", "network": {"id": "72c50a42-688f-4868-8e19-c40b103a49cd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1792423641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1792423641-network", "vif_mac": "fa:16:3e:be:34:a2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "068c5270255744a18208a0ad9b35f168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a57c385-a0", "ovs_interfaceid": "4a57c385-a0c8-454a-acbf-d1f783ff3131", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 11:53:43 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Converting VIF {"id": "4a57c385-a0c8-454a-acbf-d1f783ff3131", "address": "fa:16:3e:be:34:a2", "network": {"id": "72c50a42-688f-4868-8e19-c40b103a49cd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1792423641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1792423641-network", "vif_mac": "fa:16:3e:be:34:a2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "068c5270255744a18208a0ad9b35f168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a57c385-a0", "ovs_interfaceid": "4a57c385-a0c8-454a-acbf-d1f783ff3131", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:53:43 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:be:34:a2,bridge_name='br-int',has_traffic_filtering=True,id=4a57c385-a0c8-454a-acbf-d1f783ff3131,network=Network(72c50a42-688f-4868-8e19-c40b103a49cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a57c385-a0') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:53:43 user nova-compute[73449]: DEBUG os_vif [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:be:34:a2,bridge_name='br-int',has_traffic_filtering=True,id=4a57c385-a0c8-454a-acbf-d1f783ff3131,network=Network(72c50a42-688f-4868-8e19-c40b103a49cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a57c385-a0') {{(pid=73449) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 11:53:43 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:53:43 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4a57c385-a0, bridge=br-int, if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:53:43 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:53:43 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:53:43 user nova-compute[73449]: INFO os_vif [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:be:34:a2,bridge_name='br-int',has_traffic_filtering=True,id=4a57c385-a0c8-454a-acbf-d1f783ff3131,network=Network(72c50a42-688f-4868-8e19-c40b103a49cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a57c385-a0')
Aug 17 11:53:43 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] calling os-brick to detach iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 11:53:43 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, {'target_iqns': ['iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ktosaVNw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 11:53:43 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 11:53:43 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:53:43 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:53:43 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7', 0)] {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 11:53:43 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:53:44 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:53:44 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a185406-1c7c-40c2-85a7-ad7fbbe0c40d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:674238ab-cc2c-41a5-a152-8937a50e5526\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc855d21-60f9-4798-aecf-44a569bf0a11\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:53:44 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:53:44 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:53:44 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[507d2e8c-5a10-4cdb-83d8-010440a5e4d3]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc855d21-60f9-4798-aecf-44a569bf0a11 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674238ab-cc2c-41a5-a152-8937a50e5526 (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:53:44 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 (non-flash)
Aug 17 11:53:44 user nova-compute[73449]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 (non-flash)
Aug 17 11:53:44 user nova-compute[73449]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc855d21-60f9-4798-aecf-44a569bf0a11 (non-flash)
Aug 17 11:53:44 user nova-compute[73449]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674238ab-cc2c-41a5-a152-8937a50e5526 (non-flash)
Aug 17 11:53:44 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:53:44 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 (non-flash)
Aug 17 11:53:44 user nova-compute[73449]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 (non-flash)
Aug 17 11:53:44 user nova-compute[73449]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc855d21-60f9-4798-aecf-44a569bf0a11 (non-flash)
Aug 17 11:53:44 user nova-compute[73449]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674238ab-cc2c-41a5-a152-8937a50e5526 (non-flash)
Aug 17 11:53:44 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:53:44 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe7587e72e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7'): ({'sdg'}, set())}) {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 11:53:44 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Removing single pathed devices sdg {{(pid=73449) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 11:53:44 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:53:44 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:53:44 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cbcfebd-c760-45e7-8f3c-842e3e3a1ad0]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:53:44 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:53:44 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.021s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:53:44 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[363ef9ad-14a9-4a5e-bc0c-ca3e36238694]: (4, ('ok\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:53:44 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Flushing IO for device /dev/sdg {{(pid=73449) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 11:53:44 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:53:44 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:53:44 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[19adbb28-7107-4c9f-87ec-754bf6bada52]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:53:44 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=73449) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 11:53:44 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:53:44 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.047s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:53:44 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[d115c31e-4c27-4898-a4b3-6c57239a7250]: (4, ('1', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:53:44 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=73449) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 11:53:44 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] SCSI volumes sdg have been removed. {{(pid=73449) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 11:53:44 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7')] {{(pid=73449) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 11:53:44 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:53:44 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:53:44 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[809232b5-eb10-42c1-9615-1cddde0f59fb]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:53:44 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:53:44 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 -p 172.16.0.220:3260 --logout {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:53:44 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:53:44 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfe32721-02ac-4487-abcb-4ed03c89c196]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:53:44 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7, portal: 172.16.0.220,3260]
Aug 17 11:53:44 user nova-compute[73449]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7, portal: 172.16.0.220,3260] successful.
Aug 17 11:53:44 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:53:44 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 -p 172.16.0.220:3260 --op delete {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:53:44 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:53:44 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[b667636e-808c-4d1a-834e-b1d81830f010]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:53:44 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:53:44 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.303s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:53:44 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] <== disconnect_volume: return (304ms) None {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 11:53:44 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] Disconnected iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 11:53:44 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] skipping disk /dev/sdg (vda) as it is a volume {{(pid=73449) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 11:53:47 user nova-compute[73449]: DEBUG nova.compute.manager [None req-2f88f0b9-46ae-4245-915e-92dc8b608c53 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] Start spawning the instance on the hypervisor. {{(pid=73449) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 11:53:47 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-2f88f0b9-46ae-4245-915e-92dc8b608c53 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] Creating instance directory {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 11:53:47 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-2f88f0b9-46ae-4245-915e-92dc8b608c53 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] Creating image(s)
Aug 17 11:53:47 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-2f88f0b9-46ae-4245-915e-92dc8b608c53 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] Did not create local disks {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 11:53:47 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-2f88f0b9-46ae-4245-915e-92dc8b608c53 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] Ensure instance console log exists: /opt/stack/data/nova/instances/31f5f3d2-41d8-4a26-9eb2-18b891f94734/console.log {{(pid=73449) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 11:53:47 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-2f88f0b9-46ae-4245-915e-92dc8b608c53 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:53:47 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-2f88f0b9-46ae-4245-915e-92dc8b608c53 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:53:47 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-2f88f0b9-46ae-4245-915e-92dc8b608c53 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:53:47 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-2f88f0b9-46ae-4245-915e-92dc8b608c53 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] Start _get_guest_xml network_info=[{"id": "ea00b08a-3d80-453b-8c1a-9bdc74ac652f", "address": "fa:16:3e:d2:96:e4", "network": {"id": "9455bb75-f75a-41ff-8f6f-49f55aa738f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-425274599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec3b0b72e47448ebe99f9fc64119c1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea00b08a-3d", "ovs_interfaceid": "ea00b08a-3d80-453b-8c1a-9bdc74ac652f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T11:36:11Z,direct_url=<?>,disk_format='qcow2',id=0a2904ae-083d-41c8-83db-343132b36148,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7a77880136a54ef195c82e018e1939db',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T11:36:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'attachment_id': 'cfcf98ce-4cfe-4029-9aa2-c1157cf8ec33', 'boot_index': 0, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pRTkFKvC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '31f5f3d2-41d8-4a26-9eb2-18b891f94734', 'attached_at': '', 'detached_at': '', 'volume_id': 'e6c52a84-6fd6-4981-90d6-4673350908c9', 'serial': 'e6c52a84-6fd6-4981-90d6-4673350908c9'}, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 11:53:47 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-2f88f0b9-46ae-4245-915e-92dc8b608c53 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:53:47 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-2f88f0b9-46ae-4245-915e-92dc8b608c53 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:53:47 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-2f88f0b9-46ae-4245-915e-92dc8b608c53 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 11:53:47 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-2f88f0b9-46ae-4245-915e-92dc8b608c53 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] CPU controller missing on host. {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 11:53:47 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-2f88f0b9-46ae-4245-915e-92dc8b608c53 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 11:53:47 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-2f88f0b9-46ae-4245-915e-92dc8b608c53 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] CPU controller found on host. {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 11:53:47 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-2f88f0b9-46ae-4245-915e-92dc8b608c53 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73449) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 11:53:47 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-2f88f0b9-46ae-4245-915e-92dc8b608c53 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T11:35:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T11:36:11Z,direct_url=<?>,disk_format='qcow2',id=0a2904ae-083d-41c8-83db-343132b36148,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7a77880136a54ef195c82e018e1939db',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T11:36:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 11:53:47 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-2f88f0b9-46ae-4245-915e-92dc8b608c53 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Flavor limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 11:53:47 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-2f88f0b9-46ae-4245-915e-92dc8b608c53 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Image limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 11:53:47 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-2f88f0b9-46ae-4245-915e-92dc8b608c53 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Flavor pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 11:53:47 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-2f88f0b9-46ae-4245-915e-92dc8b608c53 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Image pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 11:53:47 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-2f88f0b9-46ae-4245-915e-92dc8b608c53 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 11:53:47 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-2f88f0b9-46ae-4245-915e-92dc8b608c53 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 11:53:47 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-2f88f0b9-46ae-4245-915e-92dc8b608c53 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 11:53:47 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-2f88f0b9-46ae-4245-915e-92dc8b608c53 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Got 1 possible topologies {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 11:53:47 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-2f88f0b9-46ae-4245-915e-92dc8b608c53 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 11:53:47 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-2f88f0b9-46ae-4245-915e-92dc8b608c53 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 11:53:47 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f88f0b9-46ae-4245-915e-92dc8b608c53 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] Calling os-brick to attach iSCSI Volume {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 11:53:47 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f88f0b9-46ae-4245-915e-92dc8b608c53 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pRTkFKvC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 11:53:47 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-2f88f0b9-46ae-4245-915e-92dc8b608c53 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 11:53:47 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-2f88f0b9-46ae-4245-915e-92dc8b608c53 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:53:47 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-2f88f0b9-46ae-4245-915e-92dc8b608c53 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:53:47 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-2f88f0b9-46ae-4245-915e-92dc8b608c53 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 11:53:47 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-2f88f0b9-46ae-4245-915e-92dc8b608c53 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:53:47 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-2f88f0b9-46ae-4245-915e-92dc8b608c53 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:53:47 user nova-compute[73449]: INFO os_brick.initiator.connectors.iscsi [None req-2f88f0b9-46ae-4245-915e-92dc8b608c53 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 11:53:47 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 -p 172.16.0.220:3260 {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:53:47 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:53:47 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd29a17f-f55d-430b-a70b-08fb3a0e23da]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:53:47 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f88f0b9-46ae-4245-915e-92dc8b608c53 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 11:53:47 user nova-compute[73449]:  {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:53:47 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 -p 172.16.0.220:3260 --interface default --op new {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:53:47 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:53:47 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cd42fbb-6a1e-43d5-8dc5-ac0c7afcefe7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9] added\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:53:47 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f88f0b9-46ae-4245-915e-92dc8b608c53 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9] added
Aug 17 11:53:47 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:53:47 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:53:47 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:53:47 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[0127c282-f3c5-4ccc-8f22-cf47e903e3fe]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:53:47 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f88f0b9-46ae-4245-915e-92dc8b608c53 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:53:47 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:53:47 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:53:47 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9b46a2b-ec1d-4909-a0af-49c1944ff5ba]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:53:47 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f88f0b9-46ae-4245-915e-92dc8b608c53 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:53:47 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pRTkFKvC {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:53:47 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pRTkFKvC" returned: 0 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:53:47 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[feae8918-ba95-493a-9809-9b016b9c6116]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:53:47 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f88f0b9-46ae-4245-915e-92dc8b608c53 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pRTkFKvC'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:53:47 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:53:47 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:53:47 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3a9dcd8-69de-4bb2-928e-6c8f6fd98c5f]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:53:47 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f88f0b9-46ae-4245-915e-92dc8b608c53 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:53:47 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:53:47 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:53:47 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9543ac6-4e66-4d6b-b50f-2d131ebea8ac]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc855d21-60f9-4798-aecf-44a569bf0a11 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674238ab-cc2c-41a5-a152-8937a50e5526 (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:53:47 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f88f0b9-46ae-4245-915e-92dc8b608c53 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 (non-flash)
Aug 17 11:53:47 user nova-compute[73449]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc855d21-60f9-4798-aecf-44a569bf0a11 (non-flash)
Aug 17 11:53:47 user nova-compute[73449]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674238ab-cc2c-41a5-a152-8937a50e5526 (non-flash)
Aug 17 11:53:47 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:53:47 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f88f0b9-46ae-4245-915e-92dc8b608c53 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 (non-flash)
Aug 17 11:53:47 user nova-compute[73449]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc855d21-60f9-4798-aecf-44a569bf0a11 (non-flash)
Aug 17 11:53:47 user nova-compute[73449]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674238ab-cc2c-41a5-a152-8937a50e5526 (non-flash)
Aug 17 11:53:47 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:53:47 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 -p 172.16.0.220:3260 --login {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:53:47 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:53:47 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[719b19c6-9018-48e3-b5d4-bc316a372009]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:53:47 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f88f0b9-46ae-4245-915e-92dc8b608c53 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9, portal: 172.16.0.220,3260]
Aug 17 11:53:47 user nova-compute[73449]: Login to [iface: default, target: iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9, portal: 172.16.0.220,3260] successful.
Aug 17 11:53:47 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:53:47 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:53:47 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:53:47 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[70aab8bb-879f-4a40-83a2-3ccee2ca822b]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:53:47 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f88f0b9-46ae-4245-915e-92dc8b608c53 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:53:47 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:53:47 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:53:47 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[05f65e31-69d3-4d1c-bf99-fad976c05040]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc855d21-60f9-4798-aecf-44a569bf0a11 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674238ab-cc2c-41a5-a152-8937a50e5526 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:53:47 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f88f0b9-46ae-4245-915e-92dc8b608c53 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 (non-flash)
Aug 17 11:53:47 user nova-compute[73449]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc855d21-60f9-4798-aecf-44a569bf0a11 (non-flash)
Aug 17 11:53:47 user nova-compute[73449]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674238ab-cc2c-41a5-a152-8937a50e5526 (non-flash)
Aug 17 11:53:47 user nova-compute[73449]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)
Aug 17 11:53:47 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:53:47 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f88f0b9-46ae-4245-915e-92dc8b608c53 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 (non-flash)
Aug 17 11:53:47 user nova-compute[73449]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc855d21-60f9-4798-aecf-44a569bf0a11 (non-flash)
Aug 17 11:53:47 user nova-compute[73449]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674238ab-cc2c-41a5-a152-8937a50e5526 (non-flash)
Aug 17 11:53:47 user nova-compute[73449]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)
Aug 17 11:53:47 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:53:47 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-2f88f0b9-46ae-4245-915e-92dc8b608c53 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.306s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:53:47 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f88f0b9-46ae-4245-915e-92dc8b608c53 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Connected to 172.16.0.220:3260 {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 11:53:47 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-2f88f0b9-46ae-4245-915e-92dc8b608c53 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] HCTL ('36', '-', '-', 0) found on session 38 with lun 0 {{(pid=73449) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 11:53:47 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-2f88f0b9-46ae-4245-915e-92dc8b608c53 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73449) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 11:53:47 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:53:47 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.046s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:53:47 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[0381f68e-694e-4700-aac5-43af006b126c]: (4, ('- - 0', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:53:47 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-2f88f0b9-46ae-4245-915e-92dc8b608c53 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Searching for a device in session 38 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73449) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 11:53:47 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f88f0b9-46ae-4245-915e-92dc8b608c53 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pRTkFKvC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 11:53:48 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-2f88f0b9-46ae-4245-915e-92dc8b608c53 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.368s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:53:48 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f88f0b9-46ae-4245-915e-92dc8b608c53 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] <== connect_volume: return (1369ms) {'type': 'block', 'scsi_wwn': '26538633163643235', 'path': '/dev/sde'} {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 11:53:48 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f88f0b9-46ae-4245-915e-92dc8b608c53 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26538633163643235', 'path': '/dev/sde'} {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 11:53:48 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:53:48 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-2f88f0b9-46ae-4245-915e-92dc8b608c53 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:53:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-337335098',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-337335098',id=32,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ec3b0b72e47448ebe99f9fc64119c1c',ramdisk_id='',reservation_id='r-7gzwba2q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1818019421',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T11:53:30Z,user_data=None,user_id='14eb3826311a4f8f91d8264e87f7b866',uuid=31f5f3d2-41d8-4a26-9eb2-18b891f94734,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ea00b08a-3d80-453b-8c1a-9bdc74ac652f", "address": "fa:16:3e:d2:96:e4", "network": {"id": "9455bb75-f75a-41ff-8f6f-49f55aa738f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-425274599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec3b0b72e47448ebe99f9fc64119c1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea00b08a-3d", "ovs_interfaceid": "ea00b08a-3d80-453b-8c1a-9bdc74ac652f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73449) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 11:53:48 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-2f88f0b9-46ae-4245-915e-92dc8b608c53 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Converting VIF {"id": "ea00b08a-3d80-453b-8c1a-9bdc74ac652f", "address": "fa:16:3e:d2:96:e4", "network": {"id": "9455bb75-f75a-41ff-8f6f-49f55aa738f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-425274599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec3b0b72e47448ebe99f9fc64119c1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea00b08a-3d", "ovs_interfaceid": "ea00b08a-3d80-453b-8c1a-9bdc74ac652f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:53:48 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-2f88f0b9-46ae-4245-915e-92dc8b608c53 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:96:e4,bridge_name='br-int',has_traffic_filtering=True,id=ea00b08a-3d80-453b-8c1a-9bdc74ac652f,network=Network(9455bb75-f75a-41ff-8f6f-49f55aa738f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea00b08a-3d') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:53:48 user nova-compute[73449]: DEBUG nova.objects.instance [None req-2f88f0b9-46ae-4245-915e-92dc8b608c53 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Lazy-loading 'pci_devices' on Instance uuid 31f5f3d2-41d8-4a26-9eb2-18b891f94734 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:53:49 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-2f88f0b9-46ae-4245-915e-92dc8b608c53 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] End _get_guest_xml xml=<domain type="kvm">
Aug 17 11:53:49 user nova-compute[73449]:   <uuid>31f5f3d2-41d8-4a26-9eb2-18b891f94734</uuid>
Aug 17 11:53:49 user nova-compute[73449]:   <name>instance-00000020</name>
Aug 17 11:53:49 user nova-compute[73449]:   <memory>524288</memory>
Aug 17 11:53:49 user nova-compute[73449]:   <vcpu>1</vcpu>
Aug 17 11:53:49 user nova-compute[73449]:   <metadata>
Aug 17 11:53:49 user nova-compute[73449]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 11:53:49 user nova-compute[73449]:       <nova:package version="0.0.0"/>
Aug 17 11:53:49 user nova-compute[73449]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-337335098</nova:name>
Aug 17 11:53:49 user nova-compute[73449]:       <nova:creationTime>2023-08-17 11:53:47</nova:creationTime>
Aug 17 11:53:49 user nova-compute[73449]:       <nova:flavor name="m1.tiny">
Aug 17 11:53:49 user nova-compute[73449]:         <nova:memory>512</nova:memory>
Aug 17 11:53:49 user nova-compute[73449]:         <nova:disk>1</nova:disk>
Aug 17 11:53:49 user nova-compute[73449]:         <nova:swap>0</nova:swap>
Aug 17 11:53:49 user nova-compute[73449]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 11:53:49 user nova-compute[73449]:         <nova:vcpus>1</nova:vcpus>
Aug 17 11:53:49 user nova-compute[73449]:       </nova:flavor>
Aug 17 11:53:49 user nova-compute[73449]:       <nova:owner>
Aug 17 11:53:49 user nova-compute[73449]:         <nova:user uuid="14eb3826311a4f8f91d8264e87f7b866">tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member</nova:user>
Aug 17 11:53:49 user nova-compute[73449]:         <nova:project uuid="4ec3b0b72e47448ebe99f9fc64119c1c">tempest-ServerBootFromVolumeStableRescueTest-1818019421</nova:project>
Aug 17 11:53:49 user nova-compute[73449]:       </nova:owner>
Aug 17 11:53:49 user nova-compute[73449]:       <nova:root type="image" uuid="0a2904ae-083d-41c8-83db-343132b36148"/>
Aug 17 11:53:49 user nova-compute[73449]:       <nova:ports>
Aug 17 11:53:49 user nova-compute[73449]:         <nova:port uuid="ea00b08a-3d80-453b-8c1a-9bdc74ac652f">
Aug 17 11:53:49 user nova-compute[73449]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 17 11:53:49 user nova-compute[73449]:         </nova:port>
Aug 17 11:53:49 user nova-compute[73449]:       </nova:ports>
Aug 17 11:53:49 user nova-compute[73449]:     </nova:instance>
Aug 17 11:53:49 user nova-compute[73449]:   </metadata>
Aug 17 11:53:49 user nova-compute[73449]:   <sysinfo type="smbios">
Aug 17 11:53:49 user nova-compute[73449]:     <system>
Aug 17 11:53:49 user nova-compute[73449]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 11:53:49 user nova-compute[73449]:       <entry name="product">OpenStack Nova</entry>
Aug 17 11:53:49 user nova-compute[73449]:       <entry name="version">0.0.0</entry>
Aug 17 11:53:49 user nova-compute[73449]:       <entry name="serial">31f5f3d2-41d8-4a26-9eb2-18b891f94734</entry>
Aug 17 11:53:49 user nova-compute[73449]:       <entry name="uuid">31f5f3d2-41d8-4a26-9eb2-18b891f94734</entry>
Aug 17 11:53:49 user nova-compute[73449]:       <entry name="family">Virtual Machine</entry>
Aug 17 11:53:49 user nova-compute[73449]:     </system>
Aug 17 11:53:49 user nova-compute[73449]:   </sysinfo>
Aug 17 11:53:49 user nova-compute[73449]:   <os>
Aug 17 11:53:49 user nova-compute[73449]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 11:53:49 user nova-compute[73449]:     <boot dev="hd"/>
Aug 17 11:53:49 user nova-compute[73449]:     <smbios mode="sysinfo"/>
Aug 17 11:53:49 user nova-compute[73449]:   </os>
Aug 17 11:53:49 user nova-compute[73449]:   <features>
Aug 17 11:53:49 user nova-compute[73449]:     <acpi/>
Aug 17 11:53:49 user nova-compute[73449]:     <apic/>
Aug 17 11:53:49 user nova-compute[73449]:     <vmcoreinfo/>
Aug 17 11:53:49 user nova-compute[73449]:   </features>
Aug 17 11:53:49 user nova-compute[73449]:   <clock offset="utc">
Aug 17 11:53:49 user nova-compute[73449]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 11:53:49 user nova-compute[73449]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 11:53:49 user nova-compute[73449]:     <timer name="hpet" present="no"/>
Aug 17 11:53:49 user nova-compute[73449]:   </clock>
Aug 17 11:53:49 user nova-compute[73449]:   <cpu mode="custom" match="exact">
Aug 17 11:53:49 user nova-compute[73449]:     <model>Nehalem</model>
Aug 17 11:53:49 user nova-compute[73449]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 11:53:49 user nova-compute[73449]:   </cpu>
Aug 17 11:53:49 user nova-compute[73449]:   <devices>
Aug 17 11:53:49 user nova-compute[73449]:     <disk type="block" device="disk">
Aug 17 11:53:49 user nova-compute[73449]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 11:53:49 user nova-compute[73449]:       <source dev="/dev/sde"/>
Aug 17 11:53:49 user nova-compute[73449]:       <target dev="vda" bus="virtio"/>
Aug 17 11:53:49 user nova-compute[73449]:       <serial>e6c52a84-6fd6-4981-90d6-4673350908c9</serial>
Aug 17 11:53:49 user nova-compute[73449]:     </disk>
Aug 17 11:53:49 user nova-compute[73449]:     <interface type="ethernet">
Aug 17 11:53:49 user nova-compute[73449]:       <mac address="fa:16:3e:d2:96:e4"/>
Aug 17 11:53:49 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 11:53:49 user nova-compute[73449]:       <mtu size="1442"/>
Aug 17 11:53:49 user nova-compute[73449]:       <target dev="tapea00b08a-3d"/>
Aug 17 11:53:49 user nova-compute[73449]:     </interface>
Aug 17 11:53:49 user nova-compute[73449]:     <serial type="pty">
Aug 17 11:53:49 user nova-compute[73449]:       <log file="/opt/stack/data/nova/instances/31f5f3d2-41d8-4a26-9eb2-18b891f94734/console.log" append="off"/>
Aug 17 11:53:49 user nova-compute[73449]:     </serial>
Aug 17 11:53:49 user nova-compute[73449]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 11:53:49 user nova-compute[73449]:     <video>
Aug 17 11:53:49 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 11:53:49 user nova-compute[73449]:     </video>
Aug 17 11:53:49 user nova-compute[73449]:     <rng model="virtio">
Aug 17 11:53:49 user nova-compute[73449]:       <backend model="random">/dev/urandom</backend>
Aug 17 11:53:49 user nova-compute[73449]:     </rng>
Aug 17 11:53:49 user nova-compute[73449]:     <controller type="usb" index="0" model="none"/>
Aug 17 11:53:49 user nova-compute[73449]:     <memballoon model="virtio">
Aug 17 11:53:49 user nova-compute[73449]:       <stats period="10"/>
Aug 17 11:53:49 user nova-compute[73449]:     </memballoon>
Aug 17 11:53:49 user nova-compute[73449]:   </devices>
Aug 17 11:53:49 user nova-compute[73449]: </domain>
Aug 17 11:53:49 user nova-compute[73449]:  {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 11:53:49 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-2f88f0b9-46ae-4245-915e-92dc8b608c53 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:53:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-337335098',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-337335098',id=32,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ec3b0b72e47448ebe99f9fc64119c1c',ramdisk_id='',reservation_id='r-7gzwba2q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1818019421',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T11:53:30Z,user_data=None,user_id='14eb3826311a4f8f91d8264e87f7b866',uuid=31f5f3d2-41d8-4a26-9eb2-18b891f94734,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ea00b08a-3d80-453b-8c1a-9bdc74ac652f", "address": "fa:16:3e:d2:96:e4", "network": {"id": "9455bb75-f75a-41ff-8f6f-49f55aa738f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-425274599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec3b0b72e47448ebe99f9fc64119c1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea00b08a-3d", "ovs_interfaceid": "ea00b08a-3d80-453b-8c1a-9bdc74ac652f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 11:53:49 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-2f88f0b9-46ae-4245-915e-92dc8b608c53 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Converting VIF {"id": "ea00b08a-3d80-453b-8c1a-9bdc74ac652f", "address": "fa:16:3e:d2:96:e4", "network": {"id": "9455bb75-f75a-41ff-8f6f-49f55aa738f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-425274599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec3b0b72e47448ebe99f9fc64119c1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea00b08a-3d", "ovs_interfaceid": "ea00b08a-3d80-453b-8c1a-9bdc74ac652f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:53:49 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-2f88f0b9-46ae-4245-915e-92dc8b608c53 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:96:e4,bridge_name='br-int',has_traffic_filtering=True,id=ea00b08a-3d80-453b-8c1a-9bdc74ac652f,network=Network(9455bb75-f75a-41ff-8f6f-49f55aa738f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea00b08a-3d') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:53:49 user nova-compute[73449]: DEBUG os_vif [None req-2f88f0b9-46ae-4245-915e-92dc8b608c53 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:96:e4,bridge_name='br-int',has_traffic_filtering=True,id=ea00b08a-3d80-453b-8c1a-9bdc74ac652f,network=Network(9455bb75-f75a-41ff-8f6f-49f55aa738f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea00b08a-3d') {{(pid=73449) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 11:53:49 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:53:49 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:53:49 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 11:53:49 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:53:49 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapea00b08a-3d, may_exist=True, interface_attrs={}) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:53:49 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapea00b08a-3d, col_values=(('external_ids', {'iface-id': 'ea00b08a-3d80-453b-8c1a-9bdc74ac652f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d2:96:e4', 'vm-uuid': '31f5f3d2-41d8-4a26-9eb2-18b891f94734'}),), if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:53:49 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:53:49 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:53:49 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:53:49 user nova-compute[73449]: INFO os_vif [None req-2f88f0b9-46ae-4245-915e-92dc8b608c53 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:96:e4,bridge_name='br-int',has_traffic_filtering=True,id=ea00b08a-3d80-453b-8c1a-9bdc74ac652f,network=Network(9455bb75-f75a-41ff-8f6f-49f55aa738f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea00b08a-3d')
Aug 17 11:53:49 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-2f88f0b9-46ae-4245-915e-92dc8b608c53 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] No BDM found with device name vda, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 11:53:49 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-2f88f0b9-46ae-4245-915e-92dc8b608c53 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] No VIF found with MAC fa:16:3e:d2:96:e4, not building metadata {{(pid=73449) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 11:53:49 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c14cf909-87e9-405a-ae97-08fb9e6e79d3 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] Calling os-brick to attach iSCSI Volume {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 11:53:49 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-c14cf909-87e9-405a-ae97-08fb9e6e79d3 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0a382874-91aa-4ff2-aae4-15db10fe5ff2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PgQlnxmj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 11:53:49 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-c14cf909-87e9-405a-ae97-08fb9e6e79d3 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 11:53:49 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-c14cf909-87e9-405a-ae97-08fb9e6e79d3 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:53:49 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-c14cf909-87e9-405a-ae97-08fb9e6e79d3 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:53:49 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-c14cf909-87e9-405a-ae97-08fb9e6e79d3 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 11:53:49 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-c14cf909-87e9-405a-ae97-08fb9e6e79d3 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a382874-91aa-4ff2-aae4-15db10fe5ff2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:53:49 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-c14cf909-87e9-405a-ae97-08fb9e6e79d3 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a382874-91aa-4ff2-aae4-15db10fe5ff2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:53:49 user nova-compute[73449]: INFO os_brick.initiator.connectors.iscsi [None req-c14cf909-87e9-405a-ae97-08fb9e6e79d3 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 11:53:49 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a382874-91aa-4ff2-aae4-15db10fe5ff2 -p 172.16.0.220:3260 {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:53:49 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a382874-91aa-4ff2-aae4-15db10fe5ff2 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:53:49 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4c2b777-fdae-4b03-a143-bf43dc8f3837]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:53:49 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-c14cf909-87e9-405a-ae97-08fb9e6e79d3 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 11:53:49 user nova-compute[73449]:  {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:53:49 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a382874-91aa-4ff2-aae4-15db10fe5ff2 -p 172.16.0.220:3260 --interface default --op new {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:53:49 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a382874-91aa-4ff2-aae4-15db10fe5ff2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:53:49 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[30c8a2d2-a25f-447f-b43f-a8e5fc482c15]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0a382874-91aa-4ff2-aae4-15db10fe5ff2] added\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:53:49 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-c14cf909-87e9-405a-ae97-08fb9e6e79d3 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0a382874-91aa-4ff2-aae4-15db10fe5ff2] added
Aug 17 11:53:49 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:53:49 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a382874-91aa-4ff2-aae4-15db10fe5ff2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:53:49 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a382874-91aa-4ff2-aae4-15db10fe5ff2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:53:49 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4bfdda1-e5da-4ae9-842c-5ba22fd396ec]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:53:49 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-c14cf909-87e9-405a-ae97-08fb9e6e79d3 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:53:49 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a382874-91aa-4ff2-aae4-15db10fe5ff2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:53:49 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a382874-91aa-4ff2-aae4-15db10fe5ff2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:53:49 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[11bb8643-035a-46b7-aad6-383a1f757162]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:53:49 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-c14cf909-87e9-405a-ae97-08fb9e6e79d3 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:53:49 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a382874-91aa-4ff2-aae4-15db10fe5ff2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PgQlnxmj {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:53:49 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a382874-91aa-4ff2-aae4-15db10fe5ff2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PgQlnxmj" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:53:49 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[237cd0e7-5fb9-4697-b8e8-b69d7395629a]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:53:49 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-c14cf909-87e9-405a-ae97-08fb9e6e79d3 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PgQlnxmj'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:53:49 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a382874-91aa-4ff2-aae4-15db10fe5ff2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:53:49 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a382874-91aa-4ff2-aae4-15db10fe5ff2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:53:49 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7c44fc5-811e-40a4-be9f-1aa08345c99e]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:53:49 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-c14cf909-87e9-405a-ae97-08fb9e6e79d3 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:53:49 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:53:49 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:53:49 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[642c7ea3-bcce-45b6-9d51-27181c4a2dfd]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc855d21-60f9-4798-aecf-44a569bf0a11 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674238ab-cc2c-41a5-a152-8937a50e5526 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:53:49 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-c14cf909-87e9-405a-ae97-08fb9e6e79d3 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 (non-flash)
Aug 17 11:53:49 user nova-compute[73449]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc855d21-60f9-4798-aecf-44a569bf0a11 (non-flash)
Aug 17 11:53:49 user nova-compute[73449]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674238ab-cc2c-41a5-a152-8937a50e5526 (non-flash)
Aug 17 11:53:49 user nova-compute[73449]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)
Aug 17 11:53:49 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:53:49 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-c14cf909-87e9-405a-ae97-08fb9e6e79d3 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 (non-flash)
Aug 17 11:53:49 user nova-compute[73449]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc855d21-60f9-4798-aecf-44a569bf0a11 (non-flash)
Aug 17 11:53:49 user nova-compute[73449]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674238ab-cc2c-41a5-a152-8937a50e5526 (non-flash)
Aug 17 11:53:49 user nova-compute[73449]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)
Aug 17 11:53:49 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:53:49 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a382874-91aa-4ff2-aae4-15db10fe5ff2 -p 172.16.0.220:3260 --login {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:53:50 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a382874-91aa-4ff2-aae4-15db10fe5ff2 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:53:50 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[3895e839-7c78-43d8-8be9-5bb2015c981d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0a382874-91aa-4ff2-aae4-15db10fe5ff2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0a382874-91aa-4ff2-aae4-15db10fe5ff2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:53:50 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-c14cf909-87e9-405a-ae97-08fb9e6e79d3 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0a382874-91aa-4ff2-aae4-15db10fe5ff2, portal: 172.16.0.220,3260]
Aug 17 11:53:50 user nova-compute[73449]: Login to [iface: default, target: iqn.2010-10.org.openstack:0a382874-91aa-4ff2-aae4-15db10fe5ff2, portal: 172.16.0.220,3260] successful.
Aug 17 11:53:50 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:53:50 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a382874-91aa-4ff2-aae4-15db10fe5ff2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:53:50 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a382874-91aa-4ff2-aae4-15db10fe5ff2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:53:50 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c4357a0-29ff-4e67-9ceb-d3bcdafa04eb]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:53:50 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-c14cf909-87e9-405a-ae97-08fb9e6e79d3 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:53:50 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:53:50 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:53:50 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[95e6007f-e16b-4853-a4f7-657c3a15583e]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc855d21-60f9-4798-aecf-44a569bf0a11 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674238ab-cc2c-41a5-a152-8937a50e5526 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a382874-91aa-4ff2-aae4-15db10fe5ff2 (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:53:50 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-c14cf909-87e9-405a-ae97-08fb9e6e79d3 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 (non-flash)
Aug 17 11:53:50 user nova-compute[73449]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc855d21-60f9-4798-aecf-44a569bf0a11 (non-flash)
Aug 17 11:53:50 user nova-compute[73449]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674238ab-cc2c-41a5-a152-8937a50e5526 (non-flash)
Aug 17 11:53:50 user nova-compute[73449]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)
Aug 17 11:53:50 user nova-compute[73449]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a382874-91aa-4ff2-aae4-15db10fe5ff2 (non-flash)
Aug 17 11:53:50 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:53:50 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-c14cf909-87e9-405a-ae97-08fb9e6e79d3 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 (non-flash)
Aug 17 11:53:50 user nova-compute[73449]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc855d21-60f9-4798-aecf-44a569bf0a11 (non-flash)
Aug 17 11:53:50 user nova-compute[73449]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674238ab-cc2c-41a5-a152-8937a50e5526 (non-flash)
Aug 17 11:53:50 user nova-compute[73449]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)
Aug 17 11:53:50 user nova-compute[73449]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a382874-91aa-4ff2-aae4-15db10fe5ff2 (non-flash)
Aug 17 11:53:50 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:53:50 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-c14cf909-87e9-405a-ae97-08fb9e6e79d3 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a382874-91aa-4ff2-aae4-15db10fe5ff2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:53:50 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-c14cf909-87e9-405a-ae97-08fb9e6e79d3 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Connected to 172.16.0.220:3260 {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 11:53:50 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-c14cf909-87e9-405a-ae97-08fb9e6e79d3 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] HCTL ('37', '-', '-', 0) found on session 39 with lun 0 {{(pid=73449) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 11:53:50 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-c14cf909-87e9-405a-ae97-08fb9e6e79d3 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73449) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 11:53:50 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:53:50 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:53:50 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[89211590-75bf-4a33-ab6d-c76640ef9c85]: (4, ('- - 0', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:53:50 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-c14cf909-87e9-405a-ae97-08fb9e6e79d3 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Searching for a device in session 39 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73449) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 11:53:50 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-c14cf909-87e9-405a-ae97-08fb9e6e79d3 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PgQlnxmj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 11:53:50 user nova-compute[73449]: DEBUG nova.network.neutron [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] Port 4a57c385-a0c8-454a-acbf-d1f783ff3131 binding to destination host user is already ACTIVE {{(pid=73449) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 17 11:53:50 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Acquiring lock "b32df06e-0b5a-4384-946b-64d64aeeb07e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:53:50 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Lock "b32df06e-0b5a-4384-946b-64d64aeeb07e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:53:50 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Lock "b32df06e-0b5a-4384-946b-64d64aeeb07e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:53:50 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:53:50 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:53:50 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:53:50 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Acquiring lock "refresh_cache-b32df06e-0b5a-4384-946b-64d64aeeb07e" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:53:50 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Acquired lock "refresh_cache-b32df06e-0b5a-4384-946b-64d64aeeb07e" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:53:50 user nova-compute[73449]: DEBUG nova.network.neutron [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] Building network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 11:53:50 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:53:50 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:53:50 user nova-compute[73449]: DEBUG nova.compute.manager [req-29ef70a2-27a5-4e16-9b88-e68bc6406963 req-ba1309a2-c4de-4f9c-ad03-bc3168f10f14 service nova] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] Received event network-vif-plugged-ea00b08a-3d80-453b-8c1a-9bdc74ac652f {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:53:50 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-29ef70a2-27a5-4e16-9b88-e68bc6406963 req-ba1309a2-c4de-4f9c-ad03-bc3168f10f14 service nova] Acquiring lock "31f5f3d2-41d8-4a26-9eb2-18b891f94734-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:53:50 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-29ef70a2-27a5-4e16-9b88-e68bc6406963 req-ba1309a2-c4de-4f9c-ad03-bc3168f10f14 service nova] Lock "31f5f3d2-41d8-4a26-9eb2-18b891f94734-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:53:50 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-29ef70a2-27a5-4e16-9b88-e68bc6406963 req-ba1309a2-c4de-4f9c-ad03-bc3168f10f14 service nova] Lock "31f5f3d2-41d8-4a26-9eb2-18b891f94734-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:53:50 user nova-compute[73449]: DEBUG nova.compute.manager [req-29ef70a2-27a5-4e16-9b88-e68bc6406963 req-ba1309a2-c4de-4f9c-ad03-bc3168f10f14 service nova] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] No waiting events found dispatching network-vif-plugged-ea00b08a-3d80-453b-8c1a-9bdc74ac652f {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:53:50 user nova-compute[73449]: WARNING nova.compute.manager [req-29ef70a2-27a5-4e16-9b88-e68bc6406963 req-ba1309a2-c4de-4f9c-ad03-bc3168f10f14 service nova] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] Received unexpected event network-vif-plugged-ea00b08a-3d80-453b-8c1a-9bdc74ac652f for instance with vm_state building and task_state spawning.
Aug 17 11:53:50 user nova-compute[73449]: DEBUG nova.network.neutron [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] Updating instance_info_cache with network_info: [{"id": "4a57c385-a0c8-454a-acbf-d1f783ff3131", "address": "fa:16:3e:be:34:a2", "network": {"id": "72c50a42-688f-4868-8e19-c40b103a49cd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1792423641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "068c5270255744a18208a0ad9b35f168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a57c385-a0", "ovs_interfaceid": "4a57c385-a0c8-454a-acbf-d1f783ff3131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:53:50 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Releasing lock "refresh_cache-b32df06e-0b5a-4384-946b-64d64aeeb07e" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:53:51 user nova-compute[73449]: DEBUG os_brick.utils [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 11:53:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:53:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:53:51 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf360b27-c9ca-4547-a360-b8941ee8943f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4d3924302012\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:53:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:53:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:53:51 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[42ed701a-b201-46fb-b15d-c91cc25be6fd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:53:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:53:51 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-c14cf909-87e9-405a-ae97-08fb9e6e79d3 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.331s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:53:51 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-c14cf909-87e9-405a-ae97-08fb9e6e79d3 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] <== connect_volume: return (1332ms) {'type': 'block', 'scsi_wwn': '26237383533653263', 'path': '/dev/sdf'} {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 11:53:51 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c14cf909-87e9-405a-ae97-08fb9e6e79d3 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26237383533653263', 'path': '/dev/sdf'} {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 11:53:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:53:51 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f44527e-63fc-4f53-a0b3-86956c64c36b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:53:51 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[210b41ce-6310-436f-ba05-e43691035465]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:53:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Running cmd (subprocess): nvme version {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:53:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] 'nvme version' failed. Not Retrying. {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 11:53:51 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.nvmeof [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] nvme not present on system {{(pid=73449) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 11:53:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:53:51 user nova-compute[73449]: DEBUG nova.objects.instance [None req-c14cf909-87e9-405a-ae97-08fb9e6e79d3 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Lazy-loading 'flavor' on Instance uuid 01ef4274-dfa1-4f7d-a24c-a1686b692f70 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:53:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 11:53:51 user nova-compute[73449]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 11:53:51 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[82b63393-02c9-4589-84cc-dfe43777dbd5]: (4, '') {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:53:51 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73449) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 11:53:51 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73449) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 11:53:51 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] LIGHTOS: no hostnqn found. {{(pid=73449) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 11:53:51 user nova-compute[73449]: DEBUG os_brick.utils [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4d3924302012', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 11:53:51 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-c14cf909-87e9-405a-ae97-08fb9e6e79d3 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 11:53:51 user nova-compute[73449]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 11:53:51 user nova-compute[73449]:   <source dev="/dev/sdf"/>
Aug 17 11:53:51 user nova-compute[73449]:   <target dev="vdb" bus="virtio"/>
Aug 17 11:53:51 user nova-compute[73449]:   <serial>0a382874-91aa-4ff2-aae4-15db10fe5ff2</serial>
Aug 17 11:53:51 user nova-compute[73449]: </disk>
Aug 17 11:53:51 user nova-compute[73449]:  {{(pid=73449) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 11:53:51 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-c14cf909-87e9-405a-ae97-08fb9e6e79d3 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] No BDM found with device name vda, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 11:53:51 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-c14cf909-87e9-405a-ae97-08fb9e6e79d3 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 11:53:51 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-c14cf909-87e9-405a-ae97-08fb9e6e79d3 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] No VIF found with MAC fa:16:3e:b9:37:67, not building metadata {{(pid=73449) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 11:53:51 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-c14cf909-87e9-405a-ae97-08fb9e6e79d3 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Lock "01ef4274-dfa1-4f7d-a24c-a1686b692f70" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.365s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:53:52 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692273232.5749424, 31f5f3d2-41d8-4a26-9eb2-18b891f94734 => Resumed> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:53:52 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] VM Resumed (Lifecycle Event)
Aug 17 11:53:52 user nova-compute[73449]: DEBUG nova.compute.manager [None req-2f88f0b9-46ae-4245-915e-92dc8b608c53 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] Instance event wait completed in 0 seconds for  {{(pid=73449) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 11:53:52 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-2f88f0b9-46ae-4245-915e-92dc8b608c53 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] Guest created on hypervisor {{(pid=73449) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 11:53:52 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] Instance spawned successfully.
Aug 17 11:53:52 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-2f88f0b9-46ae-4245-915e-92dc8b608c53 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 11:53:52 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:53:52 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 11:53:52 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-2f88f0b9-46ae-4245-915e-92dc8b608c53 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] Found default for hw_cdrom_bus of ide {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:53:52 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-2f88f0b9-46ae-4245-915e-92dc8b608c53 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] Found default for hw_disk_bus of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:53:52 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-2f88f0b9-46ae-4245-915e-92dc8b608c53 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] Found default for hw_input_bus of None {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:53:52 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-2f88f0b9-46ae-4245-915e-92dc8b608c53 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] Found default for hw_pointer_model of None {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:53:52 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-2f88f0b9-46ae-4245-915e-92dc8b608c53 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] Found default for hw_video_model of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:53:52 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-2f88f0b9-46ae-4245-915e-92dc8b608c53 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] Found default for hw_vif_model of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:53:52 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 11:53:52 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692273232.5767784, 31f5f3d2-41d8-4a26-9eb2-18b891f94734 => Started> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:53:52 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] VM Started (Lifecycle Event)
Aug 17 11:53:52 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:53:52 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 11:53:52 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 11:53:52 user nova-compute[73449]: INFO nova.compute.manager [None req-2f88f0b9-46ae-4245-915e-92dc8b608c53 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] Took 5.17 seconds to spawn the instance on the hypervisor.
Aug 17 11:53:52 user nova-compute[73449]: DEBUG nova.compute.manager [None req-2f88f0b9-46ae-4245-915e-92dc8b608c53 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:53:52 user nova-compute[73449]: DEBUG nova.compute.manager [req-45e6d9cc-819c-4d2f-bc32-53c73648127b req-ec125e0d-0d29-483f-8db6-be7507b060f8 service nova] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] Received event network-vif-plugged-ea00b08a-3d80-453b-8c1a-9bdc74ac652f {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:53:52 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-45e6d9cc-819c-4d2f-bc32-53c73648127b req-ec125e0d-0d29-483f-8db6-be7507b060f8 service nova] Acquiring lock "31f5f3d2-41d8-4a26-9eb2-18b891f94734-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:53:52 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-45e6d9cc-819c-4d2f-bc32-53c73648127b req-ec125e0d-0d29-483f-8db6-be7507b060f8 service nova] Lock "31f5f3d2-41d8-4a26-9eb2-18b891f94734-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:53:52 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-45e6d9cc-819c-4d2f-bc32-53c73648127b req-ec125e0d-0d29-483f-8db6-be7507b060f8 service nova] Lock "31f5f3d2-41d8-4a26-9eb2-18b891f94734-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:53:52 user nova-compute[73449]: DEBUG nova.compute.manager [req-45e6d9cc-819c-4d2f-bc32-53c73648127b req-ec125e0d-0d29-483f-8db6-be7507b060f8 service nova] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] No waiting events found dispatching network-vif-plugged-ea00b08a-3d80-453b-8c1a-9bdc74ac652f {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:53:52 user nova-compute[73449]: WARNING nova.compute.manager [req-45e6d9cc-819c-4d2f-bc32-53c73648127b req-ec125e0d-0d29-483f-8db6-be7507b060f8 service nova] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] Received unexpected event network-vif-plugged-ea00b08a-3d80-453b-8c1a-9bdc74ac652f for instance with vm_state building and task_state spawning.
Aug 17 11:53:52 user nova-compute[73449]: INFO nova.compute.manager [None req-2f88f0b9-46ae-4245-915e-92dc8b608c53 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] Took 23.67 seconds to build instance.
Aug 17 11:53:52 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-2f88f0b9-46ae-4245-915e-92dc8b608c53 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Lock "31f5f3d2-41d8-4a26-9eb2-18b891f94734" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.862s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:53:53 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:53:54 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:53:54 user nova-compute[73449]: DEBUG nova.compute.manager [req-a373d749-bd12-4b42-872e-588e85156773 req-17676e46-f6a2-43b4-adc0-1ab76d218b13 service nova] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] Received event network-changed-e1cb1992-df66-4253-ba1f-3c30647c61de {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:53:54 user nova-compute[73449]: DEBUG nova.compute.manager [req-a373d749-bd12-4b42-872e-588e85156773 req-17676e46-f6a2-43b4-adc0-1ab76d218b13 service nova] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] Refreshing instance network info cache due to event network-changed-e1cb1992-df66-4253-ba1f-3c30647c61de. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 11:53:54 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-a373d749-bd12-4b42-872e-588e85156773 req-17676e46-f6a2-43b4-adc0-1ab76d218b13 service nova] Acquiring lock "refresh_cache-01ef4274-dfa1-4f7d-a24c-a1686b692f70" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:53:54 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-a373d749-bd12-4b42-872e-588e85156773 req-17676e46-f6a2-43b4-adc0-1ab76d218b13 service nova] Acquired lock "refresh_cache-01ef4274-dfa1-4f7d-a24c-a1686b692f70" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:53:54 user nova-compute[73449]: DEBUG nova.network.neutron [req-a373d749-bd12-4b42-872e-588e85156773 req-17676e46-f6a2-43b4-adc0-1ab76d218b13 service nova] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] Refreshing network info cache for port e1cb1992-df66-4253-ba1f-3c30647c61de {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 11:53:55 user nova-compute[73449]: DEBUG nova.network.neutron [req-a373d749-bd12-4b42-872e-588e85156773 req-17676e46-f6a2-43b4-adc0-1ab76d218b13 service nova] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] Updated VIF entry in instance network info cache for port e1cb1992-df66-4253-ba1f-3c30647c61de. {{(pid=73449) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 11:53:55 user nova-compute[73449]: DEBUG nova.network.neutron [req-a373d749-bd12-4b42-872e-588e85156773 req-17676e46-f6a2-43b4-adc0-1ab76d218b13 service nova] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] Updating instance_info_cache with network_info: [{"id": "e1cb1992-df66-4253-ba1f-3c30647c61de", "address": "fa:16:3e:b9:37:67", "network": {"id": "ff73f5c3-bae6-46cc-bcb8-bbd5be1b478d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1229197917-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5ba3ebf47bd4b999e68c74a5c0ab060", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1cb1992-df", "ovs_interfaceid": "e1cb1992-df66-4253-ba1f-3c30647c61de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:53:55 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-a373d749-bd12-4b42-872e-588e85156773 req-17676e46-f6a2-43b4-adc0-1ab76d218b13 service nova] Releasing lock "refresh_cache-01ef4274-dfa1-4f7d-a24c-a1686b692f70" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:53:57 user nova-compute[73449]: DEBUG nova.compute.manager [req-36cf4fd9-0dbc-4548-a343-fc45edd70510 req-c47793ea-94f4-4dc3-ac4d-6dae6c5e4494 service nova] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] Received event network-changed-e1cb1992-df66-4253-ba1f-3c30647c61de {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:53:57 user nova-compute[73449]: DEBUG nova.compute.manager [req-36cf4fd9-0dbc-4548-a343-fc45edd70510 req-c47793ea-94f4-4dc3-ac4d-6dae6c5e4494 service nova] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] Refreshing instance network info cache due to event network-changed-e1cb1992-df66-4253-ba1f-3c30647c61de. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 11:53:57 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-36cf4fd9-0dbc-4548-a343-fc45edd70510 req-c47793ea-94f4-4dc3-ac4d-6dae6c5e4494 service nova] Acquiring lock "refresh_cache-01ef4274-dfa1-4f7d-a24c-a1686b692f70" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:53:57 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-36cf4fd9-0dbc-4548-a343-fc45edd70510 req-c47793ea-94f4-4dc3-ac4d-6dae6c5e4494 service nova] Acquired lock "refresh_cache-01ef4274-dfa1-4f7d-a24c-a1686b692f70" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:53:57 user nova-compute[73449]: DEBUG nova.network.neutron [req-36cf4fd9-0dbc-4548-a343-fc45edd70510 req-c47793ea-94f4-4dc3-ac4d-6dae6c5e4494 service nova] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] Refreshing network info cache for port e1cb1992-df66-4253-ba1f-3c30647c61de {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 11:53:57 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-c4b5c72a-93c7-46d9-b93e-888590cee90d tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Acquiring lock "01ef4274-dfa1-4f7d-a24c-a1686b692f70" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:53:57 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-c4b5c72a-93c7-46d9-b93e-888590cee90d tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Lock "01ef4274-dfa1-4f7d-a24c-a1686b692f70" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:53:57 user nova-compute[73449]: INFO nova.compute.manager [None req-c4b5c72a-93c7-46d9-b93e-888590cee90d tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] Rebooting instance
Aug 17 11:53:57 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-c4b5c72a-93c7-46d9-b93e-888590cee90d tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Acquiring lock "refresh_cache-01ef4274-dfa1-4f7d-a24c-a1686b692f70" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:53:57 user nova-compute[73449]: DEBUG nova.network.neutron [req-36cf4fd9-0dbc-4548-a343-fc45edd70510 req-c47793ea-94f4-4dc3-ac4d-6dae6c5e4494 service nova] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] Updated VIF entry in instance network info cache for port e1cb1992-df66-4253-ba1f-3c30647c61de. {{(pid=73449) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 11:53:57 user nova-compute[73449]: DEBUG nova.network.neutron [req-36cf4fd9-0dbc-4548-a343-fc45edd70510 req-c47793ea-94f4-4dc3-ac4d-6dae6c5e4494 service nova] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] Updating instance_info_cache with network_info: [{"id": "e1cb1992-df66-4253-ba1f-3c30647c61de", "address": "fa:16:3e:b9:37:67", "network": {"id": "ff73f5c3-bae6-46cc-bcb8-bbd5be1b478d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1229197917-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5ba3ebf47bd4b999e68c74a5c0ab060", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1cb1992-df", "ovs_interfaceid": "e1cb1992-df66-4253-ba1f-3c30647c61de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:53:57 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-36cf4fd9-0dbc-4548-a343-fc45edd70510 req-c47793ea-94f4-4dc3-ac4d-6dae6c5e4494 service nova] Releasing lock "refresh_cache-01ef4274-dfa1-4f7d-a24c-a1686b692f70" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:53:57 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-c4b5c72a-93c7-46d9-b93e-888590cee90d tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Acquired lock "refresh_cache-01ef4274-dfa1-4f7d-a24c-a1686b692f70" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:53:57 user nova-compute[73449]: DEBUG nova.network.neutron [None req-c4b5c72a-93c7-46d9-b93e-888590cee90d tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] Building network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 11:53:58 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:53:58 user nova-compute[73449]: DEBUG nova.network.neutron [None req-c4b5c72a-93c7-46d9-b93e-888590cee90d tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] Updating instance_info_cache with network_info: [{"id": "e1cb1992-df66-4253-ba1f-3c30647c61de", "address": "fa:16:3e:b9:37:67", "network": {"id": "ff73f5c3-bae6-46cc-bcb8-bbd5be1b478d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1229197917-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5ba3ebf47bd4b999e68c74a5c0ab060", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1cb1992-df", "ovs_interfaceid": "e1cb1992-df66-4253-ba1f-3c30647c61de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:53:58 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-c4b5c72a-93c7-46d9-b93e-888590cee90d tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Releasing lock "refresh_cache-01ef4274-dfa1-4f7d-a24c-a1686b692f70" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:53:58 user nova-compute[73449]: DEBUG nova.compute.manager [None req-c4b5c72a-93c7-46d9-b93e-888590cee90d tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:53:58 user nova-compute[73449]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692273223.9409492, b32df06e-0b5a-4384-946b-64d64aeeb07e => Stopped> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:53:58 user nova-compute[73449]: INFO nova.compute.manager [-] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] VM Stopped (Lifecycle Event)
Aug 17 11:53:58 user nova-compute[73449]: DEBUG nova.compute.manager [None req-409c9fca-4a22-42a7-afcf-1ba6c1b6e998 None None] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:53:58 user nova-compute[73449]: DEBUG nova.compute.manager [None req-409c9fca-4a22-42a7-afcf-1ba6c1b6e998 None None] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 11:53:58 user nova-compute[73449]: INFO nova.compute.manager [None req-409c9fca-4a22-42a7-afcf-1ba6c1b6e998 None None] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 17 11:53:59 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:54:00 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:54:00 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:54:00 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:54:00 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:54:00 user nova-compute[73449]: DEBUG nova.compute.manager [req-dcbfd09d-197f-426a-948a-0cc93f66eb93 req-f1b27455-528b-4cce-855d-0dccddfd0156 service nova] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] Received event network-vif-unplugged-e1cb1992-df66-4253-ba1f-3c30647c61de {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:54:00 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-dcbfd09d-197f-426a-948a-0cc93f66eb93 req-f1b27455-528b-4cce-855d-0dccddfd0156 service nova] Acquiring lock "01ef4274-dfa1-4f7d-a24c-a1686b692f70-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:54:00 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-dcbfd09d-197f-426a-948a-0cc93f66eb93 req-f1b27455-528b-4cce-855d-0dccddfd0156 service nova] Lock "01ef4274-dfa1-4f7d-a24c-a1686b692f70-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:54:00 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-dcbfd09d-197f-426a-948a-0cc93f66eb93 req-f1b27455-528b-4cce-855d-0dccddfd0156 service nova] Lock "01ef4274-dfa1-4f7d-a24c-a1686b692f70-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:54:00 user nova-compute[73449]: DEBUG nova.compute.manager [req-dcbfd09d-197f-426a-948a-0cc93f66eb93 req-f1b27455-528b-4cce-855d-0dccddfd0156 service nova] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] No waiting events found dispatching network-vif-unplugged-e1cb1992-df66-4253-ba1f-3c30647c61de {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:54:00 user nova-compute[73449]: WARNING nova.compute.manager [req-dcbfd09d-197f-426a-948a-0cc93f66eb93 req-f1b27455-528b-4cce-855d-0dccddfd0156 service nova] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] Received unexpected event network-vif-unplugged-e1cb1992-df66-4253-ba1f-3c30647c61de for instance with vm_state active and task_state reboot_started.
Aug 17 11:54:01 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-571e79b3-1de0-427e-9ca7-211737e3b1b1 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Acquiring lock "9e689bc9-6625-46b7-90d0-52c50f9b73e6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:54:01 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-571e79b3-1de0-427e-9ca7-211737e3b1b1 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Lock "9e689bc9-6625-46b7-90d0-52c50f9b73e6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:54:01 user nova-compute[73449]: INFO nova.compute.manager [None req-571e79b3-1de0-427e-9ca7-211737e3b1b1 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] [instance: 9e689bc9-6625-46b7-90d0-52c50f9b73e6] Detaching volume 674238ab-cc2c-41a5-a152-8937a50e5526
Aug 17 11:54:01 user nova-compute[73449]: INFO nova.virt.block_device [None req-571e79b3-1de0-427e-9ca7-211737e3b1b1 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] [instance: 9e689bc9-6625-46b7-90d0-52c50f9b73e6] Attempting to driver detach volume 674238ab-cc2c-41a5-a152-8937a50e5526 from mountpoint /dev/vdb
Aug 17 11:54:01 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-571e79b3-1de0-427e-9ca7-211737e3b1b1 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Attempting to detach device vdb from instance 9e689bc9-6625-46b7-90d0-52c50f9b73e6 from the persistent domain config. {{(pid=73449) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 11:54:01 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-571e79b3-1de0-427e-9ca7-211737e3b1b1 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 11:54:01 user nova-compute[73449]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 11:54:01 user nova-compute[73449]:   <source dev="/dev/sdd"/>
Aug 17 11:54:01 user nova-compute[73449]:   <target dev="vdb" bus="virtio"/>
Aug 17 11:54:01 user nova-compute[73449]:   <serial>674238ab-cc2c-41a5-a152-8937a50e5526</serial>
Aug 17 11:54:01 user nova-compute[73449]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 11:54:01 user nova-compute[73449]: </disk>
Aug 17 11:54:01 user nova-compute[73449]:  {{(pid=73449) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 11:54:01 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-571e79b3-1de0-427e-9ca7-211737e3b1b1 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Successfully detached device vdb from instance 9e689bc9-6625-46b7-90d0-52c50f9b73e6 from the persistent domain config.
Aug 17 11:54:01 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-571e79b3-1de0-427e-9ca7-211737e3b1b1 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9e689bc9-6625-46b7-90d0-52c50f9b73e6 from the live domain config. {{(pid=73449) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 11:54:01 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-571e79b3-1de0-427e-9ca7-211737e3b1b1 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 11:54:01 user nova-compute[73449]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 11:54:01 user nova-compute[73449]:   <source dev="/dev/sdd"/>
Aug 17 11:54:01 user nova-compute[73449]:   <target dev="vdb" bus="virtio"/>
Aug 17 11:54:01 user nova-compute[73449]:   <serial>674238ab-cc2c-41a5-a152-8937a50e5526</serial>
Aug 17 11:54:01 user nova-compute[73449]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 11:54:01 user nova-compute[73449]: </disk>
Aug 17 11:54:01 user nova-compute[73449]:  {{(pid=73449) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 11:54:01 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-c680e58a-28e8-413d-af39-9d02140be452 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Acquiring lock "9e689bc9-6625-46b7-90d0-52c50f9b73e6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:54:01 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:54:01 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:54:01 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:54:01 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-c4b5c72a-93c7-46d9-b93e-888590cee90d tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] Instance shutdown successfully.
Aug 17 11:54:01 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:54:01 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:54:01 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:54:01 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:54:01 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:54:01 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73449) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 11:54:01 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Received event <DeviceRemovedEvent: 1692273241.85004, 9e689bc9-6625-46b7-90d0-52c50f9b73e6 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73449) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 11:54:01 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-571e79b3-1de0-427e-9ca7-211737e3b1b1 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9e689bc9-6625-46b7-90d0-52c50f9b73e6 {{(pid=73449) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 11:54:01 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-571e79b3-1de0-427e-9ca7-211737e3b1b1 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Successfully detached device vdb from instance 9e689bc9-6625-46b7-90d0-52c50f9b73e6 from the live domain config.
Aug 17 11:54:01 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-571e79b3-1de0-427e-9ca7-211737e3b1b1 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] [instance: 9e689bc9-6625-46b7-90d0-52c50f9b73e6] calling os-brick to detach iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 11:54:01 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-571e79b3-1de0-427e-9ca7-211737e3b1b1 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, {'target_iqns': ['iqn.2010-10.org.openstack:674238ab-cc2c-41a5-a152-8937a50e5526'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cOZitMmv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 11:54:01 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-571e79b3-1de0-427e-9ca7-211737e3b1b1 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 11:54:01 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-571e79b3-1de0-427e-9ca7-211737e3b1b1 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:54:01 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-571e79b3-1de0-427e-9ca7-211737e3b1b1 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:54:01 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-571e79b3-1de0-427e-9ca7-211737e3b1b1 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:674238ab-cc2c-41a5-a152-8937a50e5526', 0)] {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 11:54:01 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:54:01 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:54:01 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[953e91b1-d77c-4fab-8a3b-aea7f8e1e541]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a382874-91aa-4ff2-aae4-15db10fe5ff2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:674238ab-cc2c-41a5-a152-8937a50e5526\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc855d21-60f9-4798-aecf-44a569bf0a11\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:54:01 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:54:01 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:54:01 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfd715f8-f61a-4a41-bcb2-ab43f5dd1e4c]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc855d21-60f9-4798-aecf-44a569bf0a11 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674238ab-cc2c-41a5-a152-8937a50e5526 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a382874-91aa-4ff2-aae4-15db10fe5ff2 (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:54:01 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-571e79b3-1de0-427e-9ca7-211737e3b1b1 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 (non-flash)
Aug 17 11:54:01 user nova-compute[73449]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc855d21-60f9-4798-aecf-44a569bf0a11 (non-flash)
Aug 17 11:54:01 user nova-compute[73449]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674238ab-cc2c-41a5-a152-8937a50e5526 (non-flash)
Aug 17 11:54:01 user nova-compute[73449]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)
Aug 17 11:54:01 user nova-compute[73449]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a382874-91aa-4ff2-aae4-15db10fe5ff2 (non-flash)
Aug 17 11:54:01 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:54:01 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-571e79b3-1de0-427e-9ca7-211737e3b1b1 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 (non-flash)
Aug 17 11:54:01 user nova-compute[73449]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc855d21-60f9-4798-aecf-44a569bf0a11 (non-flash)
Aug 17 11:54:01 user nova-compute[73449]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674238ab-cc2c-41a5-a152-8937a50e5526 (non-flash)
Aug 17 11:54:01 user nova-compute[73449]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)
Aug 17 11:54:01 user nova-compute[73449]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a382874-91aa-4ff2-aae4-15db10fe5ff2 (non-flash)
Aug 17 11:54:01 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:54:01 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-571e79b3-1de0-427e-9ca7-211737e3b1b1 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe7874cdd80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:674238ab-cc2c-41a5-a152-8937a50e5526'): ({'sdd'}, set())}) {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 11:54:01 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-571e79b3-1de0-427e-9ca7-211737e3b1b1 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Removing single pathed devices sdd {{(pid=73449) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 11:54:01 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:54:01 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:54:01 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Starting heal instance info cache {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 11:54:01 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:54:01 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bb191b7-e5b1-4a2a-8b90-fc58081bc0d4]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:54:01 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:54:01 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:54:01 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[094e804a-88f3-4ae8-bbad-3141599de595]: (4, ('ok\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:54:01 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-571e79b3-1de0-427e-9ca7-211737e3b1b1 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Flushing IO for device /dev/sdd {{(pid=73449) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 11:54:01 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:54:02 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:54:02 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[af416739-e6a5-4730-8363-9a7de218cc23]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:54:02 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-571e79b3-1de0-427e-9ca7-211737e3b1b1 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73449) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 11:54:02 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:54:02 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.039s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:54:02 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f92a902-7478-4315-aea8-8b774d695761]: (4, ('1', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:54:02 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-571e79b3-1de0-427e-9ca7-211737e3b1b1 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73449) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 11:54:02 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-571e79b3-1de0-427e-9ca7-211737e3b1b1 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] SCSI volumes sdd have been removed. {{(pid=73449) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 11:54:02 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-571e79b3-1de0-427e-9ca7-211737e3b1b1 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:674238ab-cc2c-41a5-a152-8937a50e5526')] {{(pid=73449) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 11:54:02 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:674238ab-cc2c-41a5-a152-8937a50e5526 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:54:02 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:674238ab-cc2c-41a5-a152-8937a50e5526 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:54:02 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[7509a140-a534-4e33-9fcf-c294fe7751f6]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:54:02 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-571e79b3-1de0-427e-9ca7-211737e3b1b1 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:54:02 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:674238ab-cc2c-41a5-a152-8937a50e5526 -p 172.16.0.220:3260 --logout {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:54:02 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:674238ab-cc2c-41a5-a152-8937a50e5526 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:54:02 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[93bb1117-096f-4afc-8593-da7a2cda80f9]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:674238ab-cc2c-41a5-a152-8937a50e5526, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:674238ab-cc2c-41a5-a152-8937a50e5526, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:54:02 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-571e79b3-1de0-427e-9ca7-211737e3b1b1 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:674238ab-cc2c-41a5-a152-8937a50e5526, portal: 172.16.0.220,3260]
Aug 17 11:54:02 user nova-compute[73449]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:674238ab-cc2c-41a5-a152-8937a50e5526, portal: 172.16.0.220,3260] successful.
Aug 17 11:54:02 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:54:02 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:674238ab-cc2c-41a5-a152-8937a50e5526 -p 172.16.0.220:3260 --op delete {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:54:02 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:674238ab-cc2c-41a5-a152-8937a50e5526 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:54:02 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[70758885-2818-4b6a-b5b5-619a0b4f4e5b]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:54:02 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-571e79b3-1de0-427e-9ca7-211737e3b1b1 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:54:02 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-571e79b3-1de0-427e-9ca7-211737e3b1b1 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:54:02 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-571e79b3-1de0-427e-9ca7-211737e3b1b1 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] <== disconnect_volume: return (305ms) None {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 11:54:02 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-571e79b3-1de0-427e-9ca7-211737e3b1b1 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] [instance: 9e689bc9-6625-46b7-90d0-52c50f9b73e6] Disconnected iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 11:54:02 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "refresh_cache-3d468854-6182-49c8-acb7-0641df2d5219" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:54:02 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquired lock "refresh_cache-3d468854-6182-49c8-acb7-0641df2d5219" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:54:02 user nova-compute[73449]: DEBUG nova.network.neutron [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Forcefully refreshing network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 11:54:02 user nova-compute[73449]: DEBUG nova.compute.manager [req-06d1128e-9d5a-4188-84f2-34f08d77c0c4 req-6a1269fd-cc8d-4411-afaa-e0c42470605b service nova] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] Received event network-vif-plugged-e1cb1992-df66-4253-ba1f-3c30647c61de {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:54:02 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-06d1128e-9d5a-4188-84f2-34f08d77c0c4 req-6a1269fd-cc8d-4411-afaa-e0c42470605b service nova] Acquiring lock "01ef4274-dfa1-4f7d-a24c-a1686b692f70-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:54:02 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-06d1128e-9d5a-4188-84f2-34f08d77c0c4 req-6a1269fd-cc8d-4411-afaa-e0c42470605b service nova] Lock "01ef4274-dfa1-4f7d-a24c-a1686b692f70-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:54:02 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-06d1128e-9d5a-4188-84f2-34f08d77c0c4 req-6a1269fd-cc8d-4411-afaa-e0c42470605b service nova] Lock "01ef4274-dfa1-4f7d-a24c-a1686b692f70-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:54:02 user nova-compute[73449]: DEBUG nova.compute.manager [req-06d1128e-9d5a-4188-84f2-34f08d77c0c4 req-6a1269fd-cc8d-4411-afaa-e0c42470605b service nova] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] No waiting events found dispatching network-vif-plugged-e1cb1992-df66-4253-ba1f-3c30647c61de {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:54:02 user nova-compute[73449]: WARNING nova.compute.manager [req-06d1128e-9d5a-4188-84f2-34f08d77c0c4 req-6a1269fd-cc8d-4411-afaa-e0c42470605b service nova] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] Received unexpected event network-vif-plugged-e1cb1992-df66-4253-ba1f-3c30647c61de for instance with vm_state active and task_state reboot_started.
Aug 17 11:54:03 user nova-compute[73449]: DEBUG nova.objects.instance [None req-571e79b3-1de0-427e-9ca7-211737e3b1b1 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Lazy-loading 'flavor' on Instance uuid 9e689bc9-6625-46b7-90d0-52c50f9b73e6 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:54:03 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:54:03 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-571e79b3-1de0-427e-9ca7-211737e3b1b1 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Lock "9e689bc9-6625-46b7-90d0-52c50f9b73e6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.897s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:54:03 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-c680e58a-28e8-413d-af39-9d02140be452 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Lock "9e689bc9-6625-46b7-90d0-52c50f9b73e6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.745s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:54:03 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-c680e58a-28e8-413d-af39-9d02140be452 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Acquiring lock "9e689bc9-6625-46b7-90d0-52c50f9b73e6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:54:03 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-c680e58a-28e8-413d-af39-9d02140be452 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Lock "9e689bc9-6625-46b7-90d0-52c50f9b73e6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:54:03 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-c680e58a-28e8-413d-af39-9d02140be452 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Lock "9e689bc9-6625-46b7-90d0-52c50f9b73e6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:54:03 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] Starting finish_migration {{(pid=73449) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 17 11:54:03 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] Instance directory exists: not creating {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 17 11:54:03 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] Creating image(s)
Aug 17 11:54:03 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] Did not create local disks {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 11:54:03 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] Ensure instance console log exists: /opt/stack/data/nova/instances/b32df06e-0b5a-4384-946b-64d64aeeb07e/console.log {{(pid=73449) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 11:54:03 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:54:03 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:54:03 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:54:03 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] Start _get_guest_xml network_info=[{"id": "4a57c385-a0c8-454a-acbf-d1f783ff3131", "address": "fa:16:3e:be:34:a2", "network": {"id": "72c50a42-688f-4868-8e19-c40b103a49cd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1792423641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1792423641-network", "vif_mac": "fa:16:3e:be:34:a2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "068c5270255744a18208a0ad9b35f168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a57c385-a0", "ovs_interfaceid": "4a57c385-a0c8-454a-acbf-d1f783ff3131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'attachment_id': '497f7221-624c-4145-b542-9b1dfde375d0', 'boot_index': 0, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ktosaVNw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'b32df06e-0b5a-4384-946b-64d64aeeb07e', 'attached_at': '2023-08-17T11:54:03.000000', 'detached_at': '', 'volume_id': '3724ddd1-6668-4637-a4f2-175cf033a0f7', 'serial': '3724ddd1-6668-4637-a4f2-175cf033a0f7'}, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 11:54:03 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:54:03 user nova-compute[73449]: DEBUG nova.network.neutron [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Updating instance_info_cache with network_info: [{"id": "1ec58d7f-18a4-4ddb-a137-2b72c5221621", "address": "fa:16:3e:8d:35:49", "network": {"id": "870c4b80-1ae0-4a10-89b8-ec734c66c244", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2050219794-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d6856b60c404a34b6355b5fd6dd7bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec58d7f-18", "ovs_interfaceid": "1ec58d7f-18a4-4ddb-a137-2b72c5221621", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:54:03 user nova-compute[73449]: INFO nova.compute.manager [None req-c680e58a-28e8-413d-af39-9d02140be452 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] [instance: 9e689bc9-6625-46b7-90d0-52c50f9b73e6] Terminating instance
Aug 17 11:54:03 user nova-compute[73449]: DEBUG nova.compute.manager [None req-c680e58a-28e8-413d-af39-9d02140be452 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] [instance: 9e689bc9-6625-46b7-90d0-52c50f9b73e6] Start destroying the instance on the hypervisor. {{(pid=73449) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 11:54:03 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Releasing lock "refresh_cache-3d468854-6182-49c8-acb7-0641df2d5219" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:54:03 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Updated the network info_cache for instance {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 11:54:03 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:54:03 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:54:03 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 11:54:03 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] CPU controller missing on host. {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 11:54:03 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 11:54:03 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] CPU controller found on host. {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 11:54:03 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73449) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 11:54:03 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T11:36:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 11:54:03 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Flavor limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 11:54:03 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Image limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 11:54:03 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Flavor pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 11:54:03 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Image pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 11:54:03 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 11:54:03 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 11:54:03 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 11:54:03 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Got 1 possible topologies {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 11:54:03 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 11:54:03 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 11:54:03 user nova-compute[73449]: DEBUG nova.objects.instance [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Lazy-loading 'vcpu_model' on Instance uuid b32df06e-0b5a-4384-946b-64d64aeeb07e {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:54:03 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] Calling os-brick to attach iSCSI Volume {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 11:54:03 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ktosaVNw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 11:54:03 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 11:54:03 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:54:03 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:54:03 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 11:54:03 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:54:03 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:54:03 user nova-compute[73449]: INFO os_brick.initiator.connectors.iscsi [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 11:54:03 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:54:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 -p 172.16.0.220:3260 {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:54:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 -p 172.16.0.220:3260" returned: 21 in 0.042s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:54:03 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d3887e4-d5c5-47e5-8390-edff4f1f0ee3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:54:03 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 11:54:03 user nova-compute[73449]:  {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:54:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 -p 172.16.0.220:3260 --interface default --op new {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:54:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:54:03 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[239ffc64-13ff-43fe-a56f-1959cd9845f7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7] added\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:54:03 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7] added
Aug 17 11:54:03 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:54:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:54:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:54:03 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bcaccea-855e-4cc7-a198-603a825d24dd]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:54:03 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:54:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:54:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:54:03 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[f97d9afc-0cc9-493a-841c-d3e9e1ac691d]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:54:03 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:54:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ktosaVNw {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:54:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ktosaVNw" returned: 0 in 0.022s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:54:03 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0413349-41bf-4ad7-afba-ccee295be71b]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:54:03 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ktosaVNw'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:54:03 user nova-compute[73449]: DEBUG nova.compute.manager [req-541c0306-ad9d-4dc0-b28a-64117c40a495 req-4b0723b8-2c3e-431c-bc57-b772842899dc service nova] [instance: 9e689bc9-6625-46b7-90d0-52c50f9b73e6] Received event network-vif-unplugged-7de7b2c0-d9e0-4e1a-bf74-2a477c16b514 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:54:03 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-541c0306-ad9d-4dc0-b28a-64117c40a495 req-4b0723b8-2c3e-431c-bc57-b772842899dc service nova] Acquiring lock "9e689bc9-6625-46b7-90d0-52c50f9b73e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:54:03 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-541c0306-ad9d-4dc0-b28a-64117c40a495 req-4b0723b8-2c3e-431c-bc57-b772842899dc service nova] Lock "9e689bc9-6625-46b7-90d0-52c50f9b73e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:54:03 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-541c0306-ad9d-4dc0-b28a-64117c40a495 req-4b0723b8-2c3e-431c-bc57-b772842899dc service nova] Lock "9e689bc9-6625-46b7-90d0-52c50f9b73e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:54:03 user nova-compute[73449]: DEBUG nova.compute.manager [req-541c0306-ad9d-4dc0-b28a-64117c40a495 req-4b0723b8-2c3e-431c-bc57-b772842899dc service nova] [instance: 9e689bc9-6625-46b7-90d0-52c50f9b73e6] No waiting events found dispatching network-vif-unplugged-7de7b2c0-d9e0-4e1a-bf74-2a477c16b514 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:54:03 user nova-compute[73449]: DEBUG nova.compute.manager [req-541c0306-ad9d-4dc0-b28a-64117c40a495 req-4b0723b8-2c3e-431c-bc57-b772842899dc service nova] [instance: 9e689bc9-6625-46b7-90d0-52c50f9b73e6] Received event network-vif-unplugged-7de7b2c0-d9e0-4e1a-bf74-2a477c16b514 for instance with task_state deleting. {{(pid=73449) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 11:54:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:54:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:54:03 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6099dda-d470-4851-89d7-bcca7529aea7]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:54:03 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:54:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:54:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:54:03 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[247de288-3ce1-491f-b6dd-88c847777d0d]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc855d21-60f9-4798-aecf-44a569bf0a11 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a382874-91aa-4ff2-aae4-15db10fe5ff2 (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:54:03 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 (non-flash)
Aug 17 11:54:03 user nova-compute[73449]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc855d21-60f9-4798-aecf-44a569bf0a11 (non-flash)
Aug 17 11:54:03 user nova-compute[73449]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)
Aug 17 11:54:03 user nova-compute[73449]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a382874-91aa-4ff2-aae4-15db10fe5ff2 (non-flash)
Aug 17 11:54:03 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:54:03 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 (non-flash)
Aug 17 11:54:03 user nova-compute[73449]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc855d21-60f9-4798-aecf-44a569bf0a11 (non-flash)
Aug 17 11:54:03 user nova-compute[73449]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)
Aug 17 11:54:03 user nova-compute[73449]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a382874-91aa-4ff2-aae4-15db10fe5ff2 (non-flash)
Aug 17 11:54:03 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:54:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 -p 172.16.0.220:3260 --login {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:54:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 -p 172.16.0.220:3260 --login" returned: 0 in 0.091s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:54:03 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[009425db-55c2-4e20-b5d0-3eba305da010]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:54:03 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7, portal: 172.16.0.220,3260]
Aug 17 11:54:03 user nova-compute[73449]: Login to [iface: default, target: iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7, portal: 172.16.0.220,3260] successful.
Aug 17 11:54:03 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:54:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:54:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:54:03 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b56d12b-2a99-46c6-9be9-dbf3e831c4f6]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:54:03 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:54:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:54:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:54:03 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9611db0-ca7f-4228-bf7f-4a376dd5b832]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc855d21-60f9-4798-aecf-44a569bf0a11 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a382874-91aa-4ff2-aae4-15db10fe5ff2 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:54:03 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 (non-flash)
Aug 17 11:54:03 user nova-compute[73449]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc855d21-60f9-4798-aecf-44a569bf0a11 (non-flash)
Aug 17 11:54:03 user nova-compute[73449]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)
Aug 17 11:54:03 user nova-compute[73449]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a382874-91aa-4ff2-aae4-15db10fe5ff2 (non-flash)
Aug 17 11:54:03 user nova-compute[73449]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 (non-flash)
Aug 17 11:54:03 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:54:03 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 (non-flash)
Aug 17 11:54:03 user nova-compute[73449]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc855d21-60f9-4798-aecf-44a569bf0a11 (non-flash)
Aug 17 11:54:03 user nova-compute[73449]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)
Aug 17 11:54:03 user nova-compute[73449]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a382874-91aa-4ff2-aae4-15db10fe5ff2 (non-flash)
Aug 17 11:54:03 user nova-compute[73449]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 (non-flash)
Aug 17 11:54:03 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:54:03 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.416s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:54:03 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Connected to 172.16.0.220:3260 {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 11:54:03 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] HCTL ('35', '-', '-', 0) found on session 40 with lun 0 {{(pid=73449) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 11:54:03 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73449) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 11:54:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:54:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:54:03 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4226b05-b5a2-4287-9a84-59363cf82379]: (4, ('- - 0', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:54:03 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Searching for a device in session 40 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73449) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 11:54:03 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ktosaVNw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 11:54:03 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:54:03 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:54:03 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:54:03 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:54:04 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: 9e689bc9-6625-46b7-90d0-52c50f9b73e6] Instance destroyed successfully.
Aug 17 11:54:04 user nova-compute[73449]: DEBUG nova.objects.instance [None req-c680e58a-28e8-413d-af39-9d02140be452 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Lazy-loading 'resources' on Instance uuid 9e689bc9-6625-46b7-90d0-52c50f9b73e6 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:54:04 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:54:04 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-c680e58a-28e8-413d-af39-9d02140be452 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:51:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1399464348',display_name='tempest-VolumesSnapshotTestJSON-instance-1399464348',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1399464348',id=29,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPmavZYYqznf3Yd/qhYLmK2E1i3d9bVWspYCaKhSmEwiuWpwC0dL6Va7IUZ+OY5YCQy+ngJfPupmVDo/Hvga1LgbFxTILMHuFleJawMfA7RHUiTElw0JRF+ztS3k9us+xw==',key_name='tempest-keypair-1459240909',keypairs=<?>,launch_index=0,launched_at=2023-08-17T11:51:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='348b0a78aaf940b98f91655ddd6d4d6d',ramdisk_id='',reservation_id='r-4a5860fs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-363415870',owner_user_name='tempest-VolumesSnapshotTestJSON-363415870-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T11:51:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='24c0eff502f744ad8eb6359e320852d4',uuid=9e689bc9-6625-46b7-90d0-52c50f9b73e6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7de7b2c0-d9e0-4e1a-bf74-2a477c16b514", "address": "fa:16:3e:08:89:a4", "network": {"id": "bae20193-cae3-45f8-8881-68020cd853e9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-459774400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "348b0a78aaf940b98f91655ddd6d4d6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7de7b2c0-d9", "ovs_interfaceid": "7de7b2c0-d9e0-4e1a-bf74-2a477c16b514", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 11:54:04 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-c680e58a-28e8-413d-af39-9d02140be452 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Converting VIF {"id": "7de7b2c0-d9e0-4e1a-bf74-2a477c16b514", "address": "fa:16:3e:08:89:a4", "network": {"id": "bae20193-cae3-45f8-8881-68020cd853e9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-459774400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "348b0a78aaf940b98f91655ddd6d4d6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7de7b2c0-d9", "ovs_interfaceid": "7de7b2c0-d9e0-4e1a-bf74-2a477c16b514", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:54:04 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-c680e58a-28e8-413d-af39-9d02140be452 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:08:89:a4,bridge_name='br-int',has_traffic_filtering=True,id=7de7b2c0-d9e0-4e1a-bf74-2a477c16b514,network=Network(bae20193-cae3-45f8-8881-68020cd853e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7de7b2c0-d9') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:54:04 user nova-compute[73449]: DEBUG os_vif [None req-c680e58a-28e8-413d-af39-9d02140be452 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:89:a4,bridge_name='br-int',has_traffic_filtering=True,id=7de7b2c0-d9e0-4e1a-bf74-2a477c16b514,network=Network(bae20193-cae3-45f8-8881-68020cd853e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7de7b2c0-d9') {{(pid=73449) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 11:54:04 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:54:04 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:54:04 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7de7b2c0-d9, bridge=br-int, if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:54:04 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:54:04 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:54:04 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:54:04 user nova-compute[73449]: INFO os_vif [None req-c680e58a-28e8-413d-af39-9d02140be452 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:89:a4,bridge_name='br-int',has_traffic_filtering=True,id=7de7b2c0-d9e0-4e1a-bf74-2a477c16b514,network=Network(bae20193-cae3-45f8-8881-68020cd853e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7de7b2c0-d9')
Aug 17 11:54:04 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c680e58a-28e8-413d-af39-9d02140be452 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] [instance: 9e689bc9-6625-46b7-90d0-52c50f9b73e6] calling os-brick to detach iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 11:54:04 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-c680e58a-28e8-413d-af39-9d02140be452 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, {'target_iqns': ['iqn.2010-10.org.openstack:674238ab-cc2c-41a5-a152-8937a50e5526'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cOZitMmv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 11:54:04 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-c680e58a-28e8-413d-af39-9d02140be452 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 11:54:04 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-c680e58a-28e8-413d-af39-9d02140be452 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:54:04 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.459s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:54:04 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] <== connect_volume: return (1462ms) {'type': 'block', 'scsi_wwn': '26133656162363930', 'path': '/dev/sdd'} {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 11:54:04 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26133656162363930', 'path': '/dev/sdd'} {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 11:54:04 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-c680e58a-28e8-413d-af39-9d02140be452 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.702s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:54:04 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-c680e58a-28e8-413d-af39-9d02140be452 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:674238ab-cc2c-41a5-a152-8937a50e5526', 0)] {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 11:54:04 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:54:04 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:51:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1060578378',display_name='tempest-ServerActionsTestOtherA-server-1060578378',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1060578378',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCjLihiqnR89DD+L9AvKMPg4aJ24FTEbroZyaBsKATQAbGhLg8fsSlSGdiYIhidGfsmIAOo7d+B78UcRA6oBB5kBwNop43IFNlD0zoDm7uS+jBpAFARKuZg2/qBioB0EGg==',key_name='tempest-keypair-71173965',keypairs=<?>,launch_index=0,launched_at=2023-08-17T11:52:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='068c5270255744a18208a0ad9b35f168',ramdisk_id='',reservation_id='r-ycvaidk7',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-303961666',owner_user_name='tempest-ServerActionsTestOtherA-303961666-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T11:53:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e44f6d8893da4d95a8ebe95180355c04',uuid=b32df06e-0b5a-4384-946b-64d64aeeb07e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4a57c385-a0c8-454a-acbf-d1f783ff3131", "address": "fa:16:3e:be:34:a2", "network": {"id": "72c50a42-688f-4868-8e19-c40b103a49cd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1792423641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1792423641-network", "vif_mac": "fa:16:3e:be:34:a2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "068c5270255744a18208a0ad9b35f168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a57c385-a0", "ovs_interfaceid": "4a57c385-a0c8-454a-acbf-d1f783ff3131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73449) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 11:54:04 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Converting VIF {"id": "4a57c385-a0c8-454a-acbf-d1f783ff3131", "address": "fa:16:3e:be:34:a2", "network": {"id": "72c50a42-688f-4868-8e19-c40b103a49cd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1792423641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1792423641-network", "vif_mac": "fa:16:3e:be:34:a2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "068c5270255744a18208a0ad9b35f168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a57c385-a0", "ovs_interfaceid": "4a57c385-a0c8-454a-acbf-d1f783ff3131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:54:04 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:34:a2,bridge_name='br-int',has_traffic_filtering=True,id=4a57c385-a0c8-454a-acbf-d1f783ff3131,network=Network(72c50a42-688f-4868-8e19-c40b103a49cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a57c385-a0') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:54:04 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] End _get_guest_xml xml=<domain type="kvm">
Aug 17 11:54:04 user nova-compute[73449]:   <uuid>b32df06e-0b5a-4384-946b-64d64aeeb07e</uuid>
Aug 17 11:54:04 user nova-compute[73449]:   <name>instance-0000001f</name>
Aug 17 11:54:04 user nova-compute[73449]:   <memory>2097152</memory>
Aug 17 11:54:04 user nova-compute[73449]:   <vcpu>1</vcpu>
Aug 17 11:54:04 user nova-compute[73449]:   <metadata>
Aug 17 11:54:04 user nova-compute[73449]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 11:54:04 user nova-compute[73449]:       <nova:package version="0.0.0"/>
Aug 17 11:54:04 user nova-compute[73449]:       <nova:name>tempest-ServerActionsTestOtherA-server-1060578378</nova:name>
Aug 17 11:54:04 user nova-compute[73449]:       <nova:creationTime>2023-08-17 11:54:03</nova:creationTime>
Aug 17 11:54:04 user nova-compute[73449]:       <nova:flavor name="m1.small">
Aug 17 11:54:04 user nova-compute[73449]:         <nova:memory>2048</nova:memory>
Aug 17 11:54:04 user nova-compute[73449]:         <nova:disk>20</nova:disk>
Aug 17 11:54:04 user nova-compute[73449]:         <nova:swap>0</nova:swap>
Aug 17 11:54:04 user nova-compute[73449]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 11:54:04 user nova-compute[73449]:         <nova:vcpus>1</nova:vcpus>
Aug 17 11:54:04 user nova-compute[73449]:       </nova:flavor>
Aug 17 11:54:04 user nova-compute[73449]:       <nova:owner>
Aug 17 11:54:04 user nova-compute[73449]:         <nova:user uuid="e44f6d8893da4d95a8ebe95180355c04">tempest-ServerActionsTestOtherA-303961666-project-member</nova:user>
Aug 17 11:54:04 user nova-compute[73449]:         <nova:project uuid="068c5270255744a18208a0ad9b35f168">tempest-ServerActionsTestOtherA-303961666</nova:project>
Aug 17 11:54:04 user nova-compute[73449]:       </nova:owner>
Aug 17 11:54:04 user nova-compute[73449]:       <nova:ports>
Aug 17 11:54:04 user nova-compute[73449]:         <nova:port uuid="4a57c385-a0c8-454a-acbf-d1f783ff3131">
Aug 17 11:54:04 user nova-compute[73449]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 17 11:54:04 user nova-compute[73449]:         </nova:port>
Aug 17 11:54:04 user nova-compute[73449]:       </nova:ports>
Aug 17 11:54:04 user nova-compute[73449]:     </nova:instance>
Aug 17 11:54:04 user nova-compute[73449]:   </metadata>
Aug 17 11:54:04 user nova-compute[73449]:   <sysinfo type="smbios">
Aug 17 11:54:04 user nova-compute[73449]:     <system>
Aug 17 11:54:04 user nova-compute[73449]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 11:54:04 user nova-compute[73449]:       <entry name="product">OpenStack Nova</entry>
Aug 17 11:54:04 user nova-compute[73449]:       <entry name="version">0.0.0</entry>
Aug 17 11:54:04 user nova-compute[73449]:       <entry name="serial">b32df06e-0b5a-4384-946b-64d64aeeb07e</entry>
Aug 17 11:54:04 user nova-compute[73449]:       <entry name="uuid">b32df06e-0b5a-4384-946b-64d64aeeb07e</entry>
Aug 17 11:54:04 user nova-compute[73449]:       <entry name="family">Virtual Machine</entry>
Aug 17 11:54:04 user nova-compute[73449]:     </system>
Aug 17 11:54:04 user nova-compute[73449]:   </sysinfo>
Aug 17 11:54:04 user nova-compute[73449]:   <os>
Aug 17 11:54:04 user nova-compute[73449]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 11:54:04 user nova-compute[73449]:     <boot dev="hd"/>
Aug 17 11:54:04 user nova-compute[73449]:     <smbios mode="sysinfo"/>
Aug 17 11:54:04 user nova-compute[73449]:   </os>
Aug 17 11:54:04 user nova-compute[73449]:   <features>
Aug 17 11:54:04 user nova-compute[73449]:     <acpi/>
Aug 17 11:54:04 user nova-compute[73449]:     <apic/>
Aug 17 11:54:04 user nova-compute[73449]:     <vmcoreinfo/>
Aug 17 11:54:04 user nova-compute[73449]:   </features>
Aug 17 11:54:04 user nova-compute[73449]:   <clock offset="utc">
Aug 17 11:54:04 user nova-compute[73449]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 11:54:04 user nova-compute[73449]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 11:54:04 user nova-compute[73449]:     <timer name="hpet" present="no"/>
Aug 17 11:54:04 user nova-compute[73449]:   </clock>
Aug 17 11:54:04 user nova-compute[73449]:   <cpu mode="custom" match="exact">
Aug 17 11:54:04 user nova-compute[73449]:     <model>Nehalem</model>
Aug 17 11:54:04 user nova-compute[73449]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 11:54:04 user nova-compute[73449]:   </cpu>
Aug 17 11:54:04 user nova-compute[73449]:   <devices>
Aug 17 11:54:04 user nova-compute[73449]:     <disk type="block" device="disk">
Aug 17 11:54:04 user nova-compute[73449]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 11:54:04 user nova-compute[73449]:       <source dev="/dev/sdd"/>
Aug 17 11:54:04 user nova-compute[73449]:       <target dev="vda" bus="virtio"/>
Aug 17 11:54:04 user nova-compute[73449]:       <serial>3724ddd1-6668-4637-a4f2-175cf033a0f7</serial>
Aug 17 11:54:04 user nova-compute[73449]:     </disk>
Aug 17 11:54:04 user nova-compute[73449]:     <interface type="ethernet">
Aug 17 11:54:04 user nova-compute[73449]:       <mac address="fa:16:3e:be:34:a2"/>
Aug 17 11:54:04 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 11:54:04 user nova-compute[73449]:       <mtu size="1442"/>
Aug 17 11:54:04 user nova-compute[73449]:       <target dev="tap4a57c385-a0"/>
Aug 17 11:54:04 user nova-compute[73449]:     </interface>
Aug 17 11:54:04 user nova-compute[73449]:     <serial type="pty">
Aug 17 11:54:04 user nova-compute[73449]:       <log file="/opt/stack/data/nova/instances/b32df06e-0b5a-4384-946b-64d64aeeb07e/console.log" append="off"/>
Aug 17 11:54:04 user nova-compute[73449]:     </serial>
Aug 17 11:54:04 user nova-compute[73449]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 11:54:04 user nova-compute[73449]:     <video>
Aug 17 11:54:04 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 11:54:04 user nova-compute[73449]:     </video>
Aug 17 11:54:04 user nova-compute[73449]:     <rng model="virtio">
Aug 17 11:54:04 user nova-compute[73449]:       <backend model="random">/dev/urandom</backend>
Aug 17 11:54:04 user nova-compute[73449]:     </rng>
Aug 17 11:54:04 user nova-compute[73449]:     <controller type="usb" index="0" model="none"/>
Aug 17 11:54:04 user nova-compute[73449]:     <memballoon model="virtio">
Aug 17 11:54:04 user nova-compute[73449]:       <stats period="10"/>
Aug 17 11:54:04 user nova-compute[73449]:     </memballoon>
Aug 17 11:54:04 user nova-compute[73449]:   </devices>
Aug 17 11:54:04 user nova-compute[73449]: </domain>
Aug 17 11:54:04 user nova-compute[73449]:  {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 11:54:04 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:51:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1060578378',display_name='tempest-ServerActionsTestOtherA-server-1060578378',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1060578378',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCjLihiqnR89DD+L9AvKMPg4aJ24FTEbroZyaBsKATQAbGhLg8fsSlSGdiYIhidGfsmIAOo7d+B78UcRA6oBB5kBwNop43IFNlD0zoDm7uS+jBpAFARKuZg2/qBioB0EGg==',key_name='tempest-keypair-71173965',keypairs=<?>,launch_index=0,launched_at=2023-08-17T11:52:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='068c5270255744a18208a0ad9b35f168',ramdisk_id='',reservation_id='r-ycvaidk7',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-303961666',owner_user_name='tempest-ServerActionsTestOtherA-303961666-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T11:53:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e44f6d8893da4d95a8ebe95180355c04',uuid=b32df06e-0b5a-4384-946b-64d64aeeb07e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4a57c385-a0c8-454a-acbf-d1f783ff3131", "address": "fa:16:3e:be:34:a2", "network": {"id": "72c50a42-688f-4868-8e19-c40b103a49cd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1792423641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1792423641-network", "vif_mac": "fa:16:3e:be:34:a2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "068c5270255744a18208a0ad9b35f168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a57c385-a0", "ovs_interfaceid": "4a57c385-a0c8-454a-acbf-d1f783ff3131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 11:54:04 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Converting VIF {"id": "4a57c385-a0c8-454a-acbf-d1f783ff3131", "address": "fa:16:3e:be:34:a2", "network": {"id": "72c50a42-688f-4868-8e19-c40b103a49cd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1792423641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1792423641-network", "vif_mac": "fa:16:3e:be:34:a2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "068c5270255744a18208a0ad9b35f168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a57c385-a0", "ovs_interfaceid": "4a57c385-a0c8-454a-acbf-d1f783ff3131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:54:04 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:34:a2,bridge_name='br-int',has_traffic_filtering=True,id=4a57c385-a0c8-454a-acbf-d1f783ff3131,network=Network(72c50a42-688f-4868-8e19-c40b103a49cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a57c385-a0') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:54:04 user nova-compute[73449]: DEBUG os_vif [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:34:a2,bridge_name='br-int',has_traffic_filtering=True,id=4a57c385-a0c8-454a-acbf-d1f783ff3131,network=Network(72c50a42-688f-4868-8e19-c40b103a49cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a57c385-a0') {{(pid=73449) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 11:54:04 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:54:04 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fffd9db-6bd3-406d-9c25-55c3d39befa7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a382874-91aa-4ff2-aae4-15db10fe5ff2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc855d21-60f9-4798-aecf-44a569bf0a11\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:54:04 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:54:04 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:54:04 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 11:54:04 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:54:04 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:54:04 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4a57c385-a0, may_exist=True, interface_attrs={}) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:54:04 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4a57c385-a0, col_values=(('external_ids', {'iface-id': '4a57c385-a0c8-454a-acbf-d1f783ff3131', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:be:34:a2', 'vm-uuid': 'b32df06e-0b5a-4384-946b-64d64aeeb07e'}),), if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:54:04 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:54:04 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:54:04 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:54:04 user nova-compute[73449]: INFO os_vif [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:34:a2,bridge_name='br-int',has_traffic_filtering=True,id=4a57c385-a0c8-454a-acbf-d1f783ff3131,network=Network(72c50a42-688f-4868-8e19-c40b103a49cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a57c385-a0')
Aug 17 11:54:04 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:54:04 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c136228-40e4-48be-9fbd-82cc9fd1047a]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc855d21-60f9-4798-aecf-44a569bf0a11 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a382874-91aa-4ff2-aae4-15db10fe5ff2 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:54:04 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-c680e58a-28e8-413d-af39-9d02140be452 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 (non-flash)
Aug 17 11:54:04 user nova-compute[73449]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc855d21-60f9-4798-aecf-44a569bf0a11 (non-flash)
Aug 17 11:54:04 user nova-compute[73449]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)
Aug 17 11:54:04 user nova-compute[73449]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a382874-91aa-4ff2-aae4-15db10fe5ff2 (non-flash)
Aug 17 11:54:04 user nova-compute[73449]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 (non-flash)
Aug 17 11:54:04 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:54:04 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-c680e58a-28e8-413d-af39-9d02140be452 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 (non-flash)
Aug 17 11:54:04 user nova-compute[73449]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc855d21-60f9-4798-aecf-44a569bf0a11 (non-flash)
Aug 17 11:54:04 user nova-compute[73449]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)
Aug 17 11:54:04 user nova-compute[73449]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a382874-91aa-4ff2-aae4-15db10fe5ff2 (non-flash)
Aug 17 11:54:04 user nova-compute[73449]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 (non-flash)
Aug 17 11:54:04 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:54:04 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-c680e58a-28e8-413d-af39-9d02140be452 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe758107e20>, {}) {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 11:54:04 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-c680e58a-28e8-413d-af39-9d02140be452 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Disconnecting from: [] {{(pid=73449) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 11:54:04 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-c680e58a-28e8-413d-af39-9d02140be452 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.069s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:54:04 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-c680e58a-28e8-413d-af39-9d02140be452 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] <== disconnect_volume: return (771ms) None {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 11:54:04 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c680e58a-28e8-413d-af39-9d02140be452 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] [instance: 9e689bc9-6625-46b7-90d0-52c50f9b73e6] Disconnected iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 11:54:04 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-c680e58a-28e8-413d-af39-9d02140be452 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] [instance: 9e689bc9-6625-46b7-90d0-52c50f9b73e6] Deleting instance files /opt/stack/data/nova/instances/9e689bc9-6625-46b7-90d0-52c50f9b73e6_del
Aug 17 11:54:04 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-c680e58a-28e8-413d-af39-9d02140be452 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] [instance: 9e689bc9-6625-46b7-90d0-52c50f9b73e6] Deletion of /opt/stack/data/nova/instances/9e689bc9-6625-46b7-90d0-52c50f9b73e6_del complete
Aug 17 11:54:04 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] No BDM found with device name vda, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 11:54:04 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] No VIF found with MAC fa:16:3e:be:34:a2, not building metadata {{(pid=73449) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 11:54:04 user nova-compute[73449]: INFO nova.compute.manager [None req-c680e58a-28e8-413d-af39-9d02140be452 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] [instance: 9e689bc9-6625-46b7-90d0-52c50f9b73e6] Took 1.75 seconds to destroy the instance on the hypervisor.
Aug 17 11:54:04 user nova-compute[73449]: DEBUG oslo.service.loopingcall [None req-c680e58a-28e8-413d-af39-9d02140be452 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73449) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 11:54:04 user nova-compute[73449]: DEBUG nova.compute.manager [-] [instance: 9e689bc9-6625-46b7-90d0-52c50f9b73e6] Deallocating network for instance {{(pid=73449) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 11:54:04 user nova-compute[73449]: DEBUG nova.network.neutron [-] [instance: 9e689bc9-6625-46b7-90d0-52c50f9b73e6] deallocate_for_instance() {{(pid=73449) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 11:54:05 user nova-compute[73449]: DEBUG nova.compute.manager [req-814bf715-8e0c-405e-aedc-ab3f23bc3c57 req-95dc5e8b-c312-47c0-b5ee-d0094c459810 service nova] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] Received event network-vif-plugged-e1cb1992-df66-4253-ba1f-3c30647c61de {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:54:05 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-814bf715-8e0c-405e-aedc-ab3f23bc3c57 req-95dc5e8b-c312-47c0-b5ee-d0094c459810 service nova] Acquiring lock "01ef4274-dfa1-4f7d-a24c-a1686b692f70-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:54:05 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-814bf715-8e0c-405e-aedc-ab3f23bc3c57 req-95dc5e8b-c312-47c0-b5ee-d0094c459810 service nova] Lock "01ef4274-dfa1-4f7d-a24c-a1686b692f70-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:54:05 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-814bf715-8e0c-405e-aedc-ab3f23bc3c57 req-95dc5e8b-c312-47c0-b5ee-d0094c459810 service nova] Lock "01ef4274-dfa1-4f7d-a24c-a1686b692f70-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:54:05 user nova-compute[73449]: DEBUG nova.compute.manager [req-814bf715-8e0c-405e-aedc-ab3f23bc3c57 req-95dc5e8b-c312-47c0-b5ee-d0094c459810 service nova] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] No waiting events found dispatching network-vif-plugged-e1cb1992-df66-4253-ba1f-3c30647c61de {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:54:05 user nova-compute[73449]: WARNING nova.compute.manager [req-814bf715-8e0c-405e-aedc-ab3f23bc3c57 req-95dc5e8b-c312-47c0-b5ee-d0094c459810 service nova] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] Received unexpected event network-vif-plugged-e1cb1992-df66-4253-ba1f-3c30647c61de for instance with vm_state active and task_state reboot_started.
Aug 17 11:54:05 user nova-compute[73449]: DEBUG nova.compute.manager [req-814bf715-8e0c-405e-aedc-ab3f23bc3c57 req-95dc5e8b-c312-47c0-b5ee-d0094c459810 service nova] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] Received event network-vif-plugged-e1cb1992-df66-4253-ba1f-3c30647c61de {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:54:05 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-814bf715-8e0c-405e-aedc-ab3f23bc3c57 req-95dc5e8b-c312-47c0-b5ee-d0094c459810 service nova] Acquiring lock "01ef4274-dfa1-4f7d-a24c-a1686b692f70-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:54:05 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-814bf715-8e0c-405e-aedc-ab3f23bc3c57 req-95dc5e8b-c312-47c0-b5ee-d0094c459810 service nova] Lock "01ef4274-dfa1-4f7d-a24c-a1686b692f70-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:54:05 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-814bf715-8e0c-405e-aedc-ab3f23bc3c57 req-95dc5e8b-c312-47c0-b5ee-d0094c459810 service nova] Lock "01ef4274-dfa1-4f7d-a24c-a1686b692f70-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:54:05 user nova-compute[73449]: DEBUG nova.compute.manager [req-814bf715-8e0c-405e-aedc-ab3f23bc3c57 req-95dc5e8b-c312-47c0-b5ee-d0094c459810 service nova] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] No waiting events found dispatching network-vif-plugged-e1cb1992-df66-4253-ba1f-3c30647c61de {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:54:05 user nova-compute[73449]: WARNING nova.compute.manager [req-814bf715-8e0c-405e-aedc-ab3f23bc3c57 req-95dc5e8b-c312-47c0-b5ee-d0094c459810 service nova] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] Received unexpected event network-vif-plugged-e1cb1992-df66-4253-ba1f-3c30647c61de for instance with vm_state active and task_state reboot_started.
Aug 17 11:54:05 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Removed pending event for 01ef4274-dfa1-4f7d-a24c-a1686b692f70 due to event {{(pid=73449) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 17 11:54:05 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692273245.4088652, 01ef4274-dfa1-4f7d-a24c-a1686b692f70 => Resumed> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:54:05 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] VM Resumed (Lifecycle Event)
Aug 17 11:54:05 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] Instance running successfully.
Aug 17 11:54:05 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-c4b5c72a-93c7-46d9-b93e-888590cee90d tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] Instance soft rebooted successfully.
Aug 17 11:54:05 user nova-compute[73449]: DEBUG nova.compute.manager [None req-c4b5c72a-93c7-46d9-b93e-888590cee90d tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:54:05 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:54:05 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 11:54:05 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] During sync_power_state the instance has a pending task (reboot_started). Skip.
Aug 17 11:54:05 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692273245.413116, 01ef4274-dfa1-4f7d-a24c-a1686b692f70 => Started> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:54:05 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] VM Started (Lifecycle Event)
Aug 17 11:54:05 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:54:05 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 11:54:05 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-c4b5c72a-93c7-46d9-b93e-888590cee90d tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Lock "01ef4274-dfa1-4f7d-a24c-a1686b692f70" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.669s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:54:05 user nova-compute[73449]: DEBUG nova.compute.manager [req-f104eb83-3451-496d-abfc-d51455d00692 req-0171c1ea-0993-487f-b132-1ac1411e3e8f service nova] [instance: 9e689bc9-6625-46b7-90d0-52c50f9b73e6] Received event network-vif-plugged-7de7b2c0-d9e0-4e1a-bf74-2a477c16b514 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:54:05 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-f104eb83-3451-496d-abfc-d51455d00692 req-0171c1ea-0993-487f-b132-1ac1411e3e8f service nova] Acquiring lock "9e689bc9-6625-46b7-90d0-52c50f9b73e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:54:05 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-f104eb83-3451-496d-abfc-d51455d00692 req-0171c1ea-0993-487f-b132-1ac1411e3e8f service nova] Lock "9e689bc9-6625-46b7-90d0-52c50f9b73e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:54:05 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-f104eb83-3451-496d-abfc-d51455d00692 req-0171c1ea-0993-487f-b132-1ac1411e3e8f service nova] Lock "9e689bc9-6625-46b7-90d0-52c50f9b73e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:54:05 user nova-compute[73449]: DEBUG nova.compute.manager [req-f104eb83-3451-496d-abfc-d51455d00692 req-0171c1ea-0993-487f-b132-1ac1411e3e8f service nova] [instance: 9e689bc9-6625-46b7-90d0-52c50f9b73e6] No waiting events found dispatching network-vif-plugged-7de7b2c0-d9e0-4e1a-bf74-2a477c16b514 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:54:05 user nova-compute[73449]: WARNING nova.compute.manager [req-f104eb83-3451-496d-abfc-d51455d00692 req-0171c1ea-0993-487f-b132-1ac1411e3e8f service nova] [instance: 9e689bc9-6625-46b7-90d0-52c50f9b73e6] Received unexpected event network-vif-plugged-7de7b2c0-d9e0-4e1a-bf74-2a477c16b514 for instance with vm_state active and task_state deleting.
Aug 17 11:54:05 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:54:06 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:54:06 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:54:06 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:54:06 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=73449) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 11:54:06 user nova-compute[73449]: DEBUG nova.network.neutron [-] [instance: 9e689bc9-6625-46b7-90d0-52c50f9b73e6] Updating instance_info_cache with network_info: [] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:54:06 user nova-compute[73449]: INFO nova.compute.manager [-] [instance: 9e689bc9-6625-46b7-90d0-52c50f9b73e6] Took 1.17 seconds to deallocate network for instance.
Aug 17 11:54:06 user nova-compute[73449]: DEBUG nova.compute.manager [req-22df70a0-6fba-411e-90ca-19d4a8d502a0 req-f2afd34f-1427-4a2c-91d1-5b4d4687456b service nova] [instance: 9e689bc9-6625-46b7-90d0-52c50f9b73e6] Received event network-vif-deleted-7de7b2c0-d9e0-4e1a-bf74-2a477c16b514 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:54:06 user nova-compute[73449]: INFO nova.compute.manager [req-22df70a0-6fba-411e-90ca-19d4a8d502a0 req-f2afd34f-1427-4a2c-91d1-5b4d4687456b service nova] [instance: 9e689bc9-6625-46b7-90d0-52c50f9b73e6] Neutron deleted interface 7de7b2c0-d9e0-4e1a-bf74-2a477c16b514; detaching it from the instance and deleting it from the info cache
Aug 17 11:54:06 user nova-compute[73449]: DEBUG nova.network.neutron [req-22df70a0-6fba-411e-90ca-19d4a8d502a0 req-f2afd34f-1427-4a2c-91d1-5b4d4687456b service nova] [instance: 9e689bc9-6625-46b7-90d0-52c50f9b73e6] Updating instance_info_cache with network_info: [] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:54:06 user nova-compute[73449]: DEBUG nova.compute.manager [req-22df70a0-6fba-411e-90ca-19d4a8d502a0 req-f2afd34f-1427-4a2c-91d1-5b4d4687456b service nova] [instance: 9e689bc9-6625-46b7-90d0-52c50f9b73e6] Detach interface failed, port_id=7de7b2c0-d9e0-4e1a-bf74-2a477c16b514, reason: Instance 9e689bc9-6625-46b7-90d0-52c50f9b73e6 could not be found. {{(pid=73449) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 11:54:06 user nova-compute[73449]: WARNING nova.volume.cinder [None req-c680e58a-28e8-413d-af39-9d02140be452 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Attachment 8e882bd5-0d2f-41ce-a10c-84fcf4c89bce does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 8e882bd5-0d2f-41ce-a10c-84fcf4c89bce. (HTTP 404) (Request-ID: req-965c205a-d2b0-4a5e-8edd-bf0c40dc8c4b)
Aug 17 11:54:06 user nova-compute[73449]: INFO nova.compute.manager [None req-c680e58a-28e8-413d-af39-9d02140be452 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] [instance: 9e689bc9-6625-46b7-90d0-52c50f9b73e6] Took 0.03 seconds to detach 1 volumes for instance.
Aug 17 11:54:06 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-c680e58a-28e8-413d-af39-9d02140be452 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:54:06 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-c680e58a-28e8-413d-af39-9d02140be452 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:54:06 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:54:06 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:54:06 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:54:06 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:54:06 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:54:06 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:54:06 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-c680e58a-28e8-413d-af39-9d02140be452 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 11:54:06 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-c680e58a-28e8-413d-af39-9d02140be452 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 11:54:06 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-c680e58a-28e8-413d-af39-9d02140be452 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.655s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:54:06 user nova-compute[73449]: INFO nova.scheduler.client.report [None req-c680e58a-28e8-413d-af39-9d02140be452 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Deleted allocations for instance 9e689bc9-6625-46b7-90d0-52c50f9b73e6
Aug 17 11:54:07 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-c680e58a-28e8-413d-af39-9d02140be452 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Lock "9e689bc9-6625-46b7-90d0-52c50f9b73e6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.865s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:54:07 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd4ec7bd-002e-4a71-9314-96c21427af27/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:54:07 user nova-compute[73449]: DEBUG nova.compute.manager [req-bf3ca6a7-0fef-41c5-bc36-cd3528471165 req-b46d59b5-385e-408f-b3e0-b4d7da1f9e65 service nova] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] Received event network-vif-plugged-4a57c385-a0c8-454a-acbf-d1f783ff3131 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:54:07 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-bf3ca6a7-0fef-41c5-bc36-cd3528471165 req-b46d59b5-385e-408f-b3e0-b4d7da1f9e65 service nova] Acquiring lock "b32df06e-0b5a-4384-946b-64d64aeeb07e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:54:07 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-bf3ca6a7-0fef-41c5-bc36-cd3528471165 req-b46d59b5-385e-408f-b3e0-b4d7da1f9e65 service nova] Lock "b32df06e-0b5a-4384-946b-64d64aeeb07e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:54:07 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-bf3ca6a7-0fef-41c5-bc36-cd3528471165 req-b46d59b5-385e-408f-b3e0-b4d7da1f9e65 service nova] Lock "b32df06e-0b5a-4384-946b-64d64aeeb07e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:54:07 user nova-compute[73449]: DEBUG nova.compute.manager [req-bf3ca6a7-0fef-41c5-bc36-cd3528471165 req-b46d59b5-385e-408f-b3e0-b4d7da1f9e65 service nova] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] No waiting events found dispatching network-vif-plugged-4a57c385-a0c8-454a-acbf-d1f783ff3131 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:54:07 user nova-compute[73449]: WARNING nova.compute.manager [req-bf3ca6a7-0fef-41c5-bc36-cd3528471165 req-b46d59b5-385e-408f-b3e0-b4d7da1f9e65 service nova] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] Received unexpected event network-vif-plugged-4a57c385-a0c8-454a-acbf-d1f783ff3131 for instance with vm_state active and task_state resize_finish.
Aug 17 11:54:07 user nova-compute[73449]: DEBUG nova.compute.manager [req-bf3ca6a7-0fef-41c5-bc36-cd3528471165 req-b46d59b5-385e-408f-b3e0-b4d7da1f9e65 service nova] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] Received event network-vif-plugged-4a57c385-a0c8-454a-acbf-d1f783ff3131 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:54:07 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-bf3ca6a7-0fef-41c5-bc36-cd3528471165 req-b46d59b5-385e-408f-b3e0-b4d7da1f9e65 service nova] Acquiring lock "b32df06e-0b5a-4384-946b-64d64aeeb07e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:54:07 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-bf3ca6a7-0fef-41c5-bc36-cd3528471165 req-b46d59b5-385e-408f-b3e0-b4d7da1f9e65 service nova] Lock "b32df06e-0b5a-4384-946b-64d64aeeb07e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:54:07 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-bf3ca6a7-0fef-41c5-bc36-cd3528471165 req-b46d59b5-385e-408f-b3e0-b4d7da1f9e65 service nova] Lock "b32df06e-0b5a-4384-946b-64d64aeeb07e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:54:07 user nova-compute[73449]: DEBUG nova.compute.manager [req-bf3ca6a7-0fef-41c5-bc36-cd3528471165 req-b46d59b5-385e-408f-b3e0-b4d7da1f9e65 service nova] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] No waiting events found dispatching network-vif-plugged-4a57c385-a0c8-454a-acbf-d1f783ff3131 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:54:07 user nova-compute[73449]: WARNING nova.compute.manager [req-bf3ca6a7-0fef-41c5-bc36-cd3528471165 req-b46d59b5-385e-408f-b3e0-b4d7da1f9e65 service nova] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] Received unexpected event network-vif-plugged-4a57c385-a0c8-454a-acbf-d1f783ff3131 for instance with vm_state active and task_state resize_finish.
Aug 17 11:54:07 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd4ec7bd-002e-4a71-9314-96c21427af27/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:54:07 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd4ec7bd-002e-4a71-9314-96c21427af27/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:54:07 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd4ec7bd-002e-4a71-9314-96c21427af27/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:54:07 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fea9f81c-a848-4a65-863e-e09dddf65bcf/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:54:07 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fea9f81c-a848-4a65-863e-e09dddf65bcf/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:54:07 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fea9f81c-a848-4a65-863e-e09dddf65bcf/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:54:07 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fea9f81c-a848-4a65-863e-e09dddf65bcf/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:54:07 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] skipping disk /dev/sdc (vdc) as it is a volume {{(pid=73449) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 11:54:07 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a9e8ad2-19db-4975-87e4-2efce603a7d7/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:54:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a9e8ad2-19db-4975-87e4-2efce603a7d7/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:54:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a9e8ad2-19db-4975-87e4-2efce603a7d7/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:54:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a9e8ad2-19db-4975-87e4-2efce603a7d7/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:54:08 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:54:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk.rescue --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:54:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk.rescue --force-share --output=json" returned: 0 in 0.251s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:54:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk.rescue --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:54:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:54:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:54:08 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692273248.785917, b32df06e-0b5a-4384-946b-64d64aeeb07e => Resumed> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:54:08 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] VM Resumed (Lifecycle Event)
Aug 17 11:54:08 user nova-compute[73449]: DEBUG nova.compute.manager [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] Instance event wait completed in 0 seconds for  {{(pid=73449) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 11:54:08 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] Instance running successfully.
Aug 17 11:54:08 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] Failed to set time: agent not configured {{(pid=73449) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 17 11:54:08 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-12604986-6b32-4dd4-bf15-c009c3802d37 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] finish_migration finished successfully. {{(pid=73449) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 17 11:54:08 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:54:08 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 11:54:08 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 17 11:54:08 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692273248.786937, b32df06e-0b5a-4384-946b-64d64aeeb07e => Started> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:54:08 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] VM Started (Lifecycle Event)
Aug 17 11:54:08 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:54:08 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 11:54:08 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 17 11:54:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:54:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:54:09 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:54:09 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73449) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 11:54:09 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73449) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 11:54:09 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef4274-dfa1-4f7d-a24c-a1686b692f70/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:54:09 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef4274-dfa1-4f7d-a24c-a1686b692f70/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:54:09 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef4274-dfa1-4f7d-a24c-a1686b692f70/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:54:09 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef4274-dfa1-4f7d-a24c-a1686b692f70/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:54:09 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=73449) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 11:54:09 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d74c8f6-fb4e-4460-b722-674a8a1e2d25/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:54:09 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d74c8f6-fb4e-4460-b722-674a8a1e2d25/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:54:09 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d74c8f6-fb4e-4460-b722-674a8a1e2d25/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:54:09 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:54:09 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d74c8f6-fb4e-4460-b722-674a8a1e2d25/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:54:09 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89440604-1daf-4e7a-a524-2f9c21a9cb96/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:54:10 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89440604-1daf-4e7a-a524-2f9c21a9cb96/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:54:10 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89440604-1daf-4e7a-a524-2f9c21a9cb96/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:54:10 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89440604-1daf-4e7a-a524-2f9c21a9cb96/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:54:10 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d468854-6182-49c8-acb7-0641df2d5219/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:54:10 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d468854-6182-49c8-acb7-0641df2d5219/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:54:10 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d468854-6182-49c8-acb7-0641df2d5219/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:54:10 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d468854-6182-49c8-acb7-0641df2d5219/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:54:10 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73449) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 11:54:11 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:54:11 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:54:11 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:54:11 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Hypervisor/Node resource view: name=user free_ram=7573MB free_disk=25.156578063964844GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73449) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 11:54:11 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:54:11 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:54:11 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Applying migration context for instance b32df06e-0b5a-4384-946b-64d64aeeb07e as it has an incoming, in-progress migration 8d1d7b16-326c-47fe-bda2-d62bf19a18af. Migration status is finished {{(pid=73449) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 17 11:54:11 user nova-compute[73449]: INFO nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] Updating resource usage from migration 8d1d7b16-326c-47fe-bda2-d62bf19a18af
Aug 17 11:54:11 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 4a9e8ad2-19db-4975-87e4-2efce603a7d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:54:11 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 3d74c8f6-fb4e-4460-b722-674a8a1e2d25 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:54:11 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance ae75d334-431a-4008-8b3d-f2a727d92417 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:54:11 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance dd4ec7bd-002e-4a71-9314-96c21427af27 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:54:11 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 3d468854-6182-49c8-acb7-0641df2d5219 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:54:11 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 89440604-1daf-4e7a-a524-2f9c21a9cb96 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:54:11 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 01ef4274-dfa1-4f7d-a24c-a1686b692f70 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:54:11 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance fea9f81c-a848-4a65-863e-e09dddf65bcf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:54:11 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 31f5f3d2-41d8-4a26-9eb2-18b891f94734 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:54:11 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Migration 8d1d7b16-326c-47fe-bda2-d62bf19a18af is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 17 11:54:11 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance b32df06e-0b5a-4384-946b-64d64aeeb07e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:54:11 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=73449) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 11:54:11 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=73449) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 11:54:11 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 11:54:11 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 11:54:11 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Compute_service record updated for user:user {{(pid=73449) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 11:54:11 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.551s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:54:13 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:54:14 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:54:19 user nova-compute[73449]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692273244.0104501, 9e689bc9-6625-46b7-90d0-52c50f9b73e6 => Stopped> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:54:19 user nova-compute[73449]: INFO nova.compute.manager [-] [instance: 9e689bc9-6625-46b7-90d0-52c50f9b73e6] VM Stopped (Lifecycle Event)
Aug 17 11:54:19 user nova-compute[73449]: DEBUG nova.compute.manager [None req-8907094a-5884-4fb9-a7bb-8f5eb6167415 None None] [instance: 9e689bc9-6625-46b7-90d0-52c50f9b73e6] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:54:19 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:54:23 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:54:24 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:54:25 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-29ecc1a6-26fa-4901-82a8-1a1d43f98f49 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Acquiring lock "1542e090-dffe-47d1-8bf1-bb0361cfba34" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:54:25 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-29ecc1a6-26fa-4901-82a8-1a1d43f98f49 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Lock "1542e090-dffe-47d1-8bf1-bb0361cfba34" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:54:25 user nova-compute[73449]: DEBUG nova.compute.manager [None req-29ecc1a6-26fa-4901-82a8-1a1d43f98f49 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 1542e090-dffe-47d1-8bf1-bb0361cfba34] Starting instance... {{(pid=73449) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 11:54:26 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-29ecc1a6-26fa-4901-82a8-1a1d43f98f49 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:54:26 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-29ecc1a6-26fa-4901-82a8-1a1d43f98f49 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:54:26 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-29ecc1a6-26fa-4901-82a8-1a1d43f98f49 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73449) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 11:54:26 user nova-compute[73449]: INFO nova.compute.claims [None req-29ecc1a6-26fa-4901-82a8-1a1d43f98f49 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 1542e090-dffe-47d1-8bf1-bb0361cfba34] Claim successful on node user
Aug 17 11:54:26 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-29ecc1a6-26fa-4901-82a8-1a1d43f98f49 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 11:54:26 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-29ecc1a6-26fa-4901-82a8-1a1d43f98f49 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 11:54:26 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-29ecc1a6-26fa-4901-82a8-1a1d43f98f49 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.466s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:54:26 user nova-compute[73449]: DEBUG nova.compute.manager [None req-29ecc1a6-26fa-4901-82a8-1a1d43f98f49 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 1542e090-dffe-47d1-8bf1-bb0361cfba34] Start building networks asynchronously for instance. {{(pid=73449) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 11:54:26 user nova-compute[73449]: DEBUG nova.compute.manager [None req-29ecc1a6-26fa-4901-82a8-1a1d43f98f49 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 1542e090-dffe-47d1-8bf1-bb0361cfba34] Allocating IP information in the background. {{(pid=73449) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 11:54:26 user nova-compute[73449]: DEBUG nova.network.neutron [None req-29ecc1a6-26fa-4901-82a8-1a1d43f98f49 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 1542e090-dffe-47d1-8bf1-bb0361cfba34] allocate_for_instance() {{(pid=73449) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 11:54:26 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-29ecc1a6-26fa-4901-82a8-1a1d43f98f49 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 1542e090-dffe-47d1-8bf1-bb0361cfba34] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 11:54:26 user nova-compute[73449]: DEBUG nova.compute.manager [None req-29ecc1a6-26fa-4901-82a8-1a1d43f98f49 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 1542e090-dffe-47d1-8bf1-bb0361cfba34] Start building block device mappings for instance. {{(pid=73449) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 11:54:26 user nova-compute[73449]: INFO nova.virt.block_device [None req-29ecc1a6-26fa-4901-82a8-1a1d43f98f49 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 1542e090-dffe-47d1-8bf1-bb0361cfba34] Booting with volume 2a343174-094b-4cd2-98cc-f215c047baf7 at /dev/vda
Aug 17 11:54:26 user nova-compute[73449]: DEBUG nova.policy [None req-29ecc1a6-26fa-4901-82a8-1a1d43f98f49 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '804ccb0440fb46a4a4c0ae65c3893296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd46cdaff7a4b40955f7c8a12c55452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73449) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 11:54:26 user nova-compute[73449]: DEBUG os_brick.utils [None req-29ecc1a6-26fa-4901-82a8-1a1d43f98f49 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 11:54:26 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:54:26 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:54:26 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[40d88f47-7914-4edd-a0c5-ee740ee6d684]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4d3924302012\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:54:26 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:54:26 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:54:26 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[285c0ac7-5aed-4064-8707-761770da5512]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:54:26 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:54:26 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:54:26 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[41aa2fcf-7219-409f-bf6f-52cd4c82cc9e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:54:26 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[fab67f33-209d-4468-a755-640443ae08ce]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:54:26 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-29ecc1a6-26fa-4901-82a8-1a1d43f98f49 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Running cmd (subprocess): nvme version {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:54:26 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-29ecc1a6-26fa-4901-82a8-1a1d43f98f49 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] 'nvme version' failed. Not Retrying. {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 11:54:26 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.nvmeof [None req-29ecc1a6-26fa-4901-82a8-1a1d43f98f49 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] nvme not present on system {{(pid=73449) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 11:54:26 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:54:26 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 11:54:26 user nova-compute[73449]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 11:54:26 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[64b2992e-b5fb-465d-9ee8-8f18fc637676]: (4, '') {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:54:26 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-29ecc1a6-26fa-4901-82a8-1a1d43f98f49 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73449) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 11:54:26 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-29ecc1a6-26fa-4901-82a8-1a1d43f98f49 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73449) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 11:54:26 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-29ecc1a6-26fa-4901-82a8-1a1d43f98f49 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] LIGHTOS: no hostnqn found. {{(pid=73449) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 11:54:26 user nova-compute[73449]: DEBUG os_brick.utils [None req-29ecc1a6-26fa-4901-82a8-1a1d43f98f49 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] <== get_connector_properties: return (154ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4d3924302012', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 11:54:26 user nova-compute[73449]: DEBUG nova.virt.block_device [None req-29ecc1a6-26fa-4901-82a8-1a1d43f98f49 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 1542e090-dffe-47d1-8bf1-bb0361cfba34] Updating existing volume attachment record: d68467fb-de8c-4019-b4e4-17049419a94a {{(pid=73449) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 11:54:27 user nova-compute[73449]: DEBUG nova.network.neutron [None req-29ecc1a6-26fa-4901-82a8-1a1d43f98f49 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 1542e090-dffe-47d1-8bf1-bb0361cfba34] Successfully created port: 85a7a7f3-b4c3-4ff0-810a-4cce888b99a2 {{(pid=73449) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 11:54:28 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:54:28 user nova-compute[73449]: DEBUG nova.network.neutron [None req-29ecc1a6-26fa-4901-82a8-1a1d43f98f49 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 1542e090-dffe-47d1-8bf1-bb0361cfba34] Successfully updated port: 85a7a7f3-b4c3-4ff0-810a-4cce888b99a2 {{(pid=73449) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 11:54:28 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-29ecc1a6-26fa-4901-82a8-1a1d43f98f49 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Acquiring lock "refresh_cache-1542e090-dffe-47d1-8bf1-bb0361cfba34" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:54:28 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-29ecc1a6-26fa-4901-82a8-1a1d43f98f49 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Acquired lock "refresh_cache-1542e090-dffe-47d1-8bf1-bb0361cfba34" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:54:28 user nova-compute[73449]: DEBUG nova.network.neutron [None req-29ecc1a6-26fa-4901-82a8-1a1d43f98f49 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 1542e090-dffe-47d1-8bf1-bb0361cfba34] Building network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 11:54:28 user nova-compute[73449]: DEBUG nova.compute.manager [req-eaa4c0f9-c5cb-4480-afeb-66d925711229 req-0901d432-e680-438a-9355-a7cb67775169 service nova] [instance: 1542e090-dffe-47d1-8bf1-bb0361cfba34] Received event network-changed-85a7a7f3-b4c3-4ff0-810a-4cce888b99a2 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:54:28 user nova-compute[73449]: DEBUG nova.compute.manager [req-eaa4c0f9-c5cb-4480-afeb-66d925711229 req-0901d432-e680-438a-9355-a7cb67775169 service nova] [instance: 1542e090-dffe-47d1-8bf1-bb0361cfba34] Refreshing instance network info cache due to event network-changed-85a7a7f3-b4c3-4ff0-810a-4cce888b99a2. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 11:54:28 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-eaa4c0f9-c5cb-4480-afeb-66d925711229 req-0901d432-e680-438a-9355-a7cb67775169 service nova] Acquiring lock "refresh_cache-1542e090-dffe-47d1-8bf1-bb0361cfba34" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:54:28 user nova-compute[73449]: DEBUG nova.network.neutron [None req-29ecc1a6-26fa-4901-82a8-1a1d43f98f49 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 1542e090-dffe-47d1-8bf1-bb0361cfba34] Instance cache missing network info. {{(pid=73449) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 11:54:29 user nova-compute[73449]: DEBUG nova.network.neutron [None req-29ecc1a6-26fa-4901-82a8-1a1d43f98f49 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 1542e090-dffe-47d1-8bf1-bb0361cfba34] Updating instance_info_cache with network_info: [{"id": "85a7a7f3-b4c3-4ff0-810a-4cce888b99a2", "address": "fa:16:3e:3e:33:50", "network": {"id": "a9e8fcd6-4152-466b-99ad-44b85db05a05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-920564935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bd46cdaff7a4b40955f7c8a12c55452", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85a7a7f3-b4", "ovs_interfaceid": "85a7a7f3-b4c3-4ff0-810a-4cce888b99a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:54:29 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-29ecc1a6-26fa-4901-82a8-1a1d43f98f49 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Releasing lock "refresh_cache-1542e090-dffe-47d1-8bf1-bb0361cfba34" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:54:29 user nova-compute[73449]: DEBUG nova.compute.manager [None req-29ecc1a6-26fa-4901-82a8-1a1d43f98f49 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 1542e090-dffe-47d1-8bf1-bb0361cfba34] Instance network_info: |[{"id": "85a7a7f3-b4c3-4ff0-810a-4cce888b99a2", "address": "fa:16:3e:3e:33:50", "network": {"id": "a9e8fcd6-4152-466b-99ad-44b85db05a05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-920564935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bd46cdaff7a4b40955f7c8a12c55452", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85a7a7f3-b4", "ovs_interfaceid": "85a7a7f3-b4c3-4ff0-810a-4cce888b99a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73449) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 11:54:29 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-eaa4c0f9-c5cb-4480-afeb-66d925711229 req-0901d432-e680-438a-9355-a7cb67775169 service nova] Acquired lock "refresh_cache-1542e090-dffe-47d1-8bf1-bb0361cfba34" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:54:29 user nova-compute[73449]: DEBUG nova.network.neutron [req-eaa4c0f9-c5cb-4480-afeb-66d925711229 req-0901d432-e680-438a-9355-a7cb67775169 service nova] [instance: 1542e090-dffe-47d1-8bf1-bb0361cfba34] Refreshing network info cache for port 85a7a7f3-b4c3-4ff0-810a-4cce888b99a2 {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 11:54:29 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-c59429c6-61d3-4122-8e1e-41ea1efe0ccc tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Acquiring lock "042713b8-ab7f-4c14-92e5-f830ccb7e341" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:54:29 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-c59429c6-61d3-4122-8e1e-41ea1efe0ccc tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Lock "042713b8-ab7f-4c14-92e5-f830ccb7e341" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:54:29 user nova-compute[73449]: DEBUG nova.compute.manager [None req-c59429c6-61d3-4122-8e1e-41ea1efe0ccc tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Starting instance... {{(pid=73449) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 11:54:29 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-c59429c6-61d3-4122-8e1e-41ea1efe0ccc tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:54:29 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-c59429c6-61d3-4122-8e1e-41ea1efe0ccc tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:54:29 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-c59429c6-61d3-4122-8e1e-41ea1efe0ccc tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73449) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 11:54:29 user nova-compute[73449]: INFO nova.compute.claims [None req-c59429c6-61d3-4122-8e1e-41ea1efe0ccc tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Claim successful on node user
Aug 17 11:54:29 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-c59429c6-61d3-4122-8e1e-41ea1efe0ccc tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 11:54:29 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-c59429c6-61d3-4122-8e1e-41ea1efe0ccc tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 11:54:29 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-c59429c6-61d3-4122-8e1e-41ea1efe0ccc tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.469s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:54:29 user nova-compute[73449]: DEBUG nova.compute.manager [None req-c59429c6-61d3-4122-8e1e-41ea1efe0ccc tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Start building networks asynchronously for instance. {{(pid=73449) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 11:54:29 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:54:29 user nova-compute[73449]: DEBUG nova.compute.manager [None req-c59429c6-61d3-4122-8e1e-41ea1efe0ccc tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Allocating IP information in the background. {{(pid=73449) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 11:54:29 user nova-compute[73449]: DEBUG nova.network.neutron [None req-c59429c6-61d3-4122-8e1e-41ea1efe0ccc tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] allocate_for_instance() {{(pid=73449) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 11:54:29 user nova-compute[73449]: DEBUG nova.network.neutron [req-eaa4c0f9-c5cb-4480-afeb-66d925711229 req-0901d432-e680-438a-9355-a7cb67775169 service nova] [instance: 1542e090-dffe-47d1-8bf1-bb0361cfba34] Updated VIF entry in instance network info cache for port 85a7a7f3-b4c3-4ff0-810a-4cce888b99a2. {{(pid=73449) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 11:54:29 user nova-compute[73449]: DEBUG nova.network.neutron [req-eaa4c0f9-c5cb-4480-afeb-66d925711229 req-0901d432-e680-438a-9355-a7cb67775169 service nova] [instance: 1542e090-dffe-47d1-8bf1-bb0361cfba34] Updating instance_info_cache with network_info: [{"id": "85a7a7f3-b4c3-4ff0-810a-4cce888b99a2", "address": "fa:16:3e:3e:33:50", "network": {"id": "a9e8fcd6-4152-466b-99ad-44b85db05a05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-920564935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bd46cdaff7a4b40955f7c8a12c55452", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85a7a7f3-b4", "ovs_interfaceid": "85a7a7f3-b4c3-4ff0-810a-4cce888b99a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:54:29 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-eaa4c0f9-c5cb-4480-afeb-66d925711229 req-0901d432-e680-438a-9355-a7cb67775169 service nova] Releasing lock "refresh_cache-1542e090-dffe-47d1-8bf1-bb0361cfba34" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:54:29 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-c59429c6-61d3-4122-8e1e-41ea1efe0ccc tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 11:54:29 user nova-compute[73449]: DEBUG nova.compute.manager [None req-c59429c6-61d3-4122-8e1e-41ea1efe0ccc tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Start building block device mappings for instance. {{(pid=73449) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 11:54:30 user nova-compute[73449]: DEBUG nova.policy [None req-c59429c6-61d3-4122-8e1e-41ea1efe0ccc tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7ccb76bc93f84e0897da59b8d5928238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722edee53ed4a9188366c38f3b8b52f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73449) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 11:54:30 user nova-compute[73449]: DEBUG nova.compute.manager [None req-c59429c6-61d3-4122-8e1e-41ea1efe0ccc tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Start spawning the instance on the hypervisor. {{(pid=73449) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 11:54:30 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-c59429c6-61d3-4122-8e1e-41ea1efe0ccc tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Creating instance directory {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 11:54:30 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-c59429c6-61d3-4122-8e1e-41ea1efe0ccc tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Creating image(s)
Aug 17 11:54:30 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-c59429c6-61d3-4122-8e1e-41ea1efe0ccc tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Acquiring lock "/opt/stack/data/nova/instances/042713b8-ab7f-4c14-92e5-f830ccb7e341/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:54:30 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-c59429c6-61d3-4122-8e1e-41ea1efe0ccc tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Lock "/opt/stack/data/nova/instances/042713b8-ab7f-4c14-92e5-f830ccb7e341/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:54:30 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-c59429c6-61d3-4122-8e1e-41ea1efe0ccc tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Lock "/opt/stack/data/nova/instances/042713b8-ab7f-4c14-92e5-f830ccb7e341/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:54:30 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-c59429c6-61d3-4122-8e1e-41ea1efe0ccc tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:54:30 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-c59429c6-61d3-4122-8e1e-41ea1efe0ccc tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json" returned: 0 in 0.189s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:54:30 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-c59429c6-61d3-4122-8e1e-41ea1efe0ccc tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Acquiring lock "7e267a577c062ee862e95ede6b48cfd5632f3ea3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:54:30 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-c59429c6-61d3-4122-8e1e-41ea1efe0ccc tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Lock "7e267a577c062ee862e95ede6b48cfd5632f3ea3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:54:30 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-c59429c6-61d3-4122-8e1e-41ea1efe0ccc tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:54:30 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-c59429c6-61d3-4122-8e1e-41ea1efe0ccc tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json" returned: 0 in 0.177s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:54:30 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-c59429c6-61d3-4122-8e1e-41ea1efe0ccc tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3,backing_fmt=raw /opt/stack/data/nova/instances/042713b8-ab7f-4c14-92e5-f830ccb7e341/disk 1073741824 {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:54:30 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-c59429c6-61d3-4122-8e1e-41ea1efe0ccc tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3,backing_fmt=raw /opt/stack/data/nova/instances/042713b8-ab7f-4c14-92e5-f830ccb7e341/disk 1073741824" returned: 0 in 0.054s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:54:30 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-c59429c6-61d3-4122-8e1e-41ea1efe0ccc tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Lock "7e267a577c062ee862e95ede6b48cfd5632f3ea3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:54:30 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-c59429c6-61d3-4122-8e1e-41ea1efe0ccc tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:54:30 user nova-compute[73449]: DEBUG nova.network.neutron [None req-c59429c6-61d3-4122-8e1e-41ea1efe0ccc tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Successfully created port: 2ce1927a-6866-4362-bc0c-88cd0a19fa08 {{(pid=73449) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 11:54:30 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-c59429c6-61d3-4122-8e1e-41ea1efe0ccc tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json" returned: 0 in 0.188s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:54:30 user nova-compute[73449]: DEBUG nova.virt.disk.api [None req-c59429c6-61d3-4122-8e1e-41ea1efe0ccc tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Checking if we can resize image /opt/stack/data/nova/instances/042713b8-ab7f-4c14-92e5-f830ccb7e341/disk. size=1073741824 {{(pid=73449) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 11:54:30 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-c59429c6-61d3-4122-8e1e-41ea1efe0ccc tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/042713b8-ab7f-4c14-92e5-f830ccb7e341/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:54:30 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-c59429c6-61d3-4122-8e1e-41ea1efe0ccc tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/042713b8-ab7f-4c14-92e5-f830ccb7e341/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:54:30 user nova-compute[73449]: DEBUG nova.virt.disk.api [None req-c59429c6-61d3-4122-8e1e-41ea1efe0ccc tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Cannot resize image /opt/stack/data/nova/instances/042713b8-ab7f-4c14-92e5-f830ccb7e341/disk to a smaller size. {{(pid=73449) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 11:54:30 user nova-compute[73449]: DEBUG nova.objects.instance [None req-c59429c6-61d3-4122-8e1e-41ea1efe0ccc tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Lazy-loading 'migration_context' on Instance uuid 042713b8-ab7f-4c14-92e5-f830ccb7e341 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:54:30 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-c59429c6-61d3-4122-8e1e-41ea1efe0ccc tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Created local disks {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 11:54:30 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-c59429c6-61d3-4122-8e1e-41ea1efe0ccc tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Ensure instance console log exists: /opt/stack/data/nova/instances/042713b8-ab7f-4c14-92e5-f830ccb7e341/console.log {{(pid=73449) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 11:54:30 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-c59429c6-61d3-4122-8e1e-41ea1efe0ccc tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:54:30 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-c59429c6-61d3-4122-8e1e-41ea1efe0ccc tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:54:30 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-c59429c6-61d3-4122-8e1e-41ea1efe0ccc tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:54:31 user nova-compute[73449]: DEBUG nova.network.neutron [None req-c59429c6-61d3-4122-8e1e-41ea1efe0ccc tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Successfully updated port: 2ce1927a-6866-4362-bc0c-88cd0a19fa08 {{(pid=73449) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 11:54:32 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-c59429c6-61d3-4122-8e1e-41ea1efe0ccc tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Acquiring lock "refresh_cache-042713b8-ab7f-4c14-92e5-f830ccb7e341" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:54:32 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-c59429c6-61d3-4122-8e1e-41ea1efe0ccc tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Acquired lock "refresh_cache-042713b8-ab7f-4c14-92e5-f830ccb7e341" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:54:32 user nova-compute[73449]: DEBUG nova.network.neutron [None req-c59429c6-61d3-4122-8e1e-41ea1efe0ccc tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Building network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 11:54:32 user nova-compute[73449]: DEBUG nova.compute.manager [req-92b48b66-5faf-4456-8bbf-582d05a64078 req-cf299b11-df6f-4f16-af98-395d0ef5f835 service nova] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Received event network-changed-2ce1927a-6866-4362-bc0c-88cd0a19fa08 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:54:32 user nova-compute[73449]: DEBUG nova.compute.manager [req-92b48b66-5faf-4456-8bbf-582d05a64078 req-cf299b11-df6f-4f16-af98-395d0ef5f835 service nova] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Refreshing instance network info cache due to event network-changed-2ce1927a-6866-4362-bc0c-88cd0a19fa08. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 11:54:32 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-92b48b66-5faf-4456-8bbf-582d05a64078 req-cf299b11-df6f-4f16-af98-395d0ef5f835 service nova] Acquiring lock "refresh_cache-042713b8-ab7f-4c14-92e5-f830ccb7e341" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:54:32 user nova-compute[73449]: DEBUG nova.network.neutron [None req-c59429c6-61d3-4122-8e1e-41ea1efe0ccc tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Instance cache missing network info. {{(pid=73449) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 11:54:32 user nova-compute[73449]: DEBUG nova.network.neutron [None req-c59429c6-61d3-4122-8e1e-41ea1efe0ccc tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Updating instance_info_cache with network_info: [{"id": "2ce1927a-6866-4362-bc0c-88cd0a19fa08", "address": "fa:16:3e:f5:89:a9", "network": {"id": "f7298070-baaa-4842-b3b2-d9fe1058d3b6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1715911399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8722edee53ed4a9188366c38f3b8b52f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ce1927a-68", "ovs_interfaceid": "2ce1927a-6866-4362-bc0c-88cd0a19fa08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:54:32 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-c59429c6-61d3-4122-8e1e-41ea1efe0ccc tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Releasing lock "refresh_cache-042713b8-ab7f-4c14-92e5-f830ccb7e341" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:54:32 user nova-compute[73449]: DEBUG nova.compute.manager [None req-c59429c6-61d3-4122-8e1e-41ea1efe0ccc tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Instance network_info: |[{"id": "2ce1927a-6866-4362-bc0c-88cd0a19fa08", "address": "fa:16:3e:f5:89:a9", "network": {"id": "f7298070-baaa-4842-b3b2-d9fe1058d3b6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1715911399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8722edee53ed4a9188366c38f3b8b52f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ce1927a-68", "ovs_interfaceid": "2ce1927a-6866-4362-bc0c-88cd0a19fa08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73449) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 11:54:32 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-92b48b66-5faf-4456-8bbf-582d05a64078 req-cf299b11-df6f-4f16-af98-395d0ef5f835 service nova] Acquired lock "refresh_cache-042713b8-ab7f-4c14-92e5-f830ccb7e341" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:54:32 user nova-compute[73449]: DEBUG nova.network.neutron [req-92b48b66-5faf-4456-8bbf-582d05a64078 req-cf299b11-df6f-4f16-af98-395d0ef5f835 service nova] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Refreshing network info cache for port 2ce1927a-6866-4362-bc0c-88cd0a19fa08 {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 11:54:32 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-c59429c6-61d3-4122-8e1e-41ea1efe0ccc tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Start _get_guest_xml network_info=[{"id": "2ce1927a-6866-4362-bc0c-88cd0a19fa08", "address": "fa:16:3e:f5:89:a9", "network": {"id": "f7298070-baaa-4842-b3b2-d9fe1058d3b6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1715911399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8722edee53ed4a9188366c38f3b8b52f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ce1927a-68", "ovs_interfaceid": "2ce1927a-6866-4362-bc0c-88cd0a19fa08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T11:36:11Z,direct_url=<?>,disk_format='qcow2',id=0a2904ae-083d-41c8-83db-343132b36148,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7a77880136a54ef195c82e018e1939db',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T11:36:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': '0a2904ae-083d-41c8-83db-343132b36148'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 11:54:32 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-c59429c6-61d3-4122-8e1e-41ea1efe0ccc tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:54:32 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-c59429c6-61d3-4122-8e1e-41ea1efe0ccc tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:54:32 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-c59429c6-61d3-4122-8e1e-41ea1efe0ccc tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 11:54:32 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-c59429c6-61d3-4122-8e1e-41ea1efe0ccc tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] CPU controller missing on host. {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 11:54:32 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-c59429c6-61d3-4122-8e1e-41ea1efe0ccc tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 11:54:32 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-c59429c6-61d3-4122-8e1e-41ea1efe0ccc tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] CPU controller found on host. {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 11:54:32 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-c59429c6-61d3-4122-8e1e-41ea1efe0ccc tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73449) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 11:54:32 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-c59429c6-61d3-4122-8e1e-41ea1efe0ccc tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T11:35:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T11:36:11Z,direct_url=<?>,disk_format='qcow2',id=0a2904ae-083d-41c8-83db-343132b36148,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7a77880136a54ef195c82e018e1939db',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T11:36:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 11:54:32 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-c59429c6-61d3-4122-8e1e-41ea1efe0ccc tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Flavor limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 11:54:32 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-c59429c6-61d3-4122-8e1e-41ea1efe0ccc tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Image limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 11:54:32 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-c59429c6-61d3-4122-8e1e-41ea1efe0ccc tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Flavor pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 11:54:32 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-c59429c6-61d3-4122-8e1e-41ea1efe0ccc tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Image pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 11:54:32 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-c59429c6-61d3-4122-8e1e-41ea1efe0ccc tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 11:54:32 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-c59429c6-61d3-4122-8e1e-41ea1efe0ccc tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 11:54:32 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-c59429c6-61d3-4122-8e1e-41ea1efe0ccc tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 11:54:32 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-c59429c6-61d3-4122-8e1e-41ea1efe0ccc tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Got 1 possible topologies {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 11:54:32 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-c59429c6-61d3-4122-8e1e-41ea1efe0ccc tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 11:54:32 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-c59429c6-61d3-4122-8e1e-41ea1efe0ccc tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 11:54:32 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-c59429c6-61d3-4122-8e1e-41ea1efe0ccc tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:54:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2055880093',display_name='tempest-ServerRescueNegativeTestJSON-server-2055880093',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2055880093',id=34,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOzW+ki2tzNTWzsdXwhyQ03cag1C3bEbz4eJdcMuqAgtDjoLdQ3HPC6EUYWRZynVvfgMyInuHXXmT1luJVuM3RFN3wpNlldPLaGdqryaccibJZE4kiB5wj8hgruKiBMU7w==',key_name='tempest-keypair-297071468',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8722edee53ed4a9188366c38f3b8b52f',ramdisk_id='',reservation_id='r-ii2ldcnj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1458167730',owner_user_name='tempest-ServerRescueNegativeTestJSON-1458167730-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T11:54:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ccb76bc93f84e0897da59b8d5928238',uuid=042713b8-ab7f-4c14-92e5-f830ccb7e341,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2ce1927a-6866-4362-bc0c-88cd0a19fa08", "address": "fa:16:3e:f5:89:a9", "network": {"id": "f7298070-baaa-4842-b3b2-d9fe1058d3b6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1715911399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8722edee53ed4a9188366c38f3b8b52f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ce1927a-68", "ovs_interfaceid": "2ce1927a-6866-4362-bc0c-88cd0a19fa08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73449) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 11:54:32 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-c59429c6-61d3-4122-8e1e-41ea1efe0ccc tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Converting VIF {"id": "2ce1927a-6866-4362-bc0c-88cd0a19fa08", "address": "fa:16:3e:f5:89:a9", "network": {"id": "f7298070-baaa-4842-b3b2-d9fe1058d3b6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1715911399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8722edee53ed4a9188366c38f3b8b52f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ce1927a-68", "ovs_interfaceid": "2ce1927a-6866-4362-bc0c-88cd0a19fa08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:54:32 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-c59429c6-61d3-4122-8e1e-41ea1efe0ccc tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:89:a9,bridge_name='br-int',has_traffic_filtering=True,id=2ce1927a-6866-4362-bc0c-88cd0a19fa08,network=Network(f7298070-baaa-4842-b3b2-d9fe1058d3b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ce1927a-68') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:54:32 user nova-compute[73449]: DEBUG nova.objects.instance [None req-c59429c6-61d3-4122-8e1e-41ea1efe0ccc tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Lazy-loading 'pci_devices' on Instance uuid 042713b8-ab7f-4c14-92e5-f830ccb7e341 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:54:32 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-c59429c6-61d3-4122-8e1e-41ea1efe0ccc tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] End _get_guest_xml xml=<domain type="kvm">
Aug 17 11:54:32 user nova-compute[73449]:   <uuid>042713b8-ab7f-4c14-92e5-f830ccb7e341</uuid>
Aug 17 11:54:32 user nova-compute[73449]:   <name>instance-00000022</name>
Aug 17 11:54:32 user nova-compute[73449]:   <memory>524288</memory>
Aug 17 11:54:32 user nova-compute[73449]:   <vcpu>1</vcpu>
Aug 17 11:54:32 user nova-compute[73449]:   <metadata>
Aug 17 11:54:32 user nova-compute[73449]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 11:54:32 user nova-compute[73449]:       <nova:package version="0.0.0"/>
Aug 17 11:54:32 user nova-compute[73449]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2055880093</nova:name>
Aug 17 11:54:32 user nova-compute[73449]:       <nova:creationTime>2023-08-17 11:54:32</nova:creationTime>
Aug 17 11:54:32 user nova-compute[73449]:       <nova:flavor name="m1.tiny">
Aug 17 11:54:32 user nova-compute[73449]:         <nova:memory>512</nova:memory>
Aug 17 11:54:32 user nova-compute[73449]:         <nova:disk>1</nova:disk>
Aug 17 11:54:32 user nova-compute[73449]:         <nova:swap>0</nova:swap>
Aug 17 11:54:32 user nova-compute[73449]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 11:54:32 user nova-compute[73449]:         <nova:vcpus>1</nova:vcpus>
Aug 17 11:54:32 user nova-compute[73449]:       </nova:flavor>
Aug 17 11:54:32 user nova-compute[73449]:       <nova:owner>
Aug 17 11:54:32 user nova-compute[73449]:         <nova:user uuid="7ccb76bc93f84e0897da59b8d5928238">tempest-ServerRescueNegativeTestJSON-1458167730-project-member</nova:user>
Aug 17 11:54:32 user nova-compute[73449]:         <nova:project uuid="8722edee53ed4a9188366c38f3b8b52f">tempest-ServerRescueNegativeTestJSON-1458167730</nova:project>
Aug 17 11:54:32 user nova-compute[73449]:       </nova:owner>
Aug 17 11:54:32 user nova-compute[73449]:       <nova:root type="image" uuid="0a2904ae-083d-41c8-83db-343132b36148"/>
Aug 17 11:54:32 user nova-compute[73449]:       <nova:ports>
Aug 17 11:54:32 user nova-compute[73449]:         <nova:port uuid="2ce1927a-6866-4362-bc0c-88cd0a19fa08">
Aug 17 11:54:32 user nova-compute[73449]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 17 11:54:32 user nova-compute[73449]:         </nova:port>
Aug 17 11:54:32 user nova-compute[73449]:       </nova:ports>
Aug 17 11:54:32 user nova-compute[73449]:     </nova:instance>
Aug 17 11:54:32 user nova-compute[73449]:   </metadata>
Aug 17 11:54:32 user nova-compute[73449]:   <sysinfo type="smbios">
Aug 17 11:54:32 user nova-compute[73449]:     <system>
Aug 17 11:54:32 user nova-compute[73449]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 11:54:32 user nova-compute[73449]:       <entry name="product">OpenStack Nova</entry>
Aug 17 11:54:32 user nova-compute[73449]:       <entry name="version">0.0.0</entry>
Aug 17 11:54:32 user nova-compute[73449]:       <entry name="serial">042713b8-ab7f-4c14-92e5-f830ccb7e341</entry>
Aug 17 11:54:32 user nova-compute[73449]:       <entry name="uuid">042713b8-ab7f-4c14-92e5-f830ccb7e341</entry>
Aug 17 11:54:32 user nova-compute[73449]:       <entry name="family">Virtual Machine</entry>
Aug 17 11:54:32 user nova-compute[73449]:     </system>
Aug 17 11:54:32 user nova-compute[73449]:   </sysinfo>
Aug 17 11:54:32 user nova-compute[73449]:   <os>
Aug 17 11:54:32 user nova-compute[73449]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 11:54:32 user nova-compute[73449]:     <boot dev="hd"/>
Aug 17 11:54:32 user nova-compute[73449]:     <smbios mode="sysinfo"/>
Aug 17 11:54:32 user nova-compute[73449]:   </os>
Aug 17 11:54:32 user nova-compute[73449]:   <features>
Aug 17 11:54:32 user nova-compute[73449]:     <acpi/>
Aug 17 11:54:32 user nova-compute[73449]:     <apic/>
Aug 17 11:54:32 user nova-compute[73449]:     <vmcoreinfo/>
Aug 17 11:54:32 user nova-compute[73449]:   </features>
Aug 17 11:54:32 user nova-compute[73449]:   <clock offset="utc">
Aug 17 11:54:32 user nova-compute[73449]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 11:54:32 user nova-compute[73449]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 11:54:32 user nova-compute[73449]:     <timer name="hpet" present="no"/>
Aug 17 11:54:32 user nova-compute[73449]:   </clock>
Aug 17 11:54:32 user nova-compute[73449]:   <cpu mode="custom" match="exact">
Aug 17 11:54:32 user nova-compute[73449]:     <model>Nehalem</model>
Aug 17 11:54:32 user nova-compute[73449]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 11:54:32 user nova-compute[73449]:   </cpu>
Aug 17 11:54:32 user nova-compute[73449]:   <devices>
Aug 17 11:54:32 user nova-compute[73449]:     <disk type="file" device="disk">
Aug 17 11:54:32 user nova-compute[73449]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 11:54:32 user nova-compute[73449]:       <source file="/opt/stack/data/nova/instances/042713b8-ab7f-4c14-92e5-f830ccb7e341/disk"/>
Aug 17 11:54:32 user nova-compute[73449]:       <target dev="vda" bus="virtio"/>
Aug 17 11:54:32 user nova-compute[73449]:     </disk>
Aug 17 11:54:32 user nova-compute[73449]:     <interface type="ethernet">
Aug 17 11:54:32 user nova-compute[73449]:       <mac address="fa:16:3e:f5:89:a9"/>
Aug 17 11:54:32 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 11:54:32 user nova-compute[73449]:       <mtu size="1442"/>
Aug 17 11:54:32 user nova-compute[73449]:       <target dev="tap2ce1927a-68"/>
Aug 17 11:54:32 user nova-compute[73449]:     </interface>
Aug 17 11:54:32 user nova-compute[73449]:     <serial type="pty">
Aug 17 11:54:32 user nova-compute[73449]:       <log file="/opt/stack/data/nova/instances/042713b8-ab7f-4c14-92e5-f830ccb7e341/console.log" append="off"/>
Aug 17 11:54:32 user nova-compute[73449]:     </serial>
Aug 17 11:54:32 user nova-compute[73449]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 11:54:32 user nova-compute[73449]:     <video>
Aug 17 11:54:32 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 11:54:32 user nova-compute[73449]:     </video>
Aug 17 11:54:32 user nova-compute[73449]:     <rng model="virtio">
Aug 17 11:54:32 user nova-compute[73449]:       <backend model="random">/dev/urandom</backend>
Aug 17 11:54:32 user nova-compute[73449]:     </rng>
Aug 17 11:54:32 user nova-compute[73449]:     <controller type="usb" index="0" model="none"/>
Aug 17 11:54:32 user nova-compute[73449]:     <memballoon model="virtio">
Aug 17 11:54:32 user nova-compute[73449]:       <stats period="10"/>
Aug 17 11:54:32 user nova-compute[73449]:     </memballoon>
Aug 17 11:54:32 user nova-compute[73449]:   </devices>
Aug 17 11:54:32 user nova-compute[73449]: </domain>
Aug 17 11:54:32 user nova-compute[73449]:  {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 11:54:32 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-c59429c6-61d3-4122-8e1e-41ea1efe0ccc tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:54:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2055880093',display_name='tempest-ServerRescueNegativeTestJSON-server-2055880093',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2055880093',id=34,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOzW+ki2tzNTWzsdXwhyQ03cag1C3bEbz4eJdcMuqAgtDjoLdQ3HPC6EUYWRZynVvfgMyInuHXXmT1luJVuM3RFN3wpNlldPLaGdqryaccibJZE4kiB5wj8hgruKiBMU7w==',key_name='tempest-keypair-297071468',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8722edee53ed4a9188366c38f3b8b52f',ramdisk_id='',reservation_id='r-ii2ldcnj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1458167730',owner_user_name='tempest-ServerRescueNegativeTestJSON-1458167730-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T11:54:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ccb76bc93f84e0897da59b8d5928238',uuid=042713b8-ab7f-4c14-92e5-f830ccb7e341,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2ce1927a-6866-4362-bc0c-88cd0a19fa08", "address": "fa:16:3e:f5:89:a9", "network": {"id": "f7298070-baaa-4842-b3b2-d9fe1058d3b6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1715911399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8722edee53ed4a9188366c38f3b8b52f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ce1927a-68", "ovs_interfaceid": "2ce1927a-6866-4362-bc0c-88cd0a19fa08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 11:54:32 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-c59429c6-61d3-4122-8e1e-41ea1efe0ccc tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Converting VIF {"id": "2ce1927a-6866-4362-bc0c-88cd0a19fa08", "address": "fa:16:3e:f5:89:a9", "network": {"id": "f7298070-baaa-4842-b3b2-d9fe1058d3b6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1715911399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8722edee53ed4a9188366c38f3b8b52f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ce1927a-68", "ovs_interfaceid": "2ce1927a-6866-4362-bc0c-88cd0a19fa08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:54:32 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-c59429c6-61d3-4122-8e1e-41ea1efe0ccc tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:89:a9,bridge_name='br-int',has_traffic_filtering=True,id=2ce1927a-6866-4362-bc0c-88cd0a19fa08,network=Network(f7298070-baaa-4842-b3b2-d9fe1058d3b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ce1927a-68') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:54:32 user nova-compute[73449]: DEBUG os_vif [None req-c59429c6-61d3-4122-8e1e-41ea1efe0ccc tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:89:a9,bridge_name='br-int',has_traffic_filtering=True,id=2ce1927a-6866-4362-bc0c-88cd0a19fa08,network=Network(f7298070-baaa-4842-b3b2-d9fe1058d3b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ce1927a-68') {{(pid=73449) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 11:54:32 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:54:32 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:54:32 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 11:54:32 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:54:32 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2ce1927a-68, may_exist=True, interface_attrs={}) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:54:32 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2ce1927a-68, col_values=(('external_ids', {'iface-id': '2ce1927a-6866-4362-bc0c-88cd0a19fa08', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f5:89:a9', 'vm-uuid': '042713b8-ab7f-4c14-92e5-f830ccb7e341'}),), if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:54:32 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:54:32 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:54:32 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:54:32 user nova-compute[73449]: INFO os_vif [None req-c59429c6-61d3-4122-8e1e-41ea1efe0ccc tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:89:a9,bridge_name='br-int',has_traffic_filtering=True,id=2ce1927a-6866-4362-bc0c-88cd0a19fa08,network=Network(f7298070-baaa-4842-b3b2-d9fe1058d3b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ce1927a-68')
Aug 17 11:54:32 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-c59429c6-61d3-4122-8e1e-41ea1efe0ccc tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] No BDM found with device name vda, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 11:54:32 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-c59429c6-61d3-4122-8e1e-41ea1efe0ccc tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] No VIF found with MAC fa:16:3e:f5:89:a9, not building metadata {{(pid=73449) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 11:54:32 user nova-compute[73449]: DEBUG nova.network.neutron [req-92b48b66-5faf-4456-8bbf-582d05a64078 req-cf299b11-df6f-4f16-af98-395d0ef5f835 service nova] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Updated VIF entry in instance network info cache for port 2ce1927a-6866-4362-bc0c-88cd0a19fa08. {{(pid=73449) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 11:54:32 user nova-compute[73449]: DEBUG nova.network.neutron [req-92b48b66-5faf-4456-8bbf-582d05a64078 req-cf299b11-df6f-4f16-af98-395d0ef5f835 service nova] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Updating instance_info_cache with network_info: [{"id": "2ce1927a-6866-4362-bc0c-88cd0a19fa08", "address": "fa:16:3e:f5:89:a9", "network": {"id": "f7298070-baaa-4842-b3b2-d9fe1058d3b6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1715911399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8722edee53ed4a9188366c38f3b8b52f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ce1927a-68", "ovs_interfaceid": "2ce1927a-6866-4362-bc0c-88cd0a19fa08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:54:32 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-92b48b66-5faf-4456-8bbf-582d05a64078 req-cf299b11-df6f-4f16-af98-395d0ef5f835 service nova] Releasing lock "refresh_cache-042713b8-ab7f-4c14-92e5-f830ccb7e341" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:54:33 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:54:33 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:54:33 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:54:33 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:54:34 user nova-compute[73449]: DEBUG nova.compute.manager [req-cb97a416-6056-4c5e-9258-b905a4e031a1 req-2f1dec8f-c73a-4f06-abb4-26be52c7a2ee service nova] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Received event network-vif-plugged-2ce1927a-6866-4362-bc0c-88cd0a19fa08 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:54:34 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-cb97a416-6056-4c5e-9258-b905a4e031a1 req-2f1dec8f-c73a-4f06-abb4-26be52c7a2ee service nova] Acquiring lock "042713b8-ab7f-4c14-92e5-f830ccb7e341-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:54:34 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-cb97a416-6056-4c5e-9258-b905a4e031a1 req-2f1dec8f-c73a-4f06-abb4-26be52c7a2ee service nova] Lock "042713b8-ab7f-4c14-92e5-f830ccb7e341-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:54:34 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-cb97a416-6056-4c5e-9258-b905a4e031a1 req-2f1dec8f-c73a-4f06-abb4-26be52c7a2ee service nova] Lock "042713b8-ab7f-4c14-92e5-f830ccb7e341-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:54:34 user nova-compute[73449]: DEBUG nova.compute.manager [req-cb97a416-6056-4c5e-9258-b905a4e031a1 req-2f1dec8f-c73a-4f06-abb4-26be52c7a2ee service nova] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] No waiting events found dispatching network-vif-plugged-2ce1927a-6866-4362-bc0c-88cd0a19fa08 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:54:34 user nova-compute[73449]: WARNING nova.compute.manager [req-cb97a416-6056-4c5e-9258-b905a4e031a1 req-2f1dec8f-c73a-4f06-abb4-26be52c7a2ee service nova] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Received unexpected event network-vif-plugged-2ce1927a-6866-4362-bc0c-88cd0a19fa08 for instance with vm_state building and task_state spawning.
Aug 17 11:54:34 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:54:34 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:54:35 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692273275.9023364, 042713b8-ab7f-4c14-92e5-f830ccb7e341 => Resumed> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:54:35 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] VM Resumed (Lifecycle Event)
Aug 17 11:54:35 user nova-compute[73449]: DEBUG nova.compute.manager [None req-c59429c6-61d3-4122-8e1e-41ea1efe0ccc tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Instance event wait completed in 0 seconds for  {{(pid=73449) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 11:54:35 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-c59429c6-61d3-4122-8e1e-41ea1efe0ccc tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Guest created on hypervisor {{(pid=73449) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 11:54:35 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Instance spawned successfully.
Aug 17 11:54:35 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-c59429c6-61d3-4122-8e1e-41ea1efe0ccc tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 11:54:35 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:54:35 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 11:54:35 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-c59429c6-61d3-4122-8e1e-41ea1efe0ccc tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Found default for hw_cdrom_bus of ide {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:54:35 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-c59429c6-61d3-4122-8e1e-41ea1efe0ccc tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Found default for hw_disk_bus of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:54:35 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-c59429c6-61d3-4122-8e1e-41ea1efe0ccc tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Found default for hw_input_bus of None {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:54:35 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-c59429c6-61d3-4122-8e1e-41ea1efe0ccc tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Found default for hw_pointer_model of None {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:54:35 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-c59429c6-61d3-4122-8e1e-41ea1efe0ccc tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Found default for hw_video_model of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:54:35 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-c59429c6-61d3-4122-8e1e-41ea1efe0ccc tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Found default for hw_vif_model of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:54:35 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 11:54:35 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692273275.9068694, 042713b8-ab7f-4c14-92e5-f830ccb7e341 => Started> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:54:35 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] VM Started (Lifecycle Event)
Aug 17 11:54:35 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:54:35 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 11:54:36 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 11:54:36 user nova-compute[73449]: INFO nova.compute.manager [None req-c59429c6-61d3-4122-8e1e-41ea1efe0ccc tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Took 5.94 seconds to spawn the instance on the hypervisor.
Aug 17 11:54:36 user nova-compute[73449]: DEBUG nova.compute.manager [None req-c59429c6-61d3-4122-8e1e-41ea1efe0ccc tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:54:36 user nova-compute[73449]: DEBUG nova.compute.manager [req-dea8475c-119d-4a38-803f-93544bc8d5f3 req-e464fffe-0ffe-4650-ac2b-32c4769b186b service nova] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Received event network-vif-plugged-2ce1927a-6866-4362-bc0c-88cd0a19fa08 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:54:36 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-dea8475c-119d-4a38-803f-93544bc8d5f3 req-e464fffe-0ffe-4650-ac2b-32c4769b186b service nova] Acquiring lock "042713b8-ab7f-4c14-92e5-f830ccb7e341-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:54:36 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-dea8475c-119d-4a38-803f-93544bc8d5f3 req-e464fffe-0ffe-4650-ac2b-32c4769b186b service nova] Lock "042713b8-ab7f-4c14-92e5-f830ccb7e341-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:54:36 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-dea8475c-119d-4a38-803f-93544bc8d5f3 req-e464fffe-0ffe-4650-ac2b-32c4769b186b service nova] Lock "042713b8-ab7f-4c14-92e5-f830ccb7e341-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:54:36 user nova-compute[73449]: DEBUG nova.compute.manager [req-dea8475c-119d-4a38-803f-93544bc8d5f3 req-e464fffe-0ffe-4650-ac2b-32c4769b186b service nova] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] No waiting events found dispatching network-vif-plugged-2ce1927a-6866-4362-bc0c-88cd0a19fa08 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:54:36 user nova-compute[73449]: WARNING nova.compute.manager [req-dea8475c-119d-4a38-803f-93544bc8d5f3 req-e464fffe-0ffe-4650-ac2b-32c4769b186b service nova] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Received unexpected event network-vif-plugged-2ce1927a-6866-4362-bc0c-88cd0a19fa08 for instance with vm_state building and task_state spawning.
Aug 17 11:54:36 user nova-compute[73449]: INFO nova.compute.manager [None req-c59429c6-61d3-4122-8e1e-41ea1efe0ccc tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Took 6.74 seconds to build instance.
Aug 17 11:54:36 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-c59429c6-61d3-4122-8e1e-41ea1efe0ccc tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Lock "042713b8-ab7f-4c14-92e5-f830ccb7e341" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.830s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:54:37 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-1e65e782-9467-406c-990f-adc09e503598 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Acquiring lock "fea9f81c-a848-4a65-863e-e09dddf65bcf" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:54:37 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-1e65e782-9467-406c-990f-adc09e503598 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Lock "fea9f81c-a848-4a65-863e-e09dddf65bcf" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:54:37 user nova-compute[73449]: INFO nova.compute.manager [None req-1e65e782-9467-406c-990f-adc09e503598 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Detaching volume bc855d21-60f9-4798-aecf-44a569bf0a11
Aug 17 11:54:37 user nova-compute[73449]: INFO nova.virt.block_device [None req-1e65e782-9467-406c-990f-adc09e503598 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Attempting to driver detach volume bc855d21-60f9-4798-aecf-44a569bf0a11 from mountpoint /dev/vdc
Aug 17 11:54:37 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-1e65e782-9467-406c-990f-adc09e503598 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Attempting to detach device vdc from instance fea9f81c-a848-4a65-863e-e09dddf65bcf from the persistent domain config. {{(pid=73449) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 11:54:37 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-1e65e782-9467-406c-990f-adc09e503598 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 11:54:37 user nova-compute[73449]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 11:54:37 user nova-compute[73449]:   <source dev="/dev/sdc"/>
Aug 17 11:54:37 user nova-compute[73449]:   <target dev="vdc" bus="virtio"/>
Aug 17 11:54:37 user nova-compute[73449]:   <serial>bc855d21-60f9-4798-aecf-44a569bf0a11</serial>
Aug 17 11:54:37 user nova-compute[73449]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 17 11:54:37 user nova-compute[73449]: </disk>
Aug 17 11:54:37 user nova-compute[73449]:  {{(pid=73449) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 11:54:37 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-1e65e782-9467-406c-990f-adc09e503598 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Successfully detached device vdc from instance fea9f81c-a848-4a65-863e-e09dddf65bcf from the persistent domain config.
Aug 17 11:54:37 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-1e65e782-9467-406c-990f-adc09e503598 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance fea9f81c-a848-4a65-863e-e09dddf65bcf from the live domain config. {{(pid=73449) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 11:54:37 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-1e65e782-9467-406c-990f-adc09e503598 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 11:54:37 user nova-compute[73449]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 11:54:37 user nova-compute[73449]:   <source dev="/dev/sdc"/>
Aug 17 11:54:37 user nova-compute[73449]:   <target dev="vdc" bus="virtio"/>
Aug 17 11:54:37 user nova-compute[73449]:   <serial>bc855d21-60f9-4798-aecf-44a569bf0a11</serial>
Aug 17 11:54:37 user nova-compute[73449]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 17 11:54:37 user nova-compute[73449]: </disk>
Aug 17 11:54:37 user nova-compute[73449]:  {{(pid=73449) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 11:54:37 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:54:37 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Received event <DeviceRemovedEvent: 1692273277.7463276, fea9f81c-a848-4a65-863e-e09dddf65bcf => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73449) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 11:54:37 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-1e65e782-9467-406c-990f-adc09e503598 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance fea9f81c-a848-4a65-863e-e09dddf65bcf {{(pid=73449) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 11:54:37 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-1e65e782-9467-406c-990f-adc09e503598 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Successfully detached device vdc from instance fea9f81c-a848-4a65-863e-e09dddf65bcf from the live domain config.
Aug 17 11:54:37 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e65e782-9467-406c-990f-adc09e503598 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] calling os-brick to detach iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 11:54:37 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e65e782-9467-406c-990f-adc09e503598 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, {'target_iqns': ['iqn.2010-10.org.openstack:bc855d21-60f9-4798-aecf-44a569bf0a11'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wMEhRvFJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 11:54:37 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-1e65e782-9467-406c-990f-adc09e503598 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 11:54:37 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-1e65e782-9467-406c-990f-adc09e503598 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:54:37 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-1e65e782-9467-406c-990f-adc09e503598 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:54:37 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e65e782-9467-406c-990f-adc09e503598 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc855d21-60f9-4798-aecf-44a569bf0a11', 0)] {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 11:54:37 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:54:37 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:54:37 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6cb4e61-2030-4a3b-98c8-cb55b08bbe47]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a382874-91aa-4ff2-aae4-15db10fe5ff2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc855d21-60f9-4798-aecf-44a569bf0a11\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:54:37 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:54:37 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:54:37 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[7df0e94a-5160-435d-93bf-87dcf0a02fa0]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc855d21-60f9-4798-aecf-44a569bf0a11 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a382874-91aa-4ff2-aae4-15db10fe5ff2 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:54:37 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e65e782-9467-406c-990f-adc09e503598 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 (non-flash)
Aug 17 11:54:37 user nova-compute[73449]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc855d21-60f9-4798-aecf-44a569bf0a11 (non-flash)
Aug 17 11:54:37 user nova-compute[73449]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)
Aug 17 11:54:37 user nova-compute[73449]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a382874-91aa-4ff2-aae4-15db10fe5ff2 (non-flash)
Aug 17 11:54:37 user nova-compute[73449]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 (non-flash)
Aug 17 11:54:37 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:54:37 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e65e782-9467-406c-990f-adc09e503598 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 (non-flash)
Aug 17 11:54:37 user nova-compute[73449]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc855d21-60f9-4798-aecf-44a569bf0a11 (non-flash)
Aug 17 11:54:37 user nova-compute[73449]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)
Aug 17 11:54:37 user nova-compute[73449]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a382874-91aa-4ff2-aae4-15db10fe5ff2 (non-flash)
Aug 17 11:54:37 user nova-compute[73449]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 (non-flash)
Aug 17 11:54:37 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:54:37 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e65e782-9467-406c-990f-adc09e503598 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe7876677f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc855d21-60f9-4798-aecf-44a569bf0a11'): ({'sdc'}, set())}) {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 11:54:37 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-1e65e782-9467-406c-990f-adc09e503598 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Removing single pathed devices sdc {{(pid=73449) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 11:54:37 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:54:37 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:54:37 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[03a633eb-96e1-4cd2-a6ad-fee8aef5ddb9]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:54:37 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:54:37 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:54:37 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[04cd1fb2-9b19-417c-96db-28514c3d2a3a]: (4, ('ok\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:54:37 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-1e65e782-9467-406c-990f-adc09e503598 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Flushing IO for device /dev/sdc {{(pid=73449) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 11:54:37 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:54:37 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:54:37 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[92d9d394-4696-482c-9fd3-ad5d591fc5e4]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:54:37 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-1e65e782-9467-406c-990f-adc09e503598 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73449) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 11:54:37 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:54:38 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.157s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:54:38 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[13083a93-f184-4547-bb25-efecac86ca9d]: (4, ('1', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:54:38 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-1e65e782-9467-406c-990f-adc09e503598 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73449) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 11:54:38 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-1e65e782-9467-406c-990f-adc09e503598 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] SCSI volumes sdc have been removed. {{(pid=73449) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 11:54:38 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e65e782-9467-406c-990f-adc09e503598 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc855d21-60f9-4798-aecf-44a569bf0a11')] {{(pid=73449) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 11:54:38 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc855d21-60f9-4798-aecf-44a569bf0a11 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:54:38 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc855d21-60f9-4798-aecf-44a569bf0a11 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:54:38 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[48f172b9-e3ce-49dd-a869-870901b289e5]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:54:38 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e65e782-9467-406c-990f-adc09e503598 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:54:38 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc855d21-60f9-4798-aecf-44a569bf0a11 -p 172.16.0.220:3260 --logout {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:54:38 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc855d21-60f9-4798-aecf-44a569bf0a11 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:54:38 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[58fe01c5-48ae-444c-8297-be21bd2f0194]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:bc855d21-60f9-4798-aecf-44a569bf0a11, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:bc855d21-60f9-4798-aecf-44a569bf0a11, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:54:38 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e65e782-9467-406c-990f-adc09e503598 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:bc855d21-60f9-4798-aecf-44a569bf0a11, portal: 172.16.0.220,3260]
Aug 17 11:54:38 user nova-compute[73449]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:bc855d21-60f9-4798-aecf-44a569bf0a11, portal: 172.16.0.220,3260] successful.
Aug 17 11:54:38 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:54:38 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc855d21-60f9-4798-aecf-44a569bf0a11 -p 172.16.0.220:3260 --op delete {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:54:38 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc855d21-60f9-4798-aecf-44a569bf0a11 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:54:38 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[22eacb6e-b873-46ab-8d77-4e8ba6e997cd]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:54:38 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e65e782-9467-406c-990f-adc09e503598 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:54:38 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-1e65e782-9467-406c-990f-adc09e503598 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.429s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:54:38 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e65e782-9467-406c-990f-adc09e503598 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] <== disconnect_volume: return (430ms) None {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 11:54:38 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e65e782-9467-406c-990f-adc09e503598 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Disconnected iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 11:54:38 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:54:38 user nova-compute[73449]: DEBUG nova.compute.manager [None req-29ecc1a6-26fa-4901-82a8-1a1d43f98f49 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 1542e090-dffe-47d1-8bf1-bb0361cfba34] Start spawning the instance on the hypervisor. {{(pid=73449) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 11:54:38 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-29ecc1a6-26fa-4901-82a8-1a1d43f98f49 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 1542e090-dffe-47d1-8bf1-bb0361cfba34] Creating instance directory {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 11:54:38 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-29ecc1a6-26fa-4901-82a8-1a1d43f98f49 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 1542e090-dffe-47d1-8bf1-bb0361cfba34] Creating image(s)
Aug 17 11:54:38 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-29ecc1a6-26fa-4901-82a8-1a1d43f98f49 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 1542e090-dffe-47d1-8bf1-bb0361cfba34] Did not create local disks {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 11:54:38 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-29ecc1a6-26fa-4901-82a8-1a1d43f98f49 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 1542e090-dffe-47d1-8bf1-bb0361cfba34] Ensure instance console log exists: /opt/stack/data/nova/instances/1542e090-dffe-47d1-8bf1-bb0361cfba34/console.log {{(pid=73449) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 11:54:38 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-29ecc1a6-26fa-4901-82a8-1a1d43f98f49 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:54:38 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-29ecc1a6-26fa-4901-82a8-1a1d43f98f49 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:54:38 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-29ecc1a6-26fa-4901-82a8-1a1d43f98f49 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:54:38 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-29ecc1a6-26fa-4901-82a8-1a1d43f98f49 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 1542e090-dffe-47d1-8bf1-bb0361cfba34] Start _get_guest_xml network_info=[{"id": "85a7a7f3-b4c3-4ff0-810a-4cce888b99a2", "address": "fa:16:3e:3e:33:50", "network": {"id": "a9e8fcd6-4152-466b-99ad-44b85db05a05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-920564935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bd46cdaff7a4b40955f7c8a12c55452", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85a7a7f3-b4", "ovs_interfaceid": "85a7a7f3-b4c3-4ff0-810a-4cce888b99a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'attachment_id': 'd68467fb-de8c-4019-b4e4-17049419a94a', 'boot_index': 0, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CtHUhuMp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1542e090-dffe-47d1-8bf1-bb0361cfba34', 'attached_at': '', 'detached_at': '', 'volume_id': '2a343174-094b-4cd2-98cc-f215c047baf7', 'serial': '2a343174-094b-4cd2-98cc-f215c047baf7'}, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 11:54:38 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-29ecc1a6-26fa-4901-82a8-1a1d43f98f49 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:54:38 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-29ecc1a6-26fa-4901-82a8-1a1d43f98f49 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:54:38 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-29ecc1a6-26fa-4901-82a8-1a1d43f98f49 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 11:54:38 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-29ecc1a6-26fa-4901-82a8-1a1d43f98f49 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] CPU controller missing on host. {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 11:54:38 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-29ecc1a6-26fa-4901-82a8-1a1d43f98f49 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 11:54:38 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-29ecc1a6-26fa-4901-82a8-1a1d43f98f49 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] CPU controller found on host. {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 11:54:38 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-29ecc1a6-26fa-4901-82a8-1a1d43f98f49 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73449) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 11:54:38 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-29ecc1a6-26fa-4901-82a8-1a1d43f98f49 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T11:35:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 11:54:38 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-29ecc1a6-26fa-4901-82a8-1a1d43f98f49 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Flavor limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 11:54:38 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-29ecc1a6-26fa-4901-82a8-1a1d43f98f49 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Image limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 11:54:38 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-29ecc1a6-26fa-4901-82a8-1a1d43f98f49 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Flavor pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 11:54:38 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-29ecc1a6-26fa-4901-82a8-1a1d43f98f49 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Image pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 11:54:38 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-29ecc1a6-26fa-4901-82a8-1a1d43f98f49 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 11:54:38 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-29ecc1a6-26fa-4901-82a8-1a1d43f98f49 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 11:54:38 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-29ecc1a6-26fa-4901-82a8-1a1d43f98f49 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 11:54:38 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-29ecc1a6-26fa-4901-82a8-1a1d43f98f49 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Got 1 possible topologies {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 11:54:38 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-29ecc1a6-26fa-4901-82a8-1a1d43f98f49 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 11:54:38 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-29ecc1a6-26fa-4901-82a8-1a1d43f98f49 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 11:54:38 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29ecc1a6-26fa-4901-82a8-1a1d43f98f49 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 1542e090-dffe-47d1-8bf1-bb0361cfba34] Calling os-brick to attach iSCSI Volume {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 11:54:38 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-29ecc1a6-26fa-4901-82a8-1a1d43f98f49 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CtHUhuMp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 11:54:38 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-29ecc1a6-26fa-4901-82a8-1a1d43f98f49 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 11:54:38 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-29ecc1a6-26fa-4901-82a8-1a1d43f98f49 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:54:38 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-29ecc1a6-26fa-4901-82a8-1a1d43f98f49 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:54:38 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-29ecc1a6-26fa-4901-82a8-1a1d43f98f49 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 11:54:38 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-29ecc1a6-26fa-4901-82a8-1a1d43f98f49 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:54:38 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-29ecc1a6-26fa-4901-82a8-1a1d43f98f49 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:54:38 user nova-compute[73449]: INFO os_brick.initiator.connectors.iscsi [None req-29ecc1a6-26fa-4901-82a8-1a1d43f98f49 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 11:54:38 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7 -p 172.16.0.220:3260 {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:54:38 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:54:38 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2be5368-93e7-4545-b5a8-ad6eeacc99ea]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:54:38 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-29ecc1a6-26fa-4901-82a8-1a1d43f98f49 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 11:54:38 user nova-compute[73449]:  {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:54:38 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7 -p 172.16.0.220:3260 --interface default --op new {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:54:38 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:54:38 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[a378425a-558b-446a-906a-5a59ba7ba712]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7] added\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:54:38 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-29ecc1a6-26fa-4901-82a8-1a1d43f98f49 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7] added
Aug 17 11:54:38 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:54:38 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:54:38 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:54:38 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[14f5dfa3-7214-40d1-9fe4-77b42fa70522]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:54:38 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-29ecc1a6-26fa-4901-82a8-1a1d43f98f49 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:54:38 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:54:38 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:54:38 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9950ee8-bdf6-41c0-9baa-20d2065e6e62]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:54:38 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-29ecc1a6-26fa-4901-82a8-1a1d43f98f49 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:54:38 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CtHUhuMp {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:54:38 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CtHUhuMp" returned: 0 in 0.026s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:54:38 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[0756a6a7-c700-45d7-bc53-2eee628994e5]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:54:38 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-29ecc1a6-26fa-4901-82a8-1a1d43f98f49 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CtHUhuMp'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:54:38 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:54:38 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:54:38 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[44f830bc-6020-4a7c-993a-68f154e69c60]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:54:38 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-29ecc1a6-26fa-4901-82a8-1a1d43f98f49 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:54:38 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:54:38 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:54:38 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9496e08-3db8-4290-b8ad-5576b96dd600]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a382874-91aa-4ff2-aae4-15db10fe5ff2 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:54:38 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-29ecc1a6-26fa-4901-82a8-1a1d43f98f49 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 (non-flash)
Aug 17 11:54:38 user nova-compute[73449]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)
Aug 17 11:54:38 user nova-compute[73449]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a382874-91aa-4ff2-aae4-15db10fe5ff2 (non-flash)
Aug 17 11:54:38 user nova-compute[73449]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 (non-flash)
Aug 17 11:54:38 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:54:38 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-29ecc1a6-26fa-4901-82a8-1a1d43f98f49 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 (non-flash)
Aug 17 11:54:38 user nova-compute[73449]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)
Aug 17 11:54:38 user nova-compute[73449]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a382874-91aa-4ff2-aae4-15db10fe5ff2 (non-flash)
Aug 17 11:54:38 user nova-compute[73449]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 (non-flash)
Aug 17 11:54:38 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:54:38 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7 -p 172.16.0.220:3260 --login {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:54:38 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:54:38 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[97178ae3-f799-47cd-9da9-53ad454984f3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:54:38 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-29ecc1a6-26fa-4901-82a8-1a1d43f98f49 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7, portal: 172.16.0.220,3260]
Aug 17 11:54:38 user nova-compute[73449]: Login to [iface: default, target: iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7, portal: 172.16.0.220,3260] successful.
Aug 17 11:54:38 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:54:38 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:54:38 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:54:38 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[996eca27-a2b5-482e-b578-61821ae0e1f6]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:54:38 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-29ecc1a6-26fa-4901-82a8-1a1d43f98f49 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:54:38 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:54:38 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:54:38 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b8be5e3-de10-45c6-9105-03fbb154c995]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a382874-91aa-4ff2-aae4-15db10fe5ff2 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7 (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:54:38 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-29ecc1a6-26fa-4901-82a8-1a1d43f98f49 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 (non-flash)
Aug 17 11:54:38 user nova-compute[73449]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)
Aug 17 11:54:38 user nova-compute[73449]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a382874-91aa-4ff2-aae4-15db10fe5ff2 (non-flash)
Aug 17 11:54:38 user nova-compute[73449]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 (non-flash)
Aug 17 11:54:38 user nova-compute[73449]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7 (non-flash)
Aug 17 11:54:38 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:54:38 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-29ecc1a6-26fa-4901-82a8-1a1d43f98f49 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 (non-flash)
Aug 17 11:54:38 user nova-compute[73449]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)
Aug 17 11:54:38 user nova-compute[73449]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a382874-91aa-4ff2-aae4-15db10fe5ff2 (non-flash)
Aug 17 11:54:38 user nova-compute[73449]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 (non-flash)
Aug 17 11:54:38 user nova-compute[73449]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7 (non-flash)
Aug 17 11:54:38 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:54:38 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-29ecc1a6-26fa-4901-82a8-1a1d43f98f49 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.312s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:54:38 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-29ecc1a6-26fa-4901-82a8-1a1d43f98f49 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Connected to 172.16.0.220:3260 {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 11:54:38 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-29ecc1a6-26fa-4901-82a8-1a1d43f98f49 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] HCTL ('34', '-', '-', 0) found on session 41 with lun 0 {{(pid=73449) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 11:54:38 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-29ecc1a6-26fa-4901-82a8-1a1d43f98f49 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73449) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 11:54:38 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:54:38 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:54:38 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[f96b2ea6-c614-4161-82ea-c091a02903fd]: (4, ('- - 0', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:54:38 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-29ecc1a6-26fa-4901-82a8-1a1d43f98f49 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Searching for a device in session 41 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73449) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 11:54:38 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-29ecc1a6-26fa-4901-82a8-1a1d43f98f49 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CtHUhuMp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 11:54:39 user nova-compute[73449]: DEBUG nova.objects.instance [None req-1e65e782-9467-406c-990f-adc09e503598 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Lazy-loading 'flavor' on Instance uuid fea9f81c-a848-4a65-863e-e09dddf65bcf {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:54:39 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-1e65e782-9467-406c-990f-adc09e503598 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Lock "fea9f81c-a848-4a65-863e-e09dddf65bcf" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.870s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:54:39 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-29ecc1a6-26fa-4901-82a8-1a1d43f98f49 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.351s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:54:39 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-29ecc1a6-26fa-4901-82a8-1a1d43f98f49 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] <== connect_volume: return (1352ms) {'type': 'block', 'scsi_wwn': '23234616162363133', 'path': '/dev/sdc'} {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 11:54:39 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29ecc1a6-26fa-4901-82a8-1a1d43f98f49 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 1542e090-dffe-47d1-8bf1-bb0361cfba34] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23234616162363133', 'path': '/dev/sdc'} {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 11:54:39 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-29ecc1a6-26fa-4901-82a8-1a1d43f98f49 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:54:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-413418719',display_name='tempest-TestVolumeBootPattern-server-413418719',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-413418719',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIHMstqa6z3yCDWSo0nI/hXtJfgb+1MPwAN30vhg6KwDR8sZaSoGZeJ4pbZmuMNqk20Z45pPhufbqYZm+wNKDW7ChjAcmHiitPsVRUAo/TWnRjbFauozfEZ44NXHQWQQfg==',key_name='tempest-TestVolumeBootPattern-29823023',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4bd46cdaff7a4b40955f7c8a12c55452',ramdisk_id='',reservation_id='r-i4gd5t99',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-813872552',owner_user_name='tempest-TestVolumeBootPattern-813872552-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T11:54:27Z,user_data=None,user_id='804ccb0440fb46a4a4c0ae65c3893296',uuid=1542e090-dffe-47d1-8bf1-bb0361cfba34,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "85a7a7f3-b4c3-4ff0-810a-4cce888b99a2", "address": "fa:16:3e:3e:33:50", "network": {"id": "a9e8fcd6-4152-466b-99ad-44b85db05a05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-920564935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bd46cdaff7a4b40955f7c8a12c55452", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85a7a7f3-b4", "ovs_interfaceid": "85a7a7f3-b4c3-4ff0-810a-4cce888b99a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73449) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 11:54:39 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-29ecc1a6-26fa-4901-82a8-1a1d43f98f49 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Converting VIF {"id": "85a7a7f3-b4c3-4ff0-810a-4cce888b99a2", "address": "fa:16:3e:3e:33:50", "network": {"id": "a9e8fcd6-4152-466b-99ad-44b85db05a05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-920564935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bd46cdaff7a4b40955f7c8a12c55452", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85a7a7f3-b4", "ovs_interfaceid": "85a7a7f3-b4c3-4ff0-810a-4cce888b99a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:54:39 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-29ecc1a6-26fa-4901-82a8-1a1d43f98f49 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:33:50,bridge_name='br-int',has_traffic_filtering=True,id=85a7a7f3-b4c3-4ff0-810a-4cce888b99a2,network=Network(a9e8fcd6-4152-466b-99ad-44b85db05a05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85a7a7f3-b4') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:54:39 user nova-compute[73449]: DEBUG nova.objects.instance [None req-29ecc1a6-26fa-4901-82a8-1a1d43f98f49 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Lazy-loading 'pci_devices' on Instance uuid 1542e090-dffe-47d1-8bf1-bb0361cfba34 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:54:39 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-29ecc1a6-26fa-4901-82a8-1a1d43f98f49 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 1542e090-dffe-47d1-8bf1-bb0361cfba34] End _get_guest_xml xml=<domain type="kvm">
Aug 17 11:54:39 user nova-compute[73449]:   <uuid>1542e090-dffe-47d1-8bf1-bb0361cfba34</uuid>
Aug 17 11:54:39 user nova-compute[73449]:   <name>instance-00000021</name>
Aug 17 11:54:39 user nova-compute[73449]:   <memory>524288</memory>
Aug 17 11:54:39 user nova-compute[73449]:   <vcpu>1</vcpu>
Aug 17 11:54:39 user nova-compute[73449]:   <metadata>
Aug 17 11:54:39 user nova-compute[73449]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 11:54:39 user nova-compute[73449]:       <nova:package version="0.0.0"/>
Aug 17 11:54:39 user nova-compute[73449]:       <nova:name>tempest-TestVolumeBootPattern-server-413418719</nova:name>
Aug 17 11:54:39 user nova-compute[73449]:       <nova:creationTime>2023-08-17 11:54:38</nova:creationTime>
Aug 17 11:54:39 user nova-compute[73449]:       <nova:flavor name="m1.tiny">
Aug 17 11:54:39 user nova-compute[73449]:         <nova:memory>512</nova:memory>
Aug 17 11:54:39 user nova-compute[73449]:         <nova:disk>1</nova:disk>
Aug 17 11:54:39 user nova-compute[73449]:         <nova:swap>0</nova:swap>
Aug 17 11:54:39 user nova-compute[73449]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 11:54:39 user nova-compute[73449]:         <nova:vcpus>1</nova:vcpus>
Aug 17 11:54:39 user nova-compute[73449]:       </nova:flavor>
Aug 17 11:54:39 user nova-compute[73449]:       <nova:owner>
Aug 17 11:54:39 user nova-compute[73449]:         <nova:user uuid="804ccb0440fb46a4a4c0ae65c3893296">tempest-TestVolumeBootPattern-813872552-project-member</nova:user>
Aug 17 11:54:39 user nova-compute[73449]:         <nova:project uuid="4bd46cdaff7a4b40955f7c8a12c55452">tempest-TestVolumeBootPattern-813872552</nova:project>
Aug 17 11:54:39 user nova-compute[73449]:       </nova:owner>
Aug 17 11:54:39 user nova-compute[73449]:       <nova:ports>
Aug 17 11:54:39 user nova-compute[73449]:         <nova:port uuid="85a7a7f3-b4c3-4ff0-810a-4cce888b99a2">
Aug 17 11:54:39 user nova-compute[73449]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 17 11:54:39 user nova-compute[73449]:         </nova:port>
Aug 17 11:54:39 user nova-compute[73449]:       </nova:ports>
Aug 17 11:54:39 user nova-compute[73449]:     </nova:instance>
Aug 17 11:54:39 user nova-compute[73449]:   </metadata>
Aug 17 11:54:39 user nova-compute[73449]:   <sysinfo type="smbios">
Aug 17 11:54:39 user nova-compute[73449]:     <system>
Aug 17 11:54:39 user nova-compute[73449]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 11:54:39 user nova-compute[73449]:       <entry name="product">OpenStack Nova</entry>
Aug 17 11:54:39 user nova-compute[73449]:       <entry name="version">0.0.0</entry>
Aug 17 11:54:39 user nova-compute[73449]:       <entry name="serial">1542e090-dffe-47d1-8bf1-bb0361cfba34</entry>
Aug 17 11:54:39 user nova-compute[73449]:       <entry name="uuid">1542e090-dffe-47d1-8bf1-bb0361cfba34</entry>
Aug 17 11:54:39 user nova-compute[73449]:       <entry name="family">Virtual Machine</entry>
Aug 17 11:54:39 user nova-compute[73449]:     </system>
Aug 17 11:54:39 user nova-compute[73449]:   </sysinfo>
Aug 17 11:54:39 user nova-compute[73449]:   <os>
Aug 17 11:54:39 user nova-compute[73449]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 11:54:39 user nova-compute[73449]:     <boot dev="hd"/>
Aug 17 11:54:39 user nova-compute[73449]:     <smbios mode="sysinfo"/>
Aug 17 11:54:39 user nova-compute[73449]:   </os>
Aug 17 11:54:39 user nova-compute[73449]:   <features>
Aug 17 11:54:39 user nova-compute[73449]:     <acpi/>
Aug 17 11:54:39 user nova-compute[73449]:     <apic/>
Aug 17 11:54:39 user nova-compute[73449]:     <vmcoreinfo/>
Aug 17 11:54:39 user nova-compute[73449]:   </features>
Aug 17 11:54:39 user nova-compute[73449]:   <clock offset="utc">
Aug 17 11:54:39 user nova-compute[73449]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 11:54:39 user nova-compute[73449]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 11:54:39 user nova-compute[73449]:     <timer name="hpet" present="no"/>
Aug 17 11:54:39 user nova-compute[73449]:   </clock>
Aug 17 11:54:39 user nova-compute[73449]:   <cpu mode="custom" match="exact">
Aug 17 11:54:39 user nova-compute[73449]:     <model>Nehalem</model>
Aug 17 11:54:39 user nova-compute[73449]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 11:54:39 user nova-compute[73449]:   </cpu>
Aug 17 11:54:39 user nova-compute[73449]:   <devices>
Aug 17 11:54:39 user nova-compute[73449]:     <disk type="block" device="disk">
Aug 17 11:54:39 user nova-compute[73449]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 11:54:39 user nova-compute[73449]:       <source dev="/dev/sdc"/>
Aug 17 11:54:39 user nova-compute[73449]:       <target dev="vda" bus="virtio"/>
Aug 17 11:54:39 user nova-compute[73449]:       <serial>2a343174-094b-4cd2-98cc-f215c047baf7</serial>
Aug 17 11:54:39 user nova-compute[73449]:     </disk>
Aug 17 11:54:39 user nova-compute[73449]:     <interface type="ethernet">
Aug 17 11:54:39 user nova-compute[73449]:       <mac address="fa:16:3e:3e:33:50"/>
Aug 17 11:54:39 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 11:54:39 user nova-compute[73449]:       <mtu size="1442"/>
Aug 17 11:54:39 user nova-compute[73449]:       <target dev="tap85a7a7f3-b4"/>
Aug 17 11:54:39 user nova-compute[73449]:     </interface>
Aug 17 11:54:39 user nova-compute[73449]:     <serial type="pty">
Aug 17 11:54:39 user nova-compute[73449]:       <log file="/opt/stack/data/nova/instances/1542e090-dffe-47d1-8bf1-bb0361cfba34/console.log" append="off"/>
Aug 17 11:54:39 user nova-compute[73449]:     </serial>
Aug 17 11:54:39 user nova-compute[73449]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 11:54:39 user nova-compute[73449]:     <video>
Aug 17 11:54:39 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 11:54:39 user nova-compute[73449]:     </video>
Aug 17 11:54:39 user nova-compute[73449]:     <rng model="virtio">
Aug 17 11:54:39 user nova-compute[73449]:       <backend model="random">/dev/urandom</backend>
Aug 17 11:54:39 user nova-compute[73449]:     </rng>
Aug 17 11:54:39 user nova-compute[73449]:     <controller type="usb" index="0" model="none"/>
Aug 17 11:54:39 user nova-compute[73449]:     <memballoon model="virtio">
Aug 17 11:54:39 user nova-compute[73449]:       <stats period="10"/>
Aug 17 11:54:39 user nova-compute[73449]:     </memballoon>
Aug 17 11:54:39 user nova-compute[73449]:   </devices>
Aug 17 11:54:39 user nova-compute[73449]: </domain>
Aug 17 11:54:39 user nova-compute[73449]:  {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 11:54:39 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-29ecc1a6-26fa-4901-82a8-1a1d43f98f49 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:54:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-413418719',display_name='tempest-TestVolumeBootPattern-server-413418719',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-413418719',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIHMstqa6z3yCDWSo0nI/hXtJfgb+1MPwAN30vhg6KwDR8sZaSoGZeJ4pbZmuMNqk20Z45pPhufbqYZm+wNKDW7ChjAcmHiitPsVRUAo/TWnRjbFauozfEZ44NXHQWQQfg==',key_name='tempest-TestVolumeBootPattern-29823023',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4bd46cdaff7a4b40955f7c8a12c55452',ramdisk_id='',reservation_id='r-i4gd5t99',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-813872552',owner_user_name='tempest-TestVolumeBootPattern-813872552-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T11:54:27Z,user_data=None,user_id='804ccb0440fb46a4a4c0ae65c3893296',uuid=1542e090-dffe-47d1-8bf1-bb0361cfba34,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "85a7a7f3-b4c3-4ff0-810a-4cce888b99a2", "address": "fa:16:3e:3e:33:50", "network": {"id": "a9e8fcd6-4152-466b-99ad-44b85db05a05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-920564935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bd46cdaff7a4b40955f7c8a12c55452", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85a7a7f3-b4", "ovs_interfaceid": "85a7a7f3-b4c3-4ff0-810a-4cce888b99a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 11:54:39 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-29ecc1a6-26fa-4901-82a8-1a1d43f98f49 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Converting VIF {"id": "85a7a7f3-b4c3-4ff0-810a-4cce888b99a2", "address": "fa:16:3e:3e:33:50", "network": {"id": "a9e8fcd6-4152-466b-99ad-44b85db05a05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-920564935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bd46cdaff7a4b40955f7c8a12c55452", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85a7a7f3-b4", "ovs_interfaceid": "85a7a7f3-b4c3-4ff0-810a-4cce888b99a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:54:39 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-29ecc1a6-26fa-4901-82a8-1a1d43f98f49 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:33:50,bridge_name='br-int',has_traffic_filtering=True,id=85a7a7f3-b4c3-4ff0-810a-4cce888b99a2,network=Network(a9e8fcd6-4152-466b-99ad-44b85db05a05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85a7a7f3-b4') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:54:39 user nova-compute[73449]: DEBUG os_vif [None req-29ecc1a6-26fa-4901-82a8-1a1d43f98f49 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:33:50,bridge_name='br-int',has_traffic_filtering=True,id=85a7a7f3-b4c3-4ff0-810a-4cce888b99a2,network=Network(a9e8fcd6-4152-466b-99ad-44b85db05a05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85a7a7f3-b4') {{(pid=73449) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 11:54:39 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:54:39 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:54:39 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 11:54:39 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:54:39 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap85a7a7f3-b4, may_exist=True, interface_attrs={}) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:54:39 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap85a7a7f3-b4, col_values=(('external_ids', {'iface-id': '85a7a7f3-b4c3-4ff0-810a-4cce888b99a2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3e:33:50', 'vm-uuid': '1542e090-dffe-47d1-8bf1-bb0361cfba34'}),), if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:54:39 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:54:39 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:54:39 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:54:39 user nova-compute[73449]: INFO os_vif [None req-29ecc1a6-26fa-4901-82a8-1a1d43f98f49 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:33:50,bridge_name='br-int',has_traffic_filtering=True,id=85a7a7f3-b4c3-4ff0-810a-4cce888b99a2,network=Network(a9e8fcd6-4152-466b-99ad-44b85db05a05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85a7a7f3-b4')
Aug 17 11:54:40 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-29ecc1a6-26fa-4901-82a8-1a1d43f98f49 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] No BDM found with device name vda, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 11:54:40 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-29ecc1a6-26fa-4901-82a8-1a1d43f98f49 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] No VIF found with MAC fa:16:3e:3e:33:50, not building metadata {{(pid=73449) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 11:54:41 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:54:41 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:54:41 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:54:41 user nova-compute[73449]: DEBUG nova.compute.manager [req-44231322-1b3d-4f89-9f61-ce4e84892b41 req-3283d151-cf92-4494-ab59-0b6ce0b171a9 service nova] [instance: 1542e090-dffe-47d1-8bf1-bb0361cfba34] Received event network-vif-plugged-85a7a7f3-b4c3-4ff0-810a-4cce888b99a2 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:54:41 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-44231322-1b3d-4f89-9f61-ce4e84892b41 req-3283d151-cf92-4494-ab59-0b6ce0b171a9 service nova] Acquiring lock "1542e090-dffe-47d1-8bf1-bb0361cfba34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:54:41 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-44231322-1b3d-4f89-9f61-ce4e84892b41 req-3283d151-cf92-4494-ab59-0b6ce0b171a9 service nova] Lock "1542e090-dffe-47d1-8bf1-bb0361cfba34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:54:41 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-44231322-1b3d-4f89-9f61-ce4e84892b41 req-3283d151-cf92-4494-ab59-0b6ce0b171a9 service nova] Lock "1542e090-dffe-47d1-8bf1-bb0361cfba34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:54:41 user nova-compute[73449]: DEBUG nova.compute.manager [req-44231322-1b3d-4f89-9f61-ce4e84892b41 req-3283d151-cf92-4494-ab59-0b6ce0b171a9 service nova] [instance: 1542e090-dffe-47d1-8bf1-bb0361cfba34] No waiting events found dispatching network-vif-plugged-85a7a7f3-b4c3-4ff0-810a-4cce888b99a2 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:54:41 user nova-compute[73449]: WARNING nova.compute.manager [req-44231322-1b3d-4f89-9f61-ce4e84892b41 req-3283d151-cf92-4494-ab59-0b6ce0b171a9 service nova] [instance: 1542e090-dffe-47d1-8bf1-bb0361cfba34] Received unexpected event network-vif-plugged-85a7a7f3-b4c3-4ff0-810a-4cce888b99a2 for instance with vm_state building and task_state spawning.
Aug 17 11:54:41 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:54:41 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:54:41 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:54:41 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:54:43 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:54:43 user nova-compute[73449]: DEBUG nova.compute.manager [None req-29ecc1a6-26fa-4901-82a8-1a1d43f98f49 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 1542e090-dffe-47d1-8bf1-bb0361cfba34] Instance event wait completed in 0 seconds for  {{(pid=73449) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 11:54:43 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-29ecc1a6-26fa-4901-82a8-1a1d43f98f49 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 1542e090-dffe-47d1-8bf1-bb0361cfba34] Guest created on hypervisor {{(pid=73449) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 11:54:43 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692273283.5276048, 1542e090-dffe-47d1-8bf1-bb0361cfba34 => Resumed> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:54:43 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 1542e090-dffe-47d1-8bf1-bb0361cfba34] VM Resumed (Lifecycle Event)
Aug 17 11:54:43 user nova-compute[73449]: DEBUG nova.compute.manager [req-a314b8df-d0b3-484a-85f5-83f558072704 req-846c63aa-7879-4dbc-89a4-c3fe9dc95f54 service nova] [instance: 1542e090-dffe-47d1-8bf1-bb0361cfba34] Received event network-vif-plugged-85a7a7f3-b4c3-4ff0-810a-4cce888b99a2 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:54:43 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-a314b8df-d0b3-484a-85f5-83f558072704 req-846c63aa-7879-4dbc-89a4-c3fe9dc95f54 service nova] Acquiring lock "1542e090-dffe-47d1-8bf1-bb0361cfba34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:54:43 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-a314b8df-d0b3-484a-85f5-83f558072704 req-846c63aa-7879-4dbc-89a4-c3fe9dc95f54 service nova] Lock "1542e090-dffe-47d1-8bf1-bb0361cfba34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:54:43 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-a314b8df-d0b3-484a-85f5-83f558072704 req-846c63aa-7879-4dbc-89a4-c3fe9dc95f54 service nova] Lock "1542e090-dffe-47d1-8bf1-bb0361cfba34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:54:43 user nova-compute[73449]: DEBUG nova.compute.manager [req-a314b8df-d0b3-484a-85f5-83f558072704 req-846c63aa-7879-4dbc-89a4-c3fe9dc95f54 service nova] [instance: 1542e090-dffe-47d1-8bf1-bb0361cfba34] No waiting events found dispatching network-vif-plugged-85a7a7f3-b4c3-4ff0-810a-4cce888b99a2 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:54:43 user nova-compute[73449]: WARNING nova.compute.manager [req-a314b8df-d0b3-484a-85f5-83f558072704 req-846c63aa-7879-4dbc-89a4-c3fe9dc95f54 service nova] [instance: 1542e090-dffe-47d1-8bf1-bb0361cfba34] Received unexpected event network-vif-plugged-85a7a7f3-b4c3-4ff0-810a-4cce888b99a2 for instance with vm_state building and task_state spawning.
Aug 17 11:54:43 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: 1542e090-dffe-47d1-8bf1-bb0361cfba34] Instance spawned successfully.
Aug 17 11:54:43 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-29ecc1a6-26fa-4901-82a8-1a1d43f98f49 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 1542e090-dffe-47d1-8bf1-bb0361cfba34] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 11:54:43 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 1542e090-dffe-47d1-8bf1-bb0361cfba34] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:54:43 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 1542e090-dffe-47d1-8bf1-bb0361cfba34] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 11:54:43 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 1542e090-dffe-47d1-8bf1-bb0361cfba34] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 11:54:43 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692273283.5278738, 1542e090-dffe-47d1-8bf1-bb0361cfba34 => Started> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:54:43 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 1542e090-dffe-47d1-8bf1-bb0361cfba34] VM Started (Lifecycle Event)
Aug 17 11:54:43 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-29ecc1a6-26fa-4901-82a8-1a1d43f98f49 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 1542e090-dffe-47d1-8bf1-bb0361cfba34] Found default for hw_cdrom_bus of ide {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:54:43 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-29ecc1a6-26fa-4901-82a8-1a1d43f98f49 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 1542e090-dffe-47d1-8bf1-bb0361cfba34] Found default for hw_disk_bus of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:54:43 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-29ecc1a6-26fa-4901-82a8-1a1d43f98f49 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 1542e090-dffe-47d1-8bf1-bb0361cfba34] Found default for hw_input_bus of None {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:54:43 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-29ecc1a6-26fa-4901-82a8-1a1d43f98f49 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 1542e090-dffe-47d1-8bf1-bb0361cfba34] Found default for hw_pointer_model of None {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:54:43 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-29ecc1a6-26fa-4901-82a8-1a1d43f98f49 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 1542e090-dffe-47d1-8bf1-bb0361cfba34] Found default for hw_video_model of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:54:43 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-29ecc1a6-26fa-4901-82a8-1a1d43f98f49 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 1542e090-dffe-47d1-8bf1-bb0361cfba34] Found default for hw_vif_model of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:54:43 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 1542e090-dffe-47d1-8bf1-bb0361cfba34] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:54:43 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 1542e090-dffe-47d1-8bf1-bb0361cfba34] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 11:54:43 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 1542e090-dffe-47d1-8bf1-bb0361cfba34] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 11:54:43 user nova-compute[73449]: INFO nova.compute.manager [None req-29ecc1a6-26fa-4901-82a8-1a1d43f98f49 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 1542e090-dffe-47d1-8bf1-bb0361cfba34] Took 5.21 seconds to spawn the instance on the hypervisor.
Aug 17 11:54:43 user nova-compute[73449]: DEBUG nova.compute.manager [None req-29ecc1a6-26fa-4901-82a8-1a1d43f98f49 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 1542e090-dffe-47d1-8bf1-bb0361cfba34] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:54:43 user nova-compute[73449]: INFO nova.compute.manager [None req-29ecc1a6-26fa-4901-82a8-1a1d43f98f49 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 1542e090-dffe-47d1-8bf1-bb0361cfba34] Took 17.68 seconds to build instance.
Aug 17 11:54:43 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-29ecc1a6-26fa-4901-82a8-1a1d43f98f49 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Lock "1542e090-dffe-47d1-8bf1-bb0361cfba34" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.848s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:54:44 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:54:48 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:54:49 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:54:53 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:54:54 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:54:58 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:54:59 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:55:00 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:55:00 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:55:00 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:55:00 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:55:00 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:55:00 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:55:00 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:55:00 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73449) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 11:55:01 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:55:01 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Starting heal instance info cache {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 11:55:02 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "refresh_cache-dd4ec7bd-002e-4a71-9314-96c21427af27" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:55:02 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquired lock "refresh_cache-dd4ec7bd-002e-4a71-9314-96c21427af27" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:55:02 user nova-compute[73449]: DEBUG nova.network.neutron [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: dd4ec7bd-002e-4a71-9314-96c21427af27] Forcefully refreshing network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 11:55:02 user nova-compute[73449]: DEBUG nova.network.neutron [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: dd4ec7bd-002e-4a71-9314-96c21427af27] Updating instance_info_cache with network_info: [{"id": "24acbd43-f1af-45d2-953d-53b3e4c24335", "address": "fa:16:3e:20:8e:ea", "network": {"id": "c3e9bf16-545d-4ae8-bbad-5092c0e8f735", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1927778048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbaa73b99e5a498dac668e5307654fd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24acbd43-f1", "ovs_interfaceid": "24acbd43-f1af-45d2-953d-53b3e4c24335", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:55:02 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Releasing lock "refresh_cache-dd4ec7bd-002e-4a71-9314-96c21427af27" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:55:02 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: dd4ec7bd-002e-4a71-9314-96c21427af27] Updated the network info_cache for instance {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 11:55:03 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:55:03 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-aef6a344-ad70-49e5-adc4-d3ff8cf5ae6a tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Acquiring lock "3d468854-6182-49c8-acb7-0641df2d5219" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:55:03 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-aef6a344-ad70-49e5-adc4-d3ff8cf5ae6a tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Lock "3d468854-6182-49c8-acb7-0641df2d5219" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:55:03 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-aef6a344-ad70-49e5-adc4-d3ff8cf5ae6a tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Acquiring lock "3d468854-6182-49c8-acb7-0641df2d5219-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:55:03 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-aef6a344-ad70-49e5-adc4-d3ff8cf5ae6a tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Lock "3d468854-6182-49c8-acb7-0641df2d5219-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:55:03 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-aef6a344-ad70-49e5-adc4-d3ff8cf5ae6a tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Lock "3d468854-6182-49c8-acb7-0641df2d5219-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:55:03 user nova-compute[73449]: INFO nova.compute.manager [None req-aef6a344-ad70-49e5-adc4-d3ff8cf5ae6a tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Terminating instance
Aug 17 11:55:03 user nova-compute[73449]: DEBUG nova.compute.manager [None req-aef6a344-ad70-49e5-adc4-d3ff8cf5ae6a tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Start destroying the instance on the hypervisor. {{(pid=73449) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 11:55:03 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:55:03 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:55:03 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:55:04 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:55:04 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:55:04 user nova-compute[73449]: DEBUG nova.compute.manager [req-17541a68-ee06-422a-b730-5f78633b981f req-e790a8a5-bb1b-4c2c-b756-ba2bca478f85 service nova] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Received event network-vif-unplugged-1ec58d7f-18a4-4ddb-a137-2b72c5221621 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:55:04 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-17541a68-ee06-422a-b730-5f78633b981f req-e790a8a5-bb1b-4c2c-b756-ba2bca478f85 service nova] Acquiring lock "3d468854-6182-49c8-acb7-0641df2d5219-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:55:04 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-17541a68-ee06-422a-b730-5f78633b981f req-e790a8a5-bb1b-4c2c-b756-ba2bca478f85 service nova] Lock "3d468854-6182-49c8-acb7-0641df2d5219-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:55:04 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-17541a68-ee06-422a-b730-5f78633b981f req-e790a8a5-bb1b-4c2c-b756-ba2bca478f85 service nova] Lock "3d468854-6182-49c8-acb7-0641df2d5219-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:55:04 user nova-compute[73449]: DEBUG nova.compute.manager [req-17541a68-ee06-422a-b730-5f78633b981f req-e790a8a5-bb1b-4c2c-b756-ba2bca478f85 service nova] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] No waiting events found dispatching network-vif-unplugged-1ec58d7f-18a4-4ddb-a137-2b72c5221621 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:55:04 user nova-compute[73449]: DEBUG nova.compute.manager [req-17541a68-ee06-422a-b730-5f78633b981f req-e790a8a5-bb1b-4c2c-b756-ba2bca478f85 service nova] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Received event network-vif-unplugged-1ec58d7f-18a4-4ddb-a137-2b72c5221621 for instance with task_state deleting. {{(pid=73449) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 11:55:04 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:55:04 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:55:04 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Instance destroyed successfully.
Aug 17 11:55:04 user nova-compute[73449]: DEBUG nova.objects.instance [None req-aef6a344-ad70-49e5-adc4-d3ff8cf5ae6a tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Lazy-loading 'resources' on Instance uuid 3d468854-6182-49c8-acb7-0641df2d5219 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:55:04 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-aef6a344-ad70-49e5-adc4-d3ff8cf5ae6a tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:46:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1456627687',display_name='tempest-ServerActionsTestOtherB-server-1456627687',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1456627687',id=20,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNxG3No2zUVrbEXbRYCvyFo5zdmNWjUQ1w9Et6I/UYTR5GdEjRnJlmF8yAFQAym8G0hKrThB6Qoa83CCIr+oCSIdRZoU+FBKHtl3+QzEAuOyPVMVYrkASnAypoGWlwjgpQ==',key_name='tempest-keypair-1350250606',keypairs=<?>,launch_index=0,launched_at=2023-08-17T11:52:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4d6856b60c404a34b6355b5fd6dd7bb8',ramdisk_id='',reservation_id='r-2byzpdg1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-108358124',owner_user_name='tempest-ServerActionsTestOtherB-108358124-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T11:52:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2791de1444c2428f9120cc907529cfcf',uuid=3d468854-6182-49c8-acb7-0641df2d5219,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1ec58d7f-18a4-4ddb-a137-2b72c5221621", "address": "fa:16:3e:8d:35:49", "network": {"id": "870c4b80-1ae0-4a10-89b8-ec734c66c244", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2050219794-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d6856b60c404a34b6355b5fd6dd7bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec58d7f-18", "ovs_interfaceid": "1ec58d7f-18a4-4ddb-a137-2b72c5221621", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 11:55:04 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-aef6a344-ad70-49e5-adc4-d3ff8cf5ae6a tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Converting VIF {"id": "1ec58d7f-18a4-4ddb-a137-2b72c5221621", "address": "fa:16:3e:8d:35:49", "network": {"id": "870c4b80-1ae0-4a10-89b8-ec734c66c244", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2050219794-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d6856b60c404a34b6355b5fd6dd7bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec58d7f-18", "ovs_interfaceid": "1ec58d7f-18a4-4ddb-a137-2b72c5221621", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:55:04 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-aef6a344-ad70-49e5-adc4-d3ff8cf5ae6a tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8d:35:49,bridge_name='br-int',has_traffic_filtering=True,id=1ec58d7f-18a4-4ddb-a137-2b72c5221621,network=Network(870c4b80-1ae0-4a10-89b8-ec734c66c244),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ec58d7f-18') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:55:04 user nova-compute[73449]: DEBUG os_vif [None req-aef6a344-ad70-49e5-adc4-d3ff8cf5ae6a tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8d:35:49,bridge_name='br-int',has_traffic_filtering=True,id=1ec58d7f-18a4-4ddb-a137-2b72c5221621,network=Network(870c4b80-1ae0-4a10-89b8-ec734c66c244),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ec58d7f-18') {{(pid=73449) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 11:55:04 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:55:04 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1ec58d7f-18, bridge=br-int, if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:55:04 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:55:04 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:55:04 user nova-compute[73449]: INFO os_vif [None req-aef6a344-ad70-49e5-adc4-d3ff8cf5ae6a tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8d:35:49,bridge_name='br-int',has_traffic_filtering=True,id=1ec58d7f-18a4-4ddb-a137-2b72c5221621,network=Network(870c4b80-1ae0-4a10-89b8-ec734c66c244),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ec58d7f-18')
Aug 17 11:55:04 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aef6a344-ad70-49e5-adc4-d3ff8cf5ae6a tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] calling os-brick to detach iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 11:55:04 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-aef6a344-ad70-49e5-adc4-d3ff8cf5ae6a tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, {'target_iqns': ['iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZpYgxHvU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 11:55:04 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-aef6a344-ad70-49e5-adc4-d3ff8cf5ae6a tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 11:55:04 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-aef6a344-ad70-49e5-adc4-d3ff8cf5ae6a tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:55:04 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-aef6a344-ad70-49e5-adc4-d3ff8cf5ae6a tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:55:04 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-aef6a344-ad70-49e5-adc4-d3ff8cf5ae6a tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061', 0)] {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 11:55:04 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:55:04 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:55:04 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[5caee050-dbb0-4988-8e6d-a9c1007ea5a6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a382874-91aa-4ff2-aae4-15db10fe5ff2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:55:04 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:55:04 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:55:04 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[d50e9ea9-588f-4956-a36c-669a9b831177]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a382874-91aa-4ff2-aae4-15db10fe5ff2 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7 (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:55:04 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-aef6a344-ad70-49e5-adc4-d3ff8cf5ae6a tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 (non-flash)
Aug 17 11:55:04 user nova-compute[73449]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)
Aug 17 11:55:04 user nova-compute[73449]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a382874-91aa-4ff2-aae4-15db10fe5ff2 (non-flash)
Aug 17 11:55:04 user nova-compute[73449]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 (non-flash)
Aug 17 11:55:04 user nova-compute[73449]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7 (non-flash)
Aug 17 11:55:04 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:55:04 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-aef6a344-ad70-49e5-adc4-d3ff8cf5ae6a tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 (non-flash)
Aug 17 11:55:04 user nova-compute[73449]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)
Aug 17 11:55:04 user nova-compute[73449]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a382874-91aa-4ff2-aae4-15db10fe5ff2 (non-flash)
Aug 17 11:55:04 user nova-compute[73449]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 (non-flash)
Aug 17 11:55:04 user nova-compute[73449]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7 (non-flash)
Aug 17 11:55:04 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:55:04 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-aef6a344-ad70-49e5-adc4-d3ff8cf5ae6a tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe75812a830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061'): ({'sdb'}, set())}) {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 11:55:04 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-aef6a344-ad70-49e5-adc4-d3ff8cf5ae6a tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Removing single pathed devices sdb {{(pid=73449) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 11:55:04 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:55:04 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:55:04 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c1df0f9-97f7-4f62-86eb-37b39e7c36a0]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:55:04 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:55:04 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:55:04 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8cf7494-50e1-4ccf-83cf-bcfdd30a916b]: (4, ('ok\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:55:04 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-aef6a344-ad70-49e5-adc4-d3ff8cf5ae6a tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Flushing IO for device /dev/sdb {{(pid=73449) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 11:55:04 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:55:04 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:55:04 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[9964f75b-a677-427b-8409-1a0cbe0bcfdd]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:55:04 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-aef6a344-ad70-49e5-adc4-d3ff8cf5ae6a tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73449) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 11:55:04 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:55:04 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:55:04 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[264e5207-7921-463b-bed5-b5435500f63e]: (4, ('1', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:55:04 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-aef6a344-ad70-49e5-adc4-d3ff8cf5ae6a tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73449) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 11:55:04 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-aef6a344-ad70-49e5-adc4-d3ff8cf5ae6a tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] SCSI volumes sdb have been removed. {{(pid=73449) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 11:55:04 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-aef6a344-ad70-49e5-adc4-d3ff8cf5ae6a tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061')] {{(pid=73449) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 11:55:04 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:55:04 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:55:04 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[1742f5fd-02d9-47db-8c21-956097eee08f]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:55:04 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-aef6a344-ad70-49e5-adc4-d3ff8cf5ae6a tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:55:04 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 -p 172.16.0.220:3260 --logout {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:55:05 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 -p 172.16.0.220:3260 --logout" returned: 0 in 0.136s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:55:05 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c399dfe-74da-421a-a6fd-889f1b56faeb]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:55:05 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-aef6a344-ad70-49e5-adc4-d3ff8cf5ae6a tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061, portal: 172.16.0.220,3260]
Aug 17 11:55:05 user nova-compute[73449]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061, portal: 172.16.0.220,3260] successful.
Aug 17 11:55:05 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:55:05 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 -p 172.16.0.220:3260 --op delete {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:55:05 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:040e2bc9-cd90-4010-9fdf-b7cc92b1c061 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:55:05 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[b600ee59-c04f-45d5-a5a3-bcdc0d436def]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:55:05 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-aef6a344-ad70-49e5-adc4-d3ff8cf5ae6a tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:55:05 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-aef6a344-ad70-49e5-adc4-d3ff8cf5ae6a tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.391s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:55:05 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-aef6a344-ad70-49e5-adc4-d3ff8cf5ae6a tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] <== disconnect_volume: return (392ms) None {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 11:55:05 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aef6a344-ad70-49e5-adc4-d3ff8cf5ae6a tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Disconnected iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 11:55:05 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-aef6a344-ad70-49e5-adc4-d3ff8cf5ae6a tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Deleting instance files /opt/stack/data/nova/instances/3d468854-6182-49c8-acb7-0641df2d5219_del
Aug 17 11:55:05 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-aef6a344-ad70-49e5-adc4-d3ff8cf5ae6a tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Deletion of /opt/stack/data/nova/instances/3d468854-6182-49c8-acb7-0641df2d5219_del complete
Aug 17 11:55:05 user nova-compute[73449]: INFO nova.compute.manager [None req-aef6a344-ad70-49e5-adc4-d3ff8cf5ae6a tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Took 1.32 seconds to destroy the instance on the hypervisor.
Aug 17 11:55:05 user nova-compute[73449]: DEBUG oslo.service.loopingcall [None req-aef6a344-ad70-49e5-adc4-d3ff8cf5ae6a tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73449) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 11:55:05 user nova-compute[73449]: DEBUG nova.compute.manager [-] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Deallocating network for instance {{(pid=73449) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 11:55:05 user nova-compute[73449]: DEBUG nova.network.neutron [-] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] deallocate_for_instance() {{(pid=73449) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 11:55:05 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:55:05 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:55:05 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:55:05 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:55:05 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=73449) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 11:55:06 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd4ec7bd-002e-4a71-9314-96c21427af27/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:55:06 user nova-compute[73449]: DEBUG nova.network.neutron [-] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Updating instance_info_cache with network_info: [] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:55:06 user nova-compute[73449]: DEBUG nova.compute.manager [req-a6b31c45-ceb0-4e84-9861-a90248a6a77b req-2904d2ac-af9e-481c-90a1-0c760d9c6880 service nova] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Received event network-vif-deleted-1ec58d7f-18a4-4ddb-a137-2b72c5221621 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:55:06 user nova-compute[73449]: INFO nova.compute.manager [req-a6b31c45-ceb0-4e84-9861-a90248a6a77b req-2904d2ac-af9e-481c-90a1-0c760d9c6880 service nova] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Neutron deleted interface 1ec58d7f-18a4-4ddb-a137-2b72c5221621; detaching it from the instance and deleting it from the info cache
Aug 17 11:55:06 user nova-compute[73449]: DEBUG nova.network.neutron [req-a6b31c45-ceb0-4e84-9861-a90248a6a77b req-2904d2ac-af9e-481c-90a1-0c760d9c6880 service nova] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Updating instance_info_cache with network_info: [] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:55:06 user nova-compute[73449]: INFO nova.compute.manager [-] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Took 1.11 seconds to deallocate network for instance.
Aug 17 11:55:06 user nova-compute[73449]: DEBUG nova.compute.manager [req-744bdb13-0950-4e08-a153-49804f4bb469 req-b24a4ee2-ab4f-47c8-ae19-02d1a50969bb service nova] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Received event network-vif-plugged-1ec58d7f-18a4-4ddb-a137-2b72c5221621 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:55:06 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-744bdb13-0950-4e08-a153-49804f4bb469 req-b24a4ee2-ab4f-47c8-ae19-02d1a50969bb service nova] Acquiring lock "3d468854-6182-49c8-acb7-0641df2d5219-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:55:06 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-744bdb13-0950-4e08-a153-49804f4bb469 req-b24a4ee2-ab4f-47c8-ae19-02d1a50969bb service nova] Lock "3d468854-6182-49c8-acb7-0641df2d5219-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:55:06 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-744bdb13-0950-4e08-a153-49804f4bb469 req-b24a4ee2-ab4f-47c8-ae19-02d1a50969bb service nova] Lock "3d468854-6182-49c8-acb7-0641df2d5219-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:55:06 user nova-compute[73449]: DEBUG nova.compute.manager [req-744bdb13-0950-4e08-a153-49804f4bb469 req-b24a4ee2-ab4f-47c8-ae19-02d1a50969bb service nova] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] No waiting events found dispatching network-vif-plugged-1ec58d7f-18a4-4ddb-a137-2b72c5221621 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:55:06 user nova-compute[73449]: WARNING nova.compute.manager [req-744bdb13-0950-4e08-a153-49804f4bb469 req-b24a4ee2-ab4f-47c8-ae19-02d1a50969bb service nova] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Received unexpected event network-vif-plugged-1ec58d7f-18a4-4ddb-a137-2b72c5221621 for instance with vm_state active and task_state deleting.
Aug 17 11:55:06 user nova-compute[73449]: DEBUG nova.compute.manager [req-a6b31c45-ceb0-4e84-9861-a90248a6a77b req-2904d2ac-af9e-481c-90a1-0c760d9c6880 service nova] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Detach interface failed, port_id=1ec58d7f-18a4-4ddb-a137-2b72c5221621, reason: Instance 3d468854-6182-49c8-acb7-0641df2d5219 could not be found. {{(pid=73449) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 11:55:06 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd4ec7bd-002e-4a71-9314-96c21427af27/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:55:06 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd4ec7bd-002e-4a71-9314-96c21427af27/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:55:06 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd4ec7bd-002e-4a71-9314-96c21427af27/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:55:06 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fea9f81c-a848-4a65-863e-e09dddf65bcf/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:55:06 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fea9f81c-a848-4a65-863e-e09dddf65bcf/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:55:06 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fea9f81c-a848-4a65-863e-e09dddf65bcf/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:55:06 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fea9f81c-a848-4a65-863e-e09dddf65bcf/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:55:06 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/042713b8-ab7f-4c14-92e5-f830ccb7e341/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:55:07 user nova-compute[73449]: INFO nova.compute.manager [None req-aef6a344-ad70-49e5-adc4-d3ff8cf5ae6a tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Took 0.84 seconds to detach 1 volumes for instance.
Aug 17 11:55:07 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/042713b8-ab7f-4c14-92e5-f830ccb7e341/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:55:07 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/042713b8-ab7f-4c14-92e5-f830ccb7e341/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:55:07 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-aef6a344-ad70-49e5-adc4-d3ff8cf5ae6a tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:55:07 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-aef6a344-ad70-49e5-adc4-d3ff8cf5ae6a tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:55:07 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/042713b8-ab7f-4c14-92e5-f830ccb7e341/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:55:07 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a9e8ad2-19db-4975-87e4-2efce603a7d7/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:55:07 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a9e8ad2-19db-4975-87e4-2efce603a7d7/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:55:07 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a9e8ad2-19db-4975-87e4-2efce603a7d7/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:55:07 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-aef6a344-ad70-49e5-adc4-d3ff8cf5ae6a tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 11:55:07 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-aef6a344-ad70-49e5-adc4-d3ff8cf5ae6a tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 11:55:07 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-aef6a344-ad70-49e5-adc4-d3ff8cf5ae6a tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.505s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:55:07 user nova-compute[73449]: INFO nova.scheduler.client.report [None req-aef6a344-ad70-49e5-adc4-d3ff8cf5ae6a tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Deleted allocations for instance 3d468854-6182-49c8-acb7-0641df2d5219
Aug 17 11:55:07 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a9e8ad2-19db-4975-87e4-2efce603a7d7/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:55:07 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk.rescue --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:55:07 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-aef6a344-ad70-49e5-adc4-d3ff8cf5ae6a tempest-ServerActionsTestOtherB-108358124 tempest-ServerActionsTestOtherB-108358124-project-member] Lock "3d468854-6182-49c8-acb7-0641df2d5219" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.038s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:55:07 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:55:07 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk.rescue --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:55:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:55:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:55:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:55:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:55:08 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:55:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:55:08 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73449) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 11:55:08 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73449) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 11:55:08 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73449) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 11:55:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef4274-dfa1-4f7d-a24c-a1686b692f70/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:55:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef4274-dfa1-4f7d-a24c-a1686b692f70/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:55:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef4274-dfa1-4f7d-a24c-a1686b692f70/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:55:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef4274-dfa1-4f7d-a24c-a1686b692f70/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:55:08 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=73449) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 11:55:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d74c8f6-fb4e-4460-b722-674a8a1e2d25/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:55:09 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d74c8f6-fb4e-4460-b722-674a8a1e2d25/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:55:09 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d74c8f6-fb4e-4460-b722-674a8a1e2d25/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:55:09 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d74c8f6-fb4e-4460-b722-674a8a1e2d25/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:55:09 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89440604-1daf-4e7a-a524-2f9c21a9cb96/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:55:09 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89440604-1daf-4e7a-a524-2f9c21a9cb96/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:55:09 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89440604-1daf-4e7a-a524-2f9c21a9cb96/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:55:09 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:55:09 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89440604-1daf-4e7a-a524-2f9c21a9cb96/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:55:10 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:55:10 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:55:10 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Hypervisor/Node resource view: name=user free_ram=7092MB free_disk=25.151798248291016GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73449) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 11:55:10 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:55:10 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:55:10 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Applying migration context for instance b32df06e-0b5a-4384-946b-64d64aeeb07e as it has an incoming, in-progress migration 8d1d7b16-326c-47fe-bda2-d62bf19a18af. Migration status is finished {{(pid=73449) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 17 11:55:10 user nova-compute[73449]: INFO nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] Updating resource usage from migration 8d1d7b16-326c-47fe-bda2-d62bf19a18af
Aug 17 11:55:10 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 4a9e8ad2-19db-4975-87e4-2efce603a7d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:55:10 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 3d74c8f6-fb4e-4460-b722-674a8a1e2d25 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:55:10 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance ae75d334-431a-4008-8b3d-f2a727d92417 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:55:10 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance dd4ec7bd-002e-4a71-9314-96c21427af27 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:55:10 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 89440604-1daf-4e7a-a524-2f9c21a9cb96 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:55:10 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 01ef4274-dfa1-4f7d-a24c-a1686b692f70 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:55:10 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance fea9f81c-a848-4a65-863e-e09dddf65bcf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:55:10 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 31f5f3d2-41d8-4a26-9eb2-18b891f94734 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:55:10 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Migration 8d1d7b16-326c-47fe-bda2-d62bf19a18af is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 17 11:55:10 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance b32df06e-0b5a-4384-946b-64d64aeeb07e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:55:10 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 1542e090-dffe-47d1-8bf1-bb0361cfba34 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:55:10 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 042713b8-ab7f-4c14-92e5-f830ccb7e341 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:55:10 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=73449) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 11:55:10 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=73449) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 11:55:10 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 11:55:10 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 11:55:10 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Compute_service record updated for user:user {{(pid=73449) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 11:55:10 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.583s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:55:13 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:55:14 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:55:19 user nova-compute[73449]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692273304.639289, 3d468854-6182-49c8-acb7-0641df2d5219 => Stopped> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:55:19 user nova-compute[73449]: INFO nova.compute.manager [-] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] VM Stopped (Lifecycle Event)
Aug 17 11:55:19 user nova-compute[73449]: DEBUG nova.compute.manager [None req-61362783-9ea2-4882-8776-515214d3db3c None None] [instance: 3d468854-6182-49c8-acb7-0641df2d5219] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:55:19 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:55:19 user nova-compute[73449]: INFO nova.compute.manager [None req-5af314e8-928a-4d37-956d-10ae261e8cd5 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] Rescuing
Aug 17 11:55:19 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-5af314e8-928a-4d37-956d-10ae261e8cd5 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Acquiring lock "refresh_cache-31f5f3d2-41d8-4a26-9eb2-18b891f94734" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:55:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-5af314e8-928a-4d37-956d-10ae261e8cd5 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Acquired lock "refresh_cache-31f5f3d2-41d8-4a26-9eb2-18b891f94734" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:55:20 user nova-compute[73449]: DEBUG nova.network.neutron [None req-5af314e8-928a-4d37-956d-10ae261e8cd5 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] Building network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 11:55:20 user nova-compute[73449]: DEBUG nova.network.neutron [None req-5af314e8-928a-4d37-956d-10ae261e8cd5 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] Updating instance_info_cache with network_info: [{"id": "ea00b08a-3d80-453b-8c1a-9bdc74ac652f", "address": "fa:16:3e:d2:96:e4", "network": {"id": "9455bb75-f75a-41ff-8f6f-49f55aa738f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-425274599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec3b0b72e47448ebe99f9fc64119c1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea00b08a-3d", "ovs_interfaceid": "ea00b08a-3d80-453b-8c1a-9bdc74ac652f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:55:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-5af314e8-928a-4d37-956d-10ae261e8cd5 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Releasing lock "refresh_cache-31f5f3d2-41d8-4a26-9eb2-18b891f94734" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:55:20 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:55:20 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:55:20 user nova-compute[73449]: DEBUG nova.compute.manager [req-577e2d69-99c2-4bba-a018-cbf31b8c4852 req-9d4c3171-682e-4502-828c-e76fce9e42df service nova] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] Received event network-vif-unplugged-ea00b08a-3d80-453b-8c1a-9bdc74ac652f {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:55:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-577e2d69-99c2-4bba-a018-cbf31b8c4852 req-9d4c3171-682e-4502-828c-e76fce9e42df service nova] Acquiring lock "31f5f3d2-41d8-4a26-9eb2-18b891f94734-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:55:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-577e2d69-99c2-4bba-a018-cbf31b8c4852 req-9d4c3171-682e-4502-828c-e76fce9e42df service nova] Lock "31f5f3d2-41d8-4a26-9eb2-18b891f94734-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:55:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-577e2d69-99c2-4bba-a018-cbf31b8c4852 req-9d4c3171-682e-4502-828c-e76fce9e42df service nova] Lock "31f5f3d2-41d8-4a26-9eb2-18b891f94734-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:55:20 user nova-compute[73449]: DEBUG nova.compute.manager [req-577e2d69-99c2-4bba-a018-cbf31b8c4852 req-9d4c3171-682e-4502-828c-e76fce9e42df service nova] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] No waiting events found dispatching network-vif-unplugged-ea00b08a-3d80-453b-8c1a-9bdc74ac652f {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:55:20 user nova-compute[73449]: WARNING nova.compute.manager [req-577e2d69-99c2-4bba-a018-cbf31b8c4852 req-9d4c3171-682e-4502-828c-e76fce9e42df service nova] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] Received unexpected event network-vif-unplugged-ea00b08a-3d80-453b-8c1a-9bdc74ac652f for instance with vm_state active and task_state rescuing.
Aug 17 11:55:20 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:55:20 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:55:21 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] Instance destroyed successfully.
Aug 17 11:55:21 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-5af314e8-928a-4d37-956d-10ae261e8cd5 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] Attempting a stable device rescue
Aug 17 11:55:21 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-5af314e8-928a-4d37-956d-10ae261e8cd5 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73449) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 17 11:55:21 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-5af314e8-928a-4d37-956d-10ae261e8cd5 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] Instance directory exists: not creating {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 17 11:55:21 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-5af314e8-928a-4d37-956d-10ae261e8cd5 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] Creating image(s)
Aug 17 11:55:21 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-5af314e8-928a-4d37-956d-10ae261e8cd5 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Acquiring lock "/opt/stack/data/nova/instances/31f5f3d2-41d8-4a26-9eb2-18b891f94734/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:55:21 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-5af314e8-928a-4d37-956d-10ae261e8cd5 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Lock "/opt/stack/data/nova/instances/31f5f3d2-41d8-4a26-9eb2-18b891f94734/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:55:21 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-5af314e8-928a-4d37-956d-10ae261e8cd5 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Lock "/opt/stack/data/nova/instances/31f5f3d2-41d8-4a26-9eb2-18b891f94734/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:55:21 user nova-compute[73449]: DEBUG nova.objects.instance [None req-5af314e8-928a-4d37-956d-10ae261e8cd5 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Lazy-loading 'trusted_certs' on Instance uuid 31f5f3d2-41d8-4a26-9eb2-18b891f94734 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:55:21 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-5af314e8-928a-4d37-956d-10ae261e8cd5 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Acquiring lock "ea0ffd0a56891dbaf2860691c9f6b70d163a4869" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:55:21 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-5af314e8-928a-4d37-956d-10ae261e8cd5 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Lock "ea0ffd0a56891dbaf2860691c9f6b70d163a4869" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:55:22 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-5af314e8-928a-4d37-956d-10ae261e8cd5 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ea0ffd0a56891dbaf2860691c9f6b70d163a4869.part --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:55:22 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-5af314e8-928a-4d37-956d-10ae261e8cd5 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ea0ffd0a56891dbaf2860691c9f6b70d163a4869.part --force-share --output=json" returned: 0 in 0.183s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:55:22 user nova-compute[73449]: DEBUG nova.virt.images [None req-5af314e8-928a-4d37-956d-10ae261e8cd5 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] f4a7d9cc-980a-4821-af16-5151e209d42d was qcow2, converting to raw {{(pid=73449) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 17 11:55:22 user nova-compute[73449]: DEBUG nova.privsep.utils [None req-5af314e8-928a-4d37-956d-10ae261e8cd5 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73449) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 11:55:22 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-5af314e8-928a-4d37-956d-10ae261e8cd5 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ea0ffd0a56891dbaf2860691c9f6b70d163a4869.part /opt/stack/data/nova/instances/_base/ea0ffd0a56891dbaf2860691c9f6b70d163a4869.converted {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:55:22 user nova-compute[73449]: DEBUG nova.compute.manager [req-7ac5f20d-2d74-4154-adcf-40f2987d5d1f req-b1812b73-832f-4504-979b-d0d957a37adc service nova] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] Received event network-vif-plugged-ea00b08a-3d80-453b-8c1a-9bdc74ac652f {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:55:22 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-7ac5f20d-2d74-4154-adcf-40f2987d5d1f req-b1812b73-832f-4504-979b-d0d957a37adc service nova] Acquiring lock "31f5f3d2-41d8-4a26-9eb2-18b891f94734-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:55:22 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-7ac5f20d-2d74-4154-adcf-40f2987d5d1f req-b1812b73-832f-4504-979b-d0d957a37adc service nova] Lock "31f5f3d2-41d8-4a26-9eb2-18b891f94734-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:55:22 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-7ac5f20d-2d74-4154-adcf-40f2987d5d1f req-b1812b73-832f-4504-979b-d0d957a37adc service nova] Lock "31f5f3d2-41d8-4a26-9eb2-18b891f94734-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:55:22 user nova-compute[73449]: DEBUG nova.compute.manager [req-7ac5f20d-2d74-4154-adcf-40f2987d5d1f req-b1812b73-832f-4504-979b-d0d957a37adc service nova] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] No waiting events found dispatching network-vif-plugged-ea00b08a-3d80-453b-8c1a-9bdc74ac652f {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:55:22 user nova-compute[73449]: WARNING nova.compute.manager [req-7ac5f20d-2d74-4154-adcf-40f2987d5d1f req-b1812b73-832f-4504-979b-d0d957a37adc service nova] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] Received unexpected event network-vif-plugged-ea00b08a-3d80-453b-8c1a-9bdc74ac652f for instance with vm_state active and task_state rescuing.
Aug 17 11:55:23 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-5af314e8-928a-4d37-956d-10ae261e8cd5 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ea0ffd0a56891dbaf2860691c9f6b70d163a4869.part /opt/stack/data/nova/instances/_base/ea0ffd0a56891dbaf2860691c9f6b70d163a4869.converted" returned: 0 in 0.555s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:55:23 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-5af314e8-928a-4d37-956d-10ae261e8cd5 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ea0ffd0a56891dbaf2860691c9f6b70d163a4869.converted --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:55:23 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-5af314e8-928a-4d37-956d-10ae261e8cd5 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ea0ffd0a56891dbaf2860691c9f6b70d163a4869.converted --force-share --output=json" returned: 0 in 0.173s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:55:23 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-5af314e8-928a-4d37-956d-10ae261e8cd5 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Lock "ea0ffd0a56891dbaf2860691c9f6b70d163a4869" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.171s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:55:23 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-5af314e8-928a-4d37-956d-10ae261e8cd5 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Acquiring lock "ea0ffd0a56891dbaf2860691c9f6b70d163a4869" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:55:23 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-5af314e8-928a-4d37-956d-10ae261e8cd5 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Lock "ea0ffd0a56891dbaf2860691c9f6b70d163a4869" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:55:23 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-5af314e8-928a-4d37-956d-10ae261e8cd5 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ea0ffd0a56891dbaf2860691c9f6b70d163a4869 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:55:23 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-5af314e8-928a-4d37-956d-10ae261e8cd5 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ea0ffd0a56891dbaf2860691c9f6b70d163a4869 --force-share --output=json" returned: 0 in 0.173s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:55:23 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-5af314e8-928a-4d37-956d-10ae261e8cd5 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ea0ffd0a56891dbaf2860691c9f6b70d163a4869,backing_fmt=raw /opt/stack/data/nova/instances/31f5f3d2-41d8-4a26-9eb2-18b891f94734/disk.rescue {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:55:23 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-5af314e8-928a-4d37-956d-10ae261e8cd5 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ea0ffd0a56891dbaf2860691c9f6b70d163a4869,backing_fmt=raw /opt/stack/data/nova/instances/31f5f3d2-41d8-4a26-9eb2-18b891f94734/disk.rescue" returned: 0 in 0.049s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:55:23 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-5af314e8-928a-4d37-956d-10ae261e8cd5 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Lock "ea0ffd0a56891dbaf2860691c9f6b70d163a4869" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:55:23 user nova-compute[73449]: DEBUG nova.objects.instance [None req-5af314e8-928a-4d37-956d-10ae261e8cd5 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Lazy-loading 'migration_context' on Instance uuid 31f5f3d2-41d8-4a26-9eb2-18b891f94734 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:55:23 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-5af314e8-928a-4d37-956d-10ae261e8cd5 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] Created local disks {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 11:55:23 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-5af314e8-928a-4d37-956d-10ae261e8cd5 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] Start _get_guest_xml network_info=[{"id": "ea00b08a-3d80-453b-8c1a-9bdc74ac652f", "address": "fa:16:3e:d2:96:e4", "network": {"id": "9455bb75-f75a-41ff-8f6f-49f55aa738f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-425274599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-425274599-network", "vif_mac": "fa:16:3e:d2:96:e4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec3b0b72e47448ebe99f9fc64119c1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea00b08a-3d", "ovs_interfaceid": "ea00b08a-3d80-453b-8c1a-9bdc74ac652f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T11:36:11Z,direct_url=<?>,disk_format='qcow2',id=0a2904ae-083d-41c8-83db-343132b36148,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7a77880136a54ef195c82e018e1939db',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T11:36:13Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'f4a7d9cc-980a-4821-af16-5151e209d42d', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'attachment_id': 'cfcf98ce-4cfe-4029-9aa2-c1157cf8ec33', 'boot_index': 0, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pRTkFKvC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '31f5f3d2-41d8-4a26-9eb2-18b891f94734', 'attached_at': '', 'detached_at': '', 'volume_id': 'e6c52a84-6fd6-4981-90d6-4673350908c9', 'serial': 'e6c52a84-6fd6-4981-90d6-4673350908c9'}, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 11:55:23 user nova-compute[73449]: DEBUG nova.objects.instance [None req-5af314e8-928a-4d37-956d-10ae261e8cd5 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Lazy-loading 'resources' on Instance uuid 31f5f3d2-41d8-4a26-9eb2-18b891f94734 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:55:23 user nova-compute[73449]: DEBUG nova.objects.instance [None req-5af314e8-928a-4d37-956d-10ae261e8cd5 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Lazy-loading 'numa_topology' on Instance uuid 31f5f3d2-41d8-4a26-9eb2-18b891f94734 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:55:23 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-5af314e8-928a-4d37-956d-10ae261e8cd5 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:55:23 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-5af314e8-928a-4d37-956d-10ae261e8cd5 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:55:23 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-5af314e8-928a-4d37-956d-10ae261e8cd5 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 11:55:23 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-5af314e8-928a-4d37-956d-10ae261e8cd5 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] CPU controller missing on host. {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 11:55:23 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-5af314e8-928a-4d37-956d-10ae261e8cd5 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 11:55:23 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-5af314e8-928a-4d37-956d-10ae261e8cd5 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] CPU controller found on host. {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 11:55:23 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-5af314e8-928a-4d37-956d-10ae261e8cd5 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73449) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 11:55:23 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-5af314e8-928a-4d37-956d-10ae261e8cd5 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T11:35:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T11:36:11Z,direct_url=<?>,disk_format='qcow2',id=0a2904ae-083d-41c8-83db-343132b36148,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7a77880136a54ef195c82e018e1939db',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T11:36:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 11:55:23 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-5af314e8-928a-4d37-956d-10ae261e8cd5 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Flavor limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 11:55:23 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-5af314e8-928a-4d37-956d-10ae261e8cd5 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Image limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 11:55:23 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-5af314e8-928a-4d37-956d-10ae261e8cd5 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Flavor pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 11:55:23 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-5af314e8-928a-4d37-956d-10ae261e8cd5 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Image pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 11:55:23 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-5af314e8-928a-4d37-956d-10ae261e8cd5 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 11:55:23 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-5af314e8-928a-4d37-956d-10ae261e8cd5 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 11:55:23 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-5af314e8-928a-4d37-956d-10ae261e8cd5 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 11:55:23 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-5af314e8-928a-4d37-956d-10ae261e8cd5 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Got 1 possible topologies {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 11:55:23 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-5af314e8-928a-4d37-956d-10ae261e8cd5 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 11:55:23 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-5af314e8-928a-4d37-956d-10ae261e8cd5 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 11:55:23 user nova-compute[73449]: DEBUG nova.objects.instance [None req-5af314e8-928a-4d37-956d-10ae261e8cd5 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Lazy-loading 'vcpu_model' on Instance uuid 31f5f3d2-41d8-4a26-9eb2-18b891f94734 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:55:23 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5af314e8-928a-4d37-956d-10ae261e8cd5 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] Calling os-brick to attach iSCSI Volume {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 11:55:23 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-5af314e8-928a-4d37-956d-10ae261e8cd5 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pRTkFKvC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 11:55:23 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-5af314e8-928a-4d37-956d-10ae261e8cd5 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 11:55:23 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-5af314e8-928a-4d37-956d-10ae261e8cd5 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:55:23 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-5af314e8-928a-4d37-956d-10ae261e8cd5 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:55:23 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-5af314e8-928a-4d37-956d-10ae261e8cd5 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 11:55:23 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-5af314e8-928a-4d37-956d-10ae261e8cd5 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:55:23 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-5af314e8-928a-4d37-956d-10ae261e8cd5 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:55:23 user nova-compute[73449]: INFO os_brick.initiator.connectors.iscsi [None req-5af314e8-928a-4d37-956d-10ae261e8cd5 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 11:55:23 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 -p 172.16.0.220:3260 {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:55:23 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:55:23 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7275ef8-7cc5-4f6d-ba3b-e805c17371cd]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = pRTkFKvC\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:55:23 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-5af314e8-928a-4d37-956d-10ae261e8cd5 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 17 11:55:23 user nova-compute[73449]: node.name = iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9
Aug 17 11:55:23 user nova-compute[73449]: node.tpgt = -1
Aug 17 11:55:23 user nova-compute[73449]: node.startup = automatic
Aug 17 11:55:23 user nova-compute[73449]: node.leading_login = No
Aug 17 11:55:23 user nova-compute[73449]: iface.iscsi_ifacename = default
Aug 17 11:55:23 user nova-compute[73449]: iface.net_ifacename = <empty>
Aug 17 11:55:23 user nova-compute[73449]: iface.ipaddress = <empty>
Aug 17 11:55:23 user nova-compute[73449]: iface.prefix_len = 0
Aug 17 11:55:23 user nova-compute[73449]: iface.hwaddress = <empty>
Aug 17 11:55:23 user nova-compute[73449]: iface.transport_name = tcp
Aug 17 11:55:23 user nova-compute[73449]: iface.initiatorname = <empty>
Aug 17 11:55:23 user nova-compute[73449]: iface.state = <empty>
Aug 17 11:55:23 user nova-compute[73449]: iface.vlan_id = 0
Aug 17 11:55:23 user nova-compute[73449]: iface.vlan_priority = 0
Aug 17 11:55:23 user nova-compute[73449]: iface.vlan_state = <empty>
Aug 17 11:55:23 user nova-compute[73449]: iface.iface_num = 0
Aug 17 11:55:23 user nova-compute[73449]: iface.mtu = 0
Aug 17 11:55:23 user nova-compute[73449]: iface.port = 0
Aug 17 11:55:23 user nova-compute[73449]: iface.bootproto = <empty>
Aug 17 11:55:23 user nova-compute[73449]: iface.subnet_mask = <empty>
Aug 17 11:55:23 user nova-compute[73449]: iface.gateway = <empty>
Aug 17 11:55:23 user nova-compute[73449]: iface.dhcp_alt_client_id_state = <empty>
Aug 17 11:55:23 user nova-compute[73449]: iface.dhcp_alt_client_id = <empty>
Aug 17 11:55:23 user nova-compute[73449]: iface.dhcp_dns = <empty>
Aug 17 11:55:23 user nova-compute[73449]: iface.dhcp_learn_iqn = <empty>
Aug 17 11:55:23 user nova-compute[73449]: iface.dhcp_req_vendor_id_state = <empty>
Aug 17 11:55:23 user nova-compute[73449]: iface.dhcp_vendor_id_state = <empty>
Aug 17 11:55:23 user nova-compute[73449]: iface.dhcp_vendor_id = <empty>
Aug 17 11:55:23 user nova-compute[73449]: iface.dhcp_slp_da = <empty>
Aug 17 11:55:23 user nova-compute[73449]: iface.fragmentation = <empty>
Aug 17 11:55:23 user nova-compute[73449]: iface.gratuitous_arp = <empty>
Aug 17 11:55:23 user nova-compute[73449]: iface.incoming_forwarding = <empty>
Aug 17 11:55:23 user nova-compute[73449]: iface.tos_state = <empty>
Aug 17 11:55:23 user nova-compute[73449]: iface.tos = 0
Aug 17 11:55:23 user nova-compute[73449]: iface.ttl = 0
Aug 17 11:55:23 user nova-compute[73449]: iface.delayed_ack = <empty>
Aug 17 11:55:23 user nova-compute[73449]: iface.tcp_nagle = <empty>
Aug 17 11:55:23 user nova-compute[73449]: iface.tcp_wsf_state = <empty>
Aug 17 11:55:23 user nova-compute[73449]: iface.tcp_wsf = 0
Aug 17 11:55:23 user nova-compute[73449]: iface.tcp_timer_scale = 0
Aug 17 11:55:23 user nova-compute[73449]: iface.tcp_timestamp = <empty>
Aug 17 11:55:23 user nova-compute[73449]: iface.redirect = <empty>
Aug 17 11:55:23 user nova-compute[73449]: iface.def_task_mgmt_timeout = 0
Aug 17 11:55:23 user nova-compute[73449]: iface.header_digest = <empty>
Aug 17 11:55:23 user nova-compute[73449]: iface.data_digest = <empty>
Aug 17 11:55:23 user nova-compute[73449]: iface.immediate_data = <empty>
Aug 17 11:55:23 user nova-compute[73449]: iface.initial_r2t = <empty>
Aug 17 11:55:23 user nova-compute[73449]: iface.data_seq_inorder = <empty>
Aug 17 11:55:23 user nova-compute[73449]: iface.data_pdu_inorder = <empty>
Aug 17 11:55:23 user nova-compute[73449]: iface.erl = 0
Aug 17 11:55:23 user nova-compute[73449]: iface.max_receive_data_len = 0
Aug 17 11:55:23 user nova-compute[73449]: iface.first_burst_len = 0
Aug 17 11:55:23 user nova-compute[73449]: iface.max_outstanding_r2t = 0
Aug 17 11:55:23 user nova-compute[73449]: iface.max_burst_len = 0
Aug 17 11:55:23 user nova-compute[73449]: iface.chap_auth = <empty>
Aug 17 11:55:23 user nova-compute[73449]: iface.bidi_chap = <empty>
Aug 17 11:55:23 user nova-compute[73449]: iface.strict_login_compliance = <empty>
Aug 17 11:55:23 user nova-compute[73449]: iface.discovery_auth = <empty>
Aug 17 11:55:23 user nova-compute[73449]: iface.discovery_logout = <empty>
Aug 17 11:55:23 user nova-compute[73449]: node.discovery_address = <empty>
Aug 17 11:55:23 user nova-compute[73449]: node.discovery_port = 0
Aug 17 11:55:23 user nova-compute[73449]: node.discovery_type = static
Aug 17 11:55:23 user nova-compute[73449]: node.session.initial_cmdsn = 0
Aug 17 11:55:23 user nova-compute[73449]: node.session.initial_login_retry_max = 8
Aug 17 11:55:23 user nova-compute[73449]: node.session.xmit_thread_priority = -20
Aug 17 11:55:23 user nova-compute[73449]: node.session.cmds_max = 128
Aug 17 11:55:23 user nova-compute[73449]: node.session.queue_depth = 32
Aug 17 11:55:23 user nova-compute[73449]: node.session.nr_sessions = 1
Aug 17 11:55:23 user nova-compute[73449]: node.session.auth.authmethod = CHAP
Aug 17 11:55:23 user nova-compute[73449]: node.session.auth.username = pRTkFKvC
Aug 17 11:55:23 user nova-compute[73449]: node.session.auth.password = ***
Aug 17 11:55:23 user nova-compute[73449]: node.session.auth.username_in = <empty>
Aug 17 11:55:23 user nova-compute[73449]: node.session.auth.password_in = <empty>
Aug 17 11:55:23 user nova-compute[73449]: node.session.auth.chap_algs = MD5
Aug 17 11:55:23 user nova-compute[73449]: node.session.timeo.replacement_timeout = 120
Aug 17 11:55:23 user nova-compute[73449]: node.session.err_timeo.abort_timeout = 15
Aug 17 11:55:23 user nova-compute[73449]: node.session.err_timeo.lu_reset_timeout = 30
Aug 17 11:55:23 user nova-compute[73449]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 17 11:55:23 user nova-compute[73449]: node.session.err_timeo.host_reset_timeout = 60
Aug 17 11:55:23 user nova-compute[73449]: node.session.iscsi.FastAbort = Yes
Aug 17 11:55:23 user nova-compute[73449]: node.session.iscsi.InitialR2T = No
Aug 17 11:55:23 user nova-compute[73449]: node.session.iscsi.ImmediateData = Yes
Aug 17 11:55:23 user nova-compute[73449]: node.session.iscsi.FirstBurstLength = 262144
Aug 17 11:55:23 user nova-compute[73449]: node.session.iscsi.MaxBurstLength = 16776192
Aug 17 11:55:23 user nova-compute[73449]: node.session.iscsi.DefaultTime2Retain = 0
Aug 17 11:55:23 user nova-compute[73449]: node.session.iscsi.DefaultTime2Wait = 2
Aug 17 11:55:23 user nova-compute[73449]: node.session.iscsi.MaxConnections = 1
Aug 17 11:55:23 user nova-compute[73449]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 17 11:55:23 user nova-compute[73449]: node.session.iscsi.ERL = 0
Aug 17 11:55:23 user nova-compute[73449]: node.session.scan = manual
Aug 17 11:55:23 user nova-compute[73449]: node.session.reopen_max = 0
Aug 17 11:55:23 user nova-compute[73449]: node.conn[0].address = 172.16.0.220
Aug 17 11:55:23 user nova-compute[73449]: node.conn[0].port = 3260
Aug 17 11:55:23 user nova-compute[73449]: node.conn[0].startup = manual
Aug 17 11:55:23 user nova-compute[73449]: node.conn[0].tcp.window_size = 524288
Aug 17 11:55:23 user nova-compute[73449]: node.conn[0].tcp.type_of_service = 0
Aug 17 11:55:23 user nova-compute[73449]: node.conn[0].timeo.logout_timeout = 15
Aug 17 11:55:23 user nova-compute[73449]: node.conn[0].timeo.login_timeout = 15
Aug 17 11:55:23 user nova-compute[73449]: node.conn[0].timeo.auth_timeout = 45
Aug 17 11:55:23 user nova-compute[73449]: node.conn[0].timeo.noop_out_interval = 5
Aug 17 11:55:23 user nova-compute[73449]: node.conn[0].timeo.noop_out_timeout = 5
Aug 17 11:55:23 user nova-compute[73449]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 17 11:55:23 user nova-compute[73449]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 17 11:55:23 user nova-compute[73449]: node.conn[0].iscsi.HeaderDigest = None
Aug 17 11:55:23 user nova-compute[73449]: node.conn[0].iscsi.DataDigest = None
Aug 17 11:55:23 user nova-compute[73449]: node.conn[0].iscsi.IFMarker = No
Aug 17 11:55:23 user nova-compute[73449]: node.conn[0].iscsi.OFMarker = No
Aug 17 11:55:23 user nova-compute[73449]: # END RECORD
Aug 17 11:55:23 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:55:23 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:55:23 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:55:23 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9ab15a9-c7ec-4266-a975-e12f9c96872b]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:55:23 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-5af314e8-928a-4d37-956d-10ae261e8cd5 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:55:23 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:55:23 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:55:23 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c843e3a-89e2-4154-bbf5-b959ea657cdc]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:55:23 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-5af314e8-928a-4d37-956d-10ae261e8cd5 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:55:23 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pRTkFKvC {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:55:23 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pRTkFKvC" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:55:23 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f5b86c8-cf3f-4d91-930e-a0e3330fcd87]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:55:23 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-5af314e8-928a-4d37-956d-10ae261e8cd5 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pRTkFKvC'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:55:23 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:55:23 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:55:23 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[149f84c8-b071-474b-bf9f-0e8fd2876b0c]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:55:23 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-5af314e8-928a-4d37-956d-10ae261e8cd5 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:55:23 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:55:24 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:55:24 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[57e11d2b-b410-4af9-b69f-1a056707b2ea]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a382874-91aa-4ff2-aae4-15db10fe5ff2 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7 (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:55:24 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-5af314e8-928a-4d37-956d-10ae261e8cd5 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)
Aug 17 11:55:24 user nova-compute[73449]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a382874-91aa-4ff2-aae4-15db10fe5ff2 (non-flash)
Aug 17 11:55:24 user nova-compute[73449]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 (non-flash)
Aug 17 11:55:24 user nova-compute[73449]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7 (non-flash)
Aug 17 11:55:24 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:55:24 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-5af314e8-928a-4d37-956d-10ae261e8cd5 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)
Aug 17 11:55:24 user nova-compute[73449]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a382874-91aa-4ff2-aae4-15db10fe5ff2 (non-flash)
Aug 17 11:55:24 user nova-compute[73449]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 (non-flash)
Aug 17 11:55:24 user nova-compute[73449]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7 (non-flash)
Aug 17 11:55:24 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:55:24 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-5af314e8-928a-4d37-956d-10ae261e8cd5 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.148s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:55:24 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-5af314e8-928a-4d37-956d-10ae261e8cd5 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Connected to 172.16.0.220:3260 {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 11:55:24 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-5af314e8-928a-4d37-956d-10ae261e8cd5 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] HCTL ('36', '0', '0', 0) found on session 38 with lun 0 {{(pid=73449) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 11:55:24 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-5af314e8-928a-4d37-956d-10ae261e8cd5 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Scanning host 36 c: 0, t: 0, l: 0) {{(pid=73449) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 11:55:24 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:55:24 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.014s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:55:24 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[e72dabd4-3b38-4e3b-8ab3-1898bf3cb22e]: (4, ('0 0 0', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:55:24 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-5af314e8-928a-4d37-956d-10ae261e8cd5 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Searching for a device in session 38 and hctl ('36', '0', '0', 0) yield: sde {{(pid=73449) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 11:55:24 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-5af314e8-928a-4d37-956d-10ae261e8cd5 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pRTkFKvC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 11:55:24 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-5af314e8-928a-4d37-956d-10ae261e8cd5 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.171s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:55:24 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-5af314e8-928a-4d37-956d-10ae261e8cd5 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] <== connect_volume: return (173ms) {'type': 'block', 'scsi_wwn': '26538633163643235', 'path': '/dev/sde'} {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 11:55:24 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5af314e8-928a-4d37-956d-10ae261e8cd5 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26538633163643235', 'path': '/dev/sde'} {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 11:55:24 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-5af314e8-928a-4d37-956d-10ae261e8cd5 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:53:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-337335098',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-337335098',id=32,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T11:53:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4ec3b0b72e47448ebe99f9fc64119c1c',ramdisk_id='',reservation_id='r-7gzwba2q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1818019421',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T11:53:53Z,user_data=None,user_id='14eb3826311a4f8f91d8264e87f7b866',uuid=31f5f3d2-41d8-4a26-9eb2-18b891f94734,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ea00b08a-3d80-453b-8c1a-9bdc74ac652f", "address": "fa:16:3e:d2:96:e4", "network": {"id": "9455bb75-f75a-41ff-8f6f-49f55aa738f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-425274599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-425274599-network", "vif_mac": "fa:16:3e:d2:96:e4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec3b0b72e47448ebe99f9fc64119c1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea00b08a-3d", "ovs_interfaceid": "ea00b08a-3d80-453b-8c1a-9bdc74ac652f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73449) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 11:55:24 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-5af314e8-928a-4d37-956d-10ae261e8cd5 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Converting VIF {"id": "ea00b08a-3d80-453b-8c1a-9bdc74ac652f", "address": "fa:16:3e:d2:96:e4", "network": {"id": "9455bb75-f75a-41ff-8f6f-49f55aa738f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-425274599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-425274599-network", "vif_mac": "fa:16:3e:d2:96:e4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec3b0b72e47448ebe99f9fc64119c1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea00b08a-3d", "ovs_interfaceid": "ea00b08a-3d80-453b-8c1a-9bdc74ac652f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:55:24 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-5af314e8-928a-4d37-956d-10ae261e8cd5 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d2:96:e4,bridge_name='br-int',has_traffic_filtering=True,id=ea00b08a-3d80-453b-8c1a-9bdc74ac652f,network=Network(9455bb75-f75a-41ff-8f6f-49f55aa738f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea00b08a-3d') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:55:24 user nova-compute[73449]: DEBUG nova.objects.instance [None req-5af314e8-928a-4d37-956d-10ae261e8cd5 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Lazy-loading 'pci_devices' on Instance uuid 31f5f3d2-41d8-4a26-9eb2-18b891f94734 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:55:24 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-5af314e8-928a-4d37-956d-10ae261e8cd5 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] End _get_guest_xml xml=<domain type="kvm">
Aug 17 11:55:24 user nova-compute[73449]:   <uuid>31f5f3d2-41d8-4a26-9eb2-18b891f94734</uuid>
Aug 17 11:55:24 user nova-compute[73449]:   <name>instance-00000020</name>
Aug 17 11:55:24 user nova-compute[73449]:   <memory>524288</memory>
Aug 17 11:55:24 user nova-compute[73449]:   <vcpu>1</vcpu>
Aug 17 11:55:24 user nova-compute[73449]:   <metadata>
Aug 17 11:55:24 user nova-compute[73449]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 11:55:24 user nova-compute[73449]:       <nova:package version="0.0.0"/>
Aug 17 11:55:24 user nova-compute[73449]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-337335098</nova:name>
Aug 17 11:55:24 user nova-compute[73449]:       <nova:creationTime>2023-08-17 11:55:23</nova:creationTime>
Aug 17 11:55:24 user nova-compute[73449]:       <nova:flavor name="m1.tiny">
Aug 17 11:55:24 user nova-compute[73449]:         <nova:memory>512</nova:memory>
Aug 17 11:55:24 user nova-compute[73449]:         <nova:disk>1</nova:disk>
Aug 17 11:55:24 user nova-compute[73449]:         <nova:swap>0</nova:swap>
Aug 17 11:55:24 user nova-compute[73449]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 11:55:24 user nova-compute[73449]:         <nova:vcpus>1</nova:vcpus>
Aug 17 11:55:24 user nova-compute[73449]:       </nova:flavor>
Aug 17 11:55:24 user nova-compute[73449]:       <nova:owner>
Aug 17 11:55:24 user nova-compute[73449]:         <nova:user uuid="14eb3826311a4f8f91d8264e87f7b866">tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member</nova:user>
Aug 17 11:55:24 user nova-compute[73449]:         <nova:project uuid="4ec3b0b72e47448ebe99f9fc64119c1c">tempest-ServerBootFromVolumeStableRescueTest-1818019421</nova:project>
Aug 17 11:55:24 user nova-compute[73449]:       </nova:owner>
Aug 17 11:55:24 user nova-compute[73449]:       <nova:root type="image" uuid="0a2904ae-083d-41c8-83db-343132b36148"/>
Aug 17 11:55:24 user nova-compute[73449]:       <nova:ports>
Aug 17 11:55:24 user nova-compute[73449]:         <nova:port uuid="ea00b08a-3d80-453b-8c1a-9bdc74ac652f">
Aug 17 11:55:24 user nova-compute[73449]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 17 11:55:24 user nova-compute[73449]:         </nova:port>
Aug 17 11:55:24 user nova-compute[73449]:       </nova:ports>
Aug 17 11:55:24 user nova-compute[73449]:     </nova:instance>
Aug 17 11:55:24 user nova-compute[73449]:   </metadata>
Aug 17 11:55:24 user nova-compute[73449]:   <sysinfo type="smbios">
Aug 17 11:55:24 user nova-compute[73449]:     <system>
Aug 17 11:55:24 user nova-compute[73449]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 11:55:24 user nova-compute[73449]:       <entry name="product">OpenStack Nova</entry>
Aug 17 11:55:24 user nova-compute[73449]:       <entry name="version">0.0.0</entry>
Aug 17 11:55:24 user nova-compute[73449]:       <entry name="serial">31f5f3d2-41d8-4a26-9eb2-18b891f94734</entry>
Aug 17 11:55:24 user nova-compute[73449]:       <entry name="uuid">31f5f3d2-41d8-4a26-9eb2-18b891f94734</entry>
Aug 17 11:55:24 user nova-compute[73449]:       <entry name="family">Virtual Machine</entry>
Aug 17 11:55:24 user nova-compute[73449]:     </system>
Aug 17 11:55:24 user nova-compute[73449]:   </sysinfo>
Aug 17 11:55:24 user nova-compute[73449]:   <os>
Aug 17 11:55:24 user nova-compute[73449]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 11:55:24 user nova-compute[73449]:     <smbios mode="sysinfo"/>
Aug 17 11:55:24 user nova-compute[73449]:   </os>
Aug 17 11:55:24 user nova-compute[73449]:   <features>
Aug 17 11:55:24 user nova-compute[73449]:     <acpi/>
Aug 17 11:55:24 user nova-compute[73449]:     <apic/>
Aug 17 11:55:24 user nova-compute[73449]:     <vmcoreinfo/>
Aug 17 11:55:24 user nova-compute[73449]:   </features>
Aug 17 11:55:24 user nova-compute[73449]:   <clock offset="utc">
Aug 17 11:55:24 user nova-compute[73449]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 11:55:24 user nova-compute[73449]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 11:55:24 user nova-compute[73449]:     <timer name="hpet" present="no"/>
Aug 17 11:55:24 user nova-compute[73449]:   </clock>
Aug 17 11:55:24 user nova-compute[73449]:   <cpu mode="custom" match="exact">
Aug 17 11:55:24 user nova-compute[73449]:     <model>Nehalem</model>
Aug 17 11:55:24 user nova-compute[73449]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 11:55:24 user nova-compute[73449]:   </cpu>
Aug 17 11:55:24 user nova-compute[73449]:   <devices>
Aug 17 11:55:24 user nova-compute[73449]:     <disk type="block" device="disk">
Aug 17 11:55:24 user nova-compute[73449]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 11:55:24 user nova-compute[73449]:       <source dev="/dev/sde"/>
Aug 17 11:55:24 user nova-compute[73449]:       <target dev="vda" bus="virtio"/>
Aug 17 11:55:24 user nova-compute[73449]:       <serial>e6c52a84-6fd6-4981-90d6-4673350908c9</serial>
Aug 17 11:55:24 user nova-compute[73449]:     </disk>
Aug 17 11:55:24 user nova-compute[73449]:     <disk type="file" device="disk">
Aug 17 11:55:24 user nova-compute[73449]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 11:55:24 user nova-compute[73449]:       <source file="/opt/stack/data/nova/instances/31f5f3d2-41d8-4a26-9eb2-18b891f94734/disk.rescue"/>
Aug 17 11:55:24 user nova-compute[73449]:       <target dev="vdb" bus="virtio"/>
Aug 17 11:55:24 user nova-compute[73449]:       <boot order="1"/>
Aug 17 11:55:24 user nova-compute[73449]:     </disk>
Aug 17 11:55:24 user nova-compute[73449]:     <interface type="ethernet">
Aug 17 11:55:24 user nova-compute[73449]:       <mac address="fa:16:3e:d2:96:e4"/>
Aug 17 11:55:24 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 11:55:24 user nova-compute[73449]:       <mtu size="1442"/>
Aug 17 11:55:24 user nova-compute[73449]:       <target dev="tapea00b08a-3d"/>
Aug 17 11:55:24 user nova-compute[73449]:     </interface>
Aug 17 11:55:24 user nova-compute[73449]:     <serial type="pty">
Aug 17 11:55:24 user nova-compute[73449]:       <log file="/opt/stack/data/nova/instances/31f5f3d2-41d8-4a26-9eb2-18b891f94734/console.log" append="off"/>
Aug 17 11:55:24 user nova-compute[73449]:     </serial>
Aug 17 11:55:24 user nova-compute[73449]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 11:55:24 user nova-compute[73449]:     <video>
Aug 17 11:55:24 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 11:55:24 user nova-compute[73449]:     </video>
Aug 17 11:55:24 user nova-compute[73449]:     <rng model="virtio">
Aug 17 11:55:24 user nova-compute[73449]:       <backend model="random">/dev/urandom</backend>
Aug 17 11:55:24 user nova-compute[73449]:     </rng>
Aug 17 11:55:24 user nova-compute[73449]:     <controller type="usb" index="0" model="none"/>
Aug 17 11:55:24 user nova-compute[73449]:     <memballoon model="virtio">
Aug 17 11:55:24 user nova-compute[73449]:       <stats period="10"/>
Aug 17 11:55:24 user nova-compute[73449]:     </memballoon>
Aug 17 11:55:24 user nova-compute[73449]:   </devices>
Aug 17 11:55:24 user nova-compute[73449]: </domain>
Aug 17 11:55:24 user nova-compute[73449]:  {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 11:55:24 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] Instance destroyed successfully.
Aug 17 11:55:24 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-5af314e8-928a-4d37-956d-10ae261e8cd5 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] No BDM found with device name vda, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 11:55:24 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-5af314e8-928a-4d37-956d-10ae261e8cd5 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 11:55:24 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-5af314e8-928a-4d37-956d-10ae261e8cd5 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] No VIF found with MAC fa:16:3e:d2:96:e4, not building metadata {{(pid=73449) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 11:55:24 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:55:25 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:55:25 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:55:25 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:55:25 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:55:25 user nova-compute[73449]: DEBUG nova.compute.manager [req-127645de-ea6c-451f-8fc7-58776b077d5a req-7c3db962-d2cb-46f7-a663-6b2d397e114b service nova] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] Received event network-vif-plugged-ea00b08a-3d80-453b-8c1a-9bdc74ac652f {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:55:25 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-127645de-ea6c-451f-8fc7-58776b077d5a req-7c3db962-d2cb-46f7-a663-6b2d397e114b service nova] Acquiring lock "31f5f3d2-41d8-4a26-9eb2-18b891f94734-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:55:25 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-127645de-ea6c-451f-8fc7-58776b077d5a req-7c3db962-d2cb-46f7-a663-6b2d397e114b service nova] Lock "31f5f3d2-41d8-4a26-9eb2-18b891f94734-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:55:25 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-127645de-ea6c-451f-8fc7-58776b077d5a req-7c3db962-d2cb-46f7-a663-6b2d397e114b service nova] Lock "31f5f3d2-41d8-4a26-9eb2-18b891f94734-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:55:25 user nova-compute[73449]: DEBUG nova.compute.manager [req-127645de-ea6c-451f-8fc7-58776b077d5a req-7c3db962-d2cb-46f7-a663-6b2d397e114b service nova] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] No waiting events found dispatching network-vif-plugged-ea00b08a-3d80-453b-8c1a-9bdc74ac652f {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:55:25 user nova-compute[73449]: WARNING nova.compute.manager [req-127645de-ea6c-451f-8fc7-58776b077d5a req-7c3db962-d2cb-46f7-a663-6b2d397e114b service nova] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] Received unexpected event network-vif-plugged-ea00b08a-3d80-453b-8c1a-9bdc74ac652f for instance with vm_state active and task_state rescuing.
Aug 17 11:55:25 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:55:25 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:55:27 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a2903c02-e7b9-49bb-acd0-175de275bb71 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Acquiring lock "fea9f81c-a848-4a65-863e-e09dddf65bcf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:55:27 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a2903c02-e7b9-49bb-acd0-175de275bb71 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Lock "fea9f81c-a848-4a65-863e-e09dddf65bcf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:55:27 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a2903c02-e7b9-49bb-acd0-175de275bb71 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Acquiring lock "fea9f81c-a848-4a65-863e-e09dddf65bcf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:55:27 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a2903c02-e7b9-49bb-acd0-175de275bb71 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Lock "fea9f81c-a848-4a65-863e-e09dddf65bcf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:55:27 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a2903c02-e7b9-49bb-acd0-175de275bb71 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Lock "fea9f81c-a848-4a65-863e-e09dddf65bcf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:55:27 user nova-compute[73449]: INFO nova.compute.manager [None req-a2903c02-e7b9-49bb-acd0-175de275bb71 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Terminating instance
Aug 17 11:55:27 user nova-compute[73449]: DEBUG nova.compute.manager [None req-a2903c02-e7b9-49bb-acd0-175de275bb71 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Start destroying the instance on the hypervisor. {{(pid=73449) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 11:55:27 user nova-compute[73449]: DEBUG nova.compute.manager [req-35553ada-77f3-4dd0-adfc-3020f35017af req-029febfe-eef1-4403-9304-5ccd5cca8d36 service nova] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] Received event network-vif-plugged-ea00b08a-3d80-453b-8c1a-9bdc74ac652f {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:55:27 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-35553ada-77f3-4dd0-adfc-3020f35017af req-029febfe-eef1-4403-9304-5ccd5cca8d36 service nova] Acquiring lock "31f5f3d2-41d8-4a26-9eb2-18b891f94734-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:55:27 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-35553ada-77f3-4dd0-adfc-3020f35017af req-029febfe-eef1-4403-9304-5ccd5cca8d36 service nova] Lock "31f5f3d2-41d8-4a26-9eb2-18b891f94734-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:55:27 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-35553ada-77f3-4dd0-adfc-3020f35017af req-029febfe-eef1-4403-9304-5ccd5cca8d36 service nova] Lock "31f5f3d2-41d8-4a26-9eb2-18b891f94734-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:55:27 user nova-compute[73449]: DEBUG nova.compute.manager [req-35553ada-77f3-4dd0-adfc-3020f35017af req-029febfe-eef1-4403-9304-5ccd5cca8d36 service nova] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] No waiting events found dispatching network-vif-plugged-ea00b08a-3d80-453b-8c1a-9bdc74ac652f {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:55:27 user nova-compute[73449]: WARNING nova.compute.manager [req-35553ada-77f3-4dd0-adfc-3020f35017af req-029febfe-eef1-4403-9304-5ccd5cca8d36 service nova] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] Received unexpected event network-vif-plugged-ea00b08a-3d80-453b-8c1a-9bdc74ac652f for instance with vm_state active and task_state rescuing.
Aug 17 11:55:27 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:55:27 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:55:27 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:55:27 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:55:27 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:55:27 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Removed pending event for 31f5f3d2-41d8-4a26-9eb2-18b891f94734 due to event {{(pid=73449) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 17 11:55:27 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692273327.8265755, 31f5f3d2-41d8-4a26-9eb2-18b891f94734 => Resumed> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:55:27 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] VM Resumed (Lifecycle Event)
Aug 17 11:55:27 user nova-compute[73449]: DEBUG nova.compute.manager [None req-5af314e8-928a-4d37-956d-10ae261e8cd5 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:55:27 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:55:27 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 11:55:27 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 17 11:55:27 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692273327.828106, 31f5f3d2-41d8-4a26-9eb2-18b891f94734 => Started> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:55:27 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] VM Started (Lifecycle Event)
Aug 17 11:55:27 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:55:27 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 11:55:28 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:55:28 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:55:28 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Instance destroyed successfully.
Aug 17 11:55:28 user nova-compute[73449]: DEBUG nova.objects.instance [None req-a2903c02-e7b9-49bb-acd0-175de275bb71 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Lazy-loading 'resources' on Instance uuid fea9f81c-a848-4a65-863e-e09dddf65bcf {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:55:28 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-a2903c02-e7b9-49bb-acd0-175de275bb71 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T11:48:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2040756698',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2040756698',id=25,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFsRrS9Xoo8KEw47nic0apSNQihcGy2Dprwqysq5E8j0+8vyBEoJLy8MhfPnxnP5okmD+FgMjuWZuCPCrJvPG1PVoQ0IYOfI1fBkLBwSfjKGYTzfWWEpJ31p7U2edN/zYw==',key_name='tempest-keypair-553309548',keypairs=<?>,launch_index=0,launched_at=2023-08-17T11:53:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fe7b5fee01a042bb90e40b18a84c82c0',ramdisk_id='',reservation_id='r-bo9d1umq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2080997856',owner_user_name='tempest-AttachVolumeShelveTestJSON-2080997856-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T11:53:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='17ee7be9cdb14c5ca211a6b0bb80ccc1',uuid=fea9f81c-a848-4a65-863e-e09dddf65bcf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5db97a8e-3943-4259-ae41-cec1946c33f8", "address": "fa:16:3e:c2:f3:5a", "network": {"id": "d56bc428-6be6-4aa9-b43c-9d4a0f1dd83b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-791364634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe7b5fee01a042bb90e40b18a84c82c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5db97a8e-39", "ovs_interfaceid": "5db97a8e-3943-4259-ae41-cec1946c33f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 11:55:28 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-a2903c02-e7b9-49bb-acd0-175de275bb71 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Converting VIF {"id": "5db97a8e-3943-4259-ae41-cec1946c33f8", "address": "fa:16:3e:c2:f3:5a", "network": {"id": "d56bc428-6be6-4aa9-b43c-9d4a0f1dd83b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-791364634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe7b5fee01a042bb90e40b18a84c82c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5db97a8e-39", "ovs_interfaceid": "5db97a8e-3943-4259-ae41-cec1946c33f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:55:28 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-a2903c02-e7b9-49bb-acd0-175de275bb71 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:f3:5a,bridge_name='br-int',has_traffic_filtering=True,id=5db97a8e-3943-4259-ae41-cec1946c33f8,network=Network(d56bc428-6be6-4aa9-b43c-9d4a0f1dd83b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5db97a8e-39') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:55:28 user nova-compute[73449]: DEBUG os_vif [None req-a2903c02-e7b9-49bb-acd0-175de275bb71 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:f3:5a,bridge_name='br-int',has_traffic_filtering=True,id=5db97a8e-3943-4259-ae41-cec1946c33f8,network=Network(d56bc428-6be6-4aa9-b43c-9d4a0f1dd83b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5db97a8e-39') {{(pid=73449) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 11:55:28 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:55:28 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5db97a8e-39, bridge=br-int, if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:55:28 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:55:28 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:55:28 user nova-compute[73449]: INFO os_vif [None req-a2903c02-e7b9-49bb-acd0-175de275bb71 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:f3:5a,bridge_name='br-int',has_traffic_filtering=True,id=5db97a8e-3943-4259-ae41-cec1946c33f8,network=Network(d56bc428-6be6-4aa9-b43c-9d4a0f1dd83b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5db97a8e-39')
Aug 17 11:55:28 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-a2903c02-e7b9-49bb-acd0-175de275bb71 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Deleting instance files /opt/stack/data/nova/instances/fea9f81c-a848-4a65-863e-e09dddf65bcf_del
Aug 17 11:55:28 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-a2903c02-e7b9-49bb-acd0-175de275bb71 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Deletion of /opt/stack/data/nova/instances/fea9f81c-a848-4a65-863e-e09dddf65bcf_del complete
Aug 17 11:55:28 user nova-compute[73449]: INFO nova.compute.manager [None req-a2903c02-e7b9-49bb-acd0-175de275bb71 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Took 0.94 seconds to destroy the instance on the hypervisor.
Aug 17 11:55:28 user nova-compute[73449]: DEBUG oslo.service.loopingcall [None req-a2903c02-e7b9-49bb-acd0-175de275bb71 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73449) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 11:55:28 user nova-compute[73449]: DEBUG nova.compute.manager [-] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Deallocating network for instance {{(pid=73449) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 11:55:28 user nova-compute[73449]: DEBUG nova.network.neutron [-] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] deallocate_for_instance() {{(pid=73449) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 11:55:29 user nova-compute[73449]: DEBUG nova.network.neutron [-] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Updating instance_info_cache with network_info: [] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:55:29 user nova-compute[73449]: INFO nova.compute.manager [-] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Took 1.00 seconds to deallocate network for instance.
Aug 17 11:55:29 user nova-compute[73449]: DEBUG nova.compute.manager [req-5396910d-4345-4583-9563-873fbd7844e4 req-d5deac3d-bdab-437f-8ce1-09923b877c5a service nova] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Received event network-vif-deleted-5db97a8e-3943-4259-ae41-cec1946c33f8 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:55:29 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a2903c02-e7b9-49bb-acd0-175de275bb71 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:55:29 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a2903c02-e7b9-49bb-acd0-175de275bb71 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:55:29 user nova-compute[73449]: DEBUG nova.compute.manager [req-955812e1-66c2-4a3c-982d-4f91dba2d502 req-afe76cd2-6414-4f96-a07c-1c0ec32b8340 service nova] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Received event network-vif-unplugged-5db97a8e-3943-4259-ae41-cec1946c33f8 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:55:29 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-955812e1-66c2-4a3c-982d-4f91dba2d502 req-afe76cd2-6414-4f96-a07c-1c0ec32b8340 service nova] Acquiring lock "fea9f81c-a848-4a65-863e-e09dddf65bcf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:55:29 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-955812e1-66c2-4a3c-982d-4f91dba2d502 req-afe76cd2-6414-4f96-a07c-1c0ec32b8340 service nova] Lock "fea9f81c-a848-4a65-863e-e09dddf65bcf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:55:29 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-955812e1-66c2-4a3c-982d-4f91dba2d502 req-afe76cd2-6414-4f96-a07c-1c0ec32b8340 service nova] Lock "fea9f81c-a848-4a65-863e-e09dddf65bcf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:55:29 user nova-compute[73449]: DEBUG nova.compute.manager [req-955812e1-66c2-4a3c-982d-4f91dba2d502 req-afe76cd2-6414-4f96-a07c-1c0ec32b8340 service nova] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] No waiting events found dispatching network-vif-unplugged-5db97a8e-3943-4259-ae41-cec1946c33f8 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:55:29 user nova-compute[73449]: WARNING nova.compute.manager [req-955812e1-66c2-4a3c-982d-4f91dba2d502 req-afe76cd2-6414-4f96-a07c-1c0ec32b8340 service nova] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Received unexpected event network-vif-unplugged-5db97a8e-3943-4259-ae41-cec1946c33f8 for instance with vm_state deleted and task_state None.
Aug 17 11:55:29 user nova-compute[73449]: DEBUG nova.compute.manager [req-955812e1-66c2-4a3c-982d-4f91dba2d502 req-afe76cd2-6414-4f96-a07c-1c0ec32b8340 service nova] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Received event network-vif-plugged-5db97a8e-3943-4259-ae41-cec1946c33f8 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:55:29 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-955812e1-66c2-4a3c-982d-4f91dba2d502 req-afe76cd2-6414-4f96-a07c-1c0ec32b8340 service nova] Acquiring lock "fea9f81c-a848-4a65-863e-e09dddf65bcf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:55:29 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-955812e1-66c2-4a3c-982d-4f91dba2d502 req-afe76cd2-6414-4f96-a07c-1c0ec32b8340 service nova] Lock "fea9f81c-a848-4a65-863e-e09dddf65bcf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:55:29 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-955812e1-66c2-4a3c-982d-4f91dba2d502 req-afe76cd2-6414-4f96-a07c-1c0ec32b8340 service nova] Lock "fea9f81c-a848-4a65-863e-e09dddf65bcf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:55:29 user nova-compute[73449]: DEBUG nova.compute.manager [req-955812e1-66c2-4a3c-982d-4f91dba2d502 req-afe76cd2-6414-4f96-a07c-1c0ec32b8340 service nova] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] No waiting events found dispatching network-vif-plugged-5db97a8e-3943-4259-ae41-cec1946c33f8 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:55:29 user nova-compute[73449]: WARNING nova.compute.manager [req-955812e1-66c2-4a3c-982d-4f91dba2d502 req-afe76cd2-6414-4f96-a07c-1c0ec32b8340 service nova] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Received unexpected event network-vif-plugged-5db97a8e-3943-4259-ae41-cec1946c33f8 for instance with vm_state deleted and task_state None.
Aug 17 11:55:30 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-a2903c02-e7b9-49bb-acd0-175de275bb71 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 11:55:30 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-a2903c02-e7b9-49bb-acd0-175de275bb71 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 11:55:30 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a2903c02-e7b9-49bb-acd0-175de275bb71 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.454s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:55:30 user nova-compute[73449]: INFO nova.scheduler.client.report [None req-a2903c02-e7b9-49bb-acd0-175de275bb71 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Deleted allocations for instance fea9f81c-a848-4a65-863e-e09dddf65bcf
Aug 17 11:55:30 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a2903c02-e7b9-49bb-acd0-175de275bb71 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Lock "fea9f81c-a848-4a65-863e-e09dddf65bcf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.594s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:55:31 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-38765bcf-e609-44bc-96e9-b65c280674a0 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Acquiring lock "b32df06e-0b5a-4384-946b-64d64aeeb07e" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:55:31 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-38765bcf-e609-44bc-96e9-b65c280674a0 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Lock "b32df06e-0b5a-4384-946b-64d64aeeb07e" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:55:31 user nova-compute[73449]: DEBUG nova.compute.manager [None req-38765bcf-e609-44bc-96e9-b65c280674a0 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] Going to confirm migration 2 {{(pid=73449) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4694}}
Aug 17 11:55:31 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-38765bcf-e609-44bc-96e9-b65c280674a0 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Acquiring lock "refresh_cache-b32df06e-0b5a-4384-946b-64d64aeeb07e" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:55:31 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-38765bcf-e609-44bc-96e9-b65c280674a0 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Acquired lock "refresh_cache-b32df06e-0b5a-4384-946b-64d64aeeb07e" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:55:31 user nova-compute[73449]: DEBUG nova.network.neutron [None req-38765bcf-e609-44bc-96e9-b65c280674a0 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] Building network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 11:55:31 user nova-compute[73449]: DEBUG nova.objects.instance [None req-38765bcf-e609-44bc-96e9-b65c280674a0 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Lazy-loading 'info_cache' on Instance uuid b32df06e-0b5a-4384-946b-64d64aeeb07e {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:55:32 user nova-compute[73449]: DEBUG nova.network.neutron [None req-38765bcf-e609-44bc-96e9-b65c280674a0 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] Updating instance_info_cache with network_info: [{"id": "4a57c385-a0c8-454a-acbf-d1f783ff3131", "address": "fa:16:3e:be:34:a2", "network": {"id": "72c50a42-688f-4868-8e19-c40b103a49cd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1792423641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "068c5270255744a18208a0ad9b35f168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a57c385-a0", "ovs_interfaceid": "4a57c385-a0c8-454a-acbf-d1f783ff3131", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:55:32 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-38765bcf-e609-44bc-96e9-b65c280674a0 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Releasing lock "refresh_cache-b32df06e-0b5a-4384-946b-64d64aeeb07e" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:55:32 user nova-compute[73449]: DEBUG nova.objects.instance [None req-38765bcf-e609-44bc-96e9-b65c280674a0 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Lazy-loading 'migration_context' on Instance uuid b32df06e-0b5a-4384-946b-64d64aeeb07e {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:55:32 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-38765bcf-e609-44bc-96e9-b65c280674a0 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:55:32 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-38765bcf-e609-44bc-96e9-b65c280674a0 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:55:32 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-38765bcf-e609-44bc-96e9-b65c280674a0 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 11:55:32 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-38765bcf-e609-44bc-96e9-b65c280674a0 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 11:55:33 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-38765bcf-e609-44bc-96e9-b65c280674a0 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.415s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:55:33 user nova-compute[73449]: INFO nova.scheduler.client.report [None req-38765bcf-e609-44bc-96e9-b65c280674a0 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Deleted allocation for migration 8d1d7b16-326c-47fe-bda2-d62bf19a18af
Aug 17 11:55:33 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-38765bcf-e609-44bc-96e9-b65c280674a0 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Lock "b32df06e-0b5a-4384-946b-64d64aeeb07e" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.695s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:55:33 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:55:34 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-3da1945c-85fe-4033-8f8b-541851755ac3 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Acquiring lock "9e68a702-ead5-47ae-9375-5cd00b947ef4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:55:34 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-3da1945c-85fe-4033-8f8b-541851755ac3 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Lock "9e68a702-ead5-47ae-9375-5cd00b947ef4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:55:34 user nova-compute[73449]: DEBUG nova.compute.manager [None req-3da1945c-85fe-4033-8f8b-541851755ac3 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] [instance: 9e68a702-ead5-47ae-9375-5cd00b947ef4] Starting instance... {{(pid=73449) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 11:55:34 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-3da1945c-85fe-4033-8f8b-541851755ac3 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:55:34 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-3da1945c-85fe-4033-8f8b-541851755ac3 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:55:34 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-3da1945c-85fe-4033-8f8b-541851755ac3 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73449) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 11:55:34 user nova-compute[73449]: INFO nova.compute.claims [None req-3da1945c-85fe-4033-8f8b-541851755ac3 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] [instance: 9e68a702-ead5-47ae-9375-5cd00b947ef4] Claim successful on node user
Aug 17 11:55:35 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-3da1945c-85fe-4033-8f8b-541851755ac3 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 11:55:35 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-3da1945c-85fe-4033-8f8b-541851755ac3 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 11:55:35 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-3da1945c-85fe-4033-8f8b-541851755ac3 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.454s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:55:35 user nova-compute[73449]: DEBUG nova.compute.manager [None req-3da1945c-85fe-4033-8f8b-541851755ac3 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] [instance: 9e68a702-ead5-47ae-9375-5cd00b947ef4] Start building networks asynchronously for instance. {{(pid=73449) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 11:55:35 user nova-compute[73449]: DEBUG nova.compute.manager [None req-3da1945c-85fe-4033-8f8b-541851755ac3 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] [instance: 9e68a702-ead5-47ae-9375-5cd00b947ef4] Allocating IP information in the background. {{(pid=73449) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 11:55:35 user nova-compute[73449]: DEBUG nova.network.neutron [None req-3da1945c-85fe-4033-8f8b-541851755ac3 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] [instance: 9e68a702-ead5-47ae-9375-5cd00b947ef4] allocate_for_instance() {{(pid=73449) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 11:55:35 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-3da1945c-85fe-4033-8f8b-541851755ac3 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] [instance: 9e68a702-ead5-47ae-9375-5cd00b947ef4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 11:55:35 user nova-compute[73449]: DEBUG nova.compute.manager [None req-3da1945c-85fe-4033-8f8b-541851755ac3 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] [instance: 9e68a702-ead5-47ae-9375-5cd00b947ef4] Start building block device mappings for instance. {{(pid=73449) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 11:55:35 user nova-compute[73449]: DEBUG nova.policy [None req-3da1945c-85fe-4033-8f8b-541851755ac3 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '24c0eff502f744ad8eb6359e320852d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348b0a78aaf940b98f91655ddd6d4d6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73449) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 11:55:35 user nova-compute[73449]: DEBUG nova.compute.manager [None req-3da1945c-85fe-4033-8f8b-541851755ac3 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] [instance: 9e68a702-ead5-47ae-9375-5cd00b947ef4] Start spawning the instance on the hypervisor. {{(pid=73449) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 11:55:35 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-3da1945c-85fe-4033-8f8b-541851755ac3 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] [instance: 9e68a702-ead5-47ae-9375-5cd00b947ef4] Creating instance directory {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 11:55:35 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-3da1945c-85fe-4033-8f8b-541851755ac3 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] [instance: 9e68a702-ead5-47ae-9375-5cd00b947ef4] Creating image(s)
Aug 17 11:55:35 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-3da1945c-85fe-4033-8f8b-541851755ac3 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Acquiring lock "/opt/stack/data/nova/instances/9e68a702-ead5-47ae-9375-5cd00b947ef4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:55:35 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-3da1945c-85fe-4033-8f8b-541851755ac3 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Lock "/opt/stack/data/nova/instances/9e68a702-ead5-47ae-9375-5cd00b947ef4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:55:35 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-3da1945c-85fe-4033-8f8b-541851755ac3 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Lock "/opt/stack/data/nova/instances/9e68a702-ead5-47ae-9375-5cd00b947ef4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.019s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:55:35 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-3da1945c-85fe-4033-8f8b-541851755ac3 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:55:35 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-3da1945c-85fe-4033-8f8b-541851755ac3 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json" returned: 0 in 0.175s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:55:35 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-3da1945c-85fe-4033-8f8b-541851755ac3 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Acquiring lock "7e267a577c062ee862e95ede6b48cfd5632f3ea3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:55:35 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-3da1945c-85fe-4033-8f8b-541851755ac3 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Lock "7e267a577c062ee862e95ede6b48cfd5632f3ea3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:55:35 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-3da1945c-85fe-4033-8f8b-541851755ac3 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:55:35 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-3da1945c-85fe-4033-8f8b-541851755ac3 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json" returned: 0 in 0.174s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:55:35 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-3da1945c-85fe-4033-8f8b-541851755ac3 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3,backing_fmt=raw /opt/stack/data/nova/instances/9e68a702-ead5-47ae-9375-5cd00b947ef4/disk 1073741824 {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:55:36 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-3da1945c-85fe-4033-8f8b-541851755ac3 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3,backing_fmt=raw /opt/stack/data/nova/instances/9e68a702-ead5-47ae-9375-5cd00b947ef4/disk 1073741824" returned: 0 in 0.199s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:55:36 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-3da1945c-85fe-4033-8f8b-541851755ac3 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Lock "7e267a577c062ee862e95ede6b48cfd5632f3ea3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.379s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:55:36 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-3da1945c-85fe-4033-8f8b-541851755ac3 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:55:36 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-3da1945c-85fe-4033-8f8b-541851755ac3 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json" returned: 0 in 0.181s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:55:36 user nova-compute[73449]: DEBUG nova.virt.disk.api [None req-3da1945c-85fe-4033-8f8b-541851755ac3 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9e68a702-ead5-47ae-9375-5cd00b947ef4/disk. size=1073741824 {{(pid=73449) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 11:55:36 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-3da1945c-85fe-4033-8f8b-541851755ac3 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e68a702-ead5-47ae-9375-5cd00b947ef4/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:55:36 user nova-compute[73449]: DEBUG nova.network.neutron [None req-3da1945c-85fe-4033-8f8b-541851755ac3 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] [instance: 9e68a702-ead5-47ae-9375-5cd00b947ef4] Successfully created port: f4c80486-3b7b-4bcc-9593-04a46766dc36 {{(pid=73449) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 11:55:36 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-3da1945c-85fe-4033-8f8b-541851755ac3 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e68a702-ead5-47ae-9375-5cd00b947ef4/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:55:36 user nova-compute[73449]: DEBUG nova.virt.disk.api [None req-3da1945c-85fe-4033-8f8b-541851755ac3 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Cannot resize image /opt/stack/data/nova/instances/9e68a702-ead5-47ae-9375-5cd00b947ef4/disk to a smaller size. {{(pid=73449) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 11:55:36 user nova-compute[73449]: DEBUG nova.objects.instance [None req-3da1945c-85fe-4033-8f8b-541851755ac3 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Lazy-loading 'migration_context' on Instance uuid 9e68a702-ead5-47ae-9375-5cd00b947ef4 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:55:36 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-3da1945c-85fe-4033-8f8b-541851755ac3 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] [instance: 9e68a702-ead5-47ae-9375-5cd00b947ef4] Created local disks {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 11:55:36 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-3da1945c-85fe-4033-8f8b-541851755ac3 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] [instance: 9e68a702-ead5-47ae-9375-5cd00b947ef4] Ensure instance console log exists: /opt/stack/data/nova/instances/9e68a702-ead5-47ae-9375-5cd00b947ef4/console.log {{(pid=73449) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 11:55:36 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-3da1945c-85fe-4033-8f8b-541851755ac3 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:55:36 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-3da1945c-85fe-4033-8f8b-541851755ac3 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:55:36 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-3da1945c-85fe-4033-8f8b-541851755ac3 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:55:37 user nova-compute[73449]: DEBUG nova.network.neutron [None req-3da1945c-85fe-4033-8f8b-541851755ac3 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] [instance: 9e68a702-ead5-47ae-9375-5cd00b947ef4] Successfully updated port: f4c80486-3b7b-4bcc-9593-04a46766dc36 {{(pid=73449) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 11:55:37 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-3da1945c-85fe-4033-8f8b-541851755ac3 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Acquiring lock "refresh_cache-9e68a702-ead5-47ae-9375-5cd00b947ef4" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:55:37 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-3da1945c-85fe-4033-8f8b-541851755ac3 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Acquired lock "refresh_cache-9e68a702-ead5-47ae-9375-5cd00b947ef4" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:55:37 user nova-compute[73449]: DEBUG nova.network.neutron [None req-3da1945c-85fe-4033-8f8b-541851755ac3 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] [instance: 9e68a702-ead5-47ae-9375-5cd00b947ef4] Building network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 11:55:37 user nova-compute[73449]: DEBUG nova.compute.manager [req-ead75f1f-86dc-4436-809d-17cf48f506db req-cd03d631-3af3-4405-94fa-006c294d13d8 service nova] [instance: 9e68a702-ead5-47ae-9375-5cd00b947ef4] Received event network-changed-f4c80486-3b7b-4bcc-9593-04a46766dc36 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:55:37 user nova-compute[73449]: DEBUG nova.compute.manager [req-ead75f1f-86dc-4436-809d-17cf48f506db req-cd03d631-3af3-4405-94fa-006c294d13d8 service nova] [instance: 9e68a702-ead5-47ae-9375-5cd00b947ef4] Refreshing instance network info cache due to event network-changed-f4c80486-3b7b-4bcc-9593-04a46766dc36. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 11:55:37 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-ead75f1f-86dc-4436-809d-17cf48f506db req-cd03d631-3af3-4405-94fa-006c294d13d8 service nova] Acquiring lock "refresh_cache-9e68a702-ead5-47ae-9375-5cd00b947ef4" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:55:37 user nova-compute[73449]: DEBUG nova.network.neutron [None req-3da1945c-85fe-4033-8f8b-541851755ac3 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] [instance: 9e68a702-ead5-47ae-9375-5cd00b947ef4] Instance cache missing network info. {{(pid=73449) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 11:55:37 user nova-compute[73449]: DEBUG nova.network.neutron [None req-3da1945c-85fe-4033-8f8b-541851755ac3 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] [instance: 9e68a702-ead5-47ae-9375-5cd00b947ef4] Updating instance_info_cache with network_info: [{"id": "f4c80486-3b7b-4bcc-9593-04a46766dc36", "address": "fa:16:3e:35:7f:0b", "network": {"id": "bae20193-cae3-45f8-8881-68020cd853e9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-459774400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "348b0a78aaf940b98f91655ddd6d4d6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4c80486-3b", "ovs_interfaceid": "f4c80486-3b7b-4bcc-9593-04a46766dc36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:55:37 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-3da1945c-85fe-4033-8f8b-541851755ac3 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Releasing lock "refresh_cache-9e68a702-ead5-47ae-9375-5cd00b947ef4" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:55:37 user nova-compute[73449]: DEBUG nova.compute.manager [None req-3da1945c-85fe-4033-8f8b-541851755ac3 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] [instance: 9e68a702-ead5-47ae-9375-5cd00b947ef4] Instance network_info: |[{"id": "f4c80486-3b7b-4bcc-9593-04a46766dc36", "address": "fa:16:3e:35:7f:0b", "network": {"id": "bae20193-cae3-45f8-8881-68020cd853e9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-459774400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "348b0a78aaf940b98f91655ddd6d4d6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4c80486-3b", "ovs_interfaceid": "f4c80486-3b7b-4bcc-9593-04a46766dc36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73449) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 11:55:37 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-ead75f1f-86dc-4436-809d-17cf48f506db req-cd03d631-3af3-4405-94fa-006c294d13d8 service nova] Acquired lock "refresh_cache-9e68a702-ead5-47ae-9375-5cd00b947ef4" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:55:37 user nova-compute[73449]: DEBUG nova.network.neutron [req-ead75f1f-86dc-4436-809d-17cf48f506db req-cd03d631-3af3-4405-94fa-006c294d13d8 service nova] [instance: 9e68a702-ead5-47ae-9375-5cd00b947ef4] Refreshing network info cache for port f4c80486-3b7b-4bcc-9593-04a46766dc36 {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 11:55:37 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-3da1945c-85fe-4033-8f8b-541851755ac3 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] [instance: 9e68a702-ead5-47ae-9375-5cd00b947ef4] Start _get_guest_xml network_info=[{"id": "f4c80486-3b7b-4bcc-9593-04a46766dc36", "address": "fa:16:3e:35:7f:0b", "network": {"id": "bae20193-cae3-45f8-8881-68020cd853e9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-459774400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "348b0a78aaf940b98f91655ddd6d4d6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4c80486-3b", "ovs_interfaceid": "f4c80486-3b7b-4bcc-9593-04a46766dc36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T11:36:11Z,direct_url=<?>,disk_format='qcow2',id=0a2904ae-083d-41c8-83db-343132b36148,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7a77880136a54ef195c82e018e1939db',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T11:36:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': '0a2904ae-083d-41c8-83db-343132b36148'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 11:55:37 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-3da1945c-85fe-4033-8f8b-541851755ac3 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:55:37 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-3da1945c-85fe-4033-8f8b-541851755ac3 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:55:37 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-3da1945c-85fe-4033-8f8b-541851755ac3 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 11:55:37 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-3da1945c-85fe-4033-8f8b-541851755ac3 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] CPU controller missing on host. {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 11:55:37 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-3da1945c-85fe-4033-8f8b-541851755ac3 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 11:55:37 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-3da1945c-85fe-4033-8f8b-541851755ac3 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] CPU controller found on host. {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 11:55:37 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-3da1945c-85fe-4033-8f8b-541851755ac3 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73449) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 11:55:37 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-3da1945c-85fe-4033-8f8b-541851755ac3 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T11:35:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T11:36:11Z,direct_url=<?>,disk_format='qcow2',id=0a2904ae-083d-41c8-83db-343132b36148,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7a77880136a54ef195c82e018e1939db',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T11:36:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 11:55:37 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-3da1945c-85fe-4033-8f8b-541851755ac3 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Flavor limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 11:55:37 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-3da1945c-85fe-4033-8f8b-541851755ac3 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Image limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 11:55:37 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-3da1945c-85fe-4033-8f8b-541851755ac3 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Flavor pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 11:55:37 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-3da1945c-85fe-4033-8f8b-541851755ac3 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Image pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 11:55:37 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-3da1945c-85fe-4033-8f8b-541851755ac3 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 11:55:37 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-3da1945c-85fe-4033-8f8b-541851755ac3 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 11:55:37 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-3da1945c-85fe-4033-8f8b-541851755ac3 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 11:55:37 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-3da1945c-85fe-4033-8f8b-541851755ac3 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Got 1 possible topologies {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 11:55:37 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-3da1945c-85fe-4033-8f8b-541851755ac3 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 11:55:37 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-3da1945c-85fe-4033-8f8b-541851755ac3 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 11:55:37 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-3da1945c-85fe-4033-8f8b-541851755ac3 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:55:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1324112572',display_name='tempest-VolumesSnapshotTestJSON-instance-1324112572',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1324112572',id=35,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAeUBC842lE7robHmES8fz+eQ3WZq4NsR5jLSpTc5x/s/Eqd7/7hPnimog+o1z3CURrniR8+QuyMUtxlK2NJClhioavf4Gy/slFFQzw5Jr30/P3RvrfohDzd2/8XTHg5gw==',key_name='tempest-keypair-1504040959',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='348b0a78aaf940b98f91655ddd6d4d6d',ramdisk_id='',reservation_id='r-f5qm4nan',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-363415870',owner_user_name='tempest-VolumesSnapshotTestJSON-363415870-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T11:55:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='24c0eff502f744ad8eb6359e320852d4',uuid=9e68a702-ead5-47ae-9375-5cd00b947ef4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f4c80486-3b7b-4bcc-9593-04a46766dc36", "address": "fa:16:3e:35:7f:0b", "network": {"id": "bae20193-cae3-45f8-8881-68020cd853e9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-459774400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "348b0a78aaf940b98f91655ddd6d4d6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4c80486-3b", "ovs_interfaceid": "f4c80486-3b7b-4bcc-9593-04a46766dc36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73449) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 11:55:37 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-3da1945c-85fe-4033-8f8b-541851755ac3 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Converting VIF {"id": "f4c80486-3b7b-4bcc-9593-04a46766dc36", "address": "fa:16:3e:35:7f:0b", "network": {"id": "bae20193-cae3-45f8-8881-68020cd853e9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-459774400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "348b0a78aaf940b98f91655ddd6d4d6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4c80486-3b", "ovs_interfaceid": "f4c80486-3b7b-4bcc-9593-04a46766dc36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:55:37 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-3da1945c-85fe-4033-8f8b-541851755ac3 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:7f:0b,bridge_name='br-int',has_traffic_filtering=True,id=f4c80486-3b7b-4bcc-9593-04a46766dc36,network=Network(bae20193-cae3-45f8-8881-68020cd853e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4c80486-3b') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:55:37 user nova-compute[73449]: DEBUG nova.objects.instance [None req-3da1945c-85fe-4033-8f8b-541851755ac3 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Lazy-loading 'pci_devices' on Instance uuid 9e68a702-ead5-47ae-9375-5cd00b947ef4 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:55:37 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-3da1945c-85fe-4033-8f8b-541851755ac3 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] [instance: 9e68a702-ead5-47ae-9375-5cd00b947ef4] End _get_guest_xml xml=<domain type="kvm">
Aug 17 11:55:37 user nova-compute[73449]:   <uuid>9e68a702-ead5-47ae-9375-5cd00b947ef4</uuid>
Aug 17 11:55:37 user nova-compute[73449]:   <name>instance-00000023</name>
Aug 17 11:55:37 user nova-compute[73449]:   <memory>524288</memory>
Aug 17 11:55:37 user nova-compute[73449]:   <vcpu>1</vcpu>
Aug 17 11:55:37 user nova-compute[73449]:   <metadata>
Aug 17 11:55:37 user nova-compute[73449]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 11:55:37 user nova-compute[73449]:       <nova:package version="0.0.0"/>
Aug 17 11:55:37 user nova-compute[73449]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1324112572</nova:name>
Aug 17 11:55:37 user nova-compute[73449]:       <nova:creationTime>2023-08-17 11:55:37</nova:creationTime>
Aug 17 11:55:37 user nova-compute[73449]:       <nova:flavor name="m1.tiny">
Aug 17 11:55:37 user nova-compute[73449]:         <nova:memory>512</nova:memory>
Aug 17 11:55:37 user nova-compute[73449]:         <nova:disk>1</nova:disk>
Aug 17 11:55:37 user nova-compute[73449]:         <nova:swap>0</nova:swap>
Aug 17 11:55:37 user nova-compute[73449]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 11:55:37 user nova-compute[73449]:         <nova:vcpus>1</nova:vcpus>
Aug 17 11:55:37 user nova-compute[73449]:       </nova:flavor>
Aug 17 11:55:37 user nova-compute[73449]:       <nova:owner>
Aug 17 11:55:37 user nova-compute[73449]:         <nova:user uuid="24c0eff502f744ad8eb6359e320852d4">tempest-VolumesSnapshotTestJSON-363415870-project-member</nova:user>
Aug 17 11:55:37 user nova-compute[73449]:         <nova:project uuid="348b0a78aaf940b98f91655ddd6d4d6d">tempest-VolumesSnapshotTestJSON-363415870</nova:project>
Aug 17 11:55:37 user nova-compute[73449]:       </nova:owner>
Aug 17 11:55:37 user nova-compute[73449]:       <nova:root type="image" uuid="0a2904ae-083d-41c8-83db-343132b36148"/>
Aug 17 11:55:37 user nova-compute[73449]:       <nova:ports>
Aug 17 11:55:37 user nova-compute[73449]:         <nova:port uuid="f4c80486-3b7b-4bcc-9593-04a46766dc36">
Aug 17 11:55:37 user nova-compute[73449]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 17 11:55:37 user nova-compute[73449]:         </nova:port>
Aug 17 11:55:37 user nova-compute[73449]:       </nova:ports>
Aug 17 11:55:37 user nova-compute[73449]:     </nova:instance>
Aug 17 11:55:37 user nova-compute[73449]:   </metadata>
Aug 17 11:55:37 user nova-compute[73449]:   <sysinfo type="smbios">
Aug 17 11:55:37 user nova-compute[73449]:     <system>
Aug 17 11:55:37 user nova-compute[73449]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 11:55:37 user nova-compute[73449]:       <entry name="product">OpenStack Nova</entry>
Aug 17 11:55:37 user nova-compute[73449]:       <entry name="version">0.0.0</entry>
Aug 17 11:55:37 user nova-compute[73449]:       <entry name="serial">9e68a702-ead5-47ae-9375-5cd00b947ef4</entry>
Aug 17 11:55:37 user nova-compute[73449]:       <entry name="uuid">9e68a702-ead5-47ae-9375-5cd00b947ef4</entry>
Aug 17 11:55:37 user nova-compute[73449]:       <entry name="family">Virtual Machine</entry>
Aug 17 11:55:37 user nova-compute[73449]:     </system>
Aug 17 11:55:37 user nova-compute[73449]:   </sysinfo>
Aug 17 11:55:37 user nova-compute[73449]:   <os>
Aug 17 11:55:37 user nova-compute[73449]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 11:55:37 user nova-compute[73449]:     <boot dev="hd"/>
Aug 17 11:55:37 user nova-compute[73449]:     <smbios mode="sysinfo"/>
Aug 17 11:55:37 user nova-compute[73449]:   </os>
Aug 17 11:55:37 user nova-compute[73449]:   <features>
Aug 17 11:55:37 user nova-compute[73449]:     <acpi/>
Aug 17 11:55:37 user nova-compute[73449]:     <apic/>
Aug 17 11:55:37 user nova-compute[73449]:     <vmcoreinfo/>
Aug 17 11:55:37 user nova-compute[73449]:   </features>
Aug 17 11:55:37 user nova-compute[73449]:   <clock offset="utc">
Aug 17 11:55:37 user nova-compute[73449]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 11:55:37 user nova-compute[73449]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 11:55:37 user nova-compute[73449]:     <timer name="hpet" present="no"/>
Aug 17 11:55:37 user nova-compute[73449]:   </clock>
Aug 17 11:55:37 user nova-compute[73449]:   <cpu mode="custom" match="exact">
Aug 17 11:55:37 user nova-compute[73449]:     <model>Nehalem</model>
Aug 17 11:55:37 user nova-compute[73449]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 11:55:37 user nova-compute[73449]:   </cpu>
Aug 17 11:55:37 user nova-compute[73449]:   <devices>
Aug 17 11:55:37 user nova-compute[73449]:     <disk type="file" device="disk">
Aug 17 11:55:37 user nova-compute[73449]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 11:55:37 user nova-compute[73449]:       <source file="/opt/stack/data/nova/instances/9e68a702-ead5-47ae-9375-5cd00b947ef4/disk"/>
Aug 17 11:55:37 user nova-compute[73449]:       <target dev="vda" bus="virtio"/>
Aug 17 11:55:37 user nova-compute[73449]:     </disk>
Aug 17 11:55:37 user nova-compute[73449]:     <interface type="ethernet">
Aug 17 11:55:37 user nova-compute[73449]:       <mac address="fa:16:3e:35:7f:0b"/>
Aug 17 11:55:37 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 11:55:37 user nova-compute[73449]:       <mtu size="1442"/>
Aug 17 11:55:37 user nova-compute[73449]:       <target dev="tapf4c80486-3b"/>
Aug 17 11:55:37 user nova-compute[73449]:     </interface>
Aug 17 11:55:37 user nova-compute[73449]:     <serial type="pty">
Aug 17 11:55:37 user nova-compute[73449]:       <log file="/opt/stack/data/nova/instances/9e68a702-ead5-47ae-9375-5cd00b947ef4/console.log" append="off"/>
Aug 17 11:55:37 user nova-compute[73449]:     </serial>
Aug 17 11:55:37 user nova-compute[73449]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 11:55:37 user nova-compute[73449]:     <video>
Aug 17 11:55:37 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 11:55:37 user nova-compute[73449]:     </video>
Aug 17 11:55:37 user nova-compute[73449]:     <rng model="virtio">
Aug 17 11:55:37 user nova-compute[73449]:       <backend model="random">/dev/urandom</backend>
Aug 17 11:55:37 user nova-compute[73449]:     </rng>
Aug 17 11:55:37 user nova-compute[73449]:     <controller type="usb" index="0" model="none"/>
Aug 17 11:55:37 user nova-compute[73449]:     <memballoon model="virtio">
Aug 17 11:55:37 user nova-compute[73449]:       <stats period="10"/>
Aug 17 11:55:37 user nova-compute[73449]:     </memballoon>
Aug 17 11:55:37 user nova-compute[73449]:   </devices>
Aug 17 11:55:37 user nova-compute[73449]: </domain>
Aug 17 11:55:37 user nova-compute[73449]:  {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 11:55:37 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-3da1945c-85fe-4033-8f8b-541851755ac3 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:55:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1324112572',display_name='tempest-VolumesSnapshotTestJSON-instance-1324112572',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1324112572',id=35,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAeUBC842lE7robHmES8fz+eQ3WZq4NsR5jLSpTc5x/s/Eqd7/7hPnimog+o1z3CURrniR8+QuyMUtxlK2NJClhioavf4Gy/slFFQzw5Jr30/P3RvrfohDzd2/8XTHg5gw==',key_name='tempest-keypair-1504040959',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='348b0a78aaf940b98f91655ddd6d4d6d',ramdisk_id='',reservation_id='r-f5qm4nan',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-363415870',owner_user_name='tempest-VolumesSnapshotTestJSON-363415870-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T11:55:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='24c0eff502f744ad8eb6359e320852d4',uuid=9e68a702-ead5-47ae-9375-5cd00b947ef4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f4c80486-3b7b-4bcc-9593-04a46766dc36", "address": "fa:16:3e:35:7f:0b", "network": {"id": "bae20193-cae3-45f8-8881-68020cd853e9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-459774400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "348b0a78aaf940b98f91655ddd6d4d6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4c80486-3b", "ovs_interfaceid": "f4c80486-3b7b-4bcc-9593-04a46766dc36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 11:55:37 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-3da1945c-85fe-4033-8f8b-541851755ac3 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Converting VIF {"id": "f4c80486-3b7b-4bcc-9593-04a46766dc36", "address": "fa:16:3e:35:7f:0b", "network": {"id": "bae20193-cae3-45f8-8881-68020cd853e9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-459774400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "348b0a78aaf940b98f91655ddd6d4d6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4c80486-3b", "ovs_interfaceid": "f4c80486-3b7b-4bcc-9593-04a46766dc36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:55:37 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-3da1945c-85fe-4033-8f8b-541851755ac3 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:7f:0b,bridge_name='br-int',has_traffic_filtering=True,id=f4c80486-3b7b-4bcc-9593-04a46766dc36,network=Network(bae20193-cae3-45f8-8881-68020cd853e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4c80486-3b') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:55:37 user nova-compute[73449]: DEBUG os_vif [None req-3da1945c-85fe-4033-8f8b-541851755ac3 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:7f:0b,bridge_name='br-int',has_traffic_filtering=True,id=f4c80486-3b7b-4bcc-9593-04a46766dc36,network=Network(bae20193-cae3-45f8-8881-68020cd853e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4c80486-3b') {{(pid=73449) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 11:55:37 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:55:37 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:55:37 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 11:55:37 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:55:37 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf4c80486-3b, may_exist=True, interface_attrs={}) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:55:37 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf4c80486-3b, col_values=(('external_ids', {'iface-id': 'f4c80486-3b7b-4bcc-9593-04a46766dc36', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:35:7f:0b', 'vm-uuid': '9e68a702-ead5-47ae-9375-5cd00b947ef4'}),), if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:55:37 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:55:37 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:55:37 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:55:37 user nova-compute[73449]: INFO os_vif [None req-3da1945c-85fe-4033-8f8b-541851755ac3 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:7f:0b,bridge_name='br-int',has_traffic_filtering=True,id=f4c80486-3b7b-4bcc-9593-04a46766dc36,network=Network(bae20193-cae3-45f8-8881-68020cd853e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4c80486-3b')
Aug 17 11:55:37 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-3da1945c-85fe-4033-8f8b-541851755ac3 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] No BDM found with device name vda, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 11:55:37 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-3da1945c-85fe-4033-8f8b-541851755ac3 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] No VIF found with MAC fa:16:3e:35:7f:0b, not building metadata {{(pid=73449) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 11:55:38 user nova-compute[73449]: DEBUG nova.network.neutron [req-ead75f1f-86dc-4436-809d-17cf48f506db req-cd03d631-3af3-4405-94fa-006c294d13d8 service nova] [instance: 9e68a702-ead5-47ae-9375-5cd00b947ef4] Updated VIF entry in instance network info cache for port f4c80486-3b7b-4bcc-9593-04a46766dc36. {{(pid=73449) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 11:55:38 user nova-compute[73449]: DEBUG nova.network.neutron [req-ead75f1f-86dc-4436-809d-17cf48f506db req-cd03d631-3af3-4405-94fa-006c294d13d8 service nova] [instance: 9e68a702-ead5-47ae-9375-5cd00b947ef4] Updating instance_info_cache with network_info: [{"id": "f4c80486-3b7b-4bcc-9593-04a46766dc36", "address": "fa:16:3e:35:7f:0b", "network": {"id": "bae20193-cae3-45f8-8881-68020cd853e9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-459774400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "348b0a78aaf940b98f91655ddd6d4d6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4c80486-3b", "ovs_interfaceid": "f4c80486-3b7b-4bcc-9593-04a46766dc36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:55:38 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-ead75f1f-86dc-4436-809d-17cf48f506db req-cd03d631-3af3-4405-94fa-006c294d13d8 service nova] Releasing lock "refresh_cache-9e68a702-ead5-47ae-9375-5cd00b947ef4" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:55:39 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:55:39 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:55:39 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:55:39 user nova-compute[73449]: DEBUG nova.compute.manager [req-767dd258-b17b-4fe3-a936-eacca8ef5233 req-5457325c-f232-4629-9a53-ece9a815c65e service nova] [instance: 9e68a702-ead5-47ae-9375-5cd00b947ef4] Received event network-vif-plugged-f4c80486-3b7b-4bcc-9593-04a46766dc36 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:55:39 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-767dd258-b17b-4fe3-a936-eacca8ef5233 req-5457325c-f232-4629-9a53-ece9a815c65e service nova] Acquiring lock "9e68a702-ead5-47ae-9375-5cd00b947ef4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:55:39 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-767dd258-b17b-4fe3-a936-eacca8ef5233 req-5457325c-f232-4629-9a53-ece9a815c65e service nova] Lock "9e68a702-ead5-47ae-9375-5cd00b947ef4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:55:39 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-767dd258-b17b-4fe3-a936-eacca8ef5233 req-5457325c-f232-4629-9a53-ece9a815c65e service nova] Lock "9e68a702-ead5-47ae-9375-5cd00b947ef4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:55:39 user nova-compute[73449]: DEBUG nova.compute.manager [req-767dd258-b17b-4fe3-a936-eacca8ef5233 req-5457325c-f232-4629-9a53-ece9a815c65e service nova] [instance: 9e68a702-ead5-47ae-9375-5cd00b947ef4] No waiting events found dispatching network-vif-plugged-f4c80486-3b7b-4bcc-9593-04a46766dc36 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:55:39 user nova-compute[73449]: WARNING nova.compute.manager [req-767dd258-b17b-4fe3-a936-eacca8ef5233 req-5457325c-f232-4629-9a53-ece9a815c65e service nova] [instance: 9e68a702-ead5-47ae-9375-5cd00b947ef4] Received unexpected event network-vif-plugged-f4c80486-3b7b-4bcc-9593-04a46766dc36 for instance with vm_state building and task_state spawning.
Aug 17 11:55:39 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:55:39 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:55:39 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:55:39 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:55:39 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:55:41 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692273341.2499938, 9e68a702-ead5-47ae-9375-5cd00b947ef4 => Resumed> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:55:41 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 9e68a702-ead5-47ae-9375-5cd00b947ef4] VM Resumed (Lifecycle Event)
Aug 17 11:55:41 user nova-compute[73449]: DEBUG nova.compute.manager [None req-3da1945c-85fe-4033-8f8b-541851755ac3 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] [instance: 9e68a702-ead5-47ae-9375-5cd00b947ef4] Instance event wait completed in 0 seconds for  {{(pid=73449) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 11:55:41 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-3da1945c-85fe-4033-8f8b-541851755ac3 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] [instance: 9e68a702-ead5-47ae-9375-5cd00b947ef4] Guest created on hypervisor {{(pid=73449) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 11:55:41 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: 9e68a702-ead5-47ae-9375-5cd00b947ef4] Instance spawned successfully.
Aug 17 11:55:41 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-3da1945c-85fe-4033-8f8b-541851755ac3 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] [instance: 9e68a702-ead5-47ae-9375-5cd00b947ef4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 11:55:41 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 9e68a702-ead5-47ae-9375-5cd00b947ef4] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:55:41 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-3da1945c-85fe-4033-8f8b-541851755ac3 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] [instance: 9e68a702-ead5-47ae-9375-5cd00b947ef4] Found default for hw_cdrom_bus of ide {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:55:41 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-3da1945c-85fe-4033-8f8b-541851755ac3 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] [instance: 9e68a702-ead5-47ae-9375-5cd00b947ef4] Found default for hw_disk_bus of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:55:41 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-3da1945c-85fe-4033-8f8b-541851755ac3 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] [instance: 9e68a702-ead5-47ae-9375-5cd00b947ef4] Found default for hw_input_bus of None {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:55:41 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-3da1945c-85fe-4033-8f8b-541851755ac3 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] [instance: 9e68a702-ead5-47ae-9375-5cd00b947ef4] Found default for hw_pointer_model of None {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:55:41 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-3da1945c-85fe-4033-8f8b-541851755ac3 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] [instance: 9e68a702-ead5-47ae-9375-5cd00b947ef4] Found default for hw_video_model of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:55:41 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-3da1945c-85fe-4033-8f8b-541851755ac3 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] [instance: 9e68a702-ead5-47ae-9375-5cd00b947ef4] Found default for hw_vif_model of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:55:41 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 9e68a702-ead5-47ae-9375-5cd00b947ef4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 11:55:41 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 9e68a702-ead5-47ae-9375-5cd00b947ef4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 11:55:41 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692273341.2520297, 9e68a702-ead5-47ae-9375-5cd00b947ef4 => Started> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:55:41 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 9e68a702-ead5-47ae-9375-5cd00b947ef4] VM Started (Lifecycle Event)
Aug 17 11:55:41 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 9e68a702-ead5-47ae-9375-5cd00b947ef4] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:55:41 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 9e68a702-ead5-47ae-9375-5cd00b947ef4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 11:55:41 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 9e68a702-ead5-47ae-9375-5cd00b947ef4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 11:55:41 user nova-compute[73449]: INFO nova.compute.manager [None req-3da1945c-85fe-4033-8f8b-541851755ac3 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] [instance: 9e68a702-ead5-47ae-9375-5cd00b947ef4] Took 5.85 seconds to spawn the instance on the hypervisor.
Aug 17 11:55:41 user nova-compute[73449]: DEBUG nova.compute.manager [None req-3da1945c-85fe-4033-8f8b-541851755ac3 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] [instance: 9e68a702-ead5-47ae-9375-5cd00b947ef4] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:55:41 user nova-compute[73449]: DEBUG nova.compute.manager [req-6460bd25-217e-4932-afc0-ed5e08bf4ec8 req-d664bc06-caff-4c82-85ed-8a4b0175a55f service nova] [instance: 9e68a702-ead5-47ae-9375-5cd00b947ef4] Received event network-vif-plugged-f4c80486-3b7b-4bcc-9593-04a46766dc36 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:55:41 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-6460bd25-217e-4932-afc0-ed5e08bf4ec8 req-d664bc06-caff-4c82-85ed-8a4b0175a55f service nova] Acquiring lock "9e68a702-ead5-47ae-9375-5cd00b947ef4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:55:41 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-6460bd25-217e-4932-afc0-ed5e08bf4ec8 req-d664bc06-caff-4c82-85ed-8a4b0175a55f service nova] Lock "9e68a702-ead5-47ae-9375-5cd00b947ef4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:55:41 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-6460bd25-217e-4932-afc0-ed5e08bf4ec8 req-d664bc06-caff-4c82-85ed-8a4b0175a55f service nova] Lock "9e68a702-ead5-47ae-9375-5cd00b947ef4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:55:41 user nova-compute[73449]: DEBUG nova.compute.manager [req-6460bd25-217e-4932-afc0-ed5e08bf4ec8 req-d664bc06-caff-4c82-85ed-8a4b0175a55f service nova] [instance: 9e68a702-ead5-47ae-9375-5cd00b947ef4] No waiting events found dispatching network-vif-plugged-f4c80486-3b7b-4bcc-9593-04a46766dc36 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:55:41 user nova-compute[73449]: WARNING nova.compute.manager [req-6460bd25-217e-4932-afc0-ed5e08bf4ec8 req-d664bc06-caff-4c82-85ed-8a4b0175a55f service nova] [instance: 9e68a702-ead5-47ae-9375-5cd00b947ef4] Received unexpected event network-vif-plugged-f4c80486-3b7b-4bcc-9593-04a46766dc36 for instance with vm_state building and task_state spawning.
Aug 17 11:55:41 user nova-compute[73449]: INFO nova.compute.manager [None req-3da1945c-85fe-4033-8f8b-541851755ac3 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] [instance: 9e68a702-ead5-47ae-9375-5cd00b947ef4] Took 6.61 seconds to build instance.
Aug 17 11:55:41 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-3da1945c-85fe-4033-8f8b-541851755ac3 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Lock "9e68a702-ead5-47ae-9375-5cd00b947ef4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.703s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:55:42 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:55:43 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:55:43 user nova-compute[73449]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692273328.427608, fea9f81c-a848-4a65-863e-e09dddf65bcf => Stopped> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:55:43 user nova-compute[73449]: INFO nova.compute.manager [-] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] VM Stopped (Lifecycle Event)
Aug 17 11:55:43 user nova-compute[73449]: DEBUG nova.compute.manager [None req-e30d7144-6c26-4a96-84e9-794b57941046 None None] [instance: fea9f81c-a848-4a65-863e-e09dddf65bcf] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:55:47 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:55:48 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:55:49 user nova-compute[73449]: DEBUG nova.compute.manager [req-a420293c-a474-4eed-b80a-ae9da2f8bf62 req-c528b724-b074-4022-bf2e-ceae4b31bfbe service nova] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] Received event network-changed-e1cb1992-df66-4253-ba1f-3c30647c61de {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:55:49 user nova-compute[73449]: DEBUG nova.compute.manager [req-a420293c-a474-4eed-b80a-ae9da2f8bf62 req-c528b724-b074-4022-bf2e-ceae4b31bfbe service nova] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] Refreshing instance network info cache due to event network-changed-e1cb1992-df66-4253-ba1f-3c30647c61de. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 11:55:49 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-a420293c-a474-4eed-b80a-ae9da2f8bf62 req-c528b724-b074-4022-bf2e-ceae4b31bfbe service nova] Acquiring lock "refresh_cache-01ef4274-dfa1-4f7d-a24c-a1686b692f70" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:55:49 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-a420293c-a474-4eed-b80a-ae9da2f8bf62 req-c528b724-b074-4022-bf2e-ceae4b31bfbe service nova] Acquired lock "refresh_cache-01ef4274-dfa1-4f7d-a24c-a1686b692f70" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:55:49 user nova-compute[73449]: DEBUG nova.network.neutron [req-a420293c-a474-4eed-b80a-ae9da2f8bf62 req-c528b724-b074-4022-bf2e-ceae4b31bfbe service nova] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] Refreshing network info cache for port e1cb1992-df66-4253-ba1f-3c30647c61de {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 11:55:50 user nova-compute[73449]: DEBUG nova.network.neutron [req-a420293c-a474-4eed-b80a-ae9da2f8bf62 req-c528b724-b074-4022-bf2e-ceae4b31bfbe service nova] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] Updated VIF entry in instance network info cache for port e1cb1992-df66-4253-ba1f-3c30647c61de. {{(pid=73449) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 11:55:50 user nova-compute[73449]: DEBUG nova.network.neutron [req-a420293c-a474-4eed-b80a-ae9da2f8bf62 req-c528b724-b074-4022-bf2e-ceae4b31bfbe service nova] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] Updating instance_info_cache with network_info: [{"id": "e1cb1992-df66-4253-ba1f-3c30647c61de", "address": "fa:16:3e:b9:37:67", "network": {"id": "ff73f5c3-bae6-46cc-bcb8-bbd5be1b478d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1229197917-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5ba3ebf47bd4b999e68c74a5c0ab060", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1cb1992-df", "ovs_interfaceid": "e1cb1992-df66-4253-ba1f-3c30647c61de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:55:50 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-a420293c-a474-4eed-b80a-ae9da2f8bf62 req-c528b724-b074-4022-bf2e-ceae4b31bfbe service nova] Releasing lock "refresh_cache-01ef4274-dfa1-4f7d-a24c-a1686b692f70" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:55:50 user nova-compute[73449]: DEBUG nova.compute.manager [req-cef55da6-d06d-48b4-a7b1-f8c298539b1e req-0d797c5e-4db6-476f-9340-d742abbe8112 service nova] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] Received event network-changed-e1cb1992-df66-4253-ba1f-3c30647c61de {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:55:50 user nova-compute[73449]: DEBUG nova.compute.manager [req-cef55da6-d06d-48b4-a7b1-f8c298539b1e req-0d797c5e-4db6-476f-9340-d742abbe8112 service nova] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] Refreshing instance network info cache due to event network-changed-e1cb1992-df66-4253-ba1f-3c30647c61de. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 11:55:50 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-cef55da6-d06d-48b4-a7b1-f8c298539b1e req-0d797c5e-4db6-476f-9340-d742abbe8112 service nova] Acquiring lock "refresh_cache-01ef4274-dfa1-4f7d-a24c-a1686b692f70" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:55:50 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-cef55da6-d06d-48b4-a7b1-f8c298539b1e req-0d797c5e-4db6-476f-9340-d742abbe8112 service nova] Acquired lock "refresh_cache-01ef4274-dfa1-4f7d-a24c-a1686b692f70" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:55:50 user nova-compute[73449]: DEBUG nova.network.neutron [req-cef55da6-d06d-48b4-a7b1-f8c298539b1e req-0d797c5e-4db6-476f-9340-d742abbe8112 service nova] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] Refreshing network info cache for port e1cb1992-df66-4253-ba1f-3c30647c61de {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 11:55:50 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-9526a5ee-31ff-428d-927d-50f095009d7e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Acquiring lock "01ef4274-dfa1-4f7d-a24c-a1686b692f70" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:55:50 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-9526a5ee-31ff-428d-927d-50f095009d7e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Lock "01ef4274-dfa1-4f7d-a24c-a1686b692f70" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:55:50 user nova-compute[73449]: INFO nova.compute.manager [None req-9526a5ee-31ff-428d-927d-50f095009d7e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] Detaching volume 0a382874-91aa-4ff2-aae4-15db10fe5ff2
Aug 17 11:55:50 user nova-compute[73449]: INFO nova.virt.block_device [None req-9526a5ee-31ff-428d-927d-50f095009d7e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] Attempting to driver detach volume 0a382874-91aa-4ff2-aae4-15db10fe5ff2 from mountpoint /dev/vdb
Aug 17 11:55:50 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-9526a5ee-31ff-428d-927d-50f095009d7e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Attempting to detach device vdb from instance 01ef4274-dfa1-4f7d-a24c-a1686b692f70 from the persistent domain config. {{(pid=73449) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 11:55:50 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-9526a5ee-31ff-428d-927d-50f095009d7e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 11:55:50 user nova-compute[73449]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 11:55:50 user nova-compute[73449]:   <source dev="/dev/sdf"/>
Aug 17 11:55:50 user nova-compute[73449]:   <target dev="vdb" bus="virtio"/>
Aug 17 11:55:50 user nova-compute[73449]:   <serial>0a382874-91aa-4ff2-aae4-15db10fe5ff2</serial>
Aug 17 11:55:50 user nova-compute[73449]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 11:55:50 user nova-compute[73449]: </disk>
Aug 17 11:55:50 user nova-compute[73449]:  {{(pid=73449) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 11:55:50 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-9526a5ee-31ff-428d-927d-50f095009d7e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Successfully detached device vdb from instance 01ef4274-dfa1-4f7d-a24c-a1686b692f70 from the persistent domain config.
Aug 17 11:55:50 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-9526a5ee-31ff-428d-927d-50f095009d7e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 01ef4274-dfa1-4f7d-a24c-a1686b692f70 from the live domain config. {{(pid=73449) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 11:55:50 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-9526a5ee-31ff-428d-927d-50f095009d7e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 11:55:50 user nova-compute[73449]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 11:55:50 user nova-compute[73449]:   <source dev="/dev/sdf"/>
Aug 17 11:55:50 user nova-compute[73449]:   <target dev="vdb" bus="virtio"/>
Aug 17 11:55:50 user nova-compute[73449]:   <serial>0a382874-91aa-4ff2-aae4-15db10fe5ff2</serial>
Aug 17 11:55:50 user nova-compute[73449]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 11:55:50 user nova-compute[73449]: </disk>
Aug 17 11:55:50 user nova-compute[73449]:  {{(pid=73449) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 11:55:50 user nova-compute[73449]: DEBUG nova.network.neutron [req-cef55da6-d06d-48b4-a7b1-f8c298539b1e req-0d797c5e-4db6-476f-9340-d742abbe8112 service nova] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] Updated VIF entry in instance network info cache for port e1cb1992-df66-4253-ba1f-3c30647c61de. {{(pid=73449) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 11:55:50 user nova-compute[73449]: DEBUG nova.network.neutron [req-cef55da6-d06d-48b4-a7b1-f8c298539b1e req-0d797c5e-4db6-476f-9340-d742abbe8112 service nova] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] Updating instance_info_cache with network_info: [{"id": "e1cb1992-df66-4253-ba1f-3c30647c61de", "address": "fa:16:3e:b9:37:67", "network": {"id": "ff73f5c3-bae6-46cc-bcb8-bbd5be1b478d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1229197917-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5ba3ebf47bd4b999e68c74a5c0ab060", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1cb1992-df", "ovs_interfaceid": "e1cb1992-df66-4253-ba1f-3c30647c61de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:55:50 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-cef55da6-d06d-48b4-a7b1-f8c298539b1e req-0d797c5e-4db6-476f-9340-d742abbe8112 service nova] Releasing lock "refresh_cache-01ef4274-dfa1-4f7d-a24c-a1686b692f70" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:55:51 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Received event <DeviceRemovedEvent: 1692273351.1118636, 01ef4274-dfa1-4f7d-a24c-a1686b692f70 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73449) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 11:55:51 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-9526a5ee-31ff-428d-927d-50f095009d7e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 01ef4274-dfa1-4f7d-a24c-a1686b692f70 {{(pid=73449) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 11:55:51 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-9526a5ee-31ff-428d-927d-50f095009d7e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Successfully detached device vdb from instance 01ef4274-dfa1-4f7d-a24c-a1686b692f70 from the live domain config.
Aug 17 11:55:51 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9526a5ee-31ff-428d-927d-50f095009d7e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] calling os-brick to detach iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 11:55:51 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-9526a5ee-31ff-428d-927d-50f095009d7e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, {'target_iqns': ['iqn.2010-10.org.openstack:0a382874-91aa-4ff2-aae4-15db10fe5ff2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PgQlnxmj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 11:55:51 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-9526a5ee-31ff-428d-927d-50f095009d7e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 11:55:51 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-9526a5ee-31ff-428d-927d-50f095009d7e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:55:51 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-9526a5ee-31ff-428d-927d-50f095009d7e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:55:51 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-9526a5ee-31ff-428d-927d-50f095009d7e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a382874-91aa-4ff2-aae4-15db10fe5ff2', 0)] {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 11:55:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:55:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:55:51 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dfc11b0-7966-43c2-8a03-ac5fa9c9063f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a382874-91aa-4ff2-aae4-15db10fe5ff2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:55:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:55:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:55:51 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[73cd56d3-f091-44eb-82bd-6020dccbaafa]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a382874-91aa-4ff2-aae4-15db10fe5ff2 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7 (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:55:51 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-9526a5ee-31ff-428d-927d-50f095009d7e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)
Aug 17 11:55:51 user nova-compute[73449]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a382874-91aa-4ff2-aae4-15db10fe5ff2 (non-flash)
Aug 17 11:55:51 user nova-compute[73449]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 (non-flash)
Aug 17 11:55:51 user nova-compute[73449]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7 (non-flash)
Aug 17 11:55:51 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:55:51 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-9526a5ee-31ff-428d-927d-50f095009d7e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)
Aug 17 11:55:51 user nova-compute[73449]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a382874-91aa-4ff2-aae4-15db10fe5ff2 (non-flash)
Aug 17 11:55:51 user nova-compute[73449]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 (non-flash)
Aug 17 11:55:51 user nova-compute[73449]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7 (non-flash)
Aug 17 11:55:51 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:55:51 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-9526a5ee-31ff-428d-927d-50f095009d7e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe787667490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a382874-91aa-4ff2-aae4-15db10fe5ff2'): ({'sdf'}, set())}) {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 11:55:51 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-9526a5ee-31ff-428d-927d-50f095009d7e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Removing single pathed devices sdf {{(pid=73449) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 11:55:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:55:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:55:51 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[70e2f735-7b2a-4aee-af6a-9ec298e52e14]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:55:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:55:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.017s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:55:51 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[dafc6d17-253a-4c00-917f-734910e9595b]: (4, ('ok\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:55:51 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-9526a5ee-31ff-428d-927d-50f095009d7e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Flushing IO for device /dev/sdf {{(pid=73449) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 11:55:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:55:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:55:51 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e769b99-0fc9-4c81-ba60-6a0d5aa42b95]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:55:51 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-9526a5ee-31ff-428d-927d-50f095009d7e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73449) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 11:55:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:55:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.043s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:55:51 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[37880344-9aa1-4690-b90b-90926cc689ac]: (4, ('1', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:55:51 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-9526a5ee-31ff-428d-927d-50f095009d7e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73449) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 11:55:51 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-9526a5ee-31ff-428d-927d-50f095009d7e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] SCSI volumes sdf have been removed. {{(pid=73449) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 11:55:51 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-9526a5ee-31ff-428d-927d-50f095009d7e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a382874-91aa-4ff2-aae4-15db10fe5ff2')] {{(pid=73449) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 11:55:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a382874-91aa-4ff2-aae4-15db10fe5ff2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:55:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a382874-91aa-4ff2-aae4-15db10fe5ff2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:55:51 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[271fa9b1-01a0-4084-b984-d0676f563d12]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:55:51 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-9526a5ee-31ff-428d-927d-50f095009d7e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:55:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a382874-91aa-4ff2-aae4-15db10fe5ff2 -p 172.16.0.220:3260 --logout {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:55:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a382874-91aa-4ff2-aae4-15db10fe5ff2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:55:51 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[3667b455-30dc-4ca4-b47b-43f2191c5c6b]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:0a382874-91aa-4ff2-aae4-15db10fe5ff2, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:0a382874-91aa-4ff2-aae4-15db10fe5ff2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:55:51 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-9526a5ee-31ff-428d-927d-50f095009d7e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:0a382874-91aa-4ff2-aae4-15db10fe5ff2, portal: 172.16.0.220,3260]
Aug 17 11:55:51 user nova-compute[73449]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:0a382874-91aa-4ff2-aae4-15db10fe5ff2, portal: 172.16.0.220,3260] successful.
Aug 17 11:55:51 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:55:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a382874-91aa-4ff2-aae4-15db10fe5ff2 -p 172.16.0.220:3260 --op delete {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:55:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a382874-91aa-4ff2-aae4-15db10fe5ff2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:55:51 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[7110249b-b5e5-4eee-a70e-bb66abcc1d07]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:55:51 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-9526a5ee-31ff-428d-927d-50f095009d7e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:55:51 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-9526a5ee-31ff-428d-927d-50f095009d7e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.279s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:55:51 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-9526a5ee-31ff-428d-927d-50f095009d7e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] <== disconnect_volume: return (280ms) None {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 11:55:51 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9526a5ee-31ff-428d-927d-50f095009d7e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] Disconnected iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 11:55:52 user nova-compute[73449]: DEBUG nova.objects.instance [None req-9526a5ee-31ff-428d-927d-50f095009d7e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Lazy-loading 'flavor' on Instance uuid 01ef4274-dfa1-4f7d-a24c-a1686b692f70 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:55:52 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-9526a5ee-31ff-428d-927d-50f095009d7e tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Lock "01ef4274-dfa1-4f7d-a24c-a1686b692f70" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.733s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:55:52 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:55:53 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:55:56 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:55:56 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:55:56 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:55:56 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:55:56 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:55:56 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Cleaning up deleted instances {{(pid=73449) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 17 11:55:56 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] There are 0 instances to clean {{(pid=73449) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 17 11:55:57 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:55:57 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:55:57 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73449) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 11:55:58 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:56:00 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:56:01 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:56:02 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:56:02 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:56:02 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:56:02 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Starting heal instance info cache {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 11:56:03 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "refresh_cache-89440604-1daf-4e7a-a524-2f9c21a9cb96" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:56:03 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquired lock "refresh_cache-89440604-1daf-4e7a-a524-2f9c21a9cb96" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:56:03 user nova-compute[73449]: DEBUG nova.network.neutron [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: 89440604-1daf-4e7a-a524-2f9c21a9cb96] Forcefully refreshing network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 11:56:03 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:56:03 user nova-compute[73449]: DEBUG nova.network.neutron [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: 89440604-1daf-4e7a-a524-2f9c21a9cb96] Updating instance_info_cache with network_info: [{"id": "7ebcec20-01ec-4807-876d-d95bff0a8a77", "address": "fa:16:3e:52:45:6e", "network": {"id": "9455bb75-f75a-41ff-8f6f-49f55aa738f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-425274599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec3b0b72e47448ebe99f9fc64119c1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ebcec20-01", "ovs_interfaceid": "7ebcec20-01ec-4807-876d-d95bff0a8a77", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:56:03 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Releasing lock "refresh_cache-89440604-1daf-4e7a-a524-2f9c21a9cb96" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:56:03 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: 89440604-1daf-4e7a-a524-2f9c21a9cb96] Updated the network info_cache for instance {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 11:56:03 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:56:04 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:56:06 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:56:06 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:56:06 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:56:06 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:56:06 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=73449) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 11:56:07 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd4ec7bd-002e-4a71-9314-96c21427af27/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:56:07 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd4ec7bd-002e-4a71-9314-96c21427af27/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:56:07 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd4ec7bd-002e-4a71-9314-96c21427af27/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:56:07 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd4ec7bd-002e-4a71-9314-96c21427af27/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:56:07 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/042713b8-ab7f-4c14-92e5-f830ccb7e341/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:56:07 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/042713b8-ab7f-4c14-92e5-f830ccb7e341/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:56:07 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/042713b8-ab7f-4c14-92e5-f830ccb7e341/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:56:07 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:56:07 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/042713b8-ab7f-4c14-92e5-f830ccb7e341/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:56:07 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a9e8ad2-19db-4975-87e4-2efce603a7d7/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:56:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a9e8ad2-19db-4975-87e4-2efce603a7d7/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:56:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a9e8ad2-19db-4975-87e4-2efce603a7d7/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:56:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a9e8ad2-19db-4975-87e4-2efce603a7d7/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:56:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk.rescue --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:56:08 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:56:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:56:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk.rescue --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:56:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:56:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:56:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:56:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:56:09 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:56:09 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73449) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 11:56:09 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73449) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 11:56:09 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73449) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 11:56:09 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31f5f3d2-41d8-4a26-9eb2-18b891f94734/disk.rescue --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:56:09 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31f5f3d2-41d8-4a26-9eb2-18b891f94734/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:56:09 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31f5f3d2-41d8-4a26-9eb2-18b891f94734/disk.rescue --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:56:09 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31f5f3d2-41d8-4a26-9eb2-18b891f94734/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:56:09 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef4274-dfa1-4f7d-a24c-a1686b692f70/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:56:09 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef4274-dfa1-4f7d-a24c-a1686b692f70/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:56:09 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef4274-dfa1-4f7d-a24c-a1686b692f70/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:56:09 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef4274-dfa1-4f7d-a24c-a1686b692f70/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:56:09 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e68a702-ead5-47ae-9375-5cd00b947ef4/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:56:09 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e68a702-ead5-47ae-9375-5cd00b947ef4/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:56:09 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e68a702-ead5-47ae-9375-5cd00b947ef4/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:56:10 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e68a702-ead5-47ae-9375-5cd00b947ef4/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:56:10 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d74c8f6-fb4e-4460-b722-674a8a1e2d25/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:56:10 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d74c8f6-fb4e-4460-b722-674a8a1e2d25/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:56:10 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d74c8f6-fb4e-4460-b722-674a8a1e2d25/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:56:10 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d74c8f6-fb4e-4460-b722-674a8a1e2d25/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:56:10 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89440604-1daf-4e7a-a524-2f9c21a9cb96/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:56:10 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89440604-1daf-4e7a-a524-2f9c21a9cb96/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:56:10 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89440604-1daf-4e7a-a524-2f9c21a9cb96/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:56:10 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89440604-1daf-4e7a-a524-2f9c21a9cb96/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:56:11 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:56:11 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:56:11 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Hypervisor/Node resource view: name=user free_ram=7079MB free_disk=25.04473876953125GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73449) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 11:56:11 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:56:11 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:56:11 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 4a9e8ad2-19db-4975-87e4-2efce603a7d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:56:11 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 3d74c8f6-fb4e-4460-b722-674a8a1e2d25 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:56:11 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance ae75d334-431a-4008-8b3d-f2a727d92417 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:56:11 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance dd4ec7bd-002e-4a71-9314-96c21427af27 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:56:11 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 89440604-1daf-4e7a-a524-2f9c21a9cb96 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:56:11 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 01ef4274-dfa1-4f7d-a24c-a1686b692f70 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:56:11 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 31f5f3d2-41d8-4a26-9eb2-18b891f94734 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:56:11 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance b32df06e-0b5a-4384-946b-64d64aeeb07e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:56:11 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 1542e090-dffe-47d1-8bf1-bb0361cfba34 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:56:11 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 042713b8-ab7f-4c14-92e5-f830ccb7e341 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:56:11 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 9e68a702-ead5-47ae-9375-5cd00b947ef4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:56:11 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=73449) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 11:56:11 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=73449) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 11:56:11 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 11:56:11 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 11:56:11 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Compute_service record updated for user:user {{(pid=73449) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 11:56:11 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.553s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:56:11 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:56:11 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73449) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 17 11:56:12 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:56:13 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:56:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:56:18 user nova-compute[73449]: DEBUG nova.compute.manager [req-a4e91184-7d92-4025-8536-21ef81968c5d req-b2fd6521-25f9-42a9-9f77-5f266b9f2c4f service nova] [instance: 1542e090-dffe-47d1-8bf1-bb0361cfba34] Received event network-changed-85a7a7f3-b4c3-4ff0-810a-4cce888b99a2 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:56:18 user nova-compute[73449]: DEBUG nova.compute.manager [req-a4e91184-7d92-4025-8536-21ef81968c5d req-b2fd6521-25f9-42a9-9f77-5f266b9f2c4f service nova] [instance: 1542e090-dffe-47d1-8bf1-bb0361cfba34] Refreshing instance network info cache due to event network-changed-85a7a7f3-b4c3-4ff0-810a-4cce888b99a2. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 11:56:18 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-a4e91184-7d92-4025-8536-21ef81968c5d req-b2fd6521-25f9-42a9-9f77-5f266b9f2c4f service nova] Acquiring lock "refresh_cache-1542e090-dffe-47d1-8bf1-bb0361cfba34" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:56:18 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-a4e91184-7d92-4025-8536-21ef81968c5d req-b2fd6521-25f9-42a9-9f77-5f266b9f2c4f service nova] Acquired lock "refresh_cache-1542e090-dffe-47d1-8bf1-bb0361cfba34" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:56:18 user nova-compute[73449]: DEBUG nova.network.neutron [req-a4e91184-7d92-4025-8536-21ef81968c5d req-b2fd6521-25f9-42a9-9f77-5f266b9f2c4f service nova] [instance: 1542e090-dffe-47d1-8bf1-bb0361cfba34] Refreshing network info cache for port 85a7a7f3-b4c3-4ff0-810a-4cce888b99a2 {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 11:56:19 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-e1ebc790-1464-46b7-869e-f2c4ddba09a7 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Acquiring lock "1542e090-dffe-47d1-8bf1-bb0361cfba34" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:56:19 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-e1ebc790-1464-46b7-869e-f2c4ddba09a7 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Lock "1542e090-dffe-47d1-8bf1-bb0361cfba34" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:56:19 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-e1ebc790-1464-46b7-869e-f2c4ddba09a7 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Acquiring lock "1542e090-dffe-47d1-8bf1-bb0361cfba34-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:56:19 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-e1ebc790-1464-46b7-869e-f2c4ddba09a7 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Lock "1542e090-dffe-47d1-8bf1-bb0361cfba34-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:56:19 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-e1ebc790-1464-46b7-869e-f2c4ddba09a7 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Lock "1542e090-dffe-47d1-8bf1-bb0361cfba34-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:56:19 user nova-compute[73449]: INFO nova.compute.manager [None req-e1ebc790-1464-46b7-869e-f2c4ddba09a7 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 1542e090-dffe-47d1-8bf1-bb0361cfba34] Terminating instance
Aug 17 11:56:19 user nova-compute[73449]: DEBUG nova.compute.manager [None req-e1ebc790-1464-46b7-869e-f2c4ddba09a7 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 1542e090-dffe-47d1-8bf1-bb0361cfba34] Start destroying the instance on the hypervisor. {{(pid=73449) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 11:56:19 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:56:19 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:56:19 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:56:19 user nova-compute[73449]: DEBUG nova.network.neutron [req-a4e91184-7d92-4025-8536-21ef81968c5d req-b2fd6521-25f9-42a9-9f77-5f266b9f2c4f service nova] [instance: 1542e090-dffe-47d1-8bf1-bb0361cfba34] Updated VIF entry in instance network info cache for port 85a7a7f3-b4c3-4ff0-810a-4cce888b99a2. {{(pid=73449) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 11:56:19 user nova-compute[73449]: DEBUG nova.network.neutron [req-a4e91184-7d92-4025-8536-21ef81968c5d req-b2fd6521-25f9-42a9-9f77-5f266b9f2c4f service nova] [instance: 1542e090-dffe-47d1-8bf1-bb0361cfba34] Updating instance_info_cache with network_info: [{"id": "85a7a7f3-b4c3-4ff0-810a-4cce888b99a2", "address": "fa:16:3e:3e:33:50", "network": {"id": "a9e8fcd6-4152-466b-99ad-44b85db05a05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-920564935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bd46cdaff7a4b40955f7c8a12c55452", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85a7a7f3-b4", "ovs_interfaceid": "85a7a7f3-b4c3-4ff0-810a-4cce888b99a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:56:19 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-a4e91184-7d92-4025-8536-21ef81968c5d req-b2fd6521-25f9-42a9-9f77-5f266b9f2c4f service nova] Releasing lock "refresh_cache-1542e090-dffe-47d1-8bf1-bb0361cfba34" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:56:19 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: 1542e090-dffe-47d1-8bf1-bb0361cfba34] Instance destroyed successfully.
Aug 17 11:56:19 user nova-compute[73449]: DEBUG nova.objects.instance [None req-e1ebc790-1464-46b7-869e-f2c4ddba09a7 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Lazy-loading 'resources' on Instance uuid 1542e090-dffe-47d1-8bf1-bb0361cfba34 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:56:19 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-e1ebc790-1464-46b7-869e-f2c4ddba09a7 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:54:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-413418719',display_name='tempest-TestVolumeBootPattern-server-413418719',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-413418719',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIHMstqa6z3yCDWSo0nI/hXtJfgb+1MPwAN30vhg6KwDR8sZaSoGZeJ4pbZmuMNqk20Z45pPhufbqYZm+wNKDW7ChjAcmHiitPsVRUAo/TWnRjbFauozfEZ44NXHQWQQfg==',key_name='tempest-TestVolumeBootPattern-29823023',keypairs=<?>,launch_index=0,launched_at=2023-08-17T11:54:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4bd46cdaff7a4b40955f7c8a12c55452',ramdisk_id='',reservation_id='r-i4gd5t99',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-813872552',owner_user_name='tempest-TestVolumeBootPattern-813872552-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T11:54:44Z,user_data=None,user_id='804ccb0440fb46a4a4c0ae65c3893296',uuid=1542e090-dffe-47d1-8bf1-bb0361cfba34,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "85a7a7f3-b4c3-4ff0-810a-4cce888b99a2", "address": "fa:16:3e:3e:33:50", "network": {"id": "a9e8fcd6-4152-466b-99ad-44b85db05a05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-920564935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bd46cdaff7a4b40955f7c8a12c55452", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85a7a7f3-b4", "ovs_interfaceid": "85a7a7f3-b4c3-4ff0-810a-4cce888b99a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 11:56:19 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-e1ebc790-1464-46b7-869e-f2c4ddba09a7 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Converting VIF {"id": "85a7a7f3-b4c3-4ff0-810a-4cce888b99a2", "address": "fa:16:3e:3e:33:50", "network": {"id": "a9e8fcd6-4152-466b-99ad-44b85db05a05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-920564935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bd46cdaff7a4b40955f7c8a12c55452", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85a7a7f3-b4", "ovs_interfaceid": "85a7a7f3-b4c3-4ff0-810a-4cce888b99a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:56:19 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-e1ebc790-1464-46b7-869e-f2c4ddba09a7 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:33:50,bridge_name='br-int',has_traffic_filtering=True,id=85a7a7f3-b4c3-4ff0-810a-4cce888b99a2,network=Network(a9e8fcd6-4152-466b-99ad-44b85db05a05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85a7a7f3-b4') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:56:19 user nova-compute[73449]: DEBUG os_vif [None req-e1ebc790-1464-46b7-869e-f2c4ddba09a7 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:33:50,bridge_name='br-int',has_traffic_filtering=True,id=85a7a7f3-b4c3-4ff0-810a-4cce888b99a2,network=Network(a9e8fcd6-4152-466b-99ad-44b85db05a05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85a7a7f3-b4') {{(pid=73449) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 11:56:19 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:56:19 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap85a7a7f3-b4, bridge=br-int, if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:56:19 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:56:19 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:56:19 user nova-compute[73449]: INFO os_vif [None req-e1ebc790-1464-46b7-869e-f2c4ddba09a7 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:33:50,bridge_name='br-int',has_traffic_filtering=True,id=85a7a7f3-b4c3-4ff0-810a-4cce888b99a2,network=Network(a9e8fcd6-4152-466b-99ad-44b85db05a05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85a7a7f3-b4')
Aug 17 11:56:20 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1ebc790-1464-46b7-869e-f2c4ddba09a7 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 1542e090-dffe-47d1-8bf1-bb0361cfba34] calling os-brick to detach iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 11:56:20 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1ebc790-1464-46b7-869e-f2c4ddba09a7 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, {'target_iqns': ['iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CtHUhuMp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 11:56:20 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-e1ebc790-1464-46b7-869e-f2c4ddba09a7 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 11:56:20 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-e1ebc790-1464-46b7-869e-f2c4ddba09a7 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:56:20 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-e1ebc790-1464-46b7-869e-f2c4ddba09a7 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.004s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:56:20 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1ebc790-1464-46b7-869e-f2c4ddba09a7 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7', 0)] {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 11:56:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:56:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:56:20 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f0c7a71-6f5d-4986-8b0e-06853d57a550]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:56:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:56:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:56:20 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f0886e6-3f3d-4d4a-9c01-440e0473908b]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7 (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:56:20 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1ebc790-1464-46b7-869e-f2c4ddba09a7 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)
Aug 17 11:56:20 user nova-compute[73449]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 (non-flash)
Aug 17 11:56:20 user nova-compute[73449]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7 (non-flash)
Aug 17 11:56:20 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:56:20 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1ebc790-1464-46b7-869e-f2c4ddba09a7 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)
Aug 17 11:56:20 user nova-compute[73449]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 (non-flash)
Aug 17 11:56:20 user nova-compute[73449]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7 (non-flash)
Aug 17 11:56:20 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:56:20 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1ebc790-1464-46b7-869e-f2c4ddba09a7 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe738626b90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7'): ({'sdc'}, set())}) {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 11:56:20 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-e1ebc790-1464-46b7-869e-f2c4ddba09a7 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Removing single pathed devices sdc {{(pid=73449) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 11:56:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:56:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:56:20 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[098536d3-91e2-4d74-88ea-4c7b69cbdd1c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:56:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:56:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:56:20 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ffc0d35-5489-45d5-992f-b805fa8c1e00]: (4, ('ok\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:56:20 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-e1ebc790-1464-46b7-869e-f2c4ddba09a7 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Flushing IO for device /dev/sdc {{(pid=73449) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 11:56:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:56:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:56:20 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[9312958c-91dd-49da-8ab8-9ae91b0ba84b]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:56:20 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-e1ebc790-1464-46b7-869e-f2c4ddba09a7 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73449) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 11:56:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:56:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.061s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:56:20 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[11c76092-9860-4761-a0c7-0b43d6111a29]: (4, ('1', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:56:20 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-e1ebc790-1464-46b7-869e-f2c4ddba09a7 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73449) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 11:56:20 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-e1ebc790-1464-46b7-869e-f2c4ddba09a7 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] SCSI volumes sdc have been removed. {{(pid=73449) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 11:56:20 user nova-compute[73449]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_de3d2a32',) {{(pid=84309) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 17 11:56:20 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[15117a88-0626-4059-86a6-c692ef14308c]: (4, None) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:56:20 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1ebc790-1464-46b7-869e-f2c4ddba09a7 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7')] {{(pid=73449) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 11:56:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:56:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:56:20 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[613604fb-349c-4ef9-bf7f-3804e1b8a941]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:56:20 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1ebc790-1464-46b7-869e-f2c4ddba09a7 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:56:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7 -p 172.16.0.220:3260 --logout {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:56:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:56:20 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3537dc7-b6b2-4db4-ad7f-21a8d9cc5bb1]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:56:20 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1ebc790-1464-46b7-869e-f2c4ddba09a7 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7, portal: 172.16.0.220,3260]
Aug 17 11:56:20 user nova-compute[73449]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7, portal: 172.16.0.220,3260] successful.
Aug 17 11:56:20 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:56:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7 -p 172.16.0.220:3260 --op delete {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:56:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:56:20 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[da23dbf8-73f3-4fe1-9673-aec44df164eb]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:56:20 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1ebc790-1464-46b7-869e-f2c4ddba09a7 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:56:20 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-e1ebc790-1464-46b7-869e-f2c4ddba09a7 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:56:20 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1ebc790-1464-46b7-869e-f2c4ddba09a7 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] <== disconnect_volume: return (351ms) None {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 11:56:20 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1ebc790-1464-46b7-869e-f2c4ddba09a7 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 1542e090-dffe-47d1-8bf1-bb0361cfba34] Disconnected iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 11:56:20 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-e1ebc790-1464-46b7-869e-f2c4ddba09a7 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 1542e090-dffe-47d1-8bf1-bb0361cfba34] Deleting instance files /opt/stack/data/nova/instances/1542e090-dffe-47d1-8bf1-bb0361cfba34_del
Aug 17 11:56:20 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-e1ebc790-1464-46b7-869e-f2c4ddba09a7 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 1542e090-dffe-47d1-8bf1-bb0361cfba34] Deletion of /opt/stack/data/nova/instances/1542e090-dffe-47d1-8bf1-bb0361cfba34_del complete
Aug 17 11:56:20 user nova-compute[73449]: INFO nova.compute.manager [None req-e1ebc790-1464-46b7-869e-f2c4ddba09a7 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 1542e090-dffe-47d1-8bf1-bb0361cfba34] Took 1.28 seconds to destroy the instance on the hypervisor.
Aug 17 11:56:20 user nova-compute[73449]: DEBUG oslo.service.loopingcall [None req-e1ebc790-1464-46b7-869e-f2c4ddba09a7 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73449) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 11:56:20 user nova-compute[73449]: DEBUG nova.compute.manager [-] [instance: 1542e090-dffe-47d1-8bf1-bb0361cfba34] Deallocating network for instance {{(pid=73449) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 11:56:20 user nova-compute[73449]: DEBUG nova.network.neutron [-] [instance: 1542e090-dffe-47d1-8bf1-bb0361cfba34] deallocate_for_instance() {{(pid=73449) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 11:56:20 user nova-compute[73449]: DEBUG nova.compute.manager [req-ca489e58-aba7-4152-a1a5-f0f6a9a1fa01 req-0db7373c-be27-4c15-8e5e-871ef3d29b41 service nova] [instance: 1542e090-dffe-47d1-8bf1-bb0361cfba34] Received event network-vif-unplugged-85a7a7f3-b4c3-4ff0-810a-4cce888b99a2 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:56:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-ca489e58-aba7-4152-a1a5-f0f6a9a1fa01 req-0db7373c-be27-4c15-8e5e-871ef3d29b41 service nova] Acquiring lock "1542e090-dffe-47d1-8bf1-bb0361cfba34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:56:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-ca489e58-aba7-4152-a1a5-f0f6a9a1fa01 req-0db7373c-be27-4c15-8e5e-871ef3d29b41 service nova] Lock "1542e090-dffe-47d1-8bf1-bb0361cfba34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:56:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-ca489e58-aba7-4152-a1a5-f0f6a9a1fa01 req-0db7373c-be27-4c15-8e5e-871ef3d29b41 service nova] Lock "1542e090-dffe-47d1-8bf1-bb0361cfba34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:56:20 user nova-compute[73449]: DEBUG nova.compute.manager [req-ca489e58-aba7-4152-a1a5-f0f6a9a1fa01 req-0db7373c-be27-4c15-8e5e-871ef3d29b41 service nova] [instance: 1542e090-dffe-47d1-8bf1-bb0361cfba34] No waiting events found dispatching network-vif-unplugged-85a7a7f3-b4c3-4ff0-810a-4cce888b99a2 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:56:20 user nova-compute[73449]: DEBUG nova.compute.manager [req-ca489e58-aba7-4152-a1a5-f0f6a9a1fa01 req-0db7373c-be27-4c15-8e5e-871ef3d29b41 service nova] [instance: 1542e090-dffe-47d1-8bf1-bb0361cfba34] Received event network-vif-unplugged-85a7a7f3-b4c3-4ff0-810a-4cce888b99a2 for instance with task_state deleting. {{(pid=73449) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 11:56:20 user nova-compute[73449]: DEBUG nova.compute.manager [req-ca489e58-aba7-4152-a1a5-f0f6a9a1fa01 req-0db7373c-be27-4c15-8e5e-871ef3d29b41 service nova] [instance: 1542e090-dffe-47d1-8bf1-bb0361cfba34] Received event network-vif-plugged-85a7a7f3-b4c3-4ff0-810a-4cce888b99a2 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:56:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-ca489e58-aba7-4152-a1a5-f0f6a9a1fa01 req-0db7373c-be27-4c15-8e5e-871ef3d29b41 service nova] Acquiring lock "1542e090-dffe-47d1-8bf1-bb0361cfba34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:56:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-ca489e58-aba7-4152-a1a5-f0f6a9a1fa01 req-0db7373c-be27-4c15-8e5e-871ef3d29b41 service nova] Lock "1542e090-dffe-47d1-8bf1-bb0361cfba34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:56:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-ca489e58-aba7-4152-a1a5-f0f6a9a1fa01 req-0db7373c-be27-4c15-8e5e-871ef3d29b41 service nova] Lock "1542e090-dffe-47d1-8bf1-bb0361cfba34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:56:20 user nova-compute[73449]: DEBUG nova.compute.manager [req-ca489e58-aba7-4152-a1a5-f0f6a9a1fa01 req-0db7373c-be27-4c15-8e5e-871ef3d29b41 service nova] [instance: 1542e090-dffe-47d1-8bf1-bb0361cfba34] No waiting events found dispatching network-vif-plugged-85a7a7f3-b4c3-4ff0-810a-4cce888b99a2 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:56:20 user nova-compute[73449]: WARNING nova.compute.manager [req-ca489e58-aba7-4152-a1a5-f0f6a9a1fa01 req-0db7373c-be27-4c15-8e5e-871ef3d29b41 service nova] [instance: 1542e090-dffe-47d1-8bf1-bb0361cfba34] Received unexpected event network-vif-plugged-85a7a7f3-b4c3-4ff0-810a-4cce888b99a2 for instance with vm_state active and task_state deleting.
Aug 17 11:56:21 user nova-compute[73449]: DEBUG nova.compute.manager [req-c74d2186-a7f3-4826-993c-d0b8e2eadfc6 req-51eebc5a-5efd-4a22-aba3-5d6aa2df01d0 service nova] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Received event network-changed-2ce1927a-6866-4362-bc0c-88cd0a19fa08 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:56:21 user nova-compute[73449]: DEBUG nova.compute.manager [req-c74d2186-a7f3-4826-993c-d0b8e2eadfc6 req-51eebc5a-5efd-4a22-aba3-5d6aa2df01d0 service nova] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Refreshing instance network info cache due to event network-changed-2ce1927a-6866-4362-bc0c-88cd0a19fa08. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 11:56:21 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-c74d2186-a7f3-4826-993c-d0b8e2eadfc6 req-51eebc5a-5efd-4a22-aba3-5d6aa2df01d0 service nova] Acquiring lock "refresh_cache-042713b8-ab7f-4c14-92e5-f830ccb7e341" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:56:21 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-c74d2186-a7f3-4826-993c-d0b8e2eadfc6 req-51eebc5a-5efd-4a22-aba3-5d6aa2df01d0 service nova] Acquired lock "refresh_cache-042713b8-ab7f-4c14-92e5-f830ccb7e341" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:56:21 user nova-compute[73449]: DEBUG nova.network.neutron [req-c74d2186-a7f3-4826-993c-d0b8e2eadfc6 req-51eebc5a-5efd-4a22-aba3-5d6aa2df01d0 service nova] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Refreshing network info cache for port 2ce1927a-6866-4362-bc0c-88cd0a19fa08 {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 11:56:21 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-585dfd5f-16e2-4bf1-95b3-71567a34a45e tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Acquiring lock "042713b8-ab7f-4c14-92e5-f830ccb7e341" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:56:21 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-585dfd5f-16e2-4bf1-95b3-71567a34a45e tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Lock "042713b8-ab7f-4c14-92e5-f830ccb7e341" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:56:21 user nova-compute[73449]: DEBUG nova.objects.instance [None req-585dfd5f-16e2-4bf1-95b3-71567a34a45e tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Lazy-loading 'flavor' on Instance uuid 042713b8-ab7f-4c14-92e5-f830ccb7e341 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:56:21 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-585dfd5f-16e2-4bf1-95b3-71567a34a45e tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Lock "042713b8-ab7f-4c14-92e5-f830ccb7e341" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:56:22 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-585dfd5f-16e2-4bf1-95b3-71567a34a45e tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Acquiring lock "042713b8-ab7f-4c14-92e5-f830ccb7e341" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:56:22 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-585dfd5f-16e2-4bf1-95b3-71567a34a45e tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Lock "042713b8-ab7f-4c14-92e5-f830ccb7e341" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:56:22 user nova-compute[73449]: INFO nova.compute.manager [None req-585dfd5f-16e2-4bf1-95b3-71567a34a45e tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Attaching volume 6e360063-8525-4d62-8fa0-33c5062fc247 to /dev/vdb
Aug 17 11:56:22 user nova-compute[73449]: DEBUG os_brick.utils [None req-585dfd5f-16e2-4bf1-95b3-71567a34a45e tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 11:56:22 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:56:22 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:56:22 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0ad8ccd-946f-4e35-a39f-8101919f5cf5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4d3924302012\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:56:22 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:56:22 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:56:22 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a698e68-0611-49af-bcb5-8bac3b66a514]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:56:22 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:56:22 user nova-compute[73449]: DEBUG nova.network.neutron [req-c74d2186-a7f3-4826-993c-d0b8e2eadfc6 req-51eebc5a-5efd-4a22-aba3-5d6aa2df01d0 service nova] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Updated VIF entry in instance network info cache for port 2ce1927a-6866-4362-bc0c-88cd0a19fa08. {{(pid=73449) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 11:56:22 user nova-compute[73449]: DEBUG nova.network.neutron [req-c74d2186-a7f3-4826-993c-d0b8e2eadfc6 req-51eebc5a-5efd-4a22-aba3-5d6aa2df01d0 service nova] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Updating instance_info_cache with network_info: [{"id": "2ce1927a-6866-4362-bc0c-88cd0a19fa08", "address": "fa:16:3e:f5:89:a9", "network": {"id": "f7298070-baaa-4842-b3b2-d9fe1058d3b6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1715911399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8722edee53ed4a9188366c38f3b8b52f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ce1927a-68", "ovs_interfaceid": "2ce1927a-6866-4362-bc0c-88cd0a19fa08", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:56:22 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:56:22 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[0202861e-8ccc-4640-a8f6-08053cbddeb9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:56:22 user nova-compute[73449]: DEBUG nova.network.neutron [-] [instance: 1542e090-dffe-47d1-8bf1-bb0361cfba34] Updating instance_info_cache with network_info: [] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:56:22 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3808eac-169c-40dc-b2a8-bf117173feea]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:56:22 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-585dfd5f-16e2-4bf1-95b3-71567a34a45e tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Running cmd (subprocess): nvme version {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:56:22 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-585dfd5f-16e2-4bf1-95b3-71567a34a45e tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] 'nvme version' failed. Not Retrying. {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 11:56:22 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.nvmeof [None req-585dfd5f-16e2-4bf1-95b3-71567a34a45e tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] nvme not present on system {{(pid=73449) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 11:56:22 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-c74d2186-a7f3-4826-993c-d0b8e2eadfc6 req-51eebc5a-5efd-4a22-aba3-5d6aa2df01d0 service nova] Releasing lock "refresh_cache-042713b8-ab7f-4c14-92e5-f830ccb7e341" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:56:22 user nova-compute[73449]: INFO nova.compute.manager [-] [instance: 1542e090-dffe-47d1-8bf1-bb0361cfba34] Took 1.94 seconds to deallocate network for instance.
Aug 17 11:56:22 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:56:22 user nova-compute[73449]: DEBUG nova.compute.manager [req-8ff8b409-a871-4a75-a13a-f93d186eb7ad req-4ca5674d-4ab1-4efb-8419-4342f3845746 service nova] [instance: 1542e090-dffe-47d1-8bf1-bb0361cfba34] Received event network-vif-deleted-85a7a7f3-b4c3-4ff0-810a-4cce888b99a2 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:56:22 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 11:56:22 user nova-compute[73449]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 11:56:22 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[f253d479-6477-41eb-9d8a-d2c2ebb064bf]: (4, '') {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:56:22 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-585dfd5f-16e2-4bf1-95b3-71567a34a45e tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73449) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 11:56:22 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-585dfd5f-16e2-4bf1-95b3-71567a34a45e tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73449) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 11:56:22 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-585dfd5f-16e2-4bf1-95b3-71567a34a45e tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] LIGHTOS: no hostnqn found. {{(pid=73449) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 11:56:22 user nova-compute[73449]: DEBUG os_brick.utils [None req-585dfd5f-16e2-4bf1-95b3-71567a34a45e tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4d3924302012', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 11:56:22 user nova-compute[73449]: DEBUG nova.virt.block_device [None req-585dfd5f-16e2-4bf1-95b3-71567a34a45e tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Updating existing volume attachment record: 07dd1293-a29b-4d36-8ee6-88c00d6cdbaf {{(pid=73449) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 11:56:23 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:56:23 user nova-compute[73449]: INFO nova.compute.manager [None req-e1ebc790-1464-46b7-869e-f2c4ddba09a7 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 1542e090-dffe-47d1-8bf1-bb0361cfba34] Took 1.14 seconds to detach 1 volumes for instance.
Aug 17 11:56:23 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-e1ebc790-1464-46b7-869e-f2c4ddba09a7 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:56:23 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-e1ebc790-1464-46b7-869e-f2c4ddba09a7 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:56:23 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-e1ebc790-1464-46b7-869e-f2c4ddba09a7 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 11:56:23 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-e1ebc790-1464-46b7-869e-f2c4ddba09a7 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 11:56:24 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-e1ebc790-1464-46b7-869e-f2c4ddba09a7 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.460s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:56:24 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b2bbe6b4-20e2-4cea-b348-e5a3b250c76b tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Acquiring lock "4b7932d8-b781-4db7-a1c5-791ce8d1d866" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:56:24 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b2bbe6b4-20e2-4cea-b348-e5a3b250c76b tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Lock "4b7932d8-b781-4db7-a1c5-791ce8d1d866" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:56:24 user nova-compute[73449]: INFO nova.scheduler.client.report [None req-e1ebc790-1464-46b7-869e-f2c4ddba09a7 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Deleted allocations for instance 1542e090-dffe-47d1-8bf1-bb0361cfba34
Aug 17 11:56:24 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b2bbe6b4-20e2-4cea-b348-e5a3b250c76b tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] Starting instance... {{(pid=73449) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 11:56:24 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-e1ebc790-1464-46b7-869e-f2c4ddba09a7 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Lock "1542e090-dffe-47d1-8bf1-bb0361cfba34" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.046s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:56:24 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b2bbe6b4-20e2-4cea-b348-e5a3b250c76b tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:56:24 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b2bbe6b4-20e2-4cea-b348-e5a3b250c76b tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:56:24 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-b2bbe6b4-20e2-4cea-b348-e5a3b250c76b tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73449) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 11:56:24 user nova-compute[73449]: INFO nova.compute.claims [None req-b2bbe6b4-20e2-4cea-b348-e5a3b250c76b tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] Claim successful on node user
Aug 17 11:56:24 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-b2bbe6b4-20e2-4cea-b348-e5a3b250c76b tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 11:56:24 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-b2bbe6b4-20e2-4cea-b348-e5a3b250c76b tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 11:56:24 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b2bbe6b4-20e2-4cea-b348-e5a3b250c76b tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.548s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:56:24 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b2bbe6b4-20e2-4cea-b348-e5a3b250c76b tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] Start building networks asynchronously for instance. {{(pid=73449) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 11:56:24 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b2bbe6b4-20e2-4cea-b348-e5a3b250c76b tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] Allocating IP information in the background. {{(pid=73449) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 11:56:24 user nova-compute[73449]: DEBUG nova.network.neutron [None req-b2bbe6b4-20e2-4cea-b348-e5a3b250c76b tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] allocate_for_instance() {{(pid=73449) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 11:56:24 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-b2bbe6b4-20e2-4cea-b348-e5a3b250c76b tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 11:56:24 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b2bbe6b4-20e2-4cea-b348-e5a3b250c76b tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] Start building block device mappings for instance. {{(pid=73449) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 11:56:24 user nova-compute[73449]: DEBUG nova.policy [None req-b2bbe6b4-20e2-4cea-b348-e5a3b250c76b tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '17ee7be9cdb14c5ca211a6b0bb80ccc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe7b5fee01a042bb90e40b18a84c82c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73449) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 11:56:24 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:56:25 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b2bbe6b4-20e2-4cea-b348-e5a3b250c76b tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] Start spawning the instance on the hypervisor. {{(pid=73449) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 11:56:25 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b2bbe6b4-20e2-4cea-b348-e5a3b250c76b tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] Creating instance directory {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 11:56:25 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-b2bbe6b4-20e2-4cea-b348-e5a3b250c76b tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] Creating image(s)
Aug 17 11:56:25 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b2bbe6b4-20e2-4cea-b348-e5a3b250c76b tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Acquiring lock "/opt/stack/data/nova/instances/4b7932d8-b781-4db7-a1c5-791ce8d1d866/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:56:25 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b2bbe6b4-20e2-4cea-b348-e5a3b250c76b tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Lock "/opt/stack/data/nova/instances/4b7932d8-b781-4db7-a1c5-791ce8d1d866/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:56:25 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b2bbe6b4-20e2-4cea-b348-e5a3b250c76b tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Lock "/opt/stack/data/nova/instances/4b7932d8-b781-4db7-a1c5-791ce8d1d866/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:56:25 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-b2bbe6b4-20e2-4cea-b348-e5a3b250c76b tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:56:25 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-b2bbe6b4-20e2-4cea-b348-e5a3b250c76b tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json" returned: 0 in 0.210s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:56:25 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b2bbe6b4-20e2-4cea-b348-e5a3b250c76b tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Acquiring lock "7e267a577c062ee862e95ede6b48cfd5632f3ea3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:56:25 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b2bbe6b4-20e2-4cea-b348-e5a3b250c76b tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Lock "7e267a577c062ee862e95ede6b48cfd5632f3ea3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:56:25 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-b2bbe6b4-20e2-4cea-b348-e5a3b250c76b tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:56:25 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-b2bbe6b4-20e2-4cea-b348-e5a3b250c76b tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json" returned: 0 in 0.221s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:56:25 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-b2bbe6b4-20e2-4cea-b348-e5a3b250c76b tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3,backing_fmt=raw /opt/stack/data/nova/instances/4b7932d8-b781-4db7-a1c5-791ce8d1d866/disk 1073741824 {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:56:25 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-b2bbe6b4-20e2-4cea-b348-e5a3b250c76b tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3,backing_fmt=raw /opt/stack/data/nova/instances/4b7932d8-b781-4db7-a1c5-791ce8d1d866/disk 1073741824" returned: 0 in 0.056s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:56:25 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b2bbe6b4-20e2-4cea-b348-e5a3b250c76b tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Lock "7e267a577c062ee862e95ede6b48cfd5632f3ea3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.284s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:56:25 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-b2bbe6b4-20e2-4cea-b348-e5a3b250c76b tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:56:25 user nova-compute[73449]: DEBUG nova.network.neutron [None req-b2bbe6b4-20e2-4cea-b348-e5a3b250c76b tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] Successfully created port: dbd5bb98-0410-4179-a99a-9181d85357ea {{(pid=73449) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 11:56:25 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-b2bbe6b4-20e2-4cea-b348-e5a3b250c76b tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json" returned: 0 in 0.193s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:56:25 user nova-compute[73449]: DEBUG nova.virt.disk.api [None req-b2bbe6b4-20e2-4cea-b348-e5a3b250c76b tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4b7932d8-b781-4db7-a1c5-791ce8d1d866/disk. size=1073741824 {{(pid=73449) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 11:56:25 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-b2bbe6b4-20e2-4cea-b348-e5a3b250c76b tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b7932d8-b781-4db7-a1c5-791ce8d1d866/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:56:25 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-b2bbe6b4-20e2-4cea-b348-e5a3b250c76b tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b7932d8-b781-4db7-a1c5-791ce8d1d866/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:56:25 user nova-compute[73449]: DEBUG nova.virt.disk.api [None req-b2bbe6b4-20e2-4cea-b348-e5a3b250c76b tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Cannot resize image /opt/stack/data/nova/instances/4b7932d8-b781-4db7-a1c5-791ce8d1d866/disk to a smaller size. {{(pid=73449) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 11:56:25 user nova-compute[73449]: DEBUG nova.objects.instance [None req-b2bbe6b4-20e2-4cea-b348-e5a3b250c76b tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Lazy-loading 'migration_context' on Instance uuid 4b7932d8-b781-4db7-a1c5-791ce8d1d866 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:56:25 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b2bbe6b4-20e2-4cea-b348-e5a3b250c76b tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] Created local disks {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 11:56:25 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b2bbe6b4-20e2-4cea-b348-e5a3b250c76b tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] Ensure instance console log exists: /opt/stack/data/nova/instances/4b7932d8-b781-4db7-a1c5-791ce8d1d866/console.log {{(pid=73449) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 11:56:25 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b2bbe6b4-20e2-4cea-b348-e5a3b250c76b tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:56:25 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b2bbe6b4-20e2-4cea-b348-e5a3b250c76b tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:56:25 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b2bbe6b4-20e2-4cea-b348-e5a3b250c76b tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:56:26 user nova-compute[73449]: DEBUG nova.network.neutron [None req-b2bbe6b4-20e2-4cea-b348-e5a3b250c76b tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] Successfully updated port: dbd5bb98-0410-4179-a99a-9181d85357ea {{(pid=73449) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 11:56:26 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b2bbe6b4-20e2-4cea-b348-e5a3b250c76b tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Acquiring lock "refresh_cache-4b7932d8-b781-4db7-a1c5-791ce8d1d866" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:56:26 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b2bbe6b4-20e2-4cea-b348-e5a3b250c76b tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Acquired lock "refresh_cache-4b7932d8-b781-4db7-a1c5-791ce8d1d866" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:56:26 user nova-compute[73449]: DEBUG nova.network.neutron [None req-b2bbe6b4-20e2-4cea-b348-e5a3b250c76b tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] Building network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 11:56:26 user nova-compute[73449]: DEBUG nova.compute.manager [req-e0584669-775d-4af3-8a07-27648d8710bf req-8826ca87-3513-43ec-8094-e5beb2a9ebec service nova] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] Received event network-changed-dbd5bb98-0410-4179-a99a-9181d85357ea {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:56:26 user nova-compute[73449]: DEBUG nova.compute.manager [req-e0584669-775d-4af3-8a07-27648d8710bf req-8826ca87-3513-43ec-8094-e5beb2a9ebec service nova] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] Refreshing instance network info cache due to event network-changed-dbd5bb98-0410-4179-a99a-9181d85357ea. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 11:56:26 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-e0584669-775d-4af3-8a07-27648d8710bf req-8826ca87-3513-43ec-8094-e5beb2a9ebec service nova] Acquiring lock "refresh_cache-4b7932d8-b781-4db7-a1c5-791ce8d1d866" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:56:26 user nova-compute[73449]: DEBUG nova.network.neutron [None req-b2bbe6b4-20e2-4cea-b348-e5a3b250c76b tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] Instance cache missing network info. {{(pid=73449) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 11:56:27 user nova-compute[73449]: DEBUG nova.network.neutron [None req-b2bbe6b4-20e2-4cea-b348-e5a3b250c76b tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] Updating instance_info_cache with network_info: [{"id": "dbd5bb98-0410-4179-a99a-9181d85357ea", "address": "fa:16:3e:5d:b1:0e", "network": {"id": "d56bc428-6be6-4aa9-b43c-9d4a0f1dd83b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-791364634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe7b5fee01a042bb90e40b18a84c82c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbd5bb98-04", "ovs_interfaceid": "dbd5bb98-0410-4179-a99a-9181d85357ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:56:27 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b2bbe6b4-20e2-4cea-b348-e5a3b250c76b tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Releasing lock "refresh_cache-4b7932d8-b781-4db7-a1c5-791ce8d1d866" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:56:27 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b2bbe6b4-20e2-4cea-b348-e5a3b250c76b tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] Instance network_info: |[{"id": "dbd5bb98-0410-4179-a99a-9181d85357ea", "address": "fa:16:3e:5d:b1:0e", "network": {"id": "d56bc428-6be6-4aa9-b43c-9d4a0f1dd83b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-791364634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe7b5fee01a042bb90e40b18a84c82c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbd5bb98-04", "ovs_interfaceid": "dbd5bb98-0410-4179-a99a-9181d85357ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73449) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 11:56:27 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-e0584669-775d-4af3-8a07-27648d8710bf req-8826ca87-3513-43ec-8094-e5beb2a9ebec service nova] Acquired lock "refresh_cache-4b7932d8-b781-4db7-a1c5-791ce8d1d866" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:56:27 user nova-compute[73449]: DEBUG nova.network.neutron [req-e0584669-775d-4af3-8a07-27648d8710bf req-8826ca87-3513-43ec-8094-e5beb2a9ebec service nova] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] Refreshing network info cache for port dbd5bb98-0410-4179-a99a-9181d85357ea {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 11:56:27 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b2bbe6b4-20e2-4cea-b348-e5a3b250c76b tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] Start _get_guest_xml network_info=[{"id": "dbd5bb98-0410-4179-a99a-9181d85357ea", "address": "fa:16:3e:5d:b1:0e", "network": {"id": "d56bc428-6be6-4aa9-b43c-9d4a0f1dd83b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-791364634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe7b5fee01a042bb90e40b18a84c82c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbd5bb98-04", "ovs_interfaceid": "dbd5bb98-0410-4179-a99a-9181d85357ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T11:36:11Z,direct_url=<?>,disk_format='qcow2',id=0a2904ae-083d-41c8-83db-343132b36148,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7a77880136a54ef195c82e018e1939db',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T11:36:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': '0a2904ae-083d-41c8-83db-343132b36148'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 11:56:27 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-b2bbe6b4-20e2-4cea-b348-e5a3b250c76b tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:56:27 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-b2bbe6b4-20e2-4cea-b348-e5a3b250c76b tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:56:27 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-b2bbe6b4-20e2-4cea-b348-e5a3b250c76b tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 11:56:27 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-b2bbe6b4-20e2-4cea-b348-e5a3b250c76b tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] CPU controller missing on host. {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 11:56:27 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-b2bbe6b4-20e2-4cea-b348-e5a3b250c76b tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 11:56:27 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-b2bbe6b4-20e2-4cea-b348-e5a3b250c76b tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] CPU controller found on host. {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 11:56:27 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b2bbe6b4-20e2-4cea-b348-e5a3b250c76b tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73449) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 11:56:27 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-b2bbe6b4-20e2-4cea-b348-e5a3b250c76b tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T11:35:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T11:36:11Z,direct_url=<?>,disk_format='qcow2',id=0a2904ae-083d-41c8-83db-343132b36148,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7a77880136a54ef195c82e018e1939db',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T11:36:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 11:56:27 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-b2bbe6b4-20e2-4cea-b348-e5a3b250c76b tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Flavor limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 11:56:27 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-b2bbe6b4-20e2-4cea-b348-e5a3b250c76b tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Image limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 11:56:27 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-b2bbe6b4-20e2-4cea-b348-e5a3b250c76b tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Flavor pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 11:56:27 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-b2bbe6b4-20e2-4cea-b348-e5a3b250c76b tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Image pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 11:56:27 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-b2bbe6b4-20e2-4cea-b348-e5a3b250c76b tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 11:56:27 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-b2bbe6b4-20e2-4cea-b348-e5a3b250c76b tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 11:56:27 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-b2bbe6b4-20e2-4cea-b348-e5a3b250c76b tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 11:56:27 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-b2bbe6b4-20e2-4cea-b348-e5a3b250c76b tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Got 1 possible topologies {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 11:56:27 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-b2bbe6b4-20e2-4cea-b348-e5a3b250c76b tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 11:56:27 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-b2bbe6b4-20e2-4cea-b348-e5a3b250c76b tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 11:56:27 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-b2bbe6b4-20e2-4cea-b348-e5a3b250c76b tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:56:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-446672586',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-446672586',id=36,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEcw8l18SWbf1308kGLuQ4b06ysMjia3rEhaF6dU6vjJM/VmZBqAPQDr1yByzmcI8Lvjfcj9Fi6T/YyvGoW/3wLJuwBD8/OatBnsq63e8/jV0cJ+5SDnDrf0ZUEjihC93A==',key_name='tempest-keypair-279437617',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fe7b5fee01a042bb90e40b18a84c82c0',ramdisk_id='',reservation_id='r-ehpbpdxe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-2080997856',owner_user_name='tempest-AttachVolumeShelveTestJSON-2080997856-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T11:56:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='17ee7be9cdb14c5ca211a6b0bb80ccc1',uuid=4b7932d8-b781-4db7-a1c5-791ce8d1d866,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dbd5bb98-0410-4179-a99a-9181d85357ea", "address": "fa:16:3e:5d:b1:0e", "network": {"id": "d56bc428-6be6-4aa9-b43c-9d4a0f1dd83b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-791364634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe7b5fee01a042bb90e40b18a84c82c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbd5bb98-04", "ovs_interfaceid": "dbd5bb98-0410-4179-a99a-9181d85357ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73449) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 11:56:27 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-b2bbe6b4-20e2-4cea-b348-e5a3b250c76b tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Converting VIF {"id": "dbd5bb98-0410-4179-a99a-9181d85357ea", "address": "fa:16:3e:5d:b1:0e", "network": {"id": "d56bc428-6be6-4aa9-b43c-9d4a0f1dd83b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-791364634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe7b5fee01a042bb90e40b18a84c82c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbd5bb98-04", "ovs_interfaceid": "dbd5bb98-0410-4179-a99a-9181d85357ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:56:27 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-b2bbe6b4-20e2-4cea-b348-e5a3b250c76b tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:b1:0e,bridge_name='br-int',has_traffic_filtering=True,id=dbd5bb98-0410-4179-a99a-9181d85357ea,network=Network(d56bc428-6be6-4aa9-b43c-9d4a0f1dd83b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbd5bb98-04') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:56:27 user nova-compute[73449]: DEBUG nova.objects.instance [None req-b2bbe6b4-20e2-4cea-b348-e5a3b250c76b tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Lazy-loading 'pci_devices' on Instance uuid 4b7932d8-b781-4db7-a1c5-791ce8d1d866 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:56:27 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b2bbe6b4-20e2-4cea-b348-e5a3b250c76b tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] End _get_guest_xml xml=<domain type="kvm">
Aug 17 11:56:27 user nova-compute[73449]:   <uuid>4b7932d8-b781-4db7-a1c5-791ce8d1d866</uuid>
Aug 17 11:56:27 user nova-compute[73449]:   <name>instance-00000024</name>
Aug 17 11:56:27 user nova-compute[73449]:   <memory>524288</memory>
Aug 17 11:56:27 user nova-compute[73449]:   <vcpu>1</vcpu>
Aug 17 11:56:27 user nova-compute[73449]:   <metadata>
Aug 17 11:56:27 user nova-compute[73449]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 11:56:27 user nova-compute[73449]:       <nova:package version="0.0.0"/>
Aug 17 11:56:27 user nova-compute[73449]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-446672586</nova:name>
Aug 17 11:56:27 user nova-compute[73449]:       <nova:creationTime>2023-08-17 11:56:27</nova:creationTime>
Aug 17 11:56:27 user nova-compute[73449]:       <nova:flavor name="m1.tiny">
Aug 17 11:56:27 user nova-compute[73449]:         <nova:memory>512</nova:memory>
Aug 17 11:56:27 user nova-compute[73449]:         <nova:disk>1</nova:disk>
Aug 17 11:56:27 user nova-compute[73449]:         <nova:swap>0</nova:swap>
Aug 17 11:56:27 user nova-compute[73449]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 11:56:27 user nova-compute[73449]:         <nova:vcpus>1</nova:vcpus>
Aug 17 11:56:27 user nova-compute[73449]:       </nova:flavor>
Aug 17 11:56:27 user nova-compute[73449]:       <nova:owner>
Aug 17 11:56:27 user nova-compute[73449]:         <nova:user uuid="17ee7be9cdb14c5ca211a6b0bb80ccc1">tempest-AttachVolumeShelveTestJSON-2080997856-project-member</nova:user>
Aug 17 11:56:27 user nova-compute[73449]:         <nova:project uuid="fe7b5fee01a042bb90e40b18a84c82c0">tempest-AttachVolumeShelveTestJSON-2080997856</nova:project>
Aug 17 11:56:27 user nova-compute[73449]:       </nova:owner>
Aug 17 11:56:27 user nova-compute[73449]:       <nova:root type="image" uuid="0a2904ae-083d-41c8-83db-343132b36148"/>
Aug 17 11:56:27 user nova-compute[73449]:       <nova:ports>
Aug 17 11:56:27 user nova-compute[73449]:         <nova:port uuid="dbd5bb98-0410-4179-a99a-9181d85357ea">
Aug 17 11:56:27 user nova-compute[73449]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 17 11:56:27 user nova-compute[73449]:         </nova:port>
Aug 17 11:56:27 user nova-compute[73449]:       </nova:ports>
Aug 17 11:56:27 user nova-compute[73449]:     </nova:instance>
Aug 17 11:56:27 user nova-compute[73449]:   </metadata>
Aug 17 11:56:27 user nova-compute[73449]:   <sysinfo type="smbios">
Aug 17 11:56:27 user nova-compute[73449]:     <system>
Aug 17 11:56:27 user nova-compute[73449]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 11:56:27 user nova-compute[73449]:       <entry name="product">OpenStack Nova</entry>
Aug 17 11:56:27 user nova-compute[73449]:       <entry name="version">0.0.0</entry>
Aug 17 11:56:27 user nova-compute[73449]:       <entry name="serial">4b7932d8-b781-4db7-a1c5-791ce8d1d866</entry>
Aug 17 11:56:27 user nova-compute[73449]:       <entry name="uuid">4b7932d8-b781-4db7-a1c5-791ce8d1d866</entry>
Aug 17 11:56:27 user nova-compute[73449]:       <entry name="family">Virtual Machine</entry>
Aug 17 11:56:27 user nova-compute[73449]:     </system>
Aug 17 11:56:27 user nova-compute[73449]:   </sysinfo>
Aug 17 11:56:27 user nova-compute[73449]:   <os>
Aug 17 11:56:27 user nova-compute[73449]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 11:56:27 user nova-compute[73449]:     <boot dev="hd"/>
Aug 17 11:56:27 user nova-compute[73449]:     <smbios mode="sysinfo"/>
Aug 17 11:56:27 user nova-compute[73449]:   </os>
Aug 17 11:56:27 user nova-compute[73449]:   <features>
Aug 17 11:56:27 user nova-compute[73449]:     <acpi/>
Aug 17 11:56:27 user nova-compute[73449]:     <apic/>
Aug 17 11:56:27 user nova-compute[73449]:     <vmcoreinfo/>
Aug 17 11:56:27 user nova-compute[73449]:   </features>
Aug 17 11:56:27 user nova-compute[73449]:   <clock offset="utc">
Aug 17 11:56:27 user nova-compute[73449]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 11:56:27 user nova-compute[73449]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 11:56:27 user nova-compute[73449]:     <timer name="hpet" present="no"/>
Aug 17 11:56:27 user nova-compute[73449]:   </clock>
Aug 17 11:56:27 user nova-compute[73449]:   <cpu mode="custom" match="exact">
Aug 17 11:56:27 user nova-compute[73449]:     <model>Nehalem</model>
Aug 17 11:56:27 user nova-compute[73449]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 11:56:27 user nova-compute[73449]:   </cpu>
Aug 17 11:56:27 user nova-compute[73449]:   <devices>
Aug 17 11:56:27 user nova-compute[73449]:     <disk type="file" device="disk">
Aug 17 11:56:27 user nova-compute[73449]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 11:56:27 user nova-compute[73449]:       <source file="/opt/stack/data/nova/instances/4b7932d8-b781-4db7-a1c5-791ce8d1d866/disk"/>
Aug 17 11:56:27 user nova-compute[73449]:       <target dev="vda" bus="virtio"/>
Aug 17 11:56:27 user nova-compute[73449]:     </disk>
Aug 17 11:56:27 user nova-compute[73449]:     <interface type="ethernet">
Aug 17 11:56:27 user nova-compute[73449]:       <mac address="fa:16:3e:5d:b1:0e"/>
Aug 17 11:56:27 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 11:56:27 user nova-compute[73449]:       <mtu size="1442"/>
Aug 17 11:56:27 user nova-compute[73449]:       <target dev="tapdbd5bb98-04"/>
Aug 17 11:56:27 user nova-compute[73449]:     </interface>
Aug 17 11:56:27 user nova-compute[73449]:     <serial type="pty">
Aug 17 11:56:27 user nova-compute[73449]:       <log file="/opt/stack/data/nova/instances/4b7932d8-b781-4db7-a1c5-791ce8d1d866/console.log" append="off"/>
Aug 17 11:56:27 user nova-compute[73449]:     </serial>
Aug 17 11:56:27 user nova-compute[73449]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 11:56:27 user nova-compute[73449]:     <video>
Aug 17 11:56:27 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 11:56:27 user nova-compute[73449]:     </video>
Aug 17 11:56:27 user nova-compute[73449]:     <rng model="virtio">
Aug 17 11:56:27 user nova-compute[73449]:       <backend model="random">/dev/urandom</backend>
Aug 17 11:56:27 user nova-compute[73449]:     </rng>
Aug 17 11:56:27 user nova-compute[73449]:     <controller type="usb" index="0" model="none"/>
Aug 17 11:56:27 user nova-compute[73449]:     <memballoon model="virtio">
Aug 17 11:56:27 user nova-compute[73449]:       <stats period="10"/>
Aug 17 11:56:27 user nova-compute[73449]:     </memballoon>
Aug 17 11:56:27 user nova-compute[73449]:   </devices>
Aug 17 11:56:27 user nova-compute[73449]: </domain>
Aug 17 11:56:27 user nova-compute[73449]:  {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 11:56:27 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-b2bbe6b4-20e2-4cea-b348-e5a3b250c76b tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:56:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-446672586',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-446672586',id=36,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEcw8l18SWbf1308kGLuQ4b06ysMjia3rEhaF6dU6vjJM/VmZBqAPQDr1yByzmcI8Lvjfcj9Fi6T/YyvGoW/3wLJuwBD8/OatBnsq63e8/jV0cJ+5SDnDrf0ZUEjihC93A==',key_name='tempest-keypair-279437617',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fe7b5fee01a042bb90e40b18a84c82c0',ramdisk_id='',reservation_id='r-ehpbpdxe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-2080997856',owner_user_name='tempest-AttachVolumeShelveTestJSON-2080997856-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T11:56:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='17ee7be9cdb14c5ca211a6b0bb80ccc1',uuid=4b7932d8-b781-4db7-a1c5-791ce8d1d866,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dbd5bb98-0410-4179-a99a-9181d85357ea", "address": "fa:16:3e:5d:b1:0e", "network": {"id": "d56bc428-6be6-4aa9-b43c-9d4a0f1dd83b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-791364634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe7b5fee01a042bb90e40b18a84c82c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbd5bb98-04", "ovs_interfaceid": "dbd5bb98-0410-4179-a99a-9181d85357ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 11:56:27 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-b2bbe6b4-20e2-4cea-b348-e5a3b250c76b tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Converting VIF {"id": "dbd5bb98-0410-4179-a99a-9181d85357ea", "address": "fa:16:3e:5d:b1:0e", "network": {"id": "d56bc428-6be6-4aa9-b43c-9d4a0f1dd83b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-791364634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe7b5fee01a042bb90e40b18a84c82c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbd5bb98-04", "ovs_interfaceid": "dbd5bb98-0410-4179-a99a-9181d85357ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:56:27 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-b2bbe6b4-20e2-4cea-b348-e5a3b250c76b tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:b1:0e,bridge_name='br-int',has_traffic_filtering=True,id=dbd5bb98-0410-4179-a99a-9181d85357ea,network=Network(d56bc428-6be6-4aa9-b43c-9d4a0f1dd83b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbd5bb98-04') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:56:27 user nova-compute[73449]: DEBUG os_vif [None req-b2bbe6b4-20e2-4cea-b348-e5a3b250c76b tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:b1:0e,bridge_name='br-int',has_traffic_filtering=True,id=dbd5bb98-0410-4179-a99a-9181d85357ea,network=Network(d56bc428-6be6-4aa9-b43c-9d4a0f1dd83b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbd5bb98-04') {{(pid=73449) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 11:56:27 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:56:27 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:56:27 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 11:56:27 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:56:27 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdbd5bb98-04, may_exist=True, interface_attrs={}) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:56:27 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdbd5bb98-04, col_values=(('external_ids', {'iface-id': 'dbd5bb98-0410-4179-a99a-9181d85357ea', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5d:b1:0e', 'vm-uuid': '4b7932d8-b781-4db7-a1c5-791ce8d1d866'}),), if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:56:27 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:56:27 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:56:27 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:56:27 user nova-compute[73449]: INFO os_vif [None req-b2bbe6b4-20e2-4cea-b348-e5a3b250c76b tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:b1:0e,bridge_name='br-int',has_traffic_filtering=True,id=dbd5bb98-0410-4179-a99a-9181d85357ea,network=Network(d56bc428-6be6-4aa9-b43c-9d4a0f1dd83b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbd5bb98-04')
Aug 17 11:56:27 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b2bbe6b4-20e2-4cea-b348-e5a3b250c76b tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] No BDM found with device name vda, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 11:56:27 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b2bbe6b4-20e2-4cea-b348-e5a3b250c76b tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] No VIF found with MAC fa:16:3e:5d:b1:0e, not building metadata {{(pid=73449) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 11:56:27 user nova-compute[73449]: DEBUG nova.network.neutron [req-e0584669-775d-4af3-8a07-27648d8710bf req-8826ca87-3513-43ec-8094-e5beb2a9ebec service nova] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] Updated VIF entry in instance network info cache for port dbd5bb98-0410-4179-a99a-9181d85357ea. {{(pid=73449) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 11:56:27 user nova-compute[73449]: DEBUG nova.network.neutron [req-e0584669-775d-4af3-8a07-27648d8710bf req-8826ca87-3513-43ec-8094-e5beb2a9ebec service nova] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] Updating instance_info_cache with network_info: [{"id": "dbd5bb98-0410-4179-a99a-9181d85357ea", "address": "fa:16:3e:5d:b1:0e", "network": {"id": "d56bc428-6be6-4aa9-b43c-9d4a0f1dd83b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-791364634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe7b5fee01a042bb90e40b18a84c82c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbd5bb98-04", "ovs_interfaceid": "dbd5bb98-0410-4179-a99a-9181d85357ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:56:27 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-e0584669-775d-4af3-8a07-27648d8710bf req-8826ca87-3513-43ec-8094-e5beb2a9ebec service nova] Releasing lock "refresh_cache-4b7932d8-b781-4db7-a1c5-791ce8d1d866" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:56:28 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:56:28 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:56:28 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:56:28 user nova-compute[73449]: DEBUG nova.compute.manager [req-f38162e3-a36e-4491-b320-a153471d14c7 req-6028b8ff-af24-4a71-b219-ea8a6056d6de service nova] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] Received event network-vif-plugged-dbd5bb98-0410-4179-a99a-9181d85357ea {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:56:28 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-f38162e3-a36e-4491-b320-a153471d14c7 req-6028b8ff-af24-4a71-b219-ea8a6056d6de service nova] Acquiring lock "4b7932d8-b781-4db7-a1c5-791ce8d1d866-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:56:28 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-f38162e3-a36e-4491-b320-a153471d14c7 req-6028b8ff-af24-4a71-b219-ea8a6056d6de service nova] Lock "4b7932d8-b781-4db7-a1c5-791ce8d1d866-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:56:28 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-f38162e3-a36e-4491-b320-a153471d14c7 req-6028b8ff-af24-4a71-b219-ea8a6056d6de service nova] Lock "4b7932d8-b781-4db7-a1c5-791ce8d1d866-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:56:28 user nova-compute[73449]: DEBUG nova.compute.manager [req-f38162e3-a36e-4491-b320-a153471d14c7 req-6028b8ff-af24-4a71-b219-ea8a6056d6de service nova] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] No waiting events found dispatching network-vif-plugged-dbd5bb98-0410-4179-a99a-9181d85357ea {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:56:28 user nova-compute[73449]: WARNING nova.compute.manager [req-f38162e3-a36e-4491-b320-a153471d14c7 req-6028b8ff-af24-4a71-b219-ea8a6056d6de service nova] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] Received unexpected event network-vif-plugged-dbd5bb98-0410-4179-a99a-9181d85357ea for instance with vm_state building and task_state spawning.
Aug 17 11:56:29 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:56:29 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:56:29 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:56:29 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:56:30 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692273390.8949962, 4b7932d8-b781-4db7-a1c5-791ce8d1d866 => Resumed> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:56:30 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] VM Resumed (Lifecycle Event)
Aug 17 11:56:30 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b2bbe6b4-20e2-4cea-b348-e5a3b250c76b tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] Instance event wait completed in 0 seconds for  {{(pid=73449) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 11:56:30 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b2bbe6b4-20e2-4cea-b348-e5a3b250c76b tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] Guest created on hypervisor {{(pid=73449) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 11:56:30 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] Instance spawned successfully.
Aug 17 11:56:30 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b2bbe6b4-20e2-4cea-b348-e5a3b250c76b tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 11:56:30 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:56:30 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 11:56:30 user nova-compute[73449]: DEBUG nova.compute.manager [req-920935b8-d7e0-42fe-b8c7-7a8c262bff5a req-d67623fe-84f7-4730-a8b9-421214878107 service nova] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] Received event network-vif-plugged-dbd5bb98-0410-4179-a99a-9181d85357ea {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:56:30 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-920935b8-d7e0-42fe-b8c7-7a8c262bff5a req-d67623fe-84f7-4730-a8b9-421214878107 service nova] Acquiring lock "4b7932d8-b781-4db7-a1c5-791ce8d1d866-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:56:30 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-920935b8-d7e0-42fe-b8c7-7a8c262bff5a req-d67623fe-84f7-4730-a8b9-421214878107 service nova] Lock "4b7932d8-b781-4db7-a1c5-791ce8d1d866-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:56:30 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-920935b8-d7e0-42fe-b8c7-7a8c262bff5a req-d67623fe-84f7-4730-a8b9-421214878107 service nova] Lock "4b7932d8-b781-4db7-a1c5-791ce8d1d866-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:56:30 user nova-compute[73449]: DEBUG nova.compute.manager [req-920935b8-d7e0-42fe-b8c7-7a8c262bff5a req-d67623fe-84f7-4730-a8b9-421214878107 service nova] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] No waiting events found dispatching network-vif-plugged-dbd5bb98-0410-4179-a99a-9181d85357ea {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:56:30 user nova-compute[73449]: WARNING nova.compute.manager [req-920935b8-d7e0-42fe-b8c7-7a8c262bff5a req-d67623fe-84f7-4730-a8b9-421214878107 service nova] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] Received unexpected event network-vif-plugged-dbd5bb98-0410-4179-a99a-9181d85357ea for instance with vm_state building and task_state spawning.
Aug 17 11:56:30 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b2bbe6b4-20e2-4cea-b348-e5a3b250c76b tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] Found default for hw_cdrom_bus of ide {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:56:30 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b2bbe6b4-20e2-4cea-b348-e5a3b250c76b tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] Found default for hw_disk_bus of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:56:30 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b2bbe6b4-20e2-4cea-b348-e5a3b250c76b tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] Found default for hw_input_bus of None {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:56:30 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b2bbe6b4-20e2-4cea-b348-e5a3b250c76b tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] Found default for hw_pointer_model of None {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:56:30 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b2bbe6b4-20e2-4cea-b348-e5a3b250c76b tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] Found default for hw_video_model of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:56:30 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b2bbe6b4-20e2-4cea-b348-e5a3b250c76b tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] Found default for hw_vif_model of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:56:30 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 11:56:30 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692273390.89878, 4b7932d8-b781-4db7-a1c5-791ce8d1d866 => Started> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:56:30 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] VM Started (Lifecycle Event)
Aug 17 11:56:30 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:56:30 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 11:56:31 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 11:56:31 user nova-compute[73449]: INFO nova.compute.manager [None req-b2bbe6b4-20e2-4cea-b348-e5a3b250c76b tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] Took 6.00 seconds to spawn the instance on the hypervisor.
Aug 17 11:56:31 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b2bbe6b4-20e2-4cea-b348-e5a3b250c76b tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:56:31 user nova-compute[73449]: INFO nova.compute.manager [None req-b2bbe6b4-20e2-4cea-b348-e5a3b250c76b tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] Took 6.92 seconds to build instance.
Aug 17 11:56:31 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b2bbe6b4-20e2-4cea-b348-e5a3b250c76b tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Lock "4b7932d8-b781-4db7-a1c5-791ce8d1d866" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.031s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:56:32 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:56:33 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:56:33 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-585dfd5f-16e2-4bf1-95b3-71567a34a45e tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Calling os-brick to attach iSCSI Volume {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 11:56:33 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-585dfd5f-16e2-4bf1-95b3-71567a34a45e tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6e360063-8525-4d62-8fa0-33c5062fc247'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rosCbiyz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 11:56:33 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-585dfd5f-16e2-4bf1-95b3-71567a34a45e tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 11:56:33 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-585dfd5f-16e2-4bf1-95b3-71567a34a45e tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:56:33 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-585dfd5f-16e2-4bf1-95b3-71567a34a45e tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:56:33 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-585dfd5f-16e2-4bf1-95b3-71567a34a45e tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 11:56:33 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-585dfd5f-16e2-4bf1-95b3-71567a34a45e tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e360063-8525-4d62-8fa0-33c5062fc247" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:56:33 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-585dfd5f-16e2-4bf1-95b3-71567a34a45e tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e360063-8525-4d62-8fa0-33c5062fc247" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:56:33 user nova-compute[73449]: INFO os_brick.initiator.connectors.iscsi [None req-585dfd5f-16e2-4bf1-95b3-71567a34a45e tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 11:56:33 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e360063-8525-4d62-8fa0-33c5062fc247 -p 172.16.0.220:3260 {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:56:33 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e360063-8525-4d62-8fa0-33c5062fc247 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:56:33 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[868a56bd-bbe8-47cf-a0da-46f18d34eb42]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:56:33 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-585dfd5f-16e2-4bf1-95b3-71567a34a45e tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 11:56:33 user nova-compute[73449]:  {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:56:33 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e360063-8525-4d62-8fa0-33c5062fc247 -p 172.16.0.220:3260 --interface default --op new {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:56:33 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e360063-8525-4d62-8fa0-33c5062fc247 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:56:33 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[868f44c9-d9b5-40e2-ae44-6b3a9c3c119b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6e360063-8525-4d62-8fa0-33c5062fc247] added\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:56:33 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-585dfd5f-16e2-4bf1-95b3-71567a34a45e tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6e360063-8525-4d62-8fa0-33c5062fc247] added
Aug 17 11:56:33 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:56:33 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e360063-8525-4d62-8fa0-33c5062fc247 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:56:33 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e360063-8525-4d62-8fa0-33c5062fc247 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:56:33 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[23a28856-a9ec-4bb0-84be-cd95b7cbbdac]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:56:33 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-585dfd5f-16e2-4bf1-95b3-71567a34a45e tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:56:33 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e360063-8525-4d62-8fa0-33c5062fc247 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:56:33 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e360063-8525-4d62-8fa0-33c5062fc247 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:56:33 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[0756dd52-a930-4fcd-9437-96fd4a0caedb]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:56:33 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-585dfd5f-16e2-4bf1-95b3-71567a34a45e tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:56:33 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e360063-8525-4d62-8fa0-33c5062fc247 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rosCbiyz {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:56:33 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e360063-8525-4d62-8fa0-33c5062fc247 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rosCbiyz" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:56:33 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0167a2b-a191-4cea-a9fe-3a87b486ea48]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:56:33 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-585dfd5f-16e2-4bf1-95b3-71567a34a45e tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rosCbiyz'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:56:33 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e360063-8525-4d62-8fa0-33c5062fc247 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:56:33 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e360063-8525-4d62-8fa0-33c5062fc247 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.032s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:56:33 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aef89f5-9308-45ba-aa24-3f27a46caec0]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:56:33 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-585dfd5f-16e2-4bf1-95b3-71567a34a45e tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:56:33 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:56:33 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:56:33 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5d0c01b-4648-4231-93f8-e19bd0641ce8]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:56:33 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-585dfd5f-16e2-4bf1-95b3-71567a34a45e tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)
Aug 17 11:56:33 user nova-compute[73449]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 (non-flash)
Aug 17 11:56:33 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:56:33 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-585dfd5f-16e2-4bf1-95b3-71567a34a45e tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)
Aug 17 11:56:33 user nova-compute[73449]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 (non-flash)
Aug 17 11:56:33 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:56:33 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e360063-8525-4d62-8fa0-33c5062fc247 -p 172.16.0.220:3260 --login {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:56:34 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e360063-8525-4d62-8fa0-33c5062fc247 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:56:34 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[00a07017-467d-42df-ad2c-59d1615a8d22]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6e360063-8525-4d62-8fa0-33c5062fc247, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6e360063-8525-4d62-8fa0-33c5062fc247, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:56:34 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-585dfd5f-16e2-4bf1-95b3-71567a34a45e tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6e360063-8525-4d62-8fa0-33c5062fc247, portal: 172.16.0.220,3260]
Aug 17 11:56:34 user nova-compute[73449]: Login to [iface: default, target: iqn.2010-10.org.openstack:6e360063-8525-4d62-8fa0-33c5062fc247, portal: 172.16.0.220,3260] successful.
Aug 17 11:56:34 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:56:34 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e360063-8525-4d62-8fa0-33c5062fc247 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:56:34 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e360063-8525-4d62-8fa0-33c5062fc247 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:56:34 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[924e02f9-a838-4df0-89be-c3b504c598f4]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:56:34 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-585dfd5f-16e2-4bf1-95b3-71567a34a45e tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:56:34 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:56:34 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:56:34 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[87386920-23a7-4dfc-8342-9316e95cc9aa]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e360063-8525-4d62-8fa0-33c5062fc247 (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:56:34 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-585dfd5f-16e2-4bf1-95b3-71567a34a45e tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)
Aug 17 11:56:34 user nova-compute[73449]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 (non-flash)
Aug 17 11:56:34 user nova-compute[73449]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e360063-8525-4d62-8fa0-33c5062fc247 (non-flash)
Aug 17 11:56:34 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:56:34 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-585dfd5f-16e2-4bf1-95b3-71567a34a45e tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)
Aug 17 11:56:34 user nova-compute[73449]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 (non-flash)
Aug 17 11:56:34 user nova-compute[73449]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e360063-8525-4d62-8fa0-33c5062fc247 (non-flash)
Aug 17 11:56:34 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:56:34 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-585dfd5f-16e2-4bf1-95b3-71567a34a45e tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e360063-8525-4d62-8fa0-33c5062fc247" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:56:34 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-585dfd5f-16e2-4bf1-95b3-71567a34a45e tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Connected to 172.16.0.220:3260 {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 11:56:34 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-585dfd5f-16e2-4bf1-95b3-71567a34a45e tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] HCTL ('33', '-', '-', 0) found on session 42 with lun 0 {{(pid=73449) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 11:56:34 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-585dfd5f-16e2-4bf1-95b3-71567a34a45e tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73449) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 11:56:34 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:56:34 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:56:34 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[89a769db-fc9f-450e-9103-b40657b6aeef]: (4, ('- - 0', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:56:34 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-585dfd5f-16e2-4bf1-95b3-71567a34a45e tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Searching for a device in session 42 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73449) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 11:56:34 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-585dfd5f-16e2-4bf1-95b3-71567a34a45e tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rosCbiyz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 11:56:34 user nova-compute[73449]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692273379.9320333, 1542e090-dffe-47d1-8bf1-bb0361cfba34 => Stopped> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:56:34 user nova-compute[73449]: INFO nova.compute.manager [-] [instance: 1542e090-dffe-47d1-8bf1-bb0361cfba34] VM Stopped (Lifecycle Event)
Aug 17 11:56:34 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6a8c64d4-bef7-4c83-9486-0a1670a0abf2 None None] [instance: 1542e090-dffe-47d1-8bf1-bb0361cfba34] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:56:35 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-585dfd5f-16e2-4bf1-95b3-71567a34a45e tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.329s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:56:35 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-585dfd5f-16e2-4bf1-95b3-71567a34a45e tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] <== connect_volume: return (1330ms) {'type': 'block', 'scsi_wwn': '23263313836376636', 'path': '/dev/sdb'} {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 11:56:35 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-585dfd5f-16e2-4bf1-95b3-71567a34a45e tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23263313836376636', 'path': '/dev/sdb'} {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 11:56:35 user nova-compute[73449]: DEBUG nova.objects.instance [None req-585dfd5f-16e2-4bf1-95b3-71567a34a45e tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Lazy-loading 'flavor' on Instance uuid 042713b8-ab7f-4c14-92e5-f830ccb7e341 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:56:35 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-585dfd5f-16e2-4bf1-95b3-71567a34a45e tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 11:56:35 user nova-compute[73449]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 11:56:35 user nova-compute[73449]:   <source dev="/dev/sdb"/>
Aug 17 11:56:35 user nova-compute[73449]:   <target dev="vdb" bus="virtio"/>
Aug 17 11:56:35 user nova-compute[73449]:   <serial>6e360063-8525-4d62-8fa0-33c5062fc247</serial>
Aug 17 11:56:35 user nova-compute[73449]: </disk>
Aug 17 11:56:35 user nova-compute[73449]:  {{(pid=73449) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 11:56:35 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-585dfd5f-16e2-4bf1-95b3-71567a34a45e tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] No BDM found with device name vda, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 11:56:35 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-585dfd5f-16e2-4bf1-95b3-71567a34a45e tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 11:56:35 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-585dfd5f-16e2-4bf1-95b3-71567a34a45e tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] No VIF found with MAC fa:16:3e:f5:89:a9, not building metadata {{(pid=73449) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 11:56:35 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-585dfd5f-16e2-4bf1-95b3-71567a34a45e tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Lock "042713b8-ab7f-4c14-92e5-f830ccb7e341" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.559s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:56:36 user nova-compute[73449]: INFO nova.compute.manager [None req-7b3fadc6-648e-48c8-a474-d1c294958a3c tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Rescuing
Aug 17 11:56:36 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-7b3fadc6-648e-48c8-a474-d1c294958a3c tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Acquiring lock "refresh_cache-042713b8-ab7f-4c14-92e5-f830ccb7e341" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:56:36 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-7b3fadc6-648e-48c8-a474-d1c294958a3c tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Acquired lock "refresh_cache-042713b8-ab7f-4c14-92e5-f830ccb7e341" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:56:36 user nova-compute[73449]: DEBUG nova.network.neutron [None req-7b3fadc6-648e-48c8-a474-d1c294958a3c tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Building network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 11:56:36 user nova-compute[73449]: DEBUG nova.network.neutron [None req-7b3fadc6-648e-48c8-a474-d1c294958a3c tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Updating instance_info_cache with network_info: [{"id": "2ce1927a-6866-4362-bc0c-88cd0a19fa08", "address": "fa:16:3e:f5:89:a9", "network": {"id": "f7298070-baaa-4842-b3b2-d9fe1058d3b6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1715911399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8722edee53ed4a9188366c38f3b8b52f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ce1927a-68", "ovs_interfaceid": "2ce1927a-6866-4362-bc0c-88cd0a19fa08", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:56:37 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-7b3fadc6-648e-48c8-a474-d1c294958a3c tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Releasing lock "refresh_cache-042713b8-ab7f-4c14-92e5-f830ccb7e341" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:56:37 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:56:37 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:56:37 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:56:37 user nova-compute[73449]: DEBUG nova.compute.manager [req-46f3f42a-4b8e-4f55-996a-56c240f79c8d req-1484524e-6b9c-4ed5-87e4-e09d19688378 service nova] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Received event network-vif-unplugged-2ce1927a-6866-4362-bc0c-88cd0a19fa08 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:56:37 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-46f3f42a-4b8e-4f55-996a-56c240f79c8d req-1484524e-6b9c-4ed5-87e4-e09d19688378 service nova] Acquiring lock "042713b8-ab7f-4c14-92e5-f830ccb7e341-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:56:37 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-46f3f42a-4b8e-4f55-996a-56c240f79c8d req-1484524e-6b9c-4ed5-87e4-e09d19688378 service nova] Lock "042713b8-ab7f-4c14-92e5-f830ccb7e341-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:56:37 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-46f3f42a-4b8e-4f55-996a-56c240f79c8d req-1484524e-6b9c-4ed5-87e4-e09d19688378 service nova] Lock "042713b8-ab7f-4c14-92e5-f830ccb7e341-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:56:37 user nova-compute[73449]: DEBUG nova.compute.manager [req-46f3f42a-4b8e-4f55-996a-56c240f79c8d req-1484524e-6b9c-4ed5-87e4-e09d19688378 service nova] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] No waiting events found dispatching network-vif-unplugged-2ce1927a-6866-4362-bc0c-88cd0a19fa08 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:56:37 user nova-compute[73449]: WARNING nova.compute.manager [req-46f3f42a-4b8e-4f55-996a-56c240f79c8d req-1484524e-6b9c-4ed5-87e4-e09d19688378 service nova] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Received unexpected event network-vif-unplugged-2ce1927a-6866-4362-bc0c-88cd0a19fa08 for instance with vm_state active and task_state rescuing.
Aug 17 11:56:37 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:56:37 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:56:37 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:56:37 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Instance destroyed successfully.
Aug 17 11:56:37 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-7b3fadc6-648e-48c8-a474-d1c294958a3c tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Attempting rescue
Aug 17 11:56:37 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-7b3fadc6-648e-48c8-a474-d1c294958a3c tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73449) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 17 11:56:37 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-7b3fadc6-648e-48c8-a474-d1c294958a3c tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Instance directory exists: not creating {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 17 11:56:37 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-7b3fadc6-648e-48c8-a474-d1c294958a3c tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Creating image(s)
Aug 17 11:56:37 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-7b3fadc6-648e-48c8-a474-d1c294958a3c tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Acquiring lock "/opt/stack/data/nova/instances/042713b8-ab7f-4c14-92e5-f830ccb7e341/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:56:37 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-7b3fadc6-648e-48c8-a474-d1c294958a3c tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Lock "/opt/stack/data/nova/instances/042713b8-ab7f-4c14-92e5-f830ccb7e341/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:56:37 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-7b3fadc6-648e-48c8-a474-d1c294958a3c tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Lock "/opt/stack/data/nova/instances/042713b8-ab7f-4c14-92e5-f830ccb7e341/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:56:37 user nova-compute[73449]: DEBUG nova.objects.instance [None req-7b3fadc6-648e-48c8-a474-d1c294958a3c tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Lazy-loading 'trusted_certs' on Instance uuid 042713b8-ab7f-4c14-92e5-f830ccb7e341 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:56:37 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-7b3fadc6-648e-48c8-a474-d1c294958a3c tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Acquiring lock "7e267a577c062ee862e95ede6b48cfd5632f3ea3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:56:37 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-7b3fadc6-648e-48c8-a474-d1c294958a3c tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Lock "7e267a577c062ee862e95ede6b48cfd5632f3ea3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:56:37 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-7b3fadc6-648e-48c8-a474-d1c294958a3c tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:56:38 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-7b3fadc6-648e-48c8-a474-d1c294958a3c tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json" returned: 0 in 0.182s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:56:38 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-7b3fadc6-648e-48c8-a474-d1c294958a3c tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3,backing_fmt=raw /opt/stack/data/nova/instances/042713b8-ab7f-4c14-92e5-f830ccb7e341/disk.rescue {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:56:38 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-7b3fadc6-648e-48c8-a474-d1c294958a3c tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3,backing_fmt=raw /opt/stack/data/nova/instances/042713b8-ab7f-4c14-92e5-f830ccb7e341/disk.rescue" returned: 0 in 0.061s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:56:38 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-7b3fadc6-648e-48c8-a474-d1c294958a3c tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Lock "7e267a577c062ee862e95ede6b48cfd5632f3ea3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:56:38 user nova-compute[73449]: DEBUG nova.objects.instance [None req-7b3fadc6-648e-48c8-a474-d1c294958a3c tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Lazy-loading 'migration_context' on Instance uuid 042713b8-ab7f-4c14-92e5-f830ccb7e341 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:56:38 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-7b3fadc6-648e-48c8-a474-d1c294958a3c tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Created local disks {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 11:56:38 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-7b3fadc6-648e-48c8-a474-d1c294958a3c tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Start _get_guest_xml network_info=[{"id": "2ce1927a-6866-4362-bc0c-88cd0a19fa08", "address": "fa:16:3e:f5:89:a9", "network": {"id": "f7298070-baaa-4842-b3b2-d9fe1058d3b6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1715911399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1715911399-network", "vif_mac": "fa:16:3e:f5:89:a9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8722edee53ed4a9188366c38f3b8b52f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ce1927a-68", "ovs_interfaceid": "2ce1927a-6866-4362-bc0c-88cd0a19fa08", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T11:36:11Z,direct_url=<?>,disk_format='qcow2',id=0a2904ae-083d-41c8-83db-343132b36148,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7a77880136a54ef195c82e018e1939db',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T11:36:13Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '0a2904ae-083d-41c8-83db-343132b36148', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 11:56:38 user nova-compute[73449]: DEBUG nova.objects.instance [None req-7b3fadc6-648e-48c8-a474-d1c294958a3c tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Lazy-loading 'resources' on Instance uuid 042713b8-ab7f-4c14-92e5-f830ccb7e341 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:56:38 user nova-compute[73449]: DEBUG nova.objects.instance [None req-7b3fadc6-648e-48c8-a474-d1c294958a3c tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Lazy-loading 'numa_topology' on Instance uuid 042713b8-ab7f-4c14-92e5-f830ccb7e341 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:56:38 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-7b3fadc6-648e-48c8-a474-d1c294958a3c tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:56:38 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-7b3fadc6-648e-48c8-a474-d1c294958a3c tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:56:38 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-7b3fadc6-648e-48c8-a474-d1c294958a3c tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 11:56:38 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-7b3fadc6-648e-48c8-a474-d1c294958a3c tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] CPU controller missing on host. {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 11:56:38 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-7b3fadc6-648e-48c8-a474-d1c294958a3c tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 11:56:38 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-7b3fadc6-648e-48c8-a474-d1c294958a3c tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] CPU controller found on host. {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 11:56:38 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-7b3fadc6-648e-48c8-a474-d1c294958a3c tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73449) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 11:56:38 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-7b3fadc6-648e-48c8-a474-d1c294958a3c tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T11:35:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T11:36:11Z,direct_url=<?>,disk_format='qcow2',id=0a2904ae-083d-41c8-83db-343132b36148,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7a77880136a54ef195c82e018e1939db',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T11:36:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 11:56:38 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-7b3fadc6-648e-48c8-a474-d1c294958a3c tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Flavor limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 11:56:38 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-7b3fadc6-648e-48c8-a474-d1c294958a3c tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Image limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 11:56:38 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-7b3fadc6-648e-48c8-a474-d1c294958a3c tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Flavor pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 11:56:38 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-7b3fadc6-648e-48c8-a474-d1c294958a3c tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Image pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 11:56:38 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-7b3fadc6-648e-48c8-a474-d1c294958a3c tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 11:56:38 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-7b3fadc6-648e-48c8-a474-d1c294958a3c tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 11:56:38 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-7b3fadc6-648e-48c8-a474-d1c294958a3c tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 11:56:38 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-7b3fadc6-648e-48c8-a474-d1c294958a3c tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Got 1 possible topologies {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 11:56:38 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-7b3fadc6-648e-48c8-a474-d1c294958a3c tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 11:56:38 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-7b3fadc6-648e-48c8-a474-d1c294958a3c tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 11:56:38 user nova-compute[73449]: DEBUG nova.objects.instance [None req-7b3fadc6-648e-48c8-a474-d1c294958a3c tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Lazy-loading 'vcpu_model' on Instance uuid 042713b8-ab7f-4c14-92e5-f830ccb7e341 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:56:38 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-7b3fadc6-648e-48c8-a474-d1c294958a3c tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:54:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2055880093',display_name='tempest-ServerRescueNegativeTestJSON-server-2055880093',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2055880093',id=34,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOzW+ki2tzNTWzsdXwhyQ03cag1C3bEbz4eJdcMuqAgtDjoLdQ3HPC6EUYWRZynVvfgMyInuHXXmT1luJVuM3RFN3wpNlldPLaGdqryaccibJZE4kiB5wj8hgruKiBMU7w==',key_name='tempest-keypair-297071468',keypairs=<?>,launch_index=0,launched_at=2023-08-17T11:54:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8722edee53ed4a9188366c38f3b8b52f',ramdisk_id='',reservation_id='r-ii2ldcnj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1458167730',owner_user_name='tempest-ServerRescueNegativeTestJSON-1458167730-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T11:54:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ccb76bc93f84e0897da59b8d5928238',uuid=042713b8-ab7f-4c14-92e5-f830ccb7e341,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2ce1927a-6866-4362-bc0c-88cd0a19fa08", "address": "fa:16:3e:f5:89:a9", "network": {"id": "f7298070-baaa-4842-b3b2-d9fe1058d3b6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1715911399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1715911399-network", "vif_mac": "fa:16:3e:f5:89:a9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8722edee53ed4a9188366c38f3b8b52f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ce1927a-68", "ovs_interfaceid": "2ce1927a-6866-4362-bc0c-88cd0a19fa08", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73449) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 11:56:38 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-7b3fadc6-648e-48c8-a474-d1c294958a3c tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Converting VIF {"id": "2ce1927a-6866-4362-bc0c-88cd0a19fa08", "address": "fa:16:3e:f5:89:a9", "network": {"id": "f7298070-baaa-4842-b3b2-d9fe1058d3b6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1715911399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1715911399-network", "vif_mac": "fa:16:3e:f5:89:a9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8722edee53ed4a9188366c38f3b8b52f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ce1927a-68", "ovs_interfaceid": "2ce1927a-6866-4362-bc0c-88cd0a19fa08", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:56:38 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-7b3fadc6-648e-48c8-a474-d1c294958a3c tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f5:89:a9,bridge_name='br-int',has_traffic_filtering=True,id=2ce1927a-6866-4362-bc0c-88cd0a19fa08,network=Network(f7298070-baaa-4842-b3b2-d9fe1058d3b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ce1927a-68') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:56:38 user nova-compute[73449]: DEBUG nova.objects.instance [None req-7b3fadc6-648e-48c8-a474-d1c294958a3c tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Lazy-loading 'pci_devices' on Instance uuid 042713b8-ab7f-4c14-92e5-f830ccb7e341 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:56:38 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-7b3fadc6-648e-48c8-a474-d1c294958a3c tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] End _get_guest_xml xml=<domain type="kvm">
Aug 17 11:56:38 user nova-compute[73449]:   <uuid>042713b8-ab7f-4c14-92e5-f830ccb7e341</uuid>
Aug 17 11:56:38 user nova-compute[73449]:   <name>instance-00000022</name>
Aug 17 11:56:38 user nova-compute[73449]:   <memory>524288</memory>
Aug 17 11:56:38 user nova-compute[73449]:   <vcpu>1</vcpu>
Aug 17 11:56:38 user nova-compute[73449]:   <metadata>
Aug 17 11:56:38 user nova-compute[73449]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 11:56:38 user nova-compute[73449]:       <nova:package version="0.0.0"/>
Aug 17 11:56:38 user nova-compute[73449]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2055880093</nova:name>
Aug 17 11:56:38 user nova-compute[73449]:       <nova:creationTime>2023-08-17 11:56:38</nova:creationTime>
Aug 17 11:56:38 user nova-compute[73449]:       <nova:flavor name="m1.tiny">
Aug 17 11:56:38 user nova-compute[73449]:         <nova:memory>512</nova:memory>
Aug 17 11:56:38 user nova-compute[73449]:         <nova:disk>1</nova:disk>
Aug 17 11:56:38 user nova-compute[73449]:         <nova:swap>0</nova:swap>
Aug 17 11:56:38 user nova-compute[73449]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 11:56:38 user nova-compute[73449]:         <nova:vcpus>1</nova:vcpus>
Aug 17 11:56:38 user nova-compute[73449]:       </nova:flavor>
Aug 17 11:56:38 user nova-compute[73449]:       <nova:owner>
Aug 17 11:56:38 user nova-compute[73449]:         <nova:user uuid="7ccb76bc93f84e0897da59b8d5928238">tempest-ServerRescueNegativeTestJSON-1458167730-project-member</nova:user>
Aug 17 11:56:38 user nova-compute[73449]:         <nova:project uuid="8722edee53ed4a9188366c38f3b8b52f">tempest-ServerRescueNegativeTestJSON-1458167730</nova:project>
Aug 17 11:56:38 user nova-compute[73449]:       </nova:owner>
Aug 17 11:56:38 user nova-compute[73449]:       <nova:root type="image" uuid="0a2904ae-083d-41c8-83db-343132b36148"/>
Aug 17 11:56:38 user nova-compute[73449]:       <nova:ports>
Aug 17 11:56:38 user nova-compute[73449]:         <nova:port uuid="2ce1927a-6866-4362-bc0c-88cd0a19fa08">
Aug 17 11:56:38 user nova-compute[73449]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 17 11:56:38 user nova-compute[73449]:         </nova:port>
Aug 17 11:56:38 user nova-compute[73449]:       </nova:ports>
Aug 17 11:56:38 user nova-compute[73449]:     </nova:instance>
Aug 17 11:56:38 user nova-compute[73449]:   </metadata>
Aug 17 11:56:38 user nova-compute[73449]:   <sysinfo type="smbios">
Aug 17 11:56:38 user nova-compute[73449]:     <system>
Aug 17 11:56:38 user nova-compute[73449]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 11:56:38 user nova-compute[73449]:       <entry name="product">OpenStack Nova</entry>
Aug 17 11:56:38 user nova-compute[73449]:       <entry name="version">0.0.0</entry>
Aug 17 11:56:38 user nova-compute[73449]:       <entry name="serial">042713b8-ab7f-4c14-92e5-f830ccb7e341</entry>
Aug 17 11:56:38 user nova-compute[73449]:       <entry name="uuid">042713b8-ab7f-4c14-92e5-f830ccb7e341</entry>
Aug 17 11:56:38 user nova-compute[73449]:       <entry name="family">Virtual Machine</entry>
Aug 17 11:56:38 user nova-compute[73449]:     </system>
Aug 17 11:56:38 user nova-compute[73449]:   </sysinfo>
Aug 17 11:56:38 user nova-compute[73449]:   <os>
Aug 17 11:56:38 user nova-compute[73449]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 11:56:38 user nova-compute[73449]:     <smbios mode="sysinfo"/>
Aug 17 11:56:38 user nova-compute[73449]:   </os>
Aug 17 11:56:38 user nova-compute[73449]:   <features>
Aug 17 11:56:38 user nova-compute[73449]:     <acpi/>
Aug 17 11:56:38 user nova-compute[73449]:     <apic/>
Aug 17 11:56:38 user nova-compute[73449]:     <vmcoreinfo/>
Aug 17 11:56:38 user nova-compute[73449]:   </features>
Aug 17 11:56:38 user nova-compute[73449]:   <clock offset="utc">
Aug 17 11:56:38 user nova-compute[73449]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 11:56:38 user nova-compute[73449]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 11:56:38 user nova-compute[73449]:     <timer name="hpet" present="no"/>
Aug 17 11:56:38 user nova-compute[73449]:   </clock>
Aug 17 11:56:38 user nova-compute[73449]:   <cpu mode="custom" match="exact">
Aug 17 11:56:38 user nova-compute[73449]:     <model>Nehalem</model>
Aug 17 11:56:38 user nova-compute[73449]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 11:56:38 user nova-compute[73449]:   </cpu>
Aug 17 11:56:38 user nova-compute[73449]:   <devices>
Aug 17 11:56:38 user nova-compute[73449]:     <disk type="file" device="disk">
Aug 17 11:56:38 user nova-compute[73449]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 11:56:38 user nova-compute[73449]:       <source file="/opt/stack/data/nova/instances/042713b8-ab7f-4c14-92e5-f830ccb7e341/disk.rescue"/>
Aug 17 11:56:38 user nova-compute[73449]:       <target dev="vda" bus="virtio"/>
Aug 17 11:56:38 user nova-compute[73449]:     </disk>
Aug 17 11:56:38 user nova-compute[73449]:     <disk type="file" device="disk">
Aug 17 11:56:38 user nova-compute[73449]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 11:56:38 user nova-compute[73449]:       <source file="/opt/stack/data/nova/instances/042713b8-ab7f-4c14-92e5-f830ccb7e341/disk"/>
Aug 17 11:56:38 user nova-compute[73449]:       <target dev="vdb" bus="virtio"/>
Aug 17 11:56:38 user nova-compute[73449]:     </disk>
Aug 17 11:56:38 user nova-compute[73449]:     <interface type="ethernet">
Aug 17 11:56:38 user nova-compute[73449]:       <mac address="fa:16:3e:f5:89:a9"/>
Aug 17 11:56:38 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 11:56:38 user nova-compute[73449]:       <mtu size="1442"/>
Aug 17 11:56:38 user nova-compute[73449]:       <target dev="tap2ce1927a-68"/>
Aug 17 11:56:38 user nova-compute[73449]:     </interface>
Aug 17 11:56:38 user nova-compute[73449]:     <serial type="pty">
Aug 17 11:56:38 user nova-compute[73449]:       <log file="/opt/stack/data/nova/instances/042713b8-ab7f-4c14-92e5-f830ccb7e341/console.log" append="off"/>
Aug 17 11:56:38 user nova-compute[73449]:     </serial>
Aug 17 11:56:38 user nova-compute[73449]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 11:56:38 user nova-compute[73449]:     <video>
Aug 17 11:56:38 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 11:56:38 user nova-compute[73449]:     </video>
Aug 17 11:56:38 user nova-compute[73449]:     <rng model="virtio">
Aug 17 11:56:38 user nova-compute[73449]:       <backend model="random">/dev/urandom</backend>
Aug 17 11:56:38 user nova-compute[73449]:     </rng>
Aug 17 11:56:38 user nova-compute[73449]:     <controller type="usb" index="0" model="none"/>
Aug 17 11:56:38 user nova-compute[73449]:     <memballoon model="virtio">
Aug 17 11:56:38 user nova-compute[73449]:       <stats period="10"/>
Aug 17 11:56:38 user nova-compute[73449]:     </memballoon>
Aug 17 11:56:38 user nova-compute[73449]:   </devices>
Aug 17 11:56:38 user nova-compute[73449]: </domain>
Aug 17 11:56:38 user nova-compute[73449]:  {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 11:56:38 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Instance destroyed successfully.
Aug 17 11:56:38 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-7b3fadc6-648e-48c8-a474-d1c294958a3c tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] No BDM found with device name vda, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 11:56:38 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-7b3fadc6-648e-48c8-a474-d1c294958a3c tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 11:56:38 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-7b3fadc6-648e-48c8-a474-d1c294958a3c tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] No VIF found with MAC fa:16:3e:f5:89:a9, not building metadata {{(pid=73449) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 11:56:38 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:56:39 user nova-compute[73449]: DEBUG nova.compute.manager [req-f9747f37-527b-4dfa-b7ca-127709eb7ed8 req-cf82738c-0358-4bc7-b325-6af8d4bb82c0 service nova] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Received event network-vif-plugged-2ce1927a-6866-4362-bc0c-88cd0a19fa08 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:56:39 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-f9747f37-527b-4dfa-b7ca-127709eb7ed8 req-cf82738c-0358-4bc7-b325-6af8d4bb82c0 service nova] Acquiring lock "042713b8-ab7f-4c14-92e5-f830ccb7e341-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:56:39 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-f9747f37-527b-4dfa-b7ca-127709eb7ed8 req-cf82738c-0358-4bc7-b325-6af8d4bb82c0 service nova] Lock "042713b8-ab7f-4c14-92e5-f830ccb7e341-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:56:39 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-f9747f37-527b-4dfa-b7ca-127709eb7ed8 req-cf82738c-0358-4bc7-b325-6af8d4bb82c0 service nova] Lock "042713b8-ab7f-4c14-92e5-f830ccb7e341-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:56:39 user nova-compute[73449]: DEBUG nova.compute.manager [req-f9747f37-527b-4dfa-b7ca-127709eb7ed8 req-cf82738c-0358-4bc7-b325-6af8d4bb82c0 service nova] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] No waiting events found dispatching network-vif-plugged-2ce1927a-6866-4362-bc0c-88cd0a19fa08 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:56:39 user nova-compute[73449]: WARNING nova.compute.manager [req-f9747f37-527b-4dfa-b7ca-127709eb7ed8 req-cf82738c-0358-4bc7-b325-6af8d4bb82c0 service nova] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Received unexpected event network-vif-plugged-2ce1927a-6866-4362-bc0c-88cd0a19fa08 for instance with vm_state active and task_state rescuing.
Aug 17 11:56:39 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:56:39 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:56:39 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:56:39 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:56:39 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:56:39 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:56:41 user nova-compute[73449]: DEBUG nova.compute.manager [req-865f0d4b-3158-4109-bedc-4af3ac5aff97 req-758bebaa-c5cc-449d-b871-51f79ae75886 service nova] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Received event network-vif-plugged-2ce1927a-6866-4362-bc0c-88cd0a19fa08 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:56:41 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-865f0d4b-3158-4109-bedc-4af3ac5aff97 req-758bebaa-c5cc-449d-b871-51f79ae75886 service nova] Acquiring lock "042713b8-ab7f-4c14-92e5-f830ccb7e341-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:56:41 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-865f0d4b-3158-4109-bedc-4af3ac5aff97 req-758bebaa-c5cc-449d-b871-51f79ae75886 service nova] Lock "042713b8-ab7f-4c14-92e5-f830ccb7e341-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:56:41 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-865f0d4b-3158-4109-bedc-4af3ac5aff97 req-758bebaa-c5cc-449d-b871-51f79ae75886 service nova] Lock "042713b8-ab7f-4c14-92e5-f830ccb7e341-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:56:41 user nova-compute[73449]: DEBUG nova.compute.manager [req-865f0d4b-3158-4109-bedc-4af3ac5aff97 req-758bebaa-c5cc-449d-b871-51f79ae75886 service nova] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] No waiting events found dispatching network-vif-plugged-2ce1927a-6866-4362-bc0c-88cd0a19fa08 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:56:41 user nova-compute[73449]: WARNING nova.compute.manager [req-865f0d4b-3158-4109-bedc-4af3ac5aff97 req-758bebaa-c5cc-449d-b871-51f79ae75886 service nova] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Received unexpected event network-vif-plugged-2ce1927a-6866-4362-bc0c-88cd0a19fa08 for instance with vm_state active and task_state rescuing.
Aug 17 11:56:41 user nova-compute[73449]: DEBUG nova.compute.manager [req-865f0d4b-3158-4109-bedc-4af3ac5aff97 req-758bebaa-c5cc-449d-b871-51f79ae75886 service nova] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Received event network-vif-plugged-2ce1927a-6866-4362-bc0c-88cd0a19fa08 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:56:41 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-865f0d4b-3158-4109-bedc-4af3ac5aff97 req-758bebaa-c5cc-449d-b871-51f79ae75886 service nova] Acquiring lock "042713b8-ab7f-4c14-92e5-f830ccb7e341-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:56:41 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-865f0d4b-3158-4109-bedc-4af3ac5aff97 req-758bebaa-c5cc-449d-b871-51f79ae75886 service nova] Lock "042713b8-ab7f-4c14-92e5-f830ccb7e341-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:56:41 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-865f0d4b-3158-4109-bedc-4af3ac5aff97 req-758bebaa-c5cc-449d-b871-51f79ae75886 service nova] Lock "042713b8-ab7f-4c14-92e5-f830ccb7e341-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:56:41 user nova-compute[73449]: DEBUG nova.compute.manager [req-865f0d4b-3158-4109-bedc-4af3ac5aff97 req-758bebaa-c5cc-449d-b871-51f79ae75886 service nova] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] No waiting events found dispatching network-vif-plugged-2ce1927a-6866-4362-bc0c-88cd0a19fa08 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:56:41 user nova-compute[73449]: WARNING nova.compute.manager [req-865f0d4b-3158-4109-bedc-4af3ac5aff97 req-758bebaa-c5cc-449d-b871-51f79ae75886 service nova] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Received unexpected event network-vif-plugged-2ce1927a-6866-4362-bc0c-88cd0a19fa08 for instance with vm_state active and task_state rescuing.
Aug 17 11:56:41 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Removed pending event for 042713b8-ab7f-4c14-92e5-f830ccb7e341 due to event {{(pid=73449) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 17 11:56:41 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692273401.898209, 042713b8-ab7f-4c14-92e5-f830ccb7e341 => Resumed> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:56:41 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] VM Resumed (Lifecycle Event)
Aug 17 11:56:41 user nova-compute[73449]: DEBUG nova.compute.manager [None req-7b3fadc6-648e-48c8-a474-d1c294958a3c tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:56:41 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:56:41 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 11:56:41 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 17 11:56:41 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692273401.9001884, 042713b8-ab7f-4c14-92e5-f830ccb7e341 => Started> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:56:41 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] VM Started (Lifecycle Event)
Aug 17 11:56:41 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:56:42 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 11:56:42 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:56:43 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:56:45 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:56:45 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Triggering sync for uuid 4a9e8ad2-19db-4975-87e4-2efce603a7d7 {{(pid=73449) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 11:56:45 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Triggering sync for uuid 3d74c8f6-fb4e-4460-b722-674a8a1e2d25 {{(pid=73449) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 11:56:45 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Triggering sync for uuid ae75d334-431a-4008-8b3d-f2a727d92417 {{(pid=73449) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 11:56:45 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Triggering sync for uuid dd4ec7bd-002e-4a71-9314-96c21427af27 {{(pid=73449) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 11:56:45 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Triggering sync for uuid 89440604-1daf-4e7a-a524-2f9c21a9cb96 {{(pid=73449) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 11:56:45 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Triggering sync for uuid 01ef4274-dfa1-4f7d-a24c-a1686b692f70 {{(pid=73449) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 11:56:45 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Triggering sync for uuid b32df06e-0b5a-4384-946b-64d64aeeb07e {{(pid=73449) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 11:56:45 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Triggering sync for uuid 31f5f3d2-41d8-4a26-9eb2-18b891f94734 {{(pid=73449) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 11:56:45 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Triggering sync for uuid 042713b8-ab7f-4c14-92e5-f830ccb7e341 {{(pid=73449) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 11:56:45 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Triggering sync for uuid 9e68a702-ead5-47ae-9375-5cd00b947ef4 {{(pid=73449) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 11:56:45 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Triggering sync for uuid 4b7932d8-b781-4db7-a1c5-791ce8d1d866 {{(pid=73449) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 11:56:45 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "4a9e8ad2-19db-4975-87e4-2efce603a7d7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:56:45 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "4a9e8ad2-19db-4975-87e4-2efce603a7d7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:56:45 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "3d74c8f6-fb4e-4460-b722-674a8a1e2d25" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:56:45 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "3d74c8f6-fb4e-4460-b722-674a8a1e2d25" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:56:45 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "ae75d334-431a-4008-8b3d-f2a727d92417" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:56:45 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "ae75d334-431a-4008-8b3d-f2a727d92417" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:56:45 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "dd4ec7bd-002e-4a71-9314-96c21427af27" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:56:45 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "dd4ec7bd-002e-4a71-9314-96c21427af27" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:56:45 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "89440604-1daf-4e7a-a524-2f9c21a9cb96" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:56:45 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "89440604-1daf-4e7a-a524-2f9c21a9cb96" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:56:45 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "01ef4274-dfa1-4f7d-a24c-a1686b692f70" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:56:45 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "01ef4274-dfa1-4f7d-a24c-a1686b692f70" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:56:45 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "b32df06e-0b5a-4384-946b-64d64aeeb07e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:56:45 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "b32df06e-0b5a-4384-946b-64d64aeeb07e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:56:45 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "31f5f3d2-41d8-4a26-9eb2-18b891f94734" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:56:45 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "31f5f3d2-41d8-4a26-9eb2-18b891f94734" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:56:45 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "042713b8-ab7f-4c14-92e5-f830ccb7e341" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:56:45 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "042713b8-ab7f-4c14-92e5-f830ccb7e341" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:56:45 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "9e68a702-ead5-47ae-9375-5cd00b947ef4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:56:45 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "9e68a702-ead5-47ae-9375-5cd00b947ef4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:56:45 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "4b7932d8-b781-4db7-a1c5-791ce8d1d866" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:56:45 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "4b7932d8-b781-4db7-a1c5-791ce8d1d866" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:56:45 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "4a9e8ad2-19db-4975-87e4-2efce603a7d7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.060s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:56:45 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "01ef4274-dfa1-4f7d-a24c-a1686b692f70" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.068s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:56:45 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "b32df06e-0b5a-4384-946b-64d64aeeb07e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.079s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:56:45 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "ae75d334-431a-4008-8b3d-f2a727d92417" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.084s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:56:45 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "042713b8-ab7f-4c14-92e5-f830ccb7e341" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.080s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:56:45 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "dd4ec7bd-002e-4a71-9314-96c21427af27" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.093s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:56:45 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "9e68a702-ead5-47ae-9375-5cd00b947ef4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.089s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:56:45 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "3d74c8f6-fb4e-4460-b722-674a8a1e2d25" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.099s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:56:45 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "89440604-1daf-4e7a-a524-2f9c21a9cb96" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.109s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:56:45 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "31f5f3d2-41d8-4a26-9eb2-18b891f94734" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.112s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:56:45 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "4b7932d8-b781-4db7-a1c5-791ce8d1d866" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.125s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:56:47 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:56:48 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:56:48 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-83e3c3d6-fc4b-4151-863a-f01bbd27cc21 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Acquiring lock "01ef4274-dfa1-4f7d-a24c-a1686b692f70" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:56:48 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-83e3c3d6-fc4b-4151-863a-f01bbd27cc21 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Lock "01ef4274-dfa1-4f7d-a24c-a1686b692f70" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:56:48 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-83e3c3d6-fc4b-4151-863a-f01bbd27cc21 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Acquiring lock "01ef4274-dfa1-4f7d-a24c-a1686b692f70-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:56:48 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-83e3c3d6-fc4b-4151-863a-f01bbd27cc21 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Lock "01ef4274-dfa1-4f7d-a24c-a1686b692f70-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:56:48 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-83e3c3d6-fc4b-4151-863a-f01bbd27cc21 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Lock "01ef4274-dfa1-4f7d-a24c-a1686b692f70-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:56:48 user nova-compute[73449]: INFO nova.compute.manager [None req-83e3c3d6-fc4b-4151-863a-f01bbd27cc21 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] Terminating instance
Aug 17 11:56:48 user nova-compute[73449]: DEBUG nova.compute.manager [None req-83e3c3d6-fc4b-4151-863a-f01bbd27cc21 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] Start destroying the instance on the hypervisor. {{(pid=73449) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 11:56:48 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:56:48 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:56:48 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:56:48 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:56:48 user nova-compute[73449]: DEBUG nova.compute.manager [req-d3b13597-3e53-45b2-957f-1627c1586f66 req-66534206-50c3-43f0-a41d-cec0ec997b7c service nova] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] Received event network-vif-unplugged-e1cb1992-df66-4253-ba1f-3c30647c61de {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:56:48 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-d3b13597-3e53-45b2-957f-1627c1586f66 req-66534206-50c3-43f0-a41d-cec0ec997b7c service nova] Acquiring lock "01ef4274-dfa1-4f7d-a24c-a1686b692f70-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:56:48 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-d3b13597-3e53-45b2-957f-1627c1586f66 req-66534206-50c3-43f0-a41d-cec0ec997b7c service nova] Lock "01ef4274-dfa1-4f7d-a24c-a1686b692f70-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:56:48 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-d3b13597-3e53-45b2-957f-1627c1586f66 req-66534206-50c3-43f0-a41d-cec0ec997b7c service nova] Lock "01ef4274-dfa1-4f7d-a24c-a1686b692f70-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:56:48 user nova-compute[73449]: DEBUG nova.compute.manager [req-d3b13597-3e53-45b2-957f-1627c1586f66 req-66534206-50c3-43f0-a41d-cec0ec997b7c service nova] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] No waiting events found dispatching network-vif-unplugged-e1cb1992-df66-4253-ba1f-3c30647c61de {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:56:48 user nova-compute[73449]: DEBUG nova.compute.manager [req-d3b13597-3e53-45b2-957f-1627c1586f66 req-66534206-50c3-43f0-a41d-cec0ec997b7c service nova] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] Received event network-vif-unplugged-e1cb1992-df66-4253-ba1f-3c30647c61de for instance with task_state deleting. {{(pid=73449) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 11:56:49 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] Instance destroyed successfully.
Aug 17 11:56:49 user nova-compute[73449]: DEBUG nova.objects.instance [None req-83e3c3d6-fc4b-4151-863a-f01bbd27cc21 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Lazy-loading 'resources' on Instance uuid 01ef4274-dfa1-4f7d-a24c-a1686b692f70 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:56:49 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-83e3c3d6-fc4b-4151-863a-f01bbd27cc21 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:51:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1932160359',display_name='tempest-TestMinimumBasicScenario-server-1932160359',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1932160359',id=30,image_ref='6f8e20a1-db10-4cf8-9988-c16f01e25ee6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGq85eXabfFwL2RCeJ0KFYDsljWNHRqKUonIj+5b53rjzVA/YI9pb8YOAJpN21dgx0wtftVXB8cBCpqucDzGZn90zvZmHTr/jT5YZG/AyiEoEikCQlMKTOFVlw6SGxDaaw==',key_name='tempest-TestMinimumBasicScenario-1715363026',keypairs=<?>,launch_index=0,launched_at=2023-08-17T11:51:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b5ba3ebf47bd4b999e68c74a5c0ab060',ramdisk_id='',reservation_id='r-vqpcy8b2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6f8e20a1-db10-4cf8-9988-c16f01e25ee6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1063498076',owner_user_name='tempest-TestMinimumBasicScenario-1063498076-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T11:54:05Z,user_data=None,user_id='a388f1f7e6254e8cace000ec1249d6c6',uuid=01ef4274-dfa1-4f7d-a24c-a1686b692f70,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e1cb1992-df66-4253-ba1f-3c30647c61de", "address": "fa:16:3e:b9:37:67", "network": {"id": "ff73f5c3-bae6-46cc-bcb8-bbd5be1b478d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1229197917-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5ba3ebf47bd4b999e68c74a5c0ab060", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1cb1992-df", "ovs_interfaceid": "e1cb1992-df66-4253-ba1f-3c30647c61de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 11:56:49 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-83e3c3d6-fc4b-4151-863a-f01bbd27cc21 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Converting VIF {"id": "e1cb1992-df66-4253-ba1f-3c30647c61de", "address": "fa:16:3e:b9:37:67", "network": {"id": "ff73f5c3-bae6-46cc-bcb8-bbd5be1b478d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1229197917-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5ba3ebf47bd4b999e68c74a5c0ab060", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1cb1992-df", "ovs_interfaceid": "e1cb1992-df66-4253-ba1f-3c30647c61de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:56:49 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-83e3c3d6-fc4b-4151-863a-f01bbd27cc21 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b9:37:67,bridge_name='br-int',has_traffic_filtering=True,id=e1cb1992-df66-4253-ba1f-3c30647c61de,network=Network(ff73f5c3-bae6-46cc-bcb8-bbd5be1b478d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1cb1992-df') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:56:49 user nova-compute[73449]: DEBUG os_vif [None req-83e3c3d6-fc4b-4151-863a-f01bbd27cc21 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:37:67,bridge_name='br-int',has_traffic_filtering=True,id=e1cb1992-df66-4253-ba1f-3c30647c61de,network=Network(ff73f5c3-bae6-46cc-bcb8-bbd5be1b478d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1cb1992-df') {{(pid=73449) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 11:56:49 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:56:49 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape1cb1992-df, bridge=br-int, if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:56:49 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:56:49 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:56:49 user nova-compute[73449]: INFO os_vif [None req-83e3c3d6-fc4b-4151-863a-f01bbd27cc21 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:37:67,bridge_name='br-int',has_traffic_filtering=True,id=e1cb1992-df66-4253-ba1f-3c30647c61de,network=Network(ff73f5c3-bae6-46cc-bcb8-bbd5be1b478d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1cb1992-df')
Aug 17 11:56:49 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-83e3c3d6-fc4b-4151-863a-f01bbd27cc21 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] Deleting instance files /opt/stack/data/nova/instances/01ef4274-dfa1-4f7d-a24c-a1686b692f70_del
Aug 17 11:56:49 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-83e3c3d6-fc4b-4151-863a-f01bbd27cc21 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] Deletion of /opt/stack/data/nova/instances/01ef4274-dfa1-4f7d-a24c-a1686b692f70_del complete
Aug 17 11:56:49 user nova-compute[73449]: INFO nova.compute.manager [None req-83e3c3d6-fc4b-4151-863a-f01bbd27cc21 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 17 11:56:49 user nova-compute[73449]: DEBUG oslo.service.loopingcall [None req-83e3c3d6-fc4b-4151-863a-f01bbd27cc21 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73449) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 11:56:49 user nova-compute[73449]: DEBUG nova.compute.manager [-] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] Deallocating network for instance {{(pid=73449) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 11:56:49 user nova-compute[73449]: DEBUG nova.network.neutron [-] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] deallocate_for_instance() {{(pid=73449) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 11:56:49 user nova-compute[73449]: DEBUG nova.network.neutron [-] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] Updating instance_info_cache with network_info: [] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:56:50 user nova-compute[73449]: INFO nova.compute.manager [-] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] Took 0.57 seconds to deallocate network for instance.
Aug 17 11:56:50 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-83e3c3d6-fc4b-4151-863a-f01bbd27cc21 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:56:50 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-83e3c3d6-fc4b-4151-863a-f01bbd27cc21 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:56:50 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-83e3c3d6-fc4b-4151-863a-f01bbd27cc21 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Refreshing inventories for resource provider 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 17 11:56:50 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-83e3c3d6-fc4b-4151-863a-f01bbd27cc21 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Updating ProviderTree inventory for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 17 11:56:50 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-83e3c3d6-fc4b-4151-863a-f01bbd27cc21 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Updating inventory in ProviderTree for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 11:56:50 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-83e3c3d6-fc4b-4151-863a-f01bbd27cc21 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Refreshing aggregate associations for resource provider 20986bee-3f54-4b89-bec1-f8387ef700c4, aggregates: None {{(pid=73449) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 17 11:56:50 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-83e3c3d6-fc4b-4151-863a-f01bbd27cc21 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Refreshing trait associations for resource provider 20986bee-3f54-4b89-bec1-f8387ef700c4, traits: COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NODE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE42,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSSE3,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_ISO {{(pid=73449) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 17 11:56:50 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-83e3c3d6-fc4b-4151-863a-f01bbd27cc21 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 11:56:50 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-83e3c3d6-fc4b-4151-863a-f01bbd27cc21 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 11:56:50 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-83e3c3d6-fc4b-4151-863a-f01bbd27cc21 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.627s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:56:50 user nova-compute[73449]: INFO nova.scheduler.client.report [None req-83e3c3d6-fc4b-4151-863a-f01bbd27cc21 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Deleted allocations for instance 01ef4274-dfa1-4f7d-a24c-a1686b692f70
Aug 17 11:56:50 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-83e3c3d6-fc4b-4151-863a-f01bbd27cc21 tempest-TestMinimumBasicScenario-1063498076 tempest-TestMinimumBasicScenario-1063498076-project-member] Lock "01ef4274-dfa1-4f7d-a24c-a1686b692f70" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.258s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:56:50 user nova-compute[73449]: DEBUG nova.compute.manager [req-218393d3-d4b3-42d7-94ef-0c0f85251c87 req-7396a0bb-f293-4995-b4db-92391cda77cd service nova] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] Received event network-vif-plugged-e1cb1992-df66-4253-ba1f-3c30647c61de {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:56:50 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-218393d3-d4b3-42d7-94ef-0c0f85251c87 req-7396a0bb-f293-4995-b4db-92391cda77cd service nova] Acquiring lock "01ef4274-dfa1-4f7d-a24c-a1686b692f70-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:56:50 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-218393d3-d4b3-42d7-94ef-0c0f85251c87 req-7396a0bb-f293-4995-b4db-92391cda77cd service nova] Lock "01ef4274-dfa1-4f7d-a24c-a1686b692f70-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:56:50 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-218393d3-d4b3-42d7-94ef-0c0f85251c87 req-7396a0bb-f293-4995-b4db-92391cda77cd service nova] Lock "01ef4274-dfa1-4f7d-a24c-a1686b692f70-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:56:50 user nova-compute[73449]: DEBUG nova.compute.manager [req-218393d3-d4b3-42d7-94ef-0c0f85251c87 req-7396a0bb-f293-4995-b4db-92391cda77cd service nova] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] No waiting events found dispatching network-vif-plugged-e1cb1992-df66-4253-ba1f-3c30647c61de {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:56:50 user nova-compute[73449]: WARNING nova.compute.manager [req-218393d3-d4b3-42d7-94ef-0c0f85251c87 req-7396a0bb-f293-4995-b4db-92391cda77cd service nova] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] Received unexpected event network-vif-plugged-e1cb1992-df66-4253-ba1f-3c30647c61de for instance with vm_state deleted and task_state None.
Aug 17 11:56:50 user nova-compute[73449]: DEBUG nova.compute.manager [req-218393d3-d4b3-42d7-94ef-0c0f85251c87 req-7396a0bb-f293-4995-b4db-92391cda77cd service nova] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] Received event network-vif-deleted-e1cb1992-df66-4253-ba1f-3c30647c61de {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:56:53 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:56:54 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:56:57 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:56:57 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:56:57 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:56:58 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:56:59 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:56:59 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:56:59 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73449) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 11:57:01 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:57:03 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:57:03 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:57:04 user nova-compute[73449]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692273409.328438, 01ef4274-dfa1-4f7d-a24c-a1686b692f70 => Stopped> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:57:04 user nova-compute[73449]: INFO nova.compute.manager [-] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] VM Stopped (Lifecycle Event)
Aug 17 11:57:04 user nova-compute[73449]: DEBUG nova.compute.manager [None req-febbc5dd-fe25-4e5a-8782-f387a34a98c1 None None] [instance: 01ef4274-dfa1-4f7d-a24c-a1686b692f70] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:57:04 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:57:04 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:57:04 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:57:04 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Starting heal instance info cache {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 11:57:04 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Didn't find any instances for network info cache update. {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 11:57:06 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:57:06 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:57:06 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:57:06 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:57:06 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=73449) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 11:57:07 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd4ec7bd-002e-4a71-9314-96c21427af27/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:57:07 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd4ec7bd-002e-4a71-9314-96c21427af27/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:57:07 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd4ec7bd-002e-4a71-9314-96c21427af27/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:57:07 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd4ec7bd-002e-4a71-9314-96c21427af27/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:57:07 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b7932d8-b781-4db7-a1c5-791ce8d1d866/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:57:07 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b7932d8-b781-4db7-a1c5-791ce8d1d866/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:57:07 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b7932d8-b781-4db7-a1c5-791ce8d1d866/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:57:07 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b7932d8-b781-4db7-a1c5-791ce8d1d866/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:57:07 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/042713b8-ab7f-4c14-92e5-f830ccb7e341/disk.rescue --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:57:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/042713b8-ab7f-4c14-92e5-f830ccb7e341/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:57:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/042713b8-ab7f-4c14-92e5-f830ccb7e341/disk.rescue --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:57:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/042713b8-ab7f-4c14-92e5-f830ccb7e341/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:57:08 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] skipping disk /opt/stack/data/nova/instances/042713b8-ab7f-4c14-92e5-f830ccb7e341/disk (vdb) as it is a volume {{(pid=73449) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 11:57:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a9e8ad2-19db-4975-87e4-2efce603a7d7/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:57:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a9e8ad2-19db-4975-87e4-2efce603a7d7/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:57:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a9e8ad2-19db-4975-87e4-2efce603a7d7/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:57:08 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:57:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a9e8ad2-19db-4975-87e4-2efce603a7d7/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:57:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk.rescue --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:57:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:57:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk.rescue --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:57:09 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:57:09 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:57:09 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:57:09 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:57:09 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:57:09 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:57:09 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73449) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 11:57:09 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73449) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 11:57:09 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31f5f3d2-41d8-4a26-9eb2-18b891f94734/disk.rescue --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:57:09 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31f5f3d2-41d8-4a26-9eb2-18b891f94734/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:57:09 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31f5f3d2-41d8-4a26-9eb2-18b891f94734/disk.rescue --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:57:09 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31f5f3d2-41d8-4a26-9eb2-18b891f94734/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:57:09 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e68a702-ead5-47ae-9375-5cd00b947ef4/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:57:09 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e68a702-ead5-47ae-9375-5cd00b947ef4/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:57:09 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e68a702-ead5-47ae-9375-5cd00b947ef4/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:57:10 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e68a702-ead5-47ae-9375-5cd00b947ef4/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:57:10 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d74c8f6-fb4e-4460-b722-674a8a1e2d25/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:57:10 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d74c8f6-fb4e-4460-b722-674a8a1e2d25/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:57:10 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d74c8f6-fb4e-4460-b722-674a8a1e2d25/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:57:10 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d74c8f6-fb4e-4460-b722-674a8a1e2d25/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:57:10 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89440604-1daf-4e7a-a524-2f9c21a9cb96/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:57:10 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89440604-1daf-4e7a-a524-2f9c21a9cb96/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:57:10 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89440604-1daf-4e7a-a524-2f9c21a9cb96/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:57:10 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89440604-1daf-4e7a-a524-2f9c21a9cb96/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:57:10 user nova-compute[73449]: INFO nova.compute.manager [None req-96e242a7-56d4-4684-8b42-0617b722d056 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] Unrescuing
Aug 17 11:57:11 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-96e242a7-56d4-4684-8b42-0617b722d056 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Acquiring lock "refresh_cache-31f5f3d2-41d8-4a26-9eb2-18b891f94734" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:57:11 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-96e242a7-56d4-4684-8b42-0617b722d056 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Acquired lock "refresh_cache-31f5f3d2-41d8-4a26-9eb2-18b891f94734" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:57:11 user nova-compute[73449]: DEBUG nova.network.neutron [None req-96e242a7-56d4-4684-8b42-0617b722d056 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] Building network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 11:57:11 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-f956aea2-3318-45e9-b90d-18546c575e3d tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Acquiring lock "773e5c86-a86a-414d-aab4-8e13e0b68c1e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:57:11 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-f956aea2-3318-45e9-b90d-18546c575e3d tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Lock "773e5c86-a86a-414d-aab4-8e13e0b68c1e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:57:11 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:57:11 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:57:11 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Hypervisor/Node resource view: name=user free_ram=7191MB free_disk=25.038902282714844GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73449) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 11:57:11 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:57:11 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:57:11 user nova-compute[73449]: DEBUG nova.compute.manager [None req-f956aea2-3318-45e9-b90d-18546c575e3d tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 773e5c86-a86a-414d-aab4-8e13e0b68c1e] Starting instance... {{(pid=73449) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 11:57:11 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-f956aea2-3318-45e9-b90d-18546c575e3d tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:57:11 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 4a9e8ad2-19db-4975-87e4-2efce603a7d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:57:11 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 3d74c8f6-fb4e-4460-b722-674a8a1e2d25 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:57:11 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance ae75d334-431a-4008-8b3d-f2a727d92417 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:57:11 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance dd4ec7bd-002e-4a71-9314-96c21427af27 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:57:11 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 89440604-1daf-4e7a-a524-2f9c21a9cb96 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:57:11 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 31f5f3d2-41d8-4a26-9eb2-18b891f94734 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:57:11 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance b32df06e-0b5a-4384-946b-64d64aeeb07e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:57:11 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 042713b8-ab7f-4c14-92e5-f830ccb7e341 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:57:11 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 9e68a702-ead5-47ae-9375-5cd00b947ef4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:57:11 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 4b7932d8-b781-4db7-a1c5-791ce8d1d866 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:57:11 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 773e5c86-a86a-414d-aab4-8e13e0b68c1e has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Aug 17 11:57:11 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73449) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 11:57:11 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73449) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 11:57:12 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 11:57:12 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 11:57:12 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Compute_service record updated for user:user {{(pid=73449) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 11:57:12 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.559s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:57:12 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-f956aea2-3318-45e9-b90d-18546c575e3d tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.427s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:57:12 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-f956aea2-3318-45e9-b90d-18546c575e3d tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73449) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 11:57:12 user nova-compute[73449]: INFO nova.compute.claims [None req-f956aea2-3318-45e9-b90d-18546c575e3d tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 773e5c86-a86a-414d-aab4-8e13e0b68c1e] Claim successful on node user
Aug 17 11:57:12 user nova-compute[73449]: DEBUG nova.network.neutron [None req-96e242a7-56d4-4684-8b42-0617b722d056 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] Updating instance_info_cache with network_info: [{"id": "ea00b08a-3d80-453b-8c1a-9bdc74ac652f", "address": "fa:16:3e:d2:96:e4", "network": {"id": "9455bb75-f75a-41ff-8f6f-49f55aa738f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-425274599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec3b0b72e47448ebe99f9fc64119c1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea00b08a-3d", "ovs_interfaceid": "ea00b08a-3d80-453b-8c1a-9bdc74ac652f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:57:12 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-96e242a7-56d4-4684-8b42-0617b722d056 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Releasing lock "refresh_cache-31f5f3d2-41d8-4a26-9eb2-18b891f94734" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:57:12 user nova-compute[73449]: DEBUG nova.objects.instance [None req-96e242a7-56d4-4684-8b42-0617b722d056 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Lazy-loading 'flavor' on Instance uuid 31f5f3d2-41d8-4a26-9eb2-18b891f94734 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:57:12 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:57:12 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:57:12 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-f956aea2-3318-45e9-b90d-18546c575e3d tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 11:57:12 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-f956aea2-3318-45e9-b90d-18546c575e3d tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 11:57:12 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-f956aea2-3318-45e9-b90d-18546c575e3d tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.455s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:57:12 user nova-compute[73449]: DEBUG nova.compute.manager [None req-f956aea2-3318-45e9-b90d-18546c575e3d tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 773e5c86-a86a-414d-aab4-8e13e0b68c1e] Start building networks asynchronously for instance. {{(pid=73449) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 11:57:12 user nova-compute[73449]: DEBUG nova.compute.manager [req-5fa36a90-cfbf-41f3-be85-42f282db074c req-ead0186c-b044-4141-91de-aaaff41555d3 service nova] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] Received event network-vif-unplugged-ea00b08a-3d80-453b-8c1a-9bdc74ac652f {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:57:12 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-5fa36a90-cfbf-41f3-be85-42f282db074c req-ead0186c-b044-4141-91de-aaaff41555d3 service nova] Acquiring lock "31f5f3d2-41d8-4a26-9eb2-18b891f94734-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:57:12 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-5fa36a90-cfbf-41f3-be85-42f282db074c req-ead0186c-b044-4141-91de-aaaff41555d3 service nova] Lock "31f5f3d2-41d8-4a26-9eb2-18b891f94734-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:57:12 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-5fa36a90-cfbf-41f3-be85-42f282db074c req-ead0186c-b044-4141-91de-aaaff41555d3 service nova] Lock "31f5f3d2-41d8-4a26-9eb2-18b891f94734-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:57:12 user nova-compute[73449]: DEBUG nova.compute.manager [req-5fa36a90-cfbf-41f3-be85-42f282db074c req-ead0186c-b044-4141-91de-aaaff41555d3 service nova] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] No waiting events found dispatching network-vif-unplugged-ea00b08a-3d80-453b-8c1a-9bdc74ac652f {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:57:12 user nova-compute[73449]: WARNING nova.compute.manager [req-5fa36a90-cfbf-41f3-be85-42f282db074c req-ead0186c-b044-4141-91de-aaaff41555d3 service nova] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] Received unexpected event network-vif-unplugged-ea00b08a-3d80-453b-8c1a-9bdc74ac652f for instance with vm_state rescued and task_state unrescuing.
Aug 17 11:57:12 user nova-compute[73449]: DEBUG nova.compute.manager [None req-f956aea2-3318-45e9-b90d-18546c575e3d tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 773e5c86-a86a-414d-aab4-8e13e0b68c1e] Allocating IP information in the background. {{(pid=73449) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 11:57:12 user nova-compute[73449]: DEBUG nova.network.neutron [None req-f956aea2-3318-45e9-b90d-18546c575e3d tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 773e5c86-a86a-414d-aab4-8e13e0b68c1e] allocate_for_instance() {{(pid=73449) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 11:57:12 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-f956aea2-3318-45e9-b90d-18546c575e3d tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 773e5c86-a86a-414d-aab4-8e13e0b68c1e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 11:57:12 user nova-compute[73449]: DEBUG nova.compute.manager [None req-f956aea2-3318-45e9-b90d-18546c575e3d tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 773e5c86-a86a-414d-aab4-8e13e0b68c1e] Start building block device mappings for instance. {{(pid=73449) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 11:57:12 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:57:12 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:57:12 user nova-compute[73449]: DEBUG nova.policy [None req-f956aea2-3318-45e9-b90d-18546c575e3d tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '804ccb0440fb46a4a4c0ae65c3893296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd46cdaff7a4b40955f7c8a12c55452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73449) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 11:57:12 user nova-compute[73449]: INFO nova.virt.block_device [None req-f956aea2-3318-45e9-b90d-18546c575e3d tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 773e5c86-a86a-414d-aab4-8e13e0b68c1e] Booting with volume 2a343174-094b-4cd2-98cc-f215c047baf7 at /dev/vda
Aug 17 11:57:12 user nova-compute[73449]: DEBUG os_brick.utils [None req-f956aea2-3318-45e9-b90d-18546c575e3d tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 11:57:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:57:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:57:12 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[128dd09d-f08a-4544-a2d9-3205f42f8d71]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4d3924302012\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:57:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:57:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:57:12 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d755029-2c78-4be8-9484-f446614cf6f5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:57:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:57:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:57:12 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6492ecb-fca0-479e-80c3-d44bf425a4e2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:57:12 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[276df4a2-2725-4b60-9576-c340b27c2004]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:57:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-f956aea2-3318-45e9-b90d-18546c575e3d tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Running cmd (subprocess): nvme version {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:57:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-f956aea2-3318-45e9-b90d-18546c575e3d tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] 'nvme version' failed. Not Retrying. {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 11:57:12 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f956aea2-3318-45e9-b90d-18546c575e3d tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] nvme not present on system {{(pid=73449) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 11:57:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:57:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 11:57:12 user nova-compute[73449]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 11:57:12 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[06df92cd-ea3d-4f89-b9a3-5feda830629c]: (4, '') {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:57:12 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-f956aea2-3318-45e9-b90d-18546c575e3d tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73449) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 11:57:12 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-f956aea2-3318-45e9-b90d-18546c575e3d tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73449) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 11:57:13 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-f956aea2-3318-45e9-b90d-18546c575e3d tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] LIGHTOS: no hostnqn found. {{(pid=73449) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 11:57:13 user nova-compute[73449]: DEBUG os_brick.utils [None req-f956aea2-3318-45e9-b90d-18546c575e3d tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] <== get_connector_properties: return (160ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4d3924302012', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 11:57:13 user nova-compute[73449]: DEBUG nova.virt.block_device [None req-f956aea2-3318-45e9-b90d-18546c575e3d tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 773e5c86-a86a-414d-aab4-8e13e0b68c1e] Updating existing volume attachment record: e00480a0-c027-40a3-93c7-896c80ccb4bb {{(pid=73449) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 11:57:13 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] Instance destroyed successfully.
Aug 17 11:57:13 user nova-compute[73449]: DEBUG nova.network.neutron [None req-f956aea2-3318-45e9-b90d-18546c575e3d tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 773e5c86-a86a-414d-aab4-8e13e0b68c1e] Successfully created port: 4c8e383a-45a4-4c6a-858f-74a1b73e9e27 {{(pid=73449) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 11:57:13 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:57:14 user nova-compute[73449]: DEBUG nova.network.neutron [None req-f956aea2-3318-45e9-b90d-18546c575e3d tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 773e5c86-a86a-414d-aab4-8e13e0b68c1e] Successfully updated port: 4c8e383a-45a4-4c6a-858f-74a1b73e9e27 {{(pid=73449) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 11:57:14 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-f956aea2-3318-45e9-b90d-18546c575e3d tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Acquiring lock "refresh_cache-773e5c86-a86a-414d-aab4-8e13e0b68c1e" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:57:14 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-f956aea2-3318-45e9-b90d-18546c575e3d tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Acquired lock "refresh_cache-773e5c86-a86a-414d-aab4-8e13e0b68c1e" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:57:14 user nova-compute[73449]: DEBUG nova.network.neutron [None req-f956aea2-3318-45e9-b90d-18546c575e3d tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 773e5c86-a86a-414d-aab4-8e13e0b68c1e] Building network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 11:57:14 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:57:14 user nova-compute[73449]: DEBUG nova.compute.manager [req-f44fb83c-1e8a-47b3-8c86-7cbcf9c78397 req-20e51f2d-99ec-4e68-ae42-8fa4ee670db1 service nova] [instance: 773e5c86-a86a-414d-aab4-8e13e0b68c1e] Received event network-changed-4c8e383a-45a4-4c6a-858f-74a1b73e9e27 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:57:14 user nova-compute[73449]: DEBUG nova.compute.manager [req-f44fb83c-1e8a-47b3-8c86-7cbcf9c78397 req-20e51f2d-99ec-4e68-ae42-8fa4ee670db1 service nova] [instance: 773e5c86-a86a-414d-aab4-8e13e0b68c1e] Refreshing instance network info cache due to event network-changed-4c8e383a-45a4-4c6a-858f-74a1b73e9e27. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 11:57:14 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-f44fb83c-1e8a-47b3-8c86-7cbcf9c78397 req-20e51f2d-99ec-4e68-ae42-8fa4ee670db1 service nova] Acquiring lock "refresh_cache-773e5c86-a86a-414d-aab4-8e13e0b68c1e" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:57:14 user nova-compute[73449]: DEBUG nova.network.neutron [None req-f956aea2-3318-45e9-b90d-18546c575e3d tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 773e5c86-a86a-414d-aab4-8e13e0b68c1e] Instance cache missing network info. {{(pid=73449) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 11:57:14 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:57:14 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:57:14 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:57:14 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:57:14 user nova-compute[73449]: DEBUG nova.compute.manager [req-fdb299ee-52fa-4d45-9ccd-55a450b556d4 req-26230c05-e98f-4414-81f8-e46ed7c03a76 service nova] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] Received event network-vif-plugged-ea00b08a-3d80-453b-8c1a-9bdc74ac652f {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:57:14 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-fdb299ee-52fa-4d45-9ccd-55a450b556d4 req-26230c05-e98f-4414-81f8-e46ed7c03a76 service nova] Acquiring lock "31f5f3d2-41d8-4a26-9eb2-18b891f94734-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:57:14 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-fdb299ee-52fa-4d45-9ccd-55a450b556d4 req-26230c05-e98f-4414-81f8-e46ed7c03a76 service nova] Lock "31f5f3d2-41d8-4a26-9eb2-18b891f94734-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:57:14 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-fdb299ee-52fa-4d45-9ccd-55a450b556d4 req-26230c05-e98f-4414-81f8-e46ed7c03a76 service nova] Lock "31f5f3d2-41d8-4a26-9eb2-18b891f94734-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:57:14 user nova-compute[73449]: DEBUG nova.compute.manager [req-fdb299ee-52fa-4d45-9ccd-55a450b556d4 req-26230c05-e98f-4414-81f8-e46ed7c03a76 service nova] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] No waiting events found dispatching network-vif-plugged-ea00b08a-3d80-453b-8c1a-9bdc74ac652f {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:57:14 user nova-compute[73449]: WARNING nova.compute.manager [req-fdb299ee-52fa-4d45-9ccd-55a450b556d4 req-26230c05-e98f-4414-81f8-e46ed7c03a76 service nova] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] Received unexpected event network-vif-plugged-ea00b08a-3d80-453b-8c1a-9bdc74ac652f for instance with vm_state rescued and task_state unrescuing.
Aug 17 11:57:14 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:57:14 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:57:14 user nova-compute[73449]: DEBUG nova.network.neutron [None req-f956aea2-3318-45e9-b90d-18546c575e3d tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 773e5c86-a86a-414d-aab4-8e13e0b68c1e] Updating instance_info_cache with network_info: [{"id": "4c8e383a-45a4-4c6a-858f-74a1b73e9e27", "address": "fa:16:3e:40:4b:d5", "network": {"id": "a9e8fcd6-4152-466b-99ad-44b85db05a05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-920564935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bd46cdaff7a4b40955f7c8a12c55452", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c8e383a-45", "ovs_interfaceid": "4c8e383a-45a4-4c6a-858f-74a1b73e9e27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:57:14 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-f956aea2-3318-45e9-b90d-18546c575e3d tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Releasing lock "refresh_cache-773e5c86-a86a-414d-aab4-8e13e0b68c1e" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:57:14 user nova-compute[73449]: DEBUG nova.compute.manager [None req-f956aea2-3318-45e9-b90d-18546c575e3d tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 773e5c86-a86a-414d-aab4-8e13e0b68c1e] Instance network_info: |[{"id": "4c8e383a-45a4-4c6a-858f-74a1b73e9e27", "address": "fa:16:3e:40:4b:d5", "network": {"id": "a9e8fcd6-4152-466b-99ad-44b85db05a05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-920564935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bd46cdaff7a4b40955f7c8a12c55452", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c8e383a-45", "ovs_interfaceid": "4c8e383a-45a4-4c6a-858f-74a1b73e9e27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73449) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 11:57:14 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-f44fb83c-1e8a-47b3-8c86-7cbcf9c78397 req-20e51f2d-99ec-4e68-ae42-8fa4ee670db1 service nova] Acquired lock "refresh_cache-773e5c86-a86a-414d-aab4-8e13e0b68c1e" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:57:14 user nova-compute[73449]: DEBUG nova.network.neutron [req-f44fb83c-1e8a-47b3-8c86-7cbcf9c78397 req-20e51f2d-99ec-4e68-ae42-8fa4ee670db1 service nova] [instance: 773e5c86-a86a-414d-aab4-8e13e0b68c1e] Refreshing network info cache for port 4c8e383a-45a4-4c6a-858f-74a1b73e9e27 {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 11:57:15 user nova-compute[73449]: DEBUG nova.network.neutron [req-f44fb83c-1e8a-47b3-8c86-7cbcf9c78397 req-20e51f2d-99ec-4e68-ae42-8fa4ee670db1 service nova] [instance: 773e5c86-a86a-414d-aab4-8e13e0b68c1e] Updated VIF entry in instance network info cache for port 4c8e383a-45a4-4c6a-858f-74a1b73e9e27. {{(pid=73449) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 11:57:15 user nova-compute[73449]: DEBUG nova.network.neutron [req-f44fb83c-1e8a-47b3-8c86-7cbcf9c78397 req-20e51f2d-99ec-4e68-ae42-8fa4ee670db1 service nova] [instance: 773e5c86-a86a-414d-aab4-8e13e0b68c1e] Updating instance_info_cache with network_info: [{"id": "4c8e383a-45a4-4c6a-858f-74a1b73e9e27", "address": "fa:16:3e:40:4b:d5", "network": {"id": "a9e8fcd6-4152-466b-99ad-44b85db05a05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-920564935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bd46cdaff7a4b40955f7c8a12c55452", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c8e383a-45", "ovs_interfaceid": "4c8e383a-45a4-4c6a-858f-74a1b73e9e27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:57:15 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-f44fb83c-1e8a-47b3-8c86-7cbcf9c78397 req-20e51f2d-99ec-4e68-ae42-8fa4ee670db1 service nova] Releasing lock "refresh_cache-773e5c86-a86a-414d-aab4-8e13e0b68c1e" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:57:16 user nova-compute[73449]: DEBUG nova.compute.manager [req-3b9494e8-12b0-4599-b377-a43356d50042 req-ed942deb-00f9-40d4-bd02-6fdf2a802c24 service nova] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] Received event network-vif-plugged-ea00b08a-3d80-453b-8c1a-9bdc74ac652f {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:57:16 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-3b9494e8-12b0-4599-b377-a43356d50042 req-ed942deb-00f9-40d4-bd02-6fdf2a802c24 service nova] Acquiring lock "31f5f3d2-41d8-4a26-9eb2-18b891f94734-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:57:16 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-3b9494e8-12b0-4599-b377-a43356d50042 req-ed942deb-00f9-40d4-bd02-6fdf2a802c24 service nova] Lock "31f5f3d2-41d8-4a26-9eb2-18b891f94734-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:57:16 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-3b9494e8-12b0-4599-b377-a43356d50042 req-ed942deb-00f9-40d4-bd02-6fdf2a802c24 service nova] Lock "31f5f3d2-41d8-4a26-9eb2-18b891f94734-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:57:16 user nova-compute[73449]: DEBUG nova.compute.manager [req-3b9494e8-12b0-4599-b377-a43356d50042 req-ed942deb-00f9-40d4-bd02-6fdf2a802c24 service nova] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] No waiting events found dispatching network-vif-plugged-ea00b08a-3d80-453b-8c1a-9bdc74ac652f {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:57:16 user nova-compute[73449]: WARNING nova.compute.manager [req-3b9494e8-12b0-4599-b377-a43356d50042 req-ed942deb-00f9-40d4-bd02-6fdf2a802c24 service nova] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] Received unexpected event network-vif-plugged-ea00b08a-3d80-453b-8c1a-9bdc74ac652f for instance with vm_state rescued and task_state unrescuing.
Aug 17 11:57:16 user nova-compute[73449]: DEBUG nova.compute.manager [req-3b9494e8-12b0-4599-b377-a43356d50042 req-ed942deb-00f9-40d4-bd02-6fdf2a802c24 service nova] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] Received event network-vif-plugged-ea00b08a-3d80-453b-8c1a-9bdc74ac652f {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:57:16 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-3b9494e8-12b0-4599-b377-a43356d50042 req-ed942deb-00f9-40d4-bd02-6fdf2a802c24 service nova] Acquiring lock "31f5f3d2-41d8-4a26-9eb2-18b891f94734-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:57:16 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-3b9494e8-12b0-4599-b377-a43356d50042 req-ed942deb-00f9-40d4-bd02-6fdf2a802c24 service nova] Lock "31f5f3d2-41d8-4a26-9eb2-18b891f94734-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:57:16 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-3b9494e8-12b0-4599-b377-a43356d50042 req-ed942deb-00f9-40d4-bd02-6fdf2a802c24 service nova] Lock "31f5f3d2-41d8-4a26-9eb2-18b891f94734-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:57:16 user nova-compute[73449]: DEBUG nova.compute.manager [req-3b9494e8-12b0-4599-b377-a43356d50042 req-ed942deb-00f9-40d4-bd02-6fdf2a802c24 service nova] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] No waiting events found dispatching network-vif-plugged-ea00b08a-3d80-453b-8c1a-9bdc74ac652f {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:57:16 user nova-compute[73449]: WARNING nova.compute.manager [req-3b9494e8-12b0-4599-b377-a43356d50042 req-ed942deb-00f9-40d4-bd02-6fdf2a802c24 service nova] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] Received unexpected event network-vif-plugged-ea00b08a-3d80-453b-8c1a-9bdc74ac652f for instance with vm_state rescued and task_state unrescuing.
Aug 17 11:57:16 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Removed pending event for 31f5f3d2-41d8-4a26-9eb2-18b891f94734 due to event {{(pid=73449) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 17 11:57:16 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692273436.8098657, 31f5f3d2-41d8-4a26-9eb2-18b891f94734 => Resumed> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:57:16 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] VM Resumed (Lifecycle Event)
Aug 17 11:57:16 user nova-compute[73449]: DEBUG nova.compute.manager [None req-96e242a7-56d4-4684-8b42-0617b722d056 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:57:16 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:57:16 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 11:57:16 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 17 11:57:16 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692273436.8144495, 31f5f3d2-41d8-4a26-9eb2-18b891f94734 => Started> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:57:16 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] VM Started (Lifecycle Event)
Aug 17 11:57:16 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:57:16 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 11:57:18 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:57:19 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:57:23 user nova-compute[73449]: INFO nova.compute.manager [None req-a845c36e-eee1-4761-b673-3180979a0b9d tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] Get console output
Aug 17 11:57:23 user nova-compute[73449]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Aug 17 11:57:23 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:57:24 user nova-compute[73449]: DEBUG nova.compute.manager [None req-f956aea2-3318-45e9-b90d-18546c575e3d tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 773e5c86-a86a-414d-aab4-8e13e0b68c1e] Start spawning the instance on the hypervisor. {{(pid=73449) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 11:57:24 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-f956aea2-3318-45e9-b90d-18546c575e3d tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 773e5c86-a86a-414d-aab4-8e13e0b68c1e] Creating instance directory {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 11:57:24 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-f956aea2-3318-45e9-b90d-18546c575e3d tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 773e5c86-a86a-414d-aab4-8e13e0b68c1e] Creating image(s)
Aug 17 11:57:24 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-f956aea2-3318-45e9-b90d-18546c575e3d tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 773e5c86-a86a-414d-aab4-8e13e0b68c1e] Did not create local disks {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 11:57:24 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-f956aea2-3318-45e9-b90d-18546c575e3d tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 773e5c86-a86a-414d-aab4-8e13e0b68c1e] Ensure instance console log exists: /opt/stack/data/nova/instances/773e5c86-a86a-414d-aab4-8e13e0b68c1e/console.log {{(pid=73449) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 11:57:24 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-f956aea2-3318-45e9-b90d-18546c575e3d tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:57:24 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-f956aea2-3318-45e9-b90d-18546c575e3d tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:57:24 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-f956aea2-3318-45e9-b90d-18546c575e3d tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:57:24 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-f956aea2-3318-45e9-b90d-18546c575e3d tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 773e5c86-a86a-414d-aab4-8e13e0b68c1e] Start _get_guest_xml network_info=[{"id": "4c8e383a-45a4-4c6a-858f-74a1b73e9e27", "address": "fa:16:3e:40:4b:d5", "network": {"id": "a9e8fcd6-4152-466b-99ad-44b85db05a05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-920564935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bd46cdaff7a4b40955f7c8a12c55452", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c8e383a-45", "ovs_interfaceid": "4c8e383a-45a4-4c6a-858f-74a1b73e9e27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'attachment_id': 'e00480a0-c027-40a3-93c7-896c80ccb4bb', 'boot_index': 0, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CtHUhuMp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '773e5c86-a86a-414d-aab4-8e13e0b68c1e', 'attached_at': '', 'detached_at': '', 'volume_id': '2a343174-094b-4cd2-98cc-f215c047baf7', 'serial': '2a343174-094b-4cd2-98cc-f215c047baf7'}, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 11:57:24 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-f956aea2-3318-45e9-b90d-18546c575e3d tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:57:24 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-f956aea2-3318-45e9-b90d-18546c575e3d tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:57:24 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:57:24 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-f956aea2-3318-45e9-b90d-18546c575e3d tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 11:57:24 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-f956aea2-3318-45e9-b90d-18546c575e3d tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] CPU controller missing on host. {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 11:57:24 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-f956aea2-3318-45e9-b90d-18546c575e3d tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 11:57:24 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-f956aea2-3318-45e9-b90d-18546c575e3d tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] CPU controller found on host. {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 11:57:24 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-f956aea2-3318-45e9-b90d-18546c575e3d tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73449) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 11:57:24 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-f956aea2-3318-45e9-b90d-18546c575e3d tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T11:35:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 11:57:24 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-f956aea2-3318-45e9-b90d-18546c575e3d tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Flavor limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 11:57:24 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-f956aea2-3318-45e9-b90d-18546c575e3d tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Image limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 11:57:24 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-f956aea2-3318-45e9-b90d-18546c575e3d tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Flavor pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 11:57:24 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-f956aea2-3318-45e9-b90d-18546c575e3d tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Image pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 11:57:24 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-f956aea2-3318-45e9-b90d-18546c575e3d tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 11:57:24 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-f956aea2-3318-45e9-b90d-18546c575e3d tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 11:57:24 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-f956aea2-3318-45e9-b90d-18546c575e3d tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 11:57:24 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-f956aea2-3318-45e9-b90d-18546c575e3d tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Got 1 possible topologies {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 11:57:24 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-f956aea2-3318-45e9-b90d-18546c575e3d tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 11:57:24 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-f956aea2-3318-45e9-b90d-18546c575e3d tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 11:57:24 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f956aea2-3318-45e9-b90d-18546c575e3d tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 773e5c86-a86a-414d-aab4-8e13e0b68c1e] Calling os-brick to attach iSCSI Volume {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 11:57:24 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-f956aea2-3318-45e9-b90d-18546c575e3d tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CtHUhuMp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 11:57:24 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-f956aea2-3318-45e9-b90d-18546c575e3d tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 11:57:24 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-f956aea2-3318-45e9-b90d-18546c575e3d tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:57:24 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-f956aea2-3318-45e9-b90d-18546c575e3d tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:57:24 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-f956aea2-3318-45e9-b90d-18546c575e3d tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 11:57:24 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-f956aea2-3318-45e9-b90d-18546c575e3d tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:57:24 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-f956aea2-3318-45e9-b90d-18546c575e3d tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:57:24 user nova-compute[73449]: INFO os_brick.initiator.connectors.iscsi [None req-f956aea2-3318-45e9-b90d-18546c575e3d tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 11:57:24 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7 -p 172.16.0.220:3260 {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:57:24 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:57:24 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3e8202f-ed76-4877-8d1c-bde7fd4bf0dd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:57:24 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-f956aea2-3318-45e9-b90d-18546c575e3d tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 11:57:24 user nova-compute[73449]:  {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:57:24 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7 -p 172.16.0.220:3260 --interface default --op new {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:57:24 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:57:24 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[8072ad5e-7b85-48ba-b21f-a10635a2686c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7] added\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:57:24 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-f956aea2-3318-45e9-b90d-18546c575e3d tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7] added
Aug 17 11:57:24 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:57:24 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:57:24 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:57:24 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f5442a3-fad1-478f-b6f7-32d1e499a6da]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:57:24 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-f956aea2-3318-45e9-b90d-18546c575e3d tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:57:24 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:57:24 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:57:24 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e58b524-e27b-40d9-84b0-b152360dd2a2]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:57:24 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-f956aea2-3318-45e9-b90d-18546c575e3d tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:57:24 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CtHUhuMp {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:57:24 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CtHUhuMp" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:57:24 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[3307426c-c6de-43ca-b683-e5bfa3ea502c]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:57:24 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-f956aea2-3318-45e9-b90d-18546c575e3d tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CtHUhuMp'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:57:24 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:57:24 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:57:24 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[d90c1f0e-4f39-403a-9624-215c771e6a73]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:57:24 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-f956aea2-3318-45e9-b90d-18546c575e3d tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:57:24 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:57:24 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:57:24 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[f34ac8f5-9a8e-4033-93a0-e249890072cb]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e360063-8525-4d62-8fa0-33c5062fc247 (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:57:24 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-f956aea2-3318-45e9-b90d-18546c575e3d tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)
Aug 17 11:57:24 user nova-compute[73449]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 (non-flash)
Aug 17 11:57:24 user nova-compute[73449]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e360063-8525-4d62-8fa0-33c5062fc247 (non-flash)
Aug 17 11:57:24 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:57:24 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-f956aea2-3318-45e9-b90d-18546c575e3d tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)
Aug 17 11:57:24 user nova-compute[73449]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 (non-flash)
Aug 17 11:57:24 user nova-compute[73449]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e360063-8525-4d62-8fa0-33c5062fc247 (non-flash)
Aug 17 11:57:24 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:57:24 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7 -p 172.16.0.220:3260 --login {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:57:24 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:57:24 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0dc398f-8b59-4809-8491-47ab4a41b7f0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:57:24 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-f956aea2-3318-45e9-b90d-18546c575e3d tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7, portal: 172.16.0.220,3260]
Aug 17 11:57:24 user nova-compute[73449]: Login to [iface: default, target: iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7, portal: 172.16.0.220,3260] successful.
Aug 17 11:57:24 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:57:24 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:57:24 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:57:24 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfed382a-f510-40ce-af3c-f524f9deb68a]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:57:24 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-f956aea2-3318-45e9-b90d-18546c575e3d tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:57:24 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:57:24 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:57:24 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb6151d0-8c90-4546-91d3-845b370d8401]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e360063-8525-4d62-8fa0-33c5062fc247 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7 (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:57:24 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-f956aea2-3318-45e9-b90d-18546c575e3d tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)
Aug 17 11:57:24 user nova-compute[73449]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 (non-flash)
Aug 17 11:57:24 user nova-compute[73449]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e360063-8525-4d62-8fa0-33c5062fc247 (non-flash)
Aug 17 11:57:24 user nova-compute[73449]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7 (non-flash)
Aug 17 11:57:24 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:57:24 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-f956aea2-3318-45e9-b90d-18546c575e3d tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)
Aug 17 11:57:24 user nova-compute[73449]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 (non-flash)
Aug 17 11:57:24 user nova-compute[73449]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e360063-8525-4d62-8fa0-33c5062fc247 (non-flash)
Aug 17 11:57:24 user nova-compute[73449]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7 (non-flash)
Aug 17 11:57:24 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:57:24 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-f956aea2-3318-45e9-b90d-18546c575e3d tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:57:24 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-f956aea2-3318-45e9-b90d-18546c575e3d tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Connected to 172.16.0.220:3260 {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 11:57:24 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-f956aea2-3318-45e9-b90d-18546c575e3d tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] HCTL ('34', '-', '-', 0) found on session 43 with lun 0 {{(pid=73449) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 11:57:24 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-f956aea2-3318-45e9-b90d-18546c575e3d tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73449) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 11:57:24 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:57:24 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:57:24 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[c70b34c5-f7be-454c-8201-a5b8a3af86dd]: (4, ('- - 0', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:57:24 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-f956aea2-3318-45e9-b90d-18546c575e3d tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Searching for a device in session 43 and hctl ['34', '*', '*', 0] yield: None {{(pid=73449) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 11:57:25 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-f956aea2-3318-45e9-b90d-18546c575e3d tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Searching for a device in session 43 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73449) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 11:57:25 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-f956aea2-3318-45e9-b90d-18546c575e3d tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CtHUhuMp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 11:57:25 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-f956aea2-3318-45e9-b90d-18546c575e3d tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:57:25 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-f956aea2-3318-45e9-b90d-18546c575e3d tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '23234616162363133', 'path': '/dev/sdc'} {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 11:57:25 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f956aea2-3318-45e9-b90d-18546c575e3d tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 773e5c86-a86a-414d-aab4-8e13e0b68c1e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23234616162363133', 'path': '/dev/sdc'} {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 11:57:25 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-f956aea2-3318-45e9-b90d-18546c575e3d tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:57:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-98386620',display_name='tempest-TestVolumeBootPattern-server-98386620',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-98386620',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIHMstqa6z3yCDWSo0nI/hXtJfgb+1MPwAN30vhg6KwDR8sZaSoGZeJ4pbZmuMNqk20Z45pPhufbqYZm+wNKDW7ChjAcmHiitPsVRUAo/TWnRjbFauozfEZ44NXHQWQQfg==',key_name='tempest-TestVolumeBootPattern-29823023',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4bd46cdaff7a4b40955f7c8a12c55452',ramdisk_id='',reservation_id='r-bi01ccir',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-813872552',owner_user_name='tempest-TestVolumeBootPattern-813872552-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T11:57:13Z,user_data=None,user_id='804ccb0440fb46a4a4c0ae65c3893296',uuid=773e5c86-a86a-414d-aab4-8e13e0b68c1e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4c8e383a-45a4-4c6a-858f-74a1b73e9e27", "address": "fa:16:3e:40:4b:d5", "network": {"id": "a9e8fcd6-4152-466b-99ad-44b85db05a05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-920564935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bd46cdaff7a4b40955f7c8a12c55452", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c8e383a-45", "ovs_interfaceid": "4c8e383a-45a4-4c6a-858f-74a1b73e9e27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73449) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 11:57:25 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-f956aea2-3318-45e9-b90d-18546c575e3d tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Converting VIF {"id": "4c8e383a-45a4-4c6a-858f-74a1b73e9e27", "address": "fa:16:3e:40:4b:d5", "network": {"id": "a9e8fcd6-4152-466b-99ad-44b85db05a05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-920564935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bd46cdaff7a4b40955f7c8a12c55452", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c8e383a-45", "ovs_interfaceid": "4c8e383a-45a4-4c6a-858f-74a1b73e9e27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:57:25 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-f956aea2-3318-45e9-b90d-18546c575e3d tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:4b:d5,bridge_name='br-int',has_traffic_filtering=True,id=4c8e383a-45a4-4c6a-858f-74a1b73e9e27,network=Network(a9e8fcd6-4152-466b-99ad-44b85db05a05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c8e383a-45') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:57:25 user nova-compute[73449]: DEBUG nova.objects.instance [None req-f956aea2-3318-45e9-b90d-18546c575e3d tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Lazy-loading 'pci_devices' on Instance uuid 773e5c86-a86a-414d-aab4-8e13e0b68c1e {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:57:25 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-f956aea2-3318-45e9-b90d-18546c575e3d tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 773e5c86-a86a-414d-aab4-8e13e0b68c1e] End _get_guest_xml xml=<domain type="kvm">
Aug 17 11:57:25 user nova-compute[73449]:   <uuid>773e5c86-a86a-414d-aab4-8e13e0b68c1e</uuid>
Aug 17 11:57:25 user nova-compute[73449]:   <name>instance-00000025</name>
Aug 17 11:57:25 user nova-compute[73449]:   <memory>524288</memory>
Aug 17 11:57:25 user nova-compute[73449]:   <vcpu>1</vcpu>
Aug 17 11:57:25 user nova-compute[73449]:   <metadata>
Aug 17 11:57:25 user nova-compute[73449]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 11:57:25 user nova-compute[73449]:       <nova:package version="0.0.0"/>
Aug 17 11:57:25 user nova-compute[73449]:       <nova:name>tempest-TestVolumeBootPattern-server-98386620</nova:name>
Aug 17 11:57:25 user nova-compute[73449]:       <nova:creationTime>2023-08-17 11:57:24</nova:creationTime>
Aug 17 11:57:25 user nova-compute[73449]:       <nova:flavor name="m1.tiny">
Aug 17 11:57:25 user nova-compute[73449]:         <nova:memory>512</nova:memory>
Aug 17 11:57:25 user nova-compute[73449]:         <nova:disk>1</nova:disk>
Aug 17 11:57:25 user nova-compute[73449]:         <nova:swap>0</nova:swap>
Aug 17 11:57:25 user nova-compute[73449]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 11:57:25 user nova-compute[73449]:         <nova:vcpus>1</nova:vcpus>
Aug 17 11:57:25 user nova-compute[73449]:       </nova:flavor>
Aug 17 11:57:25 user nova-compute[73449]:       <nova:owner>
Aug 17 11:57:25 user nova-compute[73449]:         <nova:user uuid="804ccb0440fb46a4a4c0ae65c3893296">tempest-TestVolumeBootPattern-813872552-project-member</nova:user>
Aug 17 11:57:25 user nova-compute[73449]:         <nova:project uuid="4bd46cdaff7a4b40955f7c8a12c55452">tempest-TestVolumeBootPattern-813872552</nova:project>
Aug 17 11:57:25 user nova-compute[73449]:       </nova:owner>
Aug 17 11:57:25 user nova-compute[73449]:       <nova:ports>
Aug 17 11:57:25 user nova-compute[73449]:         <nova:port uuid="4c8e383a-45a4-4c6a-858f-74a1b73e9e27">
Aug 17 11:57:25 user nova-compute[73449]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 17 11:57:25 user nova-compute[73449]:         </nova:port>
Aug 17 11:57:25 user nova-compute[73449]:       </nova:ports>
Aug 17 11:57:25 user nova-compute[73449]:     </nova:instance>
Aug 17 11:57:25 user nova-compute[73449]:   </metadata>
Aug 17 11:57:25 user nova-compute[73449]:   <sysinfo type="smbios">
Aug 17 11:57:25 user nova-compute[73449]:     <system>
Aug 17 11:57:25 user nova-compute[73449]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 11:57:25 user nova-compute[73449]:       <entry name="product">OpenStack Nova</entry>
Aug 17 11:57:25 user nova-compute[73449]:       <entry name="version">0.0.0</entry>
Aug 17 11:57:25 user nova-compute[73449]:       <entry name="serial">773e5c86-a86a-414d-aab4-8e13e0b68c1e</entry>
Aug 17 11:57:25 user nova-compute[73449]:       <entry name="uuid">773e5c86-a86a-414d-aab4-8e13e0b68c1e</entry>
Aug 17 11:57:25 user nova-compute[73449]:       <entry name="family">Virtual Machine</entry>
Aug 17 11:57:25 user nova-compute[73449]:     </system>
Aug 17 11:57:25 user nova-compute[73449]:   </sysinfo>
Aug 17 11:57:25 user nova-compute[73449]:   <os>
Aug 17 11:57:25 user nova-compute[73449]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 11:57:25 user nova-compute[73449]:     <boot dev="hd"/>
Aug 17 11:57:25 user nova-compute[73449]:     <smbios mode="sysinfo"/>
Aug 17 11:57:25 user nova-compute[73449]:   </os>
Aug 17 11:57:25 user nova-compute[73449]:   <features>
Aug 17 11:57:25 user nova-compute[73449]:     <acpi/>
Aug 17 11:57:25 user nova-compute[73449]:     <apic/>
Aug 17 11:57:25 user nova-compute[73449]:     <vmcoreinfo/>
Aug 17 11:57:25 user nova-compute[73449]:   </features>
Aug 17 11:57:25 user nova-compute[73449]:   <clock offset="utc">
Aug 17 11:57:25 user nova-compute[73449]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 11:57:25 user nova-compute[73449]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 11:57:25 user nova-compute[73449]:     <timer name="hpet" present="no"/>
Aug 17 11:57:25 user nova-compute[73449]:   </clock>
Aug 17 11:57:25 user nova-compute[73449]:   <cpu mode="custom" match="exact">
Aug 17 11:57:25 user nova-compute[73449]:     <model>Nehalem</model>
Aug 17 11:57:25 user nova-compute[73449]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 11:57:25 user nova-compute[73449]:   </cpu>
Aug 17 11:57:25 user nova-compute[73449]:   <devices>
Aug 17 11:57:25 user nova-compute[73449]:     <disk type="block" device="disk">
Aug 17 11:57:25 user nova-compute[73449]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 11:57:25 user nova-compute[73449]:       <source dev="/dev/sdc"/>
Aug 17 11:57:25 user nova-compute[73449]:       <target dev="vda" bus="virtio"/>
Aug 17 11:57:25 user nova-compute[73449]:       <serial>2a343174-094b-4cd2-98cc-f215c047baf7</serial>
Aug 17 11:57:25 user nova-compute[73449]:     </disk>
Aug 17 11:57:25 user nova-compute[73449]:     <interface type="ethernet">
Aug 17 11:57:25 user nova-compute[73449]:       <mac address="fa:16:3e:40:4b:d5"/>
Aug 17 11:57:25 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 11:57:25 user nova-compute[73449]:       <mtu size="1442"/>
Aug 17 11:57:25 user nova-compute[73449]:       <target dev="tap4c8e383a-45"/>
Aug 17 11:57:25 user nova-compute[73449]:     </interface>
Aug 17 11:57:25 user nova-compute[73449]:     <serial type="pty">
Aug 17 11:57:25 user nova-compute[73449]:       <log file="/opt/stack/data/nova/instances/773e5c86-a86a-414d-aab4-8e13e0b68c1e/console.log" append="off"/>
Aug 17 11:57:25 user nova-compute[73449]:     </serial>
Aug 17 11:57:25 user nova-compute[73449]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 11:57:25 user nova-compute[73449]:     <video>
Aug 17 11:57:25 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 11:57:25 user nova-compute[73449]:     </video>
Aug 17 11:57:25 user nova-compute[73449]:     <rng model="virtio">
Aug 17 11:57:25 user nova-compute[73449]:       <backend model="random">/dev/urandom</backend>
Aug 17 11:57:25 user nova-compute[73449]:     </rng>
Aug 17 11:57:25 user nova-compute[73449]:     <controller type="usb" index="0" model="none"/>
Aug 17 11:57:25 user nova-compute[73449]:     <memballoon model="virtio">
Aug 17 11:57:25 user nova-compute[73449]:       <stats period="10"/>
Aug 17 11:57:25 user nova-compute[73449]:     </memballoon>
Aug 17 11:57:25 user nova-compute[73449]:   </devices>
Aug 17 11:57:25 user nova-compute[73449]: </domain>
Aug 17 11:57:25 user nova-compute[73449]:  {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 11:57:25 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-f956aea2-3318-45e9-b90d-18546c575e3d tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:57:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-98386620',display_name='tempest-TestVolumeBootPattern-server-98386620',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-98386620',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIHMstqa6z3yCDWSo0nI/hXtJfgb+1MPwAN30vhg6KwDR8sZaSoGZeJ4pbZmuMNqk20Z45pPhufbqYZm+wNKDW7ChjAcmHiitPsVRUAo/TWnRjbFauozfEZ44NXHQWQQfg==',key_name='tempest-TestVolumeBootPattern-29823023',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4bd46cdaff7a4b40955f7c8a12c55452',ramdisk_id='',reservation_id='r-bi01ccir',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-813872552',owner_user_name='tempest-TestVolumeBootPattern-813872552-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T11:57:13Z,user_data=None,user_id='804ccb0440fb46a4a4c0ae65c3893296',uuid=773e5c86-a86a-414d-aab4-8e13e0b68c1e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4c8e383a-45a4-4c6a-858f-74a1b73e9e27", "address": "fa:16:3e:40:4b:d5", "network": {"id": "a9e8fcd6-4152-466b-99ad-44b85db05a05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-920564935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bd46cdaff7a4b40955f7c8a12c55452", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c8e383a-45", "ovs_interfaceid": "4c8e383a-45a4-4c6a-858f-74a1b73e9e27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 11:57:25 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-f956aea2-3318-45e9-b90d-18546c575e3d tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Converting VIF {"id": "4c8e383a-45a4-4c6a-858f-74a1b73e9e27", "address": "fa:16:3e:40:4b:d5", "network": {"id": "a9e8fcd6-4152-466b-99ad-44b85db05a05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-920564935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bd46cdaff7a4b40955f7c8a12c55452", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c8e383a-45", "ovs_interfaceid": "4c8e383a-45a4-4c6a-858f-74a1b73e9e27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:57:25 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-f956aea2-3318-45e9-b90d-18546c575e3d tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:4b:d5,bridge_name='br-int',has_traffic_filtering=True,id=4c8e383a-45a4-4c6a-858f-74a1b73e9e27,network=Network(a9e8fcd6-4152-466b-99ad-44b85db05a05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c8e383a-45') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:57:25 user nova-compute[73449]: DEBUG os_vif [None req-f956aea2-3318-45e9-b90d-18546c575e3d tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:4b:d5,bridge_name='br-int',has_traffic_filtering=True,id=4c8e383a-45a4-4c6a-858f-74a1b73e9e27,network=Network(a9e8fcd6-4152-466b-99ad-44b85db05a05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c8e383a-45') {{(pid=73449) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 11:57:25 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:57:25 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:57:25 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 11:57:25 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:57:25 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4c8e383a-45, may_exist=True, interface_attrs={}) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:57:25 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4c8e383a-45, col_values=(('external_ids', {'iface-id': '4c8e383a-45a4-4c6a-858f-74a1b73e9e27', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:40:4b:d5', 'vm-uuid': '773e5c86-a86a-414d-aab4-8e13e0b68c1e'}),), if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:57:25 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:57:25 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:57:25 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:57:25 user nova-compute[73449]: INFO os_vif [None req-f956aea2-3318-45e9-b90d-18546c575e3d tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:4b:d5,bridge_name='br-int',has_traffic_filtering=True,id=4c8e383a-45a4-4c6a-858f-74a1b73e9e27,network=Network(a9e8fcd6-4152-466b-99ad-44b85db05a05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c8e383a-45')
Aug 17 11:57:25 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-f956aea2-3318-45e9-b90d-18546c575e3d tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] No BDM found with device name vda, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 11:57:25 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-f956aea2-3318-45e9-b90d-18546c575e3d tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] No VIF found with MAC fa:16:3e:40:4b:d5, not building metadata {{(pid=73449) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 11:57:26 user nova-compute[73449]: DEBUG nova.compute.manager [req-2a9adfdf-a256-4b02-b758-b76b9b7d9bc3 req-1015327b-05b3-4207-ae3b-6dda6b18a66b service nova] [instance: 9e68a702-ead5-47ae-9375-5cd00b947ef4] Received event network-changed-f4c80486-3b7b-4bcc-9593-04a46766dc36 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:57:26 user nova-compute[73449]: DEBUG nova.compute.manager [req-2a9adfdf-a256-4b02-b758-b76b9b7d9bc3 req-1015327b-05b3-4207-ae3b-6dda6b18a66b service nova] [instance: 9e68a702-ead5-47ae-9375-5cd00b947ef4] Refreshing instance network info cache due to event network-changed-f4c80486-3b7b-4bcc-9593-04a46766dc36. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 11:57:26 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-2a9adfdf-a256-4b02-b758-b76b9b7d9bc3 req-1015327b-05b3-4207-ae3b-6dda6b18a66b service nova] Acquiring lock "refresh_cache-9e68a702-ead5-47ae-9375-5cd00b947ef4" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:57:26 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-2a9adfdf-a256-4b02-b758-b76b9b7d9bc3 req-1015327b-05b3-4207-ae3b-6dda6b18a66b service nova] Acquired lock "refresh_cache-9e68a702-ead5-47ae-9375-5cd00b947ef4" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:57:26 user nova-compute[73449]: DEBUG nova.network.neutron [req-2a9adfdf-a256-4b02-b758-b76b9b7d9bc3 req-1015327b-05b3-4207-ae3b-6dda6b18a66b service nova] [instance: 9e68a702-ead5-47ae-9375-5cd00b947ef4] Refreshing network info cache for port f4c80486-3b7b-4bcc-9593-04a46766dc36 {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 11:57:26 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-94952b7b-dd10-440b-bb4d-912cd3dd4fb2 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Acquiring lock "9e68a702-ead5-47ae-9375-5cd00b947ef4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:57:26 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-94952b7b-dd10-440b-bb4d-912cd3dd4fb2 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Lock "9e68a702-ead5-47ae-9375-5cd00b947ef4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:57:26 user nova-compute[73449]: DEBUG nova.objects.instance [None req-94952b7b-dd10-440b-bb4d-912cd3dd4fb2 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Lazy-loading 'flavor' on Instance uuid 9e68a702-ead5-47ae-9375-5cd00b947ef4 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:57:26 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-94952b7b-dd10-440b-bb4d-912cd3dd4fb2 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] [instance: 9e68a702-ead5-47ae-9375-5cd00b947ef4] Ignoring supplied device name: /dev/vdb
Aug 17 11:57:26 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-94952b7b-dd10-440b-bb4d-912cd3dd4fb2 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Lock "9e68a702-ead5-47ae-9375-5cd00b947ef4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:57:26 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-94952b7b-dd10-440b-bb4d-912cd3dd4fb2 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Acquiring lock "9e68a702-ead5-47ae-9375-5cd00b947ef4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:57:26 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-94952b7b-dd10-440b-bb4d-912cd3dd4fb2 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Lock "9e68a702-ead5-47ae-9375-5cd00b947ef4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:57:26 user nova-compute[73449]: INFO nova.compute.manager [None req-94952b7b-dd10-440b-bb4d-912cd3dd4fb2 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] [instance: 9e68a702-ead5-47ae-9375-5cd00b947ef4] Attaching volume 8418d863-920b-4e8e-b7c6-633e8cdd2304 to /dev/vdb
Aug 17 11:57:26 user nova-compute[73449]: DEBUG nova.network.neutron [req-2a9adfdf-a256-4b02-b758-b76b9b7d9bc3 req-1015327b-05b3-4207-ae3b-6dda6b18a66b service nova] [instance: 9e68a702-ead5-47ae-9375-5cd00b947ef4] Updated VIF entry in instance network info cache for port f4c80486-3b7b-4bcc-9593-04a46766dc36. {{(pid=73449) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 11:57:26 user nova-compute[73449]: DEBUG nova.network.neutron [req-2a9adfdf-a256-4b02-b758-b76b9b7d9bc3 req-1015327b-05b3-4207-ae3b-6dda6b18a66b service nova] [instance: 9e68a702-ead5-47ae-9375-5cd00b947ef4] Updating instance_info_cache with network_info: [{"id": "f4c80486-3b7b-4bcc-9593-04a46766dc36", "address": "fa:16:3e:35:7f:0b", "network": {"id": "bae20193-cae3-45f8-8881-68020cd853e9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-459774400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "348b0a78aaf940b98f91655ddd6d4d6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4c80486-3b", "ovs_interfaceid": "f4c80486-3b7b-4bcc-9593-04a46766dc36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:57:26 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-2a9adfdf-a256-4b02-b758-b76b9b7d9bc3 req-1015327b-05b3-4207-ae3b-6dda6b18a66b service nova] Releasing lock "refresh_cache-9e68a702-ead5-47ae-9375-5cd00b947ef4" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:57:26 user nova-compute[73449]: DEBUG os_brick.utils [None req-94952b7b-dd10-440b-bb4d-912cd3dd4fb2 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 11:57:26 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:57:26 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:57:26 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[43d9ca2a-387d-4a9f-ad0d-574564cb7290]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4d3924302012\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:57:26 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:57:26 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:57:26 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a1ca563-fe9a-4d6f-9210-a9a3a967ff5e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:57:26 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:57:26 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:57:26 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[121237ca-0c66-4e01-b359-e320db5e1052]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:57:26 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[22d74e58-6208-4e6f-a7d1-e7e27eca0561]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:57:26 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-94952b7b-dd10-440b-bb4d-912cd3dd4fb2 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Running cmd (subprocess): nvme version {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:57:26 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-94952b7b-dd10-440b-bb4d-912cd3dd4fb2 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] 'nvme version' failed. Not Retrying. {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 11:57:26 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.nvmeof [None req-94952b7b-dd10-440b-bb4d-912cd3dd4fb2 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] nvme not present on system {{(pid=73449) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 11:57:26 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:57:26 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 11:57:26 user nova-compute[73449]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 11:57:26 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[d62c6708-a299-438a-b6a0-137d94fbcedc]: (4, '') {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:57:26 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-94952b7b-dd10-440b-bb4d-912cd3dd4fb2 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73449) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 11:57:26 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-94952b7b-dd10-440b-bb4d-912cd3dd4fb2 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73449) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 11:57:26 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-94952b7b-dd10-440b-bb4d-912cd3dd4fb2 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] LIGHTOS: no hostnqn found. {{(pid=73449) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 11:57:26 user nova-compute[73449]: DEBUG os_brick.utils [None req-94952b7b-dd10-440b-bb4d-912cd3dd4fb2 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4d3924302012', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 11:57:26 user nova-compute[73449]: DEBUG nova.virt.block_device [None req-94952b7b-dd10-440b-bb4d-912cd3dd4fb2 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] [instance: 9e68a702-ead5-47ae-9375-5cd00b947ef4] Updating existing volume attachment record: ea2dd35b-c1ab-4dad-882e-1439b2ae3b11 {{(pid=73449) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 11:57:27 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:57:27 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:57:27 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:57:27 user nova-compute[73449]: DEBUG nova.compute.manager [req-8930408a-1a01-4176-a427-25c1358277c1 req-18597842-1017-418c-94f2-e1f59620ad41 service nova] [instance: 773e5c86-a86a-414d-aab4-8e13e0b68c1e] Received event network-vif-plugged-4c8e383a-45a4-4c6a-858f-74a1b73e9e27 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:57:27 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-8930408a-1a01-4176-a427-25c1358277c1 req-18597842-1017-418c-94f2-e1f59620ad41 service nova] Acquiring lock "773e5c86-a86a-414d-aab4-8e13e0b68c1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:57:27 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-8930408a-1a01-4176-a427-25c1358277c1 req-18597842-1017-418c-94f2-e1f59620ad41 service nova] Lock "773e5c86-a86a-414d-aab4-8e13e0b68c1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:57:27 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-8930408a-1a01-4176-a427-25c1358277c1 req-18597842-1017-418c-94f2-e1f59620ad41 service nova] Lock "773e5c86-a86a-414d-aab4-8e13e0b68c1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:57:27 user nova-compute[73449]: DEBUG nova.compute.manager [req-8930408a-1a01-4176-a427-25c1358277c1 req-18597842-1017-418c-94f2-e1f59620ad41 service nova] [instance: 773e5c86-a86a-414d-aab4-8e13e0b68c1e] No waiting events found dispatching network-vif-plugged-4c8e383a-45a4-4c6a-858f-74a1b73e9e27 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:57:27 user nova-compute[73449]: WARNING nova.compute.manager [req-8930408a-1a01-4176-a427-25c1358277c1 req-18597842-1017-418c-94f2-e1f59620ad41 service nova] [instance: 773e5c86-a86a-414d-aab4-8e13e0b68c1e] Received unexpected event network-vif-plugged-4c8e383a-45a4-4c6a-858f-74a1b73e9e27 for instance with vm_state building and task_state spawning.
Aug 17 11:57:27 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:57:27 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:57:27 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:57:27 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:57:28 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:57:29 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692273449.3810403, 773e5c86-a86a-414d-aab4-8e13e0b68c1e => Resumed> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:57:29 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 773e5c86-a86a-414d-aab4-8e13e0b68c1e] VM Resumed (Lifecycle Event)
Aug 17 11:57:29 user nova-compute[73449]: DEBUG nova.compute.manager [None req-f956aea2-3318-45e9-b90d-18546c575e3d tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 773e5c86-a86a-414d-aab4-8e13e0b68c1e] Instance event wait completed in 0 seconds for  {{(pid=73449) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 11:57:29 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-f956aea2-3318-45e9-b90d-18546c575e3d tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 773e5c86-a86a-414d-aab4-8e13e0b68c1e] Guest created on hypervisor {{(pid=73449) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 11:57:29 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: 773e5c86-a86a-414d-aab4-8e13e0b68c1e] Instance spawned successfully.
Aug 17 11:57:29 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-f956aea2-3318-45e9-b90d-18546c575e3d tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 773e5c86-a86a-414d-aab4-8e13e0b68c1e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 11:57:29 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 773e5c86-a86a-414d-aab4-8e13e0b68c1e] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:57:29 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 773e5c86-a86a-414d-aab4-8e13e0b68c1e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 11:57:29 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-f956aea2-3318-45e9-b90d-18546c575e3d tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 773e5c86-a86a-414d-aab4-8e13e0b68c1e] Found default for hw_cdrom_bus of ide {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:57:29 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-f956aea2-3318-45e9-b90d-18546c575e3d tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 773e5c86-a86a-414d-aab4-8e13e0b68c1e] Found default for hw_disk_bus of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:57:29 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-f956aea2-3318-45e9-b90d-18546c575e3d tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 773e5c86-a86a-414d-aab4-8e13e0b68c1e] Found default for hw_input_bus of None {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:57:29 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-f956aea2-3318-45e9-b90d-18546c575e3d tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 773e5c86-a86a-414d-aab4-8e13e0b68c1e] Found default for hw_pointer_model of None {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:57:29 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-f956aea2-3318-45e9-b90d-18546c575e3d tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 773e5c86-a86a-414d-aab4-8e13e0b68c1e] Found default for hw_video_model of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:57:29 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-f956aea2-3318-45e9-b90d-18546c575e3d tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 773e5c86-a86a-414d-aab4-8e13e0b68c1e] Found default for hw_vif_model of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:57:29 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 773e5c86-a86a-414d-aab4-8e13e0b68c1e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 11:57:29 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692273449.387301, 773e5c86-a86a-414d-aab4-8e13e0b68c1e => Started> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:57:29 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 773e5c86-a86a-414d-aab4-8e13e0b68c1e] VM Started (Lifecycle Event)
Aug 17 11:57:29 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 773e5c86-a86a-414d-aab4-8e13e0b68c1e] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:57:29 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 773e5c86-a86a-414d-aab4-8e13e0b68c1e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 11:57:29 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 773e5c86-a86a-414d-aab4-8e13e0b68c1e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 11:57:29 user nova-compute[73449]: INFO nova.compute.manager [None req-f956aea2-3318-45e9-b90d-18546c575e3d tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 773e5c86-a86a-414d-aab4-8e13e0b68c1e] Took 5.16 seconds to spawn the instance on the hypervisor.
Aug 17 11:57:29 user nova-compute[73449]: DEBUG nova.compute.manager [None req-f956aea2-3318-45e9-b90d-18546c575e3d tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 773e5c86-a86a-414d-aab4-8e13e0b68c1e] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:57:29 user nova-compute[73449]: DEBUG nova.compute.manager [req-6227db2a-9aec-40ae-b723-a8761b75ad22 req-5dd144f9-c07b-4c40-9127-29d39f102a03 service nova] [instance: 773e5c86-a86a-414d-aab4-8e13e0b68c1e] Received event network-vif-plugged-4c8e383a-45a4-4c6a-858f-74a1b73e9e27 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:57:29 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-6227db2a-9aec-40ae-b723-a8761b75ad22 req-5dd144f9-c07b-4c40-9127-29d39f102a03 service nova] Acquiring lock "773e5c86-a86a-414d-aab4-8e13e0b68c1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:57:29 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-6227db2a-9aec-40ae-b723-a8761b75ad22 req-5dd144f9-c07b-4c40-9127-29d39f102a03 service nova] Lock "773e5c86-a86a-414d-aab4-8e13e0b68c1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:57:29 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-6227db2a-9aec-40ae-b723-a8761b75ad22 req-5dd144f9-c07b-4c40-9127-29d39f102a03 service nova] Lock "773e5c86-a86a-414d-aab4-8e13e0b68c1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:57:29 user nova-compute[73449]: DEBUG nova.compute.manager [req-6227db2a-9aec-40ae-b723-a8761b75ad22 req-5dd144f9-c07b-4c40-9127-29d39f102a03 service nova] [instance: 773e5c86-a86a-414d-aab4-8e13e0b68c1e] No waiting events found dispatching network-vif-plugged-4c8e383a-45a4-4c6a-858f-74a1b73e9e27 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:57:29 user nova-compute[73449]: WARNING nova.compute.manager [req-6227db2a-9aec-40ae-b723-a8761b75ad22 req-5dd144f9-c07b-4c40-9127-29d39f102a03 service nova] [instance: 773e5c86-a86a-414d-aab4-8e13e0b68c1e] Received unexpected event network-vif-plugged-4c8e383a-45a4-4c6a-858f-74a1b73e9e27 for instance with vm_state building and task_state spawning.
Aug 17 11:57:29 user nova-compute[73449]: INFO nova.compute.manager [None req-f956aea2-3318-45e9-b90d-18546c575e3d tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 773e5c86-a86a-414d-aab4-8e13e0b68c1e] Took 18.00 seconds to build instance.
Aug 17 11:57:29 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-f956aea2-3318-45e9-b90d-18546c575e3d tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Lock "773e5c86-a86a-414d-aab4-8e13e0b68c1e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.127s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:57:30 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:57:33 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:57:35 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:57:38 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94952b7b-dd10-440b-bb4d-912cd3dd4fb2 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] [instance: 9e68a702-ead5-47ae-9375-5cd00b947ef4] Calling os-brick to attach iSCSI Volume {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 11:57:38 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-94952b7b-dd10-440b-bb4d-912cd3dd4fb2 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8418d863-920b-4e8e-b7c6-633e8cdd2304'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GHhPTgOb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 11:57:38 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-94952b7b-dd10-440b-bb4d-912cd3dd4fb2 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 11:57:38 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-94952b7b-dd10-440b-bb4d-912cd3dd4fb2 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:57:38 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-94952b7b-dd10-440b-bb4d-912cd3dd4fb2 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:57:38 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-94952b7b-dd10-440b-bb4d-912cd3dd4fb2 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 11:57:38 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-94952b7b-dd10-440b-bb4d-912cd3dd4fb2 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8418d863-920b-4e8e-b7c6-633e8cdd2304" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:57:38 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-94952b7b-dd10-440b-bb4d-912cd3dd4fb2 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8418d863-920b-4e8e-b7c6-633e8cdd2304" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:57:38 user nova-compute[73449]: INFO os_brick.initiator.connectors.iscsi [None req-94952b7b-dd10-440b-bb4d-912cd3dd4fb2 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 11:57:38 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8418d863-920b-4e8e-b7c6-633e8cdd2304 -p 172.16.0.220:3260 {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:57:38 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8418d863-920b-4e8e-b7c6-633e8cdd2304 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:57:38 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[d72979d6-e4a6-4ab0-be43-3dc7f5e7236f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:57:38 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-94952b7b-dd10-440b-bb4d-912cd3dd4fb2 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 11:57:38 user nova-compute[73449]:  {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:57:38 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8418d863-920b-4e8e-b7c6-633e8cdd2304 -p 172.16.0.220:3260 --interface default --op new {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:57:38 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8418d863-920b-4e8e-b7c6-633e8cdd2304 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:57:38 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[df391f97-b1a9-40e3-ad0f-4a176bfe2d9b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8418d863-920b-4e8e-b7c6-633e8cdd2304] added\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:57:38 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-94952b7b-dd10-440b-bb4d-912cd3dd4fb2 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8418d863-920b-4e8e-b7c6-633e8cdd2304] added
Aug 17 11:57:38 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:57:38 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8418d863-920b-4e8e-b7c6-633e8cdd2304 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:57:38 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8418d863-920b-4e8e-b7c6-633e8cdd2304 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.045s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:57:38 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[32bb12b3-2502-4d8c-bcd6-5c1d119932cb]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:57:38 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-94952b7b-dd10-440b-bb4d-912cd3dd4fb2 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:57:38 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8418d863-920b-4e8e-b7c6-633e8cdd2304 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:57:38 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8418d863-920b-4e8e-b7c6-633e8cdd2304 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:57:38 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a1acb51-daa7-4d7f-8d7a-0001442087bc]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:57:38 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-94952b7b-dd10-440b-bb4d-912cd3dd4fb2 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:57:38 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8418d863-920b-4e8e-b7c6-633e8cdd2304 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GHhPTgOb {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:57:38 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8418d863-920b-4e8e-b7c6-633e8cdd2304 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GHhPTgOb" returned: 0 in 0.022s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:57:38 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[b19d85f3-bf6c-4878-a08c-d35eac3d9603]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:57:38 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-94952b7b-dd10-440b-bb4d-912cd3dd4fb2 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GHhPTgOb'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:57:38 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8418d863-920b-4e8e-b7c6-633e8cdd2304 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:57:38 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8418d863-920b-4e8e-b7c6-633e8cdd2304 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:57:38 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[612ef213-c673-4b35-8edb-d15fc2b3c346]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:57:38 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-94952b7b-dd10-440b-bb4d-912cd3dd4fb2 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:57:38 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:57:38 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:57:38 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d007065-3cfb-42bb-8b22-991b3c4c7c26]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e360063-8525-4d62-8fa0-33c5062fc247 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7 (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:57:38 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-94952b7b-dd10-440b-bb4d-912cd3dd4fb2 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)
Aug 17 11:57:38 user nova-compute[73449]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 (non-flash)
Aug 17 11:57:38 user nova-compute[73449]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e360063-8525-4d62-8fa0-33c5062fc247 (non-flash)
Aug 17 11:57:38 user nova-compute[73449]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7 (non-flash)
Aug 17 11:57:38 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:57:38 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-94952b7b-dd10-440b-bb4d-912cd3dd4fb2 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)
Aug 17 11:57:38 user nova-compute[73449]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 (non-flash)
Aug 17 11:57:38 user nova-compute[73449]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e360063-8525-4d62-8fa0-33c5062fc247 (non-flash)
Aug 17 11:57:38 user nova-compute[73449]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7 (non-flash)
Aug 17 11:57:38 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:57:38 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8418d863-920b-4e8e-b7c6-633e8cdd2304 -p 172.16.0.220:3260 --login {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:57:38 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8418d863-920b-4e8e-b7c6-633e8cdd2304 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:57:38 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[7500c2f5-d399-43fb-8255-dab7124c69b1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8418d863-920b-4e8e-b7c6-633e8cdd2304, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8418d863-920b-4e8e-b7c6-633e8cdd2304, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:57:38 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-94952b7b-dd10-440b-bb4d-912cd3dd4fb2 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8418d863-920b-4e8e-b7c6-633e8cdd2304, portal: 172.16.0.220,3260]
Aug 17 11:57:38 user nova-compute[73449]: Login to [iface: default, target: iqn.2010-10.org.openstack:8418d863-920b-4e8e-b7c6-633e8cdd2304, portal: 172.16.0.220,3260] successful.
Aug 17 11:57:38 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:57:38 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8418d863-920b-4e8e-b7c6-633e8cdd2304 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:57:38 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8418d863-920b-4e8e-b7c6-633e8cdd2304 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:57:38 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[6acdfb4b-e78b-47e0-a094-cf6647551fc0]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:57:38 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-94952b7b-dd10-440b-bb4d-912cd3dd4fb2 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:57:38 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:57:38 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:57:38 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[51a04576-81c5-450d-abad-50c4e3817ec1]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e360063-8525-4d62-8fa0-33c5062fc247 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8418d863-920b-4e8e-b7c6-633e8cdd2304 (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:57:38 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-94952b7b-dd10-440b-bb4d-912cd3dd4fb2 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)
Aug 17 11:57:38 user nova-compute[73449]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 (non-flash)
Aug 17 11:57:38 user nova-compute[73449]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e360063-8525-4d62-8fa0-33c5062fc247 (non-flash)
Aug 17 11:57:38 user nova-compute[73449]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7 (non-flash)
Aug 17 11:57:38 user nova-compute[73449]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8418d863-920b-4e8e-b7c6-633e8cdd2304 (non-flash)
Aug 17 11:57:38 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:57:38 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-94952b7b-dd10-440b-bb4d-912cd3dd4fb2 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)
Aug 17 11:57:38 user nova-compute[73449]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 (non-flash)
Aug 17 11:57:38 user nova-compute[73449]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e360063-8525-4d62-8fa0-33c5062fc247 (non-flash)
Aug 17 11:57:38 user nova-compute[73449]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7 (non-flash)
Aug 17 11:57:38 user nova-compute[73449]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8418d863-920b-4e8e-b7c6-633e8cdd2304 (non-flash)
Aug 17 11:57:38 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:57:38 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-94952b7b-dd10-440b-bb4d-912cd3dd4fb2 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8418d863-920b-4e8e-b7c6-633e8cdd2304" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.339s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:57:38 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-94952b7b-dd10-440b-bb4d-912cd3dd4fb2 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Connected to 172.16.0.220:3260 {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 11:57:38 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-94952b7b-dd10-440b-bb4d-912cd3dd4fb2 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] HCTL ('37', '-', '-', 0) found on session 44 with lun 0 {{(pid=73449) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 11:57:38 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-94952b7b-dd10-440b-bb4d-912cd3dd4fb2 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73449) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 11:57:38 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:57:38 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:57:38 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[18866a4b-4102-4282-87e5-cc92c4b377d4]: (4, ('- - 0', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:57:38 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-94952b7b-dd10-440b-bb4d-912cd3dd4fb2 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Searching for a device in session 44 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73449) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 11:57:38 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-94952b7b-dd10-440b-bb4d-912cd3dd4fb2 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GHhPTgOb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 11:57:39 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-94952b7b-dd10-440b-bb4d-912cd3dd4fb2 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.381s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:57:39 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-94952b7b-dd10-440b-bb4d-912cd3dd4fb2 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] <== connect_volume: return (1383ms) {'type': 'block', 'scsi_wwn': '23562353030613133', 'path': '/dev/sdf'} {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 11:57:39 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94952b7b-dd10-440b-bb4d-912cd3dd4fb2 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] [instance: 9e68a702-ead5-47ae-9375-5cd00b947ef4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23562353030613133', 'path': '/dev/sdf'} {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 11:57:39 user nova-compute[73449]: DEBUG nova.objects.instance [None req-94952b7b-dd10-440b-bb4d-912cd3dd4fb2 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Lazy-loading 'flavor' on Instance uuid 9e68a702-ead5-47ae-9375-5cd00b947ef4 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:57:39 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-94952b7b-dd10-440b-bb4d-912cd3dd4fb2 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 11:57:39 user nova-compute[73449]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 11:57:39 user nova-compute[73449]:   <source dev="/dev/sdf"/>
Aug 17 11:57:39 user nova-compute[73449]:   <target dev="vdb" bus="virtio"/>
Aug 17 11:57:39 user nova-compute[73449]:   <serial>8418d863-920b-4e8e-b7c6-633e8cdd2304</serial>
Aug 17 11:57:39 user nova-compute[73449]: </disk>
Aug 17 11:57:39 user nova-compute[73449]:  {{(pid=73449) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 11:57:40 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-94952b7b-dd10-440b-bb4d-912cd3dd4fb2 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] No BDM found with device name vda, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 11:57:40 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-94952b7b-dd10-440b-bb4d-912cd3dd4fb2 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 11:57:40 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-94952b7b-dd10-440b-bb4d-912cd3dd4fb2 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] No VIF found with MAC fa:16:3e:35:7f:0b, not building metadata {{(pid=73449) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 11:57:40 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-94952b7b-dd10-440b-bb4d-912cd3dd4fb2 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Lock "9e68a702-ead5-47ae-9375-5cd00b947ef4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.883s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:57:40 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:57:41 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-bd6a4fc0-665a-4acc-bd7c-4b3bd0045c1b tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Acquiring lock "dd4ec7bd-002e-4a71-9314-96c21427af27" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:57:41 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-bd6a4fc0-665a-4acc-bd7c-4b3bd0045c1b tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Lock "dd4ec7bd-002e-4a71-9314-96c21427af27" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:57:41 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-bd6a4fc0-665a-4acc-bd7c-4b3bd0045c1b tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Acquiring lock "dd4ec7bd-002e-4a71-9314-96c21427af27-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:57:41 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-bd6a4fc0-665a-4acc-bd7c-4b3bd0045c1b tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Lock "dd4ec7bd-002e-4a71-9314-96c21427af27-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:57:41 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-bd6a4fc0-665a-4acc-bd7c-4b3bd0045c1b tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Lock "dd4ec7bd-002e-4a71-9314-96c21427af27-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:57:41 user nova-compute[73449]: INFO nova.compute.manager [None req-bd6a4fc0-665a-4acc-bd7c-4b3bd0045c1b tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] [instance: dd4ec7bd-002e-4a71-9314-96c21427af27] Terminating instance
Aug 17 11:57:41 user nova-compute[73449]: DEBUG nova.compute.manager [None req-bd6a4fc0-665a-4acc-bd7c-4b3bd0045c1b tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] [instance: dd4ec7bd-002e-4a71-9314-96c21427af27] Start destroying the instance on the hypervisor. {{(pid=73449) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 11:57:41 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:57:41 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:57:42 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:57:42 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:57:42 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:57:42 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:57:42 user nova-compute[73449]: DEBUG nova.compute.manager [req-9e45a679-9148-4cc1-b6d6-cbceab68d7d7 req-dbc8119f-d4a1-4509-99ac-28024eb13736 service nova] [instance: dd4ec7bd-002e-4a71-9314-96c21427af27] Received event network-vif-unplugged-24acbd43-f1af-45d2-953d-53b3e4c24335 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:57:42 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-9e45a679-9148-4cc1-b6d6-cbceab68d7d7 req-dbc8119f-d4a1-4509-99ac-28024eb13736 service nova] Acquiring lock "dd4ec7bd-002e-4a71-9314-96c21427af27-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:57:42 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-9e45a679-9148-4cc1-b6d6-cbceab68d7d7 req-dbc8119f-d4a1-4509-99ac-28024eb13736 service nova] Lock "dd4ec7bd-002e-4a71-9314-96c21427af27-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:57:42 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-9e45a679-9148-4cc1-b6d6-cbceab68d7d7 req-dbc8119f-d4a1-4509-99ac-28024eb13736 service nova] Lock "dd4ec7bd-002e-4a71-9314-96c21427af27-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:57:42 user nova-compute[73449]: DEBUG nova.compute.manager [req-9e45a679-9148-4cc1-b6d6-cbceab68d7d7 req-dbc8119f-d4a1-4509-99ac-28024eb13736 service nova] [instance: dd4ec7bd-002e-4a71-9314-96c21427af27] No waiting events found dispatching network-vif-unplugged-24acbd43-f1af-45d2-953d-53b3e4c24335 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:57:42 user nova-compute[73449]: DEBUG nova.compute.manager [req-9e45a679-9148-4cc1-b6d6-cbceab68d7d7 req-dbc8119f-d4a1-4509-99ac-28024eb13736 service nova] [instance: dd4ec7bd-002e-4a71-9314-96c21427af27] Received event network-vif-unplugged-24acbd43-f1af-45d2-953d-53b3e4c24335 for instance with task_state deleting. {{(pid=73449) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 11:57:42 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: dd4ec7bd-002e-4a71-9314-96c21427af27] Instance destroyed successfully.
Aug 17 11:57:42 user nova-compute[73449]: DEBUG nova.objects.instance [None req-bd6a4fc0-665a-4acc-bd7c-4b3bd0045c1b tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Lazy-loading 'resources' on Instance uuid dd4ec7bd-002e-4a71-9314-96c21427af27 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:57:42 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-bd6a4fc0-665a-4acc-bd7c-4b3bd0045c1b tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:48:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2005116148',display_name='tempest-ServersNegativeTestJSON-server-2005116148',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2005116148',id=24,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T11:48:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cbaa73b99e5a498dac668e5307654fd2',ramdisk_id='',reservation_id='r-0tzatvx0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-132584909',owner_user_name='tempest-ServersNegativeTestJSON-132584909-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T11:48:49Z,user_data=None,user_id='56d7fd2eae7c4e62a7cc0e917287f03f',uuid=dd4ec7bd-002e-4a71-9314-96c21427af27,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "24acbd43-f1af-45d2-953d-53b3e4c24335", "address": "fa:16:3e:20:8e:ea", "network": {"id": "c3e9bf16-545d-4ae8-bbad-5092c0e8f735", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1927778048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbaa73b99e5a498dac668e5307654fd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24acbd43-f1", "ovs_interfaceid": "24acbd43-f1af-45d2-953d-53b3e4c24335", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 11:57:42 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-bd6a4fc0-665a-4acc-bd7c-4b3bd0045c1b tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Converting VIF {"id": "24acbd43-f1af-45d2-953d-53b3e4c24335", "address": "fa:16:3e:20:8e:ea", "network": {"id": "c3e9bf16-545d-4ae8-bbad-5092c0e8f735", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1927778048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbaa73b99e5a498dac668e5307654fd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24acbd43-f1", "ovs_interfaceid": "24acbd43-f1af-45d2-953d-53b3e4c24335", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:57:42 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-bd6a4fc0-665a-4acc-bd7c-4b3bd0045c1b tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:20:8e:ea,bridge_name='br-int',has_traffic_filtering=True,id=24acbd43-f1af-45d2-953d-53b3e4c24335,network=Network(c3e9bf16-545d-4ae8-bbad-5092c0e8f735),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24acbd43-f1') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:57:42 user nova-compute[73449]: DEBUG os_vif [None req-bd6a4fc0-665a-4acc-bd7c-4b3bd0045c1b tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:20:8e:ea,bridge_name='br-int',has_traffic_filtering=True,id=24acbd43-f1af-45d2-953d-53b3e4c24335,network=Network(c3e9bf16-545d-4ae8-bbad-5092c0e8f735),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24acbd43-f1') {{(pid=73449) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 11:57:42 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:57:42 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap24acbd43-f1, bridge=br-int, if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:57:42 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:57:42 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:57:42 user nova-compute[73449]: INFO os_vif [None req-bd6a4fc0-665a-4acc-bd7c-4b3bd0045c1b tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:20:8e:ea,bridge_name='br-int',has_traffic_filtering=True,id=24acbd43-f1af-45d2-953d-53b3e4c24335,network=Network(c3e9bf16-545d-4ae8-bbad-5092c0e8f735),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24acbd43-f1')
Aug 17 11:57:42 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-bd6a4fc0-665a-4acc-bd7c-4b3bd0045c1b tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] [instance: dd4ec7bd-002e-4a71-9314-96c21427af27] Deleting instance files /opt/stack/data/nova/instances/dd4ec7bd-002e-4a71-9314-96c21427af27_del
Aug 17 11:57:42 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-bd6a4fc0-665a-4acc-bd7c-4b3bd0045c1b tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] [instance: dd4ec7bd-002e-4a71-9314-96c21427af27] Deletion of /opt/stack/data/nova/instances/dd4ec7bd-002e-4a71-9314-96c21427af27_del complete
Aug 17 11:57:42 user nova-compute[73449]: INFO nova.compute.manager [None req-bd6a4fc0-665a-4acc-bd7c-4b3bd0045c1b tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] [instance: dd4ec7bd-002e-4a71-9314-96c21427af27] Took 0.73 seconds to destroy the instance on the hypervisor.
Aug 17 11:57:42 user nova-compute[73449]: DEBUG oslo.service.loopingcall [None req-bd6a4fc0-665a-4acc-bd7c-4b3bd0045c1b tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73449) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 11:57:42 user nova-compute[73449]: DEBUG nova.compute.manager [-] [instance: dd4ec7bd-002e-4a71-9314-96c21427af27] Deallocating network for instance {{(pid=73449) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 11:57:42 user nova-compute[73449]: DEBUG nova.network.neutron [-] [instance: dd4ec7bd-002e-4a71-9314-96c21427af27] deallocate_for_instance() {{(pid=73449) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 11:57:42 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:57:43 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:57:43 user nova-compute[73449]: DEBUG nova.network.neutron [-] [instance: dd4ec7bd-002e-4a71-9314-96c21427af27] Updating instance_info_cache with network_info: [] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:57:43 user nova-compute[73449]: DEBUG nova.compute.manager [req-41980ed7-041a-408d-9b20-b5a43af4b2bf req-6bcbb847-763d-495d-af21-d64700e8a378 service nova] [instance: dd4ec7bd-002e-4a71-9314-96c21427af27] Received event network-vif-deleted-24acbd43-f1af-45d2-953d-53b3e4c24335 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:57:43 user nova-compute[73449]: INFO nova.compute.manager [req-41980ed7-041a-408d-9b20-b5a43af4b2bf req-6bcbb847-763d-495d-af21-d64700e8a378 service nova] [instance: dd4ec7bd-002e-4a71-9314-96c21427af27] Neutron deleted interface 24acbd43-f1af-45d2-953d-53b3e4c24335; detaching it from the instance and deleting it from the info cache
Aug 17 11:57:43 user nova-compute[73449]: DEBUG nova.network.neutron [req-41980ed7-041a-408d-9b20-b5a43af4b2bf req-6bcbb847-763d-495d-af21-d64700e8a378 service nova] [instance: dd4ec7bd-002e-4a71-9314-96c21427af27] Updating instance_info_cache with network_info: [] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:57:43 user nova-compute[73449]: INFO nova.compute.manager [-] [instance: dd4ec7bd-002e-4a71-9314-96c21427af27] Took 1.15 seconds to deallocate network for instance.
Aug 17 11:57:43 user nova-compute[73449]: DEBUG nova.compute.manager [req-41980ed7-041a-408d-9b20-b5a43af4b2bf req-6bcbb847-763d-495d-af21-d64700e8a378 service nova] [instance: dd4ec7bd-002e-4a71-9314-96c21427af27] Detach interface failed, port_id=24acbd43-f1af-45d2-953d-53b3e4c24335, reason: Instance dd4ec7bd-002e-4a71-9314-96c21427af27 could not be found. {{(pid=73449) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 11:57:43 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-bd6a4fc0-665a-4acc-bd7c-4b3bd0045c1b tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:57:43 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-bd6a4fc0-665a-4acc-bd7c-4b3bd0045c1b tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:57:44 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-bd6a4fc0-665a-4acc-bd7c-4b3bd0045c1b tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 11:57:44 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-bd6a4fc0-665a-4acc-bd7c-4b3bd0045c1b tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 11:57:44 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-bd6a4fc0-665a-4acc-bd7c-4b3bd0045c1b tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.474s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:57:44 user nova-compute[73449]: INFO nova.scheduler.client.report [None req-bd6a4fc0-665a-4acc-bd7c-4b3bd0045c1b tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Deleted allocations for instance dd4ec7bd-002e-4a71-9314-96c21427af27
Aug 17 11:57:44 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-bd6a4fc0-665a-4acc-bd7c-4b3bd0045c1b tempest-ServersNegativeTestJSON-132584909 tempest-ServersNegativeTestJSON-132584909-project-member] Lock "dd4ec7bd-002e-4a71-9314-96c21427af27" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.577s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:57:44 user nova-compute[73449]: DEBUG nova.compute.manager [req-384ac988-0ce6-4d82-83cb-c49efa3639f9 req-3055a17b-9321-4f8d-9cf3-574fb431fa7b service nova] [instance: dd4ec7bd-002e-4a71-9314-96c21427af27] Received event network-vif-plugged-24acbd43-f1af-45d2-953d-53b3e4c24335 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:57:44 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-384ac988-0ce6-4d82-83cb-c49efa3639f9 req-3055a17b-9321-4f8d-9cf3-574fb431fa7b service nova] Acquiring lock "dd4ec7bd-002e-4a71-9314-96c21427af27-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:57:44 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-384ac988-0ce6-4d82-83cb-c49efa3639f9 req-3055a17b-9321-4f8d-9cf3-574fb431fa7b service nova] Lock "dd4ec7bd-002e-4a71-9314-96c21427af27-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:57:44 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-384ac988-0ce6-4d82-83cb-c49efa3639f9 req-3055a17b-9321-4f8d-9cf3-574fb431fa7b service nova] Lock "dd4ec7bd-002e-4a71-9314-96c21427af27-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:57:44 user nova-compute[73449]: DEBUG nova.compute.manager [req-384ac988-0ce6-4d82-83cb-c49efa3639f9 req-3055a17b-9321-4f8d-9cf3-574fb431fa7b service nova] [instance: dd4ec7bd-002e-4a71-9314-96c21427af27] No waiting events found dispatching network-vif-plugged-24acbd43-f1af-45d2-953d-53b3e4c24335 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:57:44 user nova-compute[73449]: WARNING nova.compute.manager [req-384ac988-0ce6-4d82-83cb-c49efa3639f9 req-3055a17b-9321-4f8d-9cf3-574fb431fa7b service nova] [instance: dd4ec7bd-002e-4a71-9314-96c21427af27] Received unexpected event network-vif-plugged-24acbd43-f1af-45d2-953d-53b3e4c24335 for instance with vm_state deleted and task_state None.
Aug 17 11:57:47 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:57:48 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:57:48 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:57:52 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:57:53 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:57:54 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:57:57 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:57:57 user nova-compute[73449]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692273462.4861252, dd4ec7bd-002e-4a71-9314-96c21427af27 => Stopped> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:57:57 user nova-compute[73449]: INFO nova.compute.manager [-] [instance: dd4ec7bd-002e-4a71-9314-96c21427af27] VM Stopped (Lifecycle Event)
Aug 17 11:57:57 user nova-compute[73449]: DEBUG nova.compute.manager [None req-bb1190b2-24af-4ec3-b0dd-f860c1579461 None None] [instance: dd4ec7bd-002e-4a71-9314-96c21427af27] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:57:57 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:57:58 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:58:01 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:58:02 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:58:02 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:58:02 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:58:02 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:58:02 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:58:02 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73449) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 11:58:02 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:58:02 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:58:03 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:58:05 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:58:05 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:58:05 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:58:06 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:58:06 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Starting heal instance info cache {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 11:58:06 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Rebuilding the list of instances to heal {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 11:58:07 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "refresh_cache-4a9e8ad2-19db-4975-87e4-2efce603a7d7" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:58:07 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquired lock "refresh_cache-4a9e8ad2-19db-4975-87e4-2efce603a7d7" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:58:07 user nova-compute[73449]: DEBUG nova.network.neutron [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: 4a9e8ad2-19db-4975-87e4-2efce603a7d7] Forcefully refreshing network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 11:58:07 user nova-compute[73449]: DEBUG nova.objects.instance [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lazy-loading 'info_cache' on Instance uuid 4a9e8ad2-19db-4975-87e4-2efce603a7d7 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:58:07 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:58:07 user nova-compute[73449]: DEBUG nova.network.neutron [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: 4a9e8ad2-19db-4975-87e4-2efce603a7d7] Updating instance_info_cache with network_info: [{"id": "3c5f8e97-0654-42f0-9575-eab6d833283a", "address": "fa:16:3e:c8:b7:51", "network": {"id": "72c50a42-688f-4868-8e19-c40b103a49cd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1792423641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "068c5270255744a18208a0ad9b35f168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c5f8e97-06", "ovs_interfaceid": "3c5f8e97-0654-42f0-9575-eab6d833283a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:58:07 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Releasing lock "refresh_cache-4a9e8ad2-19db-4975-87e4-2efce603a7d7" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:58:07 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: 4a9e8ad2-19db-4975-87e4-2efce603a7d7] Updated the network info_cache for instance {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 11:58:08 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:58:08 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:58:09 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:58:09 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:58:09 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:58:09 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=73449) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 11:58:09 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b7932d8-b781-4db7-a1c5-791ce8d1d866/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:58:09 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b7932d8-b781-4db7-a1c5-791ce8d1d866/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:58:09 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b7932d8-b781-4db7-a1c5-791ce8d1d866/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:58:09 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-06cd56be-0af6-4c02-8841-9a9fea796083 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Acquiring lock "5cacd9ed-27fb-431d-999e-31ff2464d14d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:58:09 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-06cd56be-0af6-4c02-8841-9a9fea796083 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Lock "5cacd9ed-27fb-431d-999e-31ff2464d14d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:58:09 user nova-compute[73449]: DEBUG nova.compute.manager [None req-06cd56be-0af6-4c02-8841-9a9fea796083 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] [instance: 5cacd9ed-27fb-431d-999e-31ff2464d14d] Starting instance... {{(pid=73449) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 11:58:09 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b7932d8-b781-4db7-a1c5-791ce8d1d866/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:58:09 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/042713b8-ab7f-4c14-92e5-f830ccb7e341/disk.rescue --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:58:09 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-06cd56be-0af6-4c02-8841-9a9fea796083 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:58:09 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-06cd56be-0af6-4c02-8841-9a9fea796083 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:58:09 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-06cd56be-0af6-4c02-8841-9a9fea796083 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73449) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 11:58:09 user nova-compute[73449]: INFO nova.compute.claims [None req-06cd56be-0af6-4c02-8841-9a9fea796083 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] [instance: 5cacd9ed-27fb-431d-999e-31ff2464d14d] Claim successful on node user
Aug 17 11:58:09 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/042713b8-ab7f-4c14-92e5-f830ccb7e341/disk.rescue --force-share --output=json" returned: 0 in 0.201s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:58:09 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/042713b8-ab7f-4c14-92e5-f830ccb7e341/disk.rescue --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:58:09 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/042713b8-ab7f-4c14-92e5-f830ccb7e341/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:58:09 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] skipping disk /opt/stack/data/nova/instances/042713b8-ab7f-4c14-92e5-f830ccb7e341/disk (vdb) as it is a volume {{(pid=73449) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 11:58:10 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a9e8ad2-19db-4975-87e4-2efce603a7d7/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:58:10 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-06cd56be-0af6-4c02-8841-9a9fea796083 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 11:58:10 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-06cd56be-0af6-4c02-8841-9a9fea796083 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 11:58:10 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a9e8ad2-19db-4975-87e4-2efce603a7d7/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:58:10 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a9e8ad2-19db-4975-87e4-2efce603a7d7/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:58:10 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-06cd56be-0af6-4c02-8841-9a9fea796083 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.629s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:58:10 user nova-compute[73449]: DEBUG nova.compute.manager [None req-06cd56be-0af6-4c02-8841-9a9fea796083 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] [instance: 5cacd9ed-27fb-431d-999e-31ff2464d14d] Start building networks asynchronously for instance. {{(pid=73449) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 11:58:10 user nova-compute[73449]: DEBUG nova.compute.manager [None req-06cd56be-0af6-4c02-8841-9a9fea796083 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] [instance: 5cacd9ed-27fb-431d-999e-31ff2464d14d] Allocating IP information in the background. {{(pid=73449) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 11:58:10 user nova-compute[73449]: DEBUG nova.network.neutron [None req-06cd56be-0af6-4c02-8841-9a9fea796083 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] [instance: 5cacd9ed-27fb-431d-999e-31ff2464d14d] allocate_for_instance() {{(pid=73449) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 11:58:10 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-06cd56be-0af6-4c02-8841-9a9fea796083 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] [instance: 5cacd9ed-27fb-431d-999e-31ff2464d14d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 11:58:10 user nova-compute[73449]: DEBUG nova.compute.manager [None req-06cd56be-0af6-4c02-8841-9a9fea796083 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] [instance: 5cacd9ed-27fb-431d-999e-31ff2464d14d] Start building block device mappings for instance. {{(pid=73449) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 11:58:10 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a9e8ad2-19db-4975-87e4-2efce603a7d7/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:58:10 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk.rescue --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:58:10 user nova-compute[73449]: DEBUG nova.policy [None req-06cd56be-0af6-4c02-8841-9a9fea796083 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '80c63646b70647b295581670ff09df83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bbeaa2a37b4189a850b409ac6e1c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73449) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 11:58:10 user nova-compute[73449]: DEBUG nova.compute.manager [None req-06cd56be-0af6-4c02-8841-9a9fea796083 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] [instance: 5cacd9ed-27fb-431d-999e-31ff2464d14d] Start spawning the instance on the hypervisor. {{(pid=73449) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 11:58:10 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-06cd56be-0af6-4c02-8841-9a9fea796083 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] [instance: 5cacd9ed-27fb-431d-999e-31ff2464d14d] Creating instance directory {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 11:58:10 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-06cd56be-0af6-4c02-8841-9a9fea796083 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] [instance: 5cacd9ed-27fb-431d-999e-31ff2464d14d] Creating image(s)
Aug 17 11:58:10 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-06cd56be-0af6-4c02-8841-9a9fea796083 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Acquiring lock "/opt/stack/data/nova/instances/5cacd9ed-27fb-431d-999e-31ff2464d14d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:58:10 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-06cd56be-0af6-4c02-8841-9a9fea796083 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Lock "/opt/stack/data/nova/instances/5cacd9ed-27fb-431d-999e-31ff2464d14d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:58:10 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-06cd56be-0af6-4c02-8841-9a9fea796083 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Lock "/opt/stack/data/nova/instances/5cacd9ed-27fb-431d-999e-31ff2464d14d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:58:10 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-06cd56be-0af6-4c02-8841-9a9fea796083 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:58:10 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:58:10 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk.rescue --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:58:10 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-06cd56be-0af6-4c02-8841-9a9fea796083 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json" returned: 0 in 0.200s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:58:10 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-06cd56be-0af6-4c02-8841-9a9fea796083 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Acquiring lock "7e267a577c062ee862e95ede6b48cfd5632f3ea3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:58:10 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-06cd56be-0af6-4c02-8841-9a9fea796083 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Lock "7e267a577c062ee862e95ede6b48cfd5632f3ea3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:58:10 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-06cd56be-0af6-4c02-8841-9a9fea796083 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:58:10 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:58:10 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:58:10 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-06cd56be-0af6-4c02-8841-9a9fea796083 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json" returned: 0 in 0.175s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:58:10 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-06cd56be-0af6-4c02-8841-9a9fea796083 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3,backing_fmt=raw /opt/stack/data/nova/instances/5cacd9ed-27fb-431d-999e-31ff2464d14d/disk 1073741824 {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:58:11 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-06cd56be-0af6-4c02-8841-9a9fea796083 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3,backing_fmt=raw /opt/stack/data/nova/instances/5cacd9ed-27fb-431d-999e-31ff2464d14d/disk 1073741824" returned: 0 in 0.072s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:58:11 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-06cd56be-0af6-4c02-8841-9a9fea796083 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Lock "7e267a577c062ee862e95ede6b48cfd5632f3ea3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:58:11 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-06cd56be-0af6-4c02-8841-9a9fea796083 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:58:11 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:58:11 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:58:11 user nova-compute[73449]: DEBUG nova.network.neutron [None req-06cd56be-0af6-4c02-8841-9a9fea796083 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] [instance: 5cacd9ed-27fb-431d-999e-31ff2464d14d] Successfully created port: b9152b88-6f67-4bcb-bcd0-64a3a04103dc {{(pid=73449) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 11:58:11 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-06cd56be-0af6-4c02-8841-9a9fea796083 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json" returned: 0 in 0.180s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:58:11 user nova-compute[73449]: DEBUG nova.virt.disk.api [None req-06cd56be-0af6-4c02-8841-9a9fea796083 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5cacd9ed-27fb-431d-999e-31ff2464d14d/disk. size=1073741824 {{(pid=73449) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 11:58:11 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-06cd56be-0af6-4c02-8841-9a9fea796083 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cacd9ed-27fb-431d-999e-31ff2464d14d/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:58:11 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:58:11 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73449) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 11:58:11 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73449) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 11:58:11 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e68a702-ead5-47ae-9375-5cd00b947ef4/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:58:11 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-06cd56be-0af6-4c02-8841-9a9fea796083 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cacd9ed-27fb-431d-999e-31ff2464d14d/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:58:11 user nova-compute[73449]: DEBUG nova.virt.disk.api [None req-06cd56be-0af6-4c02-8841-9a9fea796083 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Cannot resize image /opt/stack/data/nova/instances/5cacd9ed-27fb-431d-999e-31ff2464d14d/disk to a smaller size. {{(pid=73449) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 11:58:11 user nova-compute[73449]: DEBUG nova.objects.instance [None req-06cd56be-0af6-4c02-8841-9a9fea796083 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Lazy-loading 'migration_context' on Instance uuid 5cacd9ed-27fb-431d-999e-31ff2464d14d {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:58:11 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-06cd56be-0af6-4c02-8841-9a9fea796083 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] [instance: 5cacd9ed-27fb-431d-999e-31ff2464d14d] Created local disks {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 11:58:11 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-06cd56be-0af6-4c02-8841-9a9fea796083 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] [instance: 5cacd9ed-27fb-431d-999e-31ff2464d14d] Ensure instance console log exists: /opt/stack/data/nova/instances/5cacd9ed-27fb-431d-999e-31ff2464d14d/console.log {{(pid=73449) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 11:58:11 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-06cd56be-0af6-4c02-8841-9a9fea796083 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:58:11 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-06cd56be-0af6-4c02-8841-9a9fea796083 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:58:11 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-06cd56be-0af6-4c02-8841-9a9fea796083 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:58:11 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e68a702-ead5-47ae-9375-5cd00b947ef4/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:58:11 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e68a702-ead5-47ae-9375-5cd00b947ef4/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:58:11 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e68a702-ead5-47ae-9375-5cd00b947ef4/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:58:11 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=73449) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 11:58:11 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d74c8f6-fb4e-4460-b722-674a8a1e2d25/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:58:11 user nova-compute[73449]: DEBUG nova.network.neutron [None req-06cd56be-0af6-4c02-8841-9a9fea796083 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] [instance: 5cacd9ed-27fb-431d-999e-31ff2464d14d] Successfully updated port: b9152b88-6f67-4bcb-bcd0-64a3a04103dc {{(pid=73449) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 11:58:11 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d74c8f6-fb4e-4460-b722-674a8a1e2d25/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:58:11 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d74c8f6-fb4e-4460-b722-674a8a1e2d25/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:58:11 user nova-compute[73449]: DEBUG nova.compute.manager [req-0d010020-4dad-42b3-9655-a92c40d9bd5e req-754fca4f-244f-458d-a7f5-60a318f4d560 service nova] [instance: 5cacd9ed-27fb-431d-999e-31ff2464d14d] Received event network-changed-b9152b88-6f67-4bcb-bcd0-64a3a04103dc {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:58:11 user nova-compute[73449]: DEBUG nova.compute.manager [req-0d010020-4dad-42b3-9655-a92c40d9bd5e req-754fca4f-244f-458d-a7f5-60a318f4d560 service nova] [instance: 5cacd9ed-27fb-431d-999e-31ff2464d14d] Refreshing instance network info cache due to event network-changed-b9152b88-6f67-4bcb-bcd0-64a3a04103dc. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 11:58:11 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-0d010020-4dad-42b3-9655-a92c40d9bd5e req-754fca4f-244f-458d-a7f5-60a318f4d560 service nova] Acquiring lock "refresh_cache-5cacd9ed-27fb-431d-999e-31ff2464d14d" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:58:11 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-0d010020-4dad-42b3-9655-a92c40d9bd5e req-754fca4f-244f-458d-a7f5-60a318f4d560 service nova] Acquired lock "refresh_cache-5cacd9ed-27fb-431d-999e-31ff2464d14d" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:58:11 user nova-compute[73449]: DEBUG nova.network.neutron [req-0d010020-4dad-42b3-9655-a92c40d9bd5e req-754fca4f-244f-458d-a7f5-60a318f4d560 service nova] [instance: 5cacd9ed-27fb-431d-999e-31ff2464d14d] Refreshing network info cache for port b9152b88-6f67-4bcb-bcd0-64a3a04103dc {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 11:58:11 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-06cd56be-0af6-4c02-8841-9a9fea796083 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Acquiring lock "refresh_cache-5cacd9ed-27fb-431d-999e-31ff2464d14d" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:58:11 user nova-compute[73449]: DEBUG nova.network.neutron [req-0d010020-4dad-42b3-9655-a92c40d9bd5e req-754fca4f-244f-458d-a7f5-60a318f4d560 service nova] [instance: 5cacd9ed-27fb-431d-999e-31ff2464d14d] Instance cache missing network info. {{(pid=73449) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 11:58:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d74c8f6-fb4e-4460-b722-674a8a1e2d25/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:58:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89440604-1daf-4e7a-a524-2f9c21a9cb96/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:58:12 user nova-compute[73449]: DEBUG nova.network.neutron [req-0d010020-4dad-42b3-9655-a92c40d9bd5e req-754fca4f-244f-458d-a7f5-60a318f4d560 service nova] [instance: 5cacd9ed-27fb-431d-999e-31ff2464d14d] Updating instance_info_cache with network_info: [] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:58:12 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-0d010020-4dad-42b3-9655-a92c40d9bd5e req-754fca4f-244f-458d-a7f5-60a318f4d560 service nova] Releasing lock "refresh_cache-5cacd9ed-27fb-431d-999e-31ff2464d14d" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:58:12 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-06cd56be-0af6-4c02-8841-9a9fea796083 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Acquired lock "refresh_cache-5cacd9ed-27fb-431d-999e-31ff2464d14d" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:58:12 user nova-compute[73449]: DEBUG nova.network.neutron [None req-06cd56be-0af6-4c02-8841-9a9fea796083 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] [instance: 5cacd9ed-27fb-431d-999e-31ff2464d14d] Building network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 11:58:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89440604-1daf-4e7a-a524-2f9c21a9cb96/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:58:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89440604-1daf-4e7a-a524-2f9c21a9cb96/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:58:12 user nova-compute[73449]: DEBUG nova.network.neutron [None req-06cd56be-0af6-4c02-8841-9a9fea796083 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] [instance: 5cacd9ed-27fb-431d-999e-31ff2464d14d] Instance cache missing network info. {{(pid=73449) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 11:58:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89440604-1daf-4e7a-a524-2f9c21a9cb96/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:58:12 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73449) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 11:58:12 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:58:12 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:58:12 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:58:12 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Hypervisor/Node resource view: name=user free_ram=7396MB free_disk=25.078201293945312GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73449) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 11:58:12 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:58:12 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:58:12 user nova-compute[73449]: DEBUG nova.network.neutron [None req-06cd56be-0af6-4c02-8841-9a9fea796083 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] [instance: 5cacd9ed-27fb-431d-999e-31ff2464d14d] Updating instance_info_cache with network_info: [{"id": "b9152b88-6f67-4bcb-bcd0-64a3a04103dc", "address": "fa:16:3e:e5:8a:59", "network": {"id": "78528cb3-037c-4381-964f-7c0211faa0f0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-330540320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43bbeaa2a37b4189a850b409ac6e1c27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9152b88-6f", "ovs_interfaceid": "b9152b88-6f67-4bcb-bcd0-64a3a04103dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:58:12 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-06cd56be-0af6-4c02-8841-9a9fea796083 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Releasing lock "refresh_cache-5cacd9ed-27fb-431d-999e-31ff2464d14d" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:58:12 user nova-compute[73449]: DEBUG nova.compute.manager [None req-06cd56be-0af6-4c02-8841-9a9fea796083 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] [instance: 5cacd9ed-27fb-431d-999e-31ff2464d14d] Instance network_info: |[{"id": "b9152b88-6f67-4bcb-bcd0-64a3a04103dc", "address": "fa:16:3e:e5:8a:59", "network": {"id": "78528cb3-037c-4381-964f-7c0211faa0f0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-330540320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43bbeaa2a37b4189a850b409ac6e1c27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9152b88-6f", "ovs_interfaceid": "b9152b88-6f67-4bcb-bcd0-64a3a04103dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73449) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 11:58:12 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-06cd56be-0af6-4c02-8841-9a9fea796083 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] [instance: 5cacd9ed-27fb-431d-999e-31ff2464d14d] Start _get_guest_xml network_info=[{"id": "b9152b88-6f67-4bcb-bcd0-64a3a04103dc", "address": "fa:16:3e:e5:8a:59", "network": {"id": "78528cb3-037c-4381-964f-7c0211faa0f0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-330540320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43bbeaa2a37b4189a850b409ac6e1c27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9152b88-6f", "ovs_interfaceid": "b9152b88-6f67-4bcb-bcd0-64a3a04103dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T11:36:11Z,direct_url=<?>,disk_format='qcow2',id=0a2904ae-083d-41c8-83db-343132b36148,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7a77880136a54ef195c82e018e1939db',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T11:36:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': '0a2904ae-083d-41c8-83db-343132b36148'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 11:58:12 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-06cd56be-0af6-4c02-8841-9a9fea796083 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:58:12 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-06cd56be-0af6-4c02-8841-9a9fea796083 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:58:12 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-06cd56be-0af6-4c02-8841-9a9fea796083 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 11:58:12 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-06cd56be-0af6-4c02-8841-9a9fea796083 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] CPU controller missing on host. {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 11:58:12 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-06cd56be-0af6-4c02-8841-9a9fea796083 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 11:58:12 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-06cd56be-0af6-4c02-8841-9a9fea796083 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] CPU controller found on host. {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 11:58:12 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-06cd56be-0af6-4c02-8841-9a9fea796083 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73449) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 11:58:12 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-06cd56be-0af6-4c02-8841-9a9fea796083 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T11:35:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T11:36:11Z,direct_url=<?>,disk_format='qcow2',id=0a2904ae-083d-41c8-83db-343132b36148,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7a77880136a54ef195c82e018e1939db',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T11:36:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 11:58:12 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-06cd56be-0af6-4c02-8841-9a9fea796083 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Flavor limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 11:58:12 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-06cd56be-0af6-4c02-8841-9a9fea796083 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Image limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 11:58:12 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-06cd56be-0af6-4c02-8841-9a9fea796083 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Flavor pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 11:58:12 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-06cd56be-0af6-4c02-8841-9a9fea796083 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Image pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 11:58:12 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-06cd56be-0af6-4c02-8841-9a9fea796083 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 11:58:12 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-06cd56be-0af6-4c02-8841-9a9fea796083 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 11:58:12 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-06cd56be-0af6-4c02-8841-9a9fea796083 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 11:58:12 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-06cd56be-0af6-4c02-8841-9a9fea796083 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Got 1 possible topologies {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 11:58:12 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-06cd56be-0af6-4c02-8841-9a9fea796083 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 11:58:12 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-06cd56be-0af6-4c02-8841-9a9fea796083 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 11:58:13 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-06cd56be-0af6-4c02-8841-9a9fea796083 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:58:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-674583217',display_name='tempest-TestServerVolumeAttachmentScenario-server-674583217',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-674583217',id=38,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCXWqLXpWF8erKgB3vM3vw2DGg6dfNJsZsM8jNUJuubW4nr3/Me/ODTj0B6fjZCkTEIUnFqIijRGIRwM3XAXz9jFAAZsQH1LmOqziapTXFMx6WlNv83637EGmrD6si+xRg==',key_name='tempest-keypair-1050136507',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='43bbeaa2a37b4189a850b409ac6e1c27',ramdisk_id='',reservation_id='r-kx80z54f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-799133608',owner_user_name='tempest-TestServerVolumeAttachmentScenario-799133608-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T11:58:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80c63646b70647b295581670ff09df83',uuid=5cacd9ed-27fb-431d-999e-31ff2464d14d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b9152b88-6f67-4bcb-bcd0-64a3a04103dc", "address": "fa:16:3e:e5:8a:59", "network": {"id": "78528cb3-037c-4381-964f-7c0211faa0f0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-330540320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43bbeaa2a37b4189a850b409ac6e1c27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9152b88-6f", "ovs_interfaceid": "b9152b88-6f67-4bcb-bcd0-64a3a04103dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73449) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 11:58:13 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-06cd56be-0af6-4c02-8841-9a9fea796083 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Converting VIF {"id": "b9152b88-6f67-4bcb-bcd0-64a3a04103dc", "address": "fa:16:3e:e5:8a:59", "network": {"id": "78528cb3-037c-4381-964f-7c0211faa0f0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-330540320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43bbeaa2a37b4189a850b409ac6e1c27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9152b88-6f", "ovs_interfaceid": "b9152b88-6f67-4bcb-bcd0-64a3a04103dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:58:13 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-06cd56be-0af6-4c02-8841-9a9fea796083 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:8a:59,bridge_name='br-int',has_traffic_filtering=True,id=b9152b88-6f67-4bcb-bcd0-64a3a04103dc,network=Network(78528cb3-037c-4381-964f-7c0211faa0f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9152b88-6f') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:58:13 user nova-compute[73449]: DEBUG nova.objects.instance [None req-06cd56be-0af6-4c02-8841-9a9fea796083 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Lazy-loading 'pci_devices' on Instance uuid 5cacd9ed-27fb-431d-999e-31ff2464d14d {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:58:13 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 4a9e8ad2-19db-4975-87e4-2efce603a7d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:58:13 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 3d74c8f6-fb4e-4460-b722-674a8a1e2d25 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:58:13 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance ae75d334-431a-4008-8b3d-f2a727d92417 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:58:13 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 89440604-1daf-4e7a-a524-2f9c21a9cb96 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:58:13 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 31f5f3d2-41d8-4a26-9eb2-18b891f94734 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:58:13 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance b32df06e-0b5a-4384-946b-64d64aeeb07e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:58:13 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 042713b8-ab7f-4c14-92e5-f830ccb7e341 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:58:13 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 9e68a702-ead5-47ae-9375-5cd00b947ef4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:58:13 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 4b7932d8-b781-4db7-a1c5-791ce8d1d866 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:58:13 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 773e5c86-a86a-414d-aab4-8e13e0b68c1e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:58:13 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 5cacd9ed-27fb-431d-999e-31ff2464d14d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:58:13 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=73449) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 11:58:13 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=73449) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 11:58:13 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-06cd56be-0af6-4c02-8841-9a9fea796083 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] [instance: 5cacd9ed-27fb-431d-999e-31ff2464d14d] End _get_guest_xml xml=<domain type="kvm">
Aug 17 11:58:13 user nova-compute[73449]:   <uuid>5cacd9ed-27fb-431d-999e-31ff2464d14d</uuid>
Aug 17 11:58:13 user nova-compute[73449]:   <name>instance-00000026</name>
Aug 17 11:58:13 user nova-compute[73449]:   <memory>524288</memory>
Aug 17 11:58:13 user nova-compute[73449]:   <vcpu>1</vcpu>
Aug 17 11:58:13 user nova-compute[73449]:   <metadata>
Aug 17 11:58:13 user nova-compute[73449]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 11:58:13 user nova-compute[73449]:       <nova:package version="0.0.0"/>
Aug 17 11:58:13 user nova-compute[73449]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-674583217</nova:name>
Aug 17 11:58:13 user nova-compute[73449]:       <nova:creationTime>2023-08-17 11:58:12</nova:creationTime>
Aug 17 11:58:13 user nova-compute[73449]:       <nova:flavor name="m1.tiny">
Aug 17 11:58:13 user nova-compute[73449]:         <nova:memory>512</nova:memory>
Aug 17 11:58:13 user nova-compute[73449]:         <nova:disk>1</nova:disk>
Aug 17 11:58:13 user nova-compute[73449]:         <nova:swap>0</nova:swap>
Aug 17 11:58:13 user nova-compute[73449]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 11:58:13 user nova-compute[73449]:         <nova:vcpus>1</nova:vcpus>
Aug 17 11:58:13 user nova-compute[73449]:       </nova:flavor>
Aug 17 11:58:13 user nova-compute[73449]:       <nova:owner>
Aug 17 11:58:13 user nova-compute[73449]:         <nova:user uuid="80c63646b70647b295581670ff09df83">tempest-TestServerVolumeAttachmentScenario-799133608-project-member</nova:user>
Aug 17 11:58:13 user nova-compute[73449]:         <nova:project uuid="43bbeaa2a37b4189a850b409ac6e1c27">tempest-TestServerVolumeAttachmentScenario-799133608</nova:project>
Aug 17 11:58:13 user nova-compute[73449]:       </nova:owner>
Aug 17 11:58:13 user nova-compute[73449]:       <nova:root type="image" uuid="0a2904ae-083d-41c8-83db-343132b36148"/>
Aug 17 11:58:13 user nova-compute[73449]:       <nova:ports>
Aug 17 11:58:13 user nova-compute[73449]:         <nova:port uuid="b9152b88-6f67-4bcb-bcd0-64a3a04103dc">
Aug 17 11:58:13 user nova-compute[73449]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 17 11:58:13 user nova-compute[73449]:         </nova:port>
Aug 17 11:58:13 user nova-compute[73449]:       </nova:ports>
Aug 17 11:58:13 user nova-compute[73449]:     </nova:instance>
Aug 17 11:58:13 user nova-compute[73449]:   </metadata>
Aug 17 11:58:13 user nova-compute[73449]:   <sysinfo type="smbios">
Aug 17 11:58:13 user nova-compute[73449]:     <system>
Aug 17 11:58:13 user nova-compute[73449]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 11:58:13 user nova-compute[73449]:       <entry name="product">OpenStack Nova</entry>
Aug 17 11:58:13 user nova-compute[73449]:       <entry name="version">0.0.0</entry>
Aug 17 11:58:13 user nova-compute[73449]:       <entry name="serial">5cacd9ed-27fb-431d-999e-31ff2464d14d</entry>
Aug 17 11:58:13 user nova-compute[73449]:       <entry name="uuid">5cacd9ed-27fb-431d-999e-31ff2464d14d</entry>
Aug 17 11:58:13 user nova-compute[73449]:       <entry name="family">Virtual Machine</entry>
Aug 17 11:58:13 user nova-compute[73449]:     </system>
Aug 17 11:58:13 user nova-compute[73449]:   </sysinfo>
Aug 17 11:58:13 user nova-compute[73449]:   <os>
Aug 17 11:58:13 user nova-compute[73449]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 11:58:13 user nova-compute[73449]:     <boot dev="hd"/>
Aug 17 11:58:13 user nova-compute[73449]:     <smbios mode="sysinfo"/>
Aug 17 11:58:13 user nova-compute[73449]:   </os>
Aug 17 11:58:13 user nova-compute[73449]:   <features>
Aug 17 11:58:13 user nova-compute[73449]:     <acpi/>
Aug 17 11:58:13 user nova-compute[73449]:     <apic/>
Aug 17 11:58:13 user nova-compute[73449]:     <vmcoreinfo/>
Aug 17 11:58:13 user nova-compute[73449]:   </features>
Aug 17 11:58:13 user nova-compute[73449]:   <clock offset="utc">
Aug 17 11:58:13 user nova-compute[73449]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 11:58:13 user nova-compute[73449]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 11:58:13 user nova-compute[73449]:     <timer name="hpet" present="no"/>
Aug 17 11:58:13 user nova-compute[73449]:   </clock>
Aug 17 11:58:13 user nova-compute[73449]:   <cpu mode="custom" match="exact">
Aug 17 11:58:13 user nova-compute[73449]:     <model>Nehalem</model>
Aug 17 11:58:13 user nova-compute[73449]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 11:58:13 user nova-compute[73449]:   </cpu>
Aug 17 11:58:13 user nova-compute[73449]:   <devices>
Aug 17 11:58:13 user nova-compute[73449]:     <disk type="file" device="disk">
Aug 17 11:58:13 user nova-compute[73449]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 11:58:13 user nova-compute[73449]:       <source file="/opt/stack/data/nova/instances/5cacd9ed-27fb-431d-999e-31ff2464d14d/disk"/>
Aug 17 11:58:13 user nova-compute[73449]:       <target dev="vda" bus="virtio"/>
Aug 17 11:58:13 user nova-compute[73449]:     </disk>
Aug 17 11:58:13 user nova-compute[73449]:     <interface type="ethernet">
Aug 17 11:58:13 user nova-compute[73449]:       <mac address="fa:16:3e:e5:8a:59"/>
Aug 17 11:58:13 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 11:58:13 user nova-compute[73449]:       <mtu size="1442"/>
Aug 17 11:58:13 user nova-compute[73449]:       <target dev="tapb9152b88-6f"/>
Aug 17 11:58:13 user nova-compute[73449]:     </interface>
Aug 17 11:58:13 user nova-compute[73449]:     <serial type="pty">
Aug 17 11:58:13 user nova-compute[73449]:       <log file="/opt/stack/data/nova/instances/5cacd9ed-27fb-431d-999e-31ff2464d14d/console.log" append="off"/>
Aug 17 11:58:13 user nova-compute[73449]:     </serial>
Aug 17 11:58:13 user nova-compute[73449]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 11:58:13 user nova-compute[73449]:     <video>
Aug 17 11:58:13 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 11:58:13 user nova-compute[73449]:     </video>
Aug 17 11:58:13 user nova-compute[73449]:     <rng model="virtio">
Aug 17 11:58:13 user nova-compute[73449]:       <backend model="random">/dev/urandom</backend>
Aug 17 11:58:13 user nova-compute[73449]:     </rng>
Aug 17 11:58:13 user nova-compute[73449]:     <controller type="usb" index="0" model="none"/>
Aug 17 11:58:13 user nova-compute[73449]:     <memballoon model="virtio">
Aug 17 11:58:13 user nova-compute[73449]:       <stats period="10"/>
Aug 17 11:58:13 user nova-compute[73449]:     </memballoon>
Aug 17 11:58:13 user nova-compute[73449]:   </devices>
Aug 17 11:58:13 user nova-compute[73449]: </domain>
Aug 17 11:58:13 user nova-compute[73449]:  {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 11:58:13 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-06cd56be-0af6-4c02-8841-9a9fea796083 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:58:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-674583217',display_name='tempest-TestServerVolumeAttachmentScenario-server-674583217',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-674583217',id=38,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCXWqLXpWF8erKgB3vM3vw2DGg6dfNJsZsM8jNUJuubW4nr3/Me/ODTj0B6fjZCkTEIUnFqIijRGIRwM3XAXz9jFAAZsQH1LmOqziapTXFMx6WlNv83637EGmrD6si+xRg==',key_name='tempest-keypair-1050136507',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='43bbeaa2a37b4189a850b409ac6e1c27',ramdisk_id='',reservation_id='r-kx80z54f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-799133608',owner_user_name='tempest-TestServerVolumeAttachmentScenario-799133608-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T11:58:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80c63646b70647b295581670ff09df83',uuid=5cacd9ed-27fb-431d-999e-31ff2464d14d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b9152b88-6f67-4bcb-bcd0-64a3a04103dc", "address": "fa:16:3e:e5:8a:59", "network": {"id": "78528cb3-037c-4381-964f-7c0211faa0f0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-330540320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43bbeaa2a37b4189a850b409ac6e1c27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9152b88-6f", "ovs_interfaceid": "b9152b88-6f67-4bcb-bcd0-64a3a04103dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 11:58:13 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-06cd56be-0af6-4c02-8841-9a9fea796083 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Converting VIF {"id": "b9152b88-6f67-4bcb-bcd0-64a3a04103dc", "address": "fa:16:3e:e5:8a:59", "network": {"id": "78528cb3-037c-4381-964f-7c0211faa0f0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-330540320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43bbeaa2a37b4189a850b409ac6e1c27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9152b88-6f", "ovs_interfaceid": "b9152b88-6f67-4bcb-bcd0-64a3a04103dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:58:13 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-06cd56be-0af6-4c02-8841-9a9fea796083 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:8a:59,bridge_name='br-int',has_traffic_filtering=True,id=b9152b88-6f67-4bcb-bcd0-64a3a04103dc,network=Network(78528cb3-037c-4381-964f-7c0211faa0f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9152b88-6f') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:58:13 user nova-compute[73449]: DEBUG os_vif [None req-06cd56be-0af6-4c02-8841-9a9fea796083 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:8a:59,bridge_name='br-int',has_traffic_filtering=True,id=b9152b88-6f67-4bcb-bcd0-64a3a04103dc,network=Network(78528cb3-037c-4381-964f-7c0211faa0f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9152b88-6f') {{(pid=73449) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 11:58:13 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:58:13 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:58:13 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 11:58:13 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:58:13 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb9152b88-6f, may_exist=True, interface_attrs={}) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:58:13 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb9152b88-6f, col_values=(('external_ids', {'iface-id': 'b9152b88-6f67-4bcb-bcd0-64a3a04103dc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e5:8a:59', 'vm-uuid': '5cacd9ed-27fb-431d-999e-31ff2464d14d'}),), if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:58:13 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:58:13 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:58:13 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:58:13 user nova-compute[73449]: INFO os_vif [None req-06cd56be-0af6-4c02-8841-9a9fea796083 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:8a:59,bridge_name='br-int',has_traffic_filtering=True,id=b9152b88-6f67-4bcb-bcd0-64a3a04103dc,network=Network(78528cb3-037c-4381-964f-7c0211faa0f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9152b88-6f')
Aug 17 11:58:13 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-06cd56be-0af6-4c02-8841-9a9fea796083 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] No BDM found with device name vda, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 11:58:13 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-06cd56be-0af6-4c02-8841-9a9fea796083 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] No VIF found with MAC fa:16:3e:e5:8a:59, not building metadata {{(pid=73449) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 11:58:13 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 11:58:13 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 11:58:13 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Compute_service record updated for user:user {{(pid=73449) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 11:58:13 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.556s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:58:13 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:58:14 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:58:14 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:58:14 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:58:14 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:58:14 user nova-compute[73449]: DEBUG nova.compute.manager [req-9da76fd3-3d0a-4b1c-ae71-87dee169e3eb req-1c22cb8b-9872-4fb9-8500-e5be68b0a6eb service nova] [instance: 5cacd9ed-27fb-431d-999e-31ff2464d14d] Received event network-vif-plugged-b9152b88-6f67-4bcb-bcd0-64a3a04103dc {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:58:14 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-9da76fd3-3d0a-4b1c-ae71-87dee169e3eb req-1c22cb8b-9872-4fb9-8500-e5be68b0a6eb service nova] Acquiring lock "5cacd9ed-27fb-431d-999e-31ff2464d14d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:58:14 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-9da76fd3-3d0a-4b1c-ae71-87dee169e3eb req-1c22cb8b-9872-4fb9-8500-e5be68b0a6eb service nova] Lock "5cacd9ed-27fb-431d-999e-31ff2464d14d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:58:14 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-9da76fd3-3d0a-4b1c-ae71-87dee169e3eb req-1c22cb8b-9872-4fb9-8500-e5be68b0a6eb service nova] Lock "5cacd9ed-27fb-431d-999e-31ff2464d14d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:58:14 user nova-compute[73449]: DEBUG nova.compute.manager [req-9da76fd3-3d0a-4b1c-ae71-87dee169e3eb req-1c22cb8b-9872-4fb9-8500-e5be68b0a6eb service nova] [instance: 5cacd9ed-27fb-431d-999e-31ff2464d14d] No waiting events found dispatching network-vif-plugged-b9152b88-6f67-4bcb-bcd0-64a3a04103dc {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:58:14 user nova-compute[73449]: WARNING nova.compute.manager [req-9da76fd3-3d0a-4b1c-ae71-87dee169e3eb req-1c22cb8b-9872-4fb9-8500-e5be68b0a6eb service nova] [instance: 5cacd9ed-27fb-431d-999e-31ff2464d14d] Received unexpected event network-vif-plugged-b9152b88-6f67-4bcb-bcd0-64a3a04103dc for instance with vm_state building and task_state spawning.
Aug 17 11:58:15 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:58:15 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:58:15 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:58:16 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692273496.677109, 5cacd9ed-27fb-431d-999e-31ff2464d14d => Resumed> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:58:16 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 5cacd9ed-27fb-431d-999e-31ff2464d14d] VM Resumed (Lifecycle Event)
Aug 17 11:58:16 user nova-compute[73449]: DEBUG nova.compute.manager [None req-06cd56be-0af6-4c02-8841-9a9fea796083 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] [instance: 5cacd9ed-27fb-431d-999e-31ff2464d14d] Instance event wait completed in 0 seconds for  {{(pid=73449) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 11:58:16 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-06cd56be-0af6-4c02-8841-9a9fea796083 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] [instance: 5cacd9ed-27fb-431d-999e-31ff2464d14d] Guest created on hypervisor {{(pid=73449) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 11:58:16 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: 5cacd9ed-27fb-431d-999e-31ff2464d14d] Instance spawned successfully.
Aug 17 11:58:16 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-06cd56be-0af6-4c02-8841-9a9fea796083 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] [instance: 5cacd9ed-27fb-431d-999e-31ff2464d14d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 11:58:16 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 5cacd9ed-27fb-431d-999e-31ff2464d14d] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:58:16 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 5cacd9ed-27fb-431d-999e-31ff2464d14d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 11:58:16 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-06cd56be-0af6-4c02-8841-9a9fea796083 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] [instance: 5cacd9ed-27fb-431d-999e-31ff2464d14d] Found default for hw_cdrom_bus of ide {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:58:16 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-06cd56be-0af6-4c02-8841-9a9fea796083 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] [instance: 5cacd9ed-27fb-431d-999e-31ff2464d14d] Found default for hw_disk_bus of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:58:16 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-06cd56be-0af6-4c02-8841-9a9fea796083 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] [instance: 5cacd9ed-27fb-431d-999e-31ff2464d14d] Found default for hw_input_bus of None {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:58:16 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-06cd56be-0af6-4c02-8841-9a9fea796083 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] [instance: 5cacd9ed-27fb-431d-999e-31ff2464d14d] Found default for hw_pointer_model of None {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:58:16 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-06cd56be-0af6-4c02-8841-9a9fea796083 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] [instance: 5cacd9ed-27fb-431d-999e-31ff2464d14d] Found default for hw_video_model of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:58:16 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-06cd56be-0af6-4c02-8841-9a9fea796083 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] [instance: 5cacd9ed-27fb-431d-999e-31ff2464d14d] Found default for hw_vif_model of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:58:16 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 5cacd9ed-27fb-431d-999e-31ff2464d14d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 11:58:16 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692273496.6807587, 5cacd9ed-27fb-431d-999e-31ff2464d14d => Started> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:58:16 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 5cacd9ed-27fb-431d-999e-31ff2464d14d] VM Started (Lifecycle Event)
Aug 17 11:58:16 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 5cacd9ed-27fb-431d-999e-31ff2464d14d] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:58:16 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 5cacd9ed-27fb-431d-999e-31ff2464d14d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 11:58:16 user nova-compute[73449]: DEBUG nova.compute.manager [req-6990da68-8a28-4d80-9b32-e66f9e04c40b req-d9918257-a8f4-4491-b968-18ae864ccda4 service nova] [instance: 5cacd9ed-27fb-431d-999e-31ff2464d14d] Received event network-vif-plugged-b9152b88-6f67-4bcb-bcd0-64a3a04103dc {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:58:16 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-6990da68-8a28-4d80-9b32-e66f9e04c40b req-d9918257-a8f4-4491-b968-18ae864ccda4 service nova] Acquiring lock "5cacd9ed-27fb-431d-999e-31ff2464d14d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:58:16 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-6990da68-8a28-4d80-9b32-e66f9e04c40b req-d9918257-a8f4-4491-b968-18ae864ccda4 service nova] Lock "5cacd9ed-27fb-431d-999e-31ff2464d14d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:58:16 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-6990da68-8a28-4d80-9b32-e66f9e04c40b req-d9918257-a8f4-4491-b968-18ae864ccda4 service nova] Lock "5cacd9ed-27fb-431d-999e-31ff2464d14d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:58:16 user nova-compute[73449]: DEBUG nova.compute.manager [req-6990da68-8a28-4d80-9b32-e66f9e04c40b req-d9918257-a8f4-4491-b968-18ae864ccda4 service nova] [instance: 5cacd9ed-27fb-431d-999e-31ff2464d14d] No waiting events found dispatching network-vif-plugged-b9152b88-6f67-4bcb-bcd0-64a3a04103dc {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:58:16 user nova-compute[73449]: WARNING nova.compute.manager [req-6990da68-8a28-4d80-9b32-e66f9e04c40b req-d9918257-a8f4-4491-b968-18ae864ccda4 service nova] [instance: 5cacd9ed-27fb-431d-999e-31ff2464d14d] Received unexpected event network-vif-plugged-b9152b88-6f67-4bcb-bcd0-64a3a04103dc for instance with vm_state building and task_state spawning.
Aug 17 11:58:16 user nova-compute[73449]: DEBUG nova.compute.manager [req-6990da68-8a28-4d80-9b32-e66f9e04c40b req-d9918257-a8f4-4491-b968-18ae864ccda4 service nova] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] Received event network-changed-dbd5bb98-0410-4179-a99a-9181d85357ea {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:58:16 user nova-compute[73449]: DEBUG nova.compute.manager [req-6990da68-8a28-4d80-9b32-e66f9e04c40b req-d9918257-a8f4-4491-b968-18ae864ccda4 service nova] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] Refreshing instance network info cache due to event network-changed-dbd5bb98-0410-4179-a99a-9181d85357ea. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 11:58:16 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-6990da68-8a28-4d80-9b32-e66f9e04c40b req-d9918257-a8f4-4491-b968-18ae864ccda4 service nova] Acquiring lock "refresh_cache-4b7932d8-b781-4db7-a1c5-791ce8d1d866" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:58:16 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-6990da68-8a28-4d80-9b32-e66f9e04c40b req-d9918257-a8f4-4491-b968-18ae864ccda4 service nova] Acquired lock "refresh_cache-4b7932d8-b781-4db7-a1c5-791ce8d1d866" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:58:16 user nova-compute[73449]: DEBUG nova.network.neutron [req-6990da68-8a28-4d80-9b32-e66f9e04c40b req-d9918257-a8f4-4491-b968-18ae864ccda4 service nova] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] Refreshing network info cache for port dbd5bb98-0410-4179-a99a-9181d85357ea {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 11:58:16 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 5cacd9ed-27fb-431d-999e-31ff2464d14d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 11:58:16 user nova-compute[73449]: INFO nova.compute.manager [None req-06cd56be-0af6-4c02-8841-9a9fea796083 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] [instance: 5cacd9ed-27fb-431d-999e-31ff2464d14d] Took 6.28 seconds to spawn the instance on the hypervisor.
Aug 17 11:58:16 user nova-compute[73449]: DEBUG nova.compute.manager [None req-06cd56be-0af6-4c02-8841-9a9fea796083 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] [instance: 5cacd9ed-27fb-431d-999e-31ff2464d14d] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:58:16 user nova-compute[73449]: INFO nova.compute.manager [None req-06cd56be-0af6-4c02-8841-9a9fea796083 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] [instance: 5cacd9ed-27fb-431d-999e-31ff2464d14d] Took 7.33 seconds to build instance.
Aug 17 11:58:16 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-06cd56be-0af6-4c02-8841-9a9fea796083 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Lock "5cacd9ed-27fb-431d-999e-31ff2464d14d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.460s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:58:17 user nova-compute[73449]: DEBUG nova.network.neutron [req-6990da68-8a28-4d80-9b32-e66f9e04c40b req-d9918257-a8f4-4491-b968-18ae864ccda4 service nova] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] Updated VIF entry in instance network info cache for port dbd5bb98-0410-4179-a99a-9181d85357ea. {{(pid=73449) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 11:58:17 user nova-compute[73449]: DEBUG nova.network.neutron [req-6990da68-8a28-4d80-9b32-e66f9e04c40b req-d9918257-a8f4-4491-b968-18ae864ccda4 service nova] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] Updating instance_info_cache with network_info: [{"id": "dbd5bb98-0410-4179-a99a-9181d85357ea", "address": "fa:16:3e:5d:b1:0e", "network": {"id": "d56bc428-6be6-4aa9-b43c-9d4a0f1dd83b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-791364634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe7b5fee01a042bb90e40b18a84c82c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbd5bb98-04", "ovs_interfaceid": "dbd5bb98-0410-4179-a99a-9181d85357ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:58:17 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-6990da68-8a28-4d80-9b32-e66f9e04c40b req-d9918257-a8f4-4491-b968-18ae864ccda4 service nova] Releasing lock "refresh_cache-4b7932d8-b781-4db7-a1c5-791ce8d1d866" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:58:18 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:58:18 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:58:18 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-8589ef2d-34ea-4298-9813-120422f12641 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Acquiring lock "9e68a702-ead5-47ae-9375-5cd00b947ef4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:58:18 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-8589ef2d-34ea-4298-9813-120422f12641 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Lock "9e68a702-ead5-47ae-9375-5cd00b947ef4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:58:18 user nova-compute[73449]: INFO nova.compute.manager [None req-8589ef2d-34ea-4298-9813-120422f12641 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] [instance: 9e68a702-ead5-47ae-9375-5cd00b947ef4] Detaching volume 8418d863-920b-4e8e-b7c6-633e8cdd2304
Aug 17 11:58:18 user nova-compute[73449]: INFO nova.virt.block_device [None req-8589ef2d-34ea-4298-9813-120422f12641 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] [instance: 9e68a702-ead5-47ae-9375-5cd00b947ef4] Attempting to driver detach volume 8418d863-920b-4e8e-b7c6-633e8cdd2304 from mountpoint /dev/vdb
Aug 17 11:58:18 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-8589ef2d-34ea-4298-9813-120422f12641 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Attempting to detach device vdb from instance 9e68a702-ead5-47ae-9375-5cd00b947ef4 from the persistent domain config. {{(pid=73449) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 11:58:18 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-8589ef2d-34ea-4298-9813-120422f12641 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 11:58:18 user nova-compute[73449]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 11:58:18 user nova-compute[73449]:   <source dev="/dev/sdf"/>
Aug 17 11:58:18 user nova-compute[73449]:   <target dev="vdb" bus="virtio"/>
Aug 17 11:58:18 user nova-compute[73449]:   <serial>8418d863-920b-4e8e-b7c6-633e8cdd2304</serial>
Aug 17 11:58:18 user nova-compute[73449]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 11:58:18 user nova-compute[73449]: </disk>
Aug 17 11:58:18 user nova-compute[73449]:  {{(pid=73449) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 11:58:18 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-8589ef2d-34ea-4298-9813-120422f12641 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Successfully detached device vdb from instance 9e68a702-ead5-47ae-9375-5cd00b947ef4 from the persistent domain config.
Aug 17 11:58:18 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-8589ef2d-34ea-4298-9813-120422f12641 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9e68a702-ead5-47ae-9375-5cd00b947ef4 from the live domain config. {{(pid=73449) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 11:58:18 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-8589ef2d-34ea-4298-9813-120422f12641 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 11:58:18 user nova-compute[73449]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 11:58:18 user nova-compute[73449]:   <source dev="/dev/sdf"/>
Aug 17 11:58:18 user nova-compute[73449]:   <target dev="vdb" bus="virtio"/>
Aug 17 11:58:18 user nova-compute[73449]:   <serial>8418d863-920b-4e8e-b7c6-633e8cdd2304</serial>
Aug 17 11:58:18 user nova-compute[73449]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 11:58:18 user nova-compute[73449]: </disk>
Aug 17 11:58:18 user nova-compute[73449]:  {{(pid=73449) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 11:58:19 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-cb850526-e9ef-4bdf-b514-54fd163ac62d tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Acquiring lock "9e68a702-ead5-47ae-9375-5cd00b947ef4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:58:19 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Received event <DeviceRemovedEvent: 1692273499.4381053, 9e68a702-ead5-47ae-9375-5cd00b947ef4 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73449) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 11:58:19 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-8589ef2d-34ea-4298-9813-120422f12641 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9e68a702-ead5-47ae-9375-5cd00b947ef4 {{(pid=73449) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 11:58:19 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-8589ef2d-34ea-4298-9813-120422f12641 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Successfully detached device vdb from instance 9e68a702-ead5-47ae-9375-5cd00b947ef4 from the live domain config.
Aug 17 11:58:19 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8589ef2d-34ea-4298-9813-120422f12641 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] [instance: 9e68a702-ead5-47ae-9375-5cd00b947ef4] calling os-brick to detach iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 11:58:19 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-8589ef2d-34ea-4298-9813-120422f12641 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, {'target_iqns': ['iqn.2010-10.org.openstack:8418d863-920b-4e8e-b7c6-633e8cdd2304'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GHhPTgOb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 11:58:19 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-8589ef2d-34ea-4298-9813-120422f12641 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 11:58:19 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-8589ef2d-34ea-4298-9813-120422f12641 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:58:19 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-8589ef2d-34ea-4298-9813-120422f12641 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:58:19 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-8589ef2d-34ea-4298-9813-120422f12641 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8418d863-920b-4e8e-b7c6-633e8cdd2304', 0)] {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 11:58:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:58:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:58:19 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[7841d8d6-7f5a-43f6-a53a-b3dad74d2469]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e360063-8525-4d62-8fa0-33c5062fc247\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8418d863-920b-4e8e-b7c6-633e8cdd2304\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:58:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:58:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:58:19 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[77e0ce06-4ce1-4d56-8493-1cd733e630bd]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e360063-8525-4d62-8fa0-33c5062fc247 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8418d863-920b-4e8e-b7c6-633e8cdd2304 (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:58:19 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-8589ef2d-34ea-4298-9813-120422f12641 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)
Aug 17 11:58:19 user nova-compute[73449]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 (non-flash)
Aug 17 11:58:19 user nova-compute[73449]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e360063-8525-4d62-8fa0-33c5062fc247 (non-flash)
Aug 17 11:58:19 user nova-compute[73449]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7 (non-flash)
Aug 17 11:58:19 user nova-compute[73449]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8418d863-920b-4e8e-b7c6-633e8cdd2304 (non-flash)
Aug 17 11:58:19 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:58:19 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-8589ef2d-34ea-4298-9813-120422f12641 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)
Aug 17 11:58:19 user nova-compute[73449]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 (non-flash)
Aug 17 11:58:19 user nova-compute[73449]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e360063-8525-4d62-8fa0-33c5062fc247 (non-flash)
Aug 17 11:58:19 user nova-compute[73449]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7 (non-flash)
Aug 17 11:58:19 user nova-compute[73449]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8418d863-920b-4e8e-b7c6-633e8cdd2304 (non-flash)
Aug 17 11:58:19 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:58:19 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-8589ef2d-34ea-4298-9813-120422f12641 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe7582d9240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8418d863-920b-4e8e-b7c6-633e8cdd2304'): ({'sdf'}, set())}) {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 11:58:19 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-8589ef2d-34ea-4298-9813-120422f12641 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Removing single pathed devices sdf {{(pid=73449) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 11:58:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:58:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:58:19 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2777e92-0396-48ff-aab7-7571c54ab1b3]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:58:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:58:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:58:19 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bea9640-86e5-4814-9726-61263d6c611c]: (4, ('ok\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:58:19 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-8589ef2d-34ea-4298-9813-120422f12641 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Flushing IO for device /dev/sdf {{(pid=73449) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 11:58:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:58:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:58:19 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[1737dda1-68ac-46cf-aa48-1c22d9557607]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:58:19 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-8589ef2d-34ea-4298-9813-120422f12641 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73449) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 11:58:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:58:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.043s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:58:19 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[d215c5c0-7d80-4983-8ed9-65055c46b047]: (4, ('1', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:58:19 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-8589ef2d-34ea-4298-9813-120422f12641 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73449) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 11:58:19 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-8589ef2d-34ea-4298-9813-120422f12641 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] SCSI volumes sdf have been removed. {{(pid=73449) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 11:58:19 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-8589ef2d-34ea-4298-9813-120422f12641 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8418d863-920b-4e8e-b7c6-633e8cdd2304')] {{(pid=73449) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 11:58:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8418d863-920b-4e8e-b7c6-633e8cdd2304 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:58:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8418d863-920b-4e8e-b7c6-633e8cdd2304 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:58:19 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[54ea84e5-b8f1-42d0-b8cd-2fc445f68862]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:58:19 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-8589ef2d-34ea-4298-9813-120422f12641 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:58:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8418d863-920b-4e8e-b7c6-633e8cdd2304 -p 172.16.0.220:3260 --logout {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:58:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8418d863-920b-4e8e-b7c6-633e8cdd2304 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:58:19 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[e72b6845-287f-42e5-84d0-efd345f71a6e]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:8418d863-920b-4e8e-b7c6-633e8cdd2304, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:8418d863-920b-4e8e-b7c6-633e8cdd2304, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:58:19 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-8589ef2d-34ea-4298-9813-120422f12641 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:8418d863-920b-4e8e-b7c6-633e8cdd2304, portal: 172.16.0.220,3260]
Aug 17 11:58:19 user nova-compute[73449]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:8418d863-920b-4e8e-b7c6-633e8cdd2304, portal: 172.16.0.220,3260] successful.
Aug 17 11:58:19 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:58:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8418d863-920b-4e8e-b7c6-633e8cdd2304 -p 172.16.0.220:3260 --op delete {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:58:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8418d863-920b-4e8e-b7c6-633e8cdd2304 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:58:19 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b09eec7-e3a5-4c58-b11d-88402c758239]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:58:19 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-8589ef2d-34ea-4298-9813-120422f12641 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:58:19 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-8589ef2d-34ea-4298-9813-120422f12641 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.341s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:58:19 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-8589ef2d-34ea-4298-9813-120422f12641 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] <== disconnect_volume: return (342ms) None {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 11:58:19 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8589ef2d-34ea-4298-9813-120422f12641 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] [instance: 9e68a702-ead5-47ae-9375-5cd00b947ef4] Disconnected iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 11:58:20 user nova-compute[73449]: DEBUG nova.objects.instance [None req-8589ef2d-34ea-4298-9813-120422f12641 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Lazy-loading 'flavor' on Instance uuid 9e68a702-ead5-47ae-9375-5cd00b947ef4 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:58:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-8589ef2d-34ea-4298-9813-120422f12641 tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Lock "9e68a702-ead5-47ae-9375-5cd00b947ef4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.968s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:58:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-cb850526-e9ef-4bdf-b514-54fd163ac62d tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Lock "9e68a702-ead5-47ae-9375-5cd00b947ef4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.747s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:58:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-cb850526-e9ef-4bdf-b514-54fd163ac62d tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Acquiring lock "9e68a702-ead5-47ae-9375-5cd00b947ef4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:58:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-cb850526-e9ef-4bdf-b514-54fd163ac62d tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Lock "9e68a702-ead5-47ae-9375-5cd00b947ef4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:58:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-cb850526-e9ef-4bdf-b514-54fd163ac62d tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Lock "9e68a702-ead5-47ae-9375-5cd00b947ef4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:58:20 user nova-compute[73449]: INFO nova.compute.manager [None req-cb850526-e9ef-4bdf-b514-54fd163ac62d tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] [instance: 9e68a702-ead5-47ae-9375-5cd00b947ef4] Terminating instance
Aug 17 11:58:20 user nova-compute[73449]: DEBUG nova.compute.manager [None req-cb850526-e9ef-4bdf-b514-54fd163ac62d tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] [instance: 9e68a702-ead5-47ae-9375-5cd00b947ef4] Start destroying the instance on the hypervisor. {{(pid=73449) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 11:58:20 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:58:20 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:58:20 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:58:20 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:58:21 user nova-compute[73449]: DEBUG nova.compute.manager [req-dfddbe7a-b615-4566-9f17-f78dc78b0d22 req-4a1f9424-1ad2-4810-b531-1538a407dc8a service nova] [instance: 9e68a702-ead5-47ae-9375-5cd00b947ef4] Received event network-vif-unplugged-f4c80486-3b7b-4bcc-9593-04a46766dc36 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:58:21 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-dfddbe7a-b615-4566-9f17-f78dc78b0d22 req-4a1f9424-1ad2-4810-b531-1538a407dc8a service nova] Acquiring lock "9e68a702-ead5-47ae-9375-5cd00b947ef4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:58:21 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-dfddbe7a-b615-4566-9f17-f78dc78b0d22 req-4a1f9424-1ad2-4810-b531-1538a407dc8a service nova] Lock "9e68a702-ead5-47ae-9375-5cd00b947ef4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:58:21 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-dfddbe7a-b615-4566-9f17-f78dc78b0d22 req-4a1f9424-1ad2-4810-b531-1538a407dc8a service nova] Lock "9e68a702-ead5-47ae-9375-5cd00b947ef4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:58:21 user nova-compute[73449]: DEBUG nova.compute.manager [req-dfddbe7a-b615-4566-9f17-f78dc78b0d22 req-4a1f9424-1ad2-4810-b531-1538a407dc8a service nova] [instance: 9e68a702-ead5-47ae-9375-5cd00b947ef4] No waiting events found dispatching network-vif-unplugged-f4c80486-3b7b-4bcc-9593-04a46766dc36 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:58:21 user nova-compute[73449]: DEBUG nova.compute.manager [req-dfddbe7a-b615-4566-9f17-f78dc78b0d22 req-4a1f9424-1ad2-4810-b531-1538a407dc8a service nova] [instance: 9e68a702-ead5-47ae-9375-5cd00b947ef4] Received event network-vif-unplugged-f4c80486-3b7b-4bcc-9593-04a46766dc36 for instance with task_state deleting. {{(pid=73449) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 11:58:21 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: 9e68a702-ead5-47ae-9375-5cd00b947ef4] Instance destroyed successfully.
Aug 17 11:58:21 user nova-compute[73449]: DEBUG nova.objects.instance [None req-cb850526-e9ef-4bdf-b514-54fd163ac62d tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Lazy-loading 'resources' on Instance uuid 9e68a702-ead5-47ae-9375-5cd00b947ef4 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:58:21 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-cb850526-e9ef-4bdf-b514-54fd163ac62d tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:55:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1324112572',display_name='tempest-VolumesSnapshotTestJSON-instance-1324112572',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1324112572',id=35,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAeUBC842lE7robHmES8fz+eQ3WZq4NsR5jLSpTc5x/s/Eqd7/7hPnimog+o1z3CURrniR8+QuyMUtxlK2NJClhioavf4Gy/slFFQzw5Jr30/P3RvrfohDzd2/8XTHg5gw==',key_name='tempest-keypair-1504040959',keypairs=<?>,launch_index=0,launched_at=2023-08-17T11:55:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='348b0a78aaf940b98f91655ddd6d4d6d',ramdisk_id='',reservation_id='r-f5qm4nan',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-363415870',owner_user_name='tempest-VolumesSnapshotTestJSON-363415870-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T11:55:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='24c0eff502f744ad8eb6359e320852d4',uuid=9e68a702-ead5-47ae-9375-5cd00b947ef4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f4c80486-3b7b-4bcc-9593-04a46766dc36", "address": "fa:16:3e:35:7f:0b", "network": {"id": "bae20193-cae3-45f8-8881-68020cd853e9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-459774400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "348b0a78aaf940b98f91655ddd6d4d6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4c80486-3b", "ovs_interfaceid": "f4c80486-3b7b-4bcc-9593-04a46766dc36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 11:58:21 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-cb850526-e9ef-4bdf-b514-54fd163ac62d tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Converting VIF {"id": "f4c80486-3b7b-4bcc-9593-04a46766dc36", "address": "fa:16:3e:35:7f:0b", "network": {"id": "bae20193-cae3-45f8-8881-68020cd853e9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-459774400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "348b0a78aaf940b98f91655ddd6d4d6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4c80486-3b", "ovs_interfaceid": "f4c80486-3b7b-4bcc-9593-04a46766dc36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:58:21 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-cb850526-e9ef-4bdf-b514-54fd163ac62d tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:35:7f:0b,bridge_name='br-int',has_traffic_filtering=True,id=f4c80486-3b7b-4bcc-9593-04a46766dc36,network=Network(bae20193-cae3-45f8-8881-68020cd853e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4c80486-3b') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:58:21 user nova-compute[73449]: DEBUG os_vif [None req-cb850526-e9ef-4bdf-b514-54fd163ac62d tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:7f:0b,bridge_name='br-int',has_traffic_filtering=True,id=f4c80486-3b7b-4bcc-9593-04a46766dc36,network=Network(bae20193-cae3-45f8-8881-68020cd853e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4c80486-3b') {{(pid=73449) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 11:58:21 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:58:21 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf4c80486-3b, bridge=br-int, if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:58:21 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:58:21 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:58:21 user nova-compute[73449]: INFO os_vif [None req-cb850526-e9ef-4bdf-b514-54fd163ac62d tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:7f:0b,bridge_name='br-int',has_traffic_filtering=True,id=f4c80486-3b7b-4bcc-9593-04a46766dc36,network=Network(bae20193-cae3-45f8-8881-68020cd853e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4c80486-3b')
Aug 17 11:58:21 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb850526-e9ef-4bdf-b514-54fd163ac62d tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] [instance: 9e68a702-ead5-47ae-9375-5cd00b947ef4] calling os-brick to detach iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 11:58:21 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb850526-e9ef-4bdf-b514-54fd163ac62d tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, {'target_iqns': ['iqn.2010-10.org.openstack:8418d863-920b-4e8e-b7c6-633e8cdd2304'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GHhPTgOb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 11:58:21 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-cb850526-e9ef-4bdf-b514-54fd163ac62d tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 11:58:21 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-cb850526-e9ef-4bdf-b514-54fd163ac62d tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:58:21 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-cb850526-e9ef-4bdf-b514-54fd163ac62d tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:58:21 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb850526-e9ef-4bdf-b514-54fd163ac62d tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8418d863-920b-4e8e-b7c6-633e8cdd2304', 0)] {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 11:58:21 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:58:21 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:58:21 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f253740-3755-4a1e-a242-859b9f7f2be1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e360063-8525-4d62-8fa0-33c5062fc247\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:58:21 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:58:21 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:58:21 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[d384e12d-7fa4-4d52-9c86-d5cdac751e3a]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e360063-8525-4d62-8fa0-33c5062fc247 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7 (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:58:21 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb850526-e9ef-4bdf-b514-54fd163ac62d tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)
Aug 17 11:58:21 user nova-compute[73449]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 (non-flash)
Aug 17 11:58:21 user nova-compute[73449]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e360063-8525-4d62-8fa0-33c5062fc247 (non-flash)
Aug 17 11:58:21 user nova-compute[73449]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7 (non-flash)
Aug 17 11:58:21 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:58:21 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb850526-e9ef-4bdf-b514-54fd163ac62d tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)
Aug 17 11:58:21 user nova-compute[73449]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 (non-flash)
Aug 17 11:58:21 user nova-compute[73449]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e360063-8525-4d62-8fa0-33c5062fc247 (non-flash)
Aug 17 11:58:21 user nova-compute[73449]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7 (non-flash)
Aug 17 11:58:21 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:58:21 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb850526-e9ef-4bdf-b514-54fd163ac62d tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe7582dad40>, {}) {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 11:58:21 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb850526-e9ef-4bdf-b514-54fd163ac62d tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Disconnecting from: [] {{(pid=73449) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 11:58:21 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-cb850526-e9ef-4bdf-b514-54fd163ac62d tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.054s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:58:21 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb850526-e9ef-4bdf-b514-54fd163ac62d tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] <== disconnect_volume: return (56ms) None {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 11:58:21 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb850526-e9ef-4bdf-b514-54fd163ac62d tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] [instance: 9e68a702-ead5-47ae-9375-5cd00b947ef4] Disconnected iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 11:58:21 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-cb850526-e9ef-4bdf-b514-54fd163ac62d tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] [instance: 9e68a702-ead5-47ae-9375-5cd00b947ef4] Deleting instance files /opt/stack/data/nova/instances/9e68a702-ead5-47ae-9375-5cd00b947ef4_del
Aug 17 11:58:21 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-cb850526-e9ef-4bdf-b514-54fd163ac62d tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] [instance: 9e68a702-ead5-47ae-9375-5cd00b947ef4] Deletion of /opt/stack/data/nova/instances/9e68a702-ead5-47ae-9375-5cd00b947ef4_del complete
Aug 17 11:58:21 user nova-compute[73449]: INFO nova.compute.manager [None req-cb850526-e9ef-4bdf-b514-54fd163ac62d tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] [instance: 9e68a702-ead5-47ae-9375-5cd00b947ef4] Took 0.96 seconds to destroy the instance on the hypervisor.
Aug 17 11:58:21 user nova-compute[73449]: DEBUG oslo.service.loopingcall [None req-cb850526-e9ef-4bdf-b514-54fd163ac62d tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73449) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 11:58:21 user nova-compute[73449]: DEBUG nova.compute.manager [-] [instance: 9e68a702-ead5-47ae-9375-5cd00b947ef4] Deallocating network for instance {{(pid=73449) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 11:58:21 user nova-compute[73449]: DEBUG nova.network.neutron [-] [instance: 9e68a702-ead5-47ae-9375-5cd00b947ef4] deallocate_for_instance() {{(pid=73449) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 11:58:22 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-5d525248-9657-4ec5-8632-2474768a1dd0 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Acquiring lock "4b7932d8-b781-4db7-a1c5-791ce8d1d866" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:58:22 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-5d525248-9657-4ec5-8632-2474768a1dd0 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Lock "4b7932d8-b781-4db7-a1c5-791ce8d1d866" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:58:22 user nova-compute[73449]: INFO nova.compute.manager [None req-5d525248-9657-4ec5-8632-2474768a1dd0 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] Shelving
Aug 17 11:58:22 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:58:22 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:58:22 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:58:22 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:58:22 user nova-compute[73449]: DEBUG nova.compute.manager [req-ef09f85d-3521-40a4-93f6-41a249888372 req-a873792a-b525-476f-9fbd-7afbc82a4a84 service nova] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] Received event network-vif-unplugged-dbd5bb98-0410-4179-a99a-9181d85357ea {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:58:22 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-ef09f85d-3521-40a4-93f6-41a249888372 req-a873792a-b525-476f-9fbd-7afbc82a4a84 service nova] Acquiring lock "4b7932d8-b781-4db7-a1c5-791ce8d1d866-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:58:22 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-ef09f85d-3521-40a4-93f6-41a249888372 req-a873792a-b525-476f-9fbd-7afbc82a4a84 service nova] Lock "4b7932d8-b781-4db7-a1c5-791ce8d1d866-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:58:22 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-ef09f85d-3521-40a4-93f6-41a249888372 req-a873792a-b525-476f-9fbd-7afbc82a4a84 service nova] Lock "4b7932d8-b781-4db7-a1c5-791ce8d1d866-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:58:22 user nova-compute[73449]: DEBUG nova.compute.manager [req-ef09f85d-3521-40a4-93f6-41a249888372 req-a873792a-b525-476f-9fbd-7afbc82a4a84 service nova] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] No waiting events found dispatching network-vif-unplugged-dbd5bb98-0410-4179-a99a-9181d85357ea {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:58:22 user nova-compute[73449]: WARNING nova.compute.manager [req-ef09f85d-3521-40a4-93f6-41a249888372 req-a873792a-b525-476f-9fbd-7afbc82a4a84 service nova] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] Received unexpected event network-vif-unplugged-dbd5bb98-0410-4179-a99a-9181d85357ea for instance with vm_state active and task_state shelving.
Aug 17 11:58:22 user nova-compute[73449]: DEBUG nova.network.neutron [-] [instance: 9e68a702-ead5-47ae-9375-5cd00b947ef4] Updating instance_info_cache with network_info: [] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:58:22 user nova-compute[73449]: INFO nova.compute.manager [-] [instance: 9e68a702-ead5-47ae-9375-5cd00b947ef4] Took 1.12 seconds to deallocate network for instance.
Aug 17 11:58:22 user nova-compute[73449]: WARNING nova.volume.cinder [None req-cb850526-e9ef-4bdf-b514-54fd163ac62d tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Attachment ea2dd35b-c1ab-4dad-882e-1439b2ae3b11 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = ea2dd35b-c1ab-4dad-882e-1439b2ae3b11. (HTTP 404) (Request-ID: req-4e2854b4-992b-424f-b1be-28ccc7e92c2a)
Aug 17 11:58:22 user nova-compute[73449]: INFO nova.compute.manager [None req-cb850526-e9ef-4bdf-b514-54fd163ac62d tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] [instance: 9e68a702-ead5-47ae-9375-5cd00b947ef4] Took 0.03 seconds to detach 1 volumes for instance.
Aug 17 11:58:22 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:58:23 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:58:23 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-cb850526-e9ef-4bdf-b514-54fd163ac62d tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:58:23 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-cb850526-e9ef-4bdf-b514-54fd163ac62d tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:58:23 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] Instance destroyed successfully.
Aug 17 11:58:23 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-5d525248-9657-4ec5-8632-2474768a1dd0 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] Beginning cold snapshot process
Aug 17 11:58:23 user nova-compute[73449]: DEBUG nova.compute.manager [req-fdcc55c9-2d69-4a3f-9b5e-2aa047fd5b22 req-50d1b743-336e-41d6-be6a-8b02d58104c8 service nova] [instance: 9e68a702-ead5-47ae-9375-5cd00b947ef4] Received event network-vif-plugged-f4c80486-3b7b-4bcc-9593-04a46766dc36 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:58:23 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-fdcc55c9-2d69-4a3f-9b5e-2aa047fd5b22 req-50d1b743-336e-41d6-be6a-8b02d58104c8 service nova] Acquiring lock "9e68a702-ead5-47ae-9375-5cd00b947ef4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:58:23 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-fdcc55c9-2d69-4a3f-9b5e-2aa047fd5b22 req-50d1b743-336e-41d6-be6a-8b02d58104c8 service nova] Lock "9e68a702-ead5-47ae-9375-5cd00b947ef4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:58:23 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-fdcc55c9-2d69-4a3f-9b5e-2aa047fd5b22 req-50d1b743-336e-41d6-be6a-8b02d58104c8 service nova] Lock "9e68a702-ead5-47ae-9375-5cd00b947ef4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:58:23 user nova-compute[73449]: DEBUG nova.compute.manager [req-fdcc55c9-2d69-4a3f-9b5e-2aa047fd5b22 req-50d1b743-336e-41d6-be6a-8b02d58104c8 service nova] [instance: 9e68a702-ead5-47ae-9375-5cd00b947ef4] No waiting events found dispatching network-vif-plugged-f4c80486-3b7b-4bcc-9593-04a46766dc36 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:58:23 user nova-compute[73449]: WARNING nova.compute.manager [req-fdcc55c9-2d69-4a3f-9b5e-2aa047fd5b22 req-50d1b743-336e-41d6-be6a-8b02d58104c8 service nova] [instance: 9e68a702-ead5-47ae-9375-5cd00b947ef4] Received unexpected event network-vif-plugged-f4c80486-3b7b-4bcc-9593-04a46766dc36 for instance with vm_state deleted and task_state None.
Aug 17 11:58:23 user nova-compute[73449]: DEBUG nova.privsep.utils [None req-5d525248-9657-4ec5-8632-2474768a1dd0 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73449) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 11:58:23 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-5d525248-9657-4ec5-8632-2474768a1dd0 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/4b7932d8-b781-4db7-a1c5-791ce8d1d866/disk /opt/stack/data/nova/instances/snapshots/tmp1l4nsfrr/6293772245df4ac4aed4f5be464d96ff {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:58:23 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:58:23 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-cb850526-e9ef-4bdf-b514-54fd163ac62d tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 11:58:23 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-cb850526-e9ef-4bdf-b514-54fd163ac62d tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 11:58:23 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-cb850526-e9ef-4bdf-b514-54fd163ac62d tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.936s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:58:24 user nova-compute[73449]: INFO nova.scheduler.client.report [None req-cb850526-e9ef-4bdf-b514-54fd163ac62d tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Deleted allocations for instance 9e68a702-ead5-47ae-9375-5cd00b947ef4
Aug 17 11:58:24 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b8436f5c-ae79-41d6-9dde-90a13519b576 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Acquiring lock "b32df06e-0b5a-4384-946b-64d64aeeb07e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:58:24 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b8436f5c-ae79-41d6-9dde-90a13519b576 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Lock "b32df06e-0b5a-4384-946b-64d64aeeb07e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:58:24 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b8436f5c-ae79-41d6-9dde-90a13519b576 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Acquiring lock "b32df06e-0b5a-4384-946b-64d64aeeb07e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:58:24 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b8436f5c-ae79-41d6-9dde-90a13519b576 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Lock "b32df06e-0b5a-4384-946b-64d64aeeb07e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:58:24 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b8436f5c-ae79-41d6-9dde-90a13519b576 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Lock "b32df06e-0b5a-4384-946b-64d64aeeb07e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:58:24 user nova-compute[73449]: INFO nova.compute.manager [None req-b8436f5c-ae79-41d6-9dde-90a13519b576 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] Terminating instance
Aug 17 11:58:24 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b8436f5c-ae79-41d6-9dde-90a13519b576 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] Start destroying the instance on the hypervisor. {{(pid=73449) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 11:58:24 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-cb850526-e9ef-4bdf-b514-54fd163ac62d tempest-VolumesSnapshotTestJSON-363415870 tempest-VolumesSnapshotTestJSON-363415870-project-member] Lock "9e68a702-ead5-47ae-9375-5cd00b947ef4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.453s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:58:24 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:58:24 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:58:24 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:58:24 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:58:24 user nova-compute[73449]: DEBUG nova.compute.manager [req-74d1d734-024e-47e3-91a4-4233bda92644 req-71d532c0-da42-433f-9f65-b9bfdeb0ed40 service nova] [instance: 9e68a702-ead5-47ae-9375-5cd00b947ef4] Received event network-vif-deleted-f4c80486-3b7b-4bcc-9593-04a46766dc36 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:58:24 user nova-compute[73449]: DEBUG nova.compute.manager [req-74d1d734-024e-47e3-91a4-4233bda92644 req-71d532c0-da42-433f-9f65-b9bfdeb0ed40 service nova] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] Received event network-vif-plugged-dbd5bb98-0410-4179-a99a-9181d85357ea {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:58:24 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-74d1d734-024e-47e3-91a4-4233bda92644 req-71d532c0-da42-433f-9f65-b9bfdeb0ed40 service nova] Acquiring lock "4b7932d8-b781-4db7-a1c5-791ce8d1d866-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:58:24 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-74d1d734-024e-47e3-91a4-4233bda92644 req-71d532c0-da42-433f-9f65-b9bfdeb0ed40 service nova] Lock "4b7932d8-b781-4db7-a1c5-791ce8d1d866-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:58:24 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-74d1d734-024e-47e3-91a4-4233bda92644 req-71d532c0-da42-433f-9f65-b9bfdeb0ed40 service nova] Lock "4b7932d8-b781-4db7-a1c5-791ce8d1d866-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:58:24 user nova-compute[73449]: DEBUG nova.compute.manager [req-74d1d734-024e-47e3-91a4-4233bda92644 req-71d532c0-da42-433f-9f65-b9bfdeb0ed40 service nova] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] No waiting events found dispatching network-vif-plugged-dbd5bb98-0410-4179-a99a-9181d85357ea {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:58:24 user nova-compute[73449]: WARNING nova.compute.manager [req-74d1d734-024e-47e3-91a4-4233bda92644 req-71d532c0-da42-433f-9f65-b9bfdeb0ed40 service nova] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] Received unexpected event network-vif-plugged-dbd5bb98-0410-4179-a99a-9181d85357ea for instance with vm_state active and task_state shelving_image_pending_upload.
Aug 17 11:58:24 user nova-compute[73449]: DEBUG nova.compute.manager [req-74d1d734-024e-47e3-91a4-4233bda92644 req-71d532c0-da42-433f-9f65-b9bfdeb0ed40 service nova] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] Received event network-vif-unplugged-4a57c385-a0c8-454a-acbf-d1f783ff3131 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:58:24 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-74d1d734-024e-47e3-91a4-4233bda92644 req-71d532c0-da42-433f-9f65-b9bfdeb0ed40 service nova] Acquiring lock "b32df06e-0b5a-4384-946b-64d64aeeb07e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:58:24 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-74d1d734-024e-47e3-91a4-4233bda92644 req-71d532c0-da42-433f-9f65-b9bfdeb0ed40 service nova] Lock "b32df06e-0b5a-4384-946b-64d64aeeb07e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:58:24 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-74d1d734-024e-47e3-91a4-4233bda92644 req-71d532c0-da42-433f-9f65-b9bfdeb0ed40 service nova] Lock "b32df06e-0b5a-4384-946b-64d64aeeb07e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:58:24 user nova-compute[73449]: DEBUG nova.compute.manager [req-74d1d734-024e-47e3-91a4-4233bda92644 req-71d532c0-da42-433f-9f65-b9bfdeb0ed40 service nova] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] No waiting events found dispatching network-vif-unplugged-4a57c385-a0c8-454a-acbf-d1f783ff3131 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:58:24 user nova-compute[73449]: DEBUG nova.compute.manager [req-74d1d734-024e-47e3-91a4-4233bda92644 req-71d532c0-da42-433f-9f65-b9bfdeb0ed40 service nova] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] Received event network-vif-unplugged-4a57c385-a0c8-454a-acbf-d1f783ff3131 for instance with task_state deleting. {{(pid=73449) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 11:58:24 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-5d525248-9657-4ec5-8632-2474768a1dd0 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/4b7932d8-b781-4db7-a1c5-791ce8d1d866/disk /opt/stack/data/nova/instances/snapshots/tmp1l4nsfrr/6293772245df4ac4aed4f5be464d96ff" returned: 0 in 1.614s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:58:24 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-5d525248-9657-4ec5-8632-2474768a1dd0 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] Snapshot extracted, beginning image upload
Aug 17 11:58:25 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] Instance destroyed successfully.
Aug 17 11:58:25 user nova-compute[73449]: DEBUG nova.objects.instance [None req-b8436f5c-ae79-41d6-9dde-90a13519b576 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Lazy-loading 'resources' on Instance uuid b32df06e-0b5a-4384-946b-64d64aeeb07e {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:58:25 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-b8436f5c-ae79-41d6-9dde-90a13519b576 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:51:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1060578378',display_name='tempest-ServerActionsTestOtherA-server-1060578378',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1060578378',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCjLihiqnR89DD+L9AvKMPg4aJ24FTEbroZyaBsKATQAbGhLg8fsSlSGdiYIhidGfsmIAOo7d+B78UcRA6oBB5kBwNop43IFNlD0zoDm7uS+jBpAFARKuZg2/qBioB0EGg==',key_name='tempest-keypair-71173965',keypairs=<?>,launch_index=0,launched_at=2023-08-17T11:54:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='068c5270255744a18208a0ad9b35f168',ramdisk_id='',reservation_id='r-ycvaidk7',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-303961666',owner_user_name='tempest-ServerActionsTestOtherA-303961666-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T11:55:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e44f6d8893da4d95a8ebe95180355c04',uuid=b32df06e-0b5a-4384-946b-64d64aeeb07e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4a57c385-a0c8-454a-acbf-d1f783ff3131", "address": "fa:16:3e:be:34:a2", "network": {"id": "72c50a42-688f-4868-8e19-c40b103a49cd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1792423641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "068c5270255744a18208a0ad9b35f168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a57c385-a0", "ovs_interfaceid": "4a57c385-a0c8-454a-acbf-d1f783ff3131", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 11:58:25 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-b8436f5c-ae79-41d6-9dde-90a13519b576 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Converting VIF {"id": "4a57c385-a0c8-454a-acbf-d1f783ff3131", "address": "fa:16:3e:be:34:a2", "network": {"id": "72c50a42-688f-4868-8e19-c40b103a49cd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1792423641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "068c5270255744a18208a0ad9b35f168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a57c385-a0", "ovs_interfaceid": "4a57c385-a0c8-454a-acbf-d1f783ff3131", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:58:25 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-b8436f5c-ae79-41d6-9dde-90a13519b576 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:be:34:a2,bridge_name='br-int',has_traffic_filtering=True,id=4a57c385-a0c8-454a-acbf-d1f783ff3131,network=Network(72c50a42-688f-4868-8e19-c40b103a49cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a57c385-a0') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:58:25 user nova-compute[73449]: DEBUG os_vif [None req-b8436f5c-ae79-41d6-9dde-90a13519b576 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:be:34:a2,bridge_name='br-int',has_traffic_filtering=True,id=4a57c385-a0c8-454a-acbf-d1f783ff3131,network=Network(72c50a42-688f-4868-8e19-c40b103a49cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a57c385-a0') {{(pid=73449) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 11:58:25 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:58:25 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4a57c385-a0, bridge=br-int, if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:58:25 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:58:25 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:58:25 user nova-compute[73449]: INFO os_vif [None req-b8436f5c-ae79-41d6-9dde-90a13519b576 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:be:34:a2,bridge_name='br-int',has_traffic_filtering=True,id=4a57c385-a0c8-454a-acbf-d1f783ff3131,network=Network(72c50a42-688f-4868-8e19-c40b103a49cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a57c385-a0')
Aug 17 11:58:25 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8436f5c-ae79-41d6-9dde-90a13519b576 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] calling os-brick to detach iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 11:58:25 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8436f5c-ae79-41d6-9dde-90a13519b576 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, {'target_iqns': ['iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ktosaVNw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 11:58:25 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-b8436f5c-ae79-41d6-9dde-90a13519b576 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 11:58:25 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-b8436f5c-ae79-41d6-9dde-90a13519b576 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:58:25 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-b8436f5c-ae79-41d6-9dde-90a13519b576 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:58:25 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8436f5c-ae79-41d6-9dde-90a13519b576 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7', 0)] {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 11:58:25 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:58:25 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.029s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:58:25 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[54e1d82a-bda4-4050-a12b-85f5f1a664ac]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e360063-8525-4d62-8fa0-33c5062fc247\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:58:25 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:58:25 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:58:25 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[e55790a6-85a0-4d22-8ef0-eb52a0f504a4]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e360063-8525-4d62-8fa0-33c5062fc247 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7 (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:58:25 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8436f5c-ae79-41d6-9dde-90a13519b576 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)
Aug 17 11:58:25 user nova-compute[73449]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 (non-flash)
Aug 17 11:58:25 user nova-compute[73449]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e360063-8525-4d62-8fa0-33c5062fc247 (non-flash)
Aug 17 11:58:25 user nova-compute[73449]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7 (non-flash)
Aug 17 11:58:25 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:58:25 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8436f5c-ae79-41d6-9dde-90a13519b576 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)
Aug 17 11:58:25 user nova-compute[73449]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 (non-flash)
Aug 17 11:58:25 user nova-compute[73449]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e360063-8525-4d62-8fa0-33c5062fc247 (non-flash)
Aug 17 11:58:25 user nova-compute[73449]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7 (non-flash)
Aug 17 11:58:25 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:58:25 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8436f5c-ae79-41d6-9dde-90a13519b576 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe7587be440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7'): ({'sdd'}, set())}) {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 11:58:25 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-b8436f5c-ae79-41d6-9dde-90a13519b576 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Removing single pathed devices sdd {{(pid=73449) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 11:58:25 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:58:25 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:58:25 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[83e6b223-a97e-45f2-ac62-af4c32807fac]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:58:25 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:58:25 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.024s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:58:25 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[1240720a-5507-443b-ac38-41c9adbf2820]: (4, ('ok\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:58:25 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-b8436f5c-ae79-41d6-9dde-90a13519b576 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Flushing IO for device /dev/sdd {{(pid=73449) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 11:58:25 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:58:25 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:58:25 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3c1b670-be94-4239-966a-68b0423abdb1]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:58:25 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-b8436f5c-ae79-41d6-9dde-90a13519b576 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73449) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 11:58:25 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:58:25 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.039s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:58:25 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c49f518-89f8-468a-ac47-922e2141b9ce]: (4, ('1', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:58:25 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-b8436f5c-ae79-41d6-9dde-90a13519b576 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73449) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 11:58:25 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-b8436f5c-ae79-41d6-9dde-90a13519b576 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] SCSI volumes sdd have been removed. {{(pid=73449) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 11:58:25 user nova-compute[73449]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_71bc9408', '/dev/disk/by-id/scsi-26133656162363930', '/dev/disk/by-id/scsi-1SCST_BIO71bc9408-a3eab69024479c06') {{(pid=84309) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 17 11:58:25 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[c098edb7-1202-45fe-9ee1-3d54e52b1eed]: (4, None) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:58:25 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8436f5c-ae79-41d6-9dde-90a13519b576 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7')] {{(pid=73449) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 11:58:25 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:58:25 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:58:25 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[b489bb42-d6c6-4617-9511-d97a0badf4f7]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:58:25 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8436f5c-ae79-41d6-9dde-90a13519b576 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:58:25 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 -p 172.16.0.220:3260 --logout {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:58:25 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:58:25 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c071267-6560-4803-8b25-72cb8593befb]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:58:25 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8436f5c-ae79-41d6-9dde-90a13519b576 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7, portal: 172.16.0.220,3260]
Aug 17 11:58:25 user nova-compute[73449]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7, portal: 172.16.0.220,3260] successful.
Aug 17 11:58:25 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:58:25 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 -p 172.16.0.220:3260 --op delete {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:58:25 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3724ddd1-6668-4637-a4f2-175cf033a0f7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:58:25 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[046f3451-2c71-4780-abdb-eea777db2bdb]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:58:25 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8436f5c-ae79-41d6-9dde-90a13519b576 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:58:25 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-b8436f5c-ae79-41d6-9dde-90a13519b576 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:58:25 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8436f5c-ae79-41d6-9dde-90a13519b576 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] <== disconnect_volume: return (324ms) None {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 11:58:25 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8436f5c-ae79-41d6-9dde-90a13519b576 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] Disconnected iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 11:58:25 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-b8436f5c-ae79-41d6-9dde-90a13519b576 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] Deleting instance files /opt/stack/data/nova/instances/b32df06e-0b5a-4384-946b-64d64aeeb07e_del
Aug 17 11:58:25 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-b8436f5c-ae79-41d6-9dde-90a13519b576 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] Deletion of /opt/stack/data/nova/instances/b32df06e-0b5a-4384-946b-64d64aeeb07e_del complete
Aug 17 11:58:25 user nova-compute[73449]: INFO nova.compute.manager [None req-b8436f5c-ae79-41d6-9dde-90a13519b576 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] Took 1.30 seconds to destroy the instance on the hypervisor.
Aug 17 11:58:25 user nova-compute[73449]: DEBUG oslo.service.loopingcall [None req-b8436f5c-ae79-41d6-9dde-90a13519b576 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73449) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 11:58:25 user nova-compute[73449]: DEBUG nova.compute.manager [-] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] Deallocating network for instance {{(pid=73449) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 11:58:25 user nova-compute[73449]: DEBUG nova.network.neutron [-] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] deallocate_for_instance() {{(pid=73449) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 11:58:26 user nova-compute[73449]: DEBUG nova.network.neutron [-] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] Updating instance_info_cache with network_info: [] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:58:26 user nova-compute[73449]: DEBUG nova.compute.manager [req-456a40bb-7a57-48a2-aea0-38dfa2f9ec31 req-7ea2158f-33ac-45b7-8fe0-9af139ca69f6 service nova] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] Received event network-vif-plugged-4a57c385-a0c8-454a-acbf-d1f783ff3131 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:58:26 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-456a40bb-7a57-48a2-aea0-38dfa2f9ec31 req-7ea2158f-33ac-45b7-8fe0-9af139ca69f6 service nova] Acquiring lock "b32df06e-0b5a-4384-946b-64d64aeeb07e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:58:26 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-456a40bb-7a57-48a2-aea0-38dfa2f9ec31 req-7ea2158f-33ac-45b7-8fe0-9af139ca69f6 service nova] Lock "b32df06e-0b5a-4384-946b-64d64aeeb07e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:58:26 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-456a40bb-7a57-48a2-aea0-38dfa2f9ec31 req-7ea2158f-33ac-45b7-8fe0-9af139ca69f6 service nova] Lock "b32df06e-0b5a-4384-946b-64d64aeeb07e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:58:26 user nova-compute[73449]: DEBUG nova.compute.manager [req-456a40bb-7a57-48a2-aea0-38dfa2f9ec31 req-7ea2158f-33ac-45b7-8fe0-9af139ca69f6 service nova] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] No waiting events found dispatching network-vif-plugged-4a57c385-a0c8-454a-acbf-d1f783ff3131 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:58:26 user nova-compute[73449]: WARNING nova.compute.manager [req-456a40bb-7a57-48a2-aea0-38dfa2f9ec31 req-7ea2158f-33ac-45b7-8fe0-9af139ca69f6 service nova] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] Received unexpected event network-vif-plugged-4a57c385-a0c8-454a-acbf-d1f783ff3131 for instance with vm_state active and task_state deleting.
Aug 17 11:58:26 user nova-compute[73449]: INFO nova.compute.manager [-] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] Took 1.26 seconds to deallocate network for instance.
Aug 17 11:58:27 user nova-compute[73449]: INFO nova.compute.manager [None req-5bca5a47-0d39-439e-bb13-017974e93efd tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Unrescuing
Aug 17 11:58:27 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-5bca5a47-0d39-439e-bb13-017974e93efd tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Acquiring lock "refresh_cache-042713b8-ab7f-4c14-92e5-f830ccb7e341" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:58:27 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-5bca5a47-0d39-439e-bb13-017974e93efd tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Acquired lock "refresh_cache-042713b8-ab7f-4c14-92e5-f830ccb7e341" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:58:27 user nova-compute[73449]: DEBUG nova.network.neutron [None req-5bca5a47-0d39-439e-bb13-017974e93efd tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Building network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 11:58:27 user nova-compute[73449]: INFO nova.compute.manager [None req-b8436f5c-ae79-41d6-9dde-90a13519b576 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] Took 0.84 seconds to detach 1 volumes for instance.
Aug 17 11:58:27 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b8436f5c-ae79-41d6-9dde-90a13519b576 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] Deleting volume: 3724ddd1-6668-4637-a4f2-175cf033a0f7 {{(pid=73449) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 17 11:58:27 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-5d525248-9657-4ec5-8632-2474768a1dd0 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] Snapshot image upload complete
Aug 17 11:58:27 user nova-compute[73449]: DEBUG nova.compute.manager [None req-5d525248-9657-4ec5-8632-2474768a1dd0 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:58:27 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b8436f5c-ae79-41d6-9dde-90a13519b576 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:58:27 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b8436f5c-ae79-41d6-9dde-90a13519b576 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:58:27 user nova-compute[73449]: INFO nova.compute.manager [None req-5d525248-9657-4ec5-8632-2474768a1dd0 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] Shelve offloading
Aug 17 11:58:27 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] Instance destroyed successfully.
Aug 17 11:58:27 user nova-compute[73449]: DEBUG nova.compute.manager [None req-5d525248-9657-4ec5-8632-2474768a1dd0 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:58:27 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-5d525248-9657-4ec5-8632-2474768a1dd0 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Acquiring lock "refresh_cache-4b7932d8-b781-4db7-a1c5-791ce8d1d866" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:58:27 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-5d525248-9657-4ec5-8632-2474768a1dd0 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Acquired lock "refresh_cache-4b7932d8-b781-4db7-a1c5-791ce8d1d866" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:58:27 user nova-compute[73449]: DEBUG nova.network.neutron [None req-5d525248-9657-4ec5-8632-2474768a1dd0 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] Building network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 11:58:28 user nova-compute[73449]: DEBUG nova.network.neutron [None req-5bca5a47-0d39-439e-bb13-017974e93efd tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Updating instance_info_cache with network_info: [{"id": "2ce1927a-6866-4362-bc0c-88cd0a19fa08", "address": "fa:16:3e:f5:89:a9", "network": {"id": "f7298070-baaa-4842-b3b2-d9fe1058d3b6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1715911399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8722edee53ed4a9188366c38f3b8b52f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ce1927a-68", "ovs_interfaceid": "2ce1927a-6866-4362-bc0c-88cd0a19fa08", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:58:28 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-5bca5a47-0d39-439e-bb13-017974e93efd tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Releasing lock "refresh_cache-042713b8-ab7f-4c14-92e5-f830ccb7e341" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:58:28 user nova-compute[73449]: DEBUG nova.objects.instance [None req-5bca5a47-0d39-439e-bb13-017974e93efd tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Lazy-loading 'flavor' on Instance uuid 042713b8-ab7f-4c14-92e5-f830ccb7e341 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:58:28 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-b8436f5c-ae79-41d6-9dde-90a13519b576 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 11:58:28 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-b8436f5c-ae79-41d6-9dde-90a13519b576 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 11:58:28 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b8436f5c-ae79-41d6-9dde-90a13519b576 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.416s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:58:28 user nova-compute[73449]: INFO nova.scheduler.client.report [None req-b8436f5c-ae79-41d6-9dde-90a13519b576 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Deleted allocations for instance b32df06e-0b5a-4384-946b-64d64aeeb07e
Aug 17 11:58:28 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:58:28 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:58:28 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b8436f5c-ae79-41d6-9dde-90a13519b576 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Lock "b32df06e-0b5a-4384-946b-64d64aeeb07e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.131s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:58:28 user nova-compute[73449]: DEBUG nova.compute.manager [req-bdd90298-2bfc-4e18-84b4-abfbe23513cb req-3f7b8ef9-3f24-407c-93eb-dc31baa11f49 service nova] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Received event network-vif-unplugged-2ce1927a-6866-4362-bc0c-88cd0a19fa08 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:58:28 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-bdd90298-2bfc-4e18-84b4-abfbe23513cb req-3f7b8ef9-3f24-407c-93eb-dc31baa11f49 service nova] Acquiring lock "042713b8-ab7f-4c14-92e5-f830ccb7e341-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:58:28 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-bdd90298-2bfc-4e18-84b4-abfbe23513cb req-3f7b8ef9-3f24-407c-93eb-dc31baa11f49 service nova] Lock "042713b8-ab7f-4c14-92e5-f830ccb7e341-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:58:28 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-bdd90298-2bfc-4e18-84b4-abfbe23513cb req-3f7b8ef9-3f24-407c-93eb-dc31baa11f49 service nova] Lock "042713b8-ab7f-4c14-92e5-f830ccb7e341-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:58:28 user nova-compute[73449]: DEBUG nova.compute.manager [req-bdd90298-2bfc-4e18-84b4-abfbe23513cb req-3f7b8ef9-3f24-407c-93eb-dc31baa11f49 service nova] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] No waiting events found dispatching network-vif-unplugged-2ce1927a-6866-4362-bc0c-88cd0a19fa08 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:58:28 user nova-compute[73449]: WARNING nova.compute.manager [req-bdd90298-2bfc-4e18-84b4-abfbe23513cb req-3f7b8ef9-3f24-407c-93eb-dc31baa11f49 service nova] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Received unexpected event network-vif-unplugged-2ce1927a-6866-4362-bc0c-88cd0a19fa08 for instance with vm_state rescued and task_state unrescuing.
Aug 17 11:58:28 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:58:28 user nova-compute[73449]: DEBUG nova.network.neutron [None req-5d525248-9657-4ec5-8632-2474768a1dd0 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] Updating instance_info_cache with network_info: [{"id": "dbd5bb98-0410-4179-a99a-9181d85357ea", "address": "fa:16:3e:5d:b1:0e", "network": {"id": "d56bc428-6be6-4aa9-b43c-9d4a0f1dd83b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-791364634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe7b5fee01a042bb90e40b18a84c82c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbd5bb98-04", "ovs_interfaceid": "dbd5bb98-0410-4179-a99a-9181d85357ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:58:28 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-5d525248-9657-4ec5-8632-2474768a1dd0 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Releasing lock "refresh_cache-4b7932d8-b781-4db7-a1c5-791ce8d1d866" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:58:28 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:58:28 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:58:28 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:58:28 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:58:28 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:58:28 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Instance destroyed successfully.
Aug 17 11:58:28 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:58:28 user nova-compute[73449]: DEBUG nova.compute.manager [req-ebaf65bf-d9b2-4555-ae40-b496c6cad398 req-34fabf23-af79-4189-925e-5fc7cc34e1cb service nova] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] Received event network-vif-deleted-4a57c385-a0c8-454a-acbf-d1f783ff3131 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:58:28 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:58:29 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:58:29 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:58:29 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:58:29 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:58:29 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] Instance destroyed successfully.
Aug 17 11:58:29 user nova-compute[73449]: DEBUG nova.objects.instance [None req-5d525248-9657-4ec5-8632-2474768a1dd0 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Lazy-loading 'resources' on Instance uuid 4b7932d8-b781-4db7-a1c5-791ce8d1d866 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:58:29 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-5d525248-9657-4ec5-8632-2474768a1dd0 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:56:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-446672586',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-446672586',id=36,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEcw8l18SWbf1308kGLuQ4b06ysMjia3rEhaF6dU6vjJM/VmZBqAPQDr1yByzmcI8Lvjfcj9Fi6T/YyvGoW/3wLJuwBD8/OatBnsq63e8/jV0cJ+5SDnDrf0ZUEjihC93A==',key_name='tempest-keypair-279437617',keypairs=<?>,launch_index=0,launched_at=2023-08-17T11:56:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='fe7b5fee01a042bb90e40b18a84c82c0',ramdisk_id='',reservation_id='r-ehpbpdxe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2080997856',owner_user_name='tempest-AttachVolumeShelveTestJSON-2080997856-project-member',shelved_at='2023-08-17T11:58:27.807852',shelved_host='user',shelved_image_id='2f4eef75-499c-4765-a06a-d236c7e48995'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T11:58:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='17ee7be9cdb14c5ca211a6b0bb80ccc1',uuid=4b7932d8-b781-4db7-a1c5-791ce8d1d866,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "dbd5bb98-0410-4179-a99a-9181d85357ea", "address": "fa:16:3e:5d:b1:0e", "network": {"id": "d56bc428-6be6-4aa9-b43c-9d4a0f1dd83b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-791364634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe7b5fee01a042bb90e40b18a84c82c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbd5bb98-04", "ovs_interfaceid": "dbd5bb98-0410-4179-a99a-9181d85357ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 11:58:29 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-5d525248-9657-4ec5-8632-2474768a1dd0 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Converting VIF {"id": "dbd5bb98-0410-4179-a99a-9181d85357ea", "address": "fa:16:3e:5d:b1:0e", "network": {"id": "d56bc428-6be6-4aa9-b43c-9d4a0f1dd83b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-791364634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe7b5fee01a042bb90e40b18a84c82c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbd5bb98-04", "ovs_interfaceid": "dbd5bb98-0410-4179-a99a-9181d85357ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:58:29 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-5d525248-9657-4ec5-8632-2474768a1dd0 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:b1:0e,bridge_name='br-int',has_traffic_filtering=True,id=dbd5bb98-0410-4179-a99a-9181d85357ea,network=Network(d56bc428-6be6-4aa9-b43c-9d4a0f1dd83b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbd5bb98-04') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:58:29 user nova-compute[73449]: DEBUG os_vif [None req-5d525248-9657-4ec5-8632-2474768a1dd0 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:b1:0e,bridge_name='br-int',has_traffic_filtering=True,id=dbd5bb98-0410-4179-a99a-9181d85357ea,network=Network(d56bc428-6be6-4aa9-b43c-9d4a0f1dd83b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbd5bb98-04') {{(pid=73449) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 11:58:29 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:58:29 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdbd5bb98-04, bridge=br-int, if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:58:29 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:58:29 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:58:29 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:58:29 user nova-compute[73449]: INFO os_vif [None req-5d525248-9657-4ec5-8632-2474768a1dd0 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:b1:0e,bridge_name='br-int',has_traffic_filtering=True,id=dbd5bb98-0410-4179-a99a-9181d85357ea,network=Network(d56bc428-6be6-4aa9-b43c-9d4a0f1dd83b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbd5bb98-04')
Aug 17 11:58:29 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-5d525248-9657-4ec5-8632-2474768a1dd0 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] Deleting instance files /opt/stack/data/nova/instances/4b7932d8-b781-4db7-a1c5-791ce8d1d866_del
Aug 17 11:58:29 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-5d525248-9657-4ec5-8632-2474768a1dd0 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] Deletion of /opt/stack/data/nova/instances/4b7932d8-b781-4db7-a1c5-791ce8d1d866_del complete
Aug 17 11:58:29 user nova-compute[73449]: DEBUG nova.compute.manager [req-b9d567dc-02ae-4d21-aef8-9e2e37fd4046 req-30ed7a80-7a8f-4b21-b90a-4e896ef59814 service nova] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] Received event network-changed-dbd5bb98-0410-4179-a99a-9181d85357ea {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:58:29 user nova-compute[73449]: DEBUG nova.compute.manager [req-b9d567dc-02ae-4d21-aef8-9e2e37fd4046 req-30ed7a80-7a8f-4b21-b90a-4e896ef59814 service nova] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] Refreshing instance network info cache due to event network-changed-dbd5bb98-0410-4179-a99a-9181d85357ea. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 11:58:29 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-b9d567dc-02ae-4d21-aef8-9e2e37fd4046 req-30ed7a80-7a8f-4b21-b90a-4e896ef59814 service nova] Acquiring lock "refresh_cache-4b7932d8-b781-4db7-a1c5-791ce8d1d866" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:58:29 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-b9d567dc-02ae-4d21-aef8-9e2e37fd4046 req-30ed7a80-7a8f-4b21-b90a-4e896ef59814 service nova] Acquired lock "refresh_cache-4b7932d8-b781-4db7-a1c5-791ce8d1d866" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:58:29 user nova-compute[73449]: DEBUG nova.network.neutron [req-b9d567dc-02ae-4d21-aef8-9e2e37fd4046 req-30ed7a80-7a8f-4b21-b90a-4e896ef59814 service nova] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] Refreshing network info cache for port dbd5bb98-0410-4179-a99a-9181d85357ea {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 11:58:29 user nova-compute[73449]: INFO nova.scheduler.client.report [None req-5d525248-9657-4ec5-8632-2474768a1dd0 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Deleted allocations for instance 4b7932d8-b781-4db7-a1c5-791ce8d1d866
Aug 17 11:58:29 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-5d525248-9657-4ec5-8632-2474768a1dd0 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:58:29 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-5d525248-9657-4ec5-8632-2474768a1dd0 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:58:29 user nova-compute[73449]: DEBUG nova.objects.instance [None req-5d525248-9657-4ec5-8632-2474768a1dd0 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Lazy-loading 'numa_topology' on Instance uuid 4b7932d8-b781-4db7-a1c5-791ce8d1d866 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:58:30 user nova-compute[73449]: DEBUG nova.network.neutron [req-b9d567dc-02ae-4d21-aef8-9e2e37fd4046 req-30ed7a80-7a8f-4b21-b90a-4e896ef59814 service nova] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] Updated VIF entry in instance network info cache for port dbd5bb98-0410-4179-a99a-9181d85357ea. {{(pid=73449) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 11:58:30 user nova-compute[73449]: DEBUG nova.network.neutron [req-b9d567dc-02ae-4d21-aef8-9e2e37fd4046 req-30ed7a80-7a8f-4b21-b90a-4e896ef59814 service nova] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] Updating instance_info_cache with network_info: [{"id": "dbd5bb98-0410-4179-a99a-9181d85357ea", "address": "fa:16:3e:5d:b1:0e", "network": {"id": "d56bc428-6be6-4aa9-b43c-9d4a0f1dd83b", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-791364634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe7b5fee01a042bb90e40b18a84c82c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapdbd5bb98-04", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:58:30 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-5d525248-9657-4ec5-8632-2474768a1dd0 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 11:58:30 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-5d525248-9657-4ec5-8632-2474768a1dd0 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 11:58:30 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-b9d567dc-02ae-4d21-aef8-9e2e37fd4046 req-30ed7a80-7a8f-4b21-b90a-4e896ef59814 service nova] Releasing lock "refresh_cache-4b7932d8-b781-4db7-a1c5-791ce8d1d866" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:58:30 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-5d525248-9657-4ec5-8632-2474768a1dd0 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.414s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:58:30 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:58:30 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:58:30 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:58:30 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:58:30 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-5d525248-9657-4ec5-8632-2474768a1dd0 tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Lock "4b7932d8-b781-4db7-a1c5-791ce8d1d866" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 8.178s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:58:30 user nova-compute[73449]: DEBUG nova.compute.manager [req-27cb2488-0bf3-41dd-92a9-671731b45770 req-259c67e0-ec55-4e0a-9582-911f00c0e391 service nova] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Received event network-vif-plugged-2ce1927a-6866-4362-bc0c-88cd0a19fa08 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:58:30 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-27cb2488-0bf3-41dd-92a9-671731b45770 req-259c67e0-ec55-4e0a-9582-911f00c0e391 service nova] Acquiring lock "042713b8-ab7f-4c14-92e5-f830ccb7e341-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:58:30 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-27cb2488-0bf3-41dd-92a9-671731b45770 req-259c67e0-ec55-4e0a-9582-911f00c0e391 service nova] Lock "042713b8-ab7f-4c14-92e5-f830ccb7e341-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:58:30 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-27cb2488-0bf3-41dd-92a9-671731b45770 req-259c67e0-ec55-4e0a-9582-911f00c0e391 service nova] Lock "042713b8-ab7f-4c14-92e5-f830ccb7e341-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:58:30 user nova-compute[73449]: DEBUG nova.compute.manager [req-27cb2488-0bf3-41dd-92a9-671731b45770 req-259c67e0-ec55-4e0a-9582-911f00c0e391 service nova] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] No waiting events found dispatching network-vif-plugged-2ce1927a-6866-4362-bc0c-88cd0a19fa08 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:58:30 user nova-compute[73449]: WARNING nova.compute.manager [req-27cb2488-0bf3-41dd-92a9-671731b45770 req-259c67e0-ec55-4e0a-9582-911f00c0e391 service nova] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Received unexpected event network-vif-plugged-2ce1927a-6866-4362-bc0c-88cd0a19fa08 for instance with vm_state rescued and task_state unrescuing.
Aug 17 11:58:30 user nova-compute[73449]: DEBUG nova.compute.manager [req-27cb2488-0bf3-41dd-92a9-671731b45770 req-259c67e0-ec55-4e0a-9582-911f00c0e391 service nova] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Received event network-vif-plugged-2ce1927a-6866-4362-bc0c-88cd0a19fa08 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:58:30 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-27cb2488-0bf3-41dd-92a9-671731b45770 req-259c67e0-ec55-4e0a-9582-911f00c0e391 service nova] Acquiring lock "042713b8-ab7f-4c14-92e5-f830ccb7e341-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:58:30 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-27cb2488-0bf3-41dd-92a9-671731b45770 req-259c67e0-ec55-4e0a-9582-911f00c0e391 service nova] Lock "042713b8-ab7f-4c14-92e5-f830ccb7e341-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:58:30 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-27cb2488-0bf3-41dd-92a9-671731b45770 req-259c67e0-ec55-4e0a-9582-911f00c0e391 service nova] Lock "042713b8-ab7f-4c14-92e5-f830ccb7e341-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:58:30 user nova-compute[73449]: DEBUG nova.compute.manager [req-27cb2488-0bf3-41dd-92a9-671731b45770 req-259c67e0-ec55-4e0a-9582-911f00c0e391 service nova] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] No waiting events found dispatching network-vif-plugged-2ce1927a-6866-4362-bc0c-88cd0a19fa08 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:58:30 user nova-compute[73449]: WARNING nova.compute.manager [req-27cb2488-0bf3-41dd-92a9-671731b45770 req-259c67e0-ec55-4e0a-9582-911f00c0e391 service nova] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Received unexpected event network-vif-plugged-2ce1927a-6866-4362-bc0c-88cd0a19fa08 for instance with vm_state rescued and task_state unrescuing.
Aug 17 11:58:30 user nova-compute[73449]: DEBUG nova.compute.manager [req-27cb2488-0bf3-41dd-92a9-671731b45770 req-259c67e0-ec55-4e0a-9582-911f00c0e391 service nova] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Received event network-vif-plugged-2ce1927a-6866-4362-bc0c-88cd0a19fa08 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:58:30 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-27cb2488-0bf3-41dd-92a9-671731b45770 req-259c67e0-ec55-4e0a-9582-911f00c0e391 service nova] Acquiring lock "042713b8-ab7f-4c14-92e5-f830ccb7e341-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:58:30 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-27cb2488-0bf3-41dd-92a9-671731b45770 req-259c67e0-ec55-4e0a-9582-911f00c0e391 service nova] Lock "042713b8-ab7f-4c14-92e5-f830ccb7e341-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:58:30 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-27cb2488-0bf3-41dd-92a9-671731b45770 req-259c67e0-ec55-4e0a-9582-911f00c0e391 service nova] Lock "042713b8-ab7f-4c14-92e5-f830ccb7e341-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:58:30 user nova-compute[73449]: DEBUG nova.compute.manager [req-27cb2488-0bf3-41dd-92a9-671731b45770 req-259c67e0-ec55-4e0a-9582-911f00c0e391 service nova] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] No waiting events found dispatching network-vif-plugged-2ce1927a-6866-4362-bc0c-88cd0a19fa08 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:58:30 user nova-compute[73449]: WARNING nova.compute.manager [req-27cb2488-0bf3-41dd-92a9-671731b45770 req-259c67e0-ec55-4e0a-9582-911f00c0e391 service nova] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Received unexpected event network-vif-plugged-2ce1927a-6866-4362-bc0c-88cd0a19fa08 for instance with vm_state rescued and task_state unrescuing.
Aug 17 11:58:30 user nova-compute[73449]: DEBUG nova.compute.manager [req-27cb2488-0bf3-41dd-92a9-671731b45770 req-259c67e0-ec55-4e0a-9582-911f00c0e391 service nova] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Received event network-vif-unplugged-2ce1927a-6866-4362-bc0c-88cd0a19fa08 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:58:30 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-27cb2488-0bf3-41dd-92a9-671731b45770 req-259c67e0-ec55-4e0a-9582-911f00c0e391 service nova] Acquiring lock "042713b8-ab7f-4c14-92e5-f830ccb7e341-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:58:30 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-27cb2488-0bf3-41dd-92a9-671731b45770 req-259c67e0-ec55-4e0a-9582-911f00c0e391 service nova] Lock "042713b8-ab7f-4c14-92e5-f830ccb7e341-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:58:30 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-27cb2488-0bf3-41dd-92a9-671731b45770 req-259c67e0-ec55-4e0a-9582-911f00c0e391 service nova] Lock "042713b8-ab7f-4c14-92e5-f830ccb7e341-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:58:30 user nova-compute[73449]: DEBUG nova.compute.manager [req-27cb2488-0bf3-41dd-92a9-671731b45770 req-259c67e0-ec55-4e0a-9582-911f00c0e391 service nova] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] No waiting events found dispatching network-vif-unplugged-2ce1927a-6866-4362-bc0c-88cd0a19fa08 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:58:30 user nova-compute[73449]: WARNING nova.compute.manager [req-27cb2488-0bf3-41dd-92a9-671731b45770 req-259c67e0-ec55-4e0a-9582-911f00c0e391 service nova] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Received unexpected event network-vif-unplugged-2ce1927a-6866-4362-bc0c-88cd0a19fa08 for instance with vm_state rescued and task_state unrescuing.
Aug 17 11:58:30 user nova-compute[73449]: DEBUG nova.compute.manager [req-27cb2488-0bf3-41dd-92a9-671731b45770 req-259c67e0-ec55-4e0a-9582-911f00c0e391 service nova] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Received event network-vif-plugged-2ce1927a-6866-4362-bc0c-88cd0a19fa08 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:58:30 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-27cb2488-0bf3-41dd-92a9-671731b45770 req-259c67e0-ec55-4e0a-9582-911f00c0e391 service nova] Acquiring lock "042713b8-ab7f-4c14-92e5-f830ccb7e341-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:58:30 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-27cb2488-0bf3-41dd-92a9-671731b45770 req-259c67e0-ec55-4e0a-9582-911f00c0e391 service nova] Lock "042713b8-ab7f-4c14-92e5-f830ccb7e341-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:58:30 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-27cb2488-0bf3-41dd-92a9-671731b45770 req-259c67e0-ec55-4e0a-9582-911f00c0e391 service nova] Lock "042713b8-ab7f-4c14-92e5-f830ccb7e341-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:58:30 user nova-compute[73449]: DEBUG nova.compute.manager [req-27cb2488-0bf3-41dd-92a9-671731b45770 req-259c67e0-ec55-4e0a-9582-911f00c0e391 service nova] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] No waiting events found dispatching network-vif-plugged-2ce1927a-6866-4362-bc0c-88cd0a19fa08 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:58:30 user nova-compute[73449]: WARNING nova.compute.manager [req-27cb2488-0bf3-41dd-92a9-671731b45770 req-259c67e0-ec55-4e0a-9582-911f00c0e391 service nova] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Received unexpected event network-vif-plugged-2ce1927a-6866-4362-bc0c-88cd0a19fa08 for instance with vm_state rescued and task_state unrescuing.
Aug 17 11:58:30 user nova-compute[73449]: DEBUG nova.compute.manager [req-27cb2488-0bf3-41dd-92a9-671731b45770 req-259c67e0-ec55-4e0a-9582-911f00c0e391 service nova] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Received event network-vif-plugged-2ce1927a-6866-4362-bc0c-88cd0a19fa08 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:58:30 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-27cb2488-0bf3-41dd-92a9-671731b45770 req-259c67e0-ec55-4e0a-9582-911f00c0e391 service nova] Acquiring lock "042713b8-ab7f-4c14-92e5-f830ccb7e341-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:58:30 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-27cb2488-0bf3-41dd-92a9-671731b45770 req-259c67e0-ec55-4e0a-9582-911f00c0e391 service nova] Lock "042713b8-ab7f-4c14-92e5-f830ccb7e341-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:58:30 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-27cb2488-0bf3-41dd-92a9-671731b45770 req-259c67e0-ec55-4e0a-9582-911f00c0e391 service nova] Lock "042713b8-ab7f-4c14-92e5-f830ccb7e341-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:58:30 user nova-compute[73449]: DEBUG nova.compute.manager [req-27cb2488-0bf3-41dd-92a9-671731b45770 req-259c67e0-ec55-4e0a-9582-911f00c0e391 service nova] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] No waiting events found dispatching network-vif-plugged-2ce1927a-6866-4362-bc0c-88cd0a19fa08 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:58:30 user nova-compute[73449]: WARNING nova.compute.manager [req-27cb2488-0bf3-41dd-92a9-671731b45770 req-259c67e0-ec55-4e0a-9582-911f00c0e391 service nova] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Received unexpected event network-vif-plugged-2ce1927a-6866-4362-bc0c-88cd0a19fa08 for instance with vm_state rescued and task_state unrescuing.
Aug 17 11:58:30 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:58:32 user nova-compute[73449]: DEBUG nova.compute.manager [req-988b0c8b-a28a-4e38-8f53-a6a8153f9f2d req-fe9d6703-82fb-48ca-a3b0-087acad5d0c7 service nova] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Received event network-vif-plugged-2ce1927a-6866-4362-bc0c-88cd0a19fa08 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:58:32 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-988b0c8b-a28a-4e38-8f53-a6a8153f9f2d req-fe9d6703-82fb-48ca-a3b0-087acad5d0c7 service nova] Acquiring lock "042713b8-ab7f-4c14-92e5-f830ccb7e341-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:58:32 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-988b0c8b-a28a-4e38-8f53-a6a8153f9f2d req-fe9d6703-82fb-48ca-a3b0-087acad5d0c7 service nova] Lock "042713b8-ab7f-4c14-92e5-f830ccb7e341-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:58:32 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-988b0c8b-a28a-4e38-8f53-a6a8153f9f2d req-fe9d6703-82fb-48ca-a3b0-087acad5d0c7 service nova] Lock "042713b8-ab7f-4c14-92e5-f830ccb7e341-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:58:32 user nova-compute[73449]: DEBUG nova.compute.manager [req-988b0c8b-a28a-4e38-8f53-a6a8153f9f2d req-fe9d6703-82fb-48ca-a3b0-087acad5d0c7 service nova] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] No waiting events found dispatching network-vif-plugged-2ce1927a-6866-4362-bc0c-88cd0a19fa08 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:58:32 user nova-compute[73449]: WARNING nova.compute.manager [req-988b0c8b-a28a-4e38-8f53-a6a8153f9f2d req-fe9d6703-82fb-48ca-a3b0-087acad5d0c7 service nova] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Received unexpected event network-vif-plugged-2ce1927a-6866-4362-bc0c-88cd0a19fa08 for instance with vm_state rescued and task_state unrescuing.
Aug 17 11:58:32 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Removed pending event for 042713b8-ab7f-4c14-92e5-f830ccb7e341 due to event {{(pid=73449) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 17 11:58:32 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692273512.7829735, 042713b8-ab7f-4c14-92e5-f830ccb7e341 => Resumed> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:58:32 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] VM Resumed (Lifecycle Event)
Aug 17 11:58:32 user nova-compute[73449]: DEBUG nova.compute.manager [None req-5bca5a47-0d39-439e-bb13-017974e93efd tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:58:32 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:58:32 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 11:58:32 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 17 11:58:32 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692273512.784723, 042713b8-ab7f-4c14-92e5-f830ccb7e341 => Started> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:58:32 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] VM Started (Lifecycle Event)
Aug 17 11:58:32 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:58:32 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 11:58:33 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:58:34 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:58:35 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:58:36 user nova-compute[73449]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692273501.5909517, 9e68a702-ead5-47ae-9375-5cd00b947ef4 => Stopped> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:58:36 user nova-compute[73449]: INFO nova.compute.manager [-] [instance: 9e68a702-ead5-47ae-9375-5cd00b947ef4] VM Stopped (Lifecycle Event)
Aug 17 11:58:36 user nova-compute[73449]: DEBUG nova.compute.manager [None req-e230351e-ac6e-445b-81d3-9e3198e78cd1 None None] [instance: 9e68a702-ead5-47ae-9375-5cd00b947ef4] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:58:38 user nova-compute[73449]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692273503.0603685, 4b7932d8-b781-4db7-a1c5-791ce8d1d866 => Stopped> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:58:38 user nova-compute[73449]: INFO nova.compute.manager [-] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] VM Stopped (Lifecycle Event)
Aug 17 11:58:38 user nova-compute[73449]: DEBUG nova.compute.manager [None req-7a7b3a34-b7b6-4ec0-b32d-29ee7d3dfb3c None None] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:58:38 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:58:39 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:58:40 user nova-compute[73449]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692273505.0011535, b32df06e-0b5a-4384-946b-64d64aeeb07e => Stopped> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:58:40 user nova-compute[73449]: INFO nova.compute.manager [-] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] VM Stopped (Lifecycle Event)
Aug 17 11:58:40 user nova-compute[73449]: DEBUG nova.compute.manager [None req-22ba6f89-ad9d-4128-aaee-bc79d05b8fcd None None] [instance: b32df06e-0b5a-4384-946b-64d64aeeb07e] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:58:43 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:58:44 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:58:46 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:58:48 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:58:49 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:58:49 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:58:51 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:58:53 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:58:53 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:58:54 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:58:56 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:58:57 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b0f535e0-7406-49c0-acc0-50cae9ae5c06 tempest-VolumesActionsTest-288873050 tempest-VolumesActionsTest-288873050-project-member] Acquiring lock "0d951782-d2d8-49a8-a0dc-05ac7f760c76" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:58:57 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b0f535e0-7406-49c0-acc0-50cae9ae5c06 tempest-VolumesActionsTest-288873050 tempest-VolumesActionsTest-288873050-project-member] Lock "0d951782-d2d8-49a8-a0dc-05ac7f760c76" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:58:57 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b0f535e0-7406-49c0-acc0-50cae9ae5c06 tempest-VolumesActionsTest-288873050 tempest-VolumesActionsTest-288873050-project-member] [instance: 0d951782-d2d8-49a8-a0dc-05ac7f760c76] Starting instance... {{(pid=73449) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 11:58:57 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b0f535e0-7406-49c0-acc0-50cae9ae5c06 tempest-VolumesActionsTest-288873050 tempest-VolumesActionsTest-288873050-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:58:57 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b0f535e0-7406-49c0-acc0-50cae9ae5c06 tempest-VolumesActionsTest-288873050 tempest-VolumesActionsTest-288873050-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:58:57 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-b0f535e0-7406-49c0-acc0-50cae9ae5c06 tempest-VolumesActionsTest-288873050 tempest-VolumesActionsTest-288873050-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73449) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 11:58:57 user nova-compute[73449]: INFO nova.compute.claims [None req-b0f535e0-7406-49c0-acc0-50cae9ae5c06 tempest-VolumesActionsTest-288873050 tempest-VolumesActionsTest-288873050-project-member] [instance: 0d951782-d2d8-49a8-a0dc-05ac7f760c76] Claim successful on node user
Aug 17 11:58:58 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-b0f535e0-7406-49c0-acc0-50cae9ae5c06 tempest-VolumesActionsTest-288873050 tempest-VolumesActionsTest-288873050-project-member] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 11:58:58 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-b0f535e0-7406-49c0-acc0-50cae9ae5c06 tempest-VolumesActionsTest-288873050 tempest-VolumesActionsTest-288873050-project-member] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 11:58:58 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b0f535e0-7406-49c0-acc0-50cae9ae5c06 tempest-VolumesActionsTest-288873050 tempest-VolumesActionsTest-288873050-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.380s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:58:58 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b0f535e0-7406-49c0-acc0-50cae9ae5c06 tempest-VolumesActionsTest-288873050 tempest-VolumesActionsTest-288873050-project-member] [instance: 0d951782-d2d8-49a8-a0dc-05ac7f760c76] Start building networks asynchronously for instance. {{(pid=73449) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 11:58:58 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b0f535e0-7406-49c0-acc0-50cae9ae5c06 tempest-VolumesActionsTest-288873050 tempest-VolumesActionsTest-288873050-project-member] [instance: 0d951782-d2d8-49a8-a0dc-05ac7f760c76] Allocating IP information in the background. {{(pid=73449) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 11:58:58 user nova-compute[73449]: DEBUG nova.network.neutron [None req-b0f535e0-7406-49c0-acc0-50cae9ae5c06 tempest-VolumesActionsTest-288873050 tempest-VolumesActionsTest-288873050-project-member] [instance: 0d951782-d2d8-49a8-a0dc-05ac7f760c76] allocate_for_instance() {{(pid=73449) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 11:58:58 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-b0f535e0-7406-49c0-acc0-50cae9ae5c06 tempest-VolumesActionsTest-288873050 tempest-VolumesActionsTest-288873050-project-member] [instance: 0d951782-d2d8-49a8-a0dc-05ac7f760c76] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 11:58:58 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b0f535e0-7406-49c0-acc0-50cae9ae5c06 tempest-VolumesActionsTest-288873050 tempest-VolumesActionsTest-288873050-project-member] [instance: 0d951782-d2d8-49a8-a0dc-05ac7f760c76] Start building block device mappings for instance. {{(pid=73449) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 11:58:58 user nova-compute[73449]: DEBUG nova.policy [None req-b0f535e0-7406-49c0-acc0-50cae9ae5c06 tempest-VolumesActionsTest-288873050 tempest-VolumesActionsTest-288873050-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f70813193df3451e95c7a8e949773329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc901d3128884f13a0c03a6b2a74dac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73449) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 11:58:58 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b0f535e0-7406-49c0-acc0-50cae9ae5c06 tempest-VolumesActionsTest-288873050 tempest-VolumesActionsTest-288873050-project-member] [instance: 0d951782-d2d8-49a8-a0dc-05ac7f760c76] Start spawning the instance on the hypervisor. {{(pid=73449) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 11:58:58 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b0f535e0-7406-49c0-acc0-50cae9ae5c06 tempest-VolumesActionsTest-288873050 tempest-VolumesActionsTest-288873050-project-member] [instance: 0d951782-d2d8-49a8-a0dc-05ac7f760c76] Creating instance directory {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 11:58:58 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-b0f535e0-7406-49c0-acc0-50cae9ae5c06 tempest-VolumesActionsTest-288873050 tempest-VolumesActionsTest-288873050-project-member] [instance: 0d951782-d2d8-49a8-a0dc-05ac7f760c76] Creating image(s)
Aug 17 11:58:58 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b0f535e0-7406-49c0-acc0-50cae9ae5c06 tempest-VolumesActionsTest-288873050 tempest-VolumesActionsTest-288873050-project-member] Acquiring lock "/opt/stack/data/nova/instances/0d951782-d2d8-49a8-a0dc-05ac7f760c76/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:58:58 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b0f535e0-7406-49c0-acc0-50cae9ae5c06 tempest-VolumesActionsTest-288873050 tempest-VolumesActionsTest-288873050-project-member] Lock "/opt/stack/data/nova/instances/0d951782-d2d8-49a8-a0dc-05ac7f760c76/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:58:58 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b0f535e0-7406-49c0-acc0-50cae9ae5c06 tempest-VolumesActionsTest-288873050 tempest-VolumesActionsTest-288873050-project-member] Lock "/opt/stack/data/nova/instances/0d951782-d2d8-49a8-a0dc-05ac7f760c76/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:58:58 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:58:58 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-b0f535e0-7406-49c0-acc0-50cae9ae5c06 tempest-VolumesActionsTest-288873050 tempest-VolumesActionsTest-288873050-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:58:58 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-b0f535e0-7406-49c0-acc0-50cae9ae5c06 tempest-VolumesActionsTest-288873050 tempest-VolumesActionsTest-288873050-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json" returned: 0 in 0.198s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:58:58 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b0f535e0-7406-49c0-acc0-50cae9ae5c06 tempest-VolumesActionsTest-288873050 tempest-VolumesActionsTest-288873050-project-member] Acquiring lock "7e267a577c062ee862e95ede6b48cfd5632f3ea3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:58:58 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b0f535e0-7406-49c0-acc0-50cae9ae5c06 tempest-VolumesActionsTest-288873050 tempest-VolumesActionsTest-288873050-project-member] Lock "7e267a577c062ee862e95ede6b48cfd5632f3ea3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:58:58 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-b0f535e0-7406-49c0-acc0-50cae9ae5c06 tempest-VolumesActionsTest-288873050 tempest-VolumesActionsTest-288873050-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:58:58 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-b0f535e0-7406-49c0-acc0-50cae9ae5c06 tempest-VolumesActionsTest-288873050 tempest-VolumesActionsTest-288873050-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json" returned: 0 in 0.175s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:58:58 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-b0f535e0-7406-49c0-acc0-50cae9ae5c06 tempest-VolumesActionsTest-288873050 tempest-VolumesActionsTest-288873050-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3,backing_fmt=raw /opt/stack/data/nova/instances/0d951782-d2d8-49a8-a0dc-05ac7f760c76/disk 1073741824 {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:58:59 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-b0f535e0-7406-49c0-acc0-50cae9ae5c06 tempest-VolumesActionsTest-288873050 tempest-VolumesActionsTest-288873050-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3,backing_fmt=raw /opt/stack/data/nova/instances/0d951782-d2d8-49a8-a0dc-05ac7f760c76/disk 1073741824" returned: 0 in 0.053s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:58:59 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b0f535e0-7406-49c0-acc0-50cae9ae5c06 tempest-VolumesActionsTest-288873050 tempest-VolumesActionsTest-288873050-project-member] Lock "7e267a577c062ee862e95ede6b48cfd5632f3ea3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:58:59 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-b0f535e0-7406-49c0-acc0-50cae9ae5c06 tempest-VolumesActionsTest-288873050 tempest-VolumesActionsTest-288873050-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:58:59 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-b0f535e0-7406-49c0-acc0-50cae9ae5c06 tempest-VolumesActionsTest-288873050 tempest-VolumesActionsTest-288873050-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json" returned: 0 in 0.194s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:58:59 user nova-compute[73449]: DEBUG nova.virt.disk.api [None req-b0f535e0-7406-49c0-acc0-50cae9ae5c06 tempest-VolumesActionsTest-288873050 tempest-VolumesActionsTest-288873050-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0d951782-d2d8-49a8-a0dc-05ac7f760c76/disk. size=1073741824 {{(pid=73449) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 11:58:59 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-b0f535e0-7406-49c0-acc0-50cae9ae5c06 tempest-VolumesActionsTest-288873050 tempest-VolumesActionsTest-288873050-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d951782-d2d8-49a8-a0dc-05ac7f760c76/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:58:59 user nova-compute[73449]: DEBUG nova.network.neutron [None req-b0f535e0-7406-49c0-acc0-50cae9ae5c06 tempest-VolumesActionsTest-288873050 tempest-VolumesActionsTest-288873050-project-member] [instance: 0d951782-d2d8-49a8-a0dc-05ac7f760c76] Successfully created port: c73bdc59-4b2b-46ff-94c5-a0fc69c7171a {{(pid=73449) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 11:58:59 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-b0f535e0-7406-49c0-acc0-50cae9ae5c06 tempest-VolumesActionsTest-288873050 tempest-VolumesActionsTest-288873050-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d951782-d2d8-49a8-a0dc-05ac7f760c76/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:58:59 user nova-compute[73449]: DEBUG nova.virt.disk.api [None req-b0f535e0-7406-49c0-acc0-50cae9ae5c06 tempest-VolumesActionsTest-288873050 tempest-VolumesActionsTest-288873050-project-member] Cannot resize image /opt/stack/data/nova/instances/0d951782-d2d8-49a8-a0dc-05ac7f760c76/disk to a smaller size. {{(pid=73449) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 11:58:59 user nova-compute[73449]: DEBUG nova.objects.instance [None req-b0f535e0-7406-49c0-acc0-50cae9ae5c06 tempest-VolumesActionsTest-288873050 tempest-VolumesActionsTest-288873050-project-member] Lazy-loading 'migration_context' on Instance uuid 0d951782-d2d8-49a8-a0dc-05ac7f760c76 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:58:59 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b0f535e0-7406-49c0-acc0-50cae9ae5c06 tempest-VolumesActionsTest-288873050 tempest-VolumesActionsTest-288873050-project-member] [instance: 0d951782-d2d8-49a8-a0dc-05ac7f760c76] Created local disks {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 11:58:59 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b0f535e0-7406-49c0-acc0-50cae9ae5c06 tempest-VolumesActionsTest-288873050 tempest-VolumesActionsTest-288873050-project-member] [instance: 0d951782-d2d8-49a8-a0dc-05ac7f760c76] Ensure instance console log exists: /opt/stack/data/nova/instances/0d951782-d2d8-49a8-a0dc-05ac7f760c76/console.log {{(pid=73449) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 11:58:59 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b0f535e0-7406-49c0-acc0-50cae9ae5c06 tempest-VolumesActionsTest-288873050 tempest-VolumesActionsTest-288873050-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:58:59 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b0f535e0-7406-49c0-acc0-50cae9ae5c06 tempest-VolumesActionsTest-288873050 tempest-VolumesActionsTest-288873050-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:58:59 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b0f535e0-7406-49c0-acc0-50cae9ae5c06 tempest-VolumesActionsTest-288873050 tempest-VolumesActionsTest-288873050-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:58:59 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:59:00 user nova-compute[73449]: DEBUG nova.network.neutron [None req-b0f535e0-7406-49c0-acc0-50cae9ae5c06 tempest-VolumesActionsTest-288873050 tempest-VolumesActionsTest-288873050-project-member] [instance: 0d951782-d2d8-49a8-a0dc-05ac7f760c76] Successfully updated port: c73bdc59-4b2b-46ff-94c5-a0fc69c7171a {{(pid=73449) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 11:59:00 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b0f535e0-7406-49c0-acc0-50cae9ae5c06 tempest-VolumesActionsTest-288873050 tempest-VolumesActionsTest-288873050-project-member] Acquiring lock "refresh_cache-0d951782-d2d8-49a8-a0dc-05ac7f760c76" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:59:00 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b0f535e0-7406-49c0-acc0-50cae9ae5c06 tempest-VolumesActionsTest-288873050 tempest-VolumesActionsTest-288873050-project-member] Acquired lock "refresh_cache-0d951782-d2d8-49a8-a0dc-05ac7f760c76" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:59:00 user nova-compute[73449]: DEBUG nova.network.neutron [None req-b0f535e0-7406-49c0-acc0-50cae9ae5c06 tempest-VolumesActionsTest-288873050 tempest-VolumesActionsTest-288873050-project-member] [instance: 0d951782-d2d8-49a8-a0dc-05ac7f760c76] Building network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 11:59:00 user nova-compute[73449]: DEBUG nova.compute.manager [req-4bb54846-9369-48f0-b38d-e2f15f35e6e9 req-67c19458-d4c5-464c-bcec-08b7d540c6f2 service nova] [instance: 0d951782-d2d8-49a8-a0dc-05ac7f760c76] Received event network-changed-c73bdc59-4b2b-46ff-94c5-a0fc69c7171a {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:59:00 user nova-compute[73449]: DEBUG nova.compute.manager [req-4bb54846-9369-48f0-b38d-e2f15f35e6e9 req-67c19458-d4c5-464c-bcec-08b7d540c6f2 service nova] [instance: 0d951782-d2d8-49a8-a0dc-05ac7f760c76] Refreshing instance network info cache due to event network-changed-c73bdc59-4b2b-46ff-94c5-a0fc69c7171a. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 11:59:00 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-4bb54846-9369-48f0-b38d-e2f15f35e6e9 req-67c19458-d4c5-464c-bcec-08b7d540c6f2 service nova] Acquiring lock "refresh_cache-0d951782-d2d8-49a8-a0dc-05ac7f760c76" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:59:00 user nova-compute[73449]: DEBUG nova.network.neutron [None req-b0f535e0-7406-49c0-acc0-50cae9ae5c06 tempest-VolumesActionsTest-288873050 tempest-VolumesActionsTest-288873050-project-member] [instance: 0d951782-d2d8-49a8-a0dc-05ac7f760c76] Instance cache missing network info. {{(pid=73449) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 11:59:00 user nova-compute[73449]: DEBUG nova.network.neutron [None req-b0f535e0-7406-49c0-acc0-50cae9ae5c06 tempest-VolumesActionsTest-288873050 tempest-VolumesActionsTest-288873050-project-member] [instance: 0d951782-d2d8-49a8-a0dc-05ac7f760c76] Updating instance_info_cache with network_info: [{"id": "c73bdc59-4b2b-46ff-94c5-a0fc69c7171a", "address": "fa:16:3e:1c:0d:0d", "network": {"id": "c3442408-5ba7-434f-ad13-f243642e135d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1898321127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc901d3128884f13a0c03a6b2a74dac3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc73bdc59-4b", "ovs_interfaceid": "c73bdc59-4b2b-46ff-94c5-a0fc69c7171a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:59:00 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b0f535e0-7406-49c0-acc0-50cae9ae5c06 tempest-VolumesActionsTest-288873050 tempest-VolumesActionsTest-288873050-project-member] Releasing lock "refresh_cache-0d951782-d2d8-49a8-a0dc-05ac7f760c76" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:59:00 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b0f535e0-7406-49c0-acc0-50cae9ae5c06 tempest-VolumesActionsTest-288873050 tempest-VolumesActionsTest-288873050-project-member] [instance: 0d951782-d2d8-49a8-a0dc-05ac7f760c76] Instance network_info: |[{"id": "c73bdc59-4b2b-46ff-94c5-a0fc69c7171a", "address": "fa:16:3e:1c:0d:0d", "network": {"id": "c3442408-5ba7-434f-ad13-f243642e135d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1898321127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc901d3128884f13a0c03a6b2a74dac3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc73bdc59-4b", "ovs_interfaceid": "c73bdc59-4b2b-46ff-94c5-a0fc69c7171a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73449) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 11:59:00 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-4bb54846-9369-48f0-b38d-e2f15f35e6e9 req-67c19458-d4c5-464c-bcec-08b7d540c6f2 service nova] Acquired lock "refresh_cache-0d951782-d2d8-49a8-a0dc-05ac7f760c76" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:59:00 user nova-compute[73449]: DEBUG nova.network.neutron [req-4bb54846-9369-48f0-b38d-e2f15f35e6e9 req-67c19458-d4c5-464c-bcec-08b7d540c6f2 service nova] [instance: 0d951782-d2d8-49a8-a0dc-05ac7f760c76] Refreshing network info cache for port c73bdc59-4b2b-46ff-94c5-a0fc69c7171a {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 11:59:00 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b0f535e0-7406-49c0-acc0-50cae9ae5c06 tempest-VolumesActionsTest-288873050 tempest-VolumesActionsTest-288873050-project-member] [instance: 0d951782-d2d8-49a8-a0dc-05ac7f760c76] Start _get_guest_xml network_info=[{"id": "c73bdc59-4b2b-46ff-94c5-a0fc69c7171a", "address": "fa:16:3e:1c:0d:0d", "network": {"id": "c3442408-5ba7-434f-ad13-f243642e135d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1898321127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc901d3128884f13a0c03a6b2a74dac3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc73bdc59-4b", "ovs_interfaceid": "c73bdc59-4b2b-46ff-94c5-a0fc69c7171a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T11:36:11Z,direct_url=<?>,disk_format='qcow2',id=0a2904ae-083d-41c8-83db-343132b36148,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7a77880136a54ef195c82e018e1939db',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T11:36:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': '0a2904ae-083d-41c8-83db-343132b36148'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 11:59:00 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-b0f535e0-7406-49c0-acc0-50cae9ae5c06 tempest-VolumesActionsTest-288873050 tempest-VolumesActionsTest-288873050-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:59:00 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-b0f535e0-7406-49c0-acc0-50cae9ae5c06 tempest-VolumesActionsTest-288873050 tempest-VolumesActionsTest-288873050-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:59:00 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-b0f535e0-7406-49c0-acc0-50cae9ae5c06 tempest-VolumesActionsTest-288873050 tempest-VolumesActionsTest-288873050-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 11:59:00 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-b0f535e0-7406-49c0-acc0-50cae9ae5c06 tempest-VolumesActionsTest-288873050 tempest-VolumesActionsTest-288873050-project-member] CPU controller missing on host. {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 11:59:00 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-b0f535e0-7406-49c0-acc0-50cae9ae5c06 tempest-VolumesActionsTest-288873050 tempest-VolumesActionsTest-288873050-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 11:59:00 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-b0f535e0-7406-49c0-acc0-50cae9ae5c06 tempest-VolumesActionsTest-288873050 tempest-VolumesActionsTest-288873050-project-member] CPU controller found on host. {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 11:59:00 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b0f535e0-7406-49c0-acc0-50cae9ae5c06 tempest-VolumesActionsTest-288873050 tempest-VolumesActionsTest-288873050-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73449) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 11:59:00 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-b0f535e0-7406-49c0-acc0-50cae9ae5c06 tempest-VolumesActionsTest-288873050 tempest-VolumesActionsTest-288873050-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T11:35:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T11:36:11Z,direct_url=<?>,disk_format='qcow2',id=0a2904ae-083d-41c8-83db-343132b36148,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7a77880136a54ef195c82e018e1939db',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T11:36:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 11:59:00 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-b0f535e0-7406-49c0-acc0-50cae9ae5c06 tempest-VolumesActionsTest-288873050 tempest-VolumesActionsTest-288873050-project-member] Flavor limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 11:59:00 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-b0f535e0-7406-49c0-acc0-50cae9ae5c06 tempest-VolumesActionsTest-288873050 tempest-VolumesActionsTest-288873050-project-member] Image limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 11:59:00 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-b0f535e0-7406-49c0-acc0-50cae9ae5c06 tempest-VolumesActionsTest-288873050 tempest-VolumesActionsTest-288873050-project-member] Flavor pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 11:59:00 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-b0f535e0-7406-49c0-acc0-50cae9ae5c06 tempest-VolumesActionsTest-288873050 tempest-VolumesActionsTest-288873050-project-member] Image pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 11:59:00 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-b0f535e0-7406-49c0-acc0-50cae9ae5c06 tempest-VolumesActionsTest-288873050 tempest-VolumesActionsTest-288873050-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 11:59:00 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-b0f535e0-7406-49c0-acc0-50cae9ae5c06 tempest-VolumesActionsTest-288873050 tempest-VolumesActionsTest-288873050-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 11:59:00 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-b0f535e0-7406-49c0-acc0-50cae9ae5c06 tempest-VolumesActionsTest-288873050 tempest-VolumesActionsTest-288873050-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 11:59:00 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-b0f535e0-7406-49c0-acc0-50cae9ae5c06 tempest-VolumesActionsTest-288873050 tempest-VolumesActionsTest-288873050-project-member] Got 1 possible topologies {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 11:59:00 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-b0f535e0-7406-49c0-acc0-50cae9ae5c06 tempest-VolumesActionsTest-288873050 tempest-VolumesActionsTest-288873050-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 11:59:00 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-b0f535e0-7406-49c0-acc0-50cae9ae5c06 tempest-VolumesActionsTest-288873050 tempest-VolumesActionsTest-288873050-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 11:59:00 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-b0f535e0-7406-49c0-acc0-50cae9ae5c06 tempest-VolumesActionsTest-288873050 tempest-VolumesActionsTest-288873050-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:58:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-205750759',display_name='tempest-VolumesActionsTest-instance-205750759',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-205750759',id=39,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dc901d3128884f13a0c03a6b2a74dac3',ramdisk_id='',reservation_id='r-umxmyjpe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-288873050',owner_user_name='tempest-VolumesActionsTest-288873050-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T11:58:58Z,user_data=None,user_id='f70813193df3451e95c7a8e949773329',uuid=0d951782-d2d8-49a8-a0dc-05ac7f760c76,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c73bdc59-4b2b-46ff-94c5-a0fc69c7171a", "address": "fa:16:3e:1c:0d:0d", "network": {"id": "c3442408-5ba7-434f-ad13-f243642e135d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1898321127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc901d3128884f13a0c03a6b2a74dac3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc73bdc59-4b", "ovs_interfaceid": "c73bdc59-4b2b-46ff-94c5-a0fc69c7171a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73449) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 11:59:00 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-b0f535e0-7406-49c0-acc0-50cae9ae5c06 tempest-VolumesActionsTest-288873050 tempest-VolumesActionsTest-288873050-project-member] Converting VIF {"id": "c73bdc59-4b2b-46ff-94c5-a0fc69c7171a", "address": "fa:16:3e:1c:0d:0d", "network": {"id": "c3442408-5ba7-434f-ad13-f243642e135d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1898321127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc901d3128884f13a0c03a6b2a74dac3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc73bdc59-4b", "ovs_interfaceid": "c73bdc59-4b2b-46ff-94c5-a0fc69c7171a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:59:00 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-b0f535e0-7406-49c0-acc0-50cae9ae5c06 tempest-VolumesActionsTest-288873050 tempest-VolumesActionsTest-288873050-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:0d:0d,bridge_name='br-int',has_traffic_filtering=True,id=c73bdc59-4b2b-46ff-94c5-a0fc69c7171a,network=Network(c3442408-5ba7-434f-ad13-f243642e135d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc73bdc59-4b') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:59:00 user nova-compute[73449]: DEBUG nova.objects.instance [None req-b0f535e0-7406-49c0-acc0-50cae9ae5c06 tempest-VolumesActionsTest-288873050 tempest-VolumesActionsTest-288873050-project-member] Lazy-loading 'pci_devices' on Instance uuid 0d951782-d2d8-49a8-a0dc-05ac7f760c76 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:59:00 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b0f535e0-7406-49c0-acc0-50cae9ae5c06 tempest-VolumesActionsTest-288873050 tempest-VolumesActionsTest-288873050-project-member] [instance: 0d951782-d2d8-49a8-a0dc-05ac7f760c76] End _get_guest_xml xml=<domain type="kvm">
Aug 17 11:59:00 user nova-compute[73449]:   <uuid>0d951782-d2d8-49a8-a0dc-05ac7f760c76</uuid>
Aug 17 11:59:00 user nova-compute[73449]:   <name>instance-00000027</name>
Aug 17 11:59:00 user nova-compute[73449]:   <memory>524288</memory>
Aug 17 11:59:00 user nova-compute[73449]:   <vcpu>1</vcpu>
Aug 17 11:59:00 user nova-compute[73449]:   <metadata>
Aug 17 11:59:00 user nova-compute[73449]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 11:59:00 user nova-compute[73449]:       <nova:package version="0.0.0"/>
Aug 17 11:59:00 user nova-compute[73449]:       <nova:name>tempest-VolumesActionsTest-instance-205750759</nova:name>
Aug 17 11:59:00 user nova-compute[73449]:       <nova:creationTime>2023-08-17 11:59:00</nova:creationTime>
Aug 17 11:59:00 user nova-compute[73449]:       <nova:flavor name="m1.tiny">
Aug 17 11:59:00 user nova-compute[73449]:         <nova:memory>512</nova:memory>
Aug 17 11:59:00 user nova-compute[73449]:         <nova:disk>1</nova:disk>
Aug 17 11:59:00 user nova-compute[73449]:         <nova:swap>0</nova:swap>
Aug 17 11:59:00 user nova-compute[73449]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 11:59:00 user nova-compute[73449]:         <nova:vcpus>1</nova:vcpus>
Aug 17 11:59:00 user nova-compute[73449]:       </nova:flavor>
Aug 17 11:59:00 user nova-compute[73449]:       <nova:owner>
Aug 17 11:59:00 user nova-compute[73449]:         <nova:user uuid="f70813193df3451e95c7a8e949773329">tempest-VolumesActionsTest-288873050-project-member</nova:user>
Aug 17 11:59:00 user nova-compute[73449]:         <nova:project uuid="dc901d3128884f13a0c03a6b2a74dac3">tempest-VolumesActionsTest-288873050</nova:project>
Aug 17 11:59:00 user nova-compute[73449]:       </nova:owner>
Aug 17 11:59:00 user nova-compute[73449]:       <nova:root type="image" uuid="0a2904ae-083d-41c8-83db-343132b36148"/>
Aug 17 11:59:00 user nova-compute[73449]:       <nova:ports>
Aug 17 11:59:00 user nova-compute[73449]:         <nova:port uuid="c73bdc59-4b2b-46ff-94c5-a0fc69c7171a">
Aug 17 11:59:00 user nova-compute[73449]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 17 11:59:00 user nova-compute[73449]:         </nova:port>
Aug 17 11:59:00 user nova-compute[73449]:       </nova:ports>
Aug 17 11:59:00 user nova-compute[73449]:     </nova:instance>
Aug 17 11:59:00 user nova-compute[73449]:   </metadata>
Aug 17 11:59:00 user nova-compute[73449]:   <sysinfo type="smbios">
Aug 17 11:59:00 user nova-compute[73449]:     <system>
Aug 17 11:59:00 user nova-compute[73449]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 11:59:00 user nova-compute[73449]:       <entry name="product">OpenStack Nova</entry>
Aug 17 11:59:00 user nova-compute[73449]:       <entry name="version">0.0.0</entry>
Aug 17 11:59:00 user nova-compute[73449]:       <entry name="serial">0d951782-d2d8-49a8-a0dc-05ac7f760c76</entry>
Aug 17 11:59:00 user nova-compute[73449]:       <entry name="uuid">0d951782-d2d8-49a8-a0dc-05ac7f760c76</entry>
Aug 17 11:59:00 user nova-compute[73449]:       <entry name="family">Virtual Machine</entry>
Aug 17 11:59:00 user nova-compute[73449]:     </system>
Aug 17 11:59:00 user nova-compute[73449]:   </sysinfo>
Aug 17 11:59:00 user nova-compute[73449]:   <os>
Aug 17 11:59:00 user nova-compute[73449]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 11:59:00 user nova-compute[73449]:     <boot dev="hd"/>
Aug 17 11:59:00 user nova-compute[73449]:     <smbios mode="sysinfo"/>
Aug 17 11:59:00 user nova-compute[73449]:   </os>
Aug 17 11:59:00 user nova-compute[73449]:   <features>
Aug 17 11:59:00 user nova-compute[73449]:     <acpi/>
Aug 17 11:59:00 user nova-compute[73449]:     <apic/>
Aug 17 11:59:00 user nova-compute[73449]:     <vmcoreinfo/>
Aug 17 11:59:00 user nova-compute[73449]:   </features>
Aug 17 11:59:00 user nova-compute[73449]:   <clock offset="utc">
Aug 17 11:59:00 user nova-compute[73449]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 11:59:00 user nova-compute[73449]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 11:59:00 user nova-compute[73449]:     <timer name="hpet" present="no"/>
Aug 17 11:59:00 user nova-compute[73449]:   </clock>
Aug 17 11:59:00 user nova-compute[73449]:   <cpu mode="custom" match="exact">
Aug 17 11:59:00 user nova-compute[73449]:     <model>Nehalem</model>
Aug 17 11:59:00 user nova-compute[73449]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 11:59:00 user nova-compute[73449]:   </cpu>
Aug 17 11:59:00 user nova-compute[73449]:   <devices>
Aug 17 11:59:00 user nova-compute[73449]:     <disk type="file" device="disk">
Aug 17 11:59:00 user nova-compute[73449]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 11:59:00 user nova-compute[73449]:       <source file="/opt/stack/data/nova/instances/0d951782-d2d8-49a8-a0dc-05ac7f760c76/disk"/>
Aug 17 11:59:00 user nova-compute[73449]:       <target dev="vda" bus="virtio"/>
Aug 17 11:59:00 user nova-compute[73449]:     </disk>
Aug 17 11:59:00 user nova-compute[73449]:     <interface type="ethernet">
Aug 17 11:59:00 user nova-compute[73449]:       <mac address="fa:16:3e:1c:0d:0d"/>
Aug 17 11:59:00 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 11:59:00 user nova-compute[73449]:       <mtu size="1442"/>
Aug 17 11:59:00 user nova-compute[73449]:       <target dev="tapc73bdc59-4b"/>
Aug 17 11:59:00 user nova-compute[73449]:     </interface>
Aug 17 11:59:00 user nova-compute[73449]:     <serial type="pty">
Aug 17 11:59:00 user nova-compute[73449]:       <log file="/opt/stack/data/nova/instances/0d951782-d2d8-49a8-a0dc-05ac7f760c76/console.log" append="off"/>
Aug 17 11:59:00 user nova-compute[73449]:     </serial>
Aug 17 11:59:00 user nova-compute[73449]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 11:59:00 user nova-compute[73449]:     <video>
Aug 17 11:59:00 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 11:59:00 user nova-compute[73449]:     </video>
Aug 17 11:59:00 user nova-compute[73449]:     <rng model="virtio">
Aug 17 11:59:00 user nova-compute[73449]:       <backend model="random">/dev/urandom</backend>
Aug 17 11:59:00 user nova-compute[73449]:     </rng>
Aug 17 11:59:00 user nova-compute[73449]:     <controller type="usb" index="0" model="none"/>
Aug 17 11:59:00 user nova-compute[73449]:     <memballoon model="virtio">
Aug 17 11:59:00 user nova-compute[73449]:       <stats period="10"/>
Aug 17 11:59:00 user nova-compute[73449]:     </memballoon>
Aug 17 11:59:00 user nova-compute[73449]:   </devices>
Aug 17 11:59:00 user nova-compute[73449]: </domain>
Aug 17 11:59:00 user nova-compute[73449]:  {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 11:59:00 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-b0f535e0-7406-49c0-acc0-50cae9ae5c06 tempest-VolumesActionsTest-288873050 tempest-VolumesActionsTest-288873050-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:58:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-205750759',display_name='tempest-VolumesActionsTest-instance-205750759',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-205750759',id=39,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dc901d3128884f13a0c03a6b2a74dac3',ramdisk_id='',reservation_id='r-umxmyjpe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-288873050',owner_user_name='tempest-VolumesActionsTest-288873050-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T11:58:58Z,user_data=None,user_id='f70813193df3451e95c7a8e949773329',uuid=0d951782-d2d8-49a8-a0dc-05ac7f760c76,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c73bdc59-4b2b-46ff-94c5-a0fc69c7171a", "address": "fa:16:3e:1c:0d:0d", "network": {"id": "c3442408-5ba7-434f-ad13-f243642e135d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1898321127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc901d3128884f13a0c03a6b2a74dac3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc73bdc59-4b", "ovs_interfaceid": "c73bdc59-4b2b-46ff-94c5-a0fc69c7171a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 11:59:00 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-b0f535e0-7406-49c0-acc0-50cae9ae5c06 tempest-VolumesActionsTest-288873050 tempest-VolumesActionsTest-288873050-project-member] Converting VIF {"id": "c73bdc59-4b2b-46ff-94c5-a0fc69c7171a", "address": "fa:16:3e:1c:0d:0d", "network": {"id": "c3442408-5ba7-434f-ad13-f243642e135d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1898321127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc901d3128884f13a0c03a6b2a74dac3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc73bdc59-4b", "ovs_interfaceid": "c73bdc59-4b2b-46ff-94c5-a0fc69c7171a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:59:00 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-b0f535e0-7406-49c0-acc0-50cae9ae5c06 tempest-VolumesActionsTest-288873050 tempest-VolumesActionsTest-288873050-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:0d:0d,bridge_name='br-int',has_traffic_filtering=True,id=c73bdc59-4b2b-46ff-94c5-a0fc69c7171a,network=Network(c3442408-5ba7-434f-ad13-f243642e135d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc73bdc59-4b') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:59:00 user nova-compute[73449]: DEBUG os_vif [None req-b0f535e0-7406-49c0-acc0-50cae9ae5c06 tempest-VolumesActionsTest-288873050 tempest-VolumesActionsTest-288873050-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:0d:0d,bridge_name='br-int',has_traffic_filtering=True,id=c73bdc59-4b2b-46ff-94c5-a0fc69c7171a,network=Network(c3442408-5ba7-434f-ad13-f243642e135d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc73bdc59-4b') {{(pid=73449) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 11:59:00 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:59:00 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:59:00 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 11:59:00 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:59:00 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc73bdc59-4b, may_exist=True, interface_attrs={}) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:59:00 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc73bdc59-4b, col_values=(('external_ids', {'iface-id': 'c73bdc59-4b2b-46ff-94c5-a0fc69c7171a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1c:0d:0d', 'vm-uuid': '0d951782-d2d8-49a8-a0dc-05ac7f760c76'}),), if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:59:00 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:59:00 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:59:00 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:59:00 user nova-compute[73449]: INFO os_vif [None req-b0f535e0-7406-49c0-acc0-50cae9ae5c06 tempest-VolumesActionsTest-288873050 tempest-VolumesActionsTest-288873050-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:0d:0d,bridge_name='br-int',has_traffic_filtering=True,id=c73bdc59-4b2b-46ff-94c5-a0fc69c7171a,network=Network(c3442408-5ba7-434f-ad13-f243642e135d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc73bdc59-4b')
Aug 17 11:59:00 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b0f535e0-7406-49c0-acc0-50cae9ae5c06 tempest-VolumesActionsTest-288873050 tempest-VolumesActionsTest-288873050-project-member] No BDM found with device name vda, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 11:59:00 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b0f535e0-7406-49c0-acc0-50cae9ae5c06 tempest-VolumesActionsTest-288873050 tempest-VolumesActionsTest-288873050-project-member] No VIF found with MAC fa:16:3e:1c:0d:0d, not building metadata {{(pid=73449) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 11:59:00 user nova-compute[73449]: DEBUG nova.network.neutron [req-4bb54846-9369-48f0-b38d-e2f15f35e6e9 req-67c19458-d4c5-464c-bcec-08b7d540c6f2 service nova] [instance: 0d951782-d2d8-49a8-a0dc-05ac7f760c76] Updated VIF entry in instance network info cache for port c73bdc59-4b2b-46ff-94c5-a0fc69c7171a. {{(pid=73449) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 11:59:00 user nova-compute[73449]: DEBUG nova.network.neutron [req-4bb54846-9369-48f0-b38d-e2f15f35e6e9 req-67c19458-d4c5-464c-bcec-08b7d540c6f2 service nova] [instance: 0d951782-d2d8-49a8-a0dc-05ac7f760c76] Updating instance_info_cache with network_info: [{"id": "c73bdc59-4b2b-46ff-94c5-a0fc69c7171a", "address": "fa:16:3e:1c:0d:0d", "network": {"id": "c3442408-5ba7-434f-ad13-f243642e135d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1898321127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc901d3128884f13a0c03a6b2a74dac3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc73bdc59-4b", "ovs_interfaceid": "c73bdc59-4b2b-46ff-94c5-a0fc69c7171a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:59:00 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-4bb54846-9369-48f0-b38d-e2f15f35e6e9 req-67c19458-d4c5-464c-bcec-08b7d540c6f2 service nova] Releasing lock "refresh_cache-0d951782-d2d8-49a8-a0dc-05ac7f760c76" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:59:01 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:59:01 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:59:01 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:59:01 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:59:01 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73449) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 11:59:02 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:59:02 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:59:02 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:59:02 user nova-compute[73449]: DEBUG nova.compute.manager [req-e45dcf04-6d17-4e03-b345-db981f11aacf req-f4e9209d-dda5-4e32-9d29-df6b7b8fcd64 service nova] [instance: 0d951782-d2d8-49a8-a0dc-05ac7f760c76] Received event network-vif-plugged-c73bdc59-4b2b-46ff-94c5-a0fc69c7171a {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:59:02 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-e45dcf04-6d17-4e03-b345-db981f11aacf req-f4e9209d-dda5-4e32-9d29-df6b7b8fcd64 service nova] Acquiring lock "0d951782-d2d8-49a8-a0dc-05ac7f760c76-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:59:02 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-e45dcf04-6d17-4e03-b345-db981f11aacf req-f4e9209d-dda5-4e32-9d29-df6b7b8fcd64 service nova] Lock "0d951782-d2d8-49a8-a0dc-05ac7f760c76-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:59:02 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-e45dcf04-6d17-4e03-b345-db981f11aacf req-f4e9209d-dda5-4e32-9d29-df6b7b8fcd64 service nova] Lock "0d951782-d2d8-49a8-a0dc-05ac7f760c76-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:59:02 user nova-compute[73449]: DEBUG nova.compute.manager [req-e45dcf04-6d17-4e03-b345-db981f11aacf req-f4e9209d-dda5-4e32-9d29-df6b7b8fcd64 service nova] [instance: 0d951782-d2d8-49a8-a0dc-05ac7f760c76] No waiting events found dispatching network-vif-plugged-c73bdc59-4b2b-46ff-94c5-a0fc69c7171a {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:59:02 user nova-compute[73449]: WARNING nova.compute.manager [req-e45dcf04-6d17-4e03-b345-db981f11aacf req-f4e9209d-dda5-4e32-9d29-df6b7b8fcd64 service nova] [instance: 0d951782-d2d8-49a8-a0dc-05ac7f760c76] Received unexpected event network-vif-plugged-c73bdc59-4b2b-46ff-94c5-a0fc69c7171a for instance with vm_state building and task_state spawning.
Aug 17 11:59:02 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:59:02 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:59:03 user nova-compute[73449]: DEBUG nova.compute.manager [req-74a71043-8c38-4320-9108-1c66c961d4b1 req-c4e2bc2a-b73c-4b7a-a180-8070000a1248 service nova] [instance: 773e5c86-a86a-414d-aab4-8e13e0b68c1e] Received event network-changed-4c8e383a-45a4-4c6a-858f-74a1b73e9e27 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:59:03 user nova-compute[73449]: DEBUG nova.compute.manager [req-74a71043-8c38-4320-9108-1c66c961d4b1 req-c4e2bc2a-b73c-4b7a-a180-8070000a1248 service nova] [instance: 773e5c86-a86a-414d-aab4-8e13e0b68c1e] Refreshing instance network info cache due to event network-changed-4c8e383a-45a4-4c6a-858f-74a1b73e9e27. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 11:59:03 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-74a71043-8c38-4320-9108-1c66c961d4b1 req-c4e2bc2a-b73c-4b7a-a180-8070000a1248 service nova] Acquiring lock "refresh_cache-773e5c86-a86a-414d-aab4-8e13e0b68c1e" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:59:03 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-74a71043-8c38-4320-9108-1c66c961d4b1 req-c4e2bc2a-b73c-4b7a-a180-8070000a1248 service nova] Acquired lock "refresh_cache-773e5c86-a86a-414d-aab4-8e13e0b68c1e" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:59:03 user nova-compute[73449]: DEBUG nova.network.neutron [req-74a71043-8c38-4320-9108-1c66c961d4b1 req-c4e2bc2a-b73c-4b7a-a180-8070000a1248 service nova] [instance: 773e5c86-a86a-414d-aab4-8e13e0b68c1e] Refreshing network info cache for port 4c8e383a-45a4-4c6a-858f-74a1b73e9e27 {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 11:59:03 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-8270c97b-ff38-429d-be1c-5ec459ce8fd4 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Acquiring lock "712c777e-251b-43d8-b923-8eda693f32ed" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:59:03 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-8270c97b-ff38-429d-be1c-5ec459ce8fd4 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Lock "712c777e-251b-43d8-b923-8eda693f32ed" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:59:03 user nova-compute[73449]: DEBUG nova.compute.manager [None req-8270c97b-ff38-429d-be1c-5ec459ce8fd4 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 712c777e-251b-43d8-b923-8eda693f32ed] Starting instance... {{(pid=73449) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 11:59:03 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-8270c97b-ff38-429d-be1c-5ec459ce8fd4 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:59:03 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-8270c97b-ff38-429d-be1c-5ec459ce8fd4 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:59:03 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-8270c97b-ff38-429d-be1c-5ec459ce8fd4 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73449) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 11:59:03 user nova-compute[73449]: INFO nova.compute.claims [None req-8270c97b-ff38-429d-be1c-5ec459ce8fd4 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 712c777e-251b-43d8-b923-8eda693f32ed] Claim successful on node user
Aug 17 11:59:03 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:59:03 user nova-compute[73449]: DEBUG nova.network.neutron [req-74a71043-8c38-4320-9108-1c66c961d4b1 req-c4e2bc2a-b73c-4b7a-a180-8070000a1248 service nova] [instance: 773e5c86-a86a-414d-aab4-8e13e0b68c1e] Updated VIF entry in instance network info cache for port 4c8e383a-45a4-4c6a-858f-74a1b73e9e27. {{(pid=73449) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 11:59:03 user nova-compute[73449]: DEBUG nova.network.neutron [req-74a71043-8c38-4320-9108-1c66c961d4b1 req-c4e2bc2a-b73c-4b7a-a180-8070000a1248 service nova] [instance: 773e5c86-a86a-414d-aab4-8e13e0b68c1e] Updating instance_info_cache with network_info: [{"id": "4c8e383a-45a4-4c6a-858f-74a1b73e9e27", "address": "fa:16:3e:40:4b:d5", "network": {"id": "a9e8fcd6-4152-466b-99ad-44b85db05a05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-920564935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bd46cdaff7a4b40955f7c8a12c55452", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c8e383a-45", "ovs_interfaceid": "4c8e383a-45a4-4c6a-858f-74a1b73e9e27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:59:03 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-8270c97b-ff38-429d-be1c-5ec459ce8fd4 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 11:59:03 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-74a71043-8c38-4320-9108-1c66c961d4b1 req-c4e2bc2a-b73c-4b7a-a180-8070000a1248 service nova] Releasing lock "refresh_cache-773e5c86-a86a-414d-aab4-8e13e0b68c1e" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:59:03 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-8270c97b-ff38-429d-be1c-5ec459ce8fd4 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 11:59:03 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-8270c97b-ff38-429d-be1c-5ec459ce8fd4 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.467s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:59:03 user nova-compute[73449]: DEBUG nova.compute.manager [None req-8270c97b-ff38-429d-be1c-5ec459ce8fd4 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 712c777e-251b-43d8-b923-8eda693f32ed] Start building networks asynchronously for instance. {{(pid=73449) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 11:59:04 user nova-compute[73449]: DEBUG nova.compute.manager [None req-8270c97b-ff38-429d-be1c-5ec459ce8fd4 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 712c777e-251b-43d8-b923-8eda693f32ed] Allocating IP information in the background. {{(pid=73449) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 11:59:04 user nova-compute[73449]: DEBUG nova.network.neutron [None req-8270c97b-ff38-429d-be1c-5ec459ce8fd4 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 712c777e-251b-43d8-b923-8eda693f32ed] allocate_for_instance() {{(pid=73449) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 11:59:04 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-8270c97b-ff38-429d-be1c-5ec459ce8fd4 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 712c777e-251b-43d8-b923-8eda693f32ed] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 11:59:04 user nova-compute[73449]: DEBUG nova.compute.manager [None req-8270c97b-ff38-429d-be1c-5ec459ce8fd4 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 712c777e-251b-43d8-b923-8eda693f32ed] Start building block device mappings for instance. {{(pid=73449) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 11:59:04 user nova-compute[73449]: DEBUG nova.compute.manager [None req-8270c97b-ff38-429d-be1c-5ec459ce8fd4 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 712c777e-251b-43d8-b923-8eda693f32ed] Start spawning the instance on the hypervisor. {{(pid=73449) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 11:59:04 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-8270c97b-ff38-429d-be1c-5ec459ce8fd4 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 712c777e-251b-43d8-b923-8eda693f32ed] Creating instance directory {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 11:59:04 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-8270c97b-ff38-429d-be1c-5ec459ce8fd4 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 712c777e-251b-43d8-b923-8eda693f32ed] Creating image(s)
Aug 17 11:59:04 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-8270c97b-ff38-429d-be1c-5ec459ce8fd4 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Acquiring lock "/opt/stack/data/nova/instances/712c777e-251b-43d8-b923-8eda693f32ed/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:59:04 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-8270c97b-ff38-429d-be1c-5ec459ce8fd4 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Lock "/opt/stack/data/nova/instances/712c777e-251b-43d8-b923-8eda693f32ed/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:59:04 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-8270c97b-ff38-429d-be1c-5ec459ce8fd4 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Lock "/opt/stack/data/nova/instances/712c777e-251b-43d8-b923-8eda693f32ed/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:59:04 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-8270c97b-ff38-429d-be1c-5ec459ce8fd4 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:59:04 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692273544.3810127, 0d951782-d2d8-49a8-a0dc-05ac7f760c76 => Resumed> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:59:04 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 0d951782-d2d8-49a8-a0dc-05ac7f760c76] VM Resumed (Lifecycle Event)
Aug 17 11:59:04 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b0f535e0-7406-49c0-acc0-50cae9ae5c06 tempest-VolumesActionsTest-288873050 tempest-VolumesActionsTest-288873050-project-member] [instance: 0d951782-d2d8-49a8-a0dc-05ac7f760c76] Instance event wait completed in 0 seconds for  {{(pid=73449) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 11:59:04 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b0f535e0-7406-49c0-acc0-50cae9ae5c06 tempest-VolumesActionsTest-288873050 tempest-VolumesActionsTest-288873050-project-member] [instance: 0d951782-d2d8-49a8-a0dc-05ac7f760c76] Guest created on hypervisor {{(pid=73449) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 11:59:04 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-8270c97b-ff38-429d-be1c-5ec459ce8fd4 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json" returned: 0 in 0.181s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:59:04 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-8270c97b-ff38-429d-be1c-5ec459ce8fd4 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Acquiring lock "7e267a577c062ee862e95ede6b48cfd5632f3ea3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:59:04 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-8270c97b-ff38-429d-be1c-5ec459ce8fd4 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Lock "7e267a577c062ee862e95ede6b48cfd5632f3ea3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:59:04 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-8270c97b-ff38-429d-be1c-5ec459ce8fd4 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:59:04 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 0d951782-d2d8-49a8-a0dc-05ac7f760c76] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:59:04 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: 0d951782-d2d8-49a8-a0dc-05ac7f760c76] Instance spawned successfully.
Aug 17 11:59:04 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b0f535e0-7406-49c0-acc0-50cae9ae5c06 tempest-VolumesActionsTest-288873050 tempest-VolumesActionsTest-288873050-project-member] [instance: 0d951782-d2d8-49a8-a0dc-05ac7f760c76] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 11:59:04 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 0d951782-d2d8-49a8-a0dc-05ac7f760c76] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 11:59:04 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b0f535e0-7406-49c0-acc0-50cae9ae5c06 tempest-VolumesActionsTest-288873050 tempest-VolumesActionsTest-288873050-project-member] [instance: 0d951782-d2d8-49a8-a0dc-05ac7f760c76] Found default for hw_cdrom_bus of ide {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:59:04 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b0f535e0-7406-49c0-acc0-50cae9ae5c06 tempest-VolumesActionsTest-288873050 tempest-VolumesActionsTest-288873050-project-member] [instance: 0d951782-d2d8-49a8-a0dc-05ac7f760c76] Found default for hw_disk_bus of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:59:04 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b0f535e0-7406-49c0-acc0-50cae9ae5c06 tempest-VolumesActionsTest-288873050 tempest-VolumesActionsTest-288873050-project-member] [instance: 0d951782-d2d8-49a8-a0dc-05ac7f760c76] Found default for hw_input_bus of None {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:59:04 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b0f535e0-7406-49c0-acc0-50cae9ae5c06 tempest-VolumesActionsTest-288873050 tempest-VolumesActionsTest-288873050-project-member] [instance: 0d951782-d2d8-49a8-a0dc-05ac7f760c76] Found default for hw_pointer_model of None {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:59:04 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b0f535e0-7406-49c0-acc0-50cae9ae5c06 tempest-VolumesActionsTest-288873050 tempest-VolumesActionsTest-288873050-project-member] [instance: 0d951782-d2d8-49a8-a0dc-05ac7f760c76] Found default for hw_video_model of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:59:04 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b0f535e0-7406-49c0-acc0-50cae9ae5c06 tempest-VolumesActionsTest-288873050 tempest-VolumesActionsTest-288873050-project-member] [instance: 0d951782-d2d8-49a8-a0dc-05ac7f760c76] Found default for hw_vif_model of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:59:04 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 0d951782-d2d8-49a8-a0dc-05ac7f760c76] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 11:59:04 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692273544.3814785, 0d951782-d2d8-49a8-a0dc-05ac7f760c76 => Started> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:59:04 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 0d951782-d2d8-49a8-a0dc-05ac7f760c76] VM Started (Lifecycle Event)
Aug 17 11:59:04 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 0d951782-d2d8-49a8-a0dc-05ac7f760c76] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:59:04 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 0d951782-d2d8-49a8-a0dc-05ac7f760c76] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 11:59:04 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-8270c97b-ff38-429d-be1c-5ec459ce8fd4 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json" returned: 0 in 0.194s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:59:04 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-8270c97b-ff38-429d-be1c-5ec459ce8fd4 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3,backing_fmt=raw /opt/stack/data/nova/instances/712c777e-251b-43d8-b923-8eda693f32ed/disk 1073741824 {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:59:04 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 0d951782-d2d8-49a8-a0dc-05ac7f760c76] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 11:59:04 user nova-compute[73449]: INFO nova.compute.manager [None req-b0f535e0-7406-49c0-acc0-50cae9ae5c06 tempest-VolumesActionsTest-288873050 tempest-VolumesActionsTest-288873050-project-member] [instance: 0d951782-d2d8-49a8-a0dc-05ac7f760c76] Took 6.09 seconds to spawn the instance on the hypervisor.
Aug 17 11:59:04 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b0f535e0-7406-49c0-acc0-50cae9ae5c06 tempest-VolumesActionsTest-288873050 tempest-VolumesActionsTest-288873050-project-member] [instance: 0d951782-d2d8-49a8-a0dc-05ac7f760c76] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:59:04 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-8270c97b-ff38-429d-be1c-5ec459ce8fd4 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3,backing_fmt=raw /opt/stack/data/nova/instances/712c777e-251b-43d8-b923-8eda693f32ed/disk 1073741824" returned: 0 in 0.065s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:59:04 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-8270c97b-ff38-429d-be1c-5ec459ce8fd4 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Lock "7e267a577c062ee862e95ede6b48cfd5632f3ea3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.262s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:59:04 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-8270c97b-ff38-429d-be1c-5ec459ce8fd4 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:59:04 user nova-compute[73449]: DEBUG nova.compute.manager [req-d2a51099-945d-4fe4-8eed-b0d9daa7fef4 req-f8aa155a-ec37-4734-b971-4ed27235fc5e service nova] [instance: 0d951782-d2d8-49a8-a0dc-05ac7f760c76] Received event network-vif-plugged-c73bdc59-4b2b-46ff-94c5-a0fc69c7171a {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:59:04 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-d2a51099-945d-4fe4-8eed-b0d9daa7fef4 req-f8aa155a-ec37-4734-b971-4ed27235fc5e service nova] Acquiring lock "0d951782-d2d8-49a8-a0dc-05ac7f760c76-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:59:04 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-d2a51099-945d-4fe4-8eed-b0d9daa7fef4 req-f8aa155a-ec37-4734-b971-4ed27235fc5e service nova] Lock "0d951782-d2d8-49a8-a0dc-05ac7f760c76-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:59:04 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-d2a51099-945d-4fe4-8eed-b0d9daa7fef4 req-f8aa155a-ec37-4734-b971-4ed27235fc5e service nova] Lock "0d951782-d2d8-49a8-a0dc-05ac7f760c76-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:59:04 user nova-compute[73449]: DEBUG nova.compute.manager [req-d2a51099-945d-4fe4-8eed-b0d9daa7fef4 req-f8aa155a-ec37-4734-b971-4ed27235fc5e service nova] [instance: 0d951782-d2d8-49a8-a0dc-05ac7f760c76] No waiting events found dispatching network-vif-plugged-c73bdc59-4b2b-46ff-94c5-a0fc69c7171a {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:59:04 user nova-compute[73449]: WARNING nova.compute.manager [req-d2a51099-945d-4fe4-8eed-b0d9daa7fef4 req-f8aa155a-ec37-4734-b971-4ed27235fc5e service nova] [instance: 0d951782-d2d8-49a8-a0dc-05ac7f760c76] Received unexpected event network-vif-plugged-c73bdc59-4b2b-46ff-94c5-a0fc69c7171a for instance with vm_state building and task_state spawning.
Aug 17 11:59:04 user nova-compute[73449]: DEBUG nova.policy [None req-8270c97b-ff38-429d-be1c-5ec459ce8fd4 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '14eb3826311a4f8f91d8264e87f7b866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec3b0b72e47448ebe99f9fc64119c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73449) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 11:59:04 user nova-compute[73449]: INFO nova.compute.manager [None req-b0f535e0-7406-49c0-acc0-50cae9ae5c06 tempest-VolumesActionsTest-288873050 tempest-VolumesActionsTest-288873050-project-member] [instance: 0d951782-d2d8-49a8-a0dc-05ac7f760c76] Took 6.88 seconds to build instance.
Aug 17 11:59:04 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-8270c97b-ff38-429d-be1c-5ec459ce8fd4 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json" returned: 0 in 0.177s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:59:04 user nova-compute[73449]: DEBUG nova.virt.disk.api [None req-8270c97b-ff38-429d-be1c-5ec459ce8fd4 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Checking if we can resize image /opt/stack/data/nova/instances/712c777e-251b-43d8-b923-8eda693f32ed/disk. size=1073741824 {{(pid=73449) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 11:59:04 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-8270c97b-ff38-429d-be1c-5ec459ce8fd4 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/712c777e-251b-43d8-b923-8eda693f32ed/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:59:04 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b0f535e0-7406-49c0-acc0-50cae9ae5c06 tempest-VolumesActionsTest-288873050 tempest-VolumesActionsTest-288873050-project-member] Lock "0d951782-d2d8-49a8-a0dc-05ac7f760c76" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.030s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:59:04 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:59:05 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-8270c97b-ff38-429d-be1c-5ec459ce8fd4 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/712c777e-251b-43d8-b923-8eda693f32ed/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:59:05 user nova-compute[73449]: DEBUG nova.virt.disk.api [None req-8270c97b-ff38-429d-be1c-5ec459ce8fd4 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Cannot resize image /opt/stack/data/nova/instances/712c777e-251b-43d8-b923-8eda693f32ed/disk to a smaller size. {{(pid=73449) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 11:59:05 user nova-compute[73449]: DEBUG nova.objects.instance [None req-8270c97b-ff38-429d-be1c-5ec459ce8fd4 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Lazy-loading 'migration_context' on Instance uuid 712c777e-251b-43d8-b923-8eda693f32ed {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:59:05 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-8270c97b-ff38-429d-be1c-5ec459ce8fd4 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 712c777e-251b-43d8-b923-8eda693f32ed] Created local disks {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 11:59:05 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-8270c97b-ff38-429d-be1c-5ec459ce8fd4 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 712c777e-251b-43d8-b923-8eda693f32ed] Ensure instance console log exists: /opt/stack/data/nova/instances/712c777e-251b-43d8-b923-8eda693f32ed/console.log {{(pid=73449) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 11:59:05 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-8270c97b-ff38-429d-be1c-5ec459ce8fd4 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:59:05 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-8270c97b-ff38-429d-be1c-5ec459ce8fd4 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:59:05 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-8270c97b-ff38-429d-be1c-5ec459ce8fd4 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:59:05 user nova-compute[73449]: DEBUG nova.network.neutron [None req-8270c97b-ff38-429d-be1c-5ec459ce8fd4 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 712c777e-251b-43d8-b923-8eda693f32ed] Successfully created port: b1a278b5-bdf7-4803-bbff-96579cf1fbd8 {{(pid=73449) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 11:59:05 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:59:06 user nova-compute[73449]: DEBUG nova.network.neutron [None req-8270c97b-ff38-429d-be1c-5ec459ce8fd4 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 712c777e-251b-43d8-b923-8eda693f32ed] Successfully updated port: b1a278b5-bdf7-4803-bbff-96579cf1fbd8 {{(pid=73449) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 11:59:06 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-8270c97b-ff38-429d-be1c-5ec459ce8fd4 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Acquiring lock "refresh_cache-712c777e-251b-43d8-b923-8eda693f32ed" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:59:06 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-8270c97b-ff38-429d-be1c-5ec459ce8fd4 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Acquired lock "refresh_cache-712c777e-251b-43d8-b923-8eda693f32ed" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:59:06 user nova-compute[73449]: DEBUG nova.network.neutron [None req-8270c97b-ff38-429d-be1c-5ec459ce8fd4 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 712c777e-251b-43d8-b923-8eda693f32ed] Building network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 11:59:06 user nova-compute[73449]: DEBUG nova.network.neutron [None req-8270c97b-ff38-429d-be1c-5ec459ce8fd4 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 712c777e-251b-43d8-b923-8eda693f32ed] Instance cache missing network info. {{(pid=73449) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 11:59:06 user nova-compute[73449]: DEBUG nova.network.neutron [None req-8270c97b-ff38-429d-be1c-5ec459ce8fd4 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 712c777e-251b-43d8-b923-8eda693f32ed] Updating instance_info_cache with network_info: [{"id": "b1a278b5-bdf7-4803-bbff-96579cf1fbd8", "address": "fa:16:3e:0e:47:73", "network": {"id": "9455bb75-f75a-41ff-8f6f-49f55aa738f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-425274599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec3b0b72e47448ebe99f9fc64119c1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1a278b5-bd", "ovs_interfaceid": "b1a278b5-bdf7-4803-bbff-96579cf1fbd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:59:06 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-8270c97b-ff38-429d-be1c-5ec459ce8fd4 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Releasing lock "refresh_cache-712c777e-251b-43d8-b923-8eda693f32ed" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:59:06 user nova-compute[73449]: DEBUG nova.compute.manager [None req-8270c97b-ff38-429d-be1c-5ec459ce8fd4 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 712c777e-251b-43d8-b923-8eda693f32ed] Instance network_info: |[{"id": "b1a278b5-bdf7-4803-bbff-96579cf1fbd8", "address": "fa:16:3e:0e:47:73", "network": {"id": "9455bb75-f75a-41ff-8f6f-49f55aa738f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-425274599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec3b0b72e47448ebe99f9fc64119c1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1a278b5-bd", "ovs_interfaceid": "b1a278b5-bdf7-4803-bbff-96579cf1fbd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73449) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 11:59:06 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-8270c97b-ff38-429d-be1c-5ec459ce8fd4 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 712c777e-251b-43d8-b923-8eda693f32ed] Start _get_guest_xml network_info=[{"id": "b1a278b5-bdf7-4803-bbff-96579cf1fbd8", "address": "fa:16:3e:0e:47:73", "network": {"id": "9455bb75-f75a-41ff-8f6f-49f55aa738f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-425274599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec3b0b72e47448ebe99f9fc64119c1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1a278b5-bd", "ovs_interfaceid": "b1a278b5-bdf7-4803-bbff-96579cf1fbd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T11:36:11Z,direct_url=<?>,disk_format='qcow2',id=0a2904ae-083d-41c8-83db-343132b36148,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7a77880136a54ef195c82e018e1939db',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T11:36:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': '0a2904ae-083d-41c8-83db-343132b36148'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 11:59:06 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-8270c97b-ff38-429d-be1c-5ec459ce8fd4 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:59:06 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-8270c97b-ff38-429d-be1c-5ec459ce8fd4 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:59:06 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-8270c97b-ff38-429d-be1c-5ec459ce8fd4 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 11:59:06 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-8270c97b-ff38-429d-be1c-5ec459ce8fd4 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] CPU controller missing on host. {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 11:59:06 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-8270c97b-ff38-429d-be1c-5ec459ce8fd4 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 11:59:06 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-8270c97b-ff38-429d-be1c-5ec459ce8fd4 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] CPU controller found on host. {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 11:59:06 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-8270c97b-ff38-429d-be1c-5ec459ce8fd4 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73449) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 11:59:06 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-8270c97b-ff38-429d-be1c-5ec459ce8fd4 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T11:35:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T11:36:11Z,direct_url=<?>,disk_format='qcow2',id=0a2904ae-083d-41c8-83db-343132b36148,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7a77880136a54ef195c82e018e1939db',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T11:36:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 11:59:06 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-8270c97b-ff38-429d-be1c-5ec459ce8fd4 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Flavor limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 11:59:06 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-8270c97b-ff38-429d-be1c-5ec459ce8fd4 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Image limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 11:59:06 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-8270c97b-ff38-429d-be1c-5ec459ce8fd4 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Flavor pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 11:59:06 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-8270c97b-ff38-429d-be1c-5ec459ce8fd4 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Image pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 11:59:06 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-8270c97b-ff38-429d-be1c-5ec459ce8fd4 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 11:59:06 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-8270c97b-ff38-429d-be1c-5ec459ce8fd4 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 11:59:06 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-8270c97b-ff38-429d-be1c-5ec459ce8fd4 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 11:59:06 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-8270c97b-ff38-429d-be1c-5ec459ce8fd4 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Got 1 possible topologies {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 11:59:06 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-8270c97b-ff38-429d-be1c-5ec459ce8fd4 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 11:59:06 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-8270c97b-ff38-429d-be1c-5ec459ce8fd4 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 11:59:06 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-8270c97b-ff38-429d-be1c-5ec459ce8fd4 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:59:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1778504664',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1778504664',id=40,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ec3b0b72e47448ebe99f9fc64119c1c',ramdisk_id='',reservation_id='r-ijc8zsq1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1818019421',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T11:59:04Z,user_data=None,user_id='14eb3826311a4f8f91d8264e87f7b866',uuid=712c777e-251b-43d8-b923-8eda693f32ed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b1a278b5-bdf7-4803-bbff-96579cf1fbd8", "address": "fa:16:3e:0e:47:73", "network": {"id": "9455bb75-f75a-41ff-8f6f-49f55aa738f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-425274599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec3b0b72e47448ebe99f9fc64119c1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1a278b5-bd", "ovs_interfaceid": "b1a278b5-bdf7-4803-bbff-96579cf1fbd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73449) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 11:59:06 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-8270c97b-ff38-429d-be1c-5ec459ce8fd4 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Converting VIF {"id": "b1a278b5-bdf7-4803-bbff-96579cf1fbd8", "address": "fa:16:3e:0e:47:73", "network": {"id": "9455bb75-f75a-41ff-8f6f-49f55aa738f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-425274599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec3b0b72e47448ebe99f9fc64119c1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1a278b5-bd", "ovs_interfaceid": "b1a278b5-bdf7-4803-bbff-96579cf1fbd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:59:06 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-8270c97b-ff38-429d-be1c-5ec459ce8fd4 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:47:73,bridge_name='br-int',has_traffic_filtering=True,id=b1a278b5-bdf7-4803-bbff-96579cf1fbd8,network=Network(9455bb75-f75a-41ff-8f6f-49f55aa738f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1a278b5-bd') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:59:06 user nova-compute[73449]: DEBUG nova.objects.instance [None req-8270c97b-ff38-429d-be1c-5ec459ce8fd4 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Lazy-loading 'pci_devices' on Instance uuid 712c777e-251b-43d8-b923-8eda693f32ed {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:59:06 user nova-compute[73449]: DEBUG nova.compute.manager [req-0bab939d-c325-4e41-842c-e4799fcfda65 req-ff2fe58a-eb55-4168-b94a-37d870da2684 service nova] [instance: 712c777e-251b-43d8-b923-8eda693f32ed] Received event network-changed-b1a278b5-bdf7-4803-bbff-96579cf1fbd8 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:59:06 user nova-compute[73449]: DEBUG nova.compute.manager [req-0bab939d-c325-4e41-842c-e4799fcfda65 req-ff2fe58a-eb55-4168-b94a-37d870da2684 service nova] [instance: 712c777e-251b-43d8-b923-8eda693f32ed] Refreshing instance network info cache due to event network-changed-b1a278b5-bdf7-4803-bbff-96579cf1fbd8. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 11:59:06 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-0bab939d-c325-4e41-842c-e4799fcfda65 req-ff2fe58a-eb55-4168-b94a-37d870da2684 service nova] Acquiring lock "refresh_cache-712c777e-251b-43d8-b923-8eda693f32ed" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:59:06 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-0bab939d-c325-4e41-842c-e4799fcfda65 req-ff2fe58a-eb55-4168-b94a-37d870da2684 service nova] Acquired lock "refresh_cache-712c777e-251b-43d8-b923-8eda693f32ed" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:59:06 user nova-compute[73449]: DEBUG nova.network.neutron [req-0bab939d-c325-4e41-842c-e4799fcfda65 req-ff2fe58a-eb55-4168-b94a-37d870da2684 service nova] [instance: 712c777e-251b-43d8-b923-8eda693f32ed] Refreshing network info cache for port b1a278b5-bdf7-4803-bbff-96579cf1fbd8 {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 11:59:06 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-8270c97b-ff38-429d-be1c-5ec459ce8fd4 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 712c777e-251b-43d8-b923-8eda693f32ed] End _get_guest_xml xml=<domain type="kvm">
Aug 17 11:59:06 user nova-compute[73449]:   <uuid>712c777e-251b-43d8-b923-8eda693f32ed</uuid>
Aug 17 11:59:06 user nova-compute[73449]:   <name>instance-00000028</name>
Aug 17 11:59:06 user nova-compute[73449]:   <memory>524288</memory>
Aug 17 11:59:06 user nova-compute[73449]:   <vcpu>1</vcpu>
Aug 17 11:59:06 user nova-compute[73449]:   <metadata>
Aug 17 11:59:06 user nova-compute[73449]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 11:59:06 user nova-compute[73449]:       <nova:package version="0.0.0"/>
Aug 17 11:59:06 user nova-compute[73449]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1778504664</nova:name>
Aug 17 11:59:06 user nova-compute[73449]:       <nova:creationTime>2023-08-17 11:59:06</nova:creationTime>
Aug 17 11:59:06 user nova-compute[73449]:       <nova:flavor name="m1.tiny">
Aug 17 11:59:06 user nova-compute[73449]:         <nova:memory>512</nova:memory>
Aug 17 11:59:06 user nova-compute[73449]:         <nova:disk>1</nova:disk>
Aug 17 11:59:06 user nova-compute[73449]:         <nova:swap>0</nova:swap>
Aug 17 11:59:06 user nova-compute[73449]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 11:59:06 user nova-compute[73449]:         <nova:vcpus>1</nova:vcpus>
Aug 17 11:59:06 user nova-compute[73449]:       </nova:flavor>
Aug 17 11:59:06 user nova-compute[73449]:       <nova:owner>
Aug 17 11:59:06 user nova-compute[73449]:         <nova:user uuid="14eb3826311a4f8f91d8264e87f7b866">tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member</nova:user>
Aug 17 11:59:06 user nova-compute[73449]:         <nova:project uuid="4ec3b0b72e47448ebe99f9fc64119c1c">tempest-ServerBootFromVolumeStableRescueTest-1818019421</nova:project>
Aug 17 11:59:06 user nova-compute[73449]:       </nova:owner>
Aug 17 11:59:06 user nova-compute[73449]:       <nova:root type="image" uuid="0a2904ae-083d-41c8-83db-343132b36148"/>
Aug 17 11:59:06 user nova-compute[73449]:       <nova:ports>
Aug 17 11:59:06 user nova-compute[73449]:         <nova:port uuid="b1a278b5-bdf7-4803-bbff-96579cf1fbd8">
Aug 17 11:59:06 user nova-compute[73449]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 17 11:59:06 user nova-compute[73449]:         </nova:port>
Aug 17 11:59:06 user nova-compute[73449]:       </nova:ports>
Aug 17 11:59:06 user nova-compute[73449]:     </nova:instance>
Aug 17 11:59:06 user nova-compute[73449]:   </metadata>
Aug 17 11:59:06 user nova-compute[73449]:   <sysinfo type="smbios">
Aug 17 11:59:06 user nova-compute[73449]:     <system>
Aug 17 11:59:06 user nova-compute[73449]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 11:59:06 user nova-compute[73449]:       <entry name="product">OpenStack Nova</entry>
Aug 17 11:59:06 user nova-compute[73449]:       <entry name="version">0.0.0</entry>
Aug 17 11:59:06 user nova-compute[73449]:       <entry name="serial">712c777e-251b-43d8-b923-8eda693f32ed</entry>
Aug 17 11:59:06 user nova-compute[73449]:       <entry name="uuid">712c777e-251b-43d8-b923-8eda693f32ed</entry>
Aug 17 11:59:06 user nova-compute[73449]:       <entry name="family">Virtual Machine</entry>
Aug 17 11:59:06 user nova-compute[73449]:     </system>
Aug 17 11:59:06 user nova-compute[73449]:   </sysinfo>
Aug 17 11:59:06 user nova-compute[73449]:   <os>
Aug 17 11:59:06 user nova-compute[73449]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 11:59:06 user nova-compute[73449]:     <boot dev="hd"/>
Aug 17 11:59:06 user nova-compute[73449]:     <smbios mode="sysinfo"/>
Aug 17 11:59:06 user nova-compute[73449]:   </os>
Aug 17 11:59:06 user nova-compute[73449]:   <features>
Aug 17 11:59:06 user nova-compute[73449]:     <acpi/>
Aug 17 11:59:06 user nova-compute[73449]:     <apic/>
Aug 17 11:59:06 user nova-compute[73449]:     <vmcoreinfo/>
Aug 17 11:59:06 user nova-compute[73449]:   </features>
Aug 17 11:59:06 user nova-compute[73449]:   <clock offset="utc">
Aug 17 11:59:06 user nova-compute[73449]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 11:59:06 user nova-compute[73449]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 11:59:06 user nova-compute[73449]:     <timer name="hpet" present="no"/>
Aug 17 11:59:06 user nova-compute[73449]:   </clock>
Aug 17 11:59:06 user nova-compute[73449]:   <cpu mode="custom" match="exact">
Aug 17 11:59:06 user nova-compute[73449]:     <model>Nehalem</model>
Aug 17 11:59:06 user nova-compute[73449]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 11:59:06 user nova-compute[73449]:   </cpu>
Aug 17 11:59:06 user nova-compute[73449]:   <devices>
Aug 17 11:59:06 user nova-compute[73449]:     <disk type="file" device="disk">
Aug 17 11:59:06 user nova-compute[73449]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 11:59:06 user nova-compute[73449]:       <source file="/opt/stack/data/nova/instances/712c777e-251b-43d8-b923-8eda693f32ed/disk"/>
Aug 17 11:59:06 user nova-compute[73449]:       <target dev="vda" bus="virtio"/>
Aug 17 11:59:06 user nova-compute[73449]:     </disk>
Aug 17 11:59:06 user nova-compute[73449]:     <interface type="ethernet">
Aug 17 11:59:06 user nova-compute[73449]:       <mac address="fa:16:3e:0e:47:73"/>
Aug 17 11:59:06 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 11:59:06 user nova-compute[73449]:       <mtu size="1442"/>
Aug 17 11:59:06 user nova-compute[73449]:       <target dev="tapb1a278b5-bd"/>
Aug 17 11:59:06 user nova-compute[73449]:     </interface>
Aug 17 11:59:06 user nova-compute[73449]:     <serial type="pty">
Aug 17 11:59:06 user nova-compute[73449]:       <log file="/opt/stack/data/nova/instances/712c777e-251b-43d8-b923-8eda693f32ed/console.log" append="off"/>
Aug 17 11:59:06 user nova-compute[73449]:     </serial>
Aug 17 11:59:06 user nova-compute[73449]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 11:59:06 user nova-compute[73449]:     <video>
Aug 17 11:59:06 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 11:59:06 user nova-compute[73449]:     </video>
Aug 17 11:59:06 user nova-compute[73449]:     <rng model="virtio">
Aug 17 11:59:06 user nova-compute[73449]:       <backend model="random">/dev/urandom</backend>
Aug 17 11:59:06 user nova-compute[73449]:     </rng>
Aug 17 11:59:06 user nova-compute[73449]:     <controller type="usb" index="0" model="none"/>
Aug 17 11:59:06 user nova-compute[73449]:     <memballoon model="virtio">
Aug 17 11:59:06 user nova-compute[73449]:       <stats period="10"/>
Aug 17 11:59:06 user nova-compute[73449]:     </memballoon>
Aug 17 11:59:06 user nova-compute[73449]:   </devices>
Aug 17 11:59:06 user nova-compute[73449]: </domain>
Aug 17 11:59:06 user nova-compute[73449]:  {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 11:59:06 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-8270c97b-ff38-429d-be1c-5ec459ce8fd4 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:59:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1778504664',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1778504664',id=40,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ec3b0b72e47448ebe99f9fc64119c1c',ramdisk_id='',reservation_id='r-ijc8zsq1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1818019421',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T11:59:04Z,user_data=None,user_id='14eb3826311a4f8f91d8264e87f7b866',uuid=712c777e-251b-43d8-b923-8eda693f32ed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b1a278b5-bdf7-4803-bbff-96579cf1fbd8", "address": "fa:16:3e:0e:47:73", "network": {"id": "9455bb75-f75a-41ff-8f6f-49f55aa738f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-425274599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec3b0b72e47448ebe99f9fc64119c1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1a278b5-bd", "ovs_interfaceid": "b1a278b5-bdf7-4803-bbff-96579cf1fbd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 11:59:06 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-8270c97b-ff38-429d-be1c-5ec459ce8fd4 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Converting VIF {"id": "b1a278b5-bdf7-4803-bbff-96579cf1fbd8", "address": "fa:16:3e:0e:47:73", "network": {"id": "9455bb75-f75a-41ff-8f6f-49f55aa738f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-425274599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec3b0b72e47448ebe99f9fc64119c1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1a278b5-bd", "ovs_interfaceid": "b1a278b5-bdf7-4803-bbff-96579cf1fbd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:59:06 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-8270c97b-ff38-429d-be1c-5ec459ce8fd4 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:47:73,bridge_name='br-int',has_traffic_filtering=True,id=b1a278b5-bdf7-4803-bbff-96579cf1fbd8,network=Network(9455bb75-f75a-41ff-8f6f-49f55aa738f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1a278b5-bd') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:59:06 user nova-compute[73449]: DEBUG os_vif [None req-8270c97b-ff38-429d-be1c-5ec459ce8fd4 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:47:73,bridge_name='br-int',has_traffic_filtering=True,id=b1a278b5-bdf7-4803-bbff-96579cf1fbd8,network=Network(9455bb75-f75a-41ff-8f6f-49f55aa738f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1a278b5-bd') {{(pid=73449) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 11:59:06 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:59:06 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:59:06 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 11:59:06 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:59:06 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb1a278b5-bd, may_exist=True, interface_attrs={}) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:59:06 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb1a278b5-bd, col_values=(('external_ids', {'iface-id': 'b1a278b5-bdf7-4803-bbff-96579cf1fbd8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0e:47:73', 'vm-uuid': '712c777e-251b-43d8-b923-8eda693f32ed'}),), if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:59:06 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:59:06 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:59:06 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:59:06 user nova-compute[73449]: INFO os_vif [None req-8270c97b-ff38-429d-be1c-5ec459ce8fd4 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:47:73,bridge_name='br-int',has_traffic_filtering=True,id=b1a278b5-bdf7-4803-bbff-96579cf1fbd8,network=Network(9455bb75-f75a-41ff-8f6f-49f55aa738f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1a278b5-bd')
Aug 17 11:59:06 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-8270c97b-ff38-429d-be1c-5ec459ce8fd4 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] No BDM found with device name vda, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 11:59:06 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-8270c97b-ff38-429d-be1c-5ec459ce8fd4 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] No VIF found with MAC fa:16:3e:0e:47:73, not building metadata {{(pid=73449) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 11:59:06 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:59:06 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:59:06 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Starting heal instance info cache {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 11:59:07 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "refresh_cache-3d74c8f6-fb4e-4460-b722-674a8a1e2d25" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:59:07 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquired lock "refresh_cache-3d74c8f6-fb4e-4460-b722-674a8a1e2d25" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:59:07 user nova-compute[73449]: DEBUG nova.network.neutron [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] Forcefully refreshing network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 11:59:07 user nova-compute[73449]: DEBUG nova.network.neutron [req-0bab939d-c325-4e41-842c-e4799fcfda65 req-ff2fe58a-eb55-4168-b94a-37d870da2684 service nova] [instance: 712c777e-251b-43d8-b923-8eda693f32ed] Updated VIF entry in instance network info cache for port b1a278b5-bdf7-4803-bbff-96579cf1fbd8. {{(pid=73449) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 11:59:07 user nova-compute[73449]: DEBUG nova.network.neutron [req-0bab939d-c325-4e41-842c-e4799fcfda65 req-ff2fe58a-eb55-4168-b94a-37d870da2684 service nova] [instance: 712c777e-251b-43d8-b923-8eda693f32ed] Updating instance_info_cache with network_info: [{"id": "b1a278b5-bdf7-4803-bbff-96579cf1fbd8", "address": "fa:16:3e:0e:47:73", "network": {"id": "9455bb75-f75a-41ff-8f6f-49f55aa738f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-425274599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec3b0b72e47448ebe99f9fc64119c1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1a278b5-bd", "ovs_interfaceid": "b1a278b5-bdf7-4803-bbff-96579cf1fbd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:59:07 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-0bab939d-c325-4e41-842c-e4799fcfda65 req-ff2fe58a-eb55-4168-b94a-37d870da2684 service nova] Releasing lock "refresh_cache-712c777e-251b-43d8-b923-8eda693f32ed" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:59:07 user nova-compute[73449]: DEBUG nova.network.neutron [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] Updating instance_info_cache with network_info: [{"id": "a0e89b76-95af-4e50-a972-b223cc5b3cab", "address": "fa:16:3e:5c:ab:e7", "network": {"id": "f7298070-baaa-4842-b3b2-d9fe1058d3b6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1715911399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8722edee53ed4a9188366c38f3b8b52f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0e89b76-95", "ovs_interfaceid": "a0e89b76-95af-4e50-a972-b223cc5b3cab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:59:07 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Releasing lock "refresh_cache-3d74c8f6-fb4e-4460-b722-674a8a1e2d25" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:59:07 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] Updated the network info_cache for instance {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 11:59:07 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:59:08 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:59:08 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:59:08 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:59:08 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:59:08 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:59:08 user nova-compute[73449]: DEBUG nova.compute.manager [req-4d055db5-3607-4246-97e6-34823ab9c834 req-71ec1f4b-fde3-49c6-9e06-d6ab2c836aa4 service nova] [instance: 712c777e-251b-43d8-b923-8eda693f32ed] Received event network-vif-plugged-b1a278b5-bdf7-4803-bbff-96579cf1fbd8 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:59:08 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-4d055db5-3607-4246-97e6-34823ab9c834 req-71ec1f4b-fde3-49c6-9e06-d6ab2c836aa4 service nova] Acquiring lock "712c777e-251b-43d8-b923-8eda693f32ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:59:08 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-4d055db5-3607-4246-97e6-34823ab9c834 req-71ec1f4b-fde3-49c6-9e06-d6ab2c836aa4 service nova] Lock "712c777e-251b-43d8-b923-8eda693f32ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:59:08 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-4d055db5-3607-4246-97e6-34823ab9c834 req-71ec1f4b-fde3-49c6-9e06-d6ab2c836aa4 service nova] Lock "712c777e-251b-43d8-b923-8eda693f32ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:59:08 user nova-compute[73449]: DEBUG nova.compute.manager [req-4d055db5-3607-4246-97e6-34823ab9c834 req-71ec1f4b-fde3-49c6-9e06-d6ab2c836aa4 service nova] [instance: 712c777e-251b-43d8-b923-8eda693f32ed] No waiting events found dispatching network-vif-plugged-b1a278b5-bdf7-4803-bbff-96579cf1fbd8 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:59:08 user nova-compute[73449]: WARNING nova.compute.manager [req-4d055db5-3607-4246-97e6-34823ab9c834 req-71ec1f4b-fde3-49c6-9e06-d6ab2c836aa4 service nova] [instance: 712c777e-251b-43d8-b923-8eda693f32ed] Received unexpected event network-vif-plugged-b1a278b5-bdf7-4803-bbff-96579cf1fbd8 for instance with vm_state building and task_state spawning.
Aug 17 11:59:08 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:59:08 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:59:09 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 11:59:09 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:59:09 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:59:09 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:59:09 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=73449) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 11:59:10 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cacd9ed-27fb-431d-999e-31ff2464d14d/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:59:10 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cacd9ed-27fb-431d-999e-31ff2464d14d/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:59:10 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cacd9ed-27fb-431d-999e-31ff2464d14d/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:59:10 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cacd9ed-27fb-431d-999e-31ff2464d14d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:59:10 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/712c777e-251b-43d8-b923-8eda693f32ed/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:59:10 user nova-compute[73449]: DEBUG nova.compute.manager [req-45d60866-768e-4a3c-a9ff-6e742eb58932 req-01955d43-12f4-4817-a6eb-6392c08547e5 service nova] [instance: 712c777e-251b-43d8-b923-8eda693f32ed] Received event network-vif-plugged-b1a278b5-bdf7-4803-bbff-96579cf1fbd8 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:59:10 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-45d60866-768e-4a3c-a9ff-6e742eb58932 req-01955d43-12f4-4817-a6eb-6392c08547e5 service nova] Acquiring lock "712c777e-251b-43d8-b923-8eda693f32ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:59:10 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-45d60866-768e-4a3c-a9ff-6e742eb58932 req-01955d43-12f4-4817-a6eb-6392c08547e5 service nova] Lock "712c777e-251b-43d8-b923-8eda693f32ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:59:10 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-45d60866-768e-4a3c-a9ff-6e742eb58932 req-01955d43-12f4-4817-a6eb-6392c08547e5 service nova] Lock "712c777e-251b-43d8-b923-8eda693f32ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:59:10 user nova-compute[73449]: DEBUG nova.compute.manager [req-45d60866-768e-4a3c-a9ff-6e742eb58932 req-01955d43-12f4-4817-a6eb-6392c08547e5 service nova] [instance: 712c777e-251b-43d8-b923-8eda693f32ed] No waiting events found dispatching network-vif-plugged-b1a278b5-bdf7-4803-bbff-96579cf1fbd8 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:59:10 user nova-compute[73449]: WARNING nova.compute.manager [req-45d60866-768e-4a3c-a9ff-6e742eb58932 req-01955d43-12f4-4817-a6eb-6392c08547e5 service nova] [instance: 712c777e-251b-43d8-b923-8eda693f32ed] Received unexpected event network-vif-plugged-b1a278b5-bdf7-4803-bbff-96579cf1fbd8 for instance with vm_state building and task_state spawning.
Aug 17 11:59:10 user nova-compute[73449]: DEBUG nova.compute.manager [None req-8270c97b-ff38-429d-be1c-5ec459ce8fd4 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 712c777e-251b-43d8-b923-8eda693f32ed] Instance event wait completed in 0 seconds for  {{(pid=73449) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 11:59:10 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-8270c97b-ff38-429d-be1c-5ec459ce8fd4 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 712c777e-251b-43d8-b923-8eda693f32ed] Guest created on hypervisor {{(pid=73449) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 11:59:10 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692273550.7318795, 712c777e-251b-43d8-b923-8eda693f32ed => Resumed> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:59:10 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 712c777e-251b-43d8-b923-8eda693f32ed] VM Resumed (Lifecycle Event)
Aug 17 11:59:10 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: 712c777e-251b-43d8-b923-8eda693f32ed] Instance spawned successfully.
Aug 17 11:59:10 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-8270c97b-ff38-429d-be1c-5ec459ce8fd4 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 712c777e-251b-43d8-b923-8eda693f32ed] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 11:59:10 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 712c777e-251b-43d8-b923-8eda693f32ed] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:59:10 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 712c777e-251b-43d8-b923-8eda693f32ed] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 11:59:10 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-8270c97b-ff38-429d-be1c-5ec459ce8fd4 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 712c777e-251b-43d8-b923-8eda693f32ed] Found default for hw_cdrom_bus of ide {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:59:10 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-8270c97b-ff38-429d-be1c-5ec459ce8fd4 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 712c777e-251b-43d8-b923-8eda693f32ed] Found default for hw_disk_bus of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:59:10 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-8270c97b-ff38-429d-be1c-5ec459ce8fd4 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 712c777e-251b-43d8-b923-8eda693f32ed] Found default for hw_input_bus of None {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:59:10 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-8270c97b-ff38-429d-be1c-5ec459ce8fd4 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 712c777e-251b-43d8-b923-8eda693f32ed] Found default for hw_pointer_model of None {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:59:10 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-8270c97b-ff38-429d-be1c-5ec459ce8fd4 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 712c777e-251b-43d8-b923-8eda693f32ed] Found default for hw_video_model of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:59:10 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-8270c97b-ff38-429d-be1c-5ec459ce8fd4 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 712c777e-251b-43d8-b923-8eda693f32ed] Found default for hw_vif_model of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:59:10 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 712c777e-251b-43d8-b923-8eda693f32ed] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 11:59:10 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692273550.7429945, 712c777e-251b-43d8-b923-8eda693f32ed => Started> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:59:10 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 712c777e-251b-43d8-b923-8eda693f32ed] VM Started (Lifecycle Event)
Aug 17 11:59:10 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 712c777e-251b-43d8-b923-8eda693f32ed] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:59:10 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 712c777e-251b-43d8-b923-8eda693f32ed] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 11:59:10 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/712c777e-251b-43d8-b923-8eda693f32ed/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:59:10 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/712c777e-251b-43d8-b923-8eda693f32ed/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:59:10 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 712c777e-251b-43d8-b923-8eda693f32ed] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 11:59:10 user nova-compute[73449]: INFO nova.compute.manager [None req-8270c97b-ff38-429d-be1c-5ec459ce8fd4 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 712c777e-251b-43d8-b923-8eda693f32ed] Took 6.70 seconds to spawn the instance on the hypervisor.
Aug 17 11:59:10 user nova-compute[73449]: DEBUG nova.compute.manager [None req-8270c97b-ff38-429d-be1c-5ec459ce8fd4 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 712c777e-251b-43d8-b923-8eda693f32ed] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:59:11 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/712c777e-251b-43d8-b923-8eda693f32ed/disk --force-share --output=json" returned: 0 in 0.311s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:59:11 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/042713b8-ab7f-4c14-92e5-f830ccb7e341/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:59:11 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/042713b8-ab7f-4c14-92e5-f830ccb7e341/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:59:11 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/042713b8-ab7f-4c14-92e5-f830ccb7e341/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:59:11 user nova-compute[73449]: INFO nova.compute.manager [None req-8270c97b-ff38-429d-be1c-5ec459ce8fd4 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 712c777e-251b-43d8-b923-8eda693f32ed] Took 7.97 seconds to build instance.
Aug 17 11:59:11 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-8270c97b-ff38-429d-be1c-5ec459ce8fd4 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Lock "712c777e-251b-43d8-b923-8eda693f32ed" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.114s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:59:11 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/042713b8-ab7f-4c14-92e5-f830ccb7e341/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:59:11 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73449) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 11:59:11 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a9e8ad2-19db-4975-87e4-2efce603a7d7/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:59:11 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a9e8ad2-19db-4975-87e4-2efce603a7d7/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:59:11 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a9e8ad2-19db-4975-87e4-2efce603a7d7/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:59:11 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:59:11 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a9e8ad2-19db-4975-87e4-2efce603a7d7/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:59:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk.rescue --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:59:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:59:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk.rescue --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:59:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk.rescue --force-share --output=json" returned: 0 in 0.243s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:59:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:59:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:59:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:59:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:59:12 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73449) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 11:59:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d951782-d2d8-49a8-a0dc-05ac7f760c76/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:59:13 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d951782-d2d8-49a8-a0dc-05ac7f760c76/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:59:13 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d951782-d2d8-49a8-a0dc-05ac7f760c76/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:59:13 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d951782-d2d8-49a8-a0dc-05ac7f760c76/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:59:13 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d74c8f6-fb4e-4460-b722-674a8a1e2d25/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:59:13 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d74c8f6-fb4e-4460-b722-674a8a1e2d25/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:59:13 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d74c8f6-fb4e-4460-b722-674a8a1e2d25/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:59:13 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:59:13 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d74c8f6-fb4e-4460-b722-674a8a1e2d25/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:59:13 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89440604-1daf-4e7a-a524-2f9c21a9cb96/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:59:13 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89440604-1daf-4e7a-a524-2f9c21a9cb96/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:59:13 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89440604-1daf-4e7a-a524-2f9c21a9cb96/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:59:14 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89440604-1daf-4e7a-a524-2f9c21a9cb96/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:59:14 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73449) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 11:59:14 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:59:14 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:59:14 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Hypervisor/Node resource view: name=user free_ram=7496MB free_disk=25.04180145263672GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73449) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 11:59:14 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:59:14 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:59:14 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 4a9e8ad2-19db-4975-87e4-2efce603a7d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:59:14 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 3d74c8f6-fb4e-4460-b722-674a8a1e2d25 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:59:14 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance ae75d334-431a-4008-8b3d-f2a727d92417 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:59:14 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 89440604-1daf-4e7a-a524-2f9c21a9cb96 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:59:14 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 31f5f3d2-41d8-4a26-9eb2-18b891f94734 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:59:14 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 042713b8-ab7f-4c14-92e5-f830ccb7e341 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:59:14 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 773e5c86-a86a-414d-aab4-8e13e0b68c1e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:59:14 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 5cacd9ed-27fb-431d-999e-31ff2464d14d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:59:14 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 0d951782-d2d8-49a8-a0dc-05ac7f760c76 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:59:14 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 712c777e-251b-43d8-b923-8eda693f32ed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 11:59:14 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73449) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 11:59:14 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73449) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 11:59:15 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 11:59:15 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 11:59:15 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Compute_service record updated for user:user {{(pid=73449) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 11:59:15 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.715s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:59:16 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:59:18 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:59:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-f196ff35-d64d-434d-b20d-57283812a014 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Acquiring lock "5ceec4cb-f976-4978-a4fd-73d84d56c5c5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:59:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-f196ff35-d64d-434d-b20d-57283812a014 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Lock "5ceec4cb-f976-4978-a4fd-73d84d56c5c5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:59:20 user nova-compute[73449]: DEBUG nova.compute.manager [None req-f196ff35-d64d-434d-b20d-57283812a014 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 5ceec4cb-f976-4978-a4fd-73d84d56c5c5] Starting instance... {{(pid=73449) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 11:59:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-f196ff35-d64d-434d-b20d-57283812a014 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:59:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-f196ff35-d64d-434d-b20d-57283812a014 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:59:20 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-f196ff35-d64d-434d-b20d-57283812a014 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73449) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 11:59:20 user nova-compute[73449]: INFO nova.compute.claims [None req-f196ff35-d64d-434d-b20d-57283812a014 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 5ceec4cb-f976-4978-a4fd-73d84d56c5c5] Claim successful on node user
Aug 17 11:59:20 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-f196ff35-d64d-434d-b20d-57283812a014 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 11:59:20 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-f196ff35-d64d-434d-b20d-57283812a014 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 11:59:21 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-f196ff35-d64d-434d-b20d-57283812a014 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.836s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:59:21 user nova-compute[73449]: DEBUG nova.compute.manager [None req-f196ff35-d64d-434d-b20d-57283812a014 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 5ceec4cb-f976-4978-a4fd-73d84d56c5c5] Start building networks asynchronously for instance. {{(pid=73449) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 11:59:21 user nova-compute[73449]: DEBUG nova.compute.manager [None req-f196ff35-d64d-434d-b20d-57283812a014 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 5ceec4cb-f976-4978-a4fd-73d84d56c5c5] Allocating IP information in the background. {{(pid=73449) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 11:59:21 user nova-compute[73449]: DEBUG nova.network.neutron [None req-f196ff35-d64d-434d-b20d-57283812a014 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 5ceec4cb-f976-4978-a4fd-73d84d56c5c5] allocate_for_instance() {{(pid=73449) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 11:59:21 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-f196ff35-d64d-434d-b20d-57283812a014 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 5ceec4cb-f976-4978-a4fd-73d84d56c5c5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 11:59:21 user nova-compute[73449]: DEBUG nova.compute.manager [None req-f196ff35-d64d-434d-b20d-57283812a014 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 5ceec4cb-f976-4978-a4fd-73d84d56c5c5] Start building block device mappings for instance. {{(pid=73449) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 11:59:21 user nova-compute[73449]: INFO nova.virt.block_device [None req-f196ff35-d64d-434d-b20d-57283812a014 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 5ceec4cb-f976-4978-a4fd-73d84d56c5c5] Booting with volume f1f60817-d9b2-4269-a40d-69f0312e0cea at /dev/vda
Aug 17 11:59:21 user nova-compute[73449]: DEBUG nova.policy [None req-f196ff35-d64d-434d-b20d-57283812a014 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '804ccb0440fb46a4a4c0ae65c3893296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd46cdaff7a4b40955f7c8a12c55452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73449) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 11:59:21 user nova-compute[73449]: DEBUG os_brick.utils [None req-f196ff35-d64d-434d-b20d-57283812a014 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 11:59:21 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:59:21 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:59:21 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[da8098d2-79ec-4179-a306-505888f0c00d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4d3924302012\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:59:21 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:59:21 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:59:21 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[03e29eee-82e2-435d-b8b5-17e230b6f057]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:59:21 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:59:21 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:59:21 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[d061417b-0282-4d00-b896-3668eb080f21]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:59:21 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[341a0c62-53f9-4b12-9d9d-52ce4c247e65]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:59:21 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-f196ff35-d64d-434d-b20d-57283812a014 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Running cmd (subprocess): nvme version {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:59:21 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-f196ff35-d64d-434d-b20d-57283812a014 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] 'nvme version' failed. Not Retrying. {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 11:59:21 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f196ff35-d64d-434d-b20d-57283812a014 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] nvme not present on system {{(pid=73449) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 11:59:21 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:59:21 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 11:59:21 user nova-compute[73449]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 11:59:21 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[27123e14-7fdc-4005-bc22-5421ba49ff43]: (4, '') {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:59:21 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-f196ff35-d64d-434d-b20d-57283812a014 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73449) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 11:59:21 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-f196ff35-d64d-434d-b20d-57283812a014 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73449) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 11:59:21 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-f196ff35-d64d-434d-b20d-57283812a014 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] LIGHTOS: no hostnqn found. {{(pid=73449) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 11:59:21 user nova-compute[73449]: DEBUG os_brick.utils [None req-f196ff35-d64d-434d-b20d-57283812a014 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4d3924302012', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 11:59:21 user nova-compute[73449]: DEBUG nova.virt.block_device [None req-f196ff35-d64d-434d-b20d-57283812a014 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 5ceec4cb-f976-4978-a4fd-73d84d56c5c5] Updating existing volume attachment record: 40b42093-0bcf-415e-8d00-fafe42f764a0 {{(pid=73449) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 11:59:21 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:59:22 user nova-compute[73449]: DEBUG nova.network.neutron [None req-f196ff35-d64d-434d-b20d-57283812a014 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 5ceec4cb-f976-4978-a4fd-73d84d56c5c5] Successfully created port: cea7daf1-fb9f-443c-bae0-184478deda7e {{(pid=73449) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 11:59:23 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:59:23 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-8bcbaacb-2773-4a7a-8070-80fd31a84c22 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Acquiring lock "4a9e8ad2-19db-4975-87e4-2efce603a7d7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:59:23 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-8bcbaacb-2773-4a7a-8070-80fd31a84c22 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Lock "4a9e8ad2-19db-4975-87e4-2efce603a7d7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:59:23 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-8bcbaacb-2773-4a7a-8070-80fd31a84c22 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Acquiring lock "4a9e8ad2-19db-4975-87e4-2efce603a7d7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:59:23 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-8bcbaacb-2773-4a7a-8070-80fd31a84c22 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Lock "4a9e8ad2-19db-4975-87e4-2efce603a7d7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:59:23 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-8bcbaacb-2773-4a7a-8070-80fd31a84c22 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Lock "4a9e8ad2-19db-4975-87e4-2efce603a7d7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:59:23 user nova-compute[73449]: INFO nova.compute.manager [None req-8bcbaacb-2773-4a7a-8070-80fd31a84c22 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: 4a9e8ad2-19db-4975-87e4-2efce603a7d7] Terminating instance
Aug 17 11:59:23 user nova-compute[73449]: DEBUG nova.compute.manager [None req-8bcbaacb-2773-4a7a-8070-80fd31a84c22 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: 4a9e8ad2-19db-4975-87e4-2efce603a7d7] Start destroying the instance on the hypervisor. {{(pid=73449) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 11:59:23 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:59:23 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:59:23 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:59:23 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:59:23 user nova-compute[73449]: DEBUG nova.network.neutron [None req-f196ff35-d64d-434d-b20d-57283812a014 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 5ceec4cb-f976-4978-a4fd-73d84d56c5c5] Successfully updated port: cea7daf1-fb9f-443c-bae0-184478deda7e {{(pid=73449) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 11:59:23 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-f196ff35-d64d-434d-b20d-57283812a014 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Acquiring lock "refresh_cache-5ceec4cb-f976-4978-a4fd-73d84d56c5c5" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:59:23 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-f196ff35-d64d-434d-b20d-57283812a014 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Acquired lock "refresh_cache-5ceec4cb-f976-4978-a4fd-73d84d56c5c5" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:59:23 user nova-compute[73449]: DEBUG nova.network.neutron [None req-f196ff35-d64d-434d-b20d-57283812a014 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 5ceec4cb-f976-4978-a4fd-73d84d56c5c5] Building network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 11:59:24 user nova-compute[73449]: DEBUG nova.compute.manager [req-d68299a7-fcfb-4f03-bdd9-dd58a11b5c5d req-12dfb9ca-7ec7-4eb8-bc17-799e34455fb3 service nova] [instance: 5ceec4cb-f976-4978-a4fd-73d84d56c5c5] Received event network-changed-cea7daf1-fb9f-443c-bae0-184478deda7e {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:59:24 user nova-compute[73449]: DEBUG nova.compute.manager [req-d68299a7-fcfb-4f03-bdd9-dd58a11b5c5d req-12dfb9ca-7ec7-4eb8-bc17-799e34455fb3 service nova] [instance: 5ceec4cb-f976-4978-a4fd-73d84d56c5c5] Refreshing instance network info cache due to event network-changed-cea7daf1-fb9f-443c-bae0-184478deda7e. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 11:59:24 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-d68299a7-fcfb-4f03-bdd9-dd58a11b5c5d req-12dfb9ca-7ec7-4eb8-bc17-799e34455fb3 service nova] Acquiring lock "refresh_cache-5ceec4cb-f976-4978-a4fd-73d84d56c5c5" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 11:59:24 user nova-compute[73449]: DEBUG nova.network.neutron [None req-f196ff35-d64d-434d-b20d-57283812a014 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 5ceec4cb-f976-4978-a4fd-73d84d56c5c5] Instance cache missing network info. {{(pid=73449) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 11:59:24 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: 4a9e8ad2-19db-4975-87e4-2efce603a7d7] Instance destroyed successfully.
Aug 17 11:59:24 user nova-compute[73449]: DEBUG nova.objects.instance [None req-8bcbaacb-2773-4a7a-8070-80fd31a84c22 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Lazy-loading 'resources' on Instance uuid 4a9e8ad2-19db-4975-87e4-2efce603a7d7 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:59:24 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-8bcbaacb-2773-4a7a-8070-80fd31a84c22 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:40:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1526960876',display_name='tempest-ServerActionsTestOtherA-server-1526960876',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1526960876',id=2,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCjLihiqnR89DD+L9AvKMPg4aJ24FTEbroZyaBsKATQAbGhLg8fsSlSGdiYIhidGfsmIAOo7d+B78UcRA6oBB5kBwNop43IFNlD0zoDm7uS+jBpAFARKuZg2/qBioB0EGg==',key_name='tempest-keypair-71173965',keypairs=<?>,launch_index=0,launched_at=2023-08-17T11:40:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='068c5270255744a18208a0ad9b35f168',ramdisk_id='',reservation_id='r-uhieyi1b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-303961666',owner_user_name='tempest-ServerActionsTestOtherA-303961666-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T11:40:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e44f6d8893da4d95a8ebe95180355c04',uuid=4a9e8ad2-19db-4975-87e4-2efce603a7d7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3c5f8e97-0654-42f0-9575-eab6d833283a", "address": "fa:16:3e:c8:b7:51", "network": {"id": "72c50a42-688f-4868-8e19-c40b103a49cd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1792423641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "068c5270255744a18208a0ad9b35f168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c5f8e97-06", "ovs_interfaceid": "3c5f8e97-0654-42f0-9575-eab6d833283a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 11:59:24 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-8bcbaacb-2773-4a7a-8070-80fd31a84c22 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Converting VIF {"id": "3c5f8e97-0654-42f0-9575-eab6d833283a", "address": "fa:16:3e:c8:b7:51", "network": {"id": "72c50a42-688f-4868-8e19-c40b103a49cd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1792423641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "068c5270255744a18208a0ad9b35f168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c5f8e97-06", "ovs_interfaceid": "3c5f8e97-0654-42f0-9575-eab6d833283a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:59:24 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-8bcbaacb-2773-4a7a-8070-80fd31a84c22 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c8:b7:51,bridge_name='br-int',has_traffic_filtering=True,id=3c5f8e97-0654-42f0-9575-eab6d833283a,network=Network(72c50a42-688f-4868-8e19-c40b103a49cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c5f8e97-06') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:59:24 user nova-compute[73449]: DEBUG os_vif [None req-8bcbaacb-2773-4a7a-8070-80fd31a84c22 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c8:b7:51,bridge_name='br-int',has_traffic_filtering=True,id=3c5f8e97-0654-42f0-9575-eab6d833283a,network=Network(72c50a42-688f-4868-8e19-c40b103a49cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c5f8e97-06') {{(pid=73449) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 11:59:24 user nova-compute[73449]: DEBUG nova.network.neutron [None req-f196ff35-d64d-434d-b20d-57283812a014 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 5ceec4cb-f976-4978-a4fd-73d84d56c5c5] Updating instance_info_cache with network_info: [{"id": "cea7daf1-fb9f-443c-bae0-184478deda7e", "address": "fa:16:3e:83:12:ce", "network": {"id": "a9e8fcd6-4152-466b-99ad-44b85db05a05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-920564935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bd46cdaff7a4b40955f7c8a12c55452", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcea7daf1-fb", "ovs_interfaceid": "cea7daf1-fb9f-443c-bae0-184478deda7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:59:24 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:59:24 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3c5f8e97-06, bridge=br-int, if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:59:24 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:59:24 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:59:24 user nova-compute[73449]: INFO os_vif [None req-8bcbaacb-2773-4a7a-8070-80fd31a84c22 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c8:b7:51,bridge_name='br-int',has_traffic_filtering=True,id=3c5f8e97-0654-42f0-9575-eab6d833283a,network=Network(72c50a42-688f-4868-8e19-c40b103a49cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c5f8e97-06')
Aug 17 11:59:24 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-8bcbaacb-2773-4a7a-8070-80fd31a84c22 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: 4a9e8ad2-19db-4975-87e4-2efce603a7d7] Deleting instance files /opt/stack/data/nova/instances/4a9e8ad2-19db-4975-87e4-2efce603a7d7_del
Aug 17 11:59:24 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-8bcbaacb-2773-4a7a-8070-80fd31a84c22 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: 4a9e8ad2-19db-4975-87e4-2efce603a7d7] Deletion of /opt/stack/data/nova/instances/4a9e8ad2-19db-4975-87e4-2efce603a7d7_del complete
Aug 17 11:59:24 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-f196ff35-d64d-434d-b20d-57283812a014 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Releasing lock "refresh_cache-5ceec4cb-f976-4978-a4fd-73d84d56c5c5" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:59:24 user nova-compute[73449]: DEBUG nova.compute.manager [None req-f196ff35-d64d-434d-b20d-57283812a014 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 5ceec4cb-f976-4978-a4fd-73d84d56c5c5] Instance network_info: |[{"id": "cea7daf1-fb9f-443c-bae0-184478deda7e", "address": "fa:16:3e:83:12:ce", "network": {"id": "a9e8fcd6-4152-466b-99ad-44b85db05a05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-920564935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bd46cdaff7a4b40955f7c8a12c55452", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcea7daf1-fb", "ovs_interfaceid": "cea7daf1-fb9f-443c-bae0-184478deda7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73449) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 11:59:24 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-d68299a7-fcfb-4f03-bdd9-dd58a11b5c5d req-12dfb9ca-7ec7-4eb8-bc17-799e34455fb3 service nova] Acquired lock "refresh_cache-5ceec4cb-f976-4978-a4fd-73d84d56c5c5" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 11:59:24 user nova-compute[73449]: DEBUG nova.network.neutron [req-d68299a7-fcfb-4f03-bdd9-dd58a11b5c5d req-12dfb9ca-7ec7-4eb8-bc17-799e34455fb3 service nova] [instance: 5ceec4cb-f976-4978-a4fd-73d84d56c5c5] Refreshing network info cache for port cea7daf1-fb9f-443c-bae0-184478deda7e {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 11:59:24 user nova-compute[73449]: INFO nova.compute.manager [None req-8bcbaacb-2773-4a7a-8070-80fd31a84c22 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] [instance: 4a9e8ad2-19db-4975-87e4-2efce603a7d7] Took 0.96 seconds to destroy the instance on the hypervisor.
Aug 17 11:59:24 user nova-compute[73449]: DEBUG oslo.service.loopingcall [None req-8bcbaacb-2773-4a7a-8070-80fd31a84c22 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73449) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 11:59:24 user nova-compute[73449]: DEBUG nova.compute.manager [-] [instance: 4a9e8ad2-19db-4975-87e4-2efce603a7d7] Deallocating network for instance {{(pid=73449) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 11:59:24 user nova-compute[73449]: DEBUG nova.network.neutron [-] [instance: 4a9e8ad2-19db-4975-87e4-2efce603a7d7] deallocate_for_instance() {{(pid=73449) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 11:59:25 user nova-compute[73449]: DEBUG nova.network.neutron [req-d68299a7-fcfb-4f03-bdd9-dd58a11b5c5d req-12dfb9ca-7ec7-4eb8-bc17-799e34455fb3 service nova] [instance: 5ceec4cb-f976-4978-a4fd-73d84d56c5c5] Updated VIF entry in instance network info cache for port cea7daf1-fb9f-443c-bae0-184478deda7e. {{(pid=73449) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 11:59:25 user nova-compute[73449]: DEBUG nova.network.neutron [req-d68299a7-fcfb-4f03-bdd9-dd58a11b5c5d req-12dfb9ca-7ec7-4eb8-bc17-799e34455fb3 service nova] [instance: 5ceec4cb-f976-4978-a4fd-73d84d56c5c5] Updating instance_info_cache with network_info: [{"id": "cea7daf1-fb9f-443c-bae0-184478deda7e", "address": "fa:16:3e:83:12:ce", "network": {"id": "a9e8fcd6-4152-466b-99ad-44b85db05a05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-920564935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bd46cdaff7a4b40955f7c8a12c55452", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcea7daf1-fb", "ovs_interfaceid": "cea7daf1-fb9f-443c-bae0-184478deda7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:59:25 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-d68299a7-fcfb-4f03-bdd9-dd58a11b5c5d req-12dfb9ca-7ec7-4eb8-bc17-799e34455fb3 service nova] Releasing lock "refresh_cache-5ceec4cb-f976-4978-a4fd-73d84d56c5c5" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 11:59:25 user nova-compute[73449]: DEBUG nova.network.neutron [-] [instance: 4a9e8ad2-19db-4975-87e4-2efce603a7d7] Updating instance_info_cache with network_info: [] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 11:59:25 user nova-compute[73449]: INFO nova.compute.manager [-] [instance: 4a9e8ad2-19db-4975-87e4-2efce603a7d7] Took 0.73 seconds to deallocate network for instance.
Aug 17 11:59:25 user nova-compute[73449]: DEBUG nova.compute.manager [req-736fcbaa-8aca-498f-87fb-676eb927c65c req-573221a2-677a-4903-a804-dbc09777440e service nova] [instance: 4a9e8ad2-19db-4975-87e4-2efce603a7d7] Received event network-vif-deleted-3c5f8e97-0654-42f0-9575-eab6d833283a {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:59:25 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-8bcbaacb-2773-4a7a-8070-80fd31a84c22 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:59:25 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-8bcbaacb-2773-4a7a-8070-80fd31a84c22 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:59:25 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-8bcbaacb-2773-4a7a-8070-80fd31a84c22 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 11:59:25 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-8bcbaacb-2773-4a7a-8070-80fd31a84c22 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 11:59:25 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-8bcbaacb-2773-4a7a-8070-80fd31a84c22 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.495s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:59:26 user nova-compute[73449]: INFO nova.scheduler.client.report [None req-8bcbaacb-2773-4a7a-8070-80fd31a84c22 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Deleted allocations for instance 4a9e8ad2-19db-4975-87e4-2efce603a7d7
Aug 17 11:59:26 user nova-compute[73449]: DEBUG nova.compute.manager [req-9f4071c4-ef2d-4346-95d0-9a83b3c9c711 req-30b254d1-83bc-4040-a6e4-9fd7eb8a09d6 service nova] [instance: 4a9e8ad2-19db-4975-87e4-2efce603a7d7] Received event network-vif-unplugged-3c5f8e97-0654-42f0-9575-eab6d833283a {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:59:26 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-9f4071c4-ef2d-4346-95d0-9a83b3c9c711 req-30b254d1-83bc-4040-a6e4-9fd7eb8a09d6 service nova] Acquiring lock "4a9e8ad2-19db-4975-87e4-2efce603a7d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:59:26 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-9f4071c4-ef2d-4346-95d0-9a83b3c9c711 req-30b254d1-83bc-4040-a6e4-9fd7eb8a09d6 service nova] Lock "4a9e8ad2-19db-4975-87e4-2efce603a7d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:59:26 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-9f4071c4-ef2d-4346-95d0-9a83b3c9c711 req-30b254d1-83bc-4040-a6e4-9fd7eb8a09d6 service nova] Lock "4a9e8ad2-19db-4975-87e4-2efce603a7d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:59:26 user nova-compute[73449]: DEBUG nova.compute.manager [req-9f4071c4-ef2d-4346-95d0-9a83b3c9c711 req-30b254d1-83bc-4040-a6e4-9fd7eb8a09d6 service nova] [instance: 4a9e8ad2-19db-4975-87e4-2efce603a7d7] No waiting events found dispatching network-vif-unplugged-3c5f8e97-0654-42f0-9575-eab6d833283a {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:59:26 user nova-compute[73449]: WARNING nova.compute.manager [req-9f4071c4-ef2d-4346-95d0-9a83b3c9c711 req-30b254d1-83bc-4040-a6e4-9fd7eb8a09d6 service nova] [instance: 4a9e8ad2-19db-4975-87e4-2efce603a7d7] Received unexpected event network-vif-unplugged-3c5f8e97-0654-42f0-9575-eab6d833283a for instance with vm_state deleted and task_state None.
Aug 17 11:59:26 user nova-compute[73449]: DEBUG nova.compute.manager [req-9f4071c4-ef2d-4346-95d0-9a83b3c9c711 req-30b254d1-83bc-4040-a6e4-9fd7eb8a09d6 service nova] [instance: 4a9e8ad2-19db-4975-87e4-2efce603a7d7] Received event network-vif-plugged-3c5f8e97-0654-42f0-9575-eab6d833283a {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:59:26 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-9f4071c4-ef2d-4346-95d0-9a83b3c9c711 req-30b254d1-83bc-4040-a6e4-9fd7eb8a09d6 service nova] Acquiring lock "4a9e8ad2-19db-4975-87e4-2efce603a7d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:59:26 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-9f4071c4-ef2d-4346-95d0-9a83b3c9c711 req-30b254d1-83bc-4040-a6e4-9fd7eb8a09d6 service nova] Lock "4a9e8ad2-19db-4975-87e4-2efce603a7d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:59:26 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-9f4071c4-ef2d-4346-95d0-9a83b3c9c711 req-30b254d1-83bc-4040-a6e4-9fd7eb8a09d6 service nova] Lock "4a9e8ad2-19db-4975-87e4-2efce603a7d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:59:26 user nova-compute[73449]: DEBUG nova.compute.manager [req-9f4071c4-ef2d-4346-95d0-9a83b3c9c711 req-30b254d1-83bc-4040-a6e4-9fd7eb8a09d6 service nova] [instance: 4a9e8ad2-19db-4975-87e4-2efce603a7d7] No waiting events found dispatching network-vif-plugged-3c5f8e97-0654-42f0-9575-eab6d833283a {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:59:26 user nova-compute[73449]: WARNING nova.compute.manager [req-9f4071c4-ef2d-4346-95d0-9a83b3c9c711 req-30b254d1-83bc-4040-a6e4-9fd7eb8a09d6 service nova] [instance: 4a9e8ad2-19db-4975-87e4-2efce603a7d7] Received unexpected event network-vif-plugged-3c5f8e97-0654-42f0-9575-eab6d833283a for instance with vm_state deleted and task_state None.
Aug 17 11:59:26 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-8bcbaacb-2773-4a7a-8070-80fd31a84c22 tempest-ServerActionsTestOtherA-303961666 tempest-ServerActionsTestOtherA-303961666-project-member] Lock "4a9e8ad2-19db-4975-87e4-2efce603a7d7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.470s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:59:28 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:59:29 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:59:32 user nova-compute[73449]: DEBUG nova.compute.manager [None req-f196ff35-d64d-434d-b20d-57283812a014 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 5ceec4cb-f976-4978-a4fd-73d84d56c5c5] Start spawning the instance on the hypervisor. {{(pid=73449) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 11:59:32 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-f196ff35-d64d-434d-b20d-57283812a014 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 5ceec4cb-f976-4978-a4fd-73d84d56c5c5] Creating instance directory {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 11:59:32 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-f196ff35-d64d-434d-b20d-57283812a014 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 5ceec4cb-f976-4978-a4fd-73d84d56c5c5] Creating image(s)
Aug 17 11:59:32 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-f196ff35-d64d-434d-b20d-57283812a014 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 5ceec4cb-f976-4978-a4fd-73d84d56c5c5] Did not create local disks {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 11:59:32 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-f196ff35-d64d-434d-b20d-57283812a014 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 5ceec4cb-f976-4978-a4fd-73d84d56c5c5] Ensure instance console log exists: /opt/stack/data/nova/instances/5ceec4cb-f976-4978-a4fd-73d84d56c5c5/console.log {{(pid=73449) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 11:59:32 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-f196ff35-d64d-434d-b20d-57283812a014 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:59:32 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-f196ff35-d64d-434d-b20d-57283812a014 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:59:32 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-f196ff35-d64d-434d-b20d-57283812a014 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:59:32 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-f196ff35-d64d-434d-b20d-57283812a014 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 5ceec4cb-f976-4978-a4fd-73d84d56c5c5] Start _get_guest_xml network_info=[{"id": "cea7daf1-fb9f-443c-bae0-184478deda7e", "address": "fa:16:3e:83:12:ce", "network": {"id": "a9e8fcd6-4152-466b-99ad-44b85db05a05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-920564935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bd46cdaff7a4b40955f7c8a12c55452", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcea7daf1-fb", "ovs_interfaceid": "cea7daf1-fb9f-443c-bae0-184478deda7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'attachment_id': '40b42093-0bcf-415e-8d00-fafe42f764a0', 'boot_index': 0, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:f1f60817-d9b2-4269-a40d-69f0312e0cea'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YNydOVGS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5ceec4cb-f976-4978-a4fd-73d84d56c5c5', 'attached_at': '', 'detached_at': '', 'volume_id': 'f1f60817-d9b2-4269-a40d-69f0312e0cea', 'serial': 'f1f60817-d9b2-4269-a40d-69f0312e0cea'}, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 11:59:32 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-f196ff35-d64d-434d-b20d-57283812a014 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:59:32 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-f196ff35-d64d-434d-b20d-57283812a014 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 11:59:32 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-f196ff35-d64d-434d-b20d-57283812a014 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 11:59:32 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-f196ff35-d64d-434d-b20d-57283812a014 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] CPU controller missing on host. {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 11:59:32 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-f196ff35-d64d-434d-b20d-57283812a014 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 11:59:32 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-f196ff35-d64d-434d-b20d-57283812a014 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] CPU controller found on host. {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 11:59:32 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-f196ff35-d64d-434d-b20d-57283812a014 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73449) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 11:59:32 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-f196ff35-d64d-434d-b20d-57283812a014 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T11:35:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 11:59:32 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-f196ff35-d64d-434d-b20d-57283812a014 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Flavor limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 11:59:32 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-f196ff35-d64d-434d-b20d-57283812a014 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Image limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 11:59:32 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-f196ff35-d64d-434d-b20d-57283812a014 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Flavor pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 11:59:32 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-f196ff35-d64d-434d-b20d-57283812a014 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Image pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 11:59:32 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-f196ff35-d64d-434d-b20d-57283812a014 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 11:59:32 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-f196ff35-d64d-434d-b20d-57283812a014 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 11:59:32 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-f196ff35-d64d-434d-b20d-57283812a014 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 11:59:32 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-f196ff35-d64d-434d-b20d-57283812a014 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Got 1 possible topologies {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 11:59:32 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-f196ff35-d64d-434d-b20d-57283812a014 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 11:59:32 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-f196ff35-d64d-434d-b20d-57283812a014 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 11:59:32 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f196ff35-d64d-434d-b20d-57283812a014 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 5ceec4cb-f976-4978-a4fd-73d84d56c5c5] Calling os-brick to attach iSCSI Volume {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 11:59:32 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-f196ff35-d64d-434d-b20d-57283812a014 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f1f60817-d9b2-4269-a40d-69f0312e0cea'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YNydOVGS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 11:59:32 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-f196ff35-d64d-434d-b20d-57283812a014 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 11:59:32 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-f196ff35-d64d-434d-b20d-57283812a014 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:59:32 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-f196ff35-d64d-434d-b20d-57283812a014 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:59:32 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-f196ff35-d64d-434d-b20d-57283812a014 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 11:59:32 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-f196ff35-d64d-434d-b20d-57283812a014 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f1f60817-d9b2-4269-a40d-69f0312e0cea" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 11:59:32 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-f196ff35-d64d-434d-b20d-57283812a014 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f1f60817-d9b2-4269-a40d-69f0312e0cea" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 11:59:32 user nova-compute[73449]: INFO os_brick.initiator.connectors.iscsi [None req-f196ff35-d64d-434d-b20d-57283812a014 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 11:59:32 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1f60817-d9b2-4269-a40d-69f0312e0cea -p 172.16.0.220:3260 {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:59:32 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1f60817-d9b2-4269-a40d-69f0312e0cea -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:59:32 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[fff586b5-84b0-4efc-934c-96f49b3c99aa]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:59:32 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-f196ff35-d64d-434d-b20d-57283812a014 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 11:59:32 user nova-compute[73449]:  {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:59:32 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1f60817-d9b2-4269-a40d-69f0312e0cea -p 172.16.0.220:3260 --interface default --op new {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:59:32 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1f60817-d9b2-4269-a40d-69f0312e0cea -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:59:32 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[228cba93-8d10-4b3c-be96-b873cd202664]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f1f60817-d9b2-4269-a40d-69f0312e0cea] added\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:59:32 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-f196ff35-d64d-434d-b20d-57283812a014 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f1f60817-d9b2-4269-a40d-69f0312e0cea] added
Aug 17 11:59:32 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:59:32 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1f60817-d9b2-4269-a40d-69f0312e0cea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:59:32 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1f60817-d9b2-4269-a40d-69f0312e0cea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:59:32 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7960b8c-070d-49e4-b6af-92e9cd6bdf2e]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:59:32 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-f196ff35-d64d-434d-b20d-57283812a014 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:59:32 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1f60817-d9b2-4269-a40d-69f0312e0cea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:59:32 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1f60817-d9b2-4269-a40d-69f0312e0cea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:59:32 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[5493e4f4-7ea4-49df-8997-36526303ec48]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:59:32 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-f196ff35-d64d-434d-b20d-57283812a014 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:59:32 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1f60817-d9b2-4269-a40d-69f0312e0cea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YNydOVGS {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:59:32 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1f60817-d9b2-4269-a40d-69f0312e0cea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YNydOVGS" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:59:32 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bd0d869-10b6-4528-b57f-5d98b8a3f6be]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:59:32 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-f196ff35-d64d-434d-b20d-57283812a014 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YNydOVGS'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:59:32 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1f60817-d9b2-4269-a40d-69f0312e0cea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:59:32 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1f60817-d9b2-4269-a40d-69f0312e0cea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:59:32 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[f831c1a3-0062-42ae-aa78-eb5caebe1867]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:59:32 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-f196ff35-d64d-434d-b20d-57283812a014 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:59:32 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:59:32 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:59:32 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3706fdc-726d-4224-8bdc-b75e8f937ff9]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e360063-8525-4d62-8fa0-33c5062fc247 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7 (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:59:32 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-f196ff35-d64d-434d-b20d-57283812a014 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)
Aug 17 11:59:32 user nova-compute[73449]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e360063-8525-4d62-8fa0-33c5062fc247 (non-flash)
Aug 17 11:59:32 user nova-compute[73449]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7 (non-flash)
Aug 17 11:59:32 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:59:32 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-f196ff35-d64d-434d-b20d-57283812a014 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)
Aug 17 11:59:32 user nova-compute[73449]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e360063-8525-4d62-8fa0-33c5062fc247 (non-flash)
Aug 17 11:59:32 user nova-compute[73449]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7 (non-flash)
Aug 17 11:59:32 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:59:32 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1f60817-d9b2-4269-a40d-69f0312e0cea -p 172.16.0.220:3260 --login {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:59:32 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1f60817-d9b2-4269-a40d-69f0312e0cea -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:59:32 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac174c32-a4de-4b1a-9de5-cfd3f924bef3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f1f60817-d9b2-4269-a40d-69f0312e0cea, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f1f60817-d9b2-4269-a40d-69f0312e0cea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:59:32 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-f196ff35-d64d-434d-b20d-57283812a014 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f1f60817-d9b2-4269-a40d-69f0312e0cea, portal: 172.16.0.220,3260]
Aug 17 11:59:32 user nova-compute[73449]: Login to [iface: default, target: iqn.2010-10.org.openstack:f1f60817-d9b2-4269-a40d-69f0312e0cea, portal: 172.16.0.220,3260] successful.
Aug 17 11:59:32 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:59:32 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1f60817-d9b2-4269-a40d-69f0312e0cea -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:59:32 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1f60817-d9b2-4269-a40d-69f0312e0cea -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:59:32 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[d502ec43-4048-4236-8624-5d2d597340ef]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:59:32 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-f196ff35-d64d-434d-b20d-57283812a014 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 11:59:32 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:59:32 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:59:32 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[8368aacb-3e05-4d5e-a3a7-745404b330db]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e360063-8525-4d62-8fa0-33c5062fc247 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1f60817-d9b2-4269-a40d-69f0312e0cea (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:59:32 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-f196ff35-d64d-434d-b20d-57283812a014 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)
Aug 17 11:59:32 user nova-compute[73449]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e360063-8525-4d62-8fa0-33c5062fc247 (non-flash)
Aug 17 11:59:32 user nova-compute[73449]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7 (non-flash)
Aug 17 11:59:32 user nova-compute[73449]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1f60817-d9b2-4269-a40d-69f0312e0cea (non-flash)
Aug 17 11:59:32 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 11:59:32 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-f196ff35-d64d-434d-b20d-57283812a014 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)
Aug 17 11:59:32 user nova-compute[73449]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e360063-8525-4d62-8fa0-33c5062fc247 (non-flash)
Aug 17 11:59:32 user nova-compute[73449]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7 (non-flash)
Aug 17 11:59:32 user nova-compute[73449]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1f60817-d9b2-4269-a40d-69f0312e0cea (non-flash)
Aug 17 11:59:32 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 11:59:32 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-f196ff35-d64d-434d-b20d-57283812a014 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f1f60817-d9b2-4269-a40d-69f0312e0cea" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:59:32 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-f196ff35-d64d-434d-b20d-57283812a014 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Connected to 172.16.0.220:3260 {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 11:59:32 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-f196ff35-d64d-434d-b20d-57283812a014 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] HCTL ('35', '-', '-', 0) found on session 45 with lun 0 {{(pid=73449) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 11:59:32 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-f196ff35-d64d-434d-b20d-57283812a014 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73449) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 11:59:32 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 11:59:33 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 11:59:33 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[28c30826-6fe0-4969-8b06-a4e9d888d469]: (4, ('- - 0', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 11:59:33 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-f196ff35-d64d-434d-b20d-57283812a014 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Searching for a device in session 45 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73449) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 11:59:33 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-f196ff35-d64d-434d-b20d-57283812a014 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YNydOVGS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 11:59:33 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:59:34 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-f196ff35-d64d-434d-b20d-57283812a014 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.327s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 11:59:34 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-f196ff35-d64d-434d-b20d-57283812a014 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] <== connect_volume: return (1329ms) {'type': 'block', 'scsi_wwn': '23439663537663437', 'path': '/dev/sdd'} {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 11:59:34 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f196ff35-d64d-434d-b20d-57283812a014 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 5ceec4cb-f976-4978-a4fd-73d84d56c5c5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23439663537663437', 'path': '/dev/sdd'} {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 11:59:34 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-f196ff35-d64d-434d-b20d-57283812a014 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:59:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1066178544',display_name='tempest-TestVolumeBootPattern-server-1066178544',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1066178544',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIHMstqa6z3yCDWSo0nI/hXtJfgb+1MPwAN30vhg6KwDR8sZaSoGZeJ4pbZmuMNqk20Z45pPhufbqYZm+wNKDW7ChjAcmHiitPsVRUAo/TWnRjbFauozfEZ44NXHQWQQfg==',key_name='tempest-TestVolumeBootPattern-29823023',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4bd46cdaff7a4b40955f7c8a12c55452',ramdisk_id='',reservation_id='r-8dkaw26u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-813872552',owner_user_name='tempest-TestVolumeBootPattern-813872552-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T11:59:21Z,user_data=None,user_id='804ccb0440fb46a4a4c0ae65c3893296',uuid=5ceec4cb-f976-4978-a4fd-73d84d56c5c5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cea7daf1-fb9f-443c-bae0-184478deda7e", "address": "fa:16:3e:83:12:ce", "network": {"id": "a9e8fcd6-4152-466b-99ad-44b85db05a05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-920564935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bd46cdaff7a4b40955f7c8a12c55452", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcea7daf1-fb", "ovs_interfaceid": "cea7daf1-fb9f-443c-bae0-184478deda7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73449) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 11:59:34 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-f196ff35-d64d-434d-b20d-57283812a014 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Converting VIF {"id": "cea7daf1-fb9f-443c-bae0-184478deda7e", "address": "fa:16:3e:83:12:ce", "network": {"id": "a9e8fcd6-4152-466b-99ad-44b85db05a05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-920564935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bd46cdaff7a4b40955f7c8a12c55452", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcea7daf1-fb", "ovs_interfaceid": "cea7daf1-fb9f-443c-bae0-184478deda7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:59:34 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-f196ff35-d64d-434d-b20d-57283812a014 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:12:ce,bridge_name='br-int',has_traffic_filtering=True,id=cea7daf1-fb9f-443c-bae0-184478deda7e,network=Network(a9e8fcd6-4152-466b-99ad-44b85db05a05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcea7daf1-fb') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:59:34 user nova-compute[73449]: DEBUG nova.objects.instance [None req-f196ff35-d64d-434d-b20d-57283812a014 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Lazy-loading 'pci_devices' on Instance uuid 5ceec4cb-f976-4978-a4fd-73d84d56c5c5 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 11:59:34 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-f196ff35-d64d-434d-b20d-57283812a014 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 5ceec4cb-f976-4978-a4fd-73d84d56c5c5] End _get_guest_xml xml=<domain type="kvm">
Aug 17 11:59:34 user nova-compute[73449]:   <uuid>5ceec4cb-f976-4978-a4fd-73d84d56c5c5</uuid>
Aug 17 11:59:34 user nova-compute[73449]:   <name>instance-00000029</name>
Aug 17 11:59:34 user nova-compute[73449]:   <memory>524288</memory>
Aug 17 11:59:34 user nova-compute[73449]:   <vcpu>1</vcpu>
Aug 17 11:59:34 user nova-compute[73449]:   <metadata>
Aug 17 11:59:34 user nova-compute[73449]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 11:59:34 user nova-compute[73449]:       <nova:package version="0.0.0"/>
Aug 17 11:59:34 user nova-compute[73449]:       <nova:name>tempest-TestVolumeBootPattern-server-1066178544</nova:name>
Aug 17 11:59:34 user nova-compute[73449]:       <nova:creationTime>2023-08-17 11:59:32</nova:creationTime>
Aug 17 11:59:34 user nova-compute[73449]:       <nova:flavor name="m1.tiny">
Aug 17 11:59:34 user nova-compute[73449]:         <nova:memory>512</nova:memory>
Aug 17 11:59:34 user nova-compute[73449]:         <nova:disk>1</nova:disk>
Aug 17 11:59:34 user nova-compute[73449]:         <nova:swap>0</nova:swap>
Aug 17 11:59:34 user nova-compute[73449]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 11:59:34 user nova-compute[73449]:         <nova:vcpus>1</nova:vcpus>
Aug 17 11:59:34 user nova-compute[73449]:       </nova:flavor>
Aug 17 11:59:34 user nova-compute[73449]:       <nova:owner>
Aug 17 11:59:34 user nova-compute[73449]:         <nova:user uuid="804ccb0440fb46a4a4c0ae65c3893296">tempest-TestVolumeBootPattern-813872552-project-member</nova:user>
Aug 17 11:59:34 user nova-compute[73449]:         <nova:project uuid="4bd46cdaff7a4b40955f7c8a12c55452">tempest-TestVolumeBootPattern-813872552</nova:project>
Aug 17 11:59:34 user nova-compute[73449]:       </nova:owner>
Aug 17 11:59:34 user nova-compute[73449]:       <nova:ports>
Aug 17 11:59:34 user nova-compute[73449]:         <nova:port uuid="cea7daf1-fb9f-443c-bae0-184478deda7e">
Aug 17 11:59:34 user nova-compute[73449]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 17 11:59:34 user nova-compute[73449]:         </nova:port>
Aug 17 11:59:34 user nova-compute[73449]:       </nova:ports>
Aug 17 11:59:34 user nova-compute[73449]:     </nova:instance>
Aug 17 11:59:34 user nova-compute[73449]:   </metadata>
Aug 17 11:59:34 user nova-compute[73449]:   <sysinfo type="smbios">
Aug 17 11:59:34 user nova-compute[73449]:     <system>
Aug 17 11:59:34 user nova-compute[73449]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 11:59:34 user nova-compute[73449]:       <entry name="product">OpenStack Nova</entry>
Aug 17 11:59:34 user nova-compute[73449]:       <entry name="version">0.0.0</entry>
Aug 17 11:59:34 user nova-compute[73449]:       <entry name="serial">5ceec4cb-f976-4978-a4fd-73d84d56c5c5</entry>
Aug 17 11:59:34 user nova-compute[73449]:       <entry name="uuid">5ceec4cb-f976-4978-a4fd-73d84d56c5c5</entry>
Aug 17 11:59:34 user nova-compute[73449]:       <entry name="family">Virtual Machine</entry>
Aug 17 11:59:34 user nova-compute[73449]:     </system>
Aug 17 11:59:34 user nova-compute[73449]:   </sysinfo>
Aug 17 11:59:34 user nova-compute[73449]:   <os>
Aug 17 11:59:34 user nova-compute[73449]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 11:59:34 user nova-compute[73449]:     <boot dev="hd"/>
Aug 17 11:59:34 user nova-compute[73449]:     <smbios mode="sysinfo"/>
Aug 17 11:59:34 user nova-compute[73449]:   </os>
Aug 17 11:59:34 user nova-compute[73449]:   <features>
Aug 17 11:59:34 user nova-compute[73449]:     <acpi/>
Aug 17 11:59:34 user nova-compute[73449]:     <apic/>
Aug 17 11:59:34 user nova-compute[73449]:     <vmcoreinfo/>
Aug 17 11:59:34 user nova-compute[73449]:   </features>
Aug 17 11:59:34 user nova-compute[73449]:   <clock offset="utc">
Aug 17 11:59:34 user nova-compute[73449]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 11:59:34 user nova-compute[73449]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 11:59:34 user nova-compute[73449]:     <timer name="hpet" present="no"/>
Aug 17 11:59:34 user nova-compute[73449]:   </clock>
Aug 17 11:59:34 user nova-compute[73449]:   <cpu mode="custom" match="exact">
Aug 17 11:59:34 user nova-compute[73449]:     <model>Nehalem</model>
Aug 17 11:59:34 user nova-compute[73449]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 11:59:34 user nova-compute[73449]:   </cpu>
Aug 17 11:59:34 user nova-compute[73449]:   <devices>
Aug 17 11:59:34 user nova-compute[73449]:     <disk type="block" device="disk">
Aug 17 11:59:34 user nova-compute[73449]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 11:59:34 user nova-compute[73449]:       <source dev="/dev/sdd"/>
Aug 17 11:59:34 user nova-compute[73449]:       <target dev="vda" bus="virtio"/>
Aug 17 11:59:34 user nova-compute[73449]:       <serial>f1f60817-d9b2-4269-a40d-69f0312e0cea</serial>
Aug 17 11:59:34 user nova-compute[73449]:     </disk>
Aug 17 11:59:34 user nova-compute[73449]:     <interface type="ethernet">
Aug 17 11:59:34 user nova-compute[73449]:       <mac address="fa:16:3e:83:12:ce"/>
Aug 17 11:59:34 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 11:59:34 user nova-compute[73449]:       <mtu size="1442"/>
Aug 17 11:59:34 user nova-compute[73449]:       <target dev="tapcea7daf1-fb"/>
Aug 17 11:59:34 user nova-compute[73449]:     </interface>
Aug 17 11:59:34 user nova-compute[73449]:     <serial type="pty">
Aug 17 11:59:34 user nova-compute[73449]:       <log file="/opt/stack/data/nova/instances/5ceec4cb-f976-4978-a4fd-73d84d56c5c5/console.log" append="off"/>
Aug 17 11:59:34 user nova-compute[73449]:     </serial>
Aug 17 11:59:34 user nova-compute[73449]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 11:59:34 user nova-compute[73449]:     <video>
Aug 17 11:59:34 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 11:59:34 user nova-compute[73449]:     </video>
Aug 17 11:59:34 user nova-compute[73449]:     <rng model="virtio">
Aug 17 11:59:34 user nova-compute[73449]:       <backend model="random">/dev/urandom</backend>
Aug 17 11:59:34 user nova-compute[73449]:     </rng>
Aug 17 11:59:34 user nova-compute[73449]:     <controller type="usb" index="0" model="none"/>
Aug 17 11:59:34 user nova-compute[73449]:     <memballoon model="virtio">
Aug 17 11:59:34 user nova-compute[73449]:       <stats period="10"/>
Aug 17 11:59:34 user nova-compute[73449]:     </memballoon>
Aug 17 11:59:34 user nova-compute[73449]:   </devices>
Aug 17 11:59:34 user nova-compute[73449]: </domain>
Aug 17 11:59:34 user nova-compute[73449]:  {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 11:59:34 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-f196ff35-d64d-434d-b20d-57283812a014 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:59:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1066178544',display_name='tempest-TestVolumeBootPattern-server-1066178544',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1066178544',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIHMstqa6z3yCDWSo0nI/hXtJfgb+1MPwAN30vhg6KwDR8sZaSoGZeJ4pbZmuMNqk20Z45pPhufbqYZm+wNKDW7ChjAcmHiitPsVRUAo/TWnRjbFauozfEZ44NXHQWQQfg==',key_name='tempest-TestVolumeBootPattern-29823023',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4bd46cdaff7a4b40955f7c8a12c55452',ramdisk_id='',reservation_id='r-8dkaw26u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-813872552',owner_user_name='tempest-TestVolumeBootPattern-813872552-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T11:59:21Z,user_data=None,user_id='804ccb0440fb46a4a4c0ae65c3893296',uuid=5ceec4cb-f976-4978-a4fd-73d84d56c5c5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cea7daf1-fb9f-443c-bae0-184478deda7e", "address": "fa:16:3e:83:12:ce", "network": {"id": "a9e8fcd6-4152-466b-99ad-44b85db05a05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-920564935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bd46cdaff7a4b40955f7c8a12c55452", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcea7daf1-fb", "ovs_interfaceid": "cea7daf1-fb9f-443c-bae0-184478deda7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 11:59:34 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-f196ff35-d64d-434d-b20d-57283812a014 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Converting VIF {"id": "cea7daf1-fb9f-443c-bae0-184478deda7e", "address": "fa:16:3e:83:12:ce", "network": {"id": "a9e8fcd6-4152-466b-99ad-44b85db05a05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-920564935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bd46cdaff7a4b40955f7c8a12c55452", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcea7daf1-fb", "ovs_interfaceid": "cea7daf1-fb9f-443c-bae0-184478deda7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 11:59:34 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-f196ff35-d64d-434d-b20d-57283812a014 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:12:ce,bridge_name='br-int',has_traffic_filtering=True,id=cea7daf1-fb9f-443c-bae0-184478deda7e,network=Network(a9e8fcd6-4152-466b-99ad-44b85db05a05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcea7daf1-fb') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 11:59:34 user nova-compute[73449]: DEBUG os_vif [None req-f196ff35-d64d-434d-b20d-57283812a014 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:12:ce,bridge_name='br-int',has_traffic_filtering=True,id=cea7daf1-fb9f-443c-bae0-184478deda7e,network=Network(a9e8fcd6-4152-466b-99ad-44b85db05a05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcea7daf1-fb') {{(pid=73449) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 11:59:34 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:59:34 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:59:34 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 11:59:34 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:59:34 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcea7daf1-fb, may_exist=True, interface_attrs={}) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:59:34 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcea7daf1-fb, col_values=(('external_ids', {'iface-id': 'cea7daf1-fb9f-443c-bae0-184478deda7e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:83:12:ce', 'vm-uuid': '5ceec4cb-f976-4978-a4fd-73d84d56c5c5'}),), if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 11:59:34 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:59:34 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:59:34 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:59:34 user nova-compute[73449]: INFO os_vif [None req-f196ff35-d64d-434d-b20d-57283812a014 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:12:ce,bridge_name='br-int',has_traffic_filtering=True,id=cea7daf1-fb9f-443c-bae0-184478deda7e,network=Network(a9e8fcd6-4152-466b-99ad-44b85db05a05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcea7daf1-fb')
Aug 17 11:59:34 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-f196ff35-d64d-434d-b20d-57283812a014 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] No BDM found with device name vda, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 11:59:34 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-f196ff35-d64d-434d-b20d-57283812a014 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] No VIF found with MAC fa:16:3e:83:12:ce, not building metadata {{(pid=73449) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 11:59:35 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:59:35 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:59:35 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:59:35 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:59:35 user nova-compute[73449]: DEBUG nova.compute.manager [req-de54a7a8-fe28-4297-9925-ee4dab1a1165 req-d87f15c8-af70-4d43-8cde-a1a90dd2b929 service nova] [instance: 5ceec4cb-f976-4978-a4fd-73d84d56c5c5] Received event network-vif-plugged-cea7daf1-fb9f-443c-bae0-184478deda7e {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:59:35 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-de54a7a8-fe28-4297-9925-ee4dab1a1165 req-d87f15c8-af70-4d43-8cde-a1a90dd2b929 service nova] Acquiring lock "5ceec4cb-f976-4978-a4fd-73d84d56c5c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:59:35 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-de54a7a8-fe28-4297-9925-ee4dab1a1165 req-d87f15c8-af70-4d43-8cde-a1a90dd2b929 service nova] Lock "5ceec4cb-f976-4978-a4fd-73d84d56c5c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:59:35 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-de54a7a8-fe28-4297-9925-ee4dab1a1165 req-d87f15c8-af70-4d43-8cde-a1a90dd2b929 service nova] Lock "5ceec4cb-f976-4978-a4fd-73d84d56c5c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:59:35 user nova-compute[73449]: DEBUG nova.compute.manager [req-de54a7a8-fe28-4297-9925-ee4dab1a1165 req-d87f15c8-af70-4d43-8cde-a1a90dd2b929 service nova] [instance: 5ceec4cb-f976-4978-a4fd-73d84d56c5c5] No waiting events found dispatching network-vif-plugged-cea7daf1-fb9f-443c-bae0-184478deda7e {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:59:35 user nova-compute[73449]: WARNING nova.compute.manager [req-de54a7a8-fe28-4297-9925-ee4dab1a1165 req-d87f15c8-af70-4d43-8cde-a1a90dd2b929 service nova] [instance: 5ceec4cb-f976-4978-a4fd-73d84d56c5c5] Received unexpected event network-vif-plugged-cea7daf1-fb9f-443c-bae0-184478deda7e for instance with vm_state building and task_state spawning.
Aug 17 11:59:35 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:59:35 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:59:37 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692273577.5355682, 5ceec4cb-f976-4978-a4fd-73d84d56c5c5 => Resumed> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:59:37 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 5ceec4cb-f976-4978-a4fd-73d84d56c5c5] VM Resumed (Lifecycle Event)
Aug 17 11:59:37 user nova-compute[73449]: DEBUG nova.compute.manager [None req-f196ff35-d64d-434d-b20d-57283812a014 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 5ceec4cb-f976-4978-a4fd-73d84d56c5c5] Instance event wait completed in 0 seconds for  {{(pid=73449) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 11:59:37 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-f196ff35-d64d-434d-b20d-57283812a014 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 5ceec4cb-f976-4978-a4fd-73d84d56c5c5] Guest created on hypervisor {{(pid=73449) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 11:59:37 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: 5ceec4cb-f976-4978-a4fd-73d84d56c5c5] Instance spawned successfully.
Aug 17 11:59:37 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-f196ff35-d64d-434d-b20d-57283812a014 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 5ceec4cb-f976-4978-a4fd-73d84d56c5c5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 11:59:37 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 5ceec4cb-f976-4978-a4fd-73d84d56c5c5] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:59:37 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 5ceec4cb-f976-4978-a4fd-73d84d56c5c5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 11:59:37 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-f196ff35-d64d-434d-b20d-57283812a014 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 5ceec4cb-f976-4978-a4fd-73d84d56c5c5] Found default for hw_cdrom_bus of ide {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:59:37 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-f196ff35-d64d-434d-b20d-57283812a014 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 5ceec4cb-f976-4978-a4fd-73d84d56c5c5] Found default for hw_disk_bus of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:59:37 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-f196ff35-d64d-434d-b20d-57283812a014 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 5ceec4cb-f976-4978-a4fd-73d84d56c5c5] Found default for hw_input_bus of None {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:59:37 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-f196ff35-d64d-434d-b20d-57283812a014 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 5ceec4cb-f976-4978-a4fd-73d84d56c5c5] Found default for hw_pointer_model of None {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:59:37 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-f196ff35-d64d-434d-b20d-57283812a014 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 5ceec4cb-f976-4978-a4fd-73d84d56c5c5] Found default for hw_video_model of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:59:37 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-f196ff35-d64d-434d-b20d-57283812a014 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 5ceec4cb-f976-4978-a4fd-73d84d56c5c5] Found default for hw_vif_model of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 11:59:37 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 5ceec4cb-f976-4978-a4fd-73d84d56c5c5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 11:59:37 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692273577.5391064, 5ceec4cb-f976-4978-a4fd-73d84d56c5c5 => Started> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:59:37 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 5ceec4cb-f976-4978-a4fd-73d84d56c5c5] VM Started (Lifecycle Event)
Aug 17 11:59:37 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 5ceec4cb-f976-4978-a4fd-73d84d56c5c5] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:59:37 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 5ceec4cb-f976-4978-a4fd-73d84d56c5c5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 11:59:37 user nova-compute[73449]: INFO nova.compute.manager [None req-f196ff35-d64d-434d-b20d-57283812a014 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 5ceec4cb-f976-4978-a4fd-73d84d56c5c5] Took 5.01 seconds to spawn the instance on the hypervisor.
Aug 17 11:59:37 user nova-compute[73449]: DEBUG nova.compute.manager [None req-f196ff35-d64d-434d-b20d-57283812a014 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 5ceec4cb-f976-4978-a4fd-73d84d56c5c5] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:59:37 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 5ceec4cb-f976-4978-a4fd-73d84d56c5c5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 11:59:37 user nova-compute[73449]: INFO nova.compute.manager [None req-f196ff35-d64d-434d-b20d-57283812a014 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 5ceec4cb-f976-4978-a4fd-73d84d56c5c5] Took 17.33 seconds to build instance.
Aug 17 11:59:37 user nova-compute[73449]: DEBUG nova.compute.manager [req-2f6f11b1-0e9f-452b-945c-677f81ad5639 req-50542c4d-f514-4f71-a088-9748f02d369c service nova] [instance: 5ceec4cb-f976-4978-a4fd-73d84d56c5c5] Received event network-vif-plugged-cea7daf1-fb9f-443c-bae0-184478deda7e {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 11:59:37 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-2f6f11b1-0e9f-452b-945c-677f81ad5639 req-50542c4d-f514-4f71-a088-9748f02d369c service nova] Acquiring lock "5ceec4cb-f976-4978-a4fd-73d84d56c5c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 11:59:37 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-2f6f11b1-0e9f-452b-945c-677f81ad5639 req-50542c4d-f514-4f71-a088-9748f02d369c service nova] Lock "5ceec4cb-f976-4978-a4fd-73d84d56c5c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 11:59:37 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-2f6f11b1-0e9f-452b-945c-677f81ad5639 req-50542c4d-f514-4f71-a088-9748f02d369c service nova] Lock "5ceec4cb-f976-4978-a4fd-73d84d56c5c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:59:37 user nova-compute[73449]: DEBUG nova.compute.manager [req-2f6f11b1-0e9f-452b-945c-677f81ad5639 req-50542c4d-f514-4f71-a088-9748f02d369c service nova] [instance: 5ceec4cb-f976-4978-a4fd-73d84d56c5c5] No waiting events found dispatching network-vif-plugged-cea7daf1-fb9f-443c-bae0-184478deda7e {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 11:59:37 user nova-compute[73449]: WARNING nova.compute.manager [req-2f6f11b1-0e9f-452b-945c-677f81ad5639 req-50542c4d-f514-4f71-a088-9748f02d369c service nova] [instance: 5ceec4cb-f976-4978-a4fd-73d84d56c5c5] Received unexpected event network-vif-plugged-cea7daf1-fb9f-443c-bae0-184478deda7e for instance with vm_state active and task_state None.
Aug 17 11:59:37 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-f196ff35-d64d-434d-b20d-57283812a014 tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Lock "5ceec4cb-f976-4978-a4fd-73d84d56c5c5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.462s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 11:59:38 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:59:39 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:59:39 user nova-compute[73449]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692273564.5561547, 4a9e8ad2-19db-4975-87e4-2efce603a7d7 => Stopped> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 11:59:39 user nova-compute[73449]: INFO nova.compute.manager [-] [instance: 4a9e8ad2-19db-4975-87e4-2efce603a7d7] VM Stopped (Lifecycle Event)
Aug 17 11:59:39 user nova-compute[73449]: DEBUG nova.compute.manager [None req-fe28d1cf-34a8-4d79-af40-bb3b88574a52 None None] [instance: 4a9e8ad2-19db-4975-87e4-2efce603a7d7] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 11:59:43 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:59:44 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:59:49 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 11:59:53 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:59:54 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:59:58 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 11:59:59 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:00:00 user nova-compute[73449]: DEBUG nova.compute.manager [req-fc0f3a35-fd5b-4d3e-833b-3ae2bf5f4312 req-88e46c0b-b9dc-417f-9011-cb6e56930670 service nova] [instance: 5cacd9ed-27fb-431d-999e-31ff2464d14d] Received event network-changed-b9152b88-6f67-4bcb-bcd0-64a3a04103dc {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:00:00 user nova-compute[73449]: DEBUG nova.compute.manager [req-fc0f3a35-fd5b-4d3e-833b-3ae2bf5f4312 req-88e46c0b-b9dc-417f-9011-cb6e56930670 service nova] [instance: 5cacd9ed-27fb-431d-999e-31ff2464d14d] Refreshing instance network info cache due to event network-changed-b9152b88-6f67-4bcb-bcd0-64a3a04103dc. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 12:00:00 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-fc0f3a35-fd5b-4d3e-833b-3ae2bf5f4312 req-88e46c0b-b9dc-417f-9011-cb6e56930670 service nova] Acquiring lock "refresh_cache-5cacd9ed-27fb-431d-999e-31ff2464d14d" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 12:00:00 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-fc0f3a35-fd5b-4d3e-833b-3ae2bf5f4312 req-88e46c0b-b9dc-417f-9011-cb6e56930670 service nova] Acquired lock "refresh_cache-5cacd9ed-27fb-431d-999e-31ff2464d14d" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 12:00:00 user nova-compute[73449]: DEBUG nova.network.neutron [req-fc0f3a35-fd5b-4d3e-833b-3ae2bf5f4312 req-88e46c0b-b9dc-417f-9011-cb6e56930670 service nova] [instance: 5cacd9ed-27fb-431d-999e-31ff2464d14d] Refreshing network info cache for port b9152b88-6f67-4bcb-bcd0-64a3a04103dc {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 12:00:01 user nova-compute[73449]: DEBUG nova.network.neutron [req-fc0f3a35-fd5b-4d3e-833b-3ae2bf5f4312 req-88e46c0b-b9dc-417f-9011-cb6e56930670 service nova] [instance: 5cacd9ed-27fb-431d-999e-31ff2464d14d] Updated VIF entry in instance network info cache for port b9152b88-6f67-4bcb-bcd0-64a3a04103dc. {{(pid=73449) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 12:00:01 user nova-compute[73449]: DEBUG nova.network.neutron [req-fc0f3a35-fd5b-4d3e-833b-3ae2bf5f4312 req-88e46c0b-b9dc-417f-9011-cb6e56930670 service nova] [instance: 5cacd9ed-27fb-431d-999e-31ff2464d14d] Updating instance_info_cache with network_info: [{"id": "b9152b88-6f67-4bcb-bcd0-64a3a04103dc", "address": "fa:16:3e:e5:8a:59", "network": {"id": "78528cb3-037c-4381-964f-7c0211faa0f0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-330540320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43bbeaa2a37b4189a850b409ac6e1c27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9152b88-6f", "ovs_interfaceid": "b9152b88-6f67-4bcb-bcd0-64a3a04103dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 12:00:01 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-fc0f3a35-fd5b-4d3e-833b-3ae2bf5f4312 req-88e46c0b-b9dc-417f-9011-cb6e56930670 service nova] Releasing lock "refresh_cache-5cacd9ed-27fb-431d-999e-31ff2464d14d" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 12:00:01 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-449dca63-8e96-42c6-83a1-e653b0ea7443 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Acquiring lock "5cacd9ed-27fb-431d-999e-31ff2464d14d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:00:01 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-449dca63-8e96-42c6-83a1-e653b0ea7443 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Lock "5cacd9ed-27fb-431d-999e-31ff2464d14d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:00:01 user nova-compute[73449]: DEBUG nova.objects.instance [None req-449dca63-8e96-42c6-83a1-e653b0ea7443 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Lazy-loading 'flavor' on Instance uuid 5cacd9ed-27fb-431d-999e-31ff2464d14d {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:00:01 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-449dca63-8e96-42c6-83a1-e653b0ea7443 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Lock "5cacd9ed-27fb-431d-999e-31ff2464d14d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.071s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:00:01 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-449dca63-8e96-42c6-83a1-e653b0ea7443 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Acquiring lock "5cacd9ed-27fb-431d-999e-31ff2464d14d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:00:01 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-449dca63-8e96-42c6-83a1-e653b0ea7443 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Lock "5cacd9ed-27fb-431d-999e-31ff2464d14d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:00:01 user nova-compute[73449]: INFO nova.compute.manager [None req-449dca63-8e96-42c6-83a1-e653b0ea7443 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] [instance: 5cacd9ed-27fb-431d-999e-31ff2464d14d] Attaching volume 82f5400e-2a45-428e-85b9-b052a993285a to /dev/vdb
Aug 17 12:00:01 user nova-compute[73449]: DEBUG os_brick.utils [None req-449dca63-8e96-42c6-83a1-e653b0ea7443 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 12:00:01 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:00:01 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:00:01 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cd80145-d03e-4d60-a309-1fb7ca5b3ef7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4d3924302012\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:00:01 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:00:01 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:00:01 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e9fdf66-6649-4c2b-bbed-84cccec05138]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:00:01 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:00:01 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:00:01 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[79b8e0b8-b3ca-47f1-8186-dc9fa3b7c5a9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:00:01 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a107910-d26b-4fe0-80bc-58105a2d68c5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:00:01 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-449dca63-8e96-42c6-83a1-e653b0ea7443 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Running cmd (subprocess): nvme version {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:00:01 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-449dca63-8e96-42c6-83a1-e653b0ea7443 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] 'nvme version' failed. Not Retrying. {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 12:00:01 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.nvmeof [None req-449dca63-8e96-42c6-83a1-e653b0ea7443 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] nvme not present on system {{(pid=73449) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 12:00:01 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:00:01 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 12:00:01 user nova-compute[73449]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 12:00:01 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3ef8151-acb1-48a9-8a05-eb7e7d454fba]: (4, '') {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:00:01 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-449dca63-8e96-42c6-83a1-e653b0ea7443 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73449) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 12:00:01 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-449dca63-8e96-42c6-83a1-e653b0ea7443 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73449) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 12:00:01 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-449dca63-8e96-42c6-83a1-e653b0ea7443 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] LIGHTOS: no hostnqn found. {{(pid=73449) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 12:00:01 user nova-compute[73449]: DEBUG os_brick.utils [None req-449dca63-8e96-42c6-83a1-e653b0ea7443 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4d3924302012', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 12:00:01 user nova-compute[73449]: DEBUG nova.virt.block_device [None req-449dca63-8e96-42c6-83a1-e653b0ea7443 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] [instance: 5cacd9ed-27fb-431d-999e-31ff2464d14d] Updating existing volume attachment record: 5990aa58-b00c-4264-bfc3-0ab1a65f6f10 {{(pid=73449) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 12:00:02 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:00:02 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:00:02 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:00:02 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:00:02 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73449) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 12:00:03 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:00:04 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:00:04 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:00:05 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:00:07 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:00:08 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:00:08 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:00:08 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Starting heal instance info cache {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 12:00:09 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:00:09 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "refresh_cache-ae75d334-431a-4008-8b3d-f2a727d92417" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 12:00:09 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquired lock "refresh_cache-ae75d334-431a-4008-8b3d-f2a727d92417" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 12:00:09 user nova-compute[73449]: DEBUG nova.network.neutron [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: ae75d334-431a-4008-8b3d-f2a727d92417] Forcefully refreshing network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 12:00:09 user nova-compute[73449]: DEBUG nova.network.neutron [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: ae75d334-431a-4008-8b3d-f2a727d92417] Updating instance_info_cache with network_info: [{"id": "0cd51063-e3d9-44a8-a1cd-b89bb41a4438", "address": "fa:16:3e:54:1f:e7", "network": {"id": "f7298070-baaa-4842-b3b2-d9fe1058d3b6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1715911399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8722edee53ed4a9188366c38f3b8b52f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cd51063-e3", "ovs_interfaceid": "0cd51063-e3d9-44a8-a1cd-b89bb41a4438", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 12:00:09 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Releasing lock "refresh_cache-ae75d334-431a-4008-8b3d-f2a727d92417" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 12:00:09 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: ae75d334-431a-4008-8b3d-f2a727d92417] Updated the network info_cache for instance {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 12:00:09 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:00:10 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:00:10 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:00:10 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:00:10 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:00:10 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=73449) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 12:00:11 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/712c777e-251b-43d8-b923-8eda693f32ed/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:00:11 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/712c777e-251b-43d8-b923-8eda693f32ed/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:00:11 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/712c777e-251b-43d8-b923-8eda693f32ed/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:00:11 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/712c777e-251b-43d8-b923-8eda693f32ed/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:00:11 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cacd9ed-27fb-431d-999e-31ff2464d14d/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:00:11 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cacd9ed-27fb-431d-999e-31ff2464d14d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:00:11 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cacd9ed-27fb-431d-999e-31ff2464d14d/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:00:11 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cacd9ed-27fb-431d-999e-31ff2464d14d/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:00:11 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/042713b8-ab7f-4c14-92e5-f830ccb7e341/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:00:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/042713b8-ab7f-4c14-92e5-f830ccb7e341/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:00:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/042713b8-ab7f-4c14-92e5-f830ccb7e341/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:00:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/042713b8-ab7f-4c14-92e5-f830ccb7e341/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:00:12 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73449) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 12:00:12 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73449) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 12:00:12 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73449) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 12:00:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk.rescue --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:00:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:00:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk.rescue --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:00:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:00:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:00:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:00:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:00:13 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:00:13 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73449) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 12:00:13 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d951782-d2d8-49a8-a0dc-05ac7f760c76/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:00:13 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-449dca63-8e96-42c6-83a1-e653b0ea7443 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] [instance: 5cacd9ed-27fb-431d-999e-31ff2464d14d] Calling os-brick to attach iSCSI Volume {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 12:00:13 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-449dca63-8e96-42c6-83a1-e653b0ea7443 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:82f5400e-2a45-428e-85b9-b052a993285a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CTSJXxwG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 12:00:13 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-449dca63-8e96-42c6-83a1-e653b0ea7443 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 12:00:13 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-449dca63-8e96-42c6-83a1-e653b0ea7443 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 12:00:13 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-449dca63-8e96-42c6-83a1-e653b0ea7443 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 12:00:13 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-449dca63-8e96-42c6-83a1-e653b0ea7443 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 12:00:13 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-449dca63-8e96-42c6-83a1-e653b0ea7443 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:82f5400e-2a45-428e-85b9-b052a993285a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 12:00:13 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-449dca63-8e96-42c6-83a1-e653b0ea7443 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:82f5400e-2a45-428e-85b9-b052a993285a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 12:00:13 user nova-compute[73449]: INFO os_brick.initiator.connectors.iscsi [None req-449dca63-8e96-42c6-83a1-e653b0ea7443 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 12:00:13 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82f5400e-2a45-428e-85b9-b052a993285a -p 172.16.0.220:3260 {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:00:13 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82f5400e-2a45-428e-85b9-b052a993285a -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:00:13 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[f92549cd-3f63-48db-803f-2cdb05b7bc4d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:00:13 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-449dca63-8e96-42c6-83a1-e653b0ea7443 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 12:00:13 user nova-compute[73449]:  {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:00:13 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82f5400e-2a45-428e-85b9-b052a993285a -p 172.16.0.220:3260 --interface default --op new {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:00:13 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82f5400e-2a45-428e-85b9-b052a993285a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:00:13 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[daa7814b-8b45-4174-b350-169c50225e09]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:82f5400e-2a45-428e-85b9-b052a993285a] added\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:00:13 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-449dca63-8e96-42c6-83a1-e653b0ea7443 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:82f5400e-2a45-428e-85b9-b052a993285a] added
Aug 17 12:00:13 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:00:13 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82f5400e-2a45-428e-85b9-b052a993285a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:00:13 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82f5400e-2a45-428e-85b9-b052a993285a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:00:13 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[7af5661d-7ce9-49b1-83ab-fafc24c8432e]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:00:13 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-449dca63-8e96-42c6-83a1-e653b0ea7443 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:00:13 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82f5400e-2a45-428e-85b9-b052a993285a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:00:13 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82f5400e-2a45-428e-85b9-b052a993285a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:00:13 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd291f6f-17f4-4380-8082-5ed954ae0899]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:00:13 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-449dca63-8e96-42c6-83a1-e653b0ea7443 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:00:13 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82f5400e-2a45-428e-85b9-b052a993285a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CTSJXxwG {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:00:13 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d951782-d2d8-49a8-a0dc-05ac7f760c76/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:00:13 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d951782-d2d8-49a8-a0dc-05ac7f760c76/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:00:13 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82f5400e-2a45-428e-85b9-b052a993285a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CTSJXxwG" returned: 0 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:00:13 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b217c0f-1cbe-420a-aa4c-ea20cec6afa5]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:00:13 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-449dca63-8e96-42c6-83a1-e653b0ea7443 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CTSJXxwG'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:00:13 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82f5400e-2a45-428e-85b9-b052a993285a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:00:13 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82f5400e-2a45-428e-85b9-b052a993285a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:00:13 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ebfc6c8-4669-45d9-a61c-77845ecd6dd8]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:00:13 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-449dca63-8e96-42c6-83a1-e653b0ea7443 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:00:13 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:00:13 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:00:13 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[d302905c-da72-4219-b269-2849e783a708]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e360063-8525-4d62-8fa0-33c5062fc247 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1f60817-d9b2-4269-a40d-69f0312e0cea (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:00:13 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-449dca63-8e96-42c6-83a1-e653b0ea7443 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)
Aug 17 12:00:13 user nova-compute[73449]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e360063-8525-4d62-8fa0-33c5062fc247 (non-flash)
Aug 17 12:00:13 user nova-compute[73449]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7 (non-flash)
Aug 17 12:00:13 user nova-compute[73449]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1f60817-d9b2-4269-a40d-69f0312e0cea (non-flash)
Aug 17 12:00:13 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 12:00:13 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-449dca63-8e96-42c6-83a1-e653b0ea7443 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)
Aug 17 12:00:13 user nova-compute[73449]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e360063-8525-4d62-8fa0-33c5062fc247 (non-flash)
Aug 17 12:00:13 user nova-compute[73449]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7 (non-flash)
Aug 17 12:00:13 user nova-compute[73449]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1f60817-d9b2-4269-a40d-69f0312e0cea (non-flash)
Aug 17 12:00:13 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 12:00:13 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82f5400e-2a45-428e-85b9-b052a993285a -p 172.16.0.220:3260 --login {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:00:13 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82f5400e-2a45-428e-85b9-b052a993285a -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:00:13 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[639711f4-92a4-4c2b-a5d1-a5bb47bef895]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:82f5400e-2a45-428e-85b9-b052a993285a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:82f5400e-2a45-428e-85b9-b052a993285a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:00:13 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-449dca63-8e96-42c6-83a1-e653b0ea7443 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:82f5400e-2a45-428e-85b9-b052a993285a, portal: 172.16.0.220,3260]
Aug 17 12:00:13 user nova-compute[73449]: Login to [iface: default, target: iqn.2010-10.org.openstack:82f5400e-2a45-428e-85b9-b052a993285a, portal: 172.16.0.220,3260] successful.
Aug 17 12:00:13 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:00:13 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82f5400e-2a45-428e-85b9-b052a993285a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:00:13 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82f5400e-2a45-428e-85b9-b052a993285a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:00:13 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[34c0fe48-e5a3-4ab2-9b0c-603167775552]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:00:13 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-449dca63-8e96-42c6-83a1-e653b0ea7443 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:00:13 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:00:13 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d951782-d2d8-49a8-a0dc-05ac7f760c76/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:00:13 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d74c8f6-fb4e-4460-b722-674a8a1e2d25/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:00:13 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:00:13 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[441c06c5-49d4-4802-a96d-68c6aa433878]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e360063-8525-4d62-8fa0-33c5062fc247 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1f60817-d9b2-4269-a40d-69f0312e0cea (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82f5400e-2a45-428e-85b9-b052a993285a (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:00:13 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-449dca63-8e96-42c6-83a1-e653b0ea7443 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)
Aug 17 12:00:13 user nova-compute[73449]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e360063-8525-4d62-8fa0-33c5062fc247 (non-flash)
Aug 17 12:00:13 user nova-compute[73449]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7 (non-flash)
Aug 17 12:00:13 user nova-compute[73449]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1f60817-d9b2-4269-a40d-69f0312e0cea (non-flash)
Aug 17 12:00:13 user nova-compute[73449]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82f5400e-2a45-428e-85b9-b052a993285a (non-flash)
Aug 17 12:00:13 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 12:00:13 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-449dca63-8e96-42c6-83a1-e653b0ea7443 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)
Aug 17 12:00:13 user nova-compute[73449]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e360063-8525-4d62-8fa0-33c5062fc247 (non-flash)
Aug 17 12:00:13 user nova-compute[73449]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7 (non-flash)
Aug 17 12:00:13 user nova-compute[73449]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1f60817-d9b2-4269-a40d-69f0312e0cea (non-flash)
Aug 17 12:00:13 user nova-compute[73449]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82f5400e-2a45-428e-85b9-b052a993285a (non-flash)
Aug 17 12:00:13 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 12:00:13 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-449dca63-8e96-42c6-83a1-e653b0ea7443 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:82f5400e-2a45-428e-85b9-b052a993285a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.341s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 12:00:13 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-449dca63-8e96-42c6-83a1-e653b0ea7443 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Connected to 172.16.0.220:3260 {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 12:00:13 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-449dca63-8e96-42c6-83a1-e653b0ea7443 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] HCTL ('37', '-', '-', 0) found on session 46 with lun 0 {{(pid=73449) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 12:00:13 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-449dca63-8e96-42c6-83a1-e653b0ea7443 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73449) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 12:00:13 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:00:13 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:00:13 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[6011a1dd-b1c6-4c53-b563-ce224685a963]: (4, ('- - 0', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:00:13 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-449dca63-8e96-42c6-83a1-e653b0ea7443 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Searching for a device in session 46 and hctl ['37', '*', '*', 0] yield: None {{(pid=73449) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 12:00:13 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:00:13 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d74c8f6-fb4e-4460-b722-674a8a1e2d25/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:00:13 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d74c8f6-fb4e-4460-b722-674a8a1e2d25/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:00:13 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d74c8f6-fb4e-4460-b722-674a8a1e2d25/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:00:13 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89440604-1daf-4e7a-a524-2f9c21a9cb96/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:00:14 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89440604-1daf-4e7a-a524-2f9c21a9cb96/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:00:14 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89440604-1daf-4e7a-a524-2f9c21a9cb96/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:00:14 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:00:14 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89440604-1daf-4e7a-a524-2f9c21a9cb96/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:00:14 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-449dca63-8e96-42c6-83a1-e653b0ea7443 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Searching for a device in session 46 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73449) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 12:00:14 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-449dca63-8e96-42c6-83a1-e653b0ea7443 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CTSJXxwG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 12:00:14 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-449dca63-8e96-42c6-83a1-e653b0ea7443 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.524s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 12:00:14 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-449dca63-8e96-42c6-83a1-e653b0ea7443 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] <== connect_volume: return (1526ms) {'type': 'block', 'scsi_wwn': '26136333230376264', 'path': '/dev/sdf'} {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 12:00:14 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-449dca63-8e96-42c6-83a1-e653b0ea7443 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] [instance: 5cacd9ed-27fb-431d-999e-31ff2464d14d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26136333230376264', 'path': '/dev/sdf'} {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 12:00:14 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 12:00:14 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 12:00:14 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Hypervisor/Node resource view: name=user free_ram=7406MB free_disk=25.002487182617188GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73449) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 12:00:14 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:00:14 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:00:14 user nova-compute[73449]: DEBUG nova.objects.instance [None req-449dca63-8e96-42c6-83a1-e653b0ea7443 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Lazy-loading 'flavor' on Instance uuid 5cacd9ed-27fb-431d-999e-31ff2464d14d {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:00:14 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-449dca63-8e96-42c6-83a1-e653b0ea7443 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 12:00:14 user nova-compute[73449]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 12:00:14 user nova-compute[73449]:   <source dev="/dev/sdf"/>
Aug 17 12:00:14 user nova-compute[73449]:   <target dev="vdb" bus="virtio"/>
Aug 17 12:00:14 user nova-compute[73449]:   <serial>82f5400e-2a45-428e-85b9-b052a993285a</serial>
Aug 17 12:00:14 user nova-compute[73449]: </disk>
Aug 17 12:00:14 user nova-compute[73449]:  {{(pid=73449) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 12:00:14 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:00:14 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 3d74c8f6-fb4e-4460-b722-674a8a1e2d25 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 12:00:14 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance ae75d334-431a-4008-8b3d-f2a727d92417 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 12:00:14 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 89440604-1daf-4e7a-a524-2f9c21a9cb96 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 12:00:14 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 31f5f3d2-41d8-4a26-9eb2-18b891f94734 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 12:00:14 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 042713b8-ab7f-4c14-92e5-f830ccb7e341 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 12:00:14 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 773e5c86-a86a-414d-aab4-8e13e0b68c1e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 12:00:14 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 5cacd9ed-27fb-431d-999e-31ff2464d14d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 12:00:14 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 0d951782-d2d8-49a8-a0dc-05ac7f760c76 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 12:00:14 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 712c777e-251b-43d8-b923-8eda693f32ed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 12:00:14 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 5ceec4cb-f976-4978-a4fd-73d84d56c5c5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 12:00:14 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73449) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 12:00:14 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73449) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 12:00:15 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-449dca63-8e96-42c6-83a1-e653b0ea7443 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] No BDM found with device name vda, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 12:00:15 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-449dca63-8e96-42c6-83a1-e653b0ea7443 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 12:00:15 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-449dca63-8e96-42c6-83a1-e653b0ea7443 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] No VIF found with MAC fa:16:3e:e5:8a:59, not building metadata {{(pid=73449) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 12:00:15 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 12:00:15 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 12:00:15 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Compute_service record updated for user:user {{(pid=73449) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 12:00:15 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.657s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:00:15 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-449dca63-8e96-42c6-83a1-e653b0ea7443 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Lock "5cacd9ed-27fb-431d-999e-31ff2464d14d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.640s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:00:15 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-ce86f3ba-9e9c-4e24-9a9f-f6bf8911535e tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Acquiring lock "4b7932d8-b781-4db7-a1c5-791ce8d1d866" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:00:15 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-ce86f3ba-9e9c-4e24-9a9f-f6bf8911535e tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Lock "4b7932d8-b781-4db7-a1c5-791ce8d1d866" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:00:15 user nova-compute[73449]: INFO nova.compute.manager [None req-ce86f3ba-9e9c-4e24-9a9f-f6bf8911535e tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] Unshelving
Aug 17 12:00:16 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-ce86f3ba-9e9c-4e24-9a9f-f6bf8911535e tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:00:16 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-ce86f3ba-9e9c-4e24-9a9f-f6bf8911535e tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:00:16 user nova-compute[73449]: DEBUG nova.objects.instance [None req-ce86f3ba-9e9c-4e24-9a9f-f6bf8911535e tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Lazy-loading 'pci_requests' on Instance uuid 4b7932d8-b781-4db7-a1c5-791ce8d1d866 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:00:16 user nova-compute[73449]: DEBUG nova.objects.instance [None req-ce86f3ba-9e9c-4e24-9a9f-f6bf8911535e tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Lazy-loading 'numa_topology' on Instance uuid 4b7932d8-b781-4db7-a1c5-791ce8d1d866 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:00:16 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-ce86f3ba-9e9c-4e24-9a9f-f6bf8911535e tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73449) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 12:00:16 user nova-compute[73449]: INFO nova.compute.claims [None req-ce86f3ba-9e9c-4e24-9a9f-f6bf8911535e tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] Claim successful on node user
Aug 17 12:00:16 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-ce86f3ba-9e9c-4e24-9a9f-f6bf8911535e tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 12:00:16 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-ce86f3ba-9e9c-4e24-9a9f-f6bf8911535e tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 12:00:16 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-ce86f3ba-9e9c-4e24-9a9f-f6bf8911535e tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.549s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:00:16 user nova-compute[73449]: INFO nova.network.neutron [None req-ce86f3ba-9e9c-4e24-9a9f-f6bf8911535e tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] Updating port dbd5bb98-0410-4179-a99a-9181d85357ea with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 17 12:00:17 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-ce86f3ba-9e9c-4e24-9a9f-f6bf8911535e tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Acquiring lock "refresh_cache-4b7932d8-b781-4db7-a1c5-791ce8d1d866" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 12:00:17 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-ce86f3ba-9e9c-4e24-9a9f-f6bf8911535e tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Acquired lock "refresh_cache-4b7932d8-b781-4db7-a1c5-791ce8d1d866" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 12:00:17 user nova-compute[73449]: DEBUG nova.network.neutron [None req-ce86f3ba-9e9c-4e24-9a9f-f6bf8911535e tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] Building network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 12:00:17 user nova-compute[73449]: DEBUG nova.compute.manager [req-e6cb221d-2a30-470e-8fcf-b75a2d89a95e req-438012bc-87a2-4633-b988-03305d7ce828 service nova] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] Received event network-changed-dbd5bb98-0410-4179-a99a-9181d85357ea {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:00:17 user nova-compute[73449]: DEBUG nova.compute.manager [req-e6cb221d-2a30-470e-8fcf-b75a2d89a95e req-438012bc-87a2-4633-b988-03305d7ce828 service nova] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] Refreshing instance network info cache due to event network-changed-dbd5bb98-0410-4179-a99a-9181d85357ea. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 12:00:17 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-e6cb221d-2a30-470e-8fcf-b75a2d89a95e req-438012bc-87a2-4633-b988-03305d7ce828 service nova] Acquiring lock "refresh_cache-4b7932d8-b781-4db7-a1c5-791ce8d1d866" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 12:00:18 user nova-compute[73449]: DEBUG nova.network.neutron [None req-ce86f3ba-9e9c-4e24-9a9f-f6bf8911535e tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] Updating instance_info_cache with network_info: [{"id": "dbd5bb98-0410-4179-a99a-9181d85357ea", "address": "fa:16:3e:5d:b1:0e", "network": {"id": "d56bc428-6be6-4aa9-b43c-9d4a0f1dd83b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-791364634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe7b5fee01a042bb90e40b18a84c82c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbd5bb98-04", "ovs_interfaceid": "dbd5bb98-0410-4179-a99a-9181d85357ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 12:00:18 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-ce86f3ba-9e9c-4e24-9a9f-f6bf8911535e tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Releasing lock "refresh_cache-4b7932d8-b781-4db7-a1c5-791ce8d1d866" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 12:00:18 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-ce86f3ba-9e9c-4e24-9a9f-f6bf8911535e tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] Creating instance directory {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 12:00:18 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-ce86f3ba-9e9c-4e24-9a9f-f6bf8911535e tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] Creating image(s)
Aug 17 12:00:18 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-ce86f3ba-9e9c-4e24-9a9f-f6bf8911535e tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Acquiring lock "/opt/stack/data/nova/instances/4b7932d8-b781-4db7-a1c5-791ce8d1d866/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:00:18 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-ce86f3ba-9e9c-4e24-9a9f-f6bf8911535e tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Lock "/opt/stack/data/nova/instances/4b7932d8-b781-4db7-a1c5-791ce8d1d866/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:00:18 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-ce86f3ba-9e9c-4e24-9a9f-f6bf8911535e tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Lock "/opt/stack/data/nova/instances/4b7932d8-b781-4db7-a1c5-791ce8d1d866/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:00:18 user nova-compute[73449]: DEBUG nova.objects.instance [None req-ce86f3ba-9e9c-4e24-9a9f-f6bf8911535e tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Lazy-loading 'trusted_certs' on Instance uuid 4b7932d8-b781-4db7-a1c5-791ce8d1d866 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:00:18 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-e6cb221d-2a30-470e-8fcf-b75a2d89a95e req-438012bc-87a2-4633-b988-03305d7ce828 service nova] Acquired lock "refresh_cache-4b7932d8-b781-4db7-a1c5-791ce8d1d866" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 12:00:18 user nova-compute[73449]: DEBUG nova.network.neutron [req-e6cb221d-2a30-470e-8fcf-b75a2d89a95e req-438012bc-87a2-4633-b988-03305d7ce828 service nova] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] Refreshing network info cache for port dbd5bb98-0410-4179-a99a-9181d85357ea {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 12:00:18 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-ce86f3ba-9e9c-4e24-9a9f-f6bf8911535e tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Acquiring lock "7f0d4cd7fcda04a8cdbc41e5c50fc25768ab8b56" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:00:18 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-ce86f3ba-9e9c-4e24-9a9f-f6bf8911535e tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Lock "7f0d4cd7fcda04a8cdbc41e5c50fc25768ab8b56" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:00:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-ce86f3ba-9e9c-4e24-9a9f-f6bf8911535e tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7f0d4cd7fcda04a8cdbc41e5c50fc25768ab8b56.part --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:00:19 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:00:19 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:00:19 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-648d6106-b46a-40ca-b429-e5202eafb036 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Acquiring lock "5cacd9ed-27fb-431d-999e-31ff2464d14d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:00:19 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-648d6106-b46a-40ca-b429-e5202eafb036 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Lock "5cacd9ed-27fb-431d-999e-31ff2464d14d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:00:19 user nova-compute[73449]: DEBUG nova.objects.instance [None req-648d6106-b46a-40ca-b429-e5202eafb036 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Lazy-loading 'flavor' on Instance uuid 5cacd9ed-27fb-431d-999e-31ff2464d14d {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:00:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-ce86f3ba-9e9c-4e24-9a9f-f6bf8911535e tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7f0d4cd7fcda04a8cdbc41e5c50fc25768ab8b56.part --force-share --output=json" returned: 0 in 0.224s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:00:19 user nova-compute[73449]: DEBUG nova.virt.images [None req-ce86f3ba-9e9c-4e24-9a9f-f6bf8911535e tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] 2f4eef75-499c-4765-a06a-d236c7e48995 was qcow2, converting to raw {{(pid=73449) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 17 12:00:20 user nova-compute[73449]: DEBUG nova.privsep.utils [None req-ce86f3ba-9e9c-4e24-9a9f-f6bf8911535e tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73449) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 12:00:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-ce86f3ba-9e9c-4e24-9a9f-f6bf8911535e tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7f0d4cd7fcda04a8cdbc41e5c50fc25768ab8b56.part /opt/stack/data/nova/instances/_base/7f0d4cd7fcda04a8cdbc41e5c50fc25768ab8b56.converted {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:00:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-648d6106-b46a-40ca-b429-e5202eafb036 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Lock "5cacd9ed-27fb-431d-999e-31ff2464d14d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.417s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:00:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-648d6106-b46a-40ca-b429-e5202eafb036 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Acquiring lock "5cacd9ed-27fb-431d-999e-31ff2464d14d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:00:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-648d6106-b46a-40ca-b429-e5202eafb036 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Lock "5cacd9ed-27fb-431d-999e-31ff2464d14d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:00:20 user nova-compute[73449]: INFO nova.compute.manager [None req-648d6106-b46a-40ca-b429-e5202eafb036 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] [instance: 5cacd9ed-27fb-431d-999e-31ff2464d14d] Attaching volume ec9ca502-d8fe-42e6-8ed0-db01b1e836fe to /dev/vdc
Aug 17 12:00:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-ce86f3ba-9e9c-4e24-9a9f-f6bf8911535e tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7f0d4cd7fcda04a8cdbc41e5c50fc25768ab8b56.part /opt/stack/data/nova/instances/_base/7f0d4cd7fcda04a8cdbc41e5c50fc25768ab8b56.converted" returned: 0 in 0.700s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:00:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-ce86f3ba-9e9c-4e24-9a9f-f6bf8911535e tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7f0d4cd7fcda04a8cdbc41e5c50fc25768ab8b56.converted --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:00:20 user nova-compute[73449]: DEBUG os_brick.utils [None req-648d6106-b46a-40ca-b429-e5202eafb036 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 12:00:20 user nova-compute[73449]: DEBUG nova.compute.manager [req-bd82a2d5-4250-4843-8f9a-ef4dabb4f39c req-5f231270-272e-4b7b-a3f7-bc732161f88c service nova] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Received event network-changed-2ce1927a-6866-4362-bc0c-88cd0a19fa08 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:00:20 user nova-compute[73449]: DEBUG nova.compute.manager [req-bd82a2d5-4250-4843-8f9a-ef4dabb4f39c req-5f231270-272e-4b7b-a3f7-bc732161f88c service nova] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Refreshing instance network info cache due to event network-changed-2ce1927a-6866-4362-bc0c-88cd0a19fa08. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 12:00:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-bd82a2d5-4250-4843-8f9a-ef4dabb4f39c req-5f231270-272e-4b7b-a3f7-bc732161f88c service nova] Acquiring lock "refresh_cache-042713b8-ab7f-4c14-92e5-f830ccb7e341" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 12:00:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-bd82a2d5-4250-4843-8f9a-ef4dabb4f39c req-5f231270-272e-4b7b-a3f7-bc732161f88c service nova] Acquired lock "refresh_cache-042713b8-ab7f-4c14-92e5-f830ccb7e341" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 12:00:20 user nova-compute[73449]: DEBUG nova.network.neutron [req-bd82a2d5-4250-4843-8f9a-ef4dabb4f39c req-5f231270-272e-4b7b-a3f7-bc732161f88c service nova] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Refreshing network info cache for port 2ce1927a-6866-4362-bc0c-88cd0a19fa08 {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 12:00:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:00:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:00:20 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[5496e234-1272-4da8-973a-8f6e3a7c74f3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4d3924302012\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:00:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:00:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:00:20 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[82ddb300-ea35-492e-9a23-ca5f6cb36441]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:00:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:00:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:00:20 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[261ffe8e-6d01-4edb-90de-3a9823f7cb93]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:00:20 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa11bdf0-d3a8-405a-ab20-80d5fb251fc9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:00:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-648d6106-b46a-40ca-b429-e5202eafb036 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Running cmd (subprocess): nvme version {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:00:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-648d6106-b46a-40ca-b429-e5202eafb036 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] 'nvme version' failed. Not Retrying. {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 12:00:20 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.nvmeof [None req-648d6106-b46a-40ca-b429-e5202eafb036 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] nvme not present on system {{(pid=73449) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 12:00:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:00:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 12:00:20 user nova-compute[73449]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 12:00:20 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[673da76f-a39e-486a-9c4b-92efbb350d12]: (4, '') {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:00:20 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-648d6106-b46a-40ca-b429-e5202eafb036 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73449) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 12:00:20 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-648d6106-b46a-40ca-b429-e5202eafb036 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73449) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 12:00:20 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-648d6106-b46a-40ca-b429-e5202eafb036 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] LIGHTOS: no hostnqn found. {{(pid=73449) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 12:00:20 user nova-compute[73449]: DEBUG os_brick.utils [None req-648d6106-b46a-40ca-b429-e5202eafb036 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] <== get_connector_properties: return (167ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4d3924302012', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 12:00:20 user nova-compute[73449]: DEBUG nova.virt.block_device [None req-648d6106-b46a-40ca-b429-e5202eafb036 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] [instance: 5cacd9ed-27fb-431d-999e-31ff2464d14d] Updating existing volume attachment record: fa1751ea-034f-4b50-82d5-d7576862ba35 {{(pid=73449) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 12:00:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-ce86f3ba-9e9c-4e24-9a9f-f6bf8911535e tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7f0d4cd7fcda04a8cdbc41e5c50fc25768ab8b56.converted --force-share --output=json" returned: 0 in 0.235s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:00:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-ce86f3ba-9e9c-4e24-9a9f-f6bf8911535e tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Lock "7f0d4cd7fcda04a8cdbc41e5c50fc25768ab8b56" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.461s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:00:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-ce86f3ba-9e9c-4e24-9a9f-f6bf8911535e tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7f0d4cd7fcda04a8cdbc41e5c50fc25768ab8b56 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:00:21 user nova-compute[73449]: DEBUG nova.network.neutron [req-e6cb221d-2a30-470e-8fcf-b75a2d89a95e req-438012bc-87a2-4633-b988-03305d7ce828 service nova] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] Updated VIF entry in instance network info cache for port dbd5bb98-0410-4179-a99a-9181d85357ea. {{(pid=73449) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 12:00:21 user nova-compute[73449]: DEBUG nova.network.neutron [req-e6cb221d-2a30-470e-8fcf-b75a2d89a95e req-438012bc-87a2-4633-b988-03305d7ce828 service nova] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] Updating instance_info_cache with network_info: [{"id": "dbd5bb98-0410-4179-a99a-9181d85357ea", "address": "fa:16:3e:5d:b1:0e", "network": {"id": "d56bc428-6be6-4aa9-b43c-9d4a0f1dd83b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-791364634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe7b5fee01a042bb90e40b18a84c82c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbd5bb98-04", "ovs_interfaceid": "dbd5bb98-0410-4179-a99a-9181d85357ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 12:00:21 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-e6cb221d-2a30-470e-8fcf-b75a2d89a95e req-438012bc-87a2-4633-b988-03305d7ce828 service nova] Releasing lock "refresh_cache-4b7932d8-b781-4db7-a1c5-791ce8d1d866" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 12:00:21 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-ce86f3ba-9e9c-4e24-9a9f-f6bf8911535e tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7f0d4cd7fcda04a8cdbc41e5c50fc25768ab8b56 --force-share --output=json" returned: 0 in 0.238s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:00:21 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-ce86f3ba-9e9c-4e24-9a9f-f6bf8911535e tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Acquiring lock "7f0d4cd7fcda04a8cdbc41e5c50fc25768ab8b56" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:00:21 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-ce86f3ba-9e9c-4e24-9a9f-f6bf8911535e tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Lock "7f0d4cd7fcda04a8cdbc41e5c50fc25768ab8b56" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:00:21 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-ce86f3ba-9e9c-4e24-9a9f-f6bf8911535e tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7f0d4cd7fcda04a8cdbc41e5c50fc25768ab8b56 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:00:21 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-ce86f3ba-9e9c-4e24-9a9f-f6bf8911535e tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7f0d4cd7fcda04a8cdbc41e5c50fc25768ab8b56 --force-share --output=json" returned: 0 in 0.240s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:00:21 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-ce86f3ba-9e9c-4e24-9a9f-f6bf8911535e tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7f0d4cd7fcda04a8cdbc41e5c50fc25768ab8b56,backing_fmt=raw /opt/stack/data/nova/instances/4b7932d8-b781-4db7-a1c5-791ce8d1d866/disk 1073741824 {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:00:21 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-ce86f3ba-9e9c-4e24-9a9f-f6bf8911535e tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7f0d4cd7fcda04a8cdbc41e5c50fc25768ab8b56,backing_fmt=raw /opt/stack/data/nova/instances/4b7932d8-b781-4db7-a1c5-791ce8d1d866/disk 1073741824" returned: 0 in 0.075s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:00:21 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-ce86f3ba-9e9c-4e24-9a9f-f6bf8911535e tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Lock "7f0d4cd7fcda04a8cdbc41e5c50fc25768ab8b56" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.322s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:00:21 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-ce86f3ba-9e9c-4e24-9a9f-f6bf8911535e tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7f0d4cd7fcda04a8cdbc41e5c50fc25768ab8b56 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:00:21 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6fcd6f7a-aee2-4696-99db-246442b2e6ca tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Acquiring lock "042713b8-ab7f-4c14-92e5-f830ccb7e341" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:00:21 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6fcd6f7a-aee2-4696-99db-246442b2e6ca tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Lock "042713b8-ab7f-4c14-92e5-f830ccb7e341" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.004s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:00:21 user nova-compute[73449]: INFO nova.compute.manager [None req-6fcd6f7a-aee2-4696-99db-246442b2e6ca tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Detaching volume 6e360063-8525-4d62-8fa0-33c5062fc247
Aug 17 12:00:21 user nova-compute[73449]: DEBUG nova.network.neutron [req-bd82a2d5-4250-4843-8f9a-ef4dabb4f39c req-5f231270-272e-4b7b-a3f7-bc732161f88c service nova] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Updated VIF entry in instance network info cache for port 2ce1927a-6866-4362-bc0c-88cd0a19fa08. {{(pid=73449) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 12:00:21 user nova-compute[73449]: DEBUG nova.network.neutron [req-bd82a2d5-4250-4843-8f9a-ef4dabb4f39c req-5f231270-272e-4b7b-a3f7-bc732161f88c service nova] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Updating instance_info_cache with network_info: [{"id": "2ce1927a-6866-4362-bc0c-88cd0a19fa08", "address": "fa:16:3e:f5:89:a9", "network": {"id": "f7298070-baaa-4842-b3b2-d9fe1058d3b6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1715911399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8722edee53ed4a9188366c38f3b8b52f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ce1927a-68", "ovs_interfaceid": "2ce1927a-6866-4362-bc0c-88cd0a19fa08", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 12:00:21 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-bd82a2d5-4250-4843-8f9a-ef4dabb4f39c req-5f231270-272e-4b7b-a3f7-bc732161f88c service nova] Releasing lock "refresh_cache-042713b8-ab7f-4c14-92e5-f830ccb7e341" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 12:00:21 user nova-compute[73449]: INFO nova.virt.block_device [None req-6fcd6f7a-aee2-4696-99db-246442b2e6ca tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Attempting to driver detach volume 6e360063-8525-4d62-8fa0-33c5062fc247 from mountpoint /dev/vdb
Aug 17 12:00:21 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6fcd6f7a-aee2-4696-99db-246442b2e6ca tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Attempting to detach device vdb from instance 042713b8-ab7f-4c14-92e5-f830ccb7e341 from the persistent domain config. {{(pid=73449) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 12:00:21 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-6fcd6f7a-aee2-4696-99db-246442b2e6ca tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 12:00:21 user nova-compute[73449]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 12:00:21 user nova-compute[73449]:   <source dev="/dev/sdb"/>
Aug 17 12:00:21 user nova-compute[73449]:   <target dev="vdb" bus="virtio"/>
Aug 17 12:00:21 user nova-compute[73449]:   <serial>6e360063-8525-4d62-8fa0-33c5062fc247</serial>
Aug 17 12:00:21 user nova-compute[73449]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 12:00:21 user nova-compute[73449]: </disk>
Aug 17 12:00:21 user nova-compute[73449]:  {{(pid=73449) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 12:00:21 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-6fcd6f7a-aee2-4696-99db-246442b2e6ca tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Successfully detached device vdb from instance 042713b8-ab7f-4c14-92e5-f830ccb7e341 from the persistent domain config.
Aug 17 12:00:21 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6fcd6f7a-aee2-4696-99db-246442b2e6ca tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 042713b8-ab7f-4c14-92e5-f830ccb7e341 from the live domain config. {{(pid=73449) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 12:00:21 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-6fcd6f7a-aee2-4696-99db-246442b2e6ca tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 12:00:21 user nova-compute[73449]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 12:00:21 user nova-compute[73449]:   <source dev="/dev/sdb"/>
Aug 17 12:00:21 user nova-compute[73449]:   <target dev="vdb" bus="virtio"/>
Aug 17 12:00:21 user nova-compute[73449]:   <serial>6e360063-8525-4d62-8fa0-33c5062fc247</serial>
Aug 17 12:00:21 user nova-compute[73449]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 12:00:21 user nova-compute[73449]: </disk>
Aug 17 12:00:21 user nova-compute[73449]:  {{(pid=73449) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 12:00:21 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-ce86f3ba-9e9c-4e24-9a9f-f6bf8911535e tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7f0d4cd7fcda04a8cdbc41e5c50fc25768ab8b56 --force-share --output=json" returned: 0 in 0.240s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:00:21 user nova-compute[73449]: DEBUG nova.objects.instance [None req-ce86f3ba-9e9c-4e24-9a9f-f6bf8911535e tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Lazy-loading 'migration_context' on Instance uuid 4b7932d8-b781-4db7-a1c5-791ce8d1d866 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:00:21 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-ce86f3ba-9e9c-4e24-9a9f-f6bf8911535e tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] Rebasing disk image.
Aug 17 12:00:21 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-ce86f3ba-9e9c-4e24-9a9f-f6bf8911535e tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:00:22 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-ce86f3ba-9e9c-4e24-9a9f-f6bf8911535e tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json" returned: 0 in 0.215s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:00:22 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-ce86f3ba-9e9c-4e24-9a9f-f6bf8911535e tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 -F raw /opt/stack/data/nova/instances/4b7932d8-b781-4db7-a1c5-791ce8d1d866/disk {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:00:22 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Received event <DeviceRemovedEvent: 1692273622.2572439, 042713b8-ab7f-4c14-92e5-f830ccb7e341 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73449) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 12:00:22 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6fcd6f7a-aee2-4696-99db-246442b2e6ca tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 042713b8-ab7f-4c14-92e5-f830ccb7e341 {{(pid=73449) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 12:00:22 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-6fcd6f7a-aee2-4696-99db-246442b2e6ca tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Successfully detached device vdb from instance 042713b8-ab7f-4c14-92e5-f830ccb7e341 from the live domain config.
Aug 17 12:00:22 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6fcd6f7a-aee2-4696-99db-246442b2e6ca tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] calling os-brick to detach iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 12:00:22 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fcd6f7a-aee2-4696-99db-246442b2e6ca tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, {'target_iqns': ['iqn.2010-10.org.openstack:6e360063-8525-4d62-8fa0-33c5062fc247'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rosCbiyz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 12:00:22 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-6fcd6f7a-aee2-4696-99db-246442b2e6ca tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 12:00:22 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-6fcd6f7a-aee2-4696-99db-246442b2e6ca tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 12:00:22 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-6fcd6f7a-aee2-4696-99db-246442b2e6ca tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 12:00:22 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fcd6f7a-aee2-4696-99db-246442b2e6ca tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e360063-8525-4d62-8fa0-33c5062fc247', 0)] {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 12:00:22 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:00:22 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:00:22 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[573f25fa-5edf-49f7-9e48-2328e854d925]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e360063-8525-4d62-8fa0-33c5062fc247\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82f5400e-2a45-428e-85b9-b052a993285a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f1f60817-d9b2-4269-a40d-69f0312e0cea\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:00:22 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:00:22 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:00:22 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1e8be17-bfec-40fb-ba99-9e50f3218873]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e360063-8525-4d62-8fa0-33c5062fc247 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1f60817-d9b2-4269-a40d-69f0312e0cea (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82f5400e-2a45-428e-85b9-b052a993285a (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:00:22 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fcd6f7a-aee2-4696-99db-246442b2e6ca tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)
Aug 17 12:00:22 user nova-compute[73449]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e360063-8525-4d62-8fa0-33c5062fc247 (non-flash)
Aug 17 12:00:22 user nova-compute[73449]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7 (non-flash)
Aug 17 12:00:22 user nova-compute[73449]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1f60817-d9b2-4269-a40d-69f0312e0cea (non-flash)
Aug 17 12:00:22 user nova-compute[73449]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82f5400e-2a45-428e-85b9-b052a993285a (non-flash)
Aug 17 12:00:22 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 12:00:22 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fcd6f7a-aee2-4696-99db-246442b2e6ca tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)
Aug 17 12:00:22 user nova-compute[73449]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e360063-8525-4d62-8fa0-33c5062fc247 (non-flash)
Aug 17 12:00:22 user nova-compute[73449]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7 (non-flash)
Aug 17 12:00:22 user nova-compute[73449]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1f60817-d9b2-4269-a40d-69f0312e0cea (non-flash)
Aug 17 12:00:22 user nova-compute[73449]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82f5400e-2a45-428e-85b9-b052a993285a (non-flash)
Aug 17 12:00:22 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 12:00:22 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fcd6f7a-aee2-4696-99db-246442b2e6ca tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe7582c16c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e360063-8525-4d62-8fa0-33c5062fc247'): ({'sdb'}, set())}) {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 12:00:22 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-6fcd6f7a-aee2-4696-99db-246442b2e6ca tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Removing single pathed devices sdb {{(pid=73449) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 12:00:22 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:00:22 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.030s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:00:22 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[199bc626-d810-47af-b6e0-f2303bc87835]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:00:22 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:00:22 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:00:22 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bd56b33-0372-4c08-862a-8e580fd32da2]: (4, ('ok\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:00:22 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-6fcd6f7a-aee2-4696-99db-246442b2e6ca tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Flushing IO for device /dev/sdb {{(pid=73449) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 12:00:22 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:00:22 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.021s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:00:22 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b3e4a81-ff72-4644-9ea5-06e53e473470]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:00:22 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-6fcd6f7a-aee2-4696-99db-246442b2e6ca tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73449) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 12:00:22 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:00:22 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.060s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:00:22 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c2f5501-0be6-41e3-a99d-f7375f33a9af]: (4, ('1', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:00:22 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-6fcd6f7a-aee2-4696-99db-246442b2e6ca tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73449) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 12:00:22 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-6fcd6f7a-aee2-4696-99db-246442b2e6ca tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] SCSI volumes sdb have been removed. {{(pid=73449) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 12:00:22 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fcd6f7a-aee2-4696-99db-246442b2e6ca tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e360063-8525-4d62-8fa0-33c5062fc247')] {{(pid=73449) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 12:00:22 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e360063-8525-4d62-8fa0-33c5062fc247 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:00:22 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e360063-8525-4d62-8fa0-33c5062fc247 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:00:22 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[38ca3bee-6ebf-4e23-a7a6-2ae55789dfa7]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:00:22 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fcd6f7a-aee2-4696-99db-246442b2e6ca tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:00:22 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e360063-8525-4d62-8fa0-33c5062fc247 -p 172.16.0.220:3260 --logout {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:00:22 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e360063-8525-4d62-8fa0-33c5062fc247 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:00:22 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[31457809-45c7-41a2-ab0e-458debdae74e]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:6e360063-8525-4d62-8fa0-33c5062fc247, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:6e360063-8525-4d62-8fa0-33c5062fc247, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:00:22 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fcd6f7a-aee2-4696-99db-246442b2e6ca tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:6e360063-8525-4d62-8fa0-33c5062fc247, portal: 172.16.0.220,3260]
Aug 17 12:00:22 user nova-compute[73449]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:6e360063-8525-4d62-8fa0-33c5062fc247, portal: 172.16.0.220,3260] successful.
Aug 17 12:00:22 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:00:22 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e360063-8525-4d62-8fa0-33c5062fc247 -p 172.16.0.220:3260 --op delete {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:00:22 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e360063-8525-4d62-8fa0-33c5062fc247 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:00:22 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[be14f5b6-512b-4337-b935-24ac16452157]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:00:22 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fcd6f7a-aee2-4696-99db-246442b2e6ca tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:00:22 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-6fcd6f7a-aee2-4696-99db-246442b2e6ca tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.358s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 12:00:22 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fcd6f7a-aee2-4696-99db-246442b2e6ca tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] <== disconnect_volume: return (360ms) None {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 12:00:22 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6fcd6f7a-aee2-4696-99db-246442b2e6ca tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Disconnected iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 12:00:22 user nova-compute[73449]: DEBUG nova.compute.manager [req-fac6fa23-e2b2-4c56-90a4-69aa24026072 req-d07b9ef6-052c-43f7-9b41-87aa934f0ff7 service nova] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Received event network-changed-2ce1927a-6866-4362-bc0c-88cd0a19fa08 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:00:22 user nova-compute[73449]: DEBUG nova.compute.manager [req-fac6fa23-e2b2-4c56-90a4-69aa24026072 req-d07b9ef6-052c-43f7-9b41-87aa934f0ff7 service nova] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Refreshing instance network info cache due to event network-changed-2ce1927a-6866-4362-bc0c-88cd0a19fa08. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 12:00:22 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-fac6fa23-e2b2-4c56-90a4-69aa24026072 req-d07b9ef6-052c-43f7-9b41-87aa934f0ff7 service nova] Acquiring lock "refresh_cache-042713b8-ab7f-4c14-92e5-f830ccb7e341" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 12:00:22 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-fac6fa23-e2b2-4c56-90a4-69aa24026072 req-d07b9ef6-052c-43f7-9b41-87aa934f0ff7 service nova] Acquired lock "refresh_cache-042713b8-ab7f-4c14-92e5-f830ccb7e341" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 12:00:22 user nova-compute[73449]: DEBUG nova.network.neutron [req-fac6fa23-e2b2-4c56-90a4-69aa24026072 req-d07b9ef6-052c-43f7-9b41-87aa934f0ff7 service nova] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Refreshing network info cache for port 2ce1927a-6866-4362-bc0c-88cd0a19fa08 {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 12:00:23 user nova-compute[73449]: DEBUG nova.network.neutron [req-fac6fa23-e2b2-4c56-90a4-69aa24026072 req-d07b9ef6-052c-43f7-9b41-87aa934f0ff7 service nova] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Updated VIF entry in instance network info cache for port 2ce1927a-6866-4362-bc0c-88cd0a19fa08. {{(pid=73449) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 12:00:23 user nova-compute[73449]: DEBUG nova.network.neutron [req-fac6fa23-e2b2-4c56-90a4-69aa24026072 req-d07b9ef6-052c-43f7-9b41-87aa934f0ff7 service nova] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Updating instance_info_cache with network_info: [{"id": "2ce1927a-6866-4362-bc0c-88cd0a19fa08", "address": "fa:16:3e:f5:89:a9", "network": {"id": "f7298070-baaa-4842-b3b2-d9fe1058d3b6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1715911399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8722edee53ed4a9188366c38f3b8b52f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ce1927a-68", "ovs_interfaceid": "2ce1927a-6866-4362-bc0c-88cd0a19fa08", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 12:00:23 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-fac6fa23-e2b2-4c56-90a4-69aa24026072 req-d07b9ef6-052c-43f7-9b41-87aa934f0ff7 service nova] Releasing lock "refresh_cache-042713b8-ab7f-4c14-92e5-f830ccb7e341" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 12:00:23 user nova-compute[73449]: DEBUG nova.objects.instance [None req-6fcd6f7a-aee2-4696-99db-246442b2e6ca tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Lazy-loading 'flavor' on Instance uuid 042713b8-ab7f-4c14-92e5-f830ccb7e341 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:00:23 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:00:23 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6fcd6f7a-aee2-4696-99db-246442b2e6ca tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Lock "042713b8-ab7f-4c14-92e5-f830ccb7e341" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.086s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:00:24 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-ce86f3ba-9e9c-4e24-9a9f-f6bf8911535e tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 -F raw /opt/stack/data/nova/instances/4b7932d8-b781-4db7-a1c5-791ce8d1d866/disk" returned: 0 in 2.738s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:00:24 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-ce86f3ba-9e9c-4e24-9a9f-f6bf8911535e tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] Created local disks {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 12:00:24 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-ce86f3ba-9e9c-4e24-9a9f-f6bf8911535e tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] Ensure instance console log exists: /opt/stack/data/nova/instances/4b7932d8-b781-4db7-a1c5-791ce8d1d866/console.log {{(pid=73449) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 12:00:24 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-ce86f3ba-9e9c-4e24-9a9f-f6bf8911535e tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:00:24 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-ce86f3ba-9e9c-4e24-9a9f-f6bf8911535e tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:00:24 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-ce86f3ba-9e9c-4e24-9a9f-f6bf8911535e tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:00:24 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-ce86f3ba-9e9c-4e24-9a9f-f6bf8911535e tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] Start _get_guest_xml network_info=[{"id": "dbd5bb98-0410-4179-a99a-9181d85357ea", "address": "fa:16:3e:5d:b1:0e", "network": {"id": "d56bc428-6be6-4aa9-b43c-9d4a0f1dd83b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-791364634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe7b5fee01a042bb90e40b18a84c82c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbd5bb98-04", "ovs_interfaceid": "dbd5bb98-0410-4179-a99a-9181d85357ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b68cc2d603dc52ea03d06931d148de6d',container_format='bare',created_at=2023-08-17T11:58:22Z,direct_url=<?>,disk_format='qcow2',id=2f4eef75-499c-4765-a06a-d236c7e48995,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-446672586-shelved',owner='fe7b5fee01a042bb90e40b18a84c82c0',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-17T11:58:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': '0a2904ae-083d-41c8-83db-343132b36148'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 12:00:24 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-ce86f3ba-9e9c-4e24-9a9f-f6bf8911535e tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 12:00:24 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-ce86f3ba-9e9c-4e24-9a9f-f6bf8911535e tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 12:00:24 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-ce86f3ba-9e9c-4e24-9a9f-f6bf8911535e tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 12:00:24 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-ce86f3ba-9e9c-4e24-9a9f-f6bf8911535e tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] CPU controller missing on host. {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 12:00:24 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-ce86f3ba-9e9c-4e24-9a9f-f6bf8911535e tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 12:00:24 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-ce86f3ba-9e9c-4e24-9a9f-f6bf8911535e tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] CPU controller found on host. {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 12:00:24 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-ce86f3ba-9e9c-4e24-9a9f-f6bf8911535e tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73449) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 12:00:24 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-ce86f3ba-9e9c-4e24-9a9f-f6bf8911535e tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T11:35:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b68cc2d603dc52ea03d06931d148de6d',container_format='bare',created_at=2023-08-17T11:58:22Z,direct_url=<?>,disk_format='qcow2',id=2f4eef75-499c-4765-a06a-d236c7e48995,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-446672586-shelved',owner='fe7b5fee01a042bb90e40b18a84c82c0',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-17T11:58:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 12:00:24 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-ce86f3ba-9e9c-4e24-9a9f-f6bf8911535e tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Flavor limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 12:00:24 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-ce86f3ba-9e9c-4e24-9a9f-f6bf8911535e tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Image limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 12:00:24 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-ce86f3ba-9e9c-4e24-9a9f-f6bf8911535e tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Flavor pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 12:00:24 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-ce86f3ba-9e9c-4e24-9a9f-f6bf8911535e tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Image pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 12:00:24 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-ce86f3ba-9e9c-4e24-9a9f-f6bf8911535e tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 12:00:24 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-ce86f3ba-9e9c-4e24-9a9f-f6bf8911535e tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 12:00:24 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-ce86f3ba-9e9c-4e24-9a9f-f6bf8911535e tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 12:00:24 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-ce86f3ba-9e9c-4e24-9a9f-f6bf8911535e tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Got 1 possible topologies {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 12:00:24 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-ce86f3ba-9e9c-4e24-9a9f-f6bf8911535e tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 12:00:24 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-ce86f3ba-9e9c-4e24-9a9f-f6bf8911535e tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 12:00:24 user nova-compute[73449]: DEBUG nova.objects.instance [None req-ce86f3ba-9e9c-4e24-9a9f-f6bf8911535e tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4b7932d8-b781-4db7-a1c5-791ce8d1d866 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:00:24 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-ce86f3ba-9e9c-4e24-9a9f-f6bf8911535e tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T11:56:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-446672586',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-446672586',id=36,image_ref='2f4eef75-499c-4765-a06a-d236c7e48995',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-279437617',keypairs=<?>,launch_index=0,launched_at=2023-08-17T11:56:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='fe7b5fee01a042bb90e40b18a84c82c0',ramdisk_id='',reservation_id='r-ehpbpdxe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2080997856',owner_user_name='tempest-AttachVolumeShelveTestJSON-2080997856-project-member',shelved_at='2023-08-17T11:58:27.807852',shelved_host='user',shelved_image_id='2f4eef75-499c-4765-a06a-d236c7e48995'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T12:00:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='17ee7be9cdb14c5ca211a6b0bb80ccc1',uuid=4b7932d8-b781-4db7-a1c5-791ce8d1d866,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "dbd5bb98-0410-4179-a99a-9181d85357ea", "address": "fa:16:3e:5d:b1:0e", "network": {"id": "d56bc428-6be6-4aa9-b43c-9d4a0f1dd83b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-791364634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe7b5fee01a042bb90e40b18a84c82c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbd5bb98-04", "ovs_interfaceid": "dbd5bb98-0410-4179-a99a-9181d85357ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73449) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 12:00:24 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-ce86f3ba-9e9c-4e24-9a9f-f6bf8911535e tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Converting VIF {"id": "dbd5bb98-0410-4179-a99a-9181d85357ea", "address": "fa:16:3e:5d:b1:0e", "network": {"id": "d56bc428-6be6-4aa9-b43c-9d4a0f1dd83b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-791364634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe7b5fee01a042bb90e40b18a84c82c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbd5bb98-04", "ovs_interfaceid": "dbd5bb98-0410-4179-a99a-9181d85357ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 12:00:24 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-ce86f3ba-9e9c-4e24-9a9f-f6bf8911535e tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:b1:0e,bridge_name='br-int',has_traffic_filtering=True,id=dbd5bb98-0410-4179-a99a-9181d85357ea,network=Network(d56bc428-6be6-4aa9-b43c-9d4a0f1dd83b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbd5bb98-04') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 12:00:24 user nova-compute[73449]: DEBUG nova.objects.instance [None req-ce86f3ba-9e9c-4e24-9a9f-f6bf8911535e tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Lazy-loading 'pci_devices' on Instance uuid 4b7932d8-b781-4db7-a1c5-791ce8d1d866 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:00:24 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:00:24 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-ce86f3ba-9e9c-4e24-9a9f-f6bf8911535e tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] End _get_guest_xml xml=<domain type="kvm">
Aug 17 12:00:24 user nova-compute[73449]:   <uuid>4b7932d8-b781-4db7-a1c5-791ce8d1d866</uuid>
Aug 17 12:00:24 user nova-compute[73449]:   <name>instance-00000024</name>
Aug 17 12:00:24 user nova-compute[73449]:   <memory>524288</memory>
Aug 17 12:00:24 user nova-compute[73449]:   <vcpu>1</vcpu>
Aug 17 12:00:24 user nova-compute[73449]:   <metadata>
Aug 17 12:00:24 user nova-compute[73449]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 12:00:24 user nova-compute[73449]:       <nova:package version="0.0.0"/>
Aug 17 12:00:24 user nova-compute[73449]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-446672586</nova:name>
Aug 17 12:00:24 user nova-compute[73449]:       <nova:creationTime>2023-08-17 12:00:24</nova:creationTime>
Aug 17 12:00:24 user nova-compute[73449]:       <nova:flavor name="m1.tiny">
Aug 17 12:00:24 user nova-compute[73449]:         <nova:memory>512</nova:memory>
Aug 17 12:00:24 user nova-compute[73449]:         <nova:disk>1</nova:disk>
Aug 17 12:00:24 user nova-compute[73449]:         <nova:swap>0</nova:swap>
Aug 17 12:00:24 user nova-compute[73449]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 12:00:24 user nova-compute[73449]:         <nova:vcpus>1</nova:vcpus>
Aug 17 12:00:24 user nova-compute[73449]:       </nova:flavor>
Aug 17 12:00:24 user nova-compute[73449]:       <nova:owner>
Aug 17 12:00:24 user nova-compute[73449]:         <nova:user uuid="17ee7be9cdb14c5ca211a6b0bb80ccc1">tempest-AttachVolumeShelveTestJSON-2080997856-project-member</nova:user>
Aug 17 12:00:24 user nova-compute[73449]:         <nova:project uuid="fe7b5fee01a042bb90e40b18a84c82c0">tempest-AttachVolumeShelveTestJSON-2080997856</nova:project>
Aug 17 12:00:24 user nova-compute[73449]:       </nova:owner>
Aug 17 12:00:24 user nova-compute[73449]:       <nova:root type="image" uuid="2f4eef75-499c-4765-a06a-d236c7e48995"/>
Aug 17 12:00:24 user nova-compute[73449]:       <nova:ports>
Aug 17 12:00:24 user nova-compute[73449]:         <nova:port uuid="dbd5bb98-0410-4179-a99a-9181d85357ea">
Aug 17 12:00:24 user nova-compute[73449]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 17 12:00:24 user nova-compute[73449]:         </nova:port>
Aug 17 12:00:24 user nova-compute[73449]:       </nova:ports>
Aug 17 12:00:24 user nova-compute[73449]:     </nova:instance>
Aug 17 12:00:24 user nova-compute[73449]:   </metadata>
Aug 17 12:00:24 user nova-compute[73449]:   <sysinfo type="smbios">
Aug 17 12:00:24 user nova-compute[73449]:     <system>
Aug 17 12:00:24 user nova-compute[73449]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 12:00:24 user nova-compute[73449]:       <entry name="product">OpenStack Nova</entry>
Aug 17 12:00:24 user nova-compute[73449]:       <entry name="version">0.0.0</entry>
Aug 17 12:00:24 user nova-compute[73449]:       <entry name="serial">4b7932d8-b781-4db7-a1c5-791ce8d1d866</entry>
Aug 17 12:00:24 user nova-compute[73449]:       <entry name="uuid">4b7932d8-b781-4db7-a1c5-791ce8d1d866</entry>
Aug 17 12:00:24 user nova-compute[73449]:       <entry name="family">Virtual Machine</entry>
Aug 17 12:00:24 user nova-compute[73449]:     </system>
Aug 17 12:00:24 user nova-compute[73449]:   </sysinfo>
Aug 17 12:00:24 user nova-compute[73449]:   <os>
Aug 17 12:00:24 user nova-compute[73449]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 12:00:24 user nova-compute[73449]:     <boot dev="hd"/>
Aug 17 12:00:24 user nova-compute[73449]:     <smbios mode="sysinfo"/>
Aug 17 12:00:24 user nova-compute[73449]:   </os>
Aug 17 12:00:24 user nova-compute[73449]:   <features>
Aug 17 12:00:24 user nova-compute[73449]:     <acpi/>
Aug 17 12:00:24 user nova-compute[73449]:     <apic/>
Aug 17 12:00:24 user nova-compute[73449]:     <vmcoreinfo/>
Aug 17 12:00:24 user nova-compute[73449]:   </features>
Aug 17 12:00:24 user nova-compute[73449]:   <clock offset="utc">
Aug 17 12:00:24 user nova-compute[73449]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 12:00:24 user nova-compute[73449]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 12:00:24 user nova-compute[73449]:     <timer name="hpet" present="no"/>
Aug 17 12:00:24 user nova-compute[73449]:   </clock>
Aug 17 12:00:24 user nova-compute[73449]:   <cpu mode="custom" match="exact">
Aug 17 12:00:24 user nova-compute[73449]:     <model>Nehalem</model>
Aug 17 12:00:24 user nova-compute[73449]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 12:00:24 user nova-compute[73449]:   </cpu>
Aug 17 12:00:24 user nova-compute[73449]:   <devices>
Aug 17 12:00:24 user nova-compute[73449]:     <disk type="file" device="disk">
Aug 17 12:00:24 user nova-compute[73449]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 12:00:24 user nova-compute[73449]:       <source file="/opt/stack/data/nova/instances/4b7932d8-b781-4db7-a1c5-791ce8d1d866/disk"/>
Aug 17 12:00:24 user nova-compute[73449]:       <target dev="vda" bus="virtio"/>
Aug 17 12:00:24 user nova-compute[73449]:     </disk>
Aug 17 12:00:24 user nova-compute[73449]:     <interface type="ethernet">
Aug 17 12:00:24 user nova-compute[73449]:       <mac address="fa:16:3e:5d:b1:0e"/>
Aug 17 12:00:24 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 12:00:24 user nova-compute[73449]:       <mtu size="1442"/>
Aug 17 12:00:24 user nova-compute[73449]:       <target dev="tapdbd5bb98-04"/>
Aug 17 12:00:24 user nova-compute[73449]:     </interface>
Aug 17 12:00:24 user nova-compute[73449]:     <serial type="pty">
Aug 17 12:00:24 user nova-compute[73449]:       <log file="/opt/stack/data/nova/instances/4b7932d8-b781-4db7-a1c5-791ce8d1d866/console.log" append="off"/>
Aug 17 12:00:24 user nova-compute[73449]:     </serial>
Aug 17 12:00:24 user nova-compute[73449]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 12:00:24 user nova-compute[73449]:     <video>
Aug 17 12:00:24 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 12:00:24 user nova-compute[73449]:     </video>
Aug 17 12:00:24 user nova-compute[73449]:     <rng model="virtio">
Aug 17 12:00:24 user nova-compute[73449]:       <backend model="random">/dev/urandom</backend>
Aug 17 12:00:24 user nova-compute[73449]:     </rng>
Aug 17 12:00:24 user nova-compute[73449]:     <controller type="usb" index="0" model="none"/>
Aug 17 12:00:24 user nova-compute[73449]:     <memballoon model="virtio">
Aug 17 12:00:24 user nova-compute[73449]:       <stats period="10"/>
Aug 17 12:00:24 user nova-compute[73449]:     </memballoon>
Aug 17 12:00:24 user nova-compute[73449]:   </devices>
Aug 17 12:00:24 user nova-compute[73449]: </domain>
Aug 17 12:00:24 user nova-compute[73449]:  {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 12:00:24 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-ce86f3ba-9e9c-4e24-9a9f-f6bf8911535e tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T11:56:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-446672586',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-446672586',id=36,image_ref='2f4eef75-499c-4765-a06a-d236c7e48995',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-279437617',keypairs=<?>,launch_index=0,launched_at=2023-08-17T11:56:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='fe7b5fee01a042bb90e40b18a84c82c0',ramdisk_id='',reservation_id='r-ehpbpdxe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2080997856',owner_user_name='tempest-AttachVolumeShelveTestJSON-2080997856-project-member',shelved_at='2023-08-17T11:58:27.807852',shelved_host='user',shelved_image_id='2f4eef75-499c-4765-a06a-d236c7e48995'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T12:00:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='17ee7be9cdb14c5ca211a6b0bb80ccc1',uuid=4b7932d8-b781-4db7-a1c5-791ce8d1d866,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "dbd5bb98-0410-4179-a99a-9181d85357ea", "address": "fa:16:3e:5d:b1:0e", "network": {"id": "d56bc428-6be6-4aa9-b43c-9d4a0f1dd83b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-791364634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe7b5fee01a042bb90e40b18a84c82c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbd5bb98-04", "ovs_interfaceid": "dbd5bb98-0410-4179-a99a-9181d85357ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 12:00:24 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-ce86f3ba-9e9c-4e24-9a9f-f6bf8911535e tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Converting VIF {"id": "dbd5bb98-0410-4179-a99a-9181d85357ea", "address": "fa:16:3e:5d:b1:0e", "network": {"id": "d56bc428-6be6-4aa9-b43c-9d4a0f1dd83b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-791364634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe7b5fee01a042bb90e40b18a84c82c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbd5bb98-04", "ovs_interfaceid": "dbd5bb98-0410-4179-a99a-9181d85357ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 12:00:24 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-ce86f3ba-9e9c-4e24-9a9f-f6bf8911535e tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:b1:0e,bridge_name='br-int',has_traffic_filtering=True,id=dbd5bb98-0410-4179-a99a-9181d85357ea,network=Network(d56bc428-6be6-4aa9-b43c-9d4a0f1dd83b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbd5bb98-04') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 12:00:24 user nova-compute[73449]: DEBUG os_vif [None req-ce86f3ba-9e9c-4e24-9a9f-f6bf8911535e tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:b1:0e,bridge_name='br-int',has_traffic_filtering=True,id=dbd5bb98-0410-4179-a99a-9181d85357ea,network=Network(d56bc428-6be6-4aa9-b43c-9d4a0f1dd83b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbd5bb98-04') {{(pid=73449) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 12:00:24 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:00:24 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 12:00:24 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 12:00:24 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:00:24 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdbd5bb98-04, may_exist=True, interface_attrs={}) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 12:00:24 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdbd5bb98-04, col_values=(('external_ids', {'iface-id': 'dbd5bb98-0410-4179-a99a-9181d85357ea', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5d:b1:0e', 'vm-uuid': '4b7932d8-b781-4db7-a1c5-791ce8d1d866'}),), if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 12:00:24 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:00:24 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:00:24 user nova-compute[73449]: INFO os_vif [None req-ce86f3ba-9e9c-4e24-9a9f-f6bf8911535e tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:b1:0e,bridge_name='br-int',has_traffic_filtering=True,id=dbd5bb98-0410-4179-a99a-9181d85357ea,network=Network(d56bc428-6be6-4aa9-b43c-9d4a0f1dd83b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbd5bb98-04')
Aug 17 12:00:24 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-ce86f3ba-9e9c-4e24-9a9f-f6bf8911535e tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] No BDM found with device name vda, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 12:00:24 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-ce86f3ba-9e9c-4e24-9a9f-f6bf8911535e tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] No VIF found with MAC fa:16:3e:5d:b1:0e, not building metadata {{(pid=73449) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 12:00:26 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:00:26 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:00:26 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:00:26 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:00:26 user nova-compute[73449]: DEBUG nova.compute.manager [req-d72500de-3360-426f-b041-d828528635f5 req-a4e8c1ab-5437-4ee2-a911-8679a634e5f5 service nova] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] Received event network-vif-plugged-dbd5bb98-0410-4179-a99a-9181d85357ea {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:00:26 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-d72500de-3360-426f-b041-d828528635f5 req-a4e8c1ab-5437-4ee2-a911-8679a634e5f5 service nova] Acquiring lock "4b7932d8-b781-4db7-a1c5-791ce8d1d866-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:00:26 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-d72500de-3360-426f-b041-d828528635f5 req-a4e8c1ab-5437-4ee2-a911-8679a634e5f5 service nova] Lock "4b7932d8-b781-4db7-a1c5-791ce8d1d866-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:00:26 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-d72500de-3360-426f-b041-d828528635f5 req-a4e8c1ab-5437-4ee2-a911-8679a634e5f5 service nova] Lock "4b7932d8-b781-4db7-a1c5-791ce8d1d866-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:00:26 user nova-compute[73449]: DEBUG nova.compute.manager [req-d72500de-3360-426f-b041-d828528635f5 req-a4e8c1ab-5437-4ee2-a911-8679a634e5f5 service nova] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] No waiting events found dispatching network-vif-plugged-dbd5bb98-0410-4179-a99a-9181d85357ea {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 12:00:26 user nova-compute[73449]: WARNING nova.compute.manager [req-d72500de-3360-426f-b041-d828528635f5 req-a4e8c1ab-5437-4ee2-a911-8679a634e5f5 service nova] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] Received unexpected event network-vif-plugged-dbd5bb98-0410-4179-a99a-9181d85357ea for instance with vm_state shelved_offloaded and task_state spawning.
Aug 17 12:00:27 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:00:27 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:00:27 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:00:27 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:00:28 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:00:28 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:00:28 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692273628.80413, 4b7932d8-b781-4db7-a1c5-791ce8d1d866 => Resumed> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 12:00:28 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] VM Resumed (Lifecycle Event)
Aug 17 12:00:28 user nova-compute[73449]: DEBUG nova.compute.manager [None req-ce86f3ba-9e9c-4e24-9a9f-f6bf8911535e tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] Instance event wait completed in 0 seconds for  {{(pid=73449) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 12:00:28 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-ce86f3ba-9e9c-4e24-9a9f-f6bf8911535e tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] Guest created on hypervisor {{(pid=73449) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 12:00:28 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] Instance spawned successfully.
Aug 17 12:00:28 user nova-compute[73449]: DEBUG nova.compute.manager [req-cac79c42-32e8-49af-b0f4-d6495351853d req-12b2357d-d12f-450f-9654-ed4163df8c68 service nova] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] Received event network-vif-plugged-dbd5bb98-0410-4179-a99a-9181d85357ea {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:00:28 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-cac79c42-32e8-49af-b0f4-d6495351853d req-12b2357d-d12f-450f-9654-ed4163df8c68 service nova] Acquiring lock "4b7932d8-b781-4db7-a1c5-791ce8d1d866-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:00:28 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-cac79c42-32e8-49af-b0f4-d6495351853d req-12b2357d-d12f-450f-9654-ed4163df8c68 service nova] Lock "4b7932d8-b781-4db7-a1c5-791ce8d1d866-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:00:28 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-cac79c42-32e8-49af-b0f4-d6495351853d req-12b2357d-d12f-450f-9654-ed4163df8c68 service nova] Lock "4b7932d8-b781-4db7-a1c5-791ce8d1d866-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:00:28 user nova-compute[73449]: DEBUG nova.compute.manager [req-cac79c42-32e8-49af-b0f4-d6495351853d req-12b2357d-d12f-450f-9654-ed4163df8c68 service nova] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] No waiting events found dispatching network-vif-plugged-dbd5bb98-0410-4179-a99a-9181d85357ea {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 12:00:28 user nova-compute[73449]: WARNING nova.compute.manager [req-cac79c42-32e8-49af-b0f4-d6495351853d req-12b2357d-d12f-450f-9654-ed4163df8c68 service nova] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] Received unexpected event network-vif-plugged-dbd5bb98-0410-4179-a99a-9181d85357ea for instance with vm_state shelved_offloaded and task_state spawning.
Aug 17 12:00:28 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 12:00:28 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 12:00:28 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 12:00:28 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692273628.80543, 4b7932d8-b781-4db7-a1c5-791ce8d1d866 => Started> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 12:00:28 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] VM Started (Lifecycle Event)
Aug 17 12:00:28 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 12:00:28 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 12:00:29 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 12:00:29 user nova-compute[73449]: DEBUG nova.compute.manager [None req-ce86f3ba-9e9c-4e24-9a9f-f6bf8911535e tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 12:00:29 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-ce86f3ba-9e9c-4e24-9a9f-f6bf8911535e tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Lock "4b7932d8-b781-4db7-a1c5-791ce8d1d866" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 13.432s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:00:29 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:00:31 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:00:33 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-648d6106-b46a-40ca-b429-e5202eafb036 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] [instance: 5cacd9ed-27fb-431d-999e-31ff2464d14d] Calling os-brick to attach iSCSI Volume {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 12:00:33 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-648d6106-b46a-40ca-b429-e5202eafb036 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ec9ca502-d8fe-42e6-8ed0-db01b1e836fe'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qLoVOIGD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 12:00:33 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-648d6106-b46a-40ca-b429-e5202eafb036 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 12:00:33 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-648d6106-b46a-40ca-b429-e5202eafb036 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 12:00:33 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-648d6106-b46a-40ca-b429-e5202eafb036 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 12:00:33 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-648d6106-b46a-40ca-b429-e5202eafb036 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 12:00:33 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-648d6106-b46a-40ca-b429-e5202eafb036 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ec9ca502-d8fe-42e6-8ed0-db01b1e836fe" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 12:00:33 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-648d6106-b46a-40ca-b429-e5202eafb036 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ec9ca502-d8fe-42e6-8ed0-db01b1e836fe" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 12:00:33 user nova-compute[73449]: INFO os_brick.initiator.connectors.iscsi [None req-648d6106-b46a-40ca-b429-e5202eafb036 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 12:00:33 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec9ca502-d8fe-42e6-8ed0-db01b1e836fe -p 172.16.0.220:3260 {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:00:33 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:00:33 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec9ca502-d8fe-42e6-8ed0-db01b1e836fe -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:00:33 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bf3b024-cd6e-4fc4-9307-06c6edbbff5c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:00:33 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-648d6106-b46a-40ca-b429-e5202eafb036 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 12:00:33 user nova-compute[73449]:  {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:00:33 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec9ca502-d8fe-42e6-8ed0-db01b1e836fe -p 172.16.0.220:3260 --interface default --op new {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:00:33 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec9ca502-d8fe-42e6-8ed0-db01b1e836fe -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:00:33 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[575a899c-59ce-4686-95cc-5a41379b1797]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ec9ca502-d8fe-42e6-8ed0-db01b1e836fe] added\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:00:33 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-648d6106-b46a-40ca-b429-e5202eafb036 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ec9ca502-d8fe-42e6-8ed0-db01b1e836fe] added
Aug 17 12:00:33 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:00:33 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec9ca502-d8fe-42e6-8ed0-db01b1e836fe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:00:33 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec9ca502-d8fe-42e6-8ed0-db01b1e836fe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:00:33 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f0a33b7-47be-465e-840b-95d829f1e00c]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:00:33 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-648d6106-b46a-40ca-b429-e5202eafb036 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:00:33 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec9ca502-d8fe-42e6-8ed0-db01b1e836fe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:00:33 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec9ca502-d8fe-42e6-8ed0-db01b1e836fe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:00:33 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[231757d1-259e-4e25-bfab-d1beceb87f70]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:00:33 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-648d6106-b46a-40ca-b429-e5202eafb036 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:00:33 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec9ca502-d8fe-42e6-8ed0-db01b1e836fe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qLoVOIGD {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:00:33 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec9ca502-d8fe-42e6-8ed0-db01b1e836fe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qLoVOIGD" returned: 0 in 0.029s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:00:33 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fc9b7c2-3f8c-4cbf-8cad-b2d6c3f21090]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:00:33 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-648d6106-b46a-40ca-b429-e5202eafb036 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qLoVOIGD'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:00:33 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec9ca502-d8fe-42e6-8ed0-db01b1e836fe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:00:33 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec9ca502-d8fe-42e6-8ed0-db01b1e836fe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:00:33 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5568c5f-4edd-4cf2-b15f-a66c512cb05d]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:00:33 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-648d6106-b46a-40ca-b429-e5202eafb036 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:00:33 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:00:33 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:00:33 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[85054b75-3f48-4b0d-a53f-1fe75789579b]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1f60817-d9b2-4269-a40d-69f0312e0cea (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82f5400e-2a45-428e-85b9-b052a993285a (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:00:33 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-648d6106-b46a-40ca-b429-e5202eafb036 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)
Aug 17 12:00:33 user nova-compute[73449]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7 (non-flash)
Aug 17 12:00:33 user nova-compute[73449]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1f60817-d9b2-4269-a40d-69f0312e0cea (non-flash)
Aug 17 12:00:33 user nova-compute[73449]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82f5400e-2a45-428e-85b9-b052a993285a (non-flash)
Aug 17 12:00:33 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 12:00:33 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-648d6106-b46a-40ca-b429-e5202eafb036 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)
Aug 17 12:00:33 user nova-compute[73449]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7 (non-flash)
Aug 17 12:00:33 user nova-compute[73449]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1f60817-d9b2-4269-a40d-69f0312e0cea (non-flash)
Aug 17 12:00:33 user nova-compute[73449]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82f5400e-2a45-428e-85b9-b052a993285a (non-flash)
Aug 17 12:00:33 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 12:00:33 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec9ca502-d8fe-42e6-8ed0-db01b1e836fe -p 172.16.0.220:3260 --login {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:00:33 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec9ca502-d8fe-42e6-8ed0-db01b1e836fe -p 172.16.0.220:3260 --login" returned: 0 in 0.090s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:00:33 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c0ece27-b3b0-4ca1-b172-863ceafa2f64]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ec9ca502-d8fe-42e6-8ed0-db01b1e836fe, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ec9ca502-d8fe-42e6-8ed0-db01b1e836fe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:00:33 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-648d6106-b46a-40ca-b429-e5202eafb036 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ec9ca502-d8fe-42e6-8ed0-db01b1e836fe, portal: 172.16.0.220,3260]
Aug 17 12:00:33 user nova-compute[73449]: Login to [iface: default, target: iqn.2010-10.org.openstack:ec9ca502-d8fe-42e6-8ed0-db01b1e836fe, portal: 172.16.0.220,3260] successful.
Aug 17 12:00:33 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:00:33 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec9ca502-d8fe-42e6-8ed0-db01b1e836fe -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:00:33 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec9ca502-d8fe-42e6-8ed0-db01b1e836fe -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:00:33 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc07b2ff-7881-48fc-9c07-614c184660ff]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:00:33 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-648d6106-b46a-40ca-b429-e5202eafb036 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:00:33 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:00:33 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:00:33 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b113fb9-f62a-48e6-8b59-b06e9823d329]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1f60817-d9b2-4269-a40d-69f0312e0cea (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82f5400e-2a45-428e-85b9-b052a993285a (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec9ca502-d8fe-42e6-8ed0-db01b1e836fe (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:00:33 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-648d6106-b46a-40ca-b429-e5202eafb036 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)
Aug 17 12:00:33 user nova-compute[73449]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7 (non-flash)
Aug 17 12:00:33 user nova-compute[73449]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1f60817-d9b2-4269-a40d-69f0312e0cea (non-flash)
Aug 17 12:00:33 user nova-compute[73449]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82f5400e-2a45-428e-85b9-b052a993285a (non-flash)
Aug 17 12:00:33 user nova-compute[73449]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec9ca502-d8fe-42e6-8ed0-db01b1e836fe (non-flash)
Aug 17 12:00:33 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 12:00:33 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-648d6106-b46a-40ca-b429-e5202eafb036 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)
Aug 17 12:00:33 user nova-compute[73449]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7 (non-flash)
Aug 17 12:00:33 user nova-compute[73449]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1f60817-d9b2-4269-a40d-69f0312e0cea (non-flash)
Aug 17 12:00:33 user nova-compute[73449]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82f5400e-2a45-428e-85b9-b052a993285a (non-flash)
Aug 17 12:00:33 user nova-compute[73449]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec9ca502-d8fe-42e6-8ed0-db01b1e836fe (non-flash)
Aug 17 12:00:33 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 12:00:33 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-648d6106-b46a-40ca-b429-e5202eafb036 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ec9ca502-d8fe-42e6-8ed0-db01b1e836fe" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.364s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 12:00:33 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-648d6106-b46a-40ca-b429-e5202eafb036 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Connected to 172.16.0.220:3260 {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 12:00:33 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-648d6106-b46a-40ca-b429-e5202eafb036 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] HCTL ('33', '-', '-', 0) found on session 47 with lun 0 {{(pid=73449) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 12:00:33 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-648d6106-b46a-40ca-b429-e5202eafb036 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73449) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 12:00:33 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:00:34 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:00:34 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[62c612ef-451d-4070-a209-eecebf40642d]: (4, ('- - 0', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:00:34 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-648d6106-b46a-40ca-b429-e5202eafb036 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73449) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 12:00:34 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-648d6106-b46a-40ca-b429-e5202eafb036 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qLoVOIGD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 12:00:34 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-937a8169-3023-4347-98b7-7a7655a95332 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Acquiring lock "d160711b-0b77-4f9a-b1d9-f0ac16240d4d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:00:34 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-937a8169-3023-4347-98b7-7a7655a95332 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Lock "d160711b-0b77-4f9a-b1d9-f0ac16240d4d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:00:34 user nova-compute[73449]: DEBUG nova.compute.manager [None req-937a8169-3023-4347-98b7-7a7655a95332 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: d160711b-0b77-4f9a-b1d9-f0ac16240d4d] Starting instance... {{(pid=73449) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 12:00:34 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-937a8169-3023-4347-98b7-7a7655a95332 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:00:34 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-937a8169-3023-4347-98b7-7a7655a95332 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:00:34 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-937a8169-3023-4347-98b7-7a7655a95332 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73449) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 12:00:34 user nova-compute[73449]: INFO nova.compute.claims [None req-937a8169-3023-4347-98b7-7a7655a95332 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: d160711b-0b77-4f9a-b1d9-f0ac16240d4d] Claim successful on node user
Aug 17 12:00:34 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:00:34 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-937a8169-3023-4347-98b7-7a7655a95332 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 12:00:35 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-937a8169-3023-4347-98b7-7a7655a95332 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 12:00:35 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-648d6106-b46a-40ca-b429-e5202eafb036 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.404s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 12:00:35 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-648d6106-b46a-40ca-b429-e5202eafb036 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] <== connect_volume: return (1405ms) {'type': 'block', 'scsi_wwn': '23663306337643935', 'path': '/dev/sdb'} {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 12:00:35 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-648d6106-b46a-40ca-b429-e5202eafb036 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] [instance: 5cacd9ed-27fb-431d-999e-31ff2464d14d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23663306337643935', 'path': '/dev/sdb'} {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 12:00:35 user nova-compute[73449]: DEBUG nova.objects.instance [None req-648d6106-b46a-40ca-b429-e5202eafb036 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Lazy-loading 'flavor' on Instance uuid 5cacd9ed-27fb-431d-999e-31ff2464d14d {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:00:35 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-648d6106-b46a-40ca-b429-e5202eafb036 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 12:00:35 user nova-compute[73449]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 12:00:35 user nova-compute[73449]:   <source dev="/dev/sdb"/>
Aug 17 12:00:35 user nova-compute[73449]:   <target dev="vdc" bus="virtio"/>
Aug 17 12:00:35 user nova-compute[73449]:   <serial>ec9ca502-d8fe-42e6-8ed0-db01b1e836fe</serial>
Aug 17 12:00:35 user nova-compute[73449]: </disk>
Aug 17 12:00:35 user nova-compute[73449]:  {{(pid=73449) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 12:00:35 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-937a8169-3023-4347-98b7-7a7655a95332 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.553s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:00:35 user nova-compute[73449]: DEBUG nova.compute.manager [None req-937a8169-3023-4347-98b7-7a7655a95332 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: d160711b-0b77-4f9a-b1d9-f0ac16240d4d] Start building networks asynchronously for instance. {{(pid=73449) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 12:00:35 user nova-compute[73449]: DEBUG nova.compute.manager [None req-937a8169-3023-4347-98b7-7a7655a95332 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: d160711b-0b77-4f9a-b1d9-f0ac16240d4d] Allocating IP information in the background. {{(pid=73449) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 12:00:35 user nova-compute[73449]: DEBUG nova.network.neutron [None req-937a8169-3023-4347-98b7-7a7655a95332 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: d160711b-0b77-4f9a-b1d9-f0ac16240d4d] allocate_for_instance() {{(pid=73449) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 12:00:35 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-937a8169-3023-4347-98b7-7a7655a95332 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: d160711b-0b77-4f9a-b1d9-f0ac16240d4d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 12:00:35 user nova-compute[73449]: DEBUG nova.compute.manager [None req-937a8169-3023-4347-98b7-7a7655a95332 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: d160711b-0b77-4f9a-b1d9-f0ac16240d4d] Start building block device mappings for instance. {{(pid=73449) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 12:00:35 user nova-compute[73449]: DEBUG nova.policy [None req-937a8169-3023-4347-98b7-7a7655a95332 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '55cde68973ca42d095180b5c0701b49b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75aa99e369c54b65aff27adbb1daf2b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73449) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 12:00:35 user nova-compute[73449]: DEBUG nova.compute.manager [None req-937a8169-3023-4347-98b7-7a7655a95332 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: d160711b-0b77-4f9a-b1d9-f0ac16240d4d] Start spawning the instance on the hypervisor. {{(pid=73449) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 12:00:35 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-937a8169-3023-4347-98b7-7a7655a95332 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: d160711b-0b77-4f9a-b1d9-f0ac16240d4d] Creating instance directory {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 12:00:35 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-937a8169-3023-4347-98b7-7a7655a95332 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: d160711b-0b77-4f9a-b1d9-f0ac16240d4d] Creating image(s)
Aug 17 12:00:35 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-937a8169-3023-4347-98b7-7a7655a95332 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Acquiring lock "/opt/stack/data/nova/instances/d160711b-0b77-4f9a-b1d9-f0ac16240d4d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:00:35 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-937a8169-3023-4347-98b7-7a7655a95332 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Lock "/opt/stack/data/nova/instances/d160711b-0b77-4f9a-b1d9-f0ac16240d4d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:00:35 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-937a8169-3023-4347-98b7-7a7655a95332 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Lock "/opt/stack/data/nova/instances/d160711b-0b77-4f9a-b1d9-f0ac16240d4d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:00:35 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-937a8169-3023-4347-98b7-7a7655a95332 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:00:35 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-648d6106-b46a-40ca-b429-e5202eafb036 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] No BDM found with device name vda, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 12:00:35 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-648d6106-b46a-40ca-b429-e5202eafb036 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 12:00:35 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-648d6106-b46a-40ca-b429-e5202eafb036 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 12:00:35 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-648d6106-b46a-40ca-b429-e5202eafb036 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] No VIF found with MAC fa:16:3e:e5:8a:59, not building metadata {{(pid=73449) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 12:00:35 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-937a8169-3023-4347-98b7-7a7655a95332 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json" returned: 0 in 0.190s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:00:35 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-937a8169-3023-4347-98b7-7a7655a95332 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Acquiring lock "7e267a577c062ee862e95ede6b48cfd5632f3ea3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:00:35 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-937a8169-3023-4347-98b7-7a7655a95332 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Lock "7e267a577c062ee862e95ede6b48cfd5632f3ea3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:00:35 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-937a8169-3023-4347-98b7-7a7655a95332 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:00:35 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-648d6106-b46a-40ca-b429-e5202eafb036 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Lock "5cacd9ed-27fb-431d-999e-31ff2464d14d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.985s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:00:35 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-937a8169-3023-4347-98b7-7a7655a95332 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json" returned: 0 in 0.181s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:00:35 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-937a8169-3023-4347-98b7-7a7655a95332 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3,backing_fmt=raw /opt/stack/data/nova/instances/d160711b-0b77-4f9a-b1d9-f0ac16240d4d/disk 1073741824 {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:00:35 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-937a8169-3023-4347-98b7-7a7655a95332 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3,backing_fmt=raw /opt/stack/data/nova/instances/d160711b-0b77-4f9a-b1d9-f0ac16240d4d/disk 1073741824" returned: 0 in 0.053s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:00:35 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-937a8169-3023-4347-98b7-7a7655a95332 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Lock "7e267a577c062ee862e95ede6b48cfd5632f3ea3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:00:35 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-937a8169-3023-4347-98b7-7a7655a95332 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:00:35 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-937a8169-3023-4347-98b7-7a7655a95332 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json" returned: 0 in 0.179s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:00:35 user nova-compute[73449]: DEBUG nova.virt.disk.api [None req-937a8169-3023-4347-98b7-7a7655a95332 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d160711b-0b77-4f9a-b1d9-f0ac16240d4d/disk. size=1073741824 {{(pid=73449) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 12:00:35 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-937a8169-3023-4347-98b7-7a7655a95332 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d160711b-0b77-4f9a-b1d9-f0ac16240d4d/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:00:36 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-937a8169-3023-4347-98b7-7a7655a95332 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d160711b-0b77-4f9a-b1d9-f0ac16240d4d/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:00:36 user nova-compute[73449]: DEBUG nova.virt.disk.api [None req-937a8169-3023-4347-98b7-7a7655a95332 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Cannot resize image /opt/stack/data/nova/instances/d160711b-0b77-4f9a-b1d9-f0ac16240d4d/disk to a smaller size. {{(pid=73449) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 12:00:36 user nova-compute[73449]: DEBUG nova.objects.instance [None req-937a8169-3023-4347-98b7-7a7655a95332 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Lazy-loading 'migration_context' on Instance uuid d160711b-0b77-4f9a-b1d9-f0ac16240d4d {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:00:36 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-937a8169-3023-4347-98b7-7a7655a95332 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: d160711b-0b77-4f9a-b1d9-f0ac16240d4d] Created local disks {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 12:00:36 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-937a8169-3023-4347-98b7-7a7655a95332 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: d160711b-0b77-4f9a-b1d9-f0ac16240d4d] Ensure instance console log exists: /opt/stack/data/nova/instances/d160711b-0b77-4f9a-b1d9-f0ac16240d4d/console.log {{(pid=73449) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 12:00:36 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-937a8169-3023-4347-98b7-7a7655a95332 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:00:36 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-937a8169-3023-4347-98b7-7a7655a95332 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:00:36 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-937a8169-3023-4347-98b7-7a7655a95332 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:00:36 user nova-compute[73449]: DEBUG nova.network.neutron [None req-937a8169-3023-4347-98b7-7a7655a95332 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: d160711b-0b77-4f9a-b1d9-f0ac16240d4d] Successfully created port: ad3f0bca-081f-47c5-909b-2b2b2e2fe69f {{(pid=73449) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 12:00:36 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-193320ed-bb58-48d3-bc1d-063ed9749fc6 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Acquiring lock "5cacd9ed-27fb-431d-999e-31ff2464d14d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:00:36 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-193320ed-bb58-48d3-bc1d-063ed9749fc6 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Lock "5cacd9ed-27fb-431d-999e-31ff2464d14d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:00:36 user nova-compute[73449]: INFO nova.compute.manager [None req-193320ed-bb58-48d3-bc1d-063ed9749fc6 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] [instance: 5cacd9ed-27fb-431d-999e-31ff2464d14d] Detaching volume ec9ca502-d8fe-42e6-8ed0-db01b1e836fe
Aug 17 12:00:36 user nova-compute[73449]: INFO nova.virt.block_device [None req-193320ed-bb58-48d3-bc1d-063ed9749fc6 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] [instance: 5cacd9ed-27fb-431d-999e-31ff2464d14d] Attempting to driver detach volume ec9ca502-d8fe-42e6-8ed0-db01b1e836fe from mountpoint /dev/vdc
Aug 17 12:00:36 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-193320ed-bb58-48d3-bc1d-063ed9749fc6 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Attempting to detach device vdc from instance 5cacd9ed-27fb-431d-999e-31ff2464d14d from the persistent domain config. {{(pid=73449) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 12:00:36 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-193320ed-bb58-48d3-bc1d-063ed9749fc6 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 12:00:36 user nova-compute[73449]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 12:00:36 user nova-compute[73449]:   <source dev="/dev/sdb"/>
Aug 17 12:00:36 user nova-compute[73449]:   <target dev="vdc" bus="virtio"/>
Aug 17 12:00:36 user nova-compute[73449]:   <serial>ec9ca502-d8fe-42e6-8ed0-db01b1e836fe</serial>
Aug 17 12:00:36 user nova-compute[73449]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 17 12:00:36 user nova-compute[73449]: </disk>
Aug 17 12:00:36 user nova-compute[73449]:  {{(pid=73449) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 12:00:36 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-193320ed-bb58-48d3-bc1d-063ed9749fc6 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Successfully detached device vdc from instance 5cacd9ed-27fb-431d-999e-31ff2464d14d from the persistent domain config.
Aug 17 12:00:36 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-193320ed-bb58-48d3-bc1d-063ed9749fc6 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 5cacd9ed-27fb-431d-999e-31ff2464d14d from the live domain config. {{(pid=73449) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 12:00:36 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-193320ed-bb58-48d3-bc1d-063ed9749fc6 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 12:00:36 user nova-compute[73449]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 12:00:36 user nova-compute[73449]:   <source dev="/dev/sdb"/>
Aug 17 12:00:36 user nova-compute[73449]:   <target dev="vdc" bus="virtio"/>
Aug 17 12:00:36 user nova-compute[73449]:   <serial>ec9ca502-d8fe-42e6-8ed0-db01b1e836fe</serial>
Aug 17 12:00:36 user nova-compute[73449]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 17 12:00:36 user nova-compute[73449]: </disk>
Aug 17 12:00:36 user nova-compute[73449]:  {{(pid=73449) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 12:00:36 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Received event <DeviceRemovedEvent: 1692273636.9980621, 5cacd9ed-27fb-431d-999e-31ff2464d14d => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73449) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 12:00:37 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-193320ed-bb58-48d3-bc1d-063ed9749fc6 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 5cacd9ed-27fb-431d-999e-31ff2464d14d {{(pid=73449) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 12:00:37 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-193320ed-bb58-48d3-bc1d-063ed9749fc6 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Successfully detached device vdc from instance 5cacd9ed-27fb-431d-999e-31ff2464d14d from the live domain config.
Aug 17 12:00:37 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-193320ed-bb58-48d3-bc1d-063ed9749fc6 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] [instance: 5cacd9ed-27fb-431d-999e-31ff2464d14d] calling os-brick to detach iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 12:00:37 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-193320ed-bb58-48d3-bc1d-063ed9749fc6 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, {'target_iqns': ['iqn.2010-10.org.openstack:ec9ca502-d8fe-42e6-8ed0-db01b1e836fe'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qLoVOIGD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 12:00:37 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-193320ed-bb58-48d3-bc1d-063ed9749fc6 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 12:00:37 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-193320ed-bb58-48d3-bc1d-063ed9749fc6 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 12:00:37 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-193320ed-bb58-48d3-bc1d-063ed9749fc6 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 12:00:37 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-193320ed-bb58-48d3-bc1d-063ed9749fc6 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ec9ca502-d8fe-42e6-8ed0-db01b1e836fe', 0)] {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 12:00:37 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:00:37 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:00:37 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a36ef91-b9e4-4c8c-89e7-ca8f81cddfd0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82f5400e-2a45-428e-85b9-b052a993285a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ec9ca502-d8fe-42e6-8ed0-db01b1e836fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f1f60817-d9b2-4269-a40d-69f0312e0cea\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:00:37 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:00:37 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:00:37 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[62791727-ad0b-49e3-b6a3-4939a2afc4ac]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1f60817-d9b2-4269-a40d-69f0312e0cea (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82f5400e-2a45-428e-85b9-b052a993285a (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec9ca502-d8fe-42e6-8ed0-db01b1e836fe (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:00:37 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-193320ed-bb58-48d3-bc1d-063ed9749fc6 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)
Aug 17 12:00:37 user nova-compute[73449]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7 (non-flash)
Aug 17 12:00:37 user nova-compute[73449]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1f60817-d9b2-4269-a40d-69f0312e0cea (non-flash)
Aug 17 12:00:37 user nova-compute[73449]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82f5400e-2a45-428e-85b9-b052a993285a (non-flash)
Aug 17 12:00:37 user nova-compute[73449]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec9ca502-d8fe-42e6-8ed0-db01b1e836fe (non-flash)
Aug 17 12:00:37 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 12:00:37 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-193320ed-bb58-48d3-bc1d-063ed9749fc6 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)
Aug 17 12:00:37 user nova-compute[73449]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7 (non-flash)
Aug 17 12:00:37 user nova-compute[73449]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1f60817-d9b2-4269-a40d-69f0312e0cea (non-flash)
Aug 17 12:00:37 user nova-compute[73449]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82f5400e-2a45-428e-85b9-b052a993285a (non-flash)
Aug 17 12:00:37 user nova-compute[73449]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec9ca502-d8fe-42e6-8ed0-db01b1e836fe (non-flash)
Aug 17 12:00:37 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 12:00:37 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-193320ed-bb58-48d3-bc1d-063ed9749fc6 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe7582ee4d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ec9ca502-d8fe-42e6-8ed0-db01b1e836fe'): ({'sdb'}, set())}) {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 12:00:37 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-193320ed-bb58-48d3-bc1d-063ed9749fc6 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Removing single pathed devices sdb {{(pid=73449) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 12:00:37 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:00:37 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:00:37 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8d6b69c-dcd0-4081-8455-2f1fc948a824]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:00:37 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:00:37 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:00:37 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d108486-9a8f-4e93-9056-22a5e7952780]: (4, ('ok\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:00:37 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-193320ed-bb58-48d3-bc1d-063ed9749fc6 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Flushing IO for device /dev/sdb {{(pid=73449) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 12:00:37 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:00:37 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:00:37 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[eddcdae4-5531-4ef2-bf75-0623b8159a25]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:00:37 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-193320ed-bb58-48d3-bc1d-063ed9749fc6 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73449) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 12:00:37 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:00:37 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:00:37 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea5a20e8-6203-4ce4-8dbe-ee149e1e193d]: (4, ('1', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:00:37 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-193320ed-bb58-48d3-bc1d-063ed9749fc6 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73449) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 12:00:37 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-193320ed-bb58-48d3-bc1d-063ed9749fc6 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] SCSI volumes sdb have been removed. {{(pid=73449) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 12:00:37 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-193320ed-bb58-48d3-bc1d-063ed9749fc6 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ec9ca502-d8fe-42e6-8ed0-db01b1e836fe')] {{(pid=73449) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 12:00:37 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec9ca502-d8fe-42e6-8ed0-db01b1e836fe -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:00:37 user nova-compute[73449]: DEBUG nova.network.neutron [None req-937a8169-3023-4347-98b7-7a7655a95332 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: d160711b-0b77-4f9a-b1d9-f0ac16240d4d] Successfully updated port: ad3f0bca-081f-47c5-909b-2b2b2e2fe69f {{(pid=73449) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 12:00:37 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-937a8169-3023-4347-98b7-7a7655a95332 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Acquiring lock "refresh_cache-d160711b-0b77-4f9a-b1d9-f0ac16240d4d" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 12:00:37 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-937a8169-3023-4347-98b7-7a7655a95332 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Acquired lock "refresh_cache-d160711b-0b77-4f9a-b1d9-f0ac16240d4d" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 12:00:37 user nova-compute[73449]: DEBUG nova.network.neutron [None req-937a8169-3023-4347-98b7-7a7655a95332 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: d160711b-0b77-4f9a-b1d9-f0ac16240d4d] Building network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 12:00:37 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec9ca502-d8fe-42e6-8ed0-db01b1e836fe -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:00:37 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c1b4957-62e8-4bf1-9072-f152b1f1b027]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:00:37 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-193320ed-bb58-48d3-bc1d-063ed9749fc6 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:00:37 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec9ca502-d8fe-42e6-8ed0-db01b1e836fe -p 172.16.0.220:3260 --logout {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:00:37 user nova-compute[73449]: DEBUG nova.network.neutron [None req-937a8169-3023-4347-98b7-7a7655a95332 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: d160711b-0b77-4f9a-b1d9-f0ac16240d4d] Instance cache missing network info. {{(pid=73449) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 12:00:37 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec9ca502-d8fe-42e6-8ed0-db01b1e836fe -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:00:37 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8b6558d-0480-4aa8-a15b-64f853dd2f3a]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:ec9ca502-d8fe-42e6-8ed0-db01b1e836fe, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:ec9ca502-d8fe-42e6-8ed0-db01b1e836fe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:00:37 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-193320ed-bb58-48d3-bc1d-063ed9749fc6 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:ec9ca502-d8fe-42e6-8ed0-db01b1e836fe, portal: 172.16.0.220,3260]
Aug 17 12:00:37 user nova-compute[73449]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:ec9ca502-d8fe-42e6-8ed0-db01b1e836fe, portal: 172.16.0.220,3260] successful.
Aug 17 12:00:37 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:00:37 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec9ca502-d8fe-42e6-8ed0-db01b1e836fe -p 172.16.0.220:3260 --op delete {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:00:37 user nova-compute[73449]: DEBUG nova.compute.manager [req-a385a241-8321-4912-afe5-d4ddfd6d3007 req-301bb0ba-9a92-43de-995b-03748518ed60 service nova] [instance: d160711b-0b77-4f9a-b1d9-f0ac16240d4d] Received event network-changed-ad3f0bca-081f-47c5-909b-2b2b2e2fe69f {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:00:37 user nova-compute[73449]: DEBUG nova.compute.manager [req-a385a241-8321-4912-afe5-d4ddfd6d3007 req-301bb0ba-9a92-43de-995b-03748518ed60 service nova] [instance: d160711b-0b77-4f9a-b1d9-f0ac16240d4d] Refreshing instance network info cache due to event network-changed-ad3f0bca-081f-47c5-909b-2b2b2e2fe69f. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 12:00:37 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-a385a241-8321-4912-afe5-d4ddfd6d3007 req-301bb0ba-9a92-43de-995b-03748518ed60 service nova] Acquiring lock "refresh_cache-d160711b-0b77-4f9a-b1d9-f0ac16240d4d" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 12:00:37 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec9ca502-d8fe-42e6-8ed0-db01b1e836fe -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:00:37 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[119a1050-93ef-4a60-b322-3c46b4d03dc6]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:00:37 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-193320ed-bb58-48d3-bc1d-063ed9749fc6 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:00:37 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-193320ed-bb58-48d3-bc1d-063ed9749fc6 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 12:00:37 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-193320ed-bb58-48d3-bc1d-063ed9749fc6 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] <== disconnect_volume: return (314ms) None {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 12:00:37 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-193320ed-bb58-48d3-bc1d-063ed9749fc6 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] [instance: 5cacd9ed-27fb-431d-999e-31ff2464d14d] Disconnected iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 12:00:37 user nova-compute[73449]: DEBUG nova.network.neutron [None req-937a8169-3023-4347-98b7-7a7655a95332 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: d160711b-0b77-4f9a-b1d9-f0ac16240d4d] Updating instance_info_cache with network_info: [{"id": "ad3f0bca-081f-47c5-909b-2b2b2e2fe69f", "address": "fa:16:3e:d6:cf:c6", "network": {"id": "71648e1b-cf19-44b7-bae2-9d38543cdee9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-822323626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75aa99e369c54b65aff27adbb1daf2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad3f0bca-08", "ovs_interfaceid": "ad3f0bca-081f-47c5-909b-2b2b2e2fe69f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 12:00:37 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-937a8169-3023-4347-98b7-7a7655a95332 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Releasing lock "refresh_cache-d160711b-0b77-4f9a-b1d9-f0ac16240d4d" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 12:00:37 user nova-compute[73449]: DEBUG nova.compute.manager [None req-937a8169-3023-4347-98b7-7a7655a95332 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: d160711b-0b77-4f9a-b1d9-f0ac16240d4d] Instance network_info: |[{"id": "ad3f0bca-081f-47c5-909b-2b2b2e2fe69f", "address": "fa:16:3e:d6:cf:c6", "network": {"id": "71648e1b-cf19-44b7-bae2-9d38543cdee9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-822323626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75aa99e369c54b65aff27adbb1daf2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad3f0bca-08", "ovs_interfaceid": "ad3f0bca-081f-47c5-909b-2b2b2e2fe69f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73449) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 12:00:37 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-a385a241-8321-4912-afe5-d4ddfd6d3007 req-301bb0ba-9a92-43de-995b-03748518ed60 service nova] Acquired lock "refresh_cache-d160711b-0b77-4f9a-b1d9-f0ac16240d4d" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 12:00:37 user nova-compute[73449]: DEBUG nova.network.neutron [req-a385a241-8321-4912-afe5-d4ddfd6d3007 req-301bb0ba-9a92-43de-995b-03748518ed60 service nova] [instance: d160711b-0b77-4f9a-b1d9-f0ac16240d4d] Refreshing network info cache for port ad3f0bca-081f-47c5-909b-2b2b2e2fe69f {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 12:00:37 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-937a8169-3023-4347-98b7-7a7655a95332 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: d160711b-0b77-4f9a-b1d9-f0ac16240d4d] Start _get_guest_xml network_info=[{"id": "ad3f0bca-081f-47c5-909b-2b2b2e2fe69f", "address": "fa:16:3e:d6:cf:c6", "network": {"id": "71648e1b-cf19-44b7-bae2-9d38543cdee9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-822323626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75aa99e369c54b65aff27adbb1daf2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad3f0bca-08", "ovs_interfaceid": "ad3f0bca-081f-47c5-909b-2b2b2e2fe69f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T11:36:11Z,direct_url=<?>,disk_format='qcow2',id=0a2904ae-083d-41c8-83db-343132b36148,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7a77880136a54ef195c82e018e1939db',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T11:36:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': '0a2904ae-083d-41c8-83db-343132b36148'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 12:00:37 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-937a8169-3023-4347-98b7-7a7655a95332 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 12:00:37 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-937a8169-3023-4347-98b7-7a7655a95332 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 12:00:37 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-937a8169-3023-4347-98b7-7a7655a95332 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 12:00:37 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-937a8169-3023-4347-98b7-7a7655a95332 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] CPU controller missing on host. {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 12:00:37 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-937a8169-3023-4347-98b7-7a7655a95332 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 12:00:37 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-937a8169-3023-4347-98b7-7a7655a95332 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] CPU controller found on host. {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 12:00:37 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-937a8169-3023-4347-98b7-7a7655a95332 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73449) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 12:00:37 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-937a8169-3023-4347-98b7-7a7655a95332 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T11:35:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T11:36:11Z,direct_url=<?>,disk_format='qcow2',id=0a2904ae-083d-41c8-83db-343132b36148,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7a77880136a54ef195c82e018e1939db',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T11:36:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 12:00:37 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-937a8169-3023-4347-98b7-7a7655a95332 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Flavor limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 12:00:37 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-937a8169-3023-4347-98b7-7a7655a95332 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Image limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 12:00:37 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-937a8169-3023-4347-98b7-7a7655a95332 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Flavor pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 12:00:37 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-937a8169-3023-4347-98b7-7a7655a95332 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Image pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 12:00:37 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-937a8169-3023-4347-98b7-7a7655a95332 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 12:00:37 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-937a8169-3023-4347-98b7-7a7655a95332 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 12:00:37 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-937a8169-3023-4347-98b7-7a7655a95332 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 12:00:37 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-937a8169-3023-4347-98b7-7a7655a95332 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Got 1 possible topologies {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 12:00:37 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-937a8169-3023-4347-98b7-7a7655a95332 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 12:00:37 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-937a8169-3023-4347-98b7-7a7655a95332 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 12:00:37 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-937a8169-3023-4347-98b7-7a7655a95332 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T12:00:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1074855423',display_name='tempest-AttachVolumeNegativeTest-server-1074855423',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1074855423',id=42,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCmFkfqS9Dfdq5RHGdGFNtv05KFEl8BQknoOmNzb2vRGjZ225jUWucs3apLskPk8Fn1rbu/P5bCBQGXFav5F4pHSv2IumBeL2E1IGuWjYSsqE29OGnIoR2e2vNHuxbYkOw==',key_name='tempest-keypair-1046412207',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75aa99e369c54b65aff27adbb1daf2b8',ramdisk_id='',reservation_id='r-ml7pzzvw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-165752051',owner_user_name='tempest-AttachVolumeNegativeTest-165752051-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T12:00:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55cde68973ca42d095180b5c0701b49b',uuid=d160711b-0b77-4f9a-b1d9-f0ac16240d4d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ad3f0bca-081f-47c5-909b-2b2b2e2fe69f", "address": "fa:16:3e:d6:cf:c6", "network": {"id": "71648e1b-cf19-44b7-bae2-9d38543cdee9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-822323626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75aa99e369c54b65aff27adbb1daf2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad3f0bca-08", "ovs_interfaceid": "ad3f0bca-081f-47c5-909b-2b2b2e2fe69f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73449) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 12:00:37 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-937a8169-3023-4347-98b7-7a7655a95332 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Converting VIF {"id": "ad3f0bca-081f-47c5-909b-2b2b2e2fe69f", "address": "fa:16:3e:d6:cf:c6", "network": {"id": "71648e1b-cf19-44b7-bae2-9d38543cdee9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-822323626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75aa99e369c54b65aff27adbb1daf2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad3f0bca-08", "ovs_interfaceid": "ad3f0bca-081f-47c5-909b-2b2b2e2fe69f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 12:00:37 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-937a8169-3023-4347-98b7-7a7655a95332 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:cf:c6,bridge_name='br-int',has_traffic_filtering=True,id=ad3f0bca-081f-47c5-909b-2b2b2e2fe69f,network=Network(71648e1b-cf19-44b7-bae2-9d38543cdee9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad3f0bca-08') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 12:00:37 user nova-compute[73449]: DEBUG nova.objects.instance [None req-937a8169-3023-4347-98b7-7a7655a95332 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Lazy-loading 'pci_devices' on Instance uuid d160711b-0b77-4f9a-b1d9-f0ac16240d4d {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:00:37 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-937a8169-3023-4347-98b7-7a7655a95332 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: d160711b-0b77-4f9a-b1d9-f0ac16240d4d] End _get_guest_xml xml=<domain type="kvm">
Aug 17 12:00:37 user nova-compute[73449]:   <uuid>d160711b-0b77-4f9a-b1d9-f0ac16240d4d</uuid>
Aug 17 12:00:37 user nova-compute[73449]:   <name>instance-0000002a</name>
Aug 17 12:00:37 user nova-compute[73449]:   <memory>524288</memory>
Aug 17 12:00:37 user nova-compute[73449]:   <vcpu>1</vcpu>
Aug 17 12:00:37 user nova-compute[73449]:   <metadata>
Aug 17 12:00:37 user nova-compute[73449]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 12:00:37 user nova-compute[73449]:       <nova:package version="0.0.0"/>
Aug 17 12:00:37 user nova-compute[73449]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1074855423</nova:name>
Aug 17 12:00:37 user nova-compute[73449]:       <nova:creationTime>2023-08-17 12:00:37</nova:creationTime>
Aug 17 12:00:37 user nova-compute[73449]:       <nova:flavor name="m1.tiny">
Aug 17 12:00:37 user nova-compute[73449]:         <nova:memory>512</nova:memory>
Aug 17 12:00:37 user nova-compute[73449]:         <nova:disk>1</nova:disk>
Aug 17 12:00:37 user nova-compute[73449]:         <nova:swap>0</nova:swap>
Aug 17 12:00:37 user nova-compute[73449]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 12:00:37 user nova-compute[73449]:         <nova:vcpus>1</nova:vcpus>
Aug 17 12:00:37 user nova-compute[73449]:       </nova:flavor>
Aug 17 12:00:37 user nova-compute[73449]:       <nova:owner>
Aug 17 12:00:37 user nova-compute[73449]:         <nova:user uuid="55cde68973ca42d095180b5c0701b49b">tempest-AttachVolumeNegativeTest-165752051-project-member</nova:user>
Aug 17 12:00:37 user nova-compute[73449]:         <nova:project uuid="75aa99e369c54b65aff27adbb1daf2b8">tempest-AttachVolumeNegativeTest-165752051</nova:project>
Aug 17 12:00:37 user nova-compute[73449]:       </nova:owner>
Aug 17 12:00:37 user nova-compute[73449]:       <nova:root type="image" uuid="0a2904ae-083d-41c8-83db-343132b36148"/>
Aug 17 12:00:37 user nova-compute[73449]:       <nova:ports>
Aug 17 12:00:37 user nova-compute[73449]:         <nova:port uuid="ad3f0bca-081f-47c5-909b-2b2b2e2fe69f">
Aug 17 12:00:37 user nova-compute[73449]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 17 12:00:37 user nova-compute[73449]:         </nova:port>
Aug 17 12:00:37 user nova-compute[73449]:       </nova:ports>
Aug 17 12:00:37 user nova-compute[73449]:     </nova:instance>
Aug 17 12:00:37 user nova-compute[73449]:   </metadata>
Aug 17 12:00:37 user nova-compute[73449]:   <sysinfo type="smbios">
Aug 17 12:00:37 user nova-compute[73449]:     <system>
Aug 17 12:00:37 user nova-compute[73449]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 12:00:37 user nova-compute[73449]:       <entry name="product">OpenStack Nova</entry>
Aug 17 12:00:37 user nova-compute[73449]:       <entry name="version">0.0.0</entry>
Aug 17 12:00:37 user nova-compute[73449]:       <entry name="serial">d160711b-0b77-4f9a-b1d9-f0ac16240d4d</entry>
Aug 17 12:00:37 user nova-compute[73449]:       <entry name="uuid">d160711b-0b77-4f9a-b1d9-f0ac16240d4d</entry>
Aug 17 12:00:37 user nova-compute[73449]:       <entry name="family">Virtual Machine</entry>
Aug 17 12:00:37 user nova-compute[73449]:     </system>
Aug 17 12:00:37 user nova-compute[73449]:   </sysinfo>
Aug 17 12:00:37 user nova-compute[73449]:   <os>
Aug 17 12:00:37 user nova-compute[73449]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 12:00:37 user nova-compute[73449]:     <boot dev="hd"/>
Aug 17 12:00:37 user nova-compute[73449]:     <smbios mode="sysinfo"/>
Aug 17 12:00:37 user nova-compute[73449]:   </os>
Aug 17 12:00:37 user nova-compute[73449]:   <features>
Aug 17 12:00:37 user nova-compute[73449]:     <acpi/>
Aug 17 12:00:37 user nova-compute[73449]:     <apic/>
Aug 17 12:00:37 user nova-compute[73449]:     <vmcoreinfo/>
Aug 17 12:00:37 user nova-compute[73449]:   </features>
Aug 17 12:00:37 user nova-compute[73449]:   <clock offset="utc">
Aug 17 12:00:37 user nova-compute[73449]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 12:00:37 user nova-compute[73449]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 12:00:37 user nova-compute[73449]:     <timer name="hpet" present="no"/>
Aug 17 12:00:37 user nova-compute[73449]:   </clock>
Aug 17 12:00:37 user nova-compute[73449]:   <cpu mode="custom" match="exact">
Aug 17 12:00:37 user nova-compute[73449]:     <model>Nehalem</model>
Aug 17 12:00:37 user nova-compute[73449]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 12:00:37 user nova-compute[73449]:   </cpu>
Aug 17 12:00:37 user nova-compute[73449]:   <devices>
Aug 17 12:00:37 user nova-compute[73449]:     <disk type="file" device="disk">
Aug 17 12:00:37 user nova-compute[73449]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 12:00:37 user nova-compute[73449]:       <source file="/opt/stack/data/nova/instances/d160711b-0b77-4f9a-b1d9-f0ac16240d4d/disk"/>
Aug 17 12:00:37 user nova-compute[73449]:       <target dev="vda" bus="virtio"/>
Aug 17 12:00:37 user nova-compute[73449]:     </disk>
Aug 17 12:00:37 user nova-compute[73449]:     <interface type="ethernet">
Aug 17 12:00:37 user nova-compute[73449]:       <mac address="fa:16:3e:d6:cf:c6"/>
Aug 17 12:00:37 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 12:00:37 user nova-compute[73449]:       <mtu size="1442"/>
Aug 17 12:00:37 user nova-compute[73449]:       <target dev="tapad3f0bca-08"/>
Aug 17 12:00:37 user nova-compute[73449]:     </interface>
Aug 17 12:00:37 user nova-compute[73449]:     <serial type="pty">
Aug 17 12:00:37 user nova-compute[73449]:       <log file="/opt/stack/data/nova/instances/d160711b-0b77-4f9a-b1d9-f0ac16240d4d/console.log" append="off"/>
Aug 17 12:00:37 user nova-compute[73449]:     </serial>
Aug 17 12:00:37 user nova-compute[73449]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 12:00:37 user nova-compute[73449]:     <video>
Aug 17 12:00:37 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 12:00:37 user nova-compute[73449]:     </video>
Aug 17 12:00:37 user nova-compute[73449]:     <rng model="virtio">
Aug 17 12:00:37 user nova-compute[73449]:       <backend model="random">/dev/urandom</backend>
Aug 17 12:00:37 user nova-compute[73449]:     </rng>
Aug 17 12:00:37 user nova-compute[73449]:     <controller type="usb" index="0" model="none"/>
Aug 17 12:00:37 user nova-compute[73449]:     <memballoon model="virtio">
Aug 17 12:00:37 user nova-compute[73449]:       <stats period="10"/>
Aug 17 12:00:37 user nova-compute[73449]:     </memballoon>
Aug 17 12:00:37 user nova-compute[73449]:   </devices>
Aug 17 12:00:37 user nova-compute[73449]: </domain>
Aug 17 12:00:37 user nova-compute[73449]:  {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 12:00:37 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-937a8169-3023-4347-98b7-7a7655a95332 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T12:00:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1074855423',display_name='tempest-AttachVolumeNegativeTest-server-1074855423',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1074855423',id=42,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCmFkfqS9Dfdq5RHGdGFNtv05KFEl8BQknoOmNzb2vRGjZ225jUWucs3apLskPk8Fn1rbu/P5bCBQGXFav5F4pHSv2IumBeL2E1IGuWjYSsqE29OGnIoR2e2vNHuxbYkOw==',key_name='tempest-keypair-1046412207',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75aa99e369c54b65aff27adbb1daf2b8',ramdisk_id='',reservation_id='r-ml7pzzvw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-165752051',owner_user_name='tempest-AttachVolumeNegativeTest-165752051-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T12:00:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55cde68973ca42d095180b5c0701b49b',uuid=d160711b-0b77-4f9a-b1d9-f0ac16240d4d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ad3f0bca-081f-47c5-909b-2b2b2e2fe69f", "address": "fa:16:3e:d6:cf:c6", "network": {"id": "71648e1b-cf19-44b7-bae2-9d38543cdee9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-822323626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75aa99e369c54b65aff27adbb1daf2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad3f0bca-08", "ovs_interfaceid": "ad3f0bca-081f-47c5-909b-2b2b2e2fe69f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 12:00:37 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-937a8169-3023-4347-98b7-7a7655a95332 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Converting VIF {"id": "ad3f0bca-081f-47c5-909b-2b2b2e2fe69f", "address": "fa:16:3e:d6:cf:c6", "network": {"id": "71648e1b-cf19-44b7-bae2-9d38543cdee9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-822323626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75aa99e369c54b65aff27adbb1daf2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad3f0bca-08", "ovs_interfaceid": "ad3f0bca-081f-47c5-909b-2b2b2e2fe69f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 12:00:37 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-937a8169-3023-4347-98b7-7a7655a95332 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:cf:c6,bridge_name='br-int',has_traffic_filtering=True,id=ad3f0bca-081f-47c5-909b-2b2b2e2fe69f,network=Network(71648e1b-cf19-44b7-bae2-9d38543cdee9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad3f0bca-08') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 12:00:37 user nova-compute[73449]: DEBUG os_vif [None req-937a8169-3023-4347-98b7-7a7655a95332 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:cf:c6,bridge_name='br-int',has_traffic_filtering=True,id=ad3f0bca-081f-47c5-909b-2b2b2e2fe69f,network=Network(71648e1b-cf19-44b7-bae2-9d38543cdee9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad3f0bca-08') {{(pid=73449) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 12:00:37 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:00:37 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 12:00:37 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 12:00:37 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:00:37 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapad3f0bca-08, may_exist=True, interface_attrs={}) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 12:00:37 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapad3f0bca-08, col_values=(('external_ids', {'iface-id': 'ad3f0bca-081f-47c5-909b-2b2b2e2fe69f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d6:cf:c6', 'vm-uuid': 'd160711b-0b77-4f9a-b1d9-f0ac16240d4d'}),), if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 12:00:37 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:00:37 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:00:37 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:00:37 user nova-compute[73449]: INFO os_vif [None req-937a8169-3023-4347-98b7-7a7655a95332 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:cf:c6,bridge_name='br-int',has_traffic_filtering=True,id=ad3f0bca-081f-47c5-909b-2b2b2e2fe69f,network=Network(71648e1b-cf19-44b7-bae2-9d38543cdee9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad3f0bca-08')
Aug 17 12:00:37 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-937a8169-3023-4347-98b7-7a7655a95332 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] No BDM found with device name vda, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 12:00:37 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-937a8169-3023-4347-98b7-7a7655a95332 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] No VIF found with MAC fa:16:3e:d6:cf:c6, not building metadata {{(pid=73449) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 12:00:38 user nova-compute[73449]: DEBUG nova.network.neutron [req-a385a241-8321-4912-afe5-d4ddfd6d3007 req-301bb0ba-9a92-43de-995b-03748518ed60 service nova] [instance: d160711b-0b77-4f9a-b1d9-f0ac16240d4d] Updated VIF entry in instance network info cache for port ad3f0bca-081f-47c5-909b-2b2b2e2fe69f. {{(pid=73449) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 12:00:38 user nova-compute[73449]: DEBUG nova.network.neutron [req-a385a241-8321-4912-afe5-d4ddfd6d3007 req-301bb0ba-9a92-43de-995b-03748518ed60 service nova] [instance: d160711b-0b77-4f9a-b1d9-f0ac16240d4d] Updating instance_info_cache with network_info: [{"id": "ad3f0bca-081f-47c5-909b-2b2b2e2fe69f", "address": "fa:16:3e:d6:cf:c6", "network": {"id": "71648e1b-cf19-44b7-bae2-9d38543cdee9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-822323626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75aa99e369c54b65aff27adbb1daf2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad3f0bca-08", "ovs_interfaceid": "ad3f0bca-081f-47c5-909b-2b2b2e2fe69f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 12:00:38 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-a385a241-8321-4912-afe5-d4ddfd6d3007 req-301bb0ba-9a92-43de-995b-03748518ed60 service nova] Releasing lock "refresh_cache-d160711b-0b77-4f9a-b1d9-f0ac16240d4d" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 12:00:38 user nova-compute[73449]: DEBUG nova.objects.instance [None req-193320ed-bb58-48d3-bc1d-063ed9749fc6 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Lazy-loading 'flavor' on Instance uuid 5cacd9ed-27fb-431d-999e-31ff2464d14d {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:00:38 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-193320ed-bb58-48d3-bc1d-063ed9749fc6 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Lock "5cacd9ed-27fb-431d-999e-31ff2464d14d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.136s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:00:38 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:00:39 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:00:39 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:00:39 user nova-compute[73449]: DEBUG nova.compute.manager [req-cb3e027a-a80d-4ce3-82ae-78a8628309bb req-fe1a82e4-fa45-45b6-8192-98bdebdd58ac service nova] [instance: d160711b-0b77-4f9a-b1d9-f0ac16240d4d] Received event network-vif-plugged-ad3f0bca-081f-47c5-909b-2b2b2e2fe69f {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:00:39 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-cb3e027a-a80d-4ce3-82ae-78a8628309bb req-fe1a82e4-fa45-45b6-8192-98bdebdd58ac service nova] Acquiring lock "d160711b-0b77-4f9a-b1d9-f0ac16240d4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:00:39 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-cb3e027a-a80d-4ce3-82ae-78a8628309bb req-fe1a82e4-fa45-45b6-8192-98bdebdd58ac service nova] Lock "d160711b-0b77-4f9a-b1d9-f0ac16240d4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:00:39 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-cb3e027a-a80d-4ce3-82ae-78a8628309bb req-fe1a82e4-fa45-45b6-8192-98bdebdd58ac service nova] Lock "d160711b-0b77-4f9a-b1d9-f0ac16240d4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:00:39 user nova-compute[73449]: DEBUG nova.compute.manager [req-cb3e027a-a80d-4ce3-82ae-78a8628309bb req-fe1a82e4-fa45-45b6-8192-98bdebdd58ac service nova] [instance: d160711b-0b77-4f9a-b1d9-f0ac16240d4d] No waiting events found dispatching network-vif-plugged-ad3f0bca-081f-47c5-909b-2b2b2e2fe69f {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 12:00:39 user nova-compute[73449]: WARNING nova.compute.manager [req-cb3e027a-a80d-4ce3-82ae-78a8628309bb req-fe1a82e4-fa45-45b6-8192-98bdebdd58ac service nova] [instance: d160711b-0b77-4f9a-b1d9-f0ac16240d4d] Received unexpected event network-vif-plugged-ad3f0bca-081f-47c5-909b-2b2b2e2fe69f for instance with vm_state building and task_state spawning.
Aug 17 12:00:39 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:00:39 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:00:39 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:00:39 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:00:39 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:00:39 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:00:41 user nova-compute[73449]: DEBUG nova.compute.manager [req-d940f5bd-a985-4244-aff6-9935e4ea8fb5 req-c8aa6567-f0cb-44a4-bf07-11f4507b8213 service nova] [instance: d160711b-0b77-4f9a-b1d9-f0ac16240d4d] Received event network-vif-plugged-ad3f0bca-081f-47c5-909b-2b2b2e2fe69f {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:00:41 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-d940f5bd-a985-4244-aff6-9935e4ea8fb5 req-c8aa6567-f0cb-44a4-bf07-11f4507b8213 service nova] Acquiring lock "d160711b-0b77-4f9a-b1d9-f0ac16240d4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:00:41 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-d940f5bd-a985-4244-aff6-9935e4ea8fb5 req-c8aa6567-f0cb-44a4-bf07-11f4507b8213 service nova] Lock "d160711b-0b77-4f9a-b1d9-f0ac16240d4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:00:41 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-d940f5bd-a985-4244-aff6-9935e4ea8fb5 req-c8aa6567-f0cb-44a4-bf07-11f4507b8213 service nova] Lock "d160711b-0b77-4f9a-b1d9-f0ac16240d4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:00:41 user nova-compute[73449]: DEBUG nova.compute.manager [req-d940f5bd-a985-4244-aff6-9935e4ea8fb5 req-c8aa6567-f0cb-44a4-bf07-11f4507b8213 service nova] [instance: d160711b-0b77-4f9a-b1d9-f0ac16240d4d] No waiting events found dispatching network-vif-plugged-ad3f0bca-081f-47c5-909b-2b2b2e2fe69f {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 12:00:41 user nova-compute[73449]: WARNING nova.compute.manager [req-d940f5bd-a985-4244-aff6-9935e4ea8fb5 req-c8aa6567-f0cb-44a4-bf07-11f4507b8213 service nova] [instance: d160711b-0b77-4f9a-b1d9-f0ac16240d4d] Received unexpected event network-vif-plugged-ad3f0bca-081f-47c5-909b-2b2b2e2fe69f for instance with vm_state building and task_state spawning.
Aug 17 12:00:41 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692273641.4542756, d160711b-0b77-4f9a-b1d9-f0ac16240d4d => Resumed> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 12:00:41 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: d160711b-0b77-4f9a-b1d9-f0ac16240d4d] VM Resumed (Lifecycle Event)
Aug 17 12:00:41 user nova-compute[73449]: DEBUG nova.compute.manager [None req-937a8169-3023-4347-98b7-7a7655a95332 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: d160711b-0b77-4f9a-b1d9-f0ac16240d4d] Instance event wait completed in 0 seconds for  {{(pid=73449) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 12:00:41 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-937a8169-3023-4347-98b7-7a7655a95332 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: d160711b-0b77-4f9a-b1d9-f0ac16240d4d] Guest created on hypervisor {{(pid=73449) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 12:00:41 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: d160711b-0b77-4f9a-b1d9-f0ac16240d4d] Instance spawned successfully.
Aug 17 12:00:41 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-937a8169-3023-4347-98b7-7a7655a95332 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: d160711b-0b77-4f9a-b1d9-f0ac16240d4d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 12:00:41 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: d160711b-0b77-4f9a-b1d9-f0ac16240d4d] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 12:00:41 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: d160711b-0b77-4f9a-b1d9-f0ac16240d4d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 12:00:41 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-937a8169-3023-4347-98b7-7a7655a95332 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: d160711b-0b77-4f9a-b1d9-f0ac16240d4d] Found default for hw_cdrom_bus of ide {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 12:00:41 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-937a8169-3023-4347-98b7-7a7655a95332 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: d160711b-0b77-4f9a-b1d9-f0ac16240d4d] Found default for hw_disk_bus of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 12:00:41 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-937a8169-3023-4347-98b7-7a7655a95332 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: d160711b-0b77-4f9a-b1d9-f0ac16240d4d] Found default for hw_input_bus of None {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 12:00:41 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-937a8169-3023-4347-98b7-7a7655a95332 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: d160711b-0b77-4f9a-b1d9-f0ac16240d4d] Found default for hw_pointer_model of None {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 12:00:41 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-937a8169-3023-4347-98b7-7a7655a95332 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: d160711b-0b77-4f9a-b1d9-f0ac16240d4d] Found default for hw_video_model of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 12:00:41 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-937a8169-3023-4347-98b7-7a7655a95332 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: d160711b-0b77-4f9a-b1d9-f0ac16240d4d] Found default for hw_vif_model of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 12:00:41 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: d160711b-0b77-4f9a-b1d9-f0ac16240d4d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 12:00:41 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692273641.4617734, d160711b-0b77-4f9a-b1d9-f0ac16240d4d => Started> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 12:00:41 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: d160711b-0b77-4f9a-b1d9-f0ac16240d4d] VM Started (Lifecycle Event)
Aug 17 12:00:41 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: d160711b-0b77-4f9a-b1d9-f0ac16240d4d] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 12:00:41 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: d160711b-0b77-4f9a-b1d9-f0ac16240d4d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 12:00:41 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: d160711b-0b77-4f9a-b1d9-f0ac16240d4d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 12:00:41 user nova-compute[73449]: INFO nova.compute.manager [None req-937a8169-3023-4347-98b7-7a7655a95332 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: d160711b-0b77-4f9a-b1d9-f0ac16240d4d] Took 6.28 seconds to spawn the instance on the hypervisor.
Aug 17 12:00:41 user nova-compute[73449]: DEBUG nova.compute.manager [None req-937a8169-3023-4347-98b7-7a7655a95332 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: d160711b-0b77-4f9a-b1d9-f0ac16240d4d] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 12:00:41 user nova-compute[73449]: INFO nova.compute.manager [None req-937a8169-3023-4347-98b7-7a7655a95332 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: d160711b-0b77-4f9a-b1d9-f0ac16240d4d] Took 7.15 seconds to build instance.
Aug 17 12:00:41 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-937a8169-3023-4347-98b7-7a7655a95332 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Lock "d160711b-0b77-4f9a-b1d9-f0ac16240d4d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.254s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:00:42 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:00:43 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:00:47 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:00:48 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:00:52 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:00:53 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:00:54 user nova-compute[73449]: DEBUG nova.compute.manager [None req-dbc8cc12-6dae-435b-b800-d9dcc89daaa1 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 712c777e-251b-43d8-b923-8eda693f32ed] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 12:00:54 user nova-compute[73449]: INFO nova.compute.manager [None req-dbc8cc12-6dae-435b-b800-d9dcc89daaa1 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 712c777e-251b-43d8-b923-8eda693f32ed] instance snapshotting
Aug 17 12:00:54 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-dbc8cc12-6dae-435b-b800-d9dcc89daaa1 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 712c777e-251b-43d8-b923-8eda693f32ed] Beginning live snapshot process
Aug 17 12:00:54 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-dbc8cc12-6dae-435b-b800-d9dcc89daaa1 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/712c777e-251b-43d8-b923-8eda693f32ed/disk --force-share --output=json -f qcow2 {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:00:54 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-dbc8cc12-6dae-435b-b800-d9dcc89daaa1 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/712c777e-251b-43d8-b923-8eda693f32ed/disk --force-share --output=json -f qcow2" returned: 0 in 0.185s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:00:54 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-dbc8cc12-6dae-435b-b800-d9dcc89daaa1 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/712c777e-251b-43d8-b923-8eda693f32ed/disk --force-share --output=json -f qcow2 {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:00:55 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-dbc8cc12-6dae-435b-b800-d9dcc89daaa1 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/712c777e-251b-43d8-b923-8eda693f32ed/disk --force-share --output=json -f qcow2" returned: 0 in 0.175s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:00:55 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-dbc8cc12-6dae-435b-b800-d9dcc89daaa1 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:00:55 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-dbc8cc12-6dae-435b-b800-d9dcc89daaa1 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json" returned: 0 in 0.200s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:00:55 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-dbc8cc12-6dae-435b-b800-d9dcc89daaa1 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp0cqkp4sa/914164f294d64d59b1dba55ecdb1890a.delta 1073741824 {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:00:55 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-dbc8cc12-6dae-435b-b800-d9dcc89daaa1 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp0cqkp4sa/914164f294d64d59b1dba55ecdb1890a.delta 1073741824" returned: 0 in 0.066s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:00:55 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-dbc8cc12-6dae-435b-b800-d9dcc89daaa1 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 712c777e-251b-43d8-b923-8eda693f32ed] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 17 12:00:56 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-dbc8cc12-6dae-435b-b800-d9dcc89daaa1 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=73449) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 12:00:56 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-dbc8cc12-6dae-435b-b800-d9dcc89daaa1 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] COPY block job progress, current cursor: 75104256 final cursor: 75497472 {{(pid=73449) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 12:00:57 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-dbc8cc12-6dae-435b-b800-d9dcc89daaa1 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=73449) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 12:00:57 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-dbc8cc12-6dae-435b-b800-d9dcc89daaa1 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 712c777e-251b-43d8-b923-8eda693f32ed] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 17 12:00:57 user nova-compute[73449]: DEBUG nova.privsep.utils [None req-dbc8cc12-6dae-435b-b800-d9dcc89daaa1 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73449) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 12:00:57 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-dbc8cc12-6dae-435b-b800-d9dcc89daaa1 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp0cqkp4sa/914164f294d64d59b1dba55ecdb1890a.delta /opt/stack/data/nova/instances/snapshots/tmp0cqkp4sa/914164f294d64d59b1dba55ecdb1890a {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:00:57 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:00:57 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-dbc8cc12-6dae-435b-b800-d9dcc89daaa1 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp0cqkp4sa/914164f294d64d59b1dba55ecdb1890a.delta /opt/stack/data/nova/instances/snapshots/tmp0cqkp4sa/914164f294d64d59b1dba55ecdb1890a" returned: 0 in 0.466s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:00:57 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-dbc8cc12-6dae-435b-b800-d9dcc89daaa1 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 712c777e-251b-43d8-b923-8eda693f32ed] Snapshot extracted, beginning image upload
Aug 17 12:00:58 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:00:59 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-aae3e320-3e5e-4bdc-8fb6-d8460cf1da2d tempest-VolumesActionsTest-288873050 tempest-VolumesActionsTest-288873050-project-member] Acquiring lock "0d951782-d2d8-49a8-a0dc-05ac7f760c76" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:00:59 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-aae3e320-3e5e-4bdc-8fb6-d8460cf1da2d tempest-VolumesActionsTest-288873050 tempest-VolumesActionsTest-288873050-project-member] Lock "0d951782-d2d8-49a8-a0dc-05ac7f760c76" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:00:59 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-aae3e320-3e5e-4bdc-8fb6-d8460cf1da2d tempest-VolumesActionsTest-288873050 tempest-VolumesActionsTest-288873050-project-member] Acquiring lock "0d951782-d2d8-49a8-a0dc-05ac7f760c76-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:00:59 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-aae3e320-3e5e-4bdc-8fb6-d8460cf1da2d tempest-VolumesActionsTest-288873050 tempest-VolumesActionsTest-288873050-project-member] Lock "0d951782-d2d8-49a8-a0dc-05ac7f760c76-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:00:59 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-aae3e320-3e5e-4bdc-8fb6-d8460cf1da2d tempest-VolumesActionsTest-288873050 tempest-VolumesActionsTest-288873050-project-member] Lock "0d951782-d2d8-49a8-a0dc-05ac7f760c76-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:00:59 user nova-compute[73449]: INFO nova.compute.manager [None req-aae3e320-3e5e-4bdc-8fb6-d8460cf1da2d tempest-VolumesActionsTest-288873050 tempest-VolumesActionsTest-288873050-project-member] [instance: 0d951782-d2d8-49a8-a0dc-05ac7f760c76] Terminating instance
Aug 17 12:00:59 user nova-compute[73449]: DEBUG nova.compute.manager [None req-aae3e320-3e5e-4bdc-8fb6-d8460cf1da2d tempest-VolumesActionsTest-288873050 tempest-VolumesActionsTest-288873050-project-member] [instance: 0d951782-d2d8-49a8-a0dc-05ac7f760c76] Start destroying the instance on the hypervisor. {{(pid=73449) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 12:00:59 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:00:59 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:00:59 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:00:59 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:00:59 user nova-compute[73449]: DEBUG nova.compute.manager [req-007a1663-54b1-4752-9c68-fa5fa493916d req-206c4489-7169-44b2-b9f8-03beb8ab5e51 service nova] [instance: 0d951782-d2d8-49a8-a0dc-05ac7f760c76] Received event network-vif-unplugged-c73bdc59-4b2b-46ff-94c5-a0fc69c7171a {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:00:59 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-007a1663-54b1-4752-9c68-fa5fa493916d req-206c4489-7169-44b2-b9f8-03beb8ab5e51 service nova] Acquiring lock "0d951782-d2d8-49a8-a0dc-05ac7f760c76-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:00:59 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-007a1663-54b1-4752-9c68-fa5fa493916d req-206c4489-7169-44b2-b9f8-03beb8ab5e51 service nova] Lock "0d951782-d2d8-49a8-a0dc-05ac7f760c76-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:00:59 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-007a1663-54b1-4752-9c68-fa5fa493916d req-206c4489-7169-44b2-b9f8-03beb8ab5e51 service nova] Lock "0d951782-d2d8-49a8-a0dc-05ac7f760c76-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:00:59 user nova-compute[73449]: DEBUG nova.compute.manager [req-007a1663-54b1-4752-9c68-fa5fa493916d req-206c4489-7169-44b2-b9f8-03beb8ab5e51 service nova] [instance: 0d951782-d2d8-49a8-a0dc-05ac7f760c76] No waiting events found dispatching network-vif-unplugged-c73bdc59-4b2b-46ff-94c5-a0fc69c7171a {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 12:00:59 user nova-compute[73449]: DEBUG nova.compute.manager [req-007a1663-54b1-4752-9c68-fa5fa493916d req-206c4489-7169-44b2-b9f8-03beb8ab5e51 service nova] [instance: 0d951782-d2d8-49a8-a0dc-05ac7f760c76] Received event network-vif-unplugged-c73bdc59-4b2b-46ff-94c5-a0fc69c7171a for instance with task_state deleting. {{(pid=73449) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 12:00:59 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: 0d951782-d2d8-49a8-a0dc-05ac7f760c76] Instance destroyed successfully.
Aug 17 12:00:59 user nova-compute[73449]: DEBUG nova.objects.instance [None req-aae3e320-3e5e-4bdc-8fb6-d8460cf1da2d tempest-VolumesActionsTest-288873050 tempest-VolumesActionsTest-288873050-project-member] Lazy-loading 'resources' on Instance uuid 0d951782-d2d8-49a8-a0dc-05ac7f760c76 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:00:59 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-aae3e320-3e5e-4bdc-8fb6-d8460cf1da2d tempest-VolumesActionsTest-288873050 tempest-VolumesActionsTest-288873050-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:58:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-205750759',display_name='tempest-VolumesActionsTest-instance-205750759',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-205750759',id=39,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T11:59:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dc901d3128884f13a0c03a6b2a74dac3',ramdisk_id='',reservation_id='r-umxmyjpe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-288873050',owner_user_name='tempest-VolumesActionsTest-288873050-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T11:59:05Z,user_data=None,user_id='f70813193df3451e95c7a8e949773329',uuid=0d951782-d2d8-49a8-a0dc-05ac7f760c76,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c73bdc59-4b2b-46ff-94c5-a0fc69c7171a", "address": "fa:16:3e:1c:0d:0d", "network": {"id": "c3442408-5ba7-434f-ad13-f243642e135d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1898321127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc901d3128884f13a0c03a6b2a74dac3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc73bdc59-4b", "ovs_interfaceid": "c73bdc59-4b2b-46ff-94c5-a0fc69c7171a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 12:00:59 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-aae3e320-3e5e-4bdc-8fb6-d8460cf1da2d tempest-VolumesActionsTest-288873050 tempest-VolumesActionsTest-288873050-project-member] Converting VIF {"id": "c73bdc59-4b2b-46ff-94c5-a0fc69c7171a", "address": "fa:16:3e:1c:0d:0d", "network": {"id": "c3442408-5ba7-434f-ad13-f243642e135d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1898321127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc901d3128884f13a0c03a6b2a74dac3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc73bdc59-4b", "ovs_interfaceid": "c73bdc59-4b2b-46ff-94c5-a0fc69c7171a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 12:00:59 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-aae3e320-3e5e-4bdc-8fb6-d8460cf1da2d tempest-VolumesActionsTest-288873050 tempest-VolumesActionsTest-288873050-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:0d:0d,bridge_name='br-int',has_traffic_filtering=True,id=c73bdc59-4b2b-46ff-94c5-a0fc69c7171a,network=Network(c3442408-5ba7-434f-ad13-f243642e135d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc73bdc59-4b') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 12:00:59 user nova-compute[73449]: DEBUG os_vif [None req-aae3e320-3e5e-4bdc-8fb6-d8460cf1da2d tempest-VolumesActionsTest-288873050 tempest-VolumesActionsTest-288873050-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:0d:0d,bridge_name='br-int',has_traffic_filtering=True,id=c73bdc59-4b2b-46ff-94c5-a0fc69c7171a,network=Network(c3442408-5ba7-434f-ad13-f243642e135d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc73bdc59-4b') {{(pid=73449) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 12:00:59 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:00:59 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc73bdc59-4b, bridge=br-int, if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 12:00:59 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:00:59 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:00:59 user nova-compute[73449]: INFO os_vif [None req-aae3e320-3e5e-4bdc-8fb6-d8460cf1da2d tempest-VolumesActionsTest-288873050 tempest-VolumesActionsTest-288873050-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:0d:0d,bridge_name='br-int',has_traffic_filtering=True,id=c73bdc59-4b2b-46ff-94c5-a0fc69c7171a,network=Network(c3442408-5ba7-434f-ad13-f243642e135d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc73bdc59-4b')
Aug 17 12:00:59 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-aae3e320-3e5e-4bdc-8fb6-d8460cf1da2d tempest-VolumesActionsTest-288873050 tempest-VolumesActionsTest-288873050-project-member] [instance: 0d951782-d2d8-49a8-a0dc-05ac7f760c76] Deleting instance files /opt/stack/data/nova/instances/0d951782-d2d8-49a8-a0dc-05ac7f760c76_del
Aug 17 12:00:59 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-aae3e320-3e5e-4bdc-8fb6-d8460cf1da2d tempest-VolumesActionsTest-288873050 tempest-VolumesActionsTest-288873050-project-member] [instance: 0d951782-d2d8-49a8-a0dc-05ac7f760c76] Deletion of /opt/stack/data/nova/instances/0d951782-d2d8-49a8-a0dc-05ac7f760c76_del complete
Aug 17 12:00:59 user nova-compute[73449]: INFO nova.compute.manager [None req-aae3e320-3e5e-4bdc-8fb6-d8460cf1da2d tempest-VolumesActionsTest-288873050 tempest-VolumesActionsTest-288873050-project-member] [instance: 0d951782-d2d8-49a8-a0dc-05ac7f760c76] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 17 12:00:59 user nova-compute[73449]: DEBUG oslo.service.loopingcall [None req-aae3e320-3e5e-4bdc-8fb6-d8460cf1da2d tempest-VolumesActionsTest-288873050 tempest-VolumesActionsTest-288873050-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73449) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 12:00:59 user nova-compute[73449]: DEBUG nova.compute.manager [-] [instance: 0d951782-d2d8-49a8-a0dc-05ac7f760c76] Deallocating network for instance {{(pid=73449) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 12:00:59 user nova-compute[73449]: DEBUG nova.network.neutron [-] [instance: 0d951782-d2d8-49a8-a0dc-05ac7f760c76] deallocate_for_instance() {{(pid=73449) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 12:01:00 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-dbc8cc12-6dae-435b-b800-d9dcc89daaa1 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 712c777e-251b-43d8-b923-8eda693f32ed] Snapshot image upload complete
Aug 17 12:01:00 user nova-compute[73449]: INFO nova.compute.manager [None req-dbc8cc12-6dae-435b-b800-d9dcc89daaa1 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 712c777e-251b-43d8-b923-8eda693f32ed] Took 5.82 seconds to snapshot the instance on the hypervisor.
Aug 17 12:01:00 user nova-compute[73449]: DEBUG nova.network.neutron [-] [instance: 0d951782-d2d8-49a8-a0dc-05ac7f760c76] Updating instance_info_cache with network_info: [] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 12:01:00 user nova-compute[73449]: INFO nova.compute.manager [-] [instance: 0d951782-d2d8-49a8-a0dc-05ac7f760c76] Took 0.59 seconds to deallocate network for instance.
Aug 17 12:01:00 user nova-compute[73449]: DEBUG nova.compute.manager [req-135e7744-a661-4f4e-bc75-6e7569b89430 req-a78fb357-fcad-46f1-96f5-641de094e129 service nova] [instance: 0d951782-d2d8-49a8-a0dc-05ac7f760c76] Received event network-vif-deleted-c73bdc59-4b2b-46ff-94c5-a0fc69c7171a {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:01:00 user nova-compute[73449]: INFO nova.compute.manager [req-135e7744-a661-4f4e-bc75-6e7569b89430 req-a78fb357-fcad-46f1-96f5-641de094e129 service nova] [instance: 0d951782-d2d8-49a8-a0dc-05ac7f760c76] Neutron deleted interface c73bdc59-4b2b-46ff-94c5-a0fc69c7171a; detaching it from the instance and deleting it from the info cache
Aug 17 12:01:00 user nova-compute[73449]: DEBUG nova.network.neutron [req-135e7744-a661-4f4e-bc75-6e7569b89430 req-a78fb357-fcad-46f1-96f5-641de094e129 service nova] [instance: 0d951782-d2d8-49a8-a0dc-05ac7f760c76] Updating instance_info_cache with network_info: [] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 12:01:00 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-aae3e320-3e5e-4bdc-8fb6-d8460cf1da2d tempest-VolumesActionsTest-288873050 tempest-VolumesActionsTest-288873050-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:01:00 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-aae3e320-3e5e-4bdc-8fb6-d8460cf1da2d tempest-VolumesActionsTest-288873050 tempest-VolumesActionsTest-288873050-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:01:00 user nova-compute[73449]: DEBUG nova.compute.manager [req-135e7744-a661-4f4e-bc75-6e7569b89430 req-a78fb357-fcad-46f1-96f5-641de094e129 service nova] [instance: 0d951782-d2d8-49a8-a0dc-05ac7f760c76] Detach interface failed, port_id=c73bdc59-4b2b-46ff-94c5-a0fc69c7171a, reason: Instance 0d951782-d2d8-49a8-a0dc-05ac7f760c76 could not be found. {{(pid=73449) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 12:01:00 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-aae3e320-3e5e-4bdc-8fb6-d8460cf1da2d tempest-VolumesActionsTest-288873050 tempest-VolumesActionsTest-288873050-project-member] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 12:01:00 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-aae3e320-3e5e-4bdc-8fb6-d8460cf1da2d tempest-VolumesActionsTest-288873050 tempest-VolumesActionsTest-288873050-project-member] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 12:01:00 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-aae3e320-3e5e-4bdc-8fb6-d8460cf1da2d tempest-VolumesActionsTest-288873050 tempest-VolumesActionsTest-288873050-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.376s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:01:01 user nova-compute[73449]: INFO nova.scheduler.client.report [None req-aae3e320-3e5e-4bdc-8fb6-d8460cf1da2d tempest-VolumesActionsTest-288873050 tempest-VolumesActionsTest-288873050-project-member] Deleted allocations for instance 0d951782-d2d8-49a8-a0dc-05ac7f760c76
Aug 17 12:01:01 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-aae3e320-3e5e-4bdc-8fb6-d8460cf1da2d tempest-VolumesActionsTest-288873050 tempest-VolumesActionsTest-288873050-project-member] Lock "0d951782-d2d8-49a8-a0dc-05ac7f760c76" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.081s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:01:01 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:01:01 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:01:01 user nova-compute[73449]: DEBUG nova.compute.manager [req-2d17fc52-ff11-4005-81b0-12d2559e9ab9 req-67d3fa38-cc46-4329-9875-f2d6efe6c49d service nova] [instance: 0d951782-d2d8-49a8-a0dc-05ac7f760c76] Received event network-vif-plugged-c73bdc59-4b2b-46ff-94c5-a0fc69c7171a {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:01:01 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-2d17fc52-ff11-4005-81b0-12d2559e9ab9 req-67d3fa38-cc46-4329-9875-f2d6efe6c49d service nova] Acquiring lock "0d951782-d2d8-49a8-a0dc-05ac7f760c76-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:01:01 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-2d17fc52-ff11-4005-81b0-12d2559e9ab9 req-67d3fa38-cc46-4329-9875-f2d6efe6c49d service nova] Lock "0d951782-d2d8-49a8-a0dc-05ac7f760c76-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:01:01 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-2d17fc52-ff11-4005-81b0-12d2559e9ab9 req-67d3fa38-cc46-4329-9875-f2d6efe6c49d service nova] Lock "0d951782-d2d8-49a8-a0dc-05ac7f760c76-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:01:01 user nova-compute[73449]: DEBUG nova.compute.manager [req-2d17fc52-ff11-4005-81b0-12d2559e9ab9 req-67d3fa38-cc46-4329-9875-f2d6efe6c49d service nova] [instance: 0d951782-d2d8-49a8-a0dc-05ac7f760c76] No waiting events found dispatching network-vif-plugged-c73bdc59-4b2b-46ff-94c5-a0fc69c7171a {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 12:01:01 user nova-compute[73449]: WARNING nova.compute.manager [req-2d17fc52-ff11-4005-81b0-12d2559e9ab9 req-67d3fa38-cc46-4329-9875-f2d6efe6c49d service nova] [instance: 0d951782-d2d8-49a8-a0dc-05ac7f760c76] Received unexpected event network-vif-plugged-c73bdc59-4b2b-46ff-94c5-a0fc69c7171a for instance with vm_state deleted and task_state None.
Aug 17 12:01:02 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:01:02 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:01:02 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73449) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 12:01:03 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:01:03 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:01:03 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Cleaning up deleted instances {{(pid=73449) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 17 12:01:03 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] There are 0 instances to clean {{(pid=73449) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 17 12:01:04 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:01:04 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:01:08 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:01:09 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:01:09 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:01:09 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:01:10 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:01:10 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Starting heal instance info cache {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 12:01:11 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "refresh_cache-89440604-1daf-4e7a-a524-2f9c21a9cb96" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 12:01:11 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquired lock "refresh_cache-89440604-1daf-4e7a-a524-2f9c21a9cb96" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 12:01:11 user nova-compute[73449]: DEBUG nova.network.neutron [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: 89440604-1daf-4e7a-a524-2f9c21a9cb96] Forcefully refreshing network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 12:01:11 user nova-compute[73449]: DEBUG nova.network.neutron [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: 89440604-1daf-4e7a-a524-2f9c21a9cb96] Updating instance_info_cache with network_info: [{"id": "7ebcec20-01ec-4807-876d-d95bff0a8a77", "address": "fa:16:3e:52:45:6e", "network": {"id": "9455bb75-f75a-41ff-8f6f-49f55aa738f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-425274599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec3b0b72e47448ebe99f9fc64119c1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ebcec20-01", "ovs_interfaceid": "7ebcec20-01ec-4807-876d-d95bff0a8a77", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 12:01:11 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Releasing lock "refresh_cache-89440604-1daf-4e7a-a524-2f9c21a9cb96" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 12:01:11 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: 89440604-1daf-4e7a-a524-2f9c21a9cb96] Updated the network info_cache for instance {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 12:01:11 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:01:11 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:01:11 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:01:11 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:01:11 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=73449) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 12:01:11 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/712c777e-251b-43d8-b923-8eda693f32ed/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:01:11 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/712c777e-251b-43d8-b923-8eda693f32ed/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:01:11 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/712c777e-251b-43d8-b923-8eda693f32ed/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:01:11 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-89dc223c-7f50-4c46-ac06-6478bfce6582 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Acquiring lock "042713b8-ab7f-4c14-92e5-f830ccb7e341" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:01:11 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-89dc223c-7f50-4c46-ac06-6478bfce6582 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Lock "042713b8-ab7f-4c14-92e5-f830ccb7e341" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:01:11 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-89dc223c-7f50-4c46-ac06-6478bfce6582 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Acquiring lock "042713b8-ab7f-4c14-92e5-f830ccb7e341-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:01:11 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-89dc223c-7f50-4c46-ac06-6478bfce6582 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Lock "042713b8-ab7f-4c14-92e5-f830ccb7e341-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:01:11 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-89dc223c-7f50-4c46-ac06-6478bfce6582 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Lock "042713b8-ab7f-4c14-92e5-f830ccb7e341-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:01:11 user nova-compute[73449]: INFO nova.compute.manager [None req-89dc223c-7f50-4c46-ac06-6478bfce6582 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Terminating instance
Aug 17 12:01:11 user nova-compute[73449]: DEBUG nova.compute.manager [None req-89dc223c-7f50-4c46-ac06-6478bfce6582 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Start destroying the instance on the hypervisor. {{(pid=73449) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 12:01:12 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:01:12 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:01:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/712c777e-251b-43d8-b923-8eda693f32ed/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:01:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cacd9ed-27fb-431d-999e-31ff2464d14d/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:01:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cacd9ed-27fb-431d-999e-31ff2464d14d/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:01:12 user nova-compute[73449]: DEBUG nova.compute.manager [req-bd1c9e03-4d6e-48e1-b0f5-78689b8f9a9f req-24bdc83d-ef87-451a-8b0f-2ef9d8569bcc service nova] [instance: 5ceec4cb-f976-4978-a4fd-73d84d56c5c5] Received event network-changed-cea7daf1-fb9f-443c-bae0-184478deda7e {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:01:12 user nova-compute[73449]: DEBUG nova.compute.manager [req-bd1c9e03-4d6e-48e1-b0f5-78689b8f9a9f req-24bdc83d-ef87-451a-8b0f-2ef9d8569bcc service nova] [instance: 5ceec4cb-f976-4978-a4fd-73d84d56c5c5] Refreshing instance network info cache due to event network-changed-cea7daf1-fb9f-443c-bae0-184478deda7e. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 12:01:12 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-bd1c9e03-4d6e-48e1-b0f5-78689b8f9a9f req-24bdc83d-ef87-451a-8b0f-2ef9d8569bcc service nova] Acquiring lock "refresh_cache-5ceec4cb-f976-4978-a4fd-73d84d56c5c5" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 12:01:12 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-bd1c9e03-4d6e-48e1-b0f5-78689b8f9a9f req-24bdc83d-ef87-451a-8b0f-2ef9d8569bcc service nova] Acquired lock "refresh_cache-5ceec4cb-f976-4978-a4fd-73d84d56c5c5" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 12:01:12 user nova-compute[73449]: DEBUG nova.network.neutron [req-bd1c9e03-4d6e-48e1-b0f5-78689b8f9a9f req-24bdc83d-ef87-451a-8b0f-2ef9d8569bcc service nova] [instance: 5ceec4cb-f976-4978-a4fd-73d84d56c5c5] Refreshing network info cache for port cea7daf1-fb9f-443c-bae0-184478deda7e {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 12:01:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cacd9ed-27fb-431d-999e-31ff2464d14d/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:01:12 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:01:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cacd9ed-27fb-431d-999e-31ff2464d14d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:01:12 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=73449) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 12:01:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/042713b8-ab7f-4c14-92e5-f830ccb7e341/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:01:12 user nova-compute[73449]: DEBUG nova.network.neutron [req-bd1c9e03-4d6e-48e1-b0f5-78689b8f9a9f req-24bdc83d-ef87-451a-8b0f-2ef9d8569bcc service nova] [instance: 5ceec4cb-f976-4978-a4fd-73d84d56c5c5] Updated VIF entry in instance network info cache for port cea7daf1-fb9f-443c-bae0-184478deda7e. {{(pid=73449) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 12:01:12 user nova-compute[73449]: DEBUG nova.network.neutron [req-bd1c9e03-4d6e-48e1-b0f5-78689b8f9a9f req-24bdc83d-ef87-451a-8b0f-2ef9d8569bcc service nova] [instance: 5ceec4cb-f976-4978-a4fd-73d84d56c5c5] Updating instance_info_cache with network_info: [{"id": "cea7daf1-fb9f-443c-bae0-184478deda7e", "address": "fa:16:3e:83:12:ce", "network": {"id": "a9e8fcd6-4152-466b-99ad-44b85db05a05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-920564935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bd46cdaff7a4b40955f7c8a12c55452", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcea7daf1-fb", "ovs_interfaceid": "cea7daf1-fb9f-443c-bae0-184478deda7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 12:01:12 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Instance destroyed successfully.
Aug 17 12:01:12 user nova-compute[73449]: DEBUG nova.objects.instance [None req-89dc223c-7f50-4c46-ac06-6478bfce6582 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Lazy-loading 'resources' on Instance uuid 042713b8-ab7f-4c14-92e5-f830ccb7e341 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:01:12 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-bd1c9e03-4d6e-48e1-b0f5-78689b8f9a9f req-24bdc83d-ef87-451a-8b0f-2ef9d8569bcc service nova] Releasing lock "refresh_cache-5ceec4cb-f976-4978-a4fd-73d84d56c5c5" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 12:01:12 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-89dc223c-7f50-4c46-ac06-6478bfce6582 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:54:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2055880093',display_name='tempest-ServerRescueNegativeTestJSON-server-2055880093',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2055880093',id=34,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOzW+ki2tzNTWzsdXwhyQ03cag1C3bEbz4eJdcMuqAgtDjoLdQ3HPC6EUYWRZynVvfgMyInuHXXmT1luJVuM3RFN3wpNlldPLaGdqryaccibJZE4kiB5wj8hgruKiBMU7w==',key_name='tempest-keypair-297071468',keypairs=<?>,launch_index=0,launched_at=2023-08-17T11:56:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8722edee53ed4a9188366c38f3b8b52f',ramdisk_id='',reservation_id='r-ii2ldcnj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1458167730',owner_user_name='tempest-ServerRescueNegativeTestJSON-1458167730-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T11:58:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ccb76bc93f84e0897da59b8d5928238',uuid=042713b8-ab7f-4c14-92e5-f830ccb7e341,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2ce1927a-6866-4362-bc0c-88cd0a19fa08", "address": "fa:16:3e:f5:89:a9", "network": {"id": "f7298070-baaa-4842-b3b2-d9fe1058d3b6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1715911399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8722edee53ed4a9188366c38f3b8b52f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ce1927a-68", "ovs_interfaceid": "2ce1927a-6866-4362-bc0c-88cd0a19fa08", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 12:01:12 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-89dc223c-7f50-4c46-ac06-6478bfce6582 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Converting VIF {"id": "2ce1927a-6866-4362-bc0c-88cd0a19fa08", "address": "fa:16:3e:f5:89:a9", "network": {"id": "f7298070-baaa-4842-b3b2-d9fe1058d3b6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1715911399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8722edee53ed4a9188366c38f3b8b52f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ce1927a-68", "ovs_interfaceid": "2ce1927a-6866-4362-bc0c-88cd0a19fa08", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 12:01:12 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-89dc223c-7f50-4c46-ac06-6478bfce6582 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f5:89:a9,bridge_name='br-int',has_traffic_filtering=True,id=2ce1927a-6866-4362-bc0c-88cd0a19fa08,network=Network(f7298070-baaa-4842-b3b2-d9fe1058d3b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ce1927a-68') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 12:01:12 user nova-compute[73449]: DEBUG os_vif [None req-89dc223c-7f50-4c46-ac06-6478bfce6582 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:89:a9,bridge_name='br-int',has_traffic_filtering=True,id=2ce1927a-6866-4362-bc0c-88cd0a19fa08,network=Network(f7298070-baaa-4842-b3b2-d9fe1058d3b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ce1927a-68') {{(pid=73449) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 12:01:12 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:01:12 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2ce1927a-68, bridge=br-int, if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 12:01:12 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:01:12 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:01:12 user nova-compute[73449]: INFO os_vif [None req-89dc223c-7f50-4c46-ac06-6478bfce6582 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:89:a9,bridge_name='br-int',has_traffic_filtering=True,id=2ce1927a-6866-4362-bc0c-88cd0a19fa08,network=Network(f7298070-baaa-4842-b3b2-d9fe1058d3b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ce1927a-68')
Aug 17 12:01:12 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-89dc223c-7f50-4c46-ac06-6478bfce6582 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Deleting instance files /opt/stack/data/nova/instances/042713b8-ab7f-4c14-92e5-f830ccb7e341_del
Aug 17 12:01:12 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-89dc223c-7f50-4c46-ac06-6478bfce6582 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Deletion of /opt/stack/data/nova/instances/042713b8-ab7f-4c14-92e5-f830ccb7e341_del complete
Aug 17 12:01:12 user nova-compute[73449]: INFO nova.compute.manager [None req-89dc223c-7f50-4c46-ac06-6478bfce6582 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Took 0.98 seconds to destroy the instance on the hypervisor.
Aug 17 12:01:12 user nova-compute[73449]: DEBUG oslo.service.loopingcall [None req-89dc223c-7f50-4c46-ac06-6478bfce6582 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73449) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 12:01:12 user nova-compute[73449]: DEBUG nova.compute.manager [-] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Deallocating network for instance {{(pid=73449) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 12:01:12 user nova-compute[73449]: DEBUG nova.network.neutron [-] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] deallocate_for_instance() {{(pid=73449) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 12:01:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/042713b8-ab7f-4c14-92e5-f830ccb7e341/disk --force-share --output=json" returned: 1 in 0.197s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:01:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/042713b8-ab7f-4c14-92e5-f830ccb7e341/disk --force-share --output=json' failed. Not Retrying. {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 12:01:12 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Periodic task is updating the host stats, it is trying to get disk info for instance-00000022, but the backing disk storage was removed by a concurrent operation such as resize. Error: No disk at /opt/stack/data/nova/instances/042713b8-ab7f-4c14-92e5-f830ccb7e341/disk: nova.exception.DiskNotFound: No disk at /opt/stack/data/nova/instances/042713b8-ab7f-4c14-92e5-f830ccb7e341/disk
Aug 17 12:01:12 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73449) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 12:01:12 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73449) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 12:01:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk.rescue --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:01:13 user nova-compute[73449]: DEBUG nova.compute.manager [req-d3c56f49-f0f2-4f61-b2bb-fcde34163e98 req-4beb8209-046c-4130-af40-57d63ddc8679 service nova] [instance: 5ceec4cb-f976-4978-a4fd-73d84d56c5c5] Received event network-changed-cea7daf1-fb9f-443c-bae0-184478deda7e {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:01:13 user nova-compute[73449]: DEBUG nova.compute.manager [req-d3c56f49-f0f2-4f61-b2bb-fcde34163e98 req-4beb8209-046c-4130-af40-57d63ddc8679 service nova] [instance: 5ceec4cb-f976-4978-a4fd-73d84d56c5c5] Refreshing instance network info cache due to event network-changed-cea7daf1-fb9f-443c-bae0-184478deda7e. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 12:01:13 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-d3c56f49-f0f2-4f61-b2bb-fcde34163e98 req-4beb8209-046c-4130-af40-57d63ddc8679 service nova] Acquiring lock "refresh_cache-5ceec4cb-f976-4978-a4fd-73d84d56c5c5" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 12:01:13 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-d3c56f49-f0f2-4f61-b2bb-fcde34163e98 req-4beb8209-046c-4130-af40-57d63ddc8679 service nova] Acquired lock "refresh_cache-5ceec4cb-f976-4978-a4fd-73d84d56c5c5" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 12:01:13 user nova-compute[73449]: DEBUG nova.network.neutron [req-d3c56f49-f0f2-4f61-b2bb-fcde34163e98 req-4beb8209-046c-4130-af40-57d63ddc8679 service nova] [instance: 5ceec4cb-f976-4978-a4fd-73d84d56c5c5] Refreshing network info cache for port cea7daf1-fb9f-443c-bae0-184478deda7e {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 12:01:13 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:01:13 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk.rescue --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:01:13 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-5530e2a5-4575-4690-a4e1-765bc97e759e tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Acquiring lock "5ceec4cb-f976-4978-a4fd-73d84d56c5c5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:01:13 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-5530e2a5-4575-4690-a4e1-765bc97e759e tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Lock "5ceec4cb-f976-4978-a4fd-73d84d56c5c5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:01:13 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-5530e2a5-4575-4690-a4e1-765bc97e759e tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Acquiring lock "5ceec4cb-f976-4978-a4fd-73d84d56c5c5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:01:13 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-5530e2a5-4575-4690-a4e1-765bc97e759e tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Lock "5ceec4cb-f976-4978-a4fd-73d84d56c5c5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:01:13 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-5530e2a5-4575-4690-a4e1-765bc97e759e tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Lock "5ceec4cb-f976-4978-a4fd-73d84d56c5c5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:01:13 user nova-compute[73449]: INFO nova.compute.manager [None req-5530e2a5-4575-4690-a4e1-765bc97e759e tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 5ceec4cb-f976-4978-a4fd-73d84d56c5c5] Terminating instance
Aug 17 12:01:13 user nova-compute[73449]: DEBUG nova.compute.manager [None req-5530e2a5-4575-4690-a4e1-765bc97e759e tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 5ceec4cb-f976-4978-a4fd-73d84d56c5c5] Start destroying the instance on the hypervisor. {{(pid=73449) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 12:01:13 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:01:13 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:01:13 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:01:13 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:01:13 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:01:13 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:01:13 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:01:13 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:01:13 user nova-compute[73449]: DEBUG nova.network.neutron [req-d3c56f49-f0f2-4f61-b2bb-fcde34163e98 req-4beb8209-046c-4130-af40-57d63ddc8679 service nova] [instance: 5ceec4cb-f976-4978-a4fd-73d84d56c5c5] Updated VIF entry in instance network info cache for port cea7daf1-fb9f-443c-bae0-184478deda7e. {{(pid=73449) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 12:01:13 user nova-compute[73449]: DEBUG nova.network.neutron [req-d3c56f49-f0f2-4f61-b2bb-fcde34163e98 req-4beb8209-046c-4130-af40-57d63ddc8679 service nova] [instance: 5ceec4cb-f976-4978-a4fd-73d84d56c5c5] Updating instance_info_cache with network_info: [{"id": "cea7daf1-fb9f-443c-bae0-184478deda7e", "address": "fa:16:3e:83:12:ce", "network": {"id": "a9e8fcd6-4152-466b-99ad-44b85db05a05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-920564935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bd46cdaff7a4b40955f7c8a12c55452", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcea7daf1-fb", "ovs_interfaceid": "cea7daf1-fb9f-443c-bae0-184478deda7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 12:01:13 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-d3c56f49-f0f2-4f61-b2bb-fcde34163e98 req-4beb8209-046c-4130-af40-57d63ddc8679 service nova] Releasing lock "refresh_cache-5ceec4cb-f976-4978-a4fd-73d84d56c5c5" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 12:01:13 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:01:13 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b7932d8-b781-4db7-a1c5-791ce8d1d866/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:01:13 user nova-compute[73449]: DEBUG nova.network.neutron [-] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Updating instance_info_cache with network_info: [] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 12:01:13 user nova-compute[73449]: DEBUG nova.compute.manager [req-8c510da5-0259-4ec0-8c84-ee76bc1c326e req-627decb7-b399-4011-9059-89b992539efb service nova] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Received event network-vif-deleted-2ce1927a-6866-4362-bc0c-88cd0a19fa08 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:01:13 user nova-compute[73449]: INFO nova.compute.manager [req-8c510da5-0259-4ec0-8c84-ee76bc1c326e req-627decb7-b399-4011-9059-89b992539efb service nova] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Neutron deleted interface 2ce1927a-6866-4362-bc0c-88cd0a19fa08; detaching it from the instance and deleting it from the info cache
Aug 17 12:01:13 user nova-compute[73449]: DEBUG nova.network.neutron [req-8c510da5-0259-4ec0-8c84-ee76bc1c326e req-627decb7-b399-4011-9059-89b992539efb service nova] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Updating instance_info_cache with network_info: [] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 12:01:13 user nova-compute[73449]: INFO nova.compute.manager [-] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Took 0.96 seconds to deallocate network for instance.
Aug 17 12:01:13 user nova-compute[73449]: DEBUG nova.compute.manager [req-8c510da5-0259-4ec0-8c84-ee76bc1c326e req-627decb7-b399-4011-9059-89b992539efb service nova] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Detach interface failed, port_id=2ce1927a-6866-4362-bc0c-88cd0a19fa08, reason: Instance 042713b8-ab7f-4c14-92e5-f830ccb7e341 could not be found. {{(pid=73449) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 12:01:13 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b7932d8-b781-4db7-a1c5-791ce8d1d866/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:01:13 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b7932d8-b781-4db7-a1c5-791ce8d1d866/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:01:14 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-89dc223c-7f50-4c46-ac06-6478bfce6582 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:01:14 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-89dc223c-7f50-4c46-ac06-6478bfce6582 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:01:14 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: 5ceec4cb-f976-4978-a4fd-73d84d56c5c5] Instance destroyed successfully.
Aug 17 12:01:14 user nova-compute[73449]: DEBUG nova.objects.instance [None req-5530e2a5-4575-4690-a4e1-765bc97e759e tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Lazy-loading 'resources' on Instance uuid 5ceec4cb-f976-4978-a4fd-73d84d56c5c5 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:01:14 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-5530e2a5-4575-4690-a4e1-765bc97e759e tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:59:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1066178544',display_name='tempest-TestVolumeBootPattern-server-1066178544',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1066178544',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIHMstqa6z3yCDWSo0nI/hXtJfgb+1MPwAN30vhg6KwDR8sZaSoGZeJ4pbZmuMNqk20Z45pPhufbqYZm+wNKDW7ChjAcmHiitPsVRUAo/TWnRjbFauozfEZ44NXHQWQQfg==',key_name='tempest-TestVolumeBootPattern-29823023',keypairs=<?>,launch_index=0,launched_at=2023-08-17T11:59:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4bd46cdaff7a4b40955f7c8a12c55452',ramdisk_id='',reservation_id='r-8dkaw26u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-813872552',owner_user_name='tempest-TestVolumeBootPattern-813872552-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T11:59:38Z,user_data=None,user_id='804ccb0440fb46a4a4c0ae65c3893296',uuid=5ceec4cb-f976-4978-a4fd-73d84d56c5c5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cea7daf1-fb9f-443c-bae0-184478deda7e", "address": "fa:16:3e:83:12:ce", "network": {"id": "a9e8fcd6-4152-466b-99ad-44b85db05a05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-920564935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bd46cdaff7a4b40955f7c8a12c55452", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcea7daf1-fb", "ovs_interfaceid": "cea7daf1-fb9f-443c-bae0-184478deda7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 12:01:14 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-5530e2a5-4575-4690-a4e1-765bc97e759e tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Converting VIF {"id": "cea7daf1-fb9f-443c-bae0-184478deda7e", "address": "fa:16:3e:83:12:ce", "network": {"id": "a9e8fcd6-4152-466b-99ad-44b85db05a05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-920564935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bd46cdaff7a4b40955f7c8a12c55452", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcea7daf1-fb", "ovs_interfaceid": "cea7daf1-fb9f-443c-bae0-184478deda7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 12:01:14 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-5530e2a5-4575-4690-a4e1-765bc97e759e tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:83:12:ce,bridge_name='br-int',has_traffic_filtering=True,id=cea7daf1-fb9f-443c-bae0-184478deda7e,network=Network(a9e8fcd6-4152-466b-99ad-44b85db05a05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcea7daf1-fb') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 12:01:14 user nova-compute[73449]: DEBUG os_vif [None req-5530e2a5-4575-4690-a4e1-765bc97e759e tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:83:12:ce,bridge_name='br-int',has_traffic_filtering=True,id=cea7daf1-fb9f-443c-bae0-184478deda7e,network=Network(a9e8fcd6-4152-466b-99ad-44b85db05a05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcea7daf1-fb') {{(pid=73449) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 12:01:14 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:01:14 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcea7daf1-fb, bridge=br-int, if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 12:01:14 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:01:14 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:01:14 user nova-compute[73449]: INFO os_vif [None req-5530e2a5-4575-4690-a4e1-765bc97e759e tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:83:12:ce,bridge_name='br-int',has_traffic_filtering=True,id=cea7daf1-fb9f-443c-bae0-184478deda7e,network=Network(a9e8fcd6-4152-466b-99ad-44b85db05a05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcea7daf1-fb')
Aug 17 12:01:14 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5530e2a5-4575-4690-a4e1-765bc97e759e tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 5ceec4cb-f976-4978-a4fd-73d84d56c5c5] calling os-brick to detach iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 12:01:14 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-5530e2a5-4575-4690-a4e1-765bc97e759e tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, {'target_iqns': ['iqn.2010-10.org.openstack:f1f60817-d9b2-4269-a40d-69f0312e0cea'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YNydOVGS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 12:01:14 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-5530e2a5-4575-4690-a4e1-765bc97e759e tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 12:01:14 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-5530e2a5-4575-4690-a4e1-765bc97e759e tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 12:01:14 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-5530e2a5-4575-4690-a4e1-765bc97e759e tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 12:01:14 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-5530e2a5-4575-4690-a4e1-765bc97e759e tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f1f60817-d9b2-4269-a40d-69f0312e0cea', 0)] {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 12:01:14 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:01:14 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:01:14 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[c68f083f-817b-4b2f-91cb-fec62e176910]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82f5400e-2a45-428e-85b9-b052a993285a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f1f60817-d9b2-4269-a40d-69f0312e0cea\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:01:14 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:01:14 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b7932d8-b781-4db7-a1c5-791ce8d1d866/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:01:14 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:01:14 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a238d5c-a44d-4846-ac58-6565162491d9]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1f60817-d9b2-4269-a40d-69f0312e0cea (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82f5400e-2a45-428e-85b9-b052a993285a (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:01:14 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-5530e2a5-4575-4690-a4e1-765bc97e759e tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)
Aug 17 12:01:14 user nova-compute[73449]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7 (non-flash)
Aug 17 12:01:14 user nova-compute[73449]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1f60817-d9b2-4269-a40d-69f0312e0cea (non-flash)
Aug 17 12:01:14 user nova-compute[73449]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82f5400e-2a45-428e-85b9-b052a993285a (non-flash)
Aug 17 12:01:14 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 12:01:14 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-5530e2a5-4575-4690-a4e1-765bc97e759e tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)
Aug 17 12:01:14 user nova-compute[73449]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7 (non-flash)
Aug 17 12:01:14 user nova-compute[73449]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1f60817-d9b2-4269-a40d-69f0312e0cea (non-flash)
Aug 17 12:01:14 user nova-compute[73449]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82f5400e-2a45-428e-85b9-b052a993285a (non-flash)
Aug 17 12:01:14 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 12:01:14 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-5530e2a5-4575-4690-a4e1-765bc97e759e tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe785333130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f1f60817-d9b2-4269-a40d-69f0312e0cea'): ({'sdd'}, set())}) {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 12:01:14 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-5530e2a5-4575-4690-a4e1-765bc97e759e tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Removing single pathed devices sdd {{(pid=73449) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 12:01:14 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:01:14 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73449) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 12:01:14 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d74c8f6-fb4e-4460-b722-674a8a1e2d25/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:01:14 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:01:14 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[75a2e94c-7761-42a1-8dad-a5c3b282c094]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:01:14 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:01:14 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:01:14 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0394f31-417e-4b6c-8905-03051c1dc488]: (4, ('ok\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:01:14 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-5530e2a5-4575-4690-a4e1-765bc97e759e tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Flushing IO for device /dev/sdd {{(pid=73449) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 12:01:14 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:01:14 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:01:14 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[18893d30-f5c5-4039-8c54-a358c2117c07]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:01:14 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-5530e2a5-4575-4690-a4e1-765bc97e759e tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73449) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 12:01:14 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:01:14 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:01:14 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[0553912e-2884-45c4-a164-6eb82be9edcb]: (4, ('1', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:01:14 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-5530e2a5-4575-4690-a4e1-765bc97e759e tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73449) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 12:01:14 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-5530e2a5-4575-4690-a4e1-765bc97e759e tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] SCSI volumes sdd have been removed. {{(pid=73449) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 12:01:14 user nova-compute[73449]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23439663537663437', '/dev/disk/by-id/scsi-1SCST_BIO124142f1-49f57f474f517da0', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_124142f1') {{(pid=84309) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 17 12:01:14 user nova-compute[73449]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23439663537663437
Aug 17 12:01:14 user nova-compute[73449]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO124142f1-49f57f474f517da0
Aug 17 12:01:14 user nova-compute[73449]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_124142f1
Aug 17 12:01:14 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[f29c2614-9edd-4ec1-8169-f03afc7372f1]: (4, None) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:01:14 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-5530e2a5-4575-4690-a4e1-765bc97e759e tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f1f60817-d9b2-4269-a40d-69f0312e0cea')] {{(pid=73449) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 12:01:14 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1f60817-d9b2-4269-a40d-69f0312e0cea -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:01:14 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1f60817-d9b2-4269-a40d-69f0312e0cea -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:01:14 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0e9a970-cf62-4859-9fb1-aee2a9568aee]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:01:14 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-5530e2a5-4575-4690-a4e1-765bc97e759e tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:01:14 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1f60817-d9b2-4269-a40d-69f0312e0cea -p 172.16.0.220:3260 --logout {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:01:14 user nova-compute[73449]: DEBUG nova.compute.manager [req-75f82139-3bfc-4e86-9ec6-3299d34370bb req-3205485d-f8b2-458a-adcd-c63a3c816ae1 service nova] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Received event network-vif-unplugged-2ce1927a-6866-4362-bc0c-88cd0a19fa08 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:01:14 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-75f82139-3bfc-4e86-9ec6-3299d34370bb req-3205485d-f8b2-458a-adcd-c63a3c816ae1 service nova] Acquiring lock "042713b8-ab7f-4c14-92e5-f830ccb7e341-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:01:14 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-75f82139-3bfc-4e86-9ec6-3299d34370bb req-3205485d-f8b2-458a-adcd-c63a3c816ae1 service nova] Lock "042713b8-ab7f-4c14-92e5-f830ccb7e341-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:01:14 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-75f82139-3bfc-4e86-9ec6-3299d34370bb req-3205485d-f8b2-458a-adcd-c63a3c816ae1 service nova] Lock "042713b8-ab7f-4c14-92e5-f830ccb7e341-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:01:14 user nova-compute[73449]: DEBUG nova.compute.manager [req-75f82139-3bfc-4e86-9ec6-3299d34370bb req-3205485d-f8b2-458a-adcd-c63a3c816ae1 service nova] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] No waiting events found dispatching network-vif-unplugged-2ce1927a-6866-4362-bc0c-88cd0a19fa08 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 12:01:14 user nova-compute[73449]: WARNING nova.compute.manager [req-75f82139-3bfc-4e86-9ec6-3299d34370bb req-3205485d-f8b2-458a-adcd-c63a3c816ae1 service nova] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Received unexpected event network-vif-unplugged-2ce1927a-6866-4362-bc0c-88cd0a19fa08 for instance with vm_state deleted and task_state None.
Aug 17 12:01:14 user nova-compute[73449]: DEBUG nova.compute.manager [req-75f82139-3bfc-4e86-9ec6-3299d34370bb req-3205485d-f8b2-458a-adcd-c63a3c816ae1 service nova] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Received event network-vif-plugged-2ce1927a-6866-4362-bc0c-88cd0a19fa08 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:01:14 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-75f82139-3bfc-4e86-9ec6-3299d34370bb req-3205485d-f8b2-458a-adcd-c63a3c816ae1 service nova] Acquiring lock "042713b8-ab7f-4c14-92e5-f830ccb7e341-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:01:14 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-75f82139-3bfc-4e86-9ec6-3299d34370bb req-3205485d-f8b2-458a-adcd-c63a3c816ae1 service nova] Lock "042713b8-ab7f-4c14-92e5-f830ccb7e341-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:01:14 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-75f82139-3bfc-4e86-9ec6-3299d34370bb req-3205485d-f8b2-458a-adcd-c63a3c816ae1 service nova] Lock "042713b8-ab7f-4c14-92e5-f830ccb7e341-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:01:14 user nova-compute[73449]: DEBUG nova.compute.manager [req-75f82139-3bfc-4e86-9ec6-3299d34370bb req-3205485d-f8b2-458a-adcd-c63a3c816ae1 service nova] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] No waiting events found dispatching network-vif-plugged-2ce1927a-6866-4362-bc0c-88cd0a19fa08 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 12:01:14 user nova-compute[73449]: WARNING nova.compute.manager [req-75f82139-3bfc-4e86-9ec6-3299d34370bb req-3205485d-f8b2-458a-adcd-c63a3c816ae1 service nova] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Received unexpected event network-vif-plugged-2ce1927a-6866-4362-bc0c-88cd0a19fa08 for instance with vm_state deleted and task_state None.
Aug 17 12:01:14 user nova-compute[73449]: DEBUG nova.compute.manager [req-75f82139-3bfc-4e86-9ec6-3299d34370bb req-3205485d-f8b2-458a-adcd-c63a3c816ae1 service nova] [instance: 5ceec4cb-f976-4978-a4fd-73d84d56c5c5] Received event network-vif-unplugged-cea7daf1-fb9f-443c-bae0-184478deda7e {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:01:14 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-75f82139-3bfc-4e86-9ec6-3299d34370bb req-3205485d-f8b2-458a-adcd-c63a3c816ae1 service nova] Acquiring lock "5ceec4cb-f976-4978-a4fd-73d84d56c5c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:01:14 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-75f82139-3bfc-4e86-9ec6-3299d34370bb req-3205485d-f8b2-458a-adcd-c63a3c816ae1 service nova] Lock "5ceec4cb-f976-4978-a4fd-73d84d56c5c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:01:14 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-75f82139-3bfc-4e86-9ec6-3299d34370bb req-3205485d-f8b2-458a-adcd-c63a3c816ae1 service nova] Lock "5ceec4cb-f976-4978-a4fd-73d84d56c5c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:01:14 user nova-compute[73449]: DEBUG nova.compute.manager [req-75f82139-3bfc-4e86-9ec6-3299d34370bb req-3205485d-f8b2-458a-adcd-c63a3c816ae1 service nova] [instance: 5ceec4cb-f976-4978-a4fd-73d84d56c5c5] No waiting events found dispatching network-vif-unplugged-cea7daf1-fb9f-443c-bae0-184478deda7e {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 12:01:14 user nova-compute[73449]: DEBUG nova.compute.manager [req-75f82139-3bfc-4e86-9ec6-3299d34370bb req-3205485d-f8b2-458a-adcd-c63a3c816ae1 service nova] [instance: 5ceec4cb-f976-4978-a4fd-73d84d56c5c5] Received event network-vif-unplugged-cea7daf1-fb9f-443c-bae0-184478deda7e for instance with task_state deleting. {{(pid=73449) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 12:01:14 user nova-compute[73449]: DEBUG nova.compute.manager [req-75f82139-3bfc-4e86-9ec6-3299d34370bb req-3205485d-f8b2-458a-adcd-c63a3c816ae1 service nova] [instance: 5ceec4cb-f976-4978-a4fd-73d84d56c5c5] Received event network-vif-plugged-cea7daf1-fb9f-443c-bae0-184478deda7e {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:01:14 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-75f82139-3bfc-4e86-9ec6-3299d34370bb req-3205485d-f8b2-458a-adcd-c63a3c816ae1 service nova] Acquiring lock "5ceec4cb-f976-4978-a4fd-73d84d56c5c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:01:14 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-75f82139-3bfc-4e86-9ec6-3299d34370bb req-3205485d-f8b2-458a-adcd-c63a3c816ae1 service nova] Lock "5ceec4cb-f976-4978-a4fd-73d84d56c5c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:01:14 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-75f82139-3bfc-4e86-9ec6-3299d34370bb req-3205485d-f8b2-458a-adcd-c63a3c816ae1 service nova] Lock "5ceec4cb-f976-4978-a4fd-73d84d56c5c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:01:14 user nova-compute[73449]: DEBUG nova.compute.manager [req-75f82139-3bfc-4e86-9ec6-3299d34370bb req-3205485d-f8b2-458a-adcd-c63a3c816ae1 service nova] [instance: 5ceec4cb-f976-4978-a4fd-73d84d56c5c5] No waiting events found dispatching network-vif-plugged-cea7daf1-fb9f-443c-bae0-184478deda7e {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 12:01:14 user nova-compute[73449]: WARNING nova.compute.manager [req-75f82139-3bfc-4e86-9ec6-3299d34370bb req-3205485d-f8b2-458a-adcd-c63a3c816ae1 service nova] [instance: 5ceec4cb-f976-4978-a4fd-73d84d56c5c5] Received unexpected event network-vif-plugged-cea7daf1-fb9f-443c-bae0-184478deda7e for instance with vm_state active and task_state deleting.
Aug 17 12:01:14 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d74c8f6-fb4e-4460-b722-674a8a1e2d25/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:01:14 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d74c8f6-fb4e-4460-b722-674a8a1e2d25/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:01:14 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1f60817-d9b2-4269-a40d-69f0312e0cea -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:01:14 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fcc321a-76a8-4ae4-a468-0daea48e4f9a]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:f1f60817-d9b2-4269-a40d-69f0312e0cea, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:f1f60817-d9b2-4269-a40d-69f0312e0cea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:01:14 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-5530e2a5-4575-4690-a4e1-765bc97e759e tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:f1f60817-d9b2-4269-a40d-69f0312e0cea, portal: 172.16.0.220,3260]
Aug 17 12:01:14 user nova-compute[73449]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:f1f60817-d9b2-4269-a40d-69f0312e0cea, portal: 172.16.0.220,3260] successful.
Aug 17 12:01:14 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:01:14 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1f60817-d9b2-4269-a40d-69f0312e0cea -p 172.16.0.220:3260 --op delete {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:01:14 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1f60817-d9b2-4269-a40d-69f0312e0cea -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:01:14 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[87c628f9-0c53-4298-9919-d277854cbbea]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:01:14 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-5530e2a5-4575-4690-a4e1-765bc97e759e tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:01:14 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-5530e2a5-4575-4690-a4e1-765bc97e759e tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.381s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 12:01:14 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-5530e2a5-4575-4690-a4e1-765bc97e759e tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] <== disconnect_volume: return (383ms) None {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 12:01:14 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5530e2a5-4575-4690-a4e1-765bc97e759e tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 5ceec4cb-f976-4978-a4fd-73d84d56c5c5] Disconnected iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 12:01:14 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-5530e2a5-4575-4690-a4e1-765bc97e759e tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 5ceec4cb-f976-4978-a4fd-73d84d56c5c5] Deleting instance files /opt/stack/data/nova/instances/5ceec4cb-f976-4978-a4fd-73d84d56c5c5_del
Aug 17 12:01:14 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-5530e2a5-4575-4690-a4e1-765bc97e759e tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 5ceec4cb-f976-4978-a4fd-73d84d56c5c5] Deletion of /opt/stack/data/nova/instances/5ceec4cb-f976-4978-a4fd-73d84d56c5c5_del complete
Aug 17 12:01:14 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-89dc223c-7f50-4c46-ac06-6478bfce6582 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 12:01:14 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-89dc223c-7f50-4c46-ac06-6478bfce6582 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 12:01:14 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-89dc223c-7f50-4c46-ac06-6478bfce6582 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.537s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:01:14 user nova-compute[73449]: INFO nova.compute.manager [None req-5530e2a5-4575-4690-a4e1-765bc97e759e tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 5ceec4cb-f976-4978-a4fd-73d84d56c5c5] Took 1.28 seconds to destroy the instance on the hypervisor.
Aug 17 12:01:14 user nova-compute[73449]: DEBUG oslo.service.loopingcall [None req-5530e2a5-4575-4690-a4e1-765bc97e759e tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73449) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 12:01:14 user nova-compute[73449]: DEBUG nova.compute.manager [-] [instance: 5ceec4cb-f976-4978-a4fd-73d84d56c5c5] Deallocating network for instance {{(pid=73449) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 12:01:14 user nova-compute[73449]: DEBUG nova.network.neutron [-] [instance: 5ceec4cb-f976-4978-a4fd-73d84d56c5c5] deallocate_for_instance() {{(pid=73449) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 12:01:14 user nova-compute[73449]: INFO nova.scheduler.client.report [None req-89dc223c-7f50-4c46-ac06-6478bfce6582 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Deleted allocations for instance 042713b8-ab7f-4c14-92e5-f830ccb7e341
Aug 17 12:01:14 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d74c8f6-fb4e-4460-b722-674a8a1e2d25/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:01:14 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89440604-1daf-4e7a-a524-2f9c21a9cb96/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:01:14 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-89dc223c-7f50-4c46-ac06-6478bfce6582 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Lock "042713b8-ab7f-4c14-92e5-f830ccb7e341" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.733s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:01:14 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89440604-1daf-4e7a-a524-2f9c21a9cb96/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:01:14 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89440604-1daf-4e7a-a524-2f9c21a9cb96/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:01:14 user nova-compute[73449]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692273659.856874, 0d951782-d2d8-49a8-a0dc-05ac7f760c76 => Stopped> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 12:01:14 user nova-compute[73449]: INFO nova.compute.manager [-] [instance: 0d951782-d2d8-49a8-a0dc-05ac7f760c76] VM Stopped (Lifecycle Event)
Aug 17 12:01:14 user nova-compute[73449]: DEBUG nova.compute.manager [None req-5ff8fd9d-a407-4fe2-b91c-e663d0428db8 None None] [instance: 0d951782-d2d8-49a8-a0dc-05ac7f760c76] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 12:01:14 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89440604-1daf-4e7a-a524-2f9c21a9cb96/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:01:14 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d160711b-0b77-4f9a-b1d9-f0ac16240d4d/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:01:15 user nova-compute[73449]: DEBUG nova.network.neutron [-] [instance: 5ceec4cb-f976-4978-a4fd-73d84d56c5c5] Updating instance_info_cache with network_info: [] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 12:01:15 user nova-compute[73449]: INFO nova.compute.manager [-] [instance: 5ceec4cb-f976-4978-a4fd-73d84d56c5c5] Took 0.57 seconds to deallocate network for instance.
Aug 17 12:01:15 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d160711b-0b77-4f9a-b1d9-f0ac16240d4d/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:01:15 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d160711b-0b77-4f9a-b1d9-f0ac16240d4d/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:01:15 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d160711b-0b77-4f9a-b1d9-f0ac16240d4d/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:01:15 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 12:01:15 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 12:01:15 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Hypervisor/Node resource view: name=user free_ram=7340MB free_disk=24.92361068725586GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73449) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 12:01:15 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:01:15 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:01:15 user nova-compute[73449]: INFO nova.compute.manager [None req-5530e2a5-4575-4690-a4e1-765bc97e759e tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 5ceec4cb-f976-4978-a4fd-73d84d56c5c5] Took 0.77 seconds to detach 1 volumes for instance.
Aug 17 12:01:15 user nova-compute[73449]: DEBUG nova.compute.manager [req-53d8d8d5-c1d3-4851-a817-68b2930397a4 req-b98bb20e-1879-4cb6-9b43-8ccc2bacaf5d service nova] [instance: 5ceec4cb-f976-4978-a4fd-73d84d56c5c5] Received event network-vif-deleted-cea7daf1-fb9f-443c-bae0-184478deda7e {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:01:15 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-5530e2a5-4575-4690-a4e1-765bc97e759e tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:01:16 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 3d74c8f6-fb4e-4460-b722-674a8a1e2d25 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 12:01:16 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance ae75d334-431a-4008-8b3d-f2a727d92417 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 12:01:16 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 89440604-1daf-4e7a-a524-2f9c21a9cb96 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 12:01:16 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 31f5f3d2-41d8-4a26-9eb2-18b891f94734 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 12:01:16 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 773e5c86-a86a-414d-aab4-8e13e0b68c1e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 12:01:16 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 5cacd9ed-27fb-431d-999e-31ff2464d14d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 12:01:16 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 712c777e-251b-43d8-b923-8eda693f32ed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 12:01:16 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 5ceec4cb-f976-4978-a4fd-73d84d56c5c5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 12:01:16 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 4b7932d8-b781-4db7-a1c5-791ce8d1d866 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 12:01:16 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance d160711b-0b77-4f9a-b1d9-f0ac16240d4d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 12:01:16 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73449) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 12:01:16 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73449) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 12:01:16 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 12:01:16 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 12:01:16 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Compute_service record updated for user:user {{(pid=73449) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 12:01:16 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.494s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:01:16 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-5530e2a5-4575-4690-a4e1-765bc97e759e tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.374s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:01:16 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-5530e2a5-4575-4690-a4e1-765bc97e759e tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 12:01:16 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-5530e2a5-4575-4690-a4e1-765bc97e759e tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 12:01:16 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-5530e2a5-4575-4690-a4e1-765bc97e759e tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.312s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:01:16 user nova-compute[73449]: INFO nova.scheduler.client.report [None req-5530e2a5-4575-4690-a4e1-765bc97e759e tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Deleted allocations for instance 5ceec4cb-f976-4978-a4fd-73d84d56c5c5
Aug 17 12:01:16 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-5530e2a5-4575-4690-a4e1-765bc97e759e tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Lock "5ceec4cb-f976-4978-a4fd-73d84d56c5c5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.496s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:01:16 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:01:19 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:01:20 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:01:20 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73449) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 17 12:01:24 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:01:26 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-fb0e8e02-99d8-474b-96b4-2f3fad3899ab tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Acquiring lock "5cacd9ed-27fb-431d-999e-31ff2464d14d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:01:26 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-fb0e8e02-99d8-474b-96b4-2f3fad3899ab tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Lock "5cacd9ed-27fb-431d-999e-31ff2464d14d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:01:26 user nova-compute[73449]: INFO nova.compute.manager [None req-fb0e8e02-99d8-474b-96b4-2f3fad3899ab tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] [instance: 5cacd9ed-27fb-431d-999e-31ff2464d14d] Detaching volume 82f5400e-2a45-428e-85b9-b052a993285a
Aug 17 12:01:27 user nova-compute[73449]: INFO nova.virt.block_device [None req-fb0e8e02-99d8-474b-96b4-2f3fad3899ab tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] [instance: 5cacd9ed-27fb-431d-999e-31ff2464d14d] Attempting to driver detach volume 82f5400e-2a45-428e-85b9-b052a993285a from mountpoint /dev/vdb
Aug 17 12:01:27 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-fb0e8e02-99d8-474b-96b4-2f3fad3899ab tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Attempting to detach device vdb from instance 5cacd9ed-27fb-431d-999e-31ff2464d14d from the persistent domain config. {{(pid=73449) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 12:01:27 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-fb0e8e02-99d8-474b-96b4-2f3fad3899ab tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 12:01:27 user nova-compute[73449]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 12:01:27 user nova-compute[73449]:   <source dev="/dev/sdf"/>
Aug 17 12:01:27 user nova-compute[73449]:   <target dev="vdb" bus="virtio"/>
Aug 17 12:01:27 user nova-compute[73449]:   <serial>82f5400e-2a45-428e-85b9-b052a993285a</serial>
Aug 17 12:01:27 user nova-compute[73449]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 12:01:27 user nova-compute[73449]: </disk>
Aug 17 12:01:27 user nova-compute[73449]:  {{(pid=73449) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 12:01:27 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-fb0e8e02-99d8-474b-96b4-2f3fad3899ab tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Successfully detached device vdb from instance 5cacd9ed-27fb-431d-999e-31ff2464d14d from the persistent domain config.
Aug 17 12:01:27 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-fb0e8e02-99d8-474b-96b4-2f3fad3899ab tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5cacd9ed-27fb-431d-999e-31ff2464d14d from the live domain config. {{(pid=73449) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 12:01:27 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-fb0e8e02-99d8-474b-96b4-2f3fad3899ab tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 12:01:27 user nova-compute[73449]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 12:01:27 user nova-compute[73449]:   <source dev="/dev/sdf"/>
Aug 17 12:01:27 user nova-compute[73449]:   <target dev="vdb" bus="virtio"/>
Aug 17 12:01:27 user nova-compute[73449]:   <serial>82f5400e-2a45-428e-85b9-b052a993285a</serial>
Aug 17 12:01:27 user nova-compute[73449]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 12:01:27 user nova-compute[73449]: </disk>
Aug 17 12:01:27 user nova-compute[73449]:  {{(pid=73449) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 12:01:27 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Received event <DeviceRemovedEvent: 1692273687.497585, 5cacd9ed-27fb-431d-999e-31ff2464d14d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73449) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 12:01:27 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-fb0e8e02-99d8-474b-96b4-2f3fad3899ab tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5cacd9ed-27fb-431d-999e-31ff2464d14d {{(pid=73449) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 12:01:27 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-fb0e8e02-99d8-474b-96b4-2f3fad3899ab tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Successfully detached device vdb from instance 5cacd9ed-27fb-431d-999e-31ff2464d14d from the live domain config.
Aug 17 12:01:27 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb0e8e02-99d8-474b-96b4-2f3fad3899ab tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] [instance: 5cacd9ed-27fb-431d-999e-31ff2464d14d] calling os-brick to detach iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 12:01:27 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb0e8e02-99d8-474b-96b4-2f3fad3899ab tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, {'target_iqns': ['iqn.2010-10.org.openstack:82f5400e-2a45-428e-85b9-b052a993285a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CTSJXxwG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 12:01:27 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-fb0e8e02-99d8-474b-96b4-2f3fad3899ab tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 12:01:27 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-fb0e8e02-99d8-474b-96b4-2f3fad3899ab tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 12:01:27 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-fb0e8e02-99d8-474b-96b4-2f3fad3899ab tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 12:01:27 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb0e8e02-99d8-474b-96b4-2f3fad3899ab tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:82f5400e-2a45-428e-85b9-b052a993285a', 0)] {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 12:01:27 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:01:27 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:01:27 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[21bc0f29-519c-4112-8ea9-4fdd04953088]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82f5400e-2a45-428e-85b9-b052a993285a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:01:27 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:01:27 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:01:27 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[93e940bf-c705-40ff-a208-d69011fe6972]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82f5400e-2a45-428e-85b9-b052a993285a (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:01:27 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb0e8e02-99d8-474b-96b4-2f3fad3899ab tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)
Aug 17 12:01:27 user nova-compute[73449]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7 (non-flash)
Aug 17 12:01:27 user nova-compute[73449]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82f5400e-2a45-428e-85b9-b052a993285a (non-flash)
Aug 17 12:01:27 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 12:01:27 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb0e8e02-99d8-474b-96b4-2f3fad3899ab tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)
Aug 17 12:01:27 user nova-compute[73449]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7 (non-flash)
Aug 17 12:01:27 user nova-compute[73449]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82f5400e-2a45-428e-85b9-b052a993285a (non-flash)
Aug 17 12:01:27 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 12:01:27 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb0e8e02-99d8-474b-96b4-2f3fad3899ab tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe7582efac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:82f5400e-2a45-428e-85b9-b052a993285a'): ({'sdf'}, set())}) {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 12:01:27 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-fb0e8e02-99d8-474b-96b4-2f3fad3899ab tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Removing single pathed devices sdf {{(pid=73449) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 12:01:27 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:01:27 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:01:27 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[62a05d0a-ec08-4307-bb89-b1fb1bcc84b7]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:01:27 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:01:27 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:01:27 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[25b025dd-197c-47fc-9e76-539ceabd0e47]: (4, ('ok\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:01:27 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-fb0e8e02-99d8-474b-96b4-2f3fad3899ab tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Flushing IO for device /dev/sdf {{(pid=73449) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 12:01:27 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:01:27 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:01:27 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccfb8825-488f-4d3f-9f4f-e8465b424e20]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:01:27 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-fb0e8e02-99d8-474b-96b4-2f3fad3899ab tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73449) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 12:01:27 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:01:27 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.045s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:01:27 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[407d5691-2864-4efa-a330-6ca661223221]: (4, ('1', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:01:27 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-fb0e8e02-99d8-474b-96b4-2f3fad3899ab tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73449) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 12:01:27 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-fb0e8e02-99d8-474b-96b4-2f3fad3899ab tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] SCSI volumes sdf have been removed. {{(pid=73449) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 12:01:27 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb0e8e02-99d8-474b-96b4-2f3fad3899ab tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:82f5400e-2a45-428e-85b9-b052a993285a')] {{(pid=73449) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 12:01:27 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82f5400e-2a45-428e-85b9-b052a993285a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:01:27 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82f5400e-2a45-428e-85b9-b052a993285a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:01:27 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2a213e8-a160-4ada-b2d8-55fea53da002]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:01:27 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb0e8e02-99d8-474b-96b4-2f3fad3899ab tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:01:27 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82f5400e-2a45-428e-85b9-b052a993285a -p 172.16.0.220:3260 --logout {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:01:27 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82f5400e-2a45-428e-85b9-b052a993285a -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:01:27 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c05cedf-0d85-407d-8955-2265b76e0bc2]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:82f5400e-2a45-428e-85b9-b052a993285a, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:82f5400e-2a45-428e-85b9-b052a993285a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:01:27 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb0e8e02-99d8-474b-96b4-2f3fad3899ab tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:82f5400e-2a45-428e-85b9-b052a993285a, portal: 172.16.0.220,3260]
Aug 17 12:01:27 user nova-compute[73449]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:82f5400e-2a45-428e-85b9-b052a993285a, portal: 172.16.0.220,3260] successful.
Aug 17 12:01:27 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:01:27 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82f5400e-2a45-428e-85b9-b052a993285a -p 172.16.0.220:3260 --op delete {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:01:27 user nova-compute[73449]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692273672.758017, 042713b8-ab7f-4c14-92e5-f830ccb7e341 => Stopped> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 12:01:27 user nova-compute[73449]: INFO nova.compute.manager [-] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] VM Stopped (Lifecycle Event)
Aug 17 12:01:27 user nova-compute[73449]: DEBUG nova.compute.manager [None req-7a4ed240-7a9d-42bc-a3f7-6db416d03918 None None] [instance: 042713b8-ab7f-4c14-92e5-f830ccb7e341] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 12:01:27 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82f5400e-2a45-428e-85b9-b052a993285a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:01:27 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[5541af37-f166-4816-8257-885501495673]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:01:27 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb0e8e02-99d8-474b-96b4-2f3fad3899ab tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:01:27 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-fb0e8e02-99d8-474b-96b4-2f3fad3899ab tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.268s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 12:01:27 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb0e8e02-99d8-474b-96b4-2f3fad3899ab tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] <== disconnect_volume: return (270ms) None {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 12:01:27 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb0e8e02-99d8-474b-96b4-2f3fad3899ab tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] [instance: 5cacd9ed-27fb-431d-999e-31ff2464d14d] Disconnected iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 12:01:28 user nova-compute[73449]: DEBUG nova.objects.instance [None req-fb0e8e02-99d8-474b-96b4-2f3fad3899ab tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Lazy-loading 'flavor' on Instance uuid 5cacd9ed-27fb-431d-999e-31ff2464d14d {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:01:28 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-fb0e8e02-99d8-474b-96b4-2f3fad3899ab tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Lock "5cacd9ed-27fb-431d-999e-31ff2464d14d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.599s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:01:29 user nova-compute[73449]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692273674.0291731, 5ceec4cb-f976-4978-a4fd-73d84d56c5c5 => Stopped> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 12:01:29 user nova-compute[73449]: INFO nova.compute.manager [-] [instance: 5ceec4cb-f976-4978-a4fd-73d84d56c5c5] VM Stopped (Lifecycle Event)
Aug 17 12:01:29 user nova-compute[73449]: DEBUG nova.compute.manager [None req-25e300f5-b20b-42c6-8fa6-a2ac377d7973 None None] [instance: 5ceec4cb-f976-4978-a4fd-73d84d56c5c5] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 12:01:29 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:01:29 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:01:29 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73449) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 12:01:29 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:01:29 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:01:29 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:01:34 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:01:39 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:01:39 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:01:39 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73449) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 12:01:39 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:01:39 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:01:39 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:01:44 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:01:49 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:01:54 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:01:56 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:01:59 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:01:59 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:01:59 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73449) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 12:01:59 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:01:59 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:01:59 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:02:00 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:02:02 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-eebae17e-b377-4222-83dd-36716139420a tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Acquiring lock "5a627da9-03a1-4239-8721-cefe99c39ee2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:02:02 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-eebae17e-b377-4222-83dd-36716139420a tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Lock "5a627da9-03a1-4239-8721-cefe99c39ee2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:02:02 user nova-compute[73449]: DEBUG nova.compute.manager [None req-eebae17e-b377-4222-83dd-36716139420a tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] Starting instance... {{(pid=73449) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 12:02:02 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-eebae17e-b377-4222-83dd-36716139420a tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:02:02 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-eebae17e-b377-4222-83dd-36716139420a tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:02:02 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-eebae17e-b377-4222-83dd-36716139420a tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73449) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 12:02:02 user nova-compute[73449]: INFO nova.compute.claims [None req-eebae17e-b377-4222-83dd-36716139420a tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] Claim successful on node user
Aug 17 12:02:02 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-eebae17e-b377-4222-83dd-36716139420a tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Refreshing inventories for resource provider 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 17 12:02:02 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:02:02 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-eebae17e-b377-4222-83dd-36716139420a tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Updating ProviderTree inventory for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 17 12:02:02 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-eebae17e-b377-4222-83dd-36716139420a tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Updating inventory in ProviderTree for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 12:02:02 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-eebae17e-b377-4222-83dd-36716139420a tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Refreshing aggregate associations for resource provider 20986bee-3f54-4b89-bec1-f8387ef700c4, aggregates: None {{(pid=73449) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 17 12:02:02 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-eebae17e-b377-4222-83dd-36716139420a tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Refreshing trait associations for resource provider 20986bee-3f54-4b89-bec1-f8387ef700c4, traits: COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NODE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE42,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSSE3,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_ISO {{(pid=73449) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 17 12:02:02 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:02:02 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:02:02 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73449) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 12:02:03 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-eebae17e-b377-4222-83dd-36716139420a tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 12:02:03 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-eebae17e-b377-4222-83dd-36716139420a tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 12:02:03 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-eebae17e-b377-4222-83dd-36716139420a tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.592s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:02:03 user nova-compute[73449]: DEBUG nova.compute.manager [None req-eebae17e-b377-4222-83dd-36716139420a tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] Start building networks asynchronously for instance. {{(pid=73449) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 12:02:03 user nova-compute[73449]: DEBUG nova.compute.manager [None req-eebae17e-b377-4222-83dd-36716139420a tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] Allocating IP information in the background. {{(pid=73449) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 12:02:03 user nova-compute[73449]: DEBUG nova.network.neutron [None req-eebae17e-b377-4222-83dd-36716139420a tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] allocate_for_instance() {{(pid=73449) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 12:02:03 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-eebae17e-b377-4222-83dd-36716139420a tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 12:02:03 user nova-compute[73449]: DEBUG nova.compute.manager [None req-eebae17e-b377-4222-83dd-36716139420a tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] Start building block device mappings for instance. {{(pid=73449) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 12:02:03 user nova-compute[73449]: INFO nova.virt.block_device [None req-eebae17e-b377-4222-83dd-36716139420a tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] Booting with volume-backed-image 0a2904ae-083d-41c8-83db-343132b36148 at /dev/vda
Aug 17 12:02:03 user nova-compute[73449]: DEBUG nova.policy [None req-eebae17e-b377-4222-83dd-36716139420a tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '14eb3826311a4f8f91d8264e87f7b866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec3b0b72e47448ebe99f9fc64119c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73449) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 12:02:04 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:02:04 user nova-compute[73449]: DEBUG nova.network.neutron [None req-eebae17e-b377-4222-83dd-36716139420a tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] Successfully created port: 69831639-3628-4b42-8ddd-fe0965dea4b6 {{(pid=73449) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 12:02:05 user nova-compute[73449]: DEBUG nova.network.neutron [None req-eebae17e-b377-4222-83dd-36716139420a tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] Successfully updated port: 69831639-3628-4b42-8ddd-fe0965dea4b6 {{(pid=73449) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 12:02:05 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-eebae17e-b377-4222-83dd-36716139420a tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Acquiring lock "refresh_cache-5a627da9-03a1-4239-8721-cefe99c39ee2" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 12:02:05 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-eebae17e-b377-4222-83dd-36716139420a tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Acquired lock "refresh_cache-5a627da9-03a1-4239-8721-cefe99c39ee2" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 12:02:05 user nova-compute[73449]: DEBUG nova.network.neutron [None req-eebae17e-b377-4222-83dd-36716139420a tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] Building network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 12:02:05 user nova-compute[73449]: DEBUG nova.compute.manager [req-ff9a58fd-b3d2-4918-8386-44333671897c req-9d2f429d-9c16-4657-afd5-3ecdd88cdfa1 service nova] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] Received event network-changed-69831639-3628-4b42-8ddd-fe0965dea4b6 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:02:05 user nova-compute[73449]: DEBUG nova.compute.manager [req-ff9a58fd-b3d2-4918-8386-44333671897c req-9d2f429d-9c16-4657-afd5-3ecdd88cdfa1 service nova] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] Refreshing instance network info cache due to event network-changed-69831639-3628-4b42-8ddd-fe0965dea4b6. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 12:02:05 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-ff9a58fd-b3d2-4918-8386-44333671897c req-9d2f429d-9c16-4657-afd5-3ecdd88cdfa1 service nova] Acquiring lock "refresh_cache-5a627da9-03a1-4239-8721-cefe99c39ee2" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 12:02:05 user nova-compute[73449]: DEBUG nova.network.neutron [None req-eebae17e-b377-4222-83dd-36716139420a tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] Instance cache missing network info. {{(pid=73449) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 12:02:05 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:02:06 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-29b10485-3448-4a58-ae77-65d7a27a947d tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Acquiring lock "4b7932d8-b781-4db7-a1c5-791ce8d1d866" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:02:06 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-29b10485-3448-4a58-ae77-65d7a27a947d tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Lock "4b7932d8-b781-4db7-a1c5-791ce8d1d866" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:02:06 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-29b10485-3448-4a58-ae77-65d7a27a947d tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Acquiring lock "4b7932d8-b781-4db7-a1c5-791ce8d1d866-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:02:06 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-29b10485-3448-4a58-ae77-65d7a27a947d tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Lock "4b7932d8-b781-4db7-a1c5-791ce8d1d866-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:02:06 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-29b10485-3448-4a58-ae77-65d7a27a947d tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Lock "4b7932d8-b781-4db7-a1c5-791ce8d1d866-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:02:06 user nova-compute[73449]: INFO nova.compute.manager [None req-29b10485-3448-4a58-ae77-65d7a27a947d tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] Terminating instance
Aug 17 12:02:06 user nova-compute[73449]: DEBUG nova.compute.manager [None req-29b10485-3448-4a58-ae77-65d7a27a947d tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] Start destroying the instance on the hypervisor. {{(pid=73449) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 12:02:06 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:02:06 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:02:06 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:02:06 user nova-compute[73449]: DEBUG nova.network.neutron [None req-eebae17e-b377-4222-83dd-36716139420a tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] Updating instance_info_cache with network_info: [{"id": "69831639-3628-4b42-8ddd-fe0965dea4b6", "address": "fa:16:3e:de:22:d6", "network": {"id": "9455bb75-f75a-41ff-8f6f-49f55aa738f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-425274599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec3b0b72e47448ebe99f9fc64119c1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69831639-36", "ovs_interfaceid": "69831639-3628-4b42-8ddd-fe0965dea4b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 12:02:06 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-eebae17e-b377-4222-83dd-36716139420a tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Releasing lock "refresh_cache-5a627da9-03a1-4239-8721-cefe99c39ee2" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 12:02:06 user nova-compute[73449]: DEBUG nova.compute.manager [None req-eebae17e-b377-4222-83dd-36716139420a tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] Instance network_info: |[{"id": "69831639-3628-4b42-8ddd-fe0965dea4b6", "address": "fa:16:3e:de:22:d6", "network": {"id": "9455bb75-f75a-41ff-8f6f-49f55aa738f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-425274599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec3b0b72e47448ebe99f9fc64119c1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69831639-36", "ovs_interfaceid": "69831639-3628-4b42-8ddd-fe0965dea4b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73449) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 12:02:06 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-ff9a58fd-b3d2-4918-8386-44333671897c req-9d2f429d-9c16-4657-afd5-3ecdd88cdfa1 service nova] Acquired lock "refresh_cache-5a627da9-03a1-4239-8721-cefe99c39ee2" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 12:02:06 user nova-compute[73449]: DEBUG nova.network.neutron [req-ff9a58fd-b3d2-4918-8386-44333671897c req-9d2f429d-9c16-4657-afd5-3ecdd88cdfa1 service nova] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] Refreshing network info cache for port 69831639-3628-4b42-8ddd-fe0965dea4b6 {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 12:02:06 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:02:06 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:02:06 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:02:06 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:02:06 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:02:06 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] Instance destroyed successfully.
Aug 17 12:02:06 user nova-compute[73449]: DEBUG nova.objects.instance [None req-29b10485-3448-4a58-ae77-65d7a27a947d tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Lazy-loading 'resources' on Instance uuid 4b7932d8-b781-4db7-a1c5-791ce8d1d866 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:02:06 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-29b10485-3448-4a58-ae77-65d7a27a947d tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T11:56:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-446672586',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-446672586',id=36,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEcw8l18SWbf1308kGLuQ4b06ysMjia3rEhaF6dU6vjJM/VmZBqAPQDr1yByzmcI8Lvjfcj9Fi6T/YyvGoW/3wLJuwBD8/OatBnsq63e8/jV0cJ+5SDnDrf0ZUEjihC93A==',key_name='tempest-keypair-279437617',keypairs=<?>,launch_index=0,launched_at=2023-08-17T12:00:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fe7b5fee01a042bb90e40b18a84c82c0',ramdisk_id='',reservation_id='r-ehpbpdxe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2080997856',owner_user_name='tempest-AttachVolumeShelveTestJSON-2080997856-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T12:00:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='17ee7be9cdb14c5ca211a6b0bb80ccc1',uuid=4b7932d8-b781-4db7-a1c5-791ce8d1d866,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dbd5bb98-0410-4179-a99a-9181d85357ea", "address": "fa:16:3e:5d:b1:0e", "network": {"id": "d56bc428-6be6-4aa9-b43c-9d4a0f1dd83b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-791364634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe7b5fee01a042bb90e40b18a84c82c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbd5bb98-04", "ovs_interfaceid": "dbd5bb98-0410-4179-a99a-9181d85357ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 12:02:06 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-29b10485-3448-4a58-ae77-65d7a27a947d tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Converting VIF {"id": "dbd5bb98-0410-4179-a99a-9181d85357ea", "address": "fa:16:3e:5d:b1:0e", "network": {"id": "d56bc428-6be6-4aa9-b43c-9d4a0f1dd83b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-791364634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe7b5fee01a042bb90e40b18a84c82c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbd5bb98-04", "ovs_interfaceid": "dbd5bb98-0410-4179-a99a-9181d85357ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 12:02:06 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-29b10485-3448-4a58-ae77-65d7a27a947d tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:b1:0e,bridge_name='br-int',has_traffic_filtering=True,id=dbd5bb98-0410-4179-a99a-9181d85357ea,network=Network(d56bc428-6be6-4aa9-b43c-9d4a0f1dd83b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbd5bb98-04') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 12:02:06 user nova-compute[73449]: DEBUG os_vif [None req-29b10485-3448-4a58-ae77-65d7a27a947d tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:b1:0e,bridge_name='br-int',has_traffic_filtering=True,id=dbd5bb98-0410-4179-a99a-9181d85357ea,network=Network(d56bc428-6be6-4aa9-b43c-9d4a0f1dd83b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbd5bb98-04') {{(pid=73449) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 12:02:06 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:02:06 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdbd5bb98-04, bridge=br-int, if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 12:02:06 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:02:06 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:02:06 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:02:06 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:02:06 user nova-compute[73449]: INFO os_vif [None req-29b10485-3448-4a58-ae77-65d7a27a947d tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:b1:0e,bridge_name='br-int',has_traffic_filtering=True,id=dbd5bb98-0410-4179-a99a-9181d85357ea,network=Network(d56bc428-6be6-4aa9-b43c-9d4a0f1dd83b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbd5bb98-04')
Aug 17 12:02:06 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-29b10485-3448-4a58-ae77-65d7a27a947d tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] Deleting instance files /opt/stack/data/nova/instances/4b7932d8-b781-4db7-a1c5-791ce8d1d866_del
Aug 17 12:02:06 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-29b10485-3448-4a58-ae77-65d7a27a947d tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] Deletion of /opt/stack/data/nova/instances/4b7932d8-b781-4db7-a1c5-791ce8d1d866_del complete
Aug 17 12:02:06 user nova-compute[73449]: INFO nova.compute.manager [None req-29b10485-3448-4a58-ae77-65d7a27a947d tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] Took 0.85 seconds to destroy the instance on the hypervisor.
Aug 17 12:02:06 user nova-compute[73449]: DEBUG oslo.service.loopingcall [None req-29b10485-3448-4a58-ae77-65d7a27a947d tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73449) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 12:02:06 user nova-compute[73449]: DEBUG nova.compute.manager [-] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] Deallocating network for instance {{(pid=73449) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 12:02:06 user nova-compute[73449]: DEBUG nova.network.neutron [-] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] deallocate_for_instance() {{(pid=73449) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 12:02:07 user nova-compute[73449]: DEBUG nova.network.neutron [req-ff9a58fd-b3d2-4918-8386-44333671897c req-9d2f429d-9c16-4657-afd5-3ecdd88cdfa1 service nova] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] Updated VIF entry in instance network info cache for port 69831639-3628-4b42-8ddd-fe0965dea4b6. {{(pid=73449) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 12:02:07 user nova-compute[73449]: DEBUG nova.network.neutron [req-ff9a58fd-b3d2-4918-8386-44333671897c req-9d2f429d-9c16-4657-afd5-3ecdd88cdfa1 service nova] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] Updating instance_info_cache with network_info: [{"id": "69831639-3628-4b42-8ddd-fe0965dea4b6", "address": "fa:16:3e:de:22:d6", "network": {"id": "9455bb75-f75a-41ff-8f6f-49f55aa738f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-425274599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec3b0b72e47448ebe99f9fc64119c1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69831639-36", "ovs_interfaceid": "69831639-3628-4b42-8ddd-fe0965dea4b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 12:02:07 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-ff9a58fd-b3d2-4918-8386-44333671897c req-9d2f429d-9c16-4657-afd5-3ecdd88cdfa1 service nova] Releasing lock "refresh_cache-5a627da9-03a1-4239-8721-cefe99c39ee2" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 12:02:07 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:02:07 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:02:07 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:02:07 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:02:07 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:02:07 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:02:07 user nova-compute[73449]: DEBUG nova.compute.manager [req-31bbdfc2-2f07-4a44-a7ac-524fee3c9764 req-70efddee-74be-4b08-a299-006e81e13aea service nova] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] Received event network-vif-unplugged-dbd5bb98-0410-4179-a99a-9181d85357ea {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:02:07 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-31bbdfc2-2f07-4a44-a7ac-524fee3c9764 req-70efddee-74be-4b08-a299-006e81e13aea service nova] Acquiring lock "4b7932d8-b781-4db7-a1c5-791ce8d1d866-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:02:07 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-31bbdfc2-2f07-4a44-a7ac-524fee3c9764 req-70efddee-74be-4b08-a299-006e81e13aea service nova] Lock "4b7932d8-b781-4db7-a1c5-791ce8d1d866-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:02:07 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-31bbdfc2-2f07-4a44-a7ac-524fee3c9764 req-70efddee-74be-4b08-a299-006e81e13aea service nova] Lock "4b7932d8-b781-4db7-a1c5-791ce8d1d866-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:02:07 user nova-compute[73449]: DEBUG nova.compute.manager [req-31bbdfc2-2f07-4a44-a7ac-524fee3c9764 req-70efddee-74be-4b08-a299-006e81e13aea service nova] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] No waiting events found dispatching network-vif-unplugged-dbd5bb98-0410-4179-a99a-9181d85357ea {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 12:02:07 user nova-compute[73449]: DEBUG nova.compute.manager [req-31bbdfc2-2f07-4a44-a7ac-524fee3c9764 req-70efddee-74be-4b08-a299-006e81e13aea service nova] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] Received event network-vif-unplugged-dbd5bb98-0410-4179-a99a-9181d85357ea for instance with task_state deleting. {{(pid=73449) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 12:02:07 user nova-compute[73449]: DEBUG nova.compute.manager [req-31bbdfc2-2f07-4a44-a7ac-524fee3c9764 req-70efddee-74be-4b08-a299-006e81e13aea service nova] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] Received event network-vif-plugged-dbd5bb98-0410-4179-a99a-9181d85357ea {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:02:07 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-31bbdfc2-2f07-4a44-a7ac-524fee3c9764 req-70efddee-74be-4b08-a299-006e81e13aea service nova] Acquiring lock "4b7932d8-b781-4db7-a1c5-791ce8d1d866-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:02:07 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-31bbdfc2-2f07-4a44-a7ac-524fee3c9764 req-70efddee-74be-4b08-a299-006e81e13aea service nova] Lock "4b7932d8-b781-4db7-a1c5-791ce8d1d866-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:02:07 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-31bbdfc2-2f07-4a44-a7ac-524fee3c9764 req-70efddee-74be-4b08-a299-006e81e13aea service nova] Lock "4b7932d8-b781-4db7-a1c5-791ce8d1d866-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:02:07 user nova-compute[73449]: DEBUG nova.compute.manager [req-31bbdfc2-2f07-4a44-a7ac-524fee3c9764 req-70efddee-74be-4b08-a299-006e81e13aea service nova] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] No waiting events found dispatching network-vif-plugged-dbd5bb98-0410-4179-a99a-9181d85357ea {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 12:02:07 user nova-compute[73449]: WARNING nova.compute.manager [req-31bbdfc2-2f07-4a44-a7ac-524fee3c9764 req-70efddee-74be-4b08-a299-006e81e13aea service nova] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] Received unexpected event network-vif-plugged-dbd5bb98-0410-4179-a99a-9181d85357ea for instance with vm_state active and task_state deleting.
Aug 17 12:02:07 user nova-compute[73449]: DEBUG nova.compute.manager [req-31bbdfc2-2f07-4a44-a7ac-524fee3c9764 req-70efddee-74be-4b08-a299-006e81e13aea service nova] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] Received event network-vif-plugged-dbd5bb98-0410-4179-a99a-9181d85357ea {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:02:07 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-31bbdfc2-2f07-4a44-a7ac-524fee3c9764 req-70efddee-74be-4b08-a299-006e81e13aea service nova] Acquiring lock "4b7932d8-b781-4db7-a1c5-791ce8d1d866-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:02:07 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-31bbdfc2-2f07-4a44-a7ac-524fee3c9764 req-70efddee-74be-4b08-a299-006e81e13aea service nova] Lock "4b7932d8-b781-4db7-a1c5-791ce8d1d866-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:02:07 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-31bbdfc2-2f07-4a44-a7ac-524fee3c9764 req-70efddee-74be-4b08-a299-006e81e13aea service nova] Lock "4b7932d8-b781-4db7-a1c5-791ce8d1d866-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:02:07 user nova-compute[73449]: DEBUG nova.compute.manager [req-31bbdfc2-2f07-4a44-a7ac-524fee3c9764 req-70efddee-74be-4b08-a299-006e81e13aea service nova] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] No waiting events found dispatching network-vif-plugged-dbd5bb98-0410-4179-a99a-9181d85357ea {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 12:02:07 user nova-compute[73449]: WARNING nova.compute.manager [req-31bbdfc2-2f07-4a44-a7ac-524fee3c9764 req-70efddee-74be-4b08-a299-006e81e13aea service nova] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] Received unexpected event network-vif-plugged-dbd5bb98-0410-4179-a99a-9181d85357ea for instance with vm_state active and task_state deleting.
Aug 17 12:02:07 user nova-compute[73449]: DEBUG nova.network.neutron [-] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] Updating instance_info_cache with network_info: [] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 12:02:07 user nova-compute[73449]: INFO nova.compute.manager [-] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] Took 0.96 seconds to deallocate network for instance.
Aug 17 12:02:07 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:02:07 user nova-compute[73449]: DEBUG nova.compute.manager [req-7aed295a-78ef-4240-8956-e5974a9bed58 req-4e771ec1-50fc-4596-9531-44dd6d8b3bb2 service nova] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] Received event network-vif-deleted-dbd5bb98-0410-4179-a99a-9181d85357ea {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:02:07 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-29b10485-3448-4a58-ae77-65d7a27a947d tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:02:07 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-29b10485-3448-4a58-ae77-65d7a27a947d tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:02:08 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-29b10485-3448-4a58-ae77-65d7a27a947d tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 12:02:08 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-29b10485-3448-4a58-ae77-65d7a27a947d tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 12:02:08 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-29b10485-3448-4a58-ae77-65d7a27a947d tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.370s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:02:08 user nova-compute[73449]: INFO nova.scheduler.client.report [None req-29b10485-3448-4a58-ae77-65d7a27a947d tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Deleted allocations for instance 4b7932d8-b781-4db7-a1c5-791ce8d1d866
Aug 17 12:02:08 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-29b10485-3448-4a58-ae77-65d7a27a947d tempest-AttachVolumeShelveTestJSON-2080997856 tempest-AttachVolumeShelveTestJSON-2080997856-project-member] Lock "4b7932d8-b781-4db7-a1c5-791ce8d1d866" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.374s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:02:08 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:02:09 user nova-compute[73449]: DEBUG nova.compute.manager [req-019a6585-ee5a-483a-a799-203bb0f84dc8 req-56df4f9d-96e1-4438-858d-f441e649849f service nova] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] Received event network-vif-plugged-dbd5bb98-0410-4179-a99a-9181d85357ea {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:02:09 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-019a6585-ee5a-483a-a799-203bb0f84dc8 req-56df4f9d-96e1-4438-858d-f441e649849f service nova] Acquiring lock "4b7932d8-b781-4db7-a1c5-791ce8d1d866-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:02:09 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-019a6585-ee5a-483a-a799-203bb0f84dc8 req-56df4f9d-96e1-4438-858d-f441e649849f service nova] Lock "4b7932d8-b781-4db7-a1c5-791ce8d1d866-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:02:09 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-019a6585-ee5a-483a-a799-203bb0f84dc8 req-56df4f9d-96e1-4438-858d-f441e649849f service nova] Lock "4b7932d8-b781-4db7-a1c5-791ce8d1d866-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:02:09 user nova-compute[73449]: DEBUG nova.compute.manager [req-019a6585-ee5a-483a-a799-203bb0f84dc8 req-56df4f9d-96e1-4438-858d-f441e649849f service nova] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] No waiting events found dispatching network-vif-plugged-dbd5bb98-0410-4179-a99a-9181d85357ea {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 12:02:09 user nova-compute[73449]: WARNING nova.compute.manager [req-019a6585-ee5a-483a-a799-203bb0f84dc8 req-56df4f9d-96e1-4438-858d-f441e649849f service nova] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] Received unexpected event network-vif-plugged-dbd5bb98-0410-4179-a99a-9181d85357ea for instance with vm_state deleted and task_state None.
Aug 17 12:02:09 user nova-compute[73449]: DEBUG nova.compute.manager [req-019a6585-ee5a-483a-a799-203bb0f84dc8 req-56df4f9d-96e1-4438-858d-f441e649849f service nova] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] Received event network-vif-plugged-dbd5bb98-0410-4179-a99a-9181d85357ea {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:02:09 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-019a6585-ee5a-483a-a799-203bb0f84dc8 req-56df4f9d-96e1-4438-858d-f441e649849f service nova] Acquiring lock "4b7932d8-b781-4db7-a1c5-791ce8d1d866-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:02:09 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-019a6585-ee5a-483a-a799-203bb0f84dc8 req-56df4f9d-96e1-4438-858d-f441e649849f service nova] Lock "4b7932d8-b781-4db7-a1c5-791ce8d1d866-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:02:09 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-019a6585-ee5a-483a-a799-203bb0f84dc8 req-56df4f9d-96e1-4438-858d-f441e649849f service nova] Lock "4b7932d8-b781-4db7-a1c5-791ce8d1d866-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:02:09 user nova-compute[73449]: DEBUG nova.compute.manager [req-019a6585-ee5a-483a-a799-203bb0f84dc8 req-56df4f9d-96e1-4438-858d-f441e649849f service nova] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] No waiting events found dispatching network-vif-plugged-dbd5bb98-0410-4179-a99a-9181d85357ea {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 12:02:09 user nova-compute[73449]: WARNING nova.compute.manager [req-019a6585-ee5a-483a-a799-203bb0f84dc8 req-56df4f9d-96e1-4438-858d-f441e649849f service nova] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] Received unexpected event network-vif-plugged-dbd5bb98-0410-4179-a99a-9181d85357ea for instance with vm_state deleted and task_state None.
Aug 17 12:02:09 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:02:10 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:02:10 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Starting heal instance info cache {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 12:02:11 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "refresh_cache-31f5f3d2-41d8-4a26-9eb2-18b891f94734" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 12:02:11 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquired lock "refresh_cache-31f5f3d2-41d8-4a26-9eb2-18b891f94734" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 12:02:11 user nova-compute[73449]: DEBUG nova.network.neutron [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] Forcefully refreshing network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 12:02:11 user nova-compute[73449]: DEBUG nova.network.neutron [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] Updating instance_info_cache with network_info: [{"id": "ea00b08a-3d80-453b-8c1a-9bdc74ac652f", "address": "fa:16:3e:d2:96:e4", "network": {"id": "9455bb75-f75a-41ff-8f6f-49f55aa738f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-425274599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec3b0b72e47448ebe99f9fc64119c1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea00b08a-3d", "ovs_interfaceid": "ea00b08a-3d80-453b-8c1a-9bdc74ac652f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 12:02:11 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Releasing lock "refresh_cache-31f5f3d2-41d8-4a26-9eb2-18b891f94734" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 12:02:11 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] Updated the network info_cache for instance {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 12:02:11 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:02:11 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:02:11 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:02:11 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:02:11 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=73449) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 12:02:11 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/712c777e-251b-43d8-b923-8eda693f32ed/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:02:11 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:02:11 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/712c777e-251b-43d8-b923-8eda693f32ed/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:02:11 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/712c777e-251b-43d8-b923-8eda693f32ed/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:02:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/712c777e-251b-43d8-b923-8eda693f32ed/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:02:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cacd9ed-27fb-431d-999e-31ff2464d14d/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:02:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cacd9ed-27fb-431d-999e-31ff2464d14d/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:02:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cacd9ed-27fb-431d-999e-31ff2464d14d/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:02:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cacd9ed-27fb-431d-999e-31ff2464d14d/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:02:12 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73449) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 12:02:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk.rescue --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:02:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:02:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk.rescue --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:02:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk.rescue --force-share --output=json" returned: 0 in 0.207s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:02:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:02:13 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:02:13 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:02:13 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:02:13 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73449) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 12:02:13 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d74c8f6-fb4e-4460-b722-674a8a1e2d25/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:02:13 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d74c8f6-fb4e-4460-b722-674a8a1e2d25/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:02:13 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d74c8f6-fb4e-4460-b722-674a8a1e2d25/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:02:13 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d74c8f6-fb4e-4460-b722-674a8a1e2d25/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:02:13 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89440604-1daf-4e7a-a524-2f9c21a9cb96/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:02:13 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89440604-1daf-4e7a-a524-2f9c21a9cb96/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:02:13 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89440604-1daf-4e7a-a524-2f9c21a9cb96/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:02:14 user nova-compute[73449]: DEBUG os_brick.utils [None req-eebae17e-b377-4222-83dd-36716139420a tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 12:02:14 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:02:14 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:02:14 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc4b0c76-96b9-4e13-bd7a-9c9503168ee9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4d3924302012\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:02:14 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:02:14 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.031s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:02:14 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[04b7bcff-b6ab-4a3b-8c3e-b4e7476d6dc4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:02:14 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:02:14 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:02:14 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[10263fda-a5e8-418f-a6f2-15e7ac7b9e83]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:02:14 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[c098e117-752e-4346-99bc-31a4f24eee9d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:02:14 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-eebae17e-b377-4222-83dd-36716139420a tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Running cmd (subprocess): nvme version {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:02:14 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-eebae17e-b377-4222-83dd-36716139420a tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] 'nvme version' failed. Not Retrying. {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 12:02:14 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.nvmeof [None req-eebae17e-b377-4222-83dd-36716139420a tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] nvme not present on system {{(pid=73449) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 12:02:14 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89440604-1daf-4e7a-a524-2f9c21a9cb96/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:02:14 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:02:14 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d160711b-0b77-4f9a-b1d9-f0ac16240d4d/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:02:14 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 12:02:14 user nova-compute[73449]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 12:02:14 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ac7bb5b-2c85-4b17-bf85-c76f7716d102]: (4, '') {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:02:14 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-eebae17e-b377-4222-83dd-36716139420a tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73449) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 12:02:14 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-eebae17e-b377-4222-83dd-36716139420a tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73449) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 12:02:14 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-eebae17e-b377-4222-83dd-36716139420a tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] LIGHTOS: no hostnqn found. {{(pid=73449) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 12:02:14 user nova-compute[73449]: DEBUG os_brick.utils [None req-eebae17e-b377-4222-83dd-36716139420a tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] <== get_connector_properties: return (168ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4d3924302012', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 12:02:14 user nova-compute[73449]: DEBUG nova.virt.block_device [None req-eebae17e-b377-4222-83dd-36716139420a tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] Updating existing volume attachment record: 960e2afa-6b32-4db9-8409-7d49a0ada225 {{(pid=73449) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 12:02:14 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d160711b-0b77-4f9a-b1d9-f0ac16240d4d/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:02:14 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d160711b-0b77-4f9a-b1d9-f0ac16240d4d/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:02:14 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d160711b-0b77-4f9a-b1d9-f0ac16240d4d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:02:14 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 12:02:15 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 12:02:15 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Hypervisor/Node resource view: name=user free_ram=7849MB free_disk=24.96930694580078GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73449) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 12:02:15 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:02:15 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:02:15 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 3d74c8f6-fb4e-4460-b722-674a8a1e2d25 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 12:02:15 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance ae75d334-431a-4008-8b3d-f2a727d92417 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 12:02:15 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 89440604-1daf-4e7a-a524-2f9c21a9cb96 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 12:02:15 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 31f5f3d2-41d8-4a26-9eb2-18b891f94734 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 12:02:15 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 773e5c86-a86a-414d-aab4-8e13e0b68c1e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 12:02:15 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 5cacd9ed-27fb-431d-999e-31ff2464d14d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 12:02:15 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 712c777e-251b-43d8-b923-8eda693f32ed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 12:02:15 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance d160711b-0b77-4f9a-b1d9-f0ac16240d4d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 12:02:15 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 5a627da9-03a1-4239-8721-cefe99c39ee2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 12:02:15 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73449) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 12:02:15 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73449) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 12:02:15 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 12:02:15 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 12:02:15 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Compute_service record updated for user:user {{(pid=73449) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 12:02:15 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.480s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:02:16 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:02:16 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:02:16 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73449) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 12:02:16 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:02:16 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:02:16 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:02:17 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-687d4653-42db-496d-8a7a-6579585d68b5 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Acquiring lock "5cacd9ed-27fb-431d-999e-31ff2464d14d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:02:17 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-687d4653-42db-496d-8a7a-6579585d68b5 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Lock "5cacd9ed-27fb-431d-999e-31ff2464d14d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:02:17 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-687d4653-42db-496d-8a7a-6579585d68b5 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Acquiring lock "5cacd9ed-27fb-431d-999e-31ff2464d14d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:02:17 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-687d4653-42db-496d-8a7a-6579585d68b5 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Lock "5cacd9ed-27fb-431d-999e-31ff2464d14d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:02:17 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-687d4653-42db-496d-8a7a-6579585d68b5 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Lock "5cacd9ed-27fb-431d-999e-31ff2464d14d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:02:17 user nova-compute[73449]: INFO nova.compute.manager [None req-687d4653-42db-496d-8a7a-6579585d68b5 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] [instance: 5cacd9ed-27fb-431d-999e-31ff2464d14d] Terminating instance
Aug 17 12:02:17 user nova-compute[73449]: DEBUG nova.compute.manager [None req-687d4653-42db-496d-8a7a-6579585d68b5 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] [instance: 5cacd9ed-27fb-431d-999e-31ff2464d14d] Start destroying the instance on the hypervisor. {{(pid=73449) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 12:02:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:02:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:02:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:02:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:02:17 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:02:18 user nova-compute[73449]: DEBUG nova.compute.manager [req-f982611b-a8f1-4755-8671-a849e7a62735 req-4dac983c-49b7-4356-962f-a0130edb673e service nova] [instance: 5cacd9ed-27fb-431d-999e-31ff2464d14d] Received event network-vif-unplugged-b9152b88-6f67-4bcb-bcd0-64a3a04103dc {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:02:18 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-f982611b-a8f1-4755-8671-a849e7a62735 req-4dac983c-49b7-4356-962f-a0130edb673e service nova] Acquiring lock "5cacd9ed-27fb-431d-999e-31ff2464d14d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:02:18 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-f982611b-a8f1-4755-8671-a849e7a62735 req-4dac983c-49b7-4356-962f-a0130edb673e service nova] Lock "5cacd9ed-27fb-431d-999e-31ff2464d14d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:02:18 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-f982611b-a8f1-4755-8671-a849e7a62735 req-4dac983c-49b7-4356-962f-a0130edb673e service nova] Lock "5cacd9ed-27fb-431d-999e-31ff2464d14d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:02:18 user nova-compute[73449]: DEBUG nova.compute.manager [req-f982611b-a8f1-4755-8671-a849e7a62735 req-4dac983c-49b7-4356-962f-a0130edb673e service nova] [instance: 5cacd9ed-27fb-431d-999e-31ff2464d14d] No waiting events found dispatching network-vif-unplugged-b9152b88-6f67-4bcb-bcd0-64a3a04103dc {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 12:02:18 user nova-compute[73449]: DEBUG nova.compute.manager [req-f982611b-a8f1-4755-8671-a849e7a62735 req-4dac983c-49b7-4356-962f-a0130edb673e service nova] [instance: 5cacd9ed-27fb-431d-999e-31ff2464d14d] Received event network-vif-unplugged-b9152b88-6f67-4bcb-bcd0-64a3a04103dc for instance with task_state deleting. {{(pid=73449) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 12:02:18 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: 5cacd9ed-27fb-431d-999e-31ff2464d14d] Instance destroyed successfully.
Aug 17 12:02:18 user nova-compute[73449]: DEBUG nova.objects.instance [None req-687d4653-42db-496d-8a7a-6579585d68b5 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Lazy-loading 'resources' on Instance uuid 5cacd9ed-27fb-431d-999e-31ff2464d14d {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:02:18 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-687d4653-42db-496d-8a7a-6579585d68b5 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:58:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-674583217',display_name='tempest-TestServerVolumeAttachmentScenario-server-674583217',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-674583217',id=38,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCXWqLXpWF8erKgB3vM3vw2DGg6dfNJsZsM8jNUJuubW4nr3/Me/ODTj0B6fjZCkTEIUnFqIijRGIRwM3XAXz9jFAAZsQH1LmOqziapTXFMx6WlNv83637EGmrD6si+xRg==',key_name='tempest-keypair-1050136507',keypairs=<?>,launch_index=0,launched_at=2023-08-17T11:58:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='43bbeaa2a37b4189a850b409ac6e1c27',ramdisk_id='',reservation_id='r-kx80z54f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-799133608',owner_user_name='tempest-TestServerVolumeAttachmentScenario-799133608-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T11:58:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80c63646b70647b295581670ff09df83',uuid=5cacd9ed-27fb-431d-999e-31ff2464d14d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b9152b88-6f67-4bcb-bcd0-64a3a04103dc", "address": "fa:16:3e:e5:8a:59", "network": {"id": "78528cb3-037c-4381-964f-7c0211faa0f0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-330540320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43bbeaa2a37b4189a850b409ac6e1c27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9152b88-6f", "ovs_interfaceid": "b9152b88-6f67-4bcb-bcd0-64a3a04103dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 12:02:18 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-687d4653-42db-496d-8a7a-6579585d68b5 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Converting VIF {"id": "b9152b88-6f67-4bcb-bcd0-64a3a04103dc", "address": "fa:16:3e:e5:8a:59", "network": {"id": "78528cb3-037c-4381-964f-7c0211faa0f0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-330540320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43bbeaa2a37b4189a850b409ac6e1c27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9152b88-6f", "ovs_interfaceid": "b9152b88-6f67-4bcb-bcd0-64a3a04103dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 12:02:18 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-687d4653-42db-496d-8a7a-6579585d68b5 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e5:8a:59,bridge_name='br-int',has_traffic_filtering=True,id=b9152b88-6f67-4bcb-bcd0-64a3a04103dc,network=Network(78528cb3-037c-4381-964f-7c0211faa0f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9152b88-6f') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 12:02:18 user nova-compute[73449]: DEBUG os_vif [None req-687d4653-42db-496d-8a7a-6579585d68b5 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:8a:59,bridge_name='br-int',has_traffic_filtering=True,id=b9152b88-6f67-4bcb-bcd0-64a3a04103dc,network=Network(78528cb3-037c-4381-964f-7c0211faa0f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9152b88-6f') {{(pid=73449) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 12:02:18 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:02:18 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb9152b88-6f, bridge=br-int, if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 12:02:18 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:02:18 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:02:18 user nova-compute[73449]: INFO os_vif [None req-687d4653-42db-496d-8a7a-6579585d68b5 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:8a:59,bridge_name='br-int',has_traffic_filtering=True,id=b9152b88-6f67-4bcb-bcd0-64a3a04103dc,network=Network(78528cb3-037c-4381-964f-7c0211faa0f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9152b88-6f')
Aug 17 12:02:18 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-687d4653-42db-496d-8a7a-6579585d68b5 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] [instance: 5cacd9ed-27fb-431d-999e-31ff2464d14d] Deleting instance files /opt/stack/data/nova/instances/5cacd9ed-27fb-431d-999e-31ff2464d14d_del
Aug 17 12:02:18 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-687d4653-42db-496d-8a7a-6579585d68b5 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] [instance: 5cacd9ed-27fb-431d-999e-31ff2464d14d] Deletion of /opt/stack/data/nova/instances/5cacd9ed-27fb-431d-999e-31ff2464d14d_del complete
Aug 17 12:02:18 user nova-compute[73449]: INFO nova.compute.manager [None req-687d4653-42db-496d-8a7a-6579585d68b5 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] [instance: 5cacd9ed-27fb-431d-999e-31ff2464d14d] Took 0.99 seconds to destroy the instance on the hypervisor.
Aug 17 12:02:18 user nova-compute[73449]: DEBUG oslo.service.loopingcall [None req-687d4653-42db-496d-8a7a-6579585d68b5 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73449) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 12:02:18 user nova-compute[73449]: DEBUG nova.compute.manager [-] [instance: 5cacd9ed-27fb-431d-999e-31ff2464d14d] Deallocating network for instance {{(pid=73449) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 12:02:18 user nova-compute[73449]: DEBUG nova.network.neutron [-] [instance: 5cacd9ed-27fb-431d-999e-31ff2464d14d] deallocate_for_instance() {{(pid=73449) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 12:02:18 user nova-compute[73449]: DEBUG nova.compute.manager [req-58983fcc-6f06-4b2f-9010-7032fced8049 req-69b6800e-d77e-4df5-9013-8b2ec6b179eb service nova] [instance: 773e5c86-a86a-414d-aab4-8e13e0b68c1e] Received event network-changed-4c8e383a-45a4-4c6a-858f-74a1b73e9e27 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:02:18 user nova-compute[73449]: DEBUG nova.compute.manager [req-58983fcc-6f06-4b2f-9010-7032fced8049 req-69b6800e-d77e-4df5-9013-8b2ec6b179eb service nova] [instance: 773e5c86-a86a-414d-aab4-8e13e0b68c1e] Refreshing instance network info cache due to event network-changed-4c8e383a-45a4-4c6a-858f-74a1b73e9e27. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 12:02:18 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-58983fcc-6f06-4b2f-9010-7032fced8049 req-69b6800e-d77e-4df5-9013-8b2ec6b179eb service nova] Acquiring lock "refresh_cache-773e5c86-a86a-414d-aab4-8e13e0b68c1e" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 12:02:18 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-58983fcc-6f06-4b2f-9010-7032fced8049 req-69b6800e-d77e-4df5-9013-8b2ec6b179eb service nova] Acquired lock "refresh_cache-773e5c86-a86a-414d-aab4-8e13e0b68c1e" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 12:02:18 user nova-compute[73449]: DEBUG nova.network.neutron [req-58983fcc-6f06-4b2f-9010-7032fced8049 req-69b6800e-d77e-4df5-9013-8b2ec6b179eb service nova] [instance: 773e5c86-a86a-414d-aab4-8e13e0b68c1e] Refreshing network info cache for port 4c8e383a-45a4-4c6a-858f-74a1b73e9e27 {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 12:02:18 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-7f640e88-fbcb-45ba-a34e-16986c1be90b tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Acquiring lock "773e5c86-a86a-414d-aab4-8e13e0b68c1e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:02:18 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-7f640e88-fbcb-45ba-a34e-16986c1be90b tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Lock "773e5c86-a86a-414d-aab4-8e13e0b68c1e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:02:18 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-7f640e88-fbcb-45ba-a34e-16986c1be90b tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Acquiring lock "773e5c86-a86a-414d-aab4-8e13e0b68c1e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:02:18 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-7f640e88-fbcb-45ba-a34e-16986c1be90b tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Lock "773e5c86-a86a-414d-aab4-8e13e0b68c1e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:02:18 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-7f640e88-fbcb-45ba-a34e-16986c1be90b tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Lock "773e5c86-a86a-414d-aab4-8e13e0b68c1e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:02:18 user nova-compute[73449]: INFO nova.compute.manager [None req-7f640e88-fbcb-45ba-a34e-16986c1be90b tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 773e5c86-a86a-414d-aab4-8e13e0b68c1e] Terminating instance
Aug 17 12:02:18 user nova-compute[73449]: DEBUG nova.compute.manager [None req-7f640e88-fbcb-45ba-a34e-16986c1be90b tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 773e5c86-a86a-414d-aab4-8e13e0b68c1e] Start destroying the instance on the hypervisor. {{(pid=73449) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 12:02:18 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:02:18 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:02:18 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:02:18 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:02:19 user nova-compute[73449]: DEBUG nova.network.neutron [req-58983fcc-6f06-4b2f-9010-7032fced8049 req-69b6800e-d77e-4df5-9013-8b2ec6b179eb service nova] [instance: 773e5c86-a86a-414d-aab4-8e13e0b68c1e] Updated VIF entry in instance network info cache for port 4c8e383a-45a4-4c6a-858f-74a1b73e9e27. {{(pid=73449) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 12:02:19 user nova-compute[73449]: DEBUG nova.network.neutron [req-58983fcc-6f06-4b2f-9010-7032fced8049 req-69b6800e-d77e-4df5-9013-8b2ec6b179eb service nova] [instance: 773e5c86-a86a-414d-aab4-8e13e0b68c1e] Updating instance_info_cache with network_info: [{"id": "4c8e383a-45a4-4c6a-858f-74a1b73e9e27", "address": "fa:16:3e:40:4b:d5", "network": {"id": "a9e8fcd6-4152-466b-99ad-44b85db05a05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-920564935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bd46cdaff7a4b40955f7c8a12c55452", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c8e383a-45", "ovs_interfaceid": "4c8e383a-45a4-4c6a-858f-74a1b73e9e27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 12:02:19 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-58983fcc-6f06-4b2f-9010-7032fced8049 req-69b6800e-d77e-4df5-9013-8b2ec6b179eb service nova] Releasing lock "refresh_cache-773e5c86-a86a-414d-aab4-8e13e0b68c1e" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 12:02:19 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: 773e5c86-a86a-414d-aab4-8e13e0b68c1e] Instance destroyed successfully.
Aug 17 12:02:19 user nova-compute[73449]: DEBUG nova.objects.instance [None req-7f640e88-fbcb-45ba-a34e-16986c1be90b tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Lazy-loading 'resources' on Instance uuid 773e5c86-a86a-414d-aab4-8e13e0b68c1e {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:02:19 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-7f640e88-fbcb-45ba-a34e-16986c1be90b tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:57:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-98386620',display_name='tempest-TestVolumeBootPattern-server-98386620',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-98386620',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIHMstqa6z3yCDWSo0nI/hXtJfgb+1MPwAN30vhg6KwDR8sZaSoGZeJ4pbZmuMNqk20Z45pPhufbqYZm+wNKDW7ChjAcmHiitPsVRUAo/TWnRjbFauozfEZ44NXHQWQQfg==',key_name='tempest-TestVolumeBootPattern-29823023',keypairs=<?>,launch_index=0,launched_at=2023-08-17T11:57:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4bd46cdaff7a4b40955f7c8a12c55452',ramdisk_id='',reservation_id='r-bi01ccir',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-813872552',owner_user_name='tempest-TestVolumeBootPattern-813872552-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T11:57:30Z,user_data=None,user_id='804ccb0440fb46a4a4c0ae65c3893296',uuid=773e5c86-a86a-414d-aab4-8e13e0b68c1e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4c8e383a-45a4-4c6a-858f-74a1b73e9e27", "address": "fa:16:3e:40:4b:d5", "network": {"id": "a9e8fcd6-4152-466b-99ad-44b85db05a05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-920564935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bd46cdaff7a4b40955f7c8a12c55452", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c8e383a-45", "ovs_interfaceid": "4c8e383a-45a4-4c6a-858f-74a1b73e9e27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 12:02:19 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-7f640e88-fbcb-45ba-a34e-16986c1be90b tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Converting VIF {"id": "4c8e383a-45a4-4c6a-858f-74a1b73e9e27", "address": "fa:16:3e:40:4b:d5", "network": {"id": "a9e8fcd6-4152-466b-99ad-44b85db05a05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-920564935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bd46cdaff7a4b40955f7c8a12c55452", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c8e383a-45", "ovs_interfaceid": "4c8e383a-45a4-4c6a-858f-74a1b73e9e27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 12:02:19 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-7f640e88-fbcb-45ba-a34e-16986c1be90b tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:40:4b:d5,bridge_name='br-int',has_traffic_filtering=True,id=4c8e383a-45a4-4c6a-858f-74a1b73e9e27,network=Network(a9e8fcd6-4152-466b-99ad-44b85db05a05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c8e383a-45') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 12:02:19 user nova-compute[73449]: DEBUG os_vif [None req-7f640e88-fbcb-45ba-a34e-16986c1be90b tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:40:4b:d5,bridge_name='br-int',has_traffic_filtering=True,id=4c8e383a-45a4-4c6a-858f-74a1b73e9e27,network=Network(a9e8fcd6-4152-466b-99ad-44b85db05a05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c8e383a-45') {{(pid=73449) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 12:02:19 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:02:19 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4c8e383a-45, bridge=br-int, if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 12:02:19 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:02:19 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:02:19 user nova-compute[73449]: INFO os_vif [None req-7f640e88-fbcb-45ba-a34e-16986c1be90b tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:40:4b:d5,bridge_name='br-int',has_traffic_filtering=True,id=4c8e383a-45a4-4c6a-858f-74a1b73e9e27,network=Network(a9e8fcd6-4152-466b-99ad-44b85db05a05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c8e383a-45')
Aug 17 12:02:19 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f640e88-fbcb-45ba-a34e-16986c1be90b tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 773e5c86-a86a-414d-aab4-8e13e0b68c1e] calling os-brick to detach iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 12:02:19 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f640e88-fbcb-45ba-a34e-16986c1be90b tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, {'target_iqns': ['iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CtHUhuMp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 12:02:19 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-7f640e88-fbcb-45ba-a34e-16986c1be90b tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 12:02:19 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-7f640e88-fbcb-45ba-a34e-16986c1be90b tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 12:02:19 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-7f640e88-fbcb-45ba-a34e-16986c1be90b tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 12:02:19 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f640e88-fbcb-45ba-a34e-16986c1be90b tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7', 0)] {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 12:02:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:02:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:02:19 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[d32b8551-d3cc-46ba-bc94-6cd5ff431937]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:02:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:02:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:02:19 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d6a44aa-4a9e-4793-91c0-8bc5cde366eb]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7 (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:02:19 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f640e88-fbcb-45ba-a34e-16986c1be90b tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)
Aug 17 12:02:19 user nova-compute[73449]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7 (non-flash)
Aug 17 12:02:19 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 12:02:19 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f640e88-fbcb-45ba-a34e-16986c1be90b tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)
Aug 17 12:02:19 user nova-compute[73449]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7 (non-flash)
Aug 17 12:02:19 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 12:02:19 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f640e88-fbcb-45ba-a34e-16986c1be90b tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe7582c2dd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7'): ({'sdc'}, set())}) {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 12:02:19 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-7f640e88-fbcb-45ba-a34e-16986c1be90b tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Removing single pathed devices sdc {{(pid=73449) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 12:02:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:02:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:02:19 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b59486f-69db-495b-be3b-87d1648023c7]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:02:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:02:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:02:19 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[837e9131-0dde-494c-9637-147483679108]: (4, ('ok\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:02:19 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-7f640e88-fbcb-45ba-a34e-16986c1be90b tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Flushing IO for device /dev/sdc {{(pid=73449) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 12:02:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:02:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:02:19 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cabd675-6b75-4604-b8cd-2ca81a04053c]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:02:19 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-7f640e88-fbcb-45ba-a34e-16986c1be90b tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73449) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 12:02:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:02:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.061s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:02:19 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[30824a63-0990-4a51-9f1e-fa36327d1633]: (4, ('1', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:02:19 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-7f640e88-fbcb-45ba-a34e-16986c1be90b tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73449) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 12:02:19 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-7f640e88-fbcb-45ba-a34e-16986c1be90b tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] SCSI volumes sdc have been removed. {{(pid=73449) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 12:02:19 user nova-compute[73449]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23234616162363133', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_de3d2a32', '/dev/disk/by-id/scsi-1SCST_BIOde3d2a32-24aab61376f3b5f2') {{(pid=84309) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 17 12:02:19 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec849726-05f4-4d9d-b661-985b950de44c]: (4, None) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:02:19 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f640e88-fbcb-45ba-a34e-16986c1be90b tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7')] {{(pid=73449) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 12:02:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:02:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:02:19 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[9222cd82-a73d-4e1f-abe6-7d7c8b560d26]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:02:19 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f640e88-fbcb-45ba-a34e-16986c1be90b tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:02:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7 -p 172.16.0.220:3260 --logout {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:02:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:02:19 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[a33ee5fa-2695-4599-a08a-b1a1bfce1abe]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:02:19 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f640e88-fbcb-45ba-a34e-16986c1be90b tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7, portal: 172.16.0.220,3260]
Aug 17 12:02:19 user nova-compute[73449]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7, portal: 172.16.0.220,3260] successful.
Aug 17 12:02:19 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:02:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7 -p 172.16.0.220:3260 --op delete {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:02:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a343174-094b-4cd2-98cc-f215c047baf7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:02:19 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[0277ee94-54b3-4cf8-acb2-6de37d82805e]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:02:19 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f640e88-fbcb-45ba-a34e-16986c1be90b tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:02:19 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-7f640e88-fbcb-45ba-a34e-16986c1be90b tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 12:02:19 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f640e88-fbcb-45ba-a34e-16986c1be90b tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] <== disconnect_volume: return (324ms) None {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 12:02:19 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f640e88-fbcb-45ba-a34e-16986c1be90b tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 773e5c86-a86a-414d-aab4-8e13e0b68c1e] Disconnected iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 12:02:19 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-7f640e88-fbcb-45ba-a34e-16986c1be90b tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 773e5c86-a86a-414d-aab4-8e13e0b68c1e] Deleting instance files /opt/stack/data/nova/instances/773e5c86-a86a-414d-aab4-8e13e0b68c1e_del
Aug 17 12:02:19 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-7f640e88-fbcb-45ba-a34e-16986c1be90b tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 773e5c86-a86a-414d-aab4-8e13e0b68c1e] Deletion of /opt/stack/data/nova/instances/773e5c86-a86a-414d-aab4-8e13e0b68c1e_del complete
Aug 17 12:02:20 user nova-compute[73449]: INFO nova.compute.manager [None req-7f640e88-fbcb-45ba-a34e-16986c1be90b tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 773e5c86-a86a-414d-aab4-8e13e0b68c1e] Took 1.20 seconds to destroy the instance on the hypervisor.
Aug 17 12:02:20 user nova-compute[73449]: DEBUG oslo.service.loopingcall [None req-7f640e88-fbcb-45ba-a34e-16986c1be90b tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73449) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 12:02:20 user nova-compute[73449]: DEBUG nova.compute.manager [-] [instance: 773e5c86-a86a-414d-aab4-8e13e0b68c1e] Deallocating network for instance {{(pid=73449) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 12:02:20 user nova-compute[73449]: DEBUG nova.network.neutron [-] [instance: 773e5c86-a86a-414d-aab4-8e13e0b68c1e] deallocate_for_instance() {{(pid=73449) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 12:02:20 user nova-compute[73449]: DEBUG nova.compute.manager [req-bfbb2c61-ca2e-40a4-94ab-cac8c848b22b req-4636fcfe-ce1d-41ff-96bc-f9dcfd403c1a service nova] [instance: 5cacd9ed-27fb-431d-999e-31ff2464d14d] Received event network-vif-plugged-b9152b88-6f67-4bcb-bcd0-64a3a04103dc {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:02:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-bfbb2c61-ca2e-40a4-94ab-cac8c848b22b req-4636fcfe-ce1d-41ff-96bc-f9dcfd403c1a service nova] Acquiring lock "5cacd9ed-27fb-431d-999e-31ff2464d14d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:02:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-bfbb2c61-ca2e-40a4-94ab-cac8c848b22b req-4636fcfe-ce1d-41ff-96bc-f9dcfd403c1a service nova] Lock "5cacd9ed-27fb-431d-999e-31ff2464d14d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:02:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-bfbb2c61-ca2e-40a4-94ab-cac8c848b22b req-4636fcfe-ce1d-41ff-96bc-f9dcfd403c1a service nova] Lock "5cacd9ed-27fb-431d-999e-31ff2464d14d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:02:20 user nova-compute[73449]: DEBUG nova.compute.manager [req-bfbb2c61-ca2e-40a4-94ab-cac8c848b22b req-4636fcfe-ce1d-41ff-96bc-f9dcfd403c1a service nova] [instance: 5cacd9ed-27fb-431d-999e-31ff2464d14d] No waiting events found dispatching network-vif-plugged-b9152b88-6f67-4bcb-bcd0-64a3a04103dc {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 12:02:20 user nova-compute[73449]: WARNING nova.compute.manager [req-bfbb2c61-ca2e-40a4-94ab-cac8c848b22b req-4636fcfe-ce1d-41ff-96bc-f9dcfd403c1a service nova] [instance: 5cacd9ed-27fb-431d-999e-31ff2464d14d] Received unexpected event network-vif-plugged-b9152b88-6f67-4bcb-bcd0-64a3a04103dc for instance with vm_state active and task_state deleting.
Aug 17 12:02:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-8371a58b-3f40-40b4-886c-10ef5166b6bf tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Acquiring lock "ae75d334-431a-4008-8b3d-f2a727d92417" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:02:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-8371a58b-3f40-40b4-886c-10ef5166b6bf tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Lock "ae75d334-431a-4008-8b3d-f2a727d92417" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:02:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-8371a58b-3f40-40b4-886c-10ef5166b6bf tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Acquiring lock "ae75d334-431a-4008-8b3d-f2a727d92417-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:02:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-8371a58b-3f40-40b4-886c-10ef5166b6bf tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Lock "ae75d334-431a-4008-8b3d-f2a727d92417-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:02:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-8371a58b-3f40-40b4-886c-10ef5166b6bf tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Lock "ae75d334-431a-4008-8b3d-f2a727d92417-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:02:20 user nova-compute[73449]: INFO nova.compute.manager [None req-8371a58b-3f40-40b4-886c-10ef5166b6bf tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: ae75d334-431a-4008-8b3d-f2a727d92417] Terminating instance
Aug 17 12:02:20 user nova-compute[73449]: DEBUG nova.compute.manager [None req-8371a58b-3f40-40b4-886c-10ef5166b6bf tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: ae75d334-431a-4008-8b3d-f2a727d92417] Start destroying the instance on the hypervisor. {{(pid=73449) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 12:02:20 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:02:20 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:02:20 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:02:20 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:02:20 user nova-compute[73449]: DEBUG nova.network.neutron [-] [instance: 773e5c86-a86a-414d-aab4-8e13e0b68c1e] Updating instance_info_cache with network_info: [] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 12:02:20 user nova-compute[73449]: DEBUG nova.network.neutron [-] [instance: 5cacd9ed-27fb-431d-999e-31ff2464d14d] Updating instance_info_cache with network_info: [] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 12:02:20 user nova-compute[73449]: INFO nova.compute.manager [-] [instance: 5cacd9ed-27fb-431d-999e-31ff2464d14d] Took 2.35 seconds to deallocate network for instance.
Aug 17 12:02:20 user nova-compute[73449]: INFO nova.compute.manager [-] [instance: 773e5c86-a86a-414d-aab4-8e13e0b68c1e] Took 0.78 seconds to deallocate network for instance.
Aug 17 12:02:20 user nova-compute[73449]: DEBUG nova.compute.manager [req-d765a6a5-1c73-4da5-9ffd-6f5d4e9225df req-cf2726fc-a6a6-4488-85db-0b9161c8d244 service nova] [instance: 773e5c86-a86a-414d-aab4-8e13e0b68c1e] Received event network-vif-deleted-4c8e383a-45a4-4c6a-858f-74a1b73e9e27 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:02:20 user nova-compute[73449]: INFO nova.compute.manager [req-d765a6a5-1c73-4da5-9ffd-6f5d4e9225df req-cf2726fc-a6a6-4488-85db-0b9161c8d244 service nova] [instance: 773e5c86-a86a-414d-aab4-8e13e0b68c1e] Neutron deleted interface 4c8e383a-45a4-4c6a-858f-74a1b73e9e27; detaching it from the instance and deleting it from the info cache
Aug 17 12:02:20 user nova-compute[73449]: DEBUG nova.network.neutron [req-d765a6a5-1c73-4da5-9ffd-6f5d4e9225df req-cf2726fc-a6a6-4488-85db-0b9161c8d244 service nova] [instance: 773e5c86-a86a-414d-aab4-8e13e0b68c1e] Updating instance_info_cache with network_info: [] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 12:02:20 user nova-compute[73449]: DEBUG nova.compute.manager [req-c398c987-8b31-46ff-99f0-8b0b4bc49f0e req-ed1274e9-e230-49fe-bfb1-71c7345df417 service nova] [instance: 773e5c86-a86a-414d-aab4-8e13e0b68c1e] Received event network-vif-unplugged-4c8e383a-45a4-4c6a-858f-74a1b73e9e27 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:02:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-c398c987-8b31-46ff-99f0-8b0b4bc49f0e req-ed1274e9-e230-49fe-bfb1-71c7345df417 service nova] Acquiring lock "773e5c86-a86a-414d-aab4-8e13e0b68c1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:02:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-c398c987-8b31-46ff-99f0-8b0b4bc49f0e req-ed1274e9-e230-49fe-bfb1-71c7345df417 service nova] Lock "773e5c86-a86a-414d-aab4-8e13e0b68c1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:02:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-c398c987-8b31-46ff-99f0-8b0b4bc49f0e req-ed1274e9-e230-49fe-bfb1-71c7345df417 service nova] Lock "773e5c86-a86a-414d-aab4-8e13e0b68c1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:02:20 user nova-compute[73449]: DEBUG nova.compute.manager [req-c398c987-8b31-46ff-99f0-8b0b4bc49f0e req-ed1274e9-e230-49fe-bfb1-71c7345df417 service nova] [instance: 773e5c86-a86a-414d-aab4-8e13e0b68c1e] No waiting events found dispatching network-vif-unplugged-4c8e383a-45a4-4c6a-858f-74a1b73e9e27 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 12:02:20 user nova-compute[73449]: DEBUG nova.compute.manager [req-c398c987-8b31-46ff-99f0-8b0b4bc49f0e req-ed1274e9-e230-49fe-bfb1-71c7345df417 service nova] [instance: 773e5c86-a86a-414d-aab4-8e13e0b68c1e] Received event network-vif-unplugged-4c8e383a-45a4-4c6a-858f-74a1b73e9e27 for instance with task_state deleting. {{(pid=73449) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 12:02:20 user nova-compute[73449]: DEBUG nova.compute.manager [req-c398c987-8b31-46ff-99f0-8b0b4bc49f0e req-ed1274e9-e230-49fe-bfb1-71c7345df417 service nova] [instance: 773e5c86-a86a-414d-aab4-8e13e0b68c1e] Received event network-vif-plugged-4c8e383a-45a4-4c6a-858f-74a1b73e9e27 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:02:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-c398c987-8b31-46ff-99f0-8b0b4bc49f0e req-ed1274e9-e230-49fe-bfb1-71c7345df417 service nova] Acquiring lock "773e5c86-a86a-414d-aab4-8e13e0b68c1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:02:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-c398c987-8b31-46ff-99f0-8b0b4bc49f0e req-ed1274e9-e230-49fe-bfb1-71c7345df417 service nova] Lock "773e5c86-a86a-414d-aab4-8e13e0b68c1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:02:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-c398c987-8b31-46ff-99f0-8b0b4bc49f0e req-ed1274e9-e230-49fe-bfb1-71c7345df417 service nova] Lock "773e5c86-a86a-414d-aab4-8e13e0b68c1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:02:20 user nova-compute[73449]: DEBUG nova.compute.manager [req-c398c987-8b31-46ff-99f0-8b0b4bc49f0e req-ed1274e9-e230-49fe-bfb1-71c7345df417 service nova] [instance: 773e5c86-a86a-414d-aab4-8e13e0b68c1e] No waiting events found dispatching network-vif-plugged-4c8e383a-45a4-4c6a-858f-74a1b73e9e27 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 12:02:20 user nova-compute[73449]: WARNING nova.compute.manager [req-c398c987-8b31-46ff-99f0-8b0b4bc49f0e req-ed1274e9-e230-49fe-bfb1-71c7345df417 service nova] [instance: 773e5c86-a86a-414d-aab4-8e13e0b68c1e] Received unexpected event network-vif-plugged-4c8e383a-45a4-4c6a-858f-74a1b73e9e27 for instance with vm_state active and task_state deleting.
Aug 17 12:02:20 user nova-compute[73449]: DEBUG nova.compute.manager [req-d765a6a5-1c73-4da5-9ffd-6f5d4e9225df req-cf2726fc-a6a6-4488-85db-0b9161c8d244 service nova] [instance: 773e5c86-a86a-414d-aab4-8e13e0b68c1e] Detach interface failed, port_id=4c8e383a-45a4-4c6a-858f-74a1b73e9e27, reason: Instance 773e5c86-a86a-414d-aab4-8e13e0b68c1e could not be found. {{(pid=73449) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 12:02:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-687d4653-42db-496d-8a7a-6579585d68b5 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:02:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-687d4653-42db-496d-8a7a-6579585d68b5 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:02:20 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:02:20 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:02:21 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:02:21 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:02:21 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: ae75d334-431a-4008-8b3d-f2a727d92417] Instance destroyed successfully.
Aug 17 12:02:21 user nova-compute[73449]: DEBUG nova.objects.instance [None req-8371a58b-3f40-40b4-886c-10ef5166b6bf tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Lazy-loading 'resources' on Instance uuid ae75d334-431a-4008-8b3d-f2a727d92417 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:02:21 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-8371a58b-3f40-40b4-886c-10ef5166b6bf tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:45:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2048350466',display_name='tempest-ServerRescueNegativeTestJSON-server-2048350466',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2048350466',id=19,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T11:47:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8722edee53ed4a9188366c38f3b8b52f',ramdisk_id='',reservation_id='r-9gepo79y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1458167730',owner_user_name='tempest-ServerRescueNegativeTestJSON-1458167730-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T11:47:49Z,user_data=None,user_id='7ccb76bc93f84e0897da59b8d5928238',uuid=ae75d334-431a-4008-8b3d-f2a727d92417,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "0cd51063-e3d9-44a8-a1cd-b89bb41a4438", "address": "fa:16:3e:54:1f:e7", "network": {"id": "f7298070-baaa-4842-b3b2-d9fe1058d3b6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1715911399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8722edee53ed4a9188366c38f3b8b52f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cd51063-e3", "ovs_interfaceid": "0cd51063-e3d9-44a8-a1cd-b89bb41a4438", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 12:02:21 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-8371a58b-3f40-40b4-886c-10ef5166b6bf tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Converting VIF {"id": "0cd51063-e3d9-44a8-a1cd-b89bb41a4438", "address": "fa:16:3e:54:1f:e7", "network": {"id": "f7298070-baaa-4842-b3b2-d9fe1058d3b6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1715911399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8722edee53ed4a9188366c38f3b8b52f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cd51063-e3", "ovs_interfaceid": "0cd51063-e3d9-44a8-a1cd-b89bb41a4438", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 12:02:21 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-8371a58b-3f40-40b4-886c-10ef5166b6bf tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:54:1f:e7,bridge_name='br-int',has_traffic_filtering=True,id=0cd51063-e3d9-44a8-a1cd-b89bb41a4438,network=Network(f7298070-baaa-4842-b3b2-d9fe1058d3b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cd51063-e3') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 12:02:21 user nova-compute[73449]: DEBUG os_vif [None req-8371a58b-3f40-40b4-886c-10ef5166b6bf tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:1f:e7,bridge_name='br-int',has_traffic_filtering=True,id=0cd51063-e3d9-44a8-a1cd-b89bb41a4438,network=Network(f7298070-baaa-4842-b3b2-d9fe1058d3b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cd51063-e3') {{(pid=73449) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 12:02:21 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:02:21 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0cd51063-e3, bridge=br-int, if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 12:02:21 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:02:21 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:02:21 user nova-compute[73449]: INFO os_vif [None req-8371a58b-3f40-40b4-886c-10ef5166b6bf tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:1f:e7,bridge_name='br-int',has_traffic_filtering=True,id=0cd51063-e3d9-44a8-a1cd-b89bb41a4438,network=Network(f7298070-baaa-4842-b3b2-d9fe1058d3b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cd51063-e3')
Aug 17 12:02:21 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-8371a58b-3f40-40b4-886c-10ef5166b6bf tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: ae75d334-431a-4008-8b3d-f2a727d92417] Deleting instance files /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417_del
Aug 17 12:02:21 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-8371a58b-3f40-40b4-886c-10ef5166b6bf tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: ae75d334-431a-4008-8b3d-f2a727d92417] Deletion of /opt/stack/data/nova/instances/ae75d334-431a-4008-8b3d-f2a727d92417_del complete
Aug 17 12:02:21 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-687d4653-42db-496d-8a7a-6579585d68b5 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 12:02:21 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-687d4653-42db-496d-8a7a-6579585d68b5 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 12:02:21 user nova-compute[73449]: INFO nova.compute.manager [None req-8371a58b-3f40-40b4-886c-10ef5166b6bf tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: ae75d334-431a-4008-8b3d-f2a727d92417] Took 1.05 seconds to destroy the instance on the hypervisor.
Aug 17 12:02:21 user nova-compute[73449]: DEBUG oslo.service.loopingcall [None req-8371a58b-3f40-40b4-886c-10ef5166b6bf tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73449) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 12:02:21 user nova-compute[73449]: DEBUG nova.compute.manager [-] [instance: ae75d334-431a-4008-8b3d-f2a727d92417] Deallocating network for instance {{(pid=73449) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 12:02:21 user nova-compute[73449]: DEBUG nova.network.neutron [-] [instance: ae75d334-431a-4008-8b3d-f2a727d92417] deallocate_for_instance() {{(pid=73449) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 12:02:21 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-687d4653-42db-496d-8a7a-6579585d68b5 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.436s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:02:21 user nova-compute[73449]: INFO nova.scheduler.client.report [None req-687d4653-42db-496d-8a7a-6579585d68b5 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Deleted allocations for instance 5cacd9ed-27fb-431d-999e-31ff2464d14d
Aug 17 12:02:21 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:02:21 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:02:21 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-687d4653-42db-496d-8a7a-6579585d68b5 tempest-TestServerVolumeAttachmentScenario-799133608 tempest-TestServerVolumeAttachmentScenario-799133608-project-member] Lock "5cacd9ed-27fb-431d-999e-31ff2464d14d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.978s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:02:21 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:02:21 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:02:21 user nova-compute[73449]: INFO nova.compute.manager [None req-7f640e88-fbcb-45ba-a34e-16986c1be90b tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] [instance: 773e5c86-a86a-414d-aab4-8e13e0b68c1e] Took 0.92 seconds to detach 1 volumes for instance.
Aug 17 12:02:21 user nova-compute[73449]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692273726.730567, 4b7932d8-b781-4db7-a1c5-791ce8d1d866 => Stopped> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 12:02:21 user nova-compute[73449]: INFO nova.compute.manager [-] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] VM Stopped (Lifecycle Event)
Aug 17 12:02:21 user nova-compute[73449]: DEBUG nova.compute.manager [None req-428d2a73-401a-440c-b88a-e369014fcff1 None None] [instance: 4b7932d8-b781-4db7-a1c5-791ce8d1d866] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 12:02:21 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-7f640e88-fbcb-45ba-a34e-16986c1be90b tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:02:21 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-7f640e88-fbcb-45ba-a34e-16986c1be90b tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:02:21 user nova-compute[73449]: DEBUG nova.network.neutron [-] [instance: ae75d334-431a-4008-8b3d-f2a727d92417] Updating instance_info_cache with network_info: [] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 12:02:21 user nova-compute[73449]: INFO nova.compute.manager [-] [instance: ae75d334-431a-4008-8b3d-f2a727d92417] Took 0.57 seconds to deallocate network for instance.
Aug 17 12:02:21 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-8371a58b-3f40-40b4-886c-10ef5166b6bf tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:02:22 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-7f640e88-fbcb-45ba-a34e-16986c1be90b tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 12:02:22 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-7f640e88-fbcb-45ba-a34e-16986c1be90b tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 12:02:22 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-7f640e88-fbcb-45ba-a34e-16986c1be90b tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.305s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:02:22 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-8371a58b-3f40-40b4-886c-10ef5166b6bf tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.193s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:02:22 user nova-compute[73449]: INFO nova.scheduler.client.report [None req-7f640e88-fbcb-45ba-a34e-16986c1be90b tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Deleted allocations for instance 773e5c86-a86a-414d-aab4-8e13e0b68c1e
Aug 17 12:02:22 user nova-compute[73449]: DEBUG nova.compute.manager [req-c7b20c44-5fef-41e9-85b8-103be94dbaf1 req-026b92b0-c4dd-4522-bc9a-66b6d1200e92 service nova] [instance: ae75d334-431a-4008-8b3d-f2a727d92417] Received event network-vif-unplugged-0cd51063-e3d9-44a8-a1cd-b89bb41a4438 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:02:22 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-c7b20c44-5fef-41e9-85b8-103be94dbaf1 req-026b92b0-c4dd-4522-bc9a-66b6d1200e92 service nova] Acquiring lock "ae75d334-431a-4008-8b3d-f2a727d92417-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:02:22 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-c7b20c44-5fef-41e9-85b8-103be94dbaf1 req-026b92b0-c4dd-4522-bc9a-66b6d1200e92 service nova] Lock "ae75d334-431a-4008-8b3d-f2a727d92417-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:02:22 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-c7b20c44-5fef-41e9-85b8-103be94dbaf1 req-026b92b0-c4dd-4522-bc9a-66b6d1200e92 service nova] Lock "ae75d334-431a-4008-8b3d-f2a727d92417-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:02:22 user nova-compute[73449]: DEBUG nova.compute.manager [req-c7b20c44-5fef-41e9-85b8-103be94dbaf1 req-026b92b0-c4dd-4522-bc9a-66b6d1200e92 service nova] [instance: ae75d334-431a-4008-8b3d-f2a727d92417] No waiting events found dispatching network-vif-unplugged-0cd51063-e3d9-44a8-a1cd-b89bb41a4438 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 12:02:22 user nova-compute[73449]: WARNING nova.compute.manager [req-c7b20c44-5fef-41e9-85b8-103be94dbaf1 req-026b92b0-c4dd-4522-bc9a-66b6d1200e92 service nova] [instance: ae75d334-431a-4008-8b3d-f2a727d92417] Received unexpected event network-vif-unplugged-0cd51063-e3d9-44a8-a1cd-b89bb41a4438 for instance with vm_state deleted and task_state None.
Aug 17 12:02:22 user nova-compute[73449]: DEBUG nova.compute.manager [req-c7b20c44-5fef-41e9-85b8-103be94dbaf1 req-026b92b0-c4dd-4522-bc9a-66b6d1200e92 service nova] [instance: ae75d334-431a-4008-8b3d-f2a727d92417] Received event network-vif-plugged-0cd51063-e3d9-44a8-a1cd-b89bb41a4438 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:02:22 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-c7b20c44-5fef-41e9-85b8-103be94dbaf1 req-026b92b0-c4dd-4522-bc9a-66b6d1200e92 service nova] Acquiring lock "ae75d334-431a-4008-8b3d-f2a727d92417-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:02:22 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-c7b20c44-5fef-41e9-85b8-103be94dbaf1 req-026b92b0-c4dd-4522-bc9a-66b6d1200e92 service nova] Lock "ae75d334-431a-4008-8b3d-f2a727d92417-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:02:22 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-c7b20c44-5fef-41e9-85b8-103be94dbaf1 req-026b92b0-c4dd-4522-bc9a-66b6d1200e92 service nova] Lock "ae75d334-431a-4008-8b3d-f2a727d92417-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:02:22 user nova-compute[73449]: DEBUG nova.compute.manager [req-c7b20c44-5fef-41e9-85b8-103be94dbaf1 req-026b92b0-c4dd-4522-bc9a-66b6d1200e92 service nova] [instance: ae75d334-431a-4008-8b3d-f2a727d92417] No waiting events found dispatching network-vif-plugged-0cd51063-e3d9-44a8-a1cd-b89bb41a4438 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 12:02:22 user nova-compute[73449]: WARNING nova.compute.manager [req-c7b20c44-5fef-41e9-85b8-103be94dbaf1 req-026b92b0-c4dd-4522-bc9a-66b6d1200e92 service nova] [instance: ae75d334-431a-4008-8b3d-f2a727d92417] Received unexpected event network-vif-plugged-0cd51063-e3d9-44a8-a1cd-b89bb41a4438 for instance with vm_state deleted and task_state None.
Aug 17 12:02:22 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-7f640e88-fbcb-45ba-a34e-16986c1be90b tempest-TestVolumeBootPattern-813872552 tempest-TestVolumeBootPattern-813872552-project-member] Lock "773e5c86-a86a-414d-aab4-8e13e0b68c1e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.531s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:02:22 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-8371a58b-3f40-40b4-886c-10ef5166b6bf tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 12:02:22 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-8371a58b-3f40-40b4-886c-10ef5166b6bf tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 12:02:22 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-8371a58b-3f40-40b4-886c-10ef5166b6bf tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.357s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:02:22 user nova-compute[73449]: INFO nova.scheduler.client.report [None req-8371a58b-3f40-40b4-886c-10ef5166b6bf tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Deleted allocations for instance ae75d334-431a-4008-8b3d-f2a727d92417
Aug 17 12:02:22 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-8371a58b-3f40-40b4-886c-10ef5166b6bf tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Lock "ae75d334-431a-4008-8b3d-f2a727d92417" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.346s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:02:22 user nova-compute[73449]: DEBUG nova.compute.manager [req-937d7e31-4717-4228-8435-3facaf04ba1a req-0989b049-d7e5-46b6-9964-50e02c4ce5b9 service nova] [instance: 5cacd9ed-27fb-431d-999e-31ff2464d14d] Received event network-vif-deleted-b9152b88-6f67-4bcb-bcd0-64a3a04103dc {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:02:22 user nova-compute[73449]: DEBUG nova.compute.manager [req-937d7e31-4717-4228-8435-3facaf04ba1a req-0989b049-d7e5-46b6-9964-50e02c4ce5b9 service nova] [instance: ae75d334-431a-4008-8b3d-f2a727d92417] Received event network-vif-deleted-0cd51063-e3d9-44a8-a1cd-b89bb41a4438 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:02:25 user nova-compute[73449]: DEBUG nova.compute.manager [req-899bfb25-1ccf-46cc-b420-f8eb2f73a83a req-bdc37ad3-5faf-4297-9db5-0835dc7abf9b service nova] [instance: d160711b-0b77-4f9a-b1d9-f0ac16240d4d] Received event network-changed-ad3f0bca-081f-47c5-909b-2b2b2e2fe69f {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:02:25 user nova-compute[73449]: DEBUG nova.compute.manager [req-899bfb25-1ccf-46cc-b420-f8eb2f73a83a req-bdc37ad3-5faf-4297-9db5-0835dc7abf9b service nova] [instance: d160711b-0b77-4f9a-b1d9-f0ac16240d4d] Refreshing instance network info cache due to event network-changed-ad3f0bca-081f-47c5-909b-2b2b2e2fe69f. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 12:02:25 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-899bfb25-1ccf-46cc-b420-f8eb2f73a83a req-bdc37ad3-5faf-4297-9db5-0835dc7abf9b service nova] Acquiring lock "refresh_cache-d160711b-0b77-4f9a-b1d9-f0ac16240d4d" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 12:02:25 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-899bfb25-1ccf-46cc-b420-f8eb2f73a83a req-bdc37ad3-5faf-4297-9db5-0835dc7abf9b service nova] Acquired lock "refresh_cache-d160711b-0b77-4f9a-b1d9-f0ac16240d4d" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 12:02:25 user nova-compute[73449]: DEBUG nova.network.neutron [req-899bfb25-1ccf-46cc-b420-f8eb2f73a83a req-bdc37ad3-5faf-4297-9db5-0835dc7abf9b service nova] [instance: d160711b-0b77-4f9a-b1d9-f0ac16240d4d] Refreshing network info cache for port ad3f0bca-081f-47c5-909b-2b2b2e2fe69f {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 12:02:25 user nova-compute[73449]: DEBUG nova.network.neutron [req-899bfb25-1ccf-46cc-b420-f8eb2f73a83a req-bdc37ad3-5faf-4297-9db5-0835dc7abf9b service nova] [instance: d160711b-0b77-4f9a-b1d9-f0ac16240d4d] Updated VIF entry in instance network info cache for port ad3f0bca-081f-47c5-909b-2b2b2e2fe69f. {{(pid=73449) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 12:02:25 user nova-compute[73449]: DEBUG nova.network.neutron [req-899bfb25-1ccf-46cc-b420-f8eb2f73a83a req-bdc37ad3-5faf-4297-9db5-0835dc7abf9b service nova] [instance: d160711b-0b77-4f9a-b1d9-f0ac16240d4d] Updating instance_info_cache with network_info: [{"id": "ad3f0bca-081f-47c5-909b-2b2b2e2fe69f", "address": "fa:16:3e:d6:cf:c6", "network": {"id": "71648e1b-cf19-44b7-bae2-9d38543cdee9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-822323626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75aa99e369c54b65aff27adbb1daf2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad3f0bca-08", "ovs_interfaceid": "ad3f0bca-081f-47c5-909b-2b2b2e2fe69f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 12:02:25 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-899bfb25-1ccf-46cc-b420-f8eb2f73a83a req-bdc37ad3-5faf-4297-9db5-0835dc7abf9b service nova] Releasing lock "refresh_cache-d160711b-0b77-4f9a-b1d9-f0ac16240d4d" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 12:02:26 user nova-compute[73449]: DEBUG nova.compute.manager [None req-eebae17e-b377-4222-83dd-36716139420a tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] Start spawning the instance on the hypervisor. {{(pid=73449) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 12:02:26 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-eebae17e-b377-4222-83dd-36716139420a tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] Creating instance directory {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 12:02:26 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-eebae17e-b377-4222-83dd-36716139420a tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] Creating image(s)
Aug 17 12:02:26 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-eebae17e-b377-4222-83dd-36716139420a tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] Did not create local disks {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 12:02:26 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-eebae17e-b377-4222-83dd-36716139420a tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] Ensure instance console log exists: /opt/stack/data/nova/instances/5a627da9-03a1-4239-8721-cefe99c39ee2/console.log {{(pid=73449) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 12:02:26 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-eebae17e-b377-4222-83dd-36716139420a tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:02:26 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-eebae17e-b377-4222-83dd-36716139420a tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:02:26 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-eebae17e-b377-4222-83dd-36716139420a tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:02:26 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-eebae17e-b377-4222-83dd-36716139420a tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] Start _get_guest_xml network_info=[{"id": "69831639-3628-4b42-8ddd-fe0965dea4b6", "address": "fa:16:3e:de:22:d6", "network": {"id": "9455bb75-f75a-41ff-8f6f-49f55aa738f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-425274599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec3b0b72e47448ebe99f9fc64119c1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69831639-36", "ovs_interfaceid": "69831639-3628-4b42-8ddd-fe0965dea4b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T11:36:11Z,direct_url=<?>,disk_format='qcow2',id=0a2904ae-083d-41c8-83db-343132b36148,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7a77880136a54ef195c82e018e1939db',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T11:36:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'attachment_id': '960e2afa-6b32-4db9-8409-7d49a0ada225', 'boot_index': 0, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:8314fb1e-61f9-44b5-b944-5a94677724c8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QnosROjY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5a627da9-03a1-4239-8721-cefe99c39ee2', 'attached_at': '', 'detached_at': '', 'volume_id': '8314fb1e-61f9-44b5-b944-5a94677724c8', 'serial': '8314fb1e-61f9-44b5-b944-5a94677724c8'}, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 12:02:26 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-eebae17e-b377-4222-83dd-36716139420a tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 12:02:26 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-eebae17e-b377-4222-83dd-36716139420a tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 12:02:26 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-eebae17e-b377-4222-83dd-36716139420a tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 12:02:26 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-eebae17e-b377-4222-83dd-36716139420a tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] CPU controller missing on host. {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 12:02:26 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-eebae17e-b377-4222-83dd-36716139420a tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 12:02:26 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-eebae17e-b377-4222-83dd-36716139420a tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] CPU controller found on host. {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 12:02:26 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-eebae17e-b377-4222-83dd-36716139420a tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73449) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 12:02:26 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-eebae17e-b377-4222-83dd-36716139420a tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T11:35:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T11:36:11Z,direct_url=<?>,disk_format='qcow2',id=0a2904ae-083d-41c8-83db-343132b36148,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7a77880136a54ef195c82e018e1939db',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T11:36:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 12:02:26 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-eebae17e-b377-4222-83dd-36716139420a tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Flavor limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 12:02:26 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-eebae17e-b377-4222-83dd-36716139420a tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Image limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 12:02:26 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-eebae17e-b377-4222-83dd-36716139420a tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Flavor pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 12:02:26 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-eebae17e-b377-4222-83dd-36716139420a tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Image pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 12:02:26 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-eebae17e-b377-4222-83dd-36716139420a tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 12:02:26 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-eebae17e-b377-4222-83dd-36716139420a tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 12:02:26 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-eebae17e-b377-4222-83dd-36716139420a tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 12:02:26 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-eebae17e-b377-4222-83dd-36716139420a tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Got 1 possible topologies {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 12:02:26 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-eebae17e-b377-4222-83dd-36716139420a tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 12:02:26 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-eebae17e-b377-4222-83dd-36716139420a tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 12:02:26 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eebae17e-b377-4222-83dd-36716139420a tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] Calling os-brick to attach iSCSI Volume {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 12:02:26 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-eebae17e-b377-4222-83dd-36716139420a tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8314fb1e-61f9-44b5-b944-5a94677724c8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QnosROjY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 12:02:26 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-eebae17e-b377-4222-83dd-36716139420a tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 12:02:26 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-eebae17e-b377-4222-83dd-36716139420a tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 12:02:26 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-eebae17e-b377-4222-83dd-36716139420a tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 12:02:26 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-eebae17e-b377-4222-83dd-36716139420a tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 12:02:26 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-eebae17e-b377-4222-83dd-36716139420a tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8314fb1e-61f9-44b5-b944-5a94677724c8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 12:02:26 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-eebae17e-b377-4222-83dd-36716139420a tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8314fb1e-61f9-44b5-b944-5a94677724c8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 12:02:26 user nova-compute[73449]: INFO os_brick.initiator.connectors.iscsi [None req-eebae17e-b377-4222-83dd-36716139420a tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 12:02:26 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8314fb1e-61f9-44b5-b944-5a94677724c8 -p 172.16.0.220:3260 {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:02:26 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8314fb1e-61f9-44b5-b944-5a94677724c8 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:02:26 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[16d83172-f6bf-4ee7-92c3-10e771e5f764]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:02:26 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-eebae17e-b377-4222-83dd-36716139420a tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 12:02:26 user nova-compute[73449]:  {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:02:26 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8314fb1e-61f9-44b5-b944-5a94677724c8 -p 172.16.0.220:3260 --interface default --op new {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:02:26 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8314fb1e-61f9-44b5-b944-5a94677724c8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:02:26 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f626229-1b05-411e-aa00-7d25205e4b7b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8314fb1e-61f9-44b5-b944-5a94677724c8] added\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:02:26 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-eebae17e-b377-4222-83dd-36716139420a tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8314fb1e-61f9-44b5-b944-5a94677724c8] added
Aug 17 12:02:26 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:02:26 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8314fb1e-61f9-44b5-b944-5a94677724c8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:02:26 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8314fb1e-61f9-44b5-b944-5a94677724c8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:02:26 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[3284397d-ec3a-48a2-93ea-732a2209adb2]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:02:26 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-eebae17e-b377-4222-83dd-36716139420a tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:02:26 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8314fb1e-61f9-44b5-b944-5a94677724c8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:02:26 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:02:26 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8314fb1e-61f9-44b5-b944-5a94677724c8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:02:26 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[3431d5cd-2da2-458f-8c73-6fbe14e28eef]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:02:26 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-eebae17e-b377-4222-83dd-36716139420a tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:02:26 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8314fb1e-61f9-44b5-b944-5a94677724c8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QnosROjY {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:02:26 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8314fb1e-61f9-44b5-b944-5a94677724c8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QnosROjY" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:02:26 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b3c68c3-93f3-4497-a245-628010b7fc26]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:02:26 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-eebae17e-b377-4222-83dd-36716139420a tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QnosROjY'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:02:26 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8314fb1e-61f9-44b5-b944-5a94677724c8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:02:26 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8314fb1e-61f9-44b5-b944-5a94677724c8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:02:26 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[43397bd7-e735-48cb-a720-2172ed67cc45]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:02:26 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-eebae17e-b377-4222-83dd-36716139420a tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:02:26 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:02:26 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:02:26 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[4df07344-34f2-4c18-99fb-7de369682989]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:02:26 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-eebae17e-b377-4222-83dd-36716139420a tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)
Aug 17 12:02:26 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 12:02:26 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-eebae17e-b377-4222-83dd-36716139420a tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)
Aug 17 12:02:26 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 12:02:26 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8314fb1e-61f9-44b5-b944-5a94677724c8 -p 172.16.0.220:3260 --login {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:02:26 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8314fb1e-61f9-44b5-b944-5a94677724c8 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:02:26 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[63268ff9-9279-43c0-ac1a-cbebe0809111]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8314fb1e-61f9-44b5-b944-5a94677724c8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8314fb1e-61f9-44b5-b944-5a94677724c8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:02:26 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-eebae17e-b377-4222-83dd-36716139420a tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8314fb1e-61f9-44b5-b944-5a94677724c8, portal: 172.16.0.220,3260]
Aug 17 12:02:26 user nova-compute[73449]: Login to [iface: default, target: iqn.2010-10.org.openstack:8314fb1e-61f9-44b5-b944-5a94677724c8, portal: 172.16.0.220,3260] successful.
Aug 17 12:02:26 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:02:26 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8314fb1e-61f9-44b5-b944-5a94677724c8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:02:26 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8314fb1e-61f9-44b5-b944-5a94677724c8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.315s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:02:26 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a2af457-3ae9-44f3-a151-7cd498b13a02]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:02:26 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-eebae17e-b377-4222-83dd-36716139420a tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:02:26 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:02:26 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:02:26 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5b5ddb3-5d42-48d7-be47-1d9af4f2ae16]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8314fb1e-61f9-44b5-b944-5a94677724c8 (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:02:26 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-eebae17e-b377-4222-83dd-36716139420a tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)
Aug 17 12:02:26 user nova-compute[73449]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8314fb1e-61f9-44b5-b944-5a94677724c8 (non-flash)
Aug 17 12:02:26 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 12:02:26 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-eebae17e-b377-4222-83dd-36716139420a tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)
Aug 17 12:02:26 user nova-compute[73449]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8314fb1e-61f9-44b5-b944-5a94677724c8 (non-flash)
Aug 17 12:02:26 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 12:02:26 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-eebae17e-b377-4222-83dd-36716139420a tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8314fb1e-61f9-44b5-b944-5a94677724c8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.573s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 12:02:26 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-eebae17e-b377-4222-83dd-36716139420a tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Connected to 172.16.0.220:3260 {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 12:02:26 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-eebae17e-b377-4222-83dd-36716139420a tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] HCTL ('33', '-', '-', 0) found on session 48 with lun 0 {{(pid=73449) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 12:02:26 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-eebae17e-b377-4222-83dd-36716139420a tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73449) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 12:02:26 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:02:26 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.053s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:02:26 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[57f5fc71-9acb-46da-93df-2854d093849e]: (4, ('- - 0', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:02:26 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-eebae17e-b377-4222-83dd-36716139420a tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: None {{(pid=73449) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 12:02:27 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-eebae17e-b377-4222-83dd-36716139420a tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73449) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 12:02:27 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-eebae17e-b377-4222-83dd-36716139420a tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QnosROjY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 12:02:27 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-eebae17e-b377-4222-83dd-36716139420a tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.640s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 12:02:27 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-eebae17e-b377-4222-83dd-36716139420a tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] <== connect_volume: return (1640ms) {'type': 'block', 'scsi_wwn': '23865313534386439', 'path': '/dev/sdb'} {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 12:02:27 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eebae17e-b377-4222-83dd-36716139420a tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23865313534386439', 'path': '/dev/sdb'} {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 12:02:27 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-eebae17e-b377-4222-83dd-36716139420a tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T12:02:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1061317430',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1061317430',id=43,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ec3b0b72e47448ebe99f9fc64119c1c',ramdisk_id='',reservation_id='r-ibt4mle4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1818019421',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T12:02:03Z,user_data=None,user_id='14eb3826311a4f8f91d8264e87f7b866',uuid=5a627da9-03a1-4239-8721-cefe99c39ee2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "69831639-3628-4b42-8ddd-fe0965dea4b6", "address": "fa:16:3e:de:22:d6", "network": {"id": "9455bb75-f75a-41ff-8f6f-49f55aa738f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-425274599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec3b0b72e47448ebe99f9fc64119c1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69831639-36", "ovs_interfaceid": "69831639-3628-4b42-8ddd-fe0965dea4b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73449) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 12:02:27 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-eebae17e-b377-4222-83dd-36716139420a tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Converting VIF {"id": "69831639-3628-4b42-8ddd-fe0965dea4b6", "address": "fa:16:3e:de:22:d6", "network": {"id": "9455bb75-f75a-41ff-8f6f-49f55aa738f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-425274599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec3b0b72e47448ebe99f9fc64119c1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69831639-36", "ovs_interfaceid": "69831639-3628-4b42-8ddd-fe0965dea4b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 12:02:27 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-eebae17e-b377-4222-83dd-36716139420a tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:22:d6,bridge_name='br-int',has_traffic_filtering=True,id=69831639-3628-4b42-8ddd-fe0965dea4b6,network=Network(9455bb75-f75a-41ff-8f6f-49f55aa738f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69831639-36') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 12:02:27 user nova-compute[73449]: DEBUG nova.objects.instance [None req-eebae17e-b377-4222-83dd-36716139420a tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Lazy-loading 'pci_devices' on Instance uuid 5a627da9-03a1-4239-8721-cefe99c39ee2 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:02:27 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-eebae17e-b377-4222-83dd-36716139420a tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] End _get_guest_xml xml=<domain type="kvm">
Aug 17 12:02:27 user nova-compute[73449]:   <uuid>5a627da9-03a1-4239-8721-cefe99c39ee2</uuid>
Aug 17 12:02:27 user nova-compute[73449]:   <name>instance-0000002b</name>
Aug 17 12:02:27 user nova-compute[73449]:   <memory>524288</memory>
Aug 17 12:02:27 user nova-compute[73449]:   <vcpu>1</vcpu>
Aug 17 12:02:27 user nova-compute[73449]:   <metadata>
Aug 17 12:02:27 user nova-compute[73449]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 12:02:27 user nova-compute[73449]:       <nova:package version="0.0.0"/>
Aug 17 12:02:27 user nova-compute[73449]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1061317430</nova:name>
Aug 17 12:02:27 user nova-compute[73449]:       <nova:creationTime>2023-08-17 12:02:26</nova:creationTime>
Aug 17 12:02:27 user nova-compute[73449]:       <nova:flavor name="m1.tiny">
Aug 17 12:02:27 user nova-compute[73449]:         <nova:memory>512</nova:memory>
Aug 17 12:02:27 user nova-compute[73449]:         <nova:disk>1</nova:disk>
Aug 17 12:02:27 user nova-compute[73449]:         <nova:swap>0</nova:swap>
Aug 17 12:02:27 user nova-compute[73449]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 12:02:27 user nova-compute[73449]:         <nova:vcpus>1</nova:vcpus>
Aug 17 12:02:27 user nova-compute[73449]:       </nova:flavor>
Aug 17 12:02:27 user nova-compute[73449]:       <nova:owner>
Aug 17 12:02:27 user nova-compute[73449]:         <nova:user uuid="14eb3826311a4f8f91d8264e87f7b866">tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member</nova:user>
Aug 17 12:02:27 user nova-compute[73449]:         <nova:project uuid="4ec3b0b72e47448ebe99f9fc64119c1c">tempest-ServerBootFromVolumeStableRescueTest-1818019421</nova:project>
Aug 17 12:02:27 user nova-compute[73449]:       </nova:owner>
Aug 17 12:02:27 user nova-compute[73449]:       <nova:root type="image" uuid="0a2904ae-083d-41c8-83db-343132b36148"/>
Aug 17 12:02:27 user nova-compute[73449]:       <nova:ports>
Aug 17 12:02:27 user nova-compute[73449]:         <nova:port uuid="69831639-3628-4b42-8ddd-fe0965dea4b6">
Aug 17 12:02:27 user nova-compute[73449]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 17 12:02:27 user nova-compute[73449]:         </nova:port>
Aug 17 12:02:27 user nova-compute[73449]:       </nova:ports>
Aug 17 12:02:27 user nova-compute[73449]:     </nova:instance>
Aug 17 12:02:27 user nova-compute[73449]:   </metadata>
Aug 17 12:02:27 user nova-compute[73449]:   <sysinfo type="smbios">
Aug 17 12:02:27 user nova-compute[73449]:     <system>
Aug 17 12:02:27 user nova-compute[73449]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 12:02:27 user nova-compute[73449]:       <entry name="product">OpenStack Nova</entry>
Aug 17 12:02:27 user nova-compute[73449]:       <entry name="version">0.0.0</entry>
Aug 17 12:02:27 user nova-compute[73449]:       <entry name="serial">5a627da9-03a1-4239-8721-cefe99c39ee2</entry>
Aug 17 12:02:27 user nova-compute[73449]:       <entry name="uuid">5a627da9-03a1-4239-8721-cefe99c39ee2</entry>
Aug 17 12:02:27 user nova-compute[73449]:       <entry name="family">Virtual Machine</entry>
Aug 17 12:02:27 user nova-compute[73449]:     </system>
Aug 17 12:02:27 user nova-compute[73449]:   </sysinfo>
Aug 17 12:02:27 user nova-compute[73449]:   <os>
Aug 17 12:02:27 user nova-compute[73449]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 12:02:27 user nova-compute[73449]:     <boot dev="hd"/>
Aug 17 12:02:27 user nova-compute[73449]:     <smbios mode="sysinfo"/>
Aug 17 12:02:27 user nova-compute[73449]:   </os>
Aug 17 12:02:27 user nova-compute[73449]:   <features>
Aug 17 12:02:27 user nova-compute[73449]:     <acpi/>
Aug 17 12:02:27 user nova-compute[73449]:     <apic/>
Aug 17 12:02:27 user nova-compute[73449]:     <vmcoreinfo/>
Aug 17 12:02:27 user nova-compute[73449]:   </features>
Aug 17 12:02:27 user nova-compute[73449]:   <clock offset="utc">
Aug 17 12:02:27 user nova-compute[73449]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 12:02:27 user nova-compute[73449]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 12:02:27 user nova-compute[73449]:     <timer name="hpet" present="no"/>
Aug 17 12:02:27 user nova-compute[73449]:   </clock>
Aug 17 12:02:27 user nova-compute[73449]:   <cpu mode="custom" match="exact">
Aug 17 12:02:27 user nova-compute[73449]:     <model>Nehalem</model>
Aug 17 12:02:27 user nova-compute[73449]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 12:02:27 user nova-compute[73449]:   </cpu>
Aug 17 12:02:27 user nova-compute[73449]:   <devices>
Aug 17 12:02:27 user nova-compute[73449]:     <disk type="block" device="disk">
Aug 17 12:02:27 user nova-compute[73449]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 12:02:27 user nova-compute[73449]:       <source dev="/dev/sdb"/>
Aug 17 12:02:27 user nova-compute[73449]:       <target dev="vda" bus="virtio"/>
Aug 17 12:02:27 user nova-compute[73449]:       <serial>8314fb1e-61f9-44b5-b944-5a94677724c8</serial>
Aug 17 12:02:27 user nova-compute[73449]:     </disk>
Aug 17 12:02:27 user nova-compute[73449]:     <interface type="ethernet">
Aug 17 12:02:27 user nova-compute[73449]:       <mac address="fa:16:3e:de:22:d6"/>
Aug 17 12:02:27 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 12:02:27 user nova-compute[73449]:       <mtu size="1442"/>
Aug 17 12:02:27 user nova-compute[73449]:       <target dev="tap69831639-36"/>
Aug 17 12:02:27 user nova-compute[73449]:     </interface>
Aug 17 12:02:27 user nova-compute[73449]:     <serial type="pty">
Aug 17 12:02:27 user nova-compute[73449]:       <log file="/opt/stack/data/nova/instances/5a627da9-03a1-4239-8721-cefe99c39ee2/console.log" append="off"/>
Aug 17 12:02:27 user nova-compute[73449]:     </serial>
Aug 17 12:02:27 user nova-compute[73449]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 12:02:27 user nova-compute[73449]:     <video>
Aug 17 12:02:27 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 12:02:27 user nova-compute[73449]:     </video>
Aug 17 12:02:27 user nova-compute[73449]:     <rng model="virtio">
Aug 17 12:02:27 user nova-compute[73449]:       <backend model="random">/dev/urandom</backend>
Aug 17 12:02:27 user nova-compute[73449]:     </rng>
Aug 17 12:02:27 user nova-compute[73449]:     <controller type="usb" index="0" model="none"/>
Aug 17 12:02:27 user nova-compute[73449]:     <memballoon model="virtio">
Aug 17 12:02:27 user nova-compute[73449]:       <stats period="10"/>
Aug 17 12:02:27 user nova-compute[73449]:     </memballoon>
Aug 17 12:02:27 user nova-compute[73449]:   </devices>
Aug 17 12:02:27 user nova-compute[73449]: </domain>
Aug 17 12:02:27 user nova-compute[73449]:  {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 12:02:27 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-eebae17e-b377-4222-83dd-36716139420a tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T12:02:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1061317430',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1061317430',id=43,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ec3b0b72e47448ebe99f9fc64119c1c',ramdisk_id='',reservation_id='r-ibt4mle4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1818019421',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T12:02:03Z,user_data=None,user_id='14eb3826311a4f8f91d8264e87f7b866',uuid=5a627da9-03a1-4239-8721-cefe99c39ee2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "69831639-3628-4b42-8ddd-fe0965dea4b6", "address": "fa:16:3e:de:22:d6", "network": {"id": "9455bb75-f75a-41ff-8f6f-49f55aa738f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-425274599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec3b0b72e47448ebe99f9fc64119c1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69831639-36", "ovs_interfaceid": "69831639-3628-4b42-8ddd-fe0965dea4b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 12:02:27 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-eebae17e-b377-4222-83dd-36716139420a tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Converting VIF {"id": "69831639-3628-4b42-8ddd-fe0965dea4b6", "address": "fa:16:3e:de:22:d6", "network": {"id": "9455bb75-f75a-41ff-8f6f-49f55aa738f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-425274599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec3b0b72e47448ebe99f9fc64119c1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69831639-36", "ovs_interfaceid": "69831639-3628-4b42-8ddd-fe0965dea4b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 12:02:27 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-eebae17e-b377-4222-83dd-36716139420a tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:22:d6,bridge_name='br-int',has_traffic_filtering=True,id=69831639-3628-4b42-8ddd-fe0965dea4b6,network=Network(9455bb75-f75a-41ff-8f6f-49f55aa738f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69831639-36') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 12:02:27 user nova-compute[73449]: DEBUG os_vif [None req-eebae17e-b377-4222-83dd-36716139420a tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:22:d6,bridge_name='br-int',has_traffic_filtering=True,id=69831639-3628-4b42-8ddd-fe0965dea4b6,network=Network(9455bb75-f75a-41ff-8f6f-49f55aa738f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69831639-36') {{(pid=73449) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 12:02:27 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:02:27 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 12:02:27 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 12:02:27 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:02:27 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap69831639-36, may_exist=True, interface_attrs={}) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 12:02:27 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap69831639-36, col_values=(('external_ids', {'iface-id': '69831639-3628-4b42-8ddd-fe0965dea4b6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:de:22:d6', 'vm-uuid': '5a627da9-03a1-4239-8721-cefe99c39ee2'}),), if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 12:02:27 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:02:27 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:02:27 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:02:27 user nova-compute[73449]: INFO os_vif [None req-eebae17e-b377-4222-83dd-36716139420a tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:22:d6,bridge_name='br-int',has_traffic_filtering=True,id=69831639-3628-4b42-8ddd-fe0965dea4b6,network=Network(9455bb75-f75a-41ff-8f6f-49f55aa738f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69831639-36')
Aug 17 12:02:27 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-eebae17e-b377-4222-83dd-36716139420a tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] No BDM found with device name vda, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 12:02:27 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-eebae17e-b377-4222-83dd-36716139420a tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] No VIF found with MAC fa:16:3e:de:22:d6, not building metadata {{(pid=73449) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 12:02:28 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:02:29 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:02:29 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:02:29 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:02:29 user nova-compute[73449]: DEBUG nova.compute.manager [req-cd3895d5-3417-446d-bab8-2b106948755c req-772c7fee-977c-4dff-84be-24cb92759548 service nova] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] Received event network-vif-plugged-69831639-3628-4b42-8ddd-fe0965dea4b6 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:02:29 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-cd3895d5-3417-446d-bab8-2b106948755c req-772c7fee-977c-4dff-84be-24cb92759548 service nova] Acquiring lock "5a627da9-03a1-4239-8721-cefe99c39ee2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:02:29 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-cd3895d5-3417-446d-bab8-2b106948755c req-772c7fee-977c-4dff-84be-24cb92759548 service nova] Lock "5a627da9-03a1-4239-8721-cefe99c39ee2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:02:29 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-cd3895d5-3417-446d-bab8-2b106948755c req-772c7fee-977c-4dff-84be-24cb92759548 service nova] Lock "5a627da9-03a1-4239-8721-cefe99c39ee2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:02:29 user nova-compute[73449]: DEBUG nova.compute.manager [req-cd3895d5-3417-446d-bab8-2b106948755c req-772c7fee-977c-4dff-84be-24cb92759548 service nova] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] No waiting events found dispatching network-vif-plugged-69831639-3628-4b42-8ddd-fe0965dea4b6 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 12:02:29 user nova-compute[73449]: WARNING nova.compute.manager [req-cd3895d5-3417-446d-bab8-2b106948755c req-772c7fee-977c-4dff-84be-24cb92759548 service nova] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] Received unexpected event network-vif-plugged-69831639-3628-4b42-8ddd-fe0965dea4b6 for instance with vm_state building and task_state spawning.
Aug 17 12:02:29 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:02:31 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692273751.2967994, 5a627da9-03a1-4239-8721-cefe99c39ee2 => Resumed> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 12:02:31 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] VM Resumed (Lifecycle Event)
Aug 17 12:02:31 user nova-compute[73449]: DEBUG nova.compute.manager [None req-eebae17e-b377-4222-83dd-36716139420a tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] Instance event wait completed in 0 seconds for  {{(pid=73449) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 12:02:31 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-eebae17e-b377-4222-83dd-36716139420a tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] Guest created on hypervisor {{(pid=73449) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 12:02:31 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] Instance spawned successfully.
Aug 17 12:02:31 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-eebae17e-b377-4222-83dd-36716139420a tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 12:02:31 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 12:02:31 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 12:02:31 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-eebae17e-b377-4222-83dd-36716139420a tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] Found default for hw_cdrom_bus of ide {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 12:02:31 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-eebae17e-b377-4222-83dd-36716139420a tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] Found default for hw_disk_bus of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 12:02:31 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-eebae17e-b377-4222-83dd-36716139420a tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] Found default for hw_input_bus of None {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 12:02:31 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-eebae17e-b377-4222-83dd-36716139420a tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] Found default for hw_pointer_model of None {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 12:02:31 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-eebae17e-b377-4222-83dd-36716139420a tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] Found default for hw_video_model of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 12:02:31 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-eebae17e-b377-4222-83dd-36716139420a tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] Found default for hw_vif_model of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 12:02:31 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 12:02:31 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692273751.2994301, 5a627da9-03a1-4239-8721-cefe99c39ee2 => Started> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 12:02:31 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] VM Started (Lifecycle Event)
Aug 17 12:02:31 user nova-compute[73449]: DEBUG nova.compute.manager [req-9db0d153-036d-42eb-b42c-7baba14e6233 req-ca67a4b6-5c77-4770-835b-3b3587169c47 service nova] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] Received event network-vif-plugged-69831639-3628-4b42-8ddd-fe0965dea4b6 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:02:31 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-9db0d153-036d-42eb-b42c-7baba14e6233 req-ca67a4b6-5c77-4770-835b-3b3587169c47 service nova] Acquiring lock "5a627da9-03a1-4239-8721-cefe99c39ee2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:02:31 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-9db0d153-036d-42eb-b42c-7baba14e6233 req-ca67a4b6-5c77-4770-835b-3b3587169c47 service nova] Lock "5a627da9-03a1-4239-8721-cefe99c39ee2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:02:31 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-9db0d153-036d-42eb-b42c-7baba14e6233 req-ca67a4b6-5c77-4770-835b-3b3587169c47 service nova] Lock "5a627da9-03a1-4239-8721-cefe99c39ee2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:02:31 user nova-compute[73449]: DEBUG nova.compute.manager [req-9db0d153-036d-42eb-b42c-7baba14e6233 req-ca67a4b6-5c77-4770-835b-3b3587169c47 service nova] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] No waiting events found dispatching network-vif-plugged-69831639-3628-4b42-8ddd-fe0965dea4b6 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 12:02:31 user nova-compute[73449]: WARNING nova.compute.manager [req-9db0d153-036d-42eb-b42c-7baba14e6233 req-ca67a4b6-5c77-4770-835b-3b3587169c47 service nova] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] Received unexpected event network-vif-plugged-69831639-3628-4b42-8ddd-fe0965dea4b6 for instance with vm_state building and task_state spawning.
Aug 17 12:02:31 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 12:02:31 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 12:02:31 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 12:02:31 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-1b6d3975-7253-4afa-af07-1daca5ddd8e5 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Acquiring lock "d160711b-0b77-4f9a-b1d9-f0ac16240d4d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:02:31 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-1b6d3975-7253-4afa-af07-1daca5ddd8e5 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Lock "d160711b-0b77-4f9a-b1d9-f0ac16240d4d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:02:31 user nova-compute[73449]: INFO nova.compute.manager [None req-eebae17e-b377-4222-83dd-36716139420a tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] Took 5.42 seconds to spawn the instance on the hypervisor.
Aug 17 12:02:31 user nova-compute[73449]: DEBUG nova.compute.manager [None req-eebae17e-b377-4222-83dd-36716139420a tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 12:02:31 user nova-compute[73449]: DEBUG nova.objects.instance [None req-1b6d3975-7253-4afa-af07-1daca5ddd8e5 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Lazy-loading 'flavor' on Instance uuid d160711b-0b77-4f9a-b1d9-f0ac16240d4d {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:02:31 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-1b6d3975-7253-4afa-af07-1daca5ddd8e5 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Lock "d160711b-0b77-4f9a-b1d9-f0ac16240d4d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:02:31 user nova-compute[73449]: INFO nova.compute.manager [None req-eebae17e-b377-4222-83dd-36716139420a tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] Took 29.09 seconds to build instance.
Aug 17 12:02:31 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-eebae17e-b377-4222-83dd-36716139420a tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Lock "5a627da9-03a1-4239-8721-cefe99c39ee2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 29.198s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:02:31 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-1b6d3975-7253-4afa-af07-1daca5ddd8e5 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Acquiring lock "d160711b-0b77-4f9a-b1d9-f0ac16240d4d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:02:31 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-1b6d3975-7253-4afa-af07-1daca5ddd8e5 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Lock "d160711b-0b77-4f9a-b1d9-f0ac16240d4d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:02:31 user nova-compute[73449]: INFO nova.compute.manager [None req-1b6d3975-7253-4afa-af07-1daca5ddd8e5 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: d160711b-0b77-4f9a-b1d9-f0ac16240d4d] Attaching volume 740e623f-bfc7-4776-b6d7-cb30de9535e4 to /dev/vdb
Aug 17 12:02:31 user nova-compute[73449]: DEBUG os_brick.utils [None req-1b6d3975-7253-4afa-af07-1daca5ddd8e5 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 12:02:31 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:02:31 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:02:31 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[81fd4f47-39c0-443c-9274-eb7677143fa2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4d3924302012\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:02:31 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:02:31 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:02:31 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a0efe14-3cf0-4af9-8d9b-695172d7bb64]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:02:31 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:02:31 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:02:31 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[a97195b3-4fc9-417e-a1a2-814f77580b74]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:02:31 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc19fb4a-674f-42d3-8d07-e736e99c8b0b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:02:31 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-1b6d3975-7253-4afa-af07-1daca5ddd8e5 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Running cmd (subprocess): nvme version {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:02:31 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-1b6d3975-7253-4afa-af07-1daca5ddd8e5 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] 'nvme version' failed. Not Retrying. {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 12:02:31 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1b6d3975-7253-4afa-af07-1daca5ddd8e5 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] nvme not present on system {{(pid=73449) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 12:02:31 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:02:31 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 12:02:31 user nova-compute[73449]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 12:02:31 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[15fb8b52-c3f3-4c76-a3c8-a2d45f7a4443]: (4, '') {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:02:31 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-1b6d3975-7253-4afa-af07-1daca5ddd8e5 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73449) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 12:02:31 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-1b6d3975-7253-4afa-af07-1daca5ddd8e5 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73449) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 12:02:31 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-1b6d3975-7253-4afa-af07-1daca5ddd8e5 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] LIGHTOS: no hostnqn found. {{(pid=73449) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 12:02:31 user nova-compute[73449]: DEBUG os_brick.utils [None req-1b6d3975-7253-4afa-af07-1daca5ddd8e5 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4d3924302012', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 12:02:31 user nova-compute[73449]: DEBUG nova.virt.block_device [None req-1b6d3975-7253-4afa-af07-1daca5ddd8e5 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: d160711b-0b77-4f9a-b1d9-f0ac16240d4d] Updating existing volume attachment record: 2be4b302-4f22-46af-9800-7f9ae4c662aa {{(pid=73449) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 12:02:32 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:02:33 user nova-compute[73449]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692273738.2773983, 5cacd9ed-27fb-431d-999e-31ff2464d14d => Stopped> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 12:02:33 user nova-compute[73449]: INFO nova.compute.manager [-] [instance: 5cacd9ed-27fb-431d-999e-31ff2464d14d] VM Stopped (Lifecycle Event)
Aug 17 12:02:33 user nova-compute[73449]: DEBUG nova.compute.manager [None req-62167602-f515-44bb-94a0-85d22299b429 None None] [instance: 5cacd9ed-27fb-431d-999e-31ff2464d14d] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 12:02:33 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:02:34 user nova-compute[73449]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692273739.5475895, 773e5c86-a86a-414d-aab4-8e13e0b68c1e => Stopped> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 12:02:34 user nova-compute[73449]: INFO nova.compute.manager [-] [instance: 773e5c86-a86a-414d-aab4-8e13e0b68c1e] VM Stopped (Lifecycle Event)
Aug 17 12:02:34 user nova-compute[73449]: DEBUG nova.compute.manager [None req-f2bd4d2b-4b7b-4c7d-8226-627b4fcdc458 None None] [instance: 773e5c86-a86a-414d-aab4-8e13e0b68c1e] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 12:02:36 user nova-compute[73449]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692273741.1051784, ae75d334-431a-4008-8b3d-f2a727d92417 => Stopped> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 12:02:36 user nova-compute[73449]: INFO nova.compute.manager [-] [instance: ae75d334-431a-4008-8b3d-f2a727d92417] VM Stopped (Lifecycle Event)
Aug 17 12:02:36 user nova-compute[73449]: DEBUG nova.compute.manager [None req-93d65cc5-2629-4ca4-8381-9f3e6ccfe184 None None] [instance: ae75d334-431a-4008-8b3d-f2a727d92417] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 12:02:37 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:02:42 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:02:42 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:02:42 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73449) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 12:02:42 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:02:42 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:02:42 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:02:42 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b6d3975-7253-4afa-af07-1daca5ddd8e5 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: d160711b-0b77-4f9a-b1d9-f0ac16240d4d] Calling os-brick to attach iSCSI Volume {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 12:02:42 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b6d3975-7253-4afa-af07-1daca5ddd8e5 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:740e623f-bfc7-4776-b6d7-cb30de9535e4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RQmcTMDX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 12:02:42 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-1b6d3975-7253-4afa-af07-1daca5ddd8e5 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 12:02:42 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-1b6d3975-7253-4afa-af07-1daca5ddd8e5 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 12:02:42 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-1b6d3975-7253-4afa-af07-1daca5ddd8e5 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 12:02:42 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-1b6d3975-7253-4afa-af07-1daca5ddd8e5 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 12:02:42 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-1b6d3975-7253-4afa-af07-1daca5ddd8e5 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:740e623f-bfc7-4776-b6d7-cb30de9535e4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 12:02:42 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-1b6d3975-7253-4afa-af07-1daca5ddd8e5 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:740e623f-bfc7-4776-b6d7-cb30de9535e4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 12:02:42 user nova-compute[73449]: INFO os_brick.initiator.connectors.iscsi [None req-1b6d3975-7253-4afa-af07-1daca5ddd8e5 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 12:02:42 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:740e623f-bfc7-4776-b6d7-cb30de9535e4 -p 172.16.0.220:3260 {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:02:42 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:740e623f-bfc7-4776-b6d7-cb30de9535e4 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:02:42 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e4edd6c-6757-435e-871b-d897528e2281]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:02:42 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b6d3975-7253-4afa-af07-1daca5ddd8e5 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 12:02:42 user nova-compute[73449]:  {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:02:42 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:740e623f-bfc7-4776-b6d7-cb30de9535e4 -p 172.16.0.220:3260 --interface default --op new {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:02:42 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:740e623f-bfc7-4776-b6d7-cb30de9535e4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:02:42 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[67c2e368-423a-470f-9954-d710278c604b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:740e623f-bfc7-4776-b6d7-cb30de9535e4] added\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:02:42 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b6d3975-7253-4afa-af07-1daca5ddd8e5 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:740e623f-bfc7-4776-b6d7-cb30de9535e4] added
Aug 17 12:02:42 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:02:42 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:740e623f-bfc7-4776-b6d7-cb30de9535e4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:02:42 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:740e623f-bfc7-4776-b6d7-cb30de9535e4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:02:42 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[909b2afa-d4b8-420e-8ce9-b6864d40d064]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:02:42 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b6d3975-7253-4afa-af07-1daca5ddd8e5 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:02:42 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:740e623f-bfc7-4776-b6d7-cb30de9535e4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:02:42 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:740e623f-bfc7-4776-b6d7-cb30de9535e4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:02:42 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[f47ccbf1-06be-4b98-8c7e-ae8c7f9cac36]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:02:42 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b6d3975-7253-4afa-af07-1daca5ddd8e5 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:02:42 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:740e623f-bfc7-4776-b6d7-cb30de9535e4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RQmcTMDX {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:02:43 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:740e623f-bfc7-4776-b6d7-cb30de9535e4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RQmcTMDX" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:02:43 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[2028002f-161e-4146-a62a-edc5b42b8cf9]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:02:43 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b6d3975-7253-4afa-af07-1daca5ddd8e5 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RQmcTMDX'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:02:43 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:740e623f-bfc7-4776-b6d7-cb30de9535e4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:02:43 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:740e623f-bfc7-4776-b6d7-cb30de9535e4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:02:43 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5e1f94a-6e4e-472c-95b1-1bd5224bb06e]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:02:43 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b6d3975-7253-4afa-af07-1daca5ddd8e5 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:02:43 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:02:43 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:02:43 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1784df1-01b8-4c6d-859d-6374b888fb5a]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8314fb1e-61f9-44b5-b944-5a94677724c8 (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:02:43 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b6d3975-7253-4afa-af07-1daca5ddd8e5 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)
Aug 17 12:02:43 user nova-compute[73449]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8314fb1e-61f9-44b5-b944-5a94677724c8 (non-flash)
Aug 17 12:02:43 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 12:02:43 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b6d3975-7253-4afa-af07-1daca5ddd8e5 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)
Aug 17 12:02:43 user nova-compute[73449]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8314fb1e-61f9-44b5-b944-5a94677724c8 (non-flash)
Aug 17 12:02:43 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 12:02:43 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:740e623f-bfc7-4776-b6d7-cb30de9535e4 -p 172.16.0.220:3260 --login {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:02:43 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:740e623f-bfc7-4776-b6d7-cb30de9535e4 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:02:43 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c02b587-b807-4509-b72d-971e087661c2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:740e623f-bfc7-4776-b6d7-cb30de9535e4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:740e623f-bfc7-4776-b6d7-cb30de9535e4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:02:43 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b6d3975-7253-4afa-af07-1daca5ddd8e5 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:740e623f-bfc7-4776-b6d7-cb30de9535e4, portal: 172.16.0.220,3260]
Aug 17 12:02:43 user nova-compute[73449]: Login to [iface: default, target: iqn.2010-10.org.openstack:740e623f-bfc7-4776-b6d7-cb30de9535e4, portal: 172.16.0.220,3260] successful.
Aug 17 12:02:43 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:02:43 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:740e623f-bfc7-4776-b6d7-cb30de9535e4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:02:43 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:740e623f-bfc7-4776-b6d7-cb30de9535e4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:02:43 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb9ea712-ae38-4213-a761-ce04c10eed36]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:02:43 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b6d3975-7253-4afa-af07-1daca5ddd8e5 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:02:43 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:02:43 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:02:43 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[88b6e09c-5a27-4f83-b3ba-042c00ed42ee]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8314fb1e-61f9-44b5-b944-5a94677724c8 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:740e623f-bfc7-4776-b6d7-cb30de9535e4 (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:02:43 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b6d3975-7253-4afa-af07-1daca5ddd8e5 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)
Aug 17 12:02:43 user nova-compute[73449]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8314fb1e-61f9-44b5-b944-5a94677724c8 (non-flash)
Aug 17 12:02:43 user nova-compute[73449]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:740e623f-bfc7-4776-b6d7-cb30de9535e4 (non-flash)
Aug 17 12:02:43 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 12:02:43 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b6d3975-7253-4afa-af07-1daca5ddd8e5 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)
Aug 17 12:02:43 user nova-compute[73449]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8314fb1e-61f9-44b5-b944-5a94677724c8 (non-flash)
Aug 17 12:02:43 user nova-compute[73449]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:740e623f-bfc7-4776-b6d7-cb30de9535e4 (non-flash)
Aug 17 12:02:43 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 12:02:43 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-1b6d3975-7253-4afa-af07-1daca5ddd8e5 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:740e623f-bfc7-4776-b6d7-cb30de9535e4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.298s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 12:02:43 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b6d3975-7253-4afa-af07-1daca5ddd8e5 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Connected to 172.16.0.220:3260 {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 12:02:43 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-1b6d3975-7253-4afa-af07-1daca5ddd8e5 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] HCTL ('34', '-', '-', 0) found on session 49 with lun 0 {{(pid=73449) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 12:02:43 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-1b6d3975-7253-4afa-af07-1daca5ddd8e5 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73449) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 12:02:43 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:02:43 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:02:43 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[28b603a9-57bc-456d-82fe-71c4d3c94311]: (4, ('- - 0', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:02:43 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-1b6d3975-7253-4afa-af07-1daca5ddd8e5 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Searching for a device in session 49 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73449) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 12:02:43 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b6d3975-7253-4afa-af07-1daca5ddd8e5 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RQmcTMDX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 12:02:43 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:02:44 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-1b6d3975-7253-4afa-af07-1daca5ddd8e5 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.329s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 12:02:44 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b6d3975-7253-4afa-af07-1daca5ddd8e5 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] <== connect_volume: return (1331ms) {'type': 'block', 'scsi_wwn': '23230626265393961', 'path': '/dev/sdc'} {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 12:02:44 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b6d3975-7253-4afa-af07-1daca5ddd8e5 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: d160711b-0b77-4f9a-b1d9-f0ac16240d4d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23230626265393961', 'path': '/dev/sdc'} {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 12:02:44 user nova-compute[73449]: DEBUG nova.objects.instance [None req-1b6d3975-7253-4afa-af07-1daca5ddd8e5 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Lazy-loading 'flavor' on Instance uuid d160711b-0b77-4f9a-b1d9-f0ac16240d4d {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:02:44 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-1b6d3975-7253-4afa-af07-1daca5ddd8e5 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 12:02:44 user nova-compute[73449]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 12:02:44 user nova-compute[73449]:   <source dev="/dev/sdc"/>
Aug 17 12:02:44 user nova-compute[73449]:   <target dev="vdb" bus="virtio"/>
Aug 17 12:02:44 user nova-compute[73449]:   <serial>740e623f-bfc7-4776-b6d7-cb30de9535e4</serial>
Aug 17 12:02:44 user nova-compute[73449]: </disk>
Aug 17 12:02:44 user nova-compute[73449]:  {{(pid=73449) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 12:02:44 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-1b6d3975-7253-4afa-af07-1daca5ddd8e5 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] No BDM found with device name vda, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 12:02:44 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-1b6d3975-7253-4afa-af07-1daca5ddd8e5 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 12:02:44 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-1b6d3975-7253-4afa-af07-1daca5ddd8e5 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] No VIF found with MAC fa:16:3e:d6:cf:c6, not building metadata {{(pid=73449) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 12:02:44 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-1b6d3975-7253-4afa-af07-1daca5ddd8e5 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Lock "d160711b-0b77-4f9a-b1d9-f0ac16240d4d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.197s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:02:47 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:02:48 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-9b77883b-5239-4192-833c-a6f2d74dfb28 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Acquiring lock "84763b6d-f33c-43d6-b6af-cac86fe8ea86" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:02:48 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-9b77883b-5239-4192-833c-a6f2d74dfb28 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Lock "84763b6d-f33c-43d6-b6af-cac86fe8ea86" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:02:48 user nova-compute[73449]: DEBUG nova.compute.manager [None req-9b77883b-5239-4192-833c-a6f2d74dfb28 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: 84763b6d-f33c-43d6-b6af-cac86fe8ea86] Starting instance... {{(pid=73449) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 12:02:48 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-9b77883b-5239-4192-833c-a6f2d74dfb28 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:02:48 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-9b77883b-5239-4192-833c-a6f2d74dfb28 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:02:48 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-9b77883b-5239-4192-833c-a6f2d74dfb28 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73449) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 12:02:48 user nova-compute[73449]: INFO nova.compute.claims [None req-9b77883b-5239-4192-833c-a6f2d74dfb28 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: 84763b6d-f33c-43d6-b6af-cac86fe8ea86] Claim successful on node user
Aug 17 12:02:48 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-9b77883b-5239-4192-833c-a6f2d74dfb28 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 12:02:48 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:02:48 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-9b77883b-5239-4192-833c-a6f2d74dfb28 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 12:02:48 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-9b77883b-5239-4192-833c-a6f2d74dfb28 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.397s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:02:48 user nova-compute[73449]: DEBUG nova.compute.manager [None req-9b77883b-5239-4192-833c-a6f2d74dfb28 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: 84763b6d-f33c-43d6-b6af-cac86fe8ea86] Start building networks asynchronously for instance. {{(pid=73449) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 12:02:48 user nova-compute[73449]: DEBUG nova.compute.manager [None req-9b77883b-5239-4192-833c-a6f2d74dfb28 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: 84763b6d-f33c-43d6-b6af-cac86fe8ea86] Allocating IP information in the background. {{(pid=73449) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 12:02:48 user nova-compute[73449]: DEBUG nova.network.neutron [None req-9b77883b-5239-4192-833c-a6f2d74dfb28 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: 84763b6d-f33c-43d6-b6af-cac86fe8ea86] allocate_for_instance() {{(pid=73449) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 12:02:48 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-9b77883b-5239-4192-833c-a6f2d74dfb28 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: 84763b6d-f33c-43d6-b6af-cac86fe8ea86] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 12:02:48 user nova-compute[73449]: DEBUG nova.compute.manager [None req-9b77883b-5239-4192-833c-a6f2d74dfb28 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: 84763b6d-f33c-43d6-b6af-cac86fe8ea86] Start building block device mappings for instance. {{(pid=73449) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 12:02:48 user nova-compute[73449]: DEBUG nova.policy [None req-9b77883b-5239-4192-833c-a6f2d74dfb28 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '55cde68973ca42d095180b5c0701b49b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75aa99e369c54b65aff27adbb1daf2b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73449) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 12:02:48 user nova-compute[73449]: DEBUG nova.compute.manager [None req-9b77883b-5239-4192-833c-a6f2d74dfb28 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: 84763b6d-f33c-43d6-b6af-cac86fe8ea86] Start spawning the instance on the hypervisor. {{(pid=73449) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 12:02:48 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-9b77883b-5239-4192-833c-a6f2d74dfb28 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: 84763b6d-f33c-43d6-b6af-cac86fe8ea86] Creating instance directory {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 12:02:48 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-9b77883b-5239-4192-833c-a6f2d74dfb28 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: 84763b6d-f33c-43d6-b6af-cac86fe8ea86] Creating image(s)
Aug 17 12:02:48 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-9b77883b-5239-4192-833c-a6f2d74dfb28 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Acquiring lock "/opt/stack/data/nova/instances/84763b6d-f33c-43d6-b6af-cac86fe8ea86/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:02:48 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-9b77883b-5239-4192-833c-a6f2d74dfb28 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Lock "/opt/stack/data/nova/instances/84763b6d-f33c-43d6-b6af-cac86fe8ea86/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:02:48 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-9b77883b-5239-4192-833c-a6f2d74dfb28 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Lock "/opt/stack/data/nova/instances/84763b6d-f33c-43d6-b6af-cac86fe8ea86/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:02:48 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-9b77883b-5239-4192-833c-a6f2d74dfb28 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:02:49 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-9b77883b-5239-4192-833c-a6f2d74dfb28 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json" returned: 0 in 0.176s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:02:49 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-9b77883b-5239-4192-833c-a6f2d74dfb28 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Acquiring lock "7e267a577c062ee862e95ede6b48cfd5632f3ea3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:02:49 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-9b77883b-5239-4192-833c-a6f2d74dfb28 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Lock "7e267a577c062ee862e95ede6b48cfd5632f3ea3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:02:49 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-9b77883b-5239-4192-833c-a6f2d74dfb28 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:02:49 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-9b77883b-5239-4192-833c-a6f2d74dfb28 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json" returned: 0 in 0.180s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:02:49 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-9b77883b-5239-4192-833c-a6f2d74dfb28 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3,backing_fmt=raw /opt/stack/data/nova/instances/84763b6d-f33c-43d6-b6af-cac86fe8ea86/disk 1073741824 {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:02:49 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-9b77883b-5239-4192-833c-a6f2d74dfb28 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3,backing_fmt=raw /opt/stack/data/nova/instances/84763b6d-f33c-43d6-b6af-cac86fe8ea86/disk 1073741824" returned: 0 in 0.050s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:02:49 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-9b77883b-5239-4192-833c-a6f2d74dfb28 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Lock "7e267a577c062ee862e95ede6b48cfd5632f3ea3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:02:49 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-9b77883b-5239-4192-833c-a6f2d74dfb28 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:02:49 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-9b77883b-5239-4192-833c-a6f2d74dfb28 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json" returned: 0 in 0.189s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:02:49 user nova-compute[73449]: DEBUG nova.virt.disk.api [None req-9b77883b-5239-4192-833c-a6f2d74dfb28 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Checking if we can resize image /opt/stack/data/nova/instances/84763b6d-f33c-43d6-b6af-cac86fe8ea86/disk. size=1073741824 {{(pid=73449) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 12:02:49 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-9b77883b-5239-4192-833c-a6f2d74dfb28 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84763b6d-f33c-43d6-b6af-cac86fe8ea86/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:02:49 user nova-compute[73449]: DEBUG nova.network.neutron [None req-9b77883b-5239-4192-833c-a6f2d74dfb28 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: 84763b6d-f33c-43d6-b6af-cac86fe8ea86] Successfully created port: 01b9226a-408b-4422-a876-eff4944132c7 {{(pid=73449) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 12:02:49 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-9b77883b-5239-4192-833c-a6f2d74dfb28 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84763b6d-f33c-43d6-b6af-cac86fe8ea86/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:02:49 user nova-compute[73449]: DEBUG nova.virt.disk.api [None req-9b77883b-5239-4192-833c-a6f2d74dfb28 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Cannot resize image /opt/stack/data/nova/instances/84763b6d-f33c-43d6-b6af-cac86fe8ea86/disk to a smaller size. {{(pid=73449) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 12:02:49 user nova-compute[73449]: DEBUG nova.objects.instance [None req-9b77883b-5239-4192-833c-a6f2d74dfb28 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Lazy-loading 'migration_context' on Instance uuid 84763b6d-f33c-43d6-b6af-cac86fe8ea86 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:02:49 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-9b77883b-5239-4192-833c-a6f2d74dfb28 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: 84763b6d-f33c-43d6-b6af-cac86fe8ea86] Created local disks {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 12:02:49 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-9b77883b-5239-4192-833c-a6f2d74dfb28 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: 84763b6d-f33c-43d6-b6af-cac86fe8ea86] Ensure instance console log exists: /opt/stack/data/nova/instances/84763b6d-f33c-43d6-b6af-cac86fe8ea86/console.log {{(pid=73449) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 12:02:49 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-9b77883b-5239-4192-833c-a6f2d74dfb28 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:02:49 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-9b77883b-5239-4192-833c-a6f2d74dfb28 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:02:49 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-9b77883b-5239-4192-833c-a6f2d74dfb28 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:02:50 user nova-compute[73449]: DEBUG nova.network.neutron [None req-9b77883b-5239-4192-833c-a6f2d74dfb28 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: 84763b6d-f33c-43d6-b6af-cac86fe8ea86] Successfully updated port: 01b9226a-408b-4422-a876-eff4944132c7 {{(pid=73449) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 12:02:50 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-9b77883b-5239-4192-833c-a6f2d74dfb28 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Acquiring lock "refresh_cache-84763b6d-f33c-43d6-b6af-cac86fe8ea86" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 12:02:50 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-9b77883b-5239-4192-833c-a6f2d74dfb28 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Acquired lock "refresh_cache-84763b6d-f33c-43d6-b6af-cac86fe8ea86" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 12:02:50 user nova-compute[73449]: DEBUG nova.network.neutron [None req-9b77883b-5239-4192-833c-a6f2d74dfb28 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: 84763b6d-f33c-43d6-b6af-cac86fe8ea86] Building network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 12:02:50 user nova-compute[73449]: DEBUG nova.compute.manager [req-765514af-7f19-454a-acc8-1d1332fe9c47 req-c0301876-b098-4201-9dbc-c5bdfa288aba service nova] [instance: 84763b6d-f33c-43d6-b6af-cac86fe8ea86] Received event network-changed-01b9226a-408b-4422-a876-eff4944132c7 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:02:50 user nova-compute[73449]: DEBUG nova.compute.manager [req-765514af-7f19-454a-acc8-1d1332fe9c47 req-c0301876-b098-4201-9dbc-c5bdfa288aba service nova] [instance: 84763b6d-f33c-43d6-b6af-cac86fe8ea86] Refreshing instance network info cache due to event network-changed-01b9226a-408b-4422-a876-eff4944132c7. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 12:02:50 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-765514af-7f19-454a-acc8-1d1332fe9c47 req-c0301876-b098-4201-9dbc-c5bdfa288aba service nova] Acquiring lock "refresh_cache-84763b6d-f33c-43d6-b6af-cac86fe8ea86" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 12:02:50 user nova-compute[73449]: DEBUG nova.network.neutron [None req-9b77883b-5239-4192-833c-a6f2d74dfb28 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: 84763b6d-f33c-43d6-b6af-cac86fe8ea86] Instance cache missing network info. {{(pid=73449) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 12:02:50 user nova-compute[73449]: DEBUG nova.network.neutron [None req-9b77883b-5239-4192-833c-a6f2d74dfb28 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: 84763b6d-f33c-43d6-b6af-cac86fe8ea86] Updating instance_info_cache with network_info: [{"id": "01b9226a-408b-4422-a876-eff4944132c7", "address": "fa:16:3e:a1:6c:41", "network": {"id": "71648e1b-cf19-44b7-bae2-9d38543cdee9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-822323626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75aa99e369c54b65aff27adbb1daf2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b9226a-40", "ovs_interfaceid": "01b9226a-408b-4422-a876-eff4944132c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 12:02:50 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-9b77883b-5239-4192-833c-a6f2d74dfb28 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Releasing lock "refresh_cache-84763b6d-f33c-43d6-b6af-cac86fe8ea86" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 12:02:50 user nova-compute[73449]: DEBUG nova.compute.manager [None req-9b77883b-5239-4192-833c-a6f2d74dfb28 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: 84763b6d-f33c-43d6-b6af-cac86fe8ea86] Instance network_info: |[{"id": "01b9226a-408b-4422-a876-eff4944132c7", "address": "fa:16:3e:a1:6c:41", "network": {"id": "71648e1b-cf19-44b7-bae2-9d38543cdee9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-822323626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75aa99e369c54b65aff27adbb1daf2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b9226a-40", "ovs_interfaceid": "01b9226a-408b-4422-a876-eff4944132c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73449) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 12:02:50 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-765514af-7f19-454a-acc8-1d1332fe9c47 req-c0301876-b098-4201-9dbc-c5bdfa288aba service nova] Acquired lock "refresh_cache-84763b6d-f33c-43d6-b6af-cac86fe8ea86" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 12:02:50 user nova-compute[73449]: DEBUG nova.network.neutron [req-765514af-7f19-454a-acc8-1d1332fe9c47 req-c0301876-b098-4201-9dbc-c5bdfa288aba service nova] [instance: 84763b6d-f33c-43d6-b6af-cac86fe8ea86] Refreshing network info cache for port 01b9226a-408b-4422-a876-eff4944132c7 {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 12:02:50 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-9b77883b-5239-4192-833c-a6f2d74dfb28 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: 84763b6d-f33c-43d6-b6af-cac86fe8ea86] Start _get_guest_xml network_info=[{"id": "01b9226a-408b-4422-a876-eff4944132c7", "address": "fa:16:3e:a1:6c:41", "network": {"id": "71648e1b-cf19-44b7-bae2-9d38543cdee9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-822323626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75aa99e369c54b65aff27adbb1daf2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b9226a-40", "ovs_interfaceid": "01b9226a-408b-4422-a876-eff4944132c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T11:36:11Z,direct_url=<?>,disk_format='qcow2',id=0a2904ae-083d-41c8-83db-343132b36148,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7a77880136a54ef195c82e018e1939db',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T11:36:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': '0a2904ae-083d-41c8-83db-343132b36148'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 12:02:50 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-9b77883b-5239-4192-833c-a6f2d74dfb28 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 12:02:50 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-9b77883b-5239-4192-833c-a6f2d74dfb28 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 12:02:50 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-9b77883b-5239-4192-833c-a6f2d74dfb28 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 12:02:50 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-9b77883b-5239-4192-833c-a6f2d74dfb28 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] CPU controller missing on host. {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 12:02:50 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-9b77883b-5239-4192-833c-a6f2d74dfb28 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 12:02:50 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-9b77883b-5239-4192-833c-a6f2d74dfb28 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] CPU controller found on host. {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 12:02:50 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-9b77883b-5239-4192-833c-a6f2d74dfb28 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73449) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 12:02:50 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-9b77883b-5239-4192-833c-a6f2d74dfb28 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T11:35:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T11:36:11Z,direct_url=<?>,disk_format='qcow2',id=0a2904ae-083d-41c8-83db-343132b36148,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7a77880136a54ef195c82e018e1939db',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T11:36:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 12:02:50 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-9b77883b-5239-4192-833c-a6f2d74dfb28 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Flavor limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 12:02:50 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-9b77883b-5239-4192-833c-a6f2d74dfb28 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Image limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 12:02:50 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-9b77883b-5239-4192-833c-a6f2d74dfb28 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Flavor pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 12:02:50 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-9b77883b-5239-4192-833c-a6f2d74dfb28 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Image pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 12:02:50 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-9b77883b-5239-4192-833c-a6f2d74dfb28 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 12:02:50 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-9b77883b-5239-4192-833c-a6f2d74dfb28 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 12:02:50 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-9b77883b-5239-4192-833c-a6f2d74dfb28 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 12:02:50 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-9b77883b-5239-4192-833c-a6f2d74dfb28 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Got 1 possible topologies {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 12:02:50 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-9b77883b-5239-4192-833c-a6f2d74dfb28 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 12:02:50 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-9b77883b-5239-4192-833c-a6f2d74dfb28 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 12:02:50 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-9b77883b-5239-4192-833c-a6f2d74dfb28 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T12:02:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1416254704',display_name='tempest-AttachVolumeNegativeTest-server-1416254704',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1416254704',id=44,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJXZrffYzBvrGoGcvriudgBTLydpnKmJaqhL3s638CRnSGatOnEqfmfk3RBliEdN1tqNfBvU1LpbyRMENj2AIbrE/P52bCPB2FB2WiZ+WdZ9DT1DlroXxY5/DB11w7BbYA==',key_name='tempest-keypair-1841019211',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75aa99e369c54b65aff27adbb1daf2b8',ramdisk_id='',reservation_id='r-plvq6p5i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-165752051',owner_user_name='tempest-AttachVolumeNegativeTest-165752051-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T12:02:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55cde68973ca42d095180b5c0701b49b',uuid=84763b6d-f33c-43d6-b6af-cac86fe8ea86,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "01b9226a-408b-4422-a876-eff4944132c7", "address": "fa:16:3e:a1:6c:41", "network": {"id": "71648e1b-cf19-44b7-bae2-9d38543cdee9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-822323626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75aa99e369c54b65aff27adbb1daf2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b9226a-40", "ovs_interfaceid": "01b9226a-408b-4422-a876-eff4944132c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73449) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 12:02:50 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-9b77883b-5239-4192-833c-a6f2d74dfb28 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Converting VIF {"id": "01b9226a-408b-4422-a876-eff4944132c7", "address": "fa:16:3e:a1:6c:41", "network": {"id": "71648e1b-cf19-44b7-bae2-9d38543cdee9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-822323626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75aa99e369c54b65aff27adbb1daf2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b9226a-40", "ovs_interfaceid": "01b9226a-408b-4422-a876-eff4944132c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 12:02:50 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-9b77883b-5239-4192-833c-a6f2d74dfb28 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:6c:41,bridge_name='br-int',has_traffic_filtering=True,id=01b9226a-408b-4422-a876-eff4944132c7,network=Network(71648e1b-cf19-44b7-bae2-9d38543cdee9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01b9226a-40') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 12:02:50 user nova-compute[73449]: DEBUG nova.objects.instance [None req-9b77883b-5239-4192-833c-a6f2d74dfb28 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Lazy-loading 'pci_devices' on Instance uuid 84763b6d-f33c-43d6-b6af-cac86fe8ea86 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:02:50 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-9b77883b-5239-4192-833c-a6f2d74dfb28 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: 84763b6d-f33c-43d6-b6af-cac86fe8ea86] End _get_guest_xml xml=<domain type="kvm">
Aug 17 12:02:50 user nova-compute[73449]:   <uuid>84763b6d-f33c-43d6-b6af-cac86fe8ea86</uuid>
Aug 17 12:02:50 user nova-compute[73449]:   <name>instance-0000002c</name>
Aug 17 12:02:50 user nova-compute[73449]:   <memory>524288</memory>
Aug 17 12:02:50 user nova-compute[73449]:   <vcpu>1</vcpu>
Aug 17 12:02:50 user nova-compute[73449]:   <metadata>
Aug 17 12:02:50 user nova-compute[73449]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 12:02:50 user nova-compute[73449]:       <nova:package version="0.0.0"/>
Aug 17 12:02:50 user nova-compute[73449]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1416254704</nova:name>
Aug 17 12:02:50 user nova-compute[73449]:       <nova:creationTime>2023-08-17 12:02:50</nova:creationTime>
Aug 17 12:02:50 user nova-compute[73449]:       <nova:flavor name="m1.tiny">
Aug 17 12:02:50 user nova-compute[73449]:         <nova:memory>512</nova:memory>
Aug 17 12:02:50 user nova-compute[73449]:         <nova:disk>1</nova:disk>
Aug 17 12:02:50 user nova-compute[73449]:         <nova:swap>0</nova:swap>
Aug 17 12:02:50 user nova-compute[73449]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 12:02:50 user nova-compute[73449]:         <nova:vcpus>1</nova:vcpus>
Aug 17 12:02:50 user nova-compute[73449]:       </nova:flavor>
Aug 17 12:02:50 user nova-compute[73449]:       <nova:owner>
Aug 17 12:02:50 user nova-compute[73449]:         <nova:user uuid="55cde68973ca42d095180b5c0701b49b">tempest-AttachVolumeNegativeTest-165752051-project-member</nova:user>
Aug 17 12:02:50 user nova-compute[73449]:         <nova:project uuid="75aa99e369c54b65aff27adbb1daf2b8">tempest-AttachVolumeNegativeTest-165752051</nova:project>
Aug 17 12:02:50 user nova-compute[73449]:       </nova:owner>
Aug 17 12:02:50 user nova-compute[73449]:       <nova:root type="image" uuid="0a2904ae-083d-41c8-83db-343132b36148"/>
Aug 17 12:02:50 user nova-compute[73449]:       <nova:ports>
Aug 17 12:02:50 user nova-compute[73449]:         <nova:port uuid="01b9226a-408b-4422-a876-eff4944132c7">
Aug 17 12:02:50 user nova-compute[73449]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 17 12:02:50 user nova-compute[73449]:         </nova:port>
Aug 17 12:02:50 user nova-compute[73449]:       </nova:ports>
Aug 17 12:02:50 user nova-compute[73449]:     </nova:instance>
Aug 17 12:02:50 user nova-compute[73449]:   </metadata>
Aug 17 12:02:50 user nova-compute[73449]:   <sysinfo type="smbios">
Aug 17 12:02:50 user nova-compute[73449]:     <system>
Aug 17 12:02:50 user nova-compute[73449]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 12:02:50 user nova-compute[73449]:       <entry name="product">OpenStack Nova</entry>
Aug 17 12:02:50 user nova-compute[73449]:       <entry name="version">0.0.0</entry>
Aug 17 12:02:50 user nova-compute[73449]:       <entry name="serial">84763b6d-f33c-43d6-b6af-cac86fe8ea86</entry>
Aug 17 12:02:50 user nova-compute[73449]:       <entry name="uuid">84763b6d-f33c-43d6-b6af-cac86fe8ea86</entry>
Aug 17 12:02:50 user nova-compute[73449]:       <entry name="family">Virtual Machine</entry>
Aug 17 12:02:50 user nova-compute[73449]:     </system>
Aug 17 12:02:50 user nova-compute[73449]:   </sysinfo>
Aug 17 12:02:50 user nova-compute[73449]:   <os>
Aug 17 12:02:50 user nova-compute[73449]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 12:02:50 user nova-compute[73449]:     <boot dev="hd"/>
Aug 17 12:02:50 user nova-compute[73449]:     <smbios mode="sysinfo"/>
Aug 17 12:02:50 user nova-compute[73449]:   </os>
Aug 17 12:02:50 user nova-compute[73449]:   <features>
Aug 17 12:02:50 user nova-compute[73449]:     <acpi/>
Aug 17 12:02:50 user nova-compute[73449]:     <apic/>
Aug 17 12:02:50 user nova-compute[73449]:     <vmcoreinfo/>
Aug 17 12:02:50 user nova-compute[73449]:   </features>
Aug 17 12:02:50 user nova-compute[73449]:   <clock offset="utc">
Aug 17 12:02:50 user nova-compute[73449]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 12:02:50 user nova-compute[73449]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 12:02:50 user nova-compute[73449]:     <timer name="hpet" present="no"/>
Aug 17 12:02:50 user nova-compute[73449]:   </clock>
Aug 17 12:02:50 user nova-compute[73449]:   <cpu mode="custom" match="exact">
Aug 17 12:02:50 user nova-compute[73449]:     <model>Nehalem</model>
Aug 17 12:02:50 user nova-compute[73449]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 12:02:50 user nova-compute[73449]:   </cpu>
Aug 17 12:02:50 user nova-compute[73449]:   <devices>
Aug 17 12:02:50 user nova-compute[73449]:     <disk type="file" device="disk">
Aug 17 12:02:50 user nova-compute[73449]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 12:02:50 user nova-compute[73449]:       <source file="/opt/stack/data/nova/instances/84763b6d-f33c-43d6-b6af-cac86fe8ea86/disk"/>
Aug 17 12:02:50 user nova-compute[73449]:       <target dev="vda" bus="virtio"/>
Aug 17 12:02:50 user nova-compute[73449]:     </disk>
Aug 17 12:02:50 user nova-compute[73449]:     <interface type="ethernet">
Aug 17 12:02:50 user nova-compute[73449]:       <mac address="fa:16:3e:a1:6c:41"/>
Aug 17 12:02:50 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 12:02:50 user nova-compute[73449]:       <mtu size="1442"/>
Aug 17 12:02:50 user nova-compute[73449]:       <target dev="tap01b9226a-40"/>
Aug 17 12:02:50 user nova-compute[73449]:     </interface>
Aug 17 12:02:50 user nova-compute[73449]:     <serial type="pty">
Aug 17 12:02:50 user nova-compute[73449]:       <log file="/opt/stack/data/nova/instances/84763b6d-f33c-43d6-b6af-cac86fe8ea86/console.log" append="off"/>
Aug 17 12:02:50 user nova-compute[73449]:     </serial>
Aug 17 12:02:50 user nova-compute[73449]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 12:02:50 user nova-compute[73449]:     <video>
Aug 17 12:02:50 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 12:02:50 user nova-compute[73449]:     </video>
Aug 17 12:02:50 user nova-compute[73449]:     <rng model="virtio">
Aug 17 12:02:50 user nova-compute[73449]:       <backend model="random">/dev/urandom</backend>
Aug 17 12:02:50 user nova-compute[73449]:     </rng>
Aug 17 12:02:50 user nova-compute[73449]:     <controller type="usb" index="0" model="none"/>
Aug 17 12:02:50 user nova-compute[73449]:     <memballoon model="virtio">
Aug 17 12:02:50 user nova-compute[73449]:       <stats period="10"/>
Aug 17 12:02:50 user nova-compute[73449]:     </memballoon>
Aug 17 12:02:50 user nova-compute[73449]:   </devices>
Aug 17 12:02:50 user nova-compute[73449]: </domain>
Aug 17 12:02:50 user nova-compute[73449]:  {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 12:02:50 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-9b77883b-5239-4192-833c-a6f2d74dfb28 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T12:02:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1416254704',display_name='tempest-AttachVolumeNegativeTest-server-1416254704',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1416254704',id=44,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJXZrffYzBvrGoGcvriudgBTLydpnKmJaqhL3s638CRnSGatOnEqfmfk3RBliEdN1tqNfBvU1LpbyRMENj2AIbrE/P52bCPB2FB2WiZ+WdZ9DT1DlroXxY5/DB11w7BbYA==',key_name='tempest-keypair-1841019211',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75aa99e369c54b65aff27adbb1daf2b8',ramdisk_id='',reservation_id='r-plvq6p5i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-165752051',owner_user_name='tempest-AttachVolumeNegativeTest-165752051-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T12:02:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55cde68973ca42d095180b5c0701b49b',uuid=84763b6d-f33c-43d6-b6af-cac86fe8ea86,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "01b9226a-408b-4422-a876-eff4944132c7", "address": "fa:16:3e:a1:6c:41", "network": {"id": "71648e1b-cf19-44b7-bae2-9d38543cdee9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-822323626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75aa99e369c54b65aff27adbb1daf2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b9226a-40", "ovs_interfaceid": "01b9226a-408b-4422-a876-eff4944132c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 12:02:50 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-9b77883b-5239-4192-833c-a6f2d74dfb28 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Converting VIF {"id": "01b9226a-408b-4422-a876-eff4944132c7", "address": "fa:16:3e:a1:6c:41", "network": {"id": "71648e1b-cf19-44b7-bae2-9d38543cdee9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-822323626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75aa99e369c54b65aff27adbb1daf2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b9226a-40", "ovs_interfaceid": "01b9226a-408b-4422-a876-eff4944132c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 12:02:50 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-9b77883b-5239-4192-833c-a6f2d74dfb28 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:6c:41,bridge_name='br-int',has_traffic_filtering=True,id=01b9226a-408b-4422-a876-eff4944132c7,network=Network(71648e1b-cf19-44b7-bae2-9d38543cdee9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01b9226a-40') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 12:02:50 user nova-compute[73449]: DEBUG os_vif [None req-9b77883b-5239-4192-833c-a6f2d74dfb28 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:6c:41,bridge_name='br-int',has_traffic_filtering=True,id=01b9226a-408b-4422-a876-eff4944132c7,network=Network(71648e1b-cf19-44b7-bae2-9d38543cdee9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01b9226a-40') {{(pid=73449) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 12:02:50 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:02:50 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 12:02:50 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 12:02:50 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:02:50 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap01b9226a-40, may_exist=True, interface_attrs={}) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 12:02:50 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap01b9226a-40, col_values=(('external_ids', {'iface-id': '01b9226a-408b-4422-a876-eff4944132c7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a1:6c:41', 'vm-uuid': '84763b6d-f33c-43d6-b6af-cac86fe8ea86'}),), if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 12:02:50 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:02:50 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:02:50 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:02:50 user nova-compute[73449]: INFO os_vif [None req-9b77883b-5239-4192-833c-a6f2d74dfb28 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:6c:41,bridge_name='br-int',has_traffic_filtering=True,id=01b9226a-408b-4422-a876-eff4944132c7,network=Network(71648e1b-cf19-44b7-bae2-9d38543cdee9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01b9226a-40')
Aug 17 12:02:51 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-9b77883b-5239-4192-833c-a6f2d74dfb28 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] No BDM found with device name vda, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 12:02:51 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-9b77883b-5239-4192-833c-a6f2d74dfb28 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] No VIF found with MAC fa:16:3e:a1:6c:41, not building metadata {{(pid=73449) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 12:02:51 user nova-compute[73449]: DEBUG nova.network.neutron [req-765514af-7f19-454a-acc8-1d1332fe9c47 req-c0301876-b098-4201-9dbc-c5bdfa288aba service nova] [instance: 84763b6d-f33c-43d6-b6af-cac86fe8ea86] Updated VIF entry in instance network info cache for port 01b9226a-408b-4422-a876-eff4944132c7. {{(pid=73449) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 12:02:51 user nova-compute[73449]: DEBUG nova.network.neutron [req-765514af-7f19-454a-acc8-1d1332fe9c47 req-c0301876-b098-4201-9dbc-c5bdfa288aba service nova] [instance: 84763b6d-f33c-43d6-b6af-cac86fe8ea86] Updating instance_info_cache with network_info: [{"id": "01b9226a-408b-4422-a876-eff4944132c7", "address": "fa:16:3e:a1:6c:41", "network": {"id": "71648e1b-cf19-44b7-bae2-9d38543cdee9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-822323626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75aa99e369c54b65aff27adbb1daf2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b9226a-40", "ovs_interfaceid": "01b9226a-408b-4422-a876-eff4944132c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 12:02:51 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-765514af-7f19-454a-acc8-1d1332fe9c47 req-c0301876-b098-4201-9dbc-c5bdfa288aba service nova] Releasing lock "refresh_cache-84763b6d-f33c-43d6-b6af-cac86fe8ea86" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 12:02:52 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:02:52 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:02:52 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:02:52 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:02:52 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:02:52 user nova-compute[73449]: DEBUG nova.compute.manager [req-ba478fa0-f391-4e48-bcd0-ed3c48095b60 req-def07a2a-cf99-4dff-94ef-ab29487cc793 service nova] [instance: 84763b6d-f33c-43d6-b6af-cac86fe8ea86] Received event network-vif-plugged-01b9226a-408b-4422-a876-eff4944132c7 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:02:52 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-ba478fa0-f391-4e48-bcd0-ed3c48095b60 req-def07a2a-cf99-4dff-94ef-ab29487cc793 service nova] Acquiring lock "84763b6d-f33c-43d6-b6af-cac86fe8ea86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:02:52 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-ba478fa0-f391-4e48-bcd0-ed3c48095b60 req-def07a2a-cf99-4dff-94ef-ab29487cc793 service nova] Lock "84763b6d-f33c-43d6-b6af-cac86fe8ea86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:02:52 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-ba478fa0-f391-4e48-bcd0-ed3c48095b60 req-def07a2a-cf99-4dff-94ef-ab29487cc793 service nova] Lock "84763b6d-f33c-43d6-b6af-cac86fe8ea86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:02:52 user nova-compute[73449]: DEBUG nova.compute.manager [req-ba478fa0-f391-4e48-bcd0-ed3c48095b60 req-def07a2a-cf99-4dff-94ef-ab29487cc793 service nova] [instance: 84763b6d-f33c-43d6-b6af-cac86fe8ea86] No waiting events found dispatching network-vif-plugged-01b9226a-408b-4422-a876-eff4944132c7 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 12:02:52 user nova-compute[73449]: WARNING nova.compute.manager [req-ba478fa0-f391-4e48-bcd0-ed3c48095b60 req-def07a2a-cf99-4dff-94ef-ab29487cc793 service nova] [instance: 84763b6d-f33c-43d6-b6af-cac86fe8ea86] Received unexpected event network-vif-plugged-01b9226a-408b-4422-a876-eff4944132c7 for instance with vm_state building and task_state spawning.
Aug 17 12:02:53 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:02:54 user nova-compute[73449]: DEBUG nova.compute.manager [req-a96bff11-99d5-4b4e-a28f-84fb23bf44e2 req-0ee0d4c1-f0d1-4c99-84c0-3d508cae734e service nova] [instance: 84763b6d-f33c-43d6-b6af-cac86fe8ea86] Received event network-vif-plugged-01b9226a-408b-4422-a876-eff4944132c7 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:02:54 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-a96bff11-99d5-4b4e-a28f-84fb23bf44e2 req-0ee0d4c1-f0d1-4c99-84c0-3d508cae734e service nova] Acquiring lock "84763b6d-f33c-43d6-b6af-cac86fe8ea86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:02:54 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-a96bff11-99d5-4b4e-a28f-84fb23bf44e2 req-0ee0d4c1-f0d1-4c99-84c0-3d508cae734e service nova] Lock "84763b6d-f33c-43d6-b6af-cac86fe8ea86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:02:54 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-a96bff11-99d5-4b4e-a28f-84fb23bf44e2 req-0ee0d4c1-f0d1-4c99-84c0-3d508cae734e service nova] Lock "84763b6d-f33c-43d6-b6af-cac86fe8ea86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:02:54 user nova-compute[73449]: DEBUG nova.compute.manager [req-a96bff11-99d5-4b4e-a28f-84fb23bf44e2 req-0ee0d4c1-f0d1-4c99-84c0-3d508cae734e service nova] [instance: 84763b6d-f33c-43d6-b6af-cac86fe8ea86] No waiting events found dispatching network-vif-plugged-01b9226a-408b-4422-a876-eff4944132c7 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 12:02:54 user nova-compute[73449]: WARNING nova.compute.manager [req-a96bff11-99d5-4b4e-a28f-84fb23bf44e2 req-0ee0d4c1-f0d1-4c99-84c0-3d508cae734e service nova] [instance: 84763b6d-f33c-43d6-b6af-cac86fe8ea86] Received unexpected event network-vif-plugged-01b9226a-408b-4422-a876-eff4944132c7 for instance with vm_state building and task_state spawning.
Aug 17 12:02:54 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:02:54 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692273774.9471555, 84763b6d-f33c-43d6-b6af-cac86fe8ea86 => Resumed> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 12:02:54 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 84763b6d-f33c-43d6-b6af-cac86fe8ea86] VM Resumed (Lifecycle Event)
Aug 17 12:02:54 user nova-compute[73449]: DEBUG nova.compute.manager [None req-9b77883b-5239-4192-833c-a6f2d74dfb28 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: 84763b6d-f33c-43d6-b6af-cac86fe8ea86] Instance event wait completed in 0 seconds for  {{(pid=73449) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 12:02:54 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-9b77883b-5239-4192-833c-a6f2d74dfb28 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: 84763b6d-f33c-43d6-b6af-cac86fe8ea86] Guest created on hypervisor {{(pid=73449) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 12:02:54 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: 84763b6d-f33c-43d6-b6af-cac86fe8ea86] Instance spawned successfully.
Aug 17 12:02:54 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-9b77883b-5239-4192-833c-a6f2d74dfb28 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: 84763b6d-f33c-43d6-b6af-cac86fe8ea86] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 12:02:54 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 84763b6d-f33c-43d6-b6af-cac86fe8ea86] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 12:02:54 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 84763b6d-f33c-43d6-b6af-cac86fe8ea86] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 12:02:54 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-9b77883b-5239-4192-833c-a6f2d74dfb28 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: 84763b6d-f33c-43d6-b6af-cac86fe8ea86] Found default for hw_cdrom_bus of ide {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 12:02:54 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-9b77883b-5239-4192-833c-a6f2d74dfb28 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: 84763b6d-f33c-43d6-b6af-cac86fe8ea86] Found default for hw_disk_bus of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 12:02:54 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-9b77883b-5239-4192-833c-a6f2d74dfb28 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: 84763b6d-f33c-43d6-b6af-cac86fe8ea86] Found default for hw_input_bus of None {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 12:02:54 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-9b77883b-5239-4192-833c-a6f2d74dfb28 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: 84763b6d-f33c-43d6-b6af-cac86fe8ea86] Found default for hw_pointer_model of None {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 12:02:54 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-9b77883b-5239-4192-833c-a6f2d74dfb28 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: 84763b6d-f33c-43d6-b6af-cac86fe8ea86] Found default for hw_video_model of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 12:02:54 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-9b77883b-5239-4192-833c-a6f2d74dfb28 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: 84763b6d-f33c-43d6-b6af-cac86fe8ea86] Found default for hw_vif_model of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 12:02:54 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 84763b6d-f33c-43d6-b6af-cac86fe8ea86] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 12:02:54 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692273774.9484978, 84763b6d-f33c-43d6-b6af-cac86fe8ea86 => Started> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 12:02:54 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 84763b6d-f33c-43d6-b6af-cac86fe8ea86] VM Started (Lifecycle Event)
Aug 17 12:02:55 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 84763b6d-f33c-43d6-b6af-cac86fe8ea86] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 12:02:55 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 84763b6d-f33c-43d6-b6af-cac86fe8ea86] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 12:02:55 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 84763b6d-f33c-43d6-b6af-cac86fe8ea86] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 12:02:55 user nova-compute[73449]: INFO nova.compute.manager [None req-9b77883b-5239-4192-833c-a6f2d74dfb28 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: 84763b6d-f33c-43d6-b6af-cac86fe8ea86] Took 6.12 seconds to spawn the instance on the hypervisor.
Aug 17 12:02:55 user nova-compute[73449]: DEBUG nova.compute.manager [None req-9b77883b-5239-4192-833c-a6f2d74dfb28 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: 84763b6d-f33c-43d6-b6af-cac86fe8ea86] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 12:02:55 user nova-compute[73449]: INFO nova.compute.manager [None req-9b77883b-5239-4192-833c-a6f2d74dfb28 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: 84763b6d-f33c-43d6-b6af-cac86fe8ea86] Took 6.85 seconds to build instance.
Aug 17 12:02:55 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-9b77883b-5239-4192-833c-a6f2d74dfb28 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Lock "84763b6d-f33c-43d6-b6af-cac86fe8ea86" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.944s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:02:55 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:02:58 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:02:58 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:02:58 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:03:00 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:03:01 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:03:03 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:03:03 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:03:04 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:03:04 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73449) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 12:03:05 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:03:06 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:03:08 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:03:10 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-bec6d400-9091-46f0-9628-a3e002f42593 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Acquiring lock "3d74c8f6-fb4e-4460-b722-674a8a1e2d25" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:03:10 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-bec6d400-9091-46f0-9628-a3e002f42593 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Lock "3d74c8f6-fb4e-4460-b722-674a8a1e2d25" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:03:10 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-bec6d400-9091-46f0-9628-a3e002f42593 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Acquiring lock "3d74c8f6-fb4e-4460-b722-674a8a1e2d25-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:03:10 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-bec6d400-9091-46f0-9628-a3e002f42593 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Lock "3d74c8f6-fb4e-4460-b722-674a8a1e2d25-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:03:10 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-bec6d400-9091-46f0-9628-a3e002f42593 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Lock "3d74c8f6-fb4e-4460-b722-674a8a1e2d25-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:03:10 user nova-compute[73449]: INFO nova.compute.manager [None req-bec6d400-9091-46f0-9628-a3e002f42593 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] Terminating instance
Aug 17 12:03:10 user nova-compute[73449]: DEBUG nova.compute.manager [None req-bec6d400-9091-46f0-9628-a3e002f42593 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] Start destroying the instance on the hypervisor. {{(pid=73449) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 12:03:10 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:03:10 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:03:10 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:03:10 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:03:10 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:03:10 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:03:10 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=73449) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 12:03:11 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:03:11 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:03:11 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:03:11 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:03:11 user nova-compute[73449]: DEBUG nova.compute.manager [req-7929c30b-302c-4b41-890b-d7faa2e5ffb5 req-fb0eeb94-d6b8-4657-9c71-3715872f66de service nova] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] Received event network-vif-unplugged-a0e89b76-95af-4e50-a972-b223cc5b3cab {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:03:11 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-7929c30b-302c-4b41-890b-d7faa2e5ffb5 req-fb0eeb94-d6b8-4657-9c71-3715872f66de service nova] Acquiring lock "3d74c8f6-fb4e-4460-b722-674a8a1e2d25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:03:11 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-7929c30b-302c-4b41-890b-d7faa2e5ffb5 req-fb0eeb94-d6b8-4657-9c71-3715872f66de service nova] Lock "3d74c8f6-fb4e-4460-b722-674a8a1e2d25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:03:11 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-7929c30b-302c-4b41-890b-d7faa2e5ffb5 req-fb0eeb94-d6b8-4657-9c71-3715872f66de service nova] Lock "3d74c8f6-fb4e-4460-b722-674a8a1e2d25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:03:11 user nova-compute[73449]: DEBUG nova.compute.manager [req-7929c30b-302c-4b41-890b-d7faa2e5ffb5 req-fb0eeb94-d6b8-4657-9c71-3715872f66de service nova] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] No waiting events found dispatching network-vif-unplugged-a0e89b76-95af-4e50-a972-b223cc5b3cab {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 12:03:11 user nova-compute[73449]: DEBUG nova.compute.manager [req-7929c30b-302c-4b41-890b-d7faa2e5ffb5 req-fb0eeb94-d6b8-4657-9c71-3715872f66de service nova] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] Received event network-vif-unplugged-a0e89b76-95af-4e50-a972-b223cc5b3cab for instance with task_state deleting. {{(pid=73449) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 12:03:11 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] Instance destroyed successfully.
Aug 17 12:03:11 user nova-compute[73449]: DEBUG nova.objects.instance [None req-bec6d400-9091-46f0-9628-a3e002f42593 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Lazy-loading 'resources' on Instance uuid 3d74c8f6-fb4e-4460-b722-674a8a1e2d25 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:03:11 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-bec6d400-9091-46f0-9628-a3e002f42593 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:45:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-232739498',display_name='tempest-ServerRescueNegativeTestJSON-server-232739498',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-232739498',id=18,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T11:50:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8722edee53ed4a9188366c38f3b8b52f',ramdisk_id='',reservation_id='r-yxd32tyb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1458167730',owner_user_name='tempest-ServerRescueNegativeTestJSON-1458167730-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T11:52:37Z,user_data=None,user_id='7ccb76bc93f84e0897da59b8d5928238',uuid=3d74c8f6-fb4e-4460-b722-674a8a1e2d25,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a0e89b76-95af-4e50-a972-b223cc5b3cab", "address": "fa:16:3e:5c:ab:e7", "network": {"id": "f7298070-baaa-4842-b3b2-d9fe1058d3b6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1715911399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8722edee53ed4a9188366c38f3b8b52f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0e89b76-95", "ovs_interfaceid": "a0e89b76-95af-4e50-a972-b223cc5b3cab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 12:03:11 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-bec6d400-9091-46f0-9628-a3e002f42593 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Converting VIF {"id": "a0e89b76-95af-4e50-a972-b223cc5b3cab", "address": "fa:16:3e:5c:ab:e7", "network": {"id": "f7298070-baaa-4842-b3b2-d9fe1058d3b6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1715911399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8722edee53ed4a9188366c38f3b8b52f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0e89b76-95", "ovs_interfaceid": "a0e89b76-95af-4e50-a972-b223cc5b3cab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 12:03:11 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-bec6d400-9091-46f0-9628-a3e002f42593 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5c:ab:e7,bridge_name='br-int',has_traffic_filtering=True,id=a0e89b76-95af-4e50-a972-b223cc5b3cab,network=Network(f7298070-baaa-4842-b3b2-d9fe1058d3b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0e89b76-95') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 12:03:11 user nova-compute[73449]: DEBUG os_vif [None req-bec6d400-9091-46f0-9628-a3e002f42593 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:ab:e7,bridge_name='br-int',has_traffic_filtering=True,id=a0e89b76-95af-4e50-a972-b223cc5b3cab,network=Network(f7298070-baaa-4842-b3b2-d9fe1058d3b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0e89b76-95') {{(pid=73449) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 12:03:11 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:03:11 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa0e89b76-95, bridge=br-int, if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 12:03:11 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:03:11 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:03:11 user nova-compute[73449]: INFO os_vif [None req-bec6d400-9091-46f0-9628-a3e002f42593 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:ab:e7,bridge_name='br-int',has_traffic_filtering=True,id=a0e89b76-95af-4e50-a972-b223cc5b3cab,network=Network(f7298070-baaa-4842-b3b2-d9fe1058d3b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0e89b76-95')
Aug 17 12:03:11 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-bec6d400-9091-46f0-9628-a3e002f42593 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] Deleting instance files /opt/stack/data/nova/instances/3d74c8f6-fb4e-4460-b722-674a8a1e2d25_del
Aug 17 12:03:11 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-bec6d400-9091-46f0-9628-a3e002f42593 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] Deletion of /opt/stack/data/nova/instances/3d74c8f6-fb4e-4460-b722-674a8a1e2d25_del complete
Aug 17 12:03:11 user nova-compute[73449]: INFO nova.compute.manager [None req-bec6d400-9091-46f0-9628-a3e002f42593 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 17 12:03:11 user nova-compute[73449]: DEBUG oslo.service.loopingcall [None req-bec6d400-9091-46f0-9628-a3e002f42593 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73449) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 12:03:11 user nova-compute[73449]: DEBUG nova.compute.manager [-] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] Deallocating network for instance {{(pid=73449) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 12:03:11 user nova-compute[73449]: DEBUG nova.network.neutron [-] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] deallocate_for_instance() {{(pid=73449) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 12:03:11 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/712c777e-251b-43d8-b923-8eda693f32ed/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:03:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/712c777e-251b-43d8-b923-8eda693f32ed/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:03:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/712c777e-251b-43d8-b923-8eda693f32ed/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:03:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/712c777e-251b-43d8-b923-8eda693f32ed/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:03:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84763b6d-f33c-43d6-b6af-cac86fe8ea86/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:03:12 user nova-compute[73449]: DEBUG nova.network.neutron [-] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] Updating instance_info_cache with network_info: [] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 12:03:12 user nova-compute[73449]: INFO nova.compute.manager [-] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] Took 0.49 seconds to deallocate network for instance.
Aug 17 12:03:12 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-bec6d400-9091-46f0-9628-a3e002f42593 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:03:12 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-bec6d400-9091-46f0-9628-a3e002f42593 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:03:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84763b6d-f33c-43d6-b6af-cac86fe8ea86/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:03:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84763b6d-f33c-43d6-b6af-cac86fe8ea86/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:03:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84763b6d-f33c-43d6-b6af-cac86fe8ea86/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:03:12 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73449) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 12:03:12 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73449) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 12:03:12 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Error from libvirt while getting description of instance-00000012: [Error Code 42] Domain not found: no domain with matching uuid '3d74c8f6-fb4e-4460-b722-674a8a1e2d25' (instance-00000012): libvirt.libvirtError: Domain not found: no domain with matching uuid '3d74c8f6-fb4e-4460-b722-674a8a1e2d25' (instance-00000012)
Aug 17 12:03:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89440604-1daf-4e7a-a524-2f9c21a9cb96/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:03:12 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-bec6d400-9091-46f0-9628-a3e002f42593 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 12:03:12 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-bec6d400-9091-46f0-9628-a3e002f42593 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 12:03:12 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-bec6d400-9091-46f0-9628-a3e002f42593 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.395s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:03:12 user nova-compute[73449]: INFO nova.scheduler.client.report [None req-bec6d400-9091-46f0-9628-a3e002f42593 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Deleted allocations for instance 3d74c8f6-fb4e-4460-b722-674a8a1e2d25
Aug 17 12:03:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89440604-1daf-4e7a-a524-2f9c21a9cb96/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:03:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89440604-1daf-4e7a-a524-2f9c21a9cb96/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:03:12 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-bec6d400-9091-46f0-9628-a3e002f42593 tempest-ServerRescueNegativeTestJSON-1458167730 tempest-ServerRescueNegativeTestJSON-1458167730-project-member] Lock "3d74c8f6-fb4e-4460-b722-674a8a1e2d25" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.004s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:03:13 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89440604-1daf-4e7a-a524-2f9c21a9cb96/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:03:13 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d160711b-0b77-4f9a-b1d9-f0ac16240d4d/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:03:13 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d160711b-0b77-4f9a-b1d9-f0ac16240d4d/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:03:13 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d160711b-0b77-4f9a-b1d9-f0ac16240d4d/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:03:13 user nova-compute[73449]: DEBUG nova.compute.manager [req-9fae00b1-1f0f-4c85-b129-d4358f70647a req-3646a163-1e99-4618-a585-756cee0841b4 service nova] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] Received event network-vif-plugged-a0e89b76-95af-4e50-a972-b223cc5b3cab {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:03:13 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-9fae00b1-1f0f-4c85-b129-d4358f70647a req-3646a163-1e99-4618-a585-756cee0841b4 service nova] Acquiring lock "3d74c8f6-fb4e-4460-b722-674a8a1e2d25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:03:13 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-9fae00b1-1f0f-4c85-b129-d4358f70647a req-3646a163-1e99-4618-a585-756cee0841b4 service nova] Lock "3d74c8f6-fb4e-4460-b722-674a8a1e2d25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:03:13 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-9fae00b1-1f0f-4c85-b129-d4358f70647a req-3646a163-1e99-4618-a585-756cee0841b4 service nova] Lock "3d74c8f6-fb4e-4460-b722-674a8a1e2d25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:03:13 user nova-compute[73449]: DEBUG nova.compute.manager [req-9fae00b1-1f0f-4c85-b129-d4358f70647a req-3646a163-1e99-4618-a585-756cee0841b4 service nova] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] No waiting events found dispatching network-vif-plugged-a0e89b76-95af-4e50-a972-b223cc5b3cab {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 12:03:13 user nova-compute[73449]: WARNING nova.compute.manager [req-9fae00b1-1f0f-4c85-b129-d4358f70647a req-3646a163-1e99-4618-a585-756cee0841b4 service nova] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] Received unexpected event network-vif-plugged-a0e89b76-95af-4e50-a972-b223cc5b3cab for instance with vm_state deleted and task_state None.
Aug 17 12:03:13 user nova-compute[73449]: DEBUG nova.compute.manager [req-9fae00b1-1f0f-4c85-b129-d4358f70647a req-3646a163-1e99-4618-a585-756cee0841b4 service nova] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] Received event network-vif-deleted-a0e89b76-95af-4e50-a972-b223cc5b3cab {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:03:13 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d160711b-0b77-4f9a-b1d9-f0ac16240d4d/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:03:13 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73449) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 12:03:13 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:03:13 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 12:03:13 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 12:03:13 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Hypervisor/Node resource view: name=user free_ram=7873MB free_disk=24.99396514892578GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73449) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 12:03:13 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:03:13 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:03:14 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 89440604-1daf-4e7a-a524-2f9c21a9cb96 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 12:03:14 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 31f5f3d2-41d8-4a26-9eb2-18b891f94734 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 12:03:14 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 712c777e-251b-43d8-b923-8eda693f32ed actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 12:03:14 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance d160711b-0b77-4f9a-b1d9-f0ac16240d4d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 12:03:14 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 5a627da9-03a1-4239-8721-cefe99c39ee2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 12:03:14 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 84763b6d-f33c-43d6-b6af-cac86fe8ea86 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 12:03:14 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=73449) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 12:03:14 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=73449) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 12:03:14 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 12:03:14 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 12:03:14 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Compute_service record updated for user:user {{(pid=73449) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 12:03:14 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.759s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:03:14 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:03:16 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:03:16 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Starting heal instance info cache {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 12:03:16 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:03:16 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Didn't find any instances for network info cache update. {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 12:03:16 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:03:18 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:03:19 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:03:21 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:03:21 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:03:22 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:03:23 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:03:25 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:03:26 user nova-compute[73449]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692273791.6997278, 3d74c8f6-fb4e-4460-b722-674a8a1e2d25 => Stopped> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 12:03:26 user nova-compute[73449]: INFO nova.compute.manager [-] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] VM Stopped (Lifecycle Event)
Aug 17 12:03:26 user nova-compute[73449]: DEBUG nova.compute.manager [None req-bb5436b4-acdd-4217-b9d0-07aed63c95c0 None None] [instance: 3d74c8f6-fb4e-4460-b722-674a8a1e2d25] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 12:03:26 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:03:27 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:03:27 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:03:28 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:03:29 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:03:30 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-d72ec4cf-3ada-49eb-b9cf-cc013d848659 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Acquiring lock "61201d5c-26f1-4c6d-a764-be2ee2e533ae" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:03:30 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-d72ec4cf-3ada-49eb-b9cf-cc013d848659 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Lock "61201d5c-26f1-4c6d-a764-be2ee2e533ae" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:03:30 user nova-compute[73449]: DEBUG nova.compute.manager [None req-d72ec4cf-3ada-49eb-b9cf-cc013d848659 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Starting instance... {{(pid=73449) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 12:03:30 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-d72ec4cf-3ada-49eb-b9cf-cc013d848659 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:03:30 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-d72ec4cf-3ada-49eb-b9cf-cc013d848659 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:03:30 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-d72ec4cf-3ada-49eb-b9cf-cc013d848659 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73449) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 12:03:30 user nova-compute[73449]: INFO nova.compute.claims [None req-d72ec4cf-3ada-49eb-b9cf-cc013d848659 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Claim successful on node user
Aug 17 12:03:30 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-d72ec4cf-3ada-49eb-b9cf-cc013d848659 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 12:03:30 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-d72ec4cf-3ada-49eb-b9cf-cc013d848659 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 12:03:30 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-d72ec4cf-3ada-49eb-b9cf-cc013d848659 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.363s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:03:30 user nova-compute[73449]: DEBUG nova.compute.manager [None req-d72ec4cf-3ada-49eb-b9cf-cc013d848659 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Start building networks asynchronously for instance. {{(pid=73449) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 12:03:31 user nova-compute[73449]: DEBUG nova.compute.manager [None req-d72ec4cf-3ada-49eb-b9cf-cc013d848659 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Allocating IP information in the background. {{(pid=73449) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 12:03:31 user nova-compute[73449]: DEBUG nova.network.neutron [None req-d72ec4cf-3ada-49eb-b9cf-cc013d848659 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] allocate_for_instance() {{(pid=73449) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 12:03:31 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-d72ec4cf-3ada-49eb-b9cf-cc013d848659 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 12:03:31 user nova-compute[73449]: DEBUG nova.compute.manager [None req-d72ec4cf-3ada-49eb-b9cf-cc013d848659 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Start building block device mappings for instance. {{(pid=73449) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 12:03:31 user nova-compute[73449]: DEBUG nova.compute.manager [None req-d72ec4cf-3ada-49eb-b9cf-cc013d848659 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Start spawning the instance on the hypervisor. {{(pid=73449) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 12:03:31 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-d72ec4cf-3ada-49eb-b9cf-cc013d848659 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Creating instance directory {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 12:03:31 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-d72ec4cf-3ada-49eb-b9cf-cc013d848659 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Creating image(s)
Aug 17 12:03:31 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-d72ec4cf-3ada-49eb-b9cf-cc013d848659 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Acquiring lock "/opt/stack/data/nova/instances/61201d5c-26f1-4c6d-a764-be2ee2e533ae/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:03:31 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-d72ec4cf-3ada-49eb-b9cf-cc013d848659 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Lock "/opt/stack/data/nova/instances/61201d5c-26f1-4c6d-a764-be2ee2e533ae/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:03:31 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-d72ec4cf-3ada-49eb-b9cf-cc013d848659 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Lock "/opt/stack/data/nova/instances/61201d5c-26f1-4c6d-a764-be2ee2e533ae/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:03:31 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-d72ec4cf-3ada-49eb-b9cf-cc013d848659 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:03:31 user nova-compute[73449]: DEBUG nova.policy [None req-d72ec4cf-3ada-49eb-b9cf-cc013d848659 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9b21e7e411a54be0890ae7b0ca85d80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a2f7faf23147fba5270c844eac051a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73449) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 12:03:31 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-d72ec4cf-3ada-49eb-b9cf-cc013d848659 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json" returned: 0 in 0.188s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:03:31 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-d72ec4cf-3ada-49eb-b9cf-cc013d848659 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Acquiring lock "7e267a577c062ee862e95ede6b48cfd5632f3ea3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:03:31 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-d72ec4cf-3ada-49eb-b9cf-cc013d848659 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Lock "7e267a577c062ee862e95ede6b48cfd5632f3ea3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:03:31 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-d72ec4cf-3ada-49eb-b9cf-cc013d848659 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:03:31 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-d72ec4cf-3ada-49eb-b9cf-cc013d848659 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json" returned: 0 in 0.197s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:03:31 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-d72ec4cf-3ada-49eb-b9cf-cc013d848659 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3,backing_fmt=raw /opt/stack/data/nova/instances/61201d5c-26f1-4c6d-a764-be2ee2e533ae/disk 1073741824 {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:03:31 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-d72ec4cf-3ada-49eb-b9cf-cc013d848659 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3,backing_fmt=raw /opt/stack/data/nova/instances/61201d5c-26f1-4c6d-a764-be2ee2e533ae/disk 1073741824" returned: 0 in 0.051s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:03:31 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-d72ec4cf-3ada-49eb-b9cf-cc013d848659 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Lock "7e267a577c062ee862e95ede6b48cfd5632f3ea3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.255s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:03:31 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-d72ec4cf-3ada-49eb-b9cf-cc013d848659 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:03:31 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:03:31 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-d72ec4cf-3ada-49eb-b9cf-cc013d848659 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json" returned: 0 in 0.189s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:03:31 user nova-compute[73449]: DEBUG nova.virt.disk.api [None req-d72ec4cf-3ada-49eb-b9cf-cc013d848659 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Checking if we can resize image /opt/stack/data/nova/instances/61201d5c-26f1-4c6d-a764-be2ee2e533ae/disk. size=1073741824 {{(pid=73449) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 12:03:31 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-d72ec4cf-3ada-49eb-b9cf-cc013d848659 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61201d5c-26f1-4c6d-a764-be2ee2e533ae/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:03:31 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-d72ec4cf-3ada-49eb-b9cf-cc013d848659 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61201d5c-26f1-4c6d-a764-be2ee2e533ae/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:03:31 user nova-compute[73449]: DEBUG nova.virt.disk.api [None req-d72ec4cf-3ada-49eb-b9cf-cc013d848659 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Cannot resize image /opt/stack/data/nova/instances/61201d5c-26f1-4c6d-a764-be2ee2e533ae/disk to a smaller size. {{(pid=73449) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 12:03:31 user nova-compute[73449]: DEBUG nova.objects.instance [None req-d72ec4cf-3ada-49eb-b9cf-cc013d848659 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Lazy-loading 'migration_context' on Instance uuid 61201d5c-26f1-4c6d-a764-be2ee2e533ae {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:03:32 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-d72ec4cf-3ada-49eb-b9cf-cc013d848659 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Created local disks {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 12:03:32 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-d72ec4cf-3ada-49eb-b9cf-cc013d848659 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Ensure instance console log exists: /opt/stack/data/nova/instances/61201d5c-26f1-4c6d-a764-be2ee2e533ae/console.log {{(pid=73449) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 12:03:32 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-d72ec4cf-3ada-49eb-b9cf-cc013d848659 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:03:32 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-d72ec4cf-3ada-49eb-b9cf-cc013d848659 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:03:32 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-d72ec4cf-3ada-49eb-b9cf-cc013d848659 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:03:32 user nova-compute[73449]: DEBUG nova.network.neutron [None req-d72ec4cf-3ada-49eb-b9cf-cc013d848659 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Successfully created port: f9f6066e-ddd2-4e41-b92a-5713cfb9a223 {{(pid=73449) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 12:03:32 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:03:33 user nova-compute[73449]: DEBUG nova.network.neutron [None req-d72ec4cf-3ada-49eb-b9cf-cc013d848659 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Successfully updated port: f9f6066e-ddd2-4e41-b92a-5713cfb9a223 {{(pid=73449) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 12:03:33 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-d72ec4cf-3ada-49eb-b9cf-cc013d848659 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Acquiring lock "refresh_cache-61201d5c-26f1-4c6d-a764-be2ee2e533ae" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 12:03:33 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-d72ec4cf-3ada-49eb-b9cf-cc013d848659 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Acquired lock "refresh_cache-61201d5c-26f1-4c6d-a764-be2ee2e533ae" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 12:03:33 user nova-compute[73449]: DEBUG nova.network.neutron [None req-d72ec4cf-3ada-49eb-b9cf-cc013d848659 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Building network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 12:03:33 user nova-compute[73449]: DEBUG nova.compute.manager [req-f4d823ac-c6b9-487c-89da-c26dce8474e3 req-eb5824f9-462f-43fe-9ba6-7d83b807b464 service nova] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Received event network-changed-f9f6066e-ddd2-4e41-b92a-5713cfb9a223 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:03:33 user nova-compute[73449]: DEBUG nova.compute.manager [req-f4d823ac-c6b9-487c-89da-c26dce8474e3 req-eb5824f9-462f-43fe-9ba6-7d83b807b464 service nova] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Refreshing instance network info cache due to event network-changed-f9f6066e-ddd2-4e41-b92a-5713cfb9a223. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 12:03:33 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-f4d823ac-c6b9-487c-89da-c26dce8474e3 req-eb5824f9-462f-43fe-9ba6-7d83b807b464 service nova] Acquiring lock "refresh_cache-61201d5c-26f1-4c6d-a764-be2ee2e533ae" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 12:03:33 user nova-compute[73449]: DEBUG nova.network.neutron [None req-d72ec4cf-3ada-49eb-b9cf-cc013d848659 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Instance cache missing network info. {{(pid=73449) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 12:03:33 user nova-compute[73449]: DEBUG nova.network.neutron [None req-d72ec4cf-3ada-49eb-b9cf-cc013d848659 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Updating instance_info_cache with network_info: [{"id": "f9f6066e-ddd2-4e41-b92a-5713cfb9a223", "address": "fa:16:3e:d2:c7:08", "network": {"id": "2ead35b7-4013-4fab-b35f-02f3237fcac1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1887618888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2a2f7faf23147fba5270c844eac051a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9f6066e-dd", "ovs_interfaceid": "f9f6066e-ddd2-4e41-b92a-5713cfb9a223", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 12:03:33 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-d72ec4cf-3ada-49eb-b9cf-cc013d848659 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Releasing lock "refresh_cache-61201d5c-26f1-4c6d-a764-be2ee2e533ae" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 12:03:33 user nova-compute[73449]: DEBUG nova.compute.manager [None req-d72ec4cf-3ada-49eb-b9cf-cc013d848659 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Instance network_info: |[{"id": "f9f6066e-ddd2-4e41-b92a-5713cfb9a223", "address": "fa:16:3e:d2:c7:08", "network": {"id": "2ead35b7-4013-4fab-b35f-02f3237fcac1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1887618888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2a2f7faf23147fba5270c844eac051a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9f6066e-dd", "ovs_interfaceid": "f9f6066e-ddd2-4e41-b92a-5713cfb9a223", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73449) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 12:03:33 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-f4d823ac-c6b9-487c-89da-c26dce8474e3 req-eb5824f9-462f-43fe-9ba6-7d83b807b464 service nova] Acquired lock "refresh_cache-61201d5c-26f1-4c6d-a764-be2ee2e533ae" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 12:03:33 user nova-compute[73449]: DEBUG nova.network.neutron [req-f4d823ac-c6b9-487c-89da-c26dce8474e3 req-eb5824f9-462f-43fe-9ba6-7d83b807b464 service nova] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Refreshing network info cache for port f9f6066e-ddd2-4e41-b92a-5713cfb9a223 {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 12:03:33 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-d72ec4cf-3ada-49eb-b9cf-cc013d848659 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Start _get_guest_xml network_info=[{"id": "f9f6066e-ddd2-4e41-b92a-5713cfb9a223", "address": "fa:16:3e:d2:c7:08", "network": {"id": "2ead35b7-4013-4fab-b35f-02f3237fcac1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1887618888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2a2f7faf23147fba5270c844eac051a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9f6066e-dd", "ovs_interfaceid": "f9f6066e-ddd2-4e41-b92a-5713cfb9a223", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T11:36:11Z,direct_url=<?>,disk_format='qcow2',id=0a2904ae-083d-41c8-83db-343132b36148,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7a77880136a54ef195c82e018e1939db',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T11:36:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': '0a2904ae-083d-41c8-83db-343132b36148'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 12:03:33 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-d72ec4cf-3ada-49eb-b9cf-cc013d848659 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 12:03:33 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-d72ec4cf-3ada-49eb-b9cf-cc013d848659 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 12:03:33 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-d72ec4cf-3ada-49eb-b9cf-cc013d848659 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 12:03:33 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-d72ec4cf-3ada-49eb-b9cf-cc013d848659 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] CPU controller missing on host. {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 12:03:33 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-d72ec4cf-3ada-49eb-b9cf-cc013d848659 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 12:03:33 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-d72ec4cf-3ada-49eb-b9cf-cc013d848659 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] CPU controller found on host. {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 12:03:33 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-d72ec4cf-3ada-49eb-b9cf-cc013d848659 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73449) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 12:03:33 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-d72ec4cf-3ada-49eb-b9cf-cc013d848659 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T11:35:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T11:36:11Z,direct_url=<?>,disk_format='qcow2',id=0a2904ae-083d-41c8-83db-343132b36148,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7a77880136a54ef195c82e018e1939db',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T11:36:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 12:03:33 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-d72ec4cf-3ada-49eb-b9cf-cc013d848659 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Flavor limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 12:03:33 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-d72ec4cf-3ada-49eb-b9cf-cc013d848659 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Image limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 12:03:33 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-d72ec4cf-3ada-49eb-b9cf-cc013d848659 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Flavor pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 12:03:33 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-d72ec4cf-3ada-49eb-b9cf-cc013d848659 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Image pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 12:03:33 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-d72ec4cf-3ada-49eb-b9cf-cc013d848659 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 12:03:33 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-d72ec4cf-3ada-49eb-b9cf-cc013d848659 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 12:03:33 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-d72ec4cf-3ada-49eb-b9cf-cc013d848659 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 12:03:33 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-d72ec4cf-3ada-49eb-b9cf-cc013d848659 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Got 1 possible topologies {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 12:03:33 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-d72ec4cf-3ada-49eb-b9cf-cc013d848659 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 12:03:33 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-d72ec4cf-3ada-49eb-b9cf-cc013d848659 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 12:03:33 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-d72ec4cf-3ada-49eb-b9cf-cc013d848659 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T12:03:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-460422634',display_name='tempest-AttachVolumeTestJSON-server-460422634',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-460422634',id=45,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNXw3KLSoC9Q0XBnEpzlvGLEU4aQOJ/QynPahuU7gv/dPY1PMhUmMgpw0sT/09d1GxZ/bLO+3BhHXGsw2GJhA2bjtLfUrL+5y9epJ9Io8OYn3n51dk0dquYLKVxFrx0m8Q==',key_name='tempest-keypair-402233619',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f2a2f7faf23147fba5270c844eac051a',ramdisk_id='',reservation_id='r-arnh7g7d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1035899549',owner_user_name='tempest-AttachVolumeTestJSON-1035899549-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T12:03:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9b21e7e411a54be0890ae7b0ca85d80c',uuid=61201d5c-26f1-4c6d-a764-be2ee2e533ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f9f6066e-ddd2-4e41-b92a-5713cfb9a223", "address": "fa:16:3e:d2:c7:08", "network": {"id": "2ead35b7-4013-4fab-b35f-02f3237fcac1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1887618888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2a2f7faf23147fba5270c844eac051a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9f6066e-dd", "ovs_interfaceid": "f9f6066e-ddd2-4e41-b92a-5713cfb9a223", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73449) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 12:03:33 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-d72ec4cf-3ada-49eb-b9cf-cc013d848659 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Converting VIF {"id": "f9f6066e-ddd2-4e41-b92a-5713cfb9a223", "address": "fa:16:3e:d2:c7:08", "network": {"id": "2ead35b7-4013-4fab-b35f-02f3237fcac1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1887618888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2a2f7faf23147fba5270c844eac051a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9f6066e-dd", "ovs_interfaceid": "f9f6066e-ddd2-4e41-b92a-5713cfb9a223", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 12:03:33 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-d72ec4cf-3ada-49eb-b9cf-cc013d848659 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:c7:08,bridge_name='br-int',has_traffic_filtering=True,id=f9f6066e-ddd2-4e41-b92a-5713cfb9a223,network=Network(2ead35b7-4013-4fab-b35f-02f3237fcac1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9f6066e-dd') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 12:03:33 user nova-compute[73449]: DEBUG nova.objects.instance [None req-d72ec4cf-3ada-49eb-b9cf-cc013d848659 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Lazy-loading 'pci_devices' on Instance uuid 61201d5c-26f1-4c6d-a764-be2ee2e533ae {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:03:33 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:03:33 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-d72ec4cf-3ada-49eb-b9cf-cc013d848659 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] End _get_guest_xml xml=<domain type="kvm">
Aug 17 12:03:33 user nova-compute[73449]:   <uuid>61201d5c-26f1-4c6d-a764-be2ee2e533ae</uuid>
Aug 17 12:03:33 user nova-compute[73449]:   <name>instance-0000002d</name>
Aug 17 12:03:33 user nova-compute[73449]:   <memory>524288</memory>
Aug 17 12:03:33 user nova-compute[73449]:   <vcpu>1</vcpu>
Aug 17 12:03:33 user nova-compute[73449]:   <metadata>
Aug 17 12:03:33 user nova-compute[73449]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 12:03:33 user nova-compute[73449]:       <nova:package version="0.0.0"/>
Aug 17 12:03:33 user nova-compute[73449]:       <nova:name>tempest-AttachVolumeTestJSON-server-460422634</nova:name>
Aug 17 12:03:33 user nova-compute[73449]:       <nova:creationTime>2023-08-17 12:03:33</nova:creationTime>
Aug 17 12:03:33 user nova-compute[73449]:       <nova:flavor name="m1.tiny">
Aug 17 12:03:33 user nova-compute[73449]:         <nova:memory>512</nova:memory>
Aug 17 12:03:33 user nova-compute[73449]:         <nova:disk>1</nova:disk>
Aug 17 12:03:33 user nova-compute[73449]:         <nova:swap>0</nova:swap>
Aug 17 12:03:33 user nova-compute[73449]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 12:03:33 user nova-compute[73449]:         <nova:vcpus>1</nova:vcpus>
Aug 17 12:03:33 user nova-compute[73449]:       </nova:flavor>
Aug 17 12:03:33 user nova-compute[73449]:       <nova:owner>
Aug 17 12:03:33 user nova-compute[73449]:         <nova:user uuid="9b21e7e411a54be0890ae7b0ca85d80c">tempest-AttachVolumeTestJSON-1035899549-project-member</nova:user>
Aug 17 12:03:33 user nova-compute[73449]:         <nova:project uuid="f2a2f7faf23147fba5270c844eac051a">tempest-AttachVolumeTestJSON-1035899549</nova:project>
Aug 17 12:03:33 user nova-compute[73449]:       </nova:owner>
Aug 17 12:03:33 user nova-compute[73449]:       <nova:root type="image" uuid="0a2904ae-083d-41c8-83db-343132b36148"/>
Aug 17 12:03:33 user nova-compute[73449]:       <nova:ports>
Aug 17 12:03:33 user nova-compute[73449]:         <nova:port uuid="f9f6066e-ddd2-4e41-b92a-5713cfb9a223">
Aug 17 12:03:33 user nova-compute[73449]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 17 12:03:33 user nova-compute[73449]:         </nova:port>
Aug 17 12:03:33 user nova-compute[73449]:       </nova:ports>
Aug 17 12:03:33 user nova-compute[73449]:     </nova:instance>
Aug 17 12:03:33 user nova-compute[73449]:   </metadata>
Aug 17 12:03:33 user nova-compute[73449]:   <sysinfo type="smbios">
Aug 17 12:03:33 user nova-compute[73449]:     <system>
Aug 17 12:03:33 user nova-compute[73449]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 12:03:33 user nova-compute[73449]:       <entry name="product">OpenStack Nova</entry>
Aug 17 12:03:33 user nova-compute[73449]:       <entry name="version">0.0.0</entry>
Aug 17 12:03:33 user nova-compute[73449]:       <entry name="serial">61201d5c-26f1-4c6d-a764-be2ee2e533ae</entry>
Aug 17 12:03:33 user nova-compute[73449]:       <entry name="uuid">61201d5c-26f1-4c6d-a764-be2ee2e533ae</entry>
Aug 17 12:03:33 user nova-compute[73449]:       <entry name="family">Virtual Machine</entry>
Aug 17 12:03:33 user nova-compute[73449]:     </system>
Aug 17 12:03:33 user nova-compute[73449]:   </sysinfo>
Aug 17 12:03:33 user nova-compute[73449]:   <os>
Aug 17 12:03:33 user nova-compute[73449]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 12:03:33 user nova-compute[73449]:     <boot dev="hd"/>
Aug 17 12:03:33 user nova-compute[73449]:     <smbios mode="sysinfo"/>
Aug 17 12:03:33 user nova-compute[73449]:   </os>
Aug 17 12:03:33 user nova-compute[73449]:   <features>
Aug 17 12:03:33 user nova-compute[73449]:     <acpi/>
Aug 17 12:03:33 user nova-compute[73449]:     <apic/>
Aug 17 12:03:33 user nova-compute[73449]:     <vmcoreinfo/>
Aug 17 12:03:33 user nova-compute[73449]:   </features>
Aug 17 12:03:33 user nova-compute[73449]:   <clock offset="utc">
Aug 17 12:03:33 user nova-compute[73449]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 12:03:33 user nova-compute[73449]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 12:03:33 user nova-compute[73449]:     <timer name="hpet" present="no"/>
Aug 17 12:03:33 user nova-compute[73449]:   </clock>
Aug 17 12:03:33 user nova-compute[73449]:   <cpu mode="custom" match="exact">
Aug 17 12:03:33 user nova-compute[73449]:     <model>Nehalem</model>
Aug 17 12:03:33 user nova-compute[73449]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 12:03:33 user nova-compute[73449]:   </cpu>
Aug 17 12:03:33 user nova-compute[73449]:   <devices>
Aug 17 12:03:33 user nova-compute[73449]:     <disk type="file" device="disk">
Aug 17 12:03:33 user nova-compute[73449]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 12:03:33 user nova-compute[73449]:       <source file="/opt/stack/data/nova/instances/61201d5c-26f1-4c6d-a764-be2ee2e533ae/disk"/>
Aug 17 12:03:33 user nova-compute[73449]:       <target dev="vda" bus="virtio"/>
Aug 17 12:03:33 user nova-compute[73449]:     </disk>
Aug 17 12:03:33 user nova-compute[73449]:     <interface type="ethernet">
Aug 17 12:03:33 user nova-compute[73449]:       <mac address="fa:16:3e:d2:c7:08"/>
Aug 17 12:03:33 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 12:03:33 user nova-compute[73449]:       <mtu size="1442"/>
Aug 17 12:03:33 user nova-compute[73449]:       <target dev="tapf9f6066e-dd"/>
Aug 17 12:03:33 user nova-compute[73449]:     </interface>
Aug 17 12:03:33 user nova-compute[73449]:     <serial type="pty">
Aug 17 12:03:33 user nova-compute[73449]:       <log file="/opt/stack/data/nova/instances/61201d5c-26f1-4c6d-a764-be2ee2e533ae/console.log" append="off"/>
Aug 17 12:03:33 user nova-compute[73449]:     </serial>
Aug 17 12:03:33 user nova-compute[73449]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 12:03:33 user nova-compute[73449]:     <video>
Aug 17 12:03:33 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 12:03:33 user nova-compute[73449]:     </video>
Aug 17 12:03:33 user nova-compute[73449]:     <rng model="virtio">
Aug 17 12:03:33 user nova-compute[73449]:       <backend model="random">/dev/urandom</backend>
Aug 17 12:03:33 user nova-compute[73449]:     </rng>
Aug 17 12:03:33 user nova-compute[73449]:     <controller type="usb" index="0" model="none"/>
Aug 17 12:03:33 user nova-compute[73449]:     <memballoon model="virtio">
Aug 17 12:03:33 user nova-compute[73449]:       <stats period="10"/>
Aug 17 12:03:33 user nova-compute[73449]:     </memballoon>
Aug 17 12:03:33 user nova-compute[73449]:   </devices>
Aug 17 12:03:33 user nova-compute[73449]: </domain>
Aug 17 12:03:33 user nova-compute[73449]:  {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 12:03:33 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-d72ec4cf-3ada-49eb-b9cf-cc013d848659 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T12:03:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-460422634',display_name='tempest-AttachVolumeTestJSON-server-460422634',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-460422634',id=45,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNXw3KLSoC9Q0XBnEpzlvGLEU4aQOJ/QynPahuU7gv/dPY1PMhUmMgpw0sT/09d1GxZ/bLO+3BhHXGsw2GJhA2bjtLfUrL+5y9epJ9Io8OYn3n51dk0dquYLKVxFrx0m8Q==',key_name='tempest-keypair-402233619',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f2a2f7faf23147fba5270c844eac051a',ramdisk_id='',reservation_id='r-arnh7g7d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1035899549',owner_user_name='tempest-AttachVolumeTestJSON-1035899549-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T12:03:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9b21e7e411a54be0890ae7b0ca85d80c',uuid=61201d5c-26f1-4c6d-a764-be2ee2e533ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f9f6066e-ddd2-4e41-b92a-5713cfb9a223", "address": "fa:16:3e:d2:c7:08", "network": {"id": "2ead35b7-4013-4fab-b35f-02f3237fcac1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1887618888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2a2f7faf23147fba5270c844eac051a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9f6066e-dd", "ovs_interfaceid": "f9f6066e-ddd2-4e41-b92a-5713cfb9a223", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 12:03:33 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-d72ec4cf-3ada-49eb-b9cf-cc013d848659 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Converting VIF {"id": "f9f6066e-ddd2-4e41-b92a-5713cfb9a223", "address": "fa:16:3e:d2:c7:08", "network": {"id": "2ead35b7-4013-4fab-b35f-02f3237fcac1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1887618888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2a2f7faf23147fba5270c844eac051a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9f6066e-dd", "ovs_interfaceid": "f9f6066e-ddd2-4e41-b92a-5713cfb9a223", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 12:03:33 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-d72ec4cf-3ada-49eb-b9cf-cc013d848659 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:c7:08,bridge_name='br-int',has_traffic_filtering=True,id=f9f6066e-ddd2-4e41-b92a-5713cfb9a223,network=Network(2ead35b7-4013-4fab-b35f-02f3237fcac1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9f6066e-dd') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 12:03:33 user nova-compute[73449]: DEBUG os_vif [None req-d72ec4cf-3ada-49eb-b9cf-cc013d848659 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:c7:08,bridge_name='br-int',has_traffic_filtering=True,id=f9f6066e-ddd2-4e41-b92a-5713cfb9a223,network=Network(2ead35b7-4013-4fab-b35f-02f3237fcac1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9f6066e-dd') {{(pid=73449) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 12:03:33 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:03:33 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 12:03:33 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 12:03:33 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:03:33 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf9f6066e-dd, may_exist=True, interface_attrs={}) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 12:03:33 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf9f6066e-dd, col_values=(('external_ids', {'iface-id': 'f9f6066e-ddd2-4e41-b92a-5713cfb9a223', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d2:c7:08', 'vm-uuid': '61201d5c-26f1-4c6d-a764-be2ee2e533ae'}),), if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 12:03:33 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:03:33 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:03:33 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:03:33 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:03:33 user nova-compute[73449]: INFO os_vif [None req-d72ec4cf-3ada-49eb-b9cf-cc013d848659 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:c7:08,bridge_name='br-int',has_traffic_filtering=True,id=f9f6066e-ddd2-4e41-b92a-5713cfb9a223,network=Network(2ead35b7-4013-4fab-b35f-02f3237fcac1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9f6066e-dd')
Aug 17 12:03:33 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-d72ec4cf-3ada-49eb-b9cf-cc013d848659 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] No BDM found with device name vda, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 12:03:33 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-d72ec4cf-3ada-49eb-b9cf-cc013d848659 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] No VIF found with MAC fa:16:3e:d2:c7:08, not building metadata {{(pid=73449) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 12:03:34 user nova-compute[73449]: DEBUG nova.network.neutron [req-f4d823ac-c6b9-487c-89da-c26dce8474e3 req-eb5824f9-462f-43fe-9ba6-7d83b807b464 service nova] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Updated VIF entry in instance network info cache for port f9f6066e-ddd2-4e41-b92a-5713cfb9a223. {{(pid=73449) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 12:03:34 user nova-compute[73449]: DEBUG nova.network.neutron [req-f4d823ac-c6b9-487c-89da-c26dce8474e3 req-eb5824f9-462f-43fe-9ba6-7d83b807b464 service nova] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Updating instance_info_cache with network_info: [{"id": "f9f6066e-ddd2-4e41-b92a-5713cfb9a223", "address": "fa:16:3e:d2:c7:08", "network": {"id": "2ead35b7-4013-4fab-b35f-02f3237fcac1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1887618888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2a2f7faf23147fba5270c844eac051a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9f6066e-dd", "ovs_interfaceid": "f9f6066e-ddd2-4e41-b92a-5713cfb9a223", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 12:03:34 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-f4d823ac-c6b9-487c-89da-c26dce8474e3 req-eb5824f9-462f-43fe-9ba6-7d83b807b464 service nova] Releasing lock "refresh_cache-61201d5c-26f1-4c6d-a764-be2ee2e533ae" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 12:03:34 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-d8d6fa50-0931-48f3-aa98-7f5400a20cc9 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] Acquiring lock "509263cd-9995-4e6b-8b26-461b7eb05ded" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:03:34 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-d8d6fa50-0931-48f3-aa98-7f5400a20cc9 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] Lock "509263cd-9995-4e6b-8b26-461b7eb05ded" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:03:34 user nova-compute[73449]: DEBUG nova.compute.manager [None req-d8d6fa50-0931-48f3-aa98-7f5400a20cc9 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] [instance: 509263cd-9995-4e6b-8b26-461b7eb05ded] Starting instance... {{(pid=73449) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 12:03:34 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-d8d6fa50-0931-48f3-aa98-7f5400a20cc9 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:03:34 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-d8d6fa50-0931-48f3-aa98-7f5400a20cc9 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:03:34 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-d8d6fa50-0931-48f3-aa98-7f5400a20cc9 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73449) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 12:03:34 user nova-compute[73449]: INFO nova.compute.claims [None req-d8d6fa50-0931-48f3-aa98-7f5400a20cc9 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] [instance: 509263cd-9995-4e6b-8b26-461b7eb05ded] Claim successful on node user
Aug 17 12:03:34 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-d8d6fa50-0931-48f3-aa98-7f5400a20cc9 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 12:03:34 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-d8d6fa50-0931-48f3-aa98-7f5400a20cc9 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 12:03:34 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-d8d6fa50-0931-48f3-aa98-7f5400a20cc9 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.373s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:03:34 user nova-compute[73449]: DEBUG nova.compute.manager [None req-d8d6fa50-0931-48f3-aa98-7f5400a20cc9 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] [instance: 509263cd-9995-4e6b-8b26-461b7eb05ded] Start building networks asynchronously for instance. {{(pid=73449) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 12:03:34 user nova-compute[73449]: DEBUG nova.compute.manager [None req-d8d6fa50-0931-48f3-aa98-7f5400a20cc9 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] [instance: 509263cd-9995-4e6b-8b26-461b7eb05ded] Allocating IP information in the background. {{(pid=73449) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 12:03:34 user nova-compute[73449]: DEBUG nova.network.neutron [None req-d8d6fa50-0931-48f3-aa98-7f5400a20cc9 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] [instance: 509263cd-9995-4e6b-8b26-461b7eb05ded] allocate_for_instance() {{(pid=73449) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 12:03:35 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-d8d6fa50-0931-48f3-aa98-7f5400a20cc9 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] [instance: 509263cd-9995-4e6b-8b26-461b7eb05ded] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 12:03:35 user nova-compute[73449]: DEBUG nova.compute.manager [None req-d8d6fa50-0931-48f3-aa98-7f5400a20cc9 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] [instance: 509263cd-9995-4e6b-8b26-461b7eb05ded] Start building block device mappings for instance. {{(pid=73449) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 12:03:35 user nova-compute[73449]: DEBUG nova.policy [None req-d8d6fa50-0931-48f3-aa98-7f5400a20cc9 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c997b7493d6048b083443ca215352322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ffc03751894a96bebd953bd9fa20ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73449) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 12:03:35 user nova-compute[73449]: DEBUG nova.compute.manager [None req-d8d6fa50-0931-48f3-aa98-7f5400a20cc9 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] [instance: 509263cd-9995-4e6b-8b26-461b7eb05ded] Start spawning the instance on the hypervisor. {{(pid=73449) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 12:03:35 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-d8d6fa50-0931-48f3-aa98-7f5400a20cc9 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] [instance: 509263cd-9995-4e6b-8b26-461b7eb05ded] Creating instance directory {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 12:03:35 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-d8d6fa50-0931-48f3-aa98-7f5400a20cc9 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] [instance: 509263cd-9995-4e6b-8b26-461b7eb05ded] Creating image(s)
Aug 17 12:03:35 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-d8d6fa50-0931-48f3-aa98-7f5400a20cc9 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] Acquiring lock "/opt/stack/data/nova/instances/509263cd-9995-4e6b-8b26-461b7eb05ded/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:03:35 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-d8d6fa50-0931-48f3-aa98-7f5400a20cc9 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] Lock "/opt/stack/data/nova/instances/509263cd-9995-4e6b-8b26-461b7eb05ded/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:03:35 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-d8d6fa50-0931-48f3-aa98-7f5400a20cc9 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] Lock "/opt/stack/data/nova/instances/509263cd-9995-4e6b-8b26-461b7eb05ded/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:03:35 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-d8d6fa50-0931-48f3-aa98-7f5400a20cc9 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:03:35 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:03:35 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-d8d6fa50-0931-48f3-aa98-7f5400a20cc9 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json" returned: 0 in 0.177s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:03:35 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-d8d6fa50-0931-48f3-aa98-7f5400a20cc9 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] Acquiring lock "7e267a577c062ee862e95ede6b48cfd5632f3ea3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:03:35 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-d8d6fa50-0931-48f3-aa98-7f5400a20cc9 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] Lock "7e267a577c062ee862e95ede6b48cfd5632f3ea3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:03:35 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-d8d6fa50-0931-48f3-aa98-7f5400a20cc9 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:03:35 user nova-compute[73449]: DEBUG nova.compute.manager [req-c3591a66-b44e-4ec5-b5d7-07d796027c5a req-38cb14e4-1bd8-4415-99e1-0aa9a8eee2d5 service nova] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Received event network-vif-plugged-f9f6066e-ddd2-4e41-b92a-5713cfb9a223 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:03:35 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-c3591a66-b44e-4ec5-b5d7-07d796027c5a req-38cb14e4-1bd8-4415-99e1-0aa9a8eee2d5 service nova] Acquiring lock "61201d5c-26f1-4c6d-a764-be2ee2e533ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:03:35 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-c3591a66-b44e-4ec5-b5d7-07d796027c5a req-38cb14e4-1bd8-4415-99e1-0aa9a8eee2d5 service nova] Lock "61201d5c-26f1-4c6d-a764-be2ee2e533ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:03:35 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-c3591a66-b44e-4ec5-b5d7-07d796027c5a req-38cb14e4-1bd8-4415-99e1-0aa9a8eee2d5 service nova] Lock "61201d5c-26f1-4c6d-a764-be2ee2e533ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:03:35 user nova-compute[73449]: DEBUG nova.compute.manager [req-c3591a66-b44e-4ec5-b5d7-07d796027c5a req-38cb14e4-1bd8-4415-99e1-0aa9a8eee2d5 service nova] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] No waiting events found dispatching network-vif-plugged-f9f6066e-ddd2-4e41-b92a-5713cfb9a223 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 12:03:35 user nova-compute[73449]: WARNING nova.compute.manager [req-c3591a66-b44e-4ec5-b5d7-07d796027c5a req-38cb14e4-1bd8-4415-99e1-0aa9a8eee2d5 service nova] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Received unexpected event network-vif-plugged-f9f6066e-ddd2-4e41-b92a-5713cfb9a223 for instance with vm_state building and task_state spawning.
Aug 17 12:03:35 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-d8d6fa50-0931-48f3-aa98-7f5400a20cc9 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json" returned: 0 in 0.181s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:03:35 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-d8d6fa50-0931-48f3-aa98-7f5400a20cc9 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3,backing_fmt=raw /opt/stack/data/nova/instances/509263cd-9995-4e6b-8b26-461b7eb05ded/disk 1073741824 {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:03:35 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-d8d6fa50-0931-48f3-aa98-7f5400a20cc9 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3,backing_fmt=raw /opt/stack/data/nova/instances/509263cd-9995-4e6b-8b26-461b7eb05ded/disk 1073741824" returned: 0 in 0.057s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:03:35 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-d8d6fa50-0931-48f3-aa98-7f5400a20cc9 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] Lock "7e267a577c062ee862e95ede6b48cfd5632f3ea3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:03:35 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-d8d6fa50-0931-48f3-aa98-7f5400a20cc9 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:03:35 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-d8d6fa50-0931-48f3-aa98-7f5400a20cc9 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json" returned: 0 in 0.190s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:03:35 user nova-compute[73449]: DEBUG nova.virt.disk.api [None req-d8d6fa50-0931-48f3-aa98-7f5400a20cc9 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] Checking if we can resize image /opt/stack/data/nova/instances/509263cd-9995-4e6b-8b26-461b7eb05ded/disk. size=1073741824 {{(pid=73449) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 12:03:35 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-d8d6fa50-0931-48f3-aa98-7f5400a20cc9 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/509263cd-9995-4e6b-8b26-461b7eb05ded/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:03:35 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:03:35 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:03:35 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-d8d6fa50-0931-48f3-aa98-7f5400a20cc9 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/509263cd-9995-4e6b-8b26-461b7eb05ded/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:03:35 user nova-compute[73449]: DEBUG nova.virt.disk.api [None req-d8d6fa50-0931-48f3-aa98-7f5400a20cc9 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] Cannot resize image /opt/stack/data/nova/instances/509263cd-9995-4e6b-8b26-461b7eb05ded/disk to a smaller size. {{(pid=73449) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 12:03:35 user nova-compute[73449]: DEBUG nova.objects.instance [None req-d8d6fa50-0931-48f3-aa98-7f5400a20cc9 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] Lazy-loading 'migration_context' on Instance uuid 509263cd-9995-4e6b-8b26-461b7eb05ded {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:03:36 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-d8d6fa50-0931-48f3-aa98-7f5400a20cc9 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] [instance: 509263cd-9995-4e6b-8b26-461b7eb05ded] Created local disks {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 12:03:36 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-d8d6fa50-0931-48f3-aa98-7f5400a20cc9 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] [instance: 509263cd-9995-4e6b-8b26-461b7eb05ded] Ensure instance console log exists: /opt/stack/data/nova/instances/509263cd-9995-4e6b-8b26-461b7eb05ded/console.log {{(pid=73449) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 12:03:36 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-d8d6fa50-0931-48f3-aa98-7f5400a20cc9 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:03:36 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-d8d6fa50-0931-48f3-aa98-7f5400a20cc9 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:03:36 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-d8d6fa50-0931-48f3-aa98-7f5400a20cc9 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:03:36 user nova-compute[73449]: DEBUG nova.network.neutron [None req-d8d6fa50-0931-48f3-aa98-7f5400a20cc9 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] [instance: 509263cd-9995-4e6b-8b26-461b7eb05ded] Successfully created port: 567c70fb-fa55-4e78-88aa-ab91baf69fed {{(pid=73449) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 12:03:37 user nova-compute[73449]: DEBUG nova.network.neutron [None req-d8d6fa50-0931-48f3-aa98-7f5400a20cc9 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] [instance: 509263cd-9995-4e6b-8b26-461b7eb05ded] Successfully updated port: 567c70fb-fa55-4e78-88aa-ab91baf69fed {{(pid=73449) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 12:03:37 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-d8d6fa50-0931-48f3-aa98-7f5400a20cc9 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] Acquiring lock "refresh_cache-509263cd-9995-4e6b-8b26-461b7eb05ded" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 12:03:37 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-d8d6fa50-0931-48f3-aa98-7f5400a20cc9 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] Acquired lock "refresh_cache-509263cd-9995-4e6b-8b26-461b7eb05ded" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 12:03:37 user nova-compute[73449]: DEBUG nova.network.neutron [None req-d8d6fa50-0931-48f3-aa98-7f5400a20cc9 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] [instance: 509263cd-9995-4e6b-8b26-461b7eb05ded] Building network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 12:03:37 user nova-compute[73449]: DEBUG nova.compute.manager [req-77fb4fcb-146e-4c6c-8429-c5be7ecaaa87 req-6ef0e6f6-fbcc-49b7-b4be-9ec20a63b087 service nova] [instance: 509263cd-9995-4e6b-8b26-461b7eb05ded] Received event network-changed-567c70fb-fa55-4e78-88aa-ab91baf69fed {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:03:37 user nova-compute[73449]: DEBUG nova.compute.manager [req-77fb4fcb-146e-4c6c-8429-c5be7ecaaa87 req-6ef0e6f6-fbcc-49b7-b4be-9ec20a63b087 service nova] [instance: 509263cd-9995-4e6b-8b26-461b7eb05ded] Refreshing instance network info cache due to event network-changed-567c70fb-fa55-4e78-88aa-ab91baf69fed. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 12:03:37 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-77fb4fcb-146e-4c6c-8429-c5be7ecaaa87 req-6ef0e6f6-fbcc-49b7-b4be-9ec20a63b087 service nova] Acquiring lock "refresh_cache-509263cd-9995-4e6b-8b26-461b7eb05ded" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 12:03:37 user nova-compute[73449]: DEBUG nova.network.neutron [None req-d8d6fa50-0931-48f3-aa98-7f5400a20cc9 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] [instance: 509263cd-9995-4e6b-8b26-461b7eb05ded] Instance cache missing network info. {{(pid=73449) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 12:03:37 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692273817.5066512, 61201d5c-26f1-4c6d-a764-be2ee2e533ae => Resumed> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 12:03:37 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] VM Resumed (Lifecycle Event)
Aug 17 12:03:37 user nova-compute[73449]: DEBUG nova.compute.manager [None req-d72ec4cf-3ada-49eb-b9cf-cc013d848659 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Instance event wait completed in 0 seconds for  {{(pid=73449) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 12:03:37 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-d72ec4cf-3ada-49eb-b9cf-cc013d848659 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Guest created on hypervisor {{(pid=73449) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 12:03:37 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Instance spawned successfully.
Aug 17 12:03:37 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-d72ec4cf-3ada-49eb-b9cf-cc013d848659 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 12:03:37 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 12:03:37 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 12:03:37 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-d72ec4cf-3ada-49eb-b9cf-cc013d848659 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Found default for hw_cdrom_bus of ide {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 12:03:37 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-d72ec4cf-3ada-49eb-b9cf-cc013d848659 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Found default for hw_disk_bus of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 12:03:37 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-d72ec4cf-3ada-49eb-b9cf-cc013d848659 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Found default for hw_input_bus of None {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 12:03:37 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-d72ec4cf-3ada-49eb-b9cf-cc013d848659 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Found default for hw_pointer_model of None {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 12:03:37 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-d72ec4cf-3ada-49eb-b9cf-cc013d848659 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Found default for hw_video_model of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 12:03:37 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-d72ec4cf-3ada-49eb-b9cf-cc013d848659 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Found default for hw_vif_model of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 12:03:37 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 12:03:37 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692273817.5088902, 61201d5c-26f1-4c6d-a764-be2ee2e533ae => Started> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 12:03:37 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] VM Started (Lifecycle Event)
Aug 17 12:03:37 user nova-compute[73449]: DEBUG nova.compute.manager [req-4a7dab11-458b-46b0-ba58-ee3a8a9ec1ec req-1eaf08eb-d666-4fc3-bceb-fd57c4659d42 service nova] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Received event network-vif-plugged-f9f6066e-ddd2-4e41-b92a-5713cfb9a223 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:03:37 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-4a7dab11-458b-46b0-ba58-ee3a8a9ec1ec req-1eaf08eb-d666-4fc3-bceb-fd57c4659d42 service nova] Acquiring lock "61201d5c-26f1-4c6d-a764-be2ee2e533ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:03:37 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-4a7dab11-458b-46b0-ba58-ee3a8a9ec1ec req-1eaf08eb-d666-4fc3-bceb-fd57c4659d42 service nova] Lock "61201d5c-26f1-4c6d-a764-be2ee2e533ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:03:37 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-4a7dab11-458b-46b0-ba58-ee3a8a9ec1ec req-1eaf08eb-d666-4fc3-bceb-fd57c4659d42 service nova] Lock "61201d5c-26f1-4c6d-a764-be2ee2e533ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:03:37 user nova-compute[73449]: DEBUG nova.compute.manager [req-4a7dab11-458b-46b0-ba58-ee3a8a9ec1ec req-1eaf08eb-d666-4fc3-bceb-fd57c4659d42 service nova] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] No waiting events found dispatching network-vif-plugged-f9f6066e-ddd2-4e41-b92a-5713cfb9a223 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 12:03:37 user nova-compute[73449]: WARNING nova.compute.manager [req-4a7dab11-458b-46b0-ba58-ee3a8a9ec1ec req-1eaf08eb-d666-4fc3-bceb-fd57c4659d42 service nova] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Received unexpected event network-vif-plugged-f9f6066e-ddd2-4e41-b92a-5713cfb9a223 for instance with vm_state building and task_state spawning.
Aug 17 12:03:37 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 12:03:37 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 12:03:37 user nova-compute[73449]: INFO nova.compute.manager [None req-d72ec4cf-3ada-49eb-b9cf-cc013d848659 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Took 6.48 seconds to spawn the instance on the hypervisor.
Aug 17 12:03:37 user nova-compute[73449]: DEBUG nova.compute.manager [None req-d72ec4cf-3ada-49eb-b9cf-cc013d848659 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 12:03:37 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 12:03:37 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:03:37 user nova-compute[73449]: INFO nova.compute.manager [None req-d72ec4cf-3ada-49eb-b9cf-cc013d848659 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Took 7.19 seconds to build instance.
Aug 17 12:03:37 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-d72ec4cf-3ada-49eb-b9cf-cc013d848659 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Lock "61201d5c-26f1-4c6d-a764-be2ee2e533ae" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.294s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:03:37 user nova-compute[73449]: DEBUG nova.network.neutron [None req-d8d6fa50-0931-48f3-aa98-7f5400a20cc9 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] [instance: 509263cd-9995-4e6b-8b26-461b7eb05ded] Updating instance_info_cache with network_info: [{"id": "567c70fb-fa55-4e78-88aa-ab91baf69fed", "address": "fa:16:3e:00:89:5f", "network": {"id": "b7788333-c3b8-48e1-9255-5cb74bd3a3be", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-892160259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5ffc03751894a96bebd953bd9fa20ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap567c70fb-fa", "ovs_interfaceid": "567c70fb-fa55-4e78-88aa-ab91baf69fed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 12:03:37 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-d8d6fa50-0931-48f3-aa98-7f5400a20cc9 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] Releasing lock "refresh_cache-509263cd-9995-4e6b-8b26-461b7eb05ded" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 12:03:37 user nova-compute[73449]: DEBUG nova.compute.manager [None req-d8d6fa50-0931-48f3-aa98-7f5400a20cc9 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] [instance: 509263cd-9995-4e6b-8b26-461b7eb05ded] Instance network_info: |[{"id": "567c70fb-fa55-4e78-88aa-ab91baf69fed", "address": "fa:16:3e:00:89:5f", "network": {"id": "b7788333-c3b8-48e1-9255-5cb74bd3a3be", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-892160259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5ffc03751894a96bebd953bd9fa20ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap567c70fb-fa", "ovs_interfaceid": "567c70fb-fa55-4e78-88aa-ab91baf69fed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73449) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 12:03:37 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-77fb4fcb-146e-4c6c-8429-c5be7ecaaa87 req-6ef0e6f6-fbcc-49b7-b4be-9ec20a63b087 service nova] Acquired lock "refresh_cache-509263cd-9995-4e6b-8b26-461b7eb05ded" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 12:03:37 user nova-compute[73449]: DEBUG nova.network.neutron [req-77fb4fcb-146e-4c6c-8429-c5be7ecaaa87 req-6ef0e6f6-fbcc-49b7-b4be-9ec20a63b087 service nova] [instance: 509263cd-9995-4e6b-8b26-461b7eb05ded] Refreshing network info cache for port 567c70fb-fa55-4e78-88aa-ab91baf69fed {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 12:03:37 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-d8d6fa50-0931-48f3-aa98-7f5400a20cc9 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] [instance: 509263cd-9995-4e6b-8b26-461b7eb05ded] Start _get_guest_xml network_info=[{"id": "567c70fb-fa55-4e78-88aa-ab91baf69fed", "address": "fa:16:3e:00:89:5f", "network": {"id": "b7788333-c3b8-48e1-9255-5cb74bd3a3be", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-892160259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5ffc03751894a96bebd953bd9fa20ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap567c70fb-fa", "ovs_interfaceid": "567c70fb-fa55-4e78-88aa-ab91baf69fed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T11:36:11Z,direct_url=<?>,disk_format='qcow2',id=0a2904ae-083d-41c8-83db-343132b36148,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7a77880136a54ef195c82e018e1939db',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T11:36:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': '0a2904ae-083d-41c8-83db-343132b36148'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 12:03:37 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-d8d6fa50-0931-48f3-aa98-7f5400a20cc9 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 12:03:37 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-d8d6fa50-0931-48f3-aa98-7f5400a20cc9 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 12:03:37 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-d8d6fa50-0931-48f3-aa98-7f5400a20cc9 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 12:03:37 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-d8d6fa50-0931-48f3-aa98-7f5400a20cc9 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] CPU controller missing on host. {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 12:03:37 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-d8d6fa50-0931-48f3-aa98-7f5400a20cc9 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 12:03:37 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-d8d6fa50-0931-48f3-aa98-7f5400a20cc9 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] CPU controller found on host. {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 12:03:37 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-d8d6fa50-0931-48f3-aa98-7f5400a20cc9 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73449) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 12:03:37 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-d8d6fa50-0931-48f3-aa98-7f5400a20cc9 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T11:35:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T11:36:11Z,direct_url=<?>,disk_format='qcow2',id=0a2904ae-083d-41c8-83db-343132b36148,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7a77880136a54ef195c82e018e1939db',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T11:36:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 12:03:37 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-d8d6fa50-0931-48f3-aa98-7f5400a20cc9 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] Flavor limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 12:03:37 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-d8d6fa50-0931-48f3-aa98-7f5400a20cc9 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] Image limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 12:03:37 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-d8d6fa50-0931-48f3-aa98-7f5400a20cc9 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] Flavor pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 12:03:37 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-d8d6fa50-0931-48f3-aa98-7f5400a20cc9 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] Image pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 12:03:37 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-d8d6fa50-0931-48f3-aa98-7f5400a20cc9 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 12:03:37 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-d8d6fa50-0931-48f3-aa98-7f5400a20cc9 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 12:03:37 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-d8d6fa50-0931-48f3-aa98-7f5400a20cc9 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 12:03:37 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-d8d6fa50-0931-48f3-aa98-7f5400a20cc9 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] Got 1 possible topologies {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 12:03:37 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-d8d6fa50-0931-48f3-aa98-7f5400a20cc9 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 12:03:37 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-d8d6fa50-0931-48f3-aa98-7f5400a20cc9 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 12:03:37 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-d8d6fa50-0931-48f3-aa98-7f5400a20cc9 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T12:03:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-2102881955',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-2102881955',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-2102881',id=46,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAxNy6TuQ4l4xcRJjv217M4vcij42l2+NK6bGelYfQBa/t9TQGdwURrbD/kB0UJl7Kino+UpKCFjUX+npEjkdGIj/4N0kg195tXF2jT5P0BNvAM6l6ytNd3T+yCJhAk1NA==',key_name='tempest-keypair-43556598',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f5ffc03751894a96bebd953bd9fa20ed',ramdisk_id='',reservation_id='r-uaydfwkd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-2044874997',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T12:03:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c997b7493d6048b083443ca215352322',uuid=509263cd-9995-4e6b-8b26-461b7eb05ded,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "567c70fb-fa55-4e78-88aa-ab91baf69fed", "address": "fa:16:3e:00:89:5f", "network": {"id": "b7788333-c3b8-48e1-9255-5cb74bd3a3be", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-892160259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5ffc03751894a96bebd953bd9fa20ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap567c70fb-fa", "ovs_interfaceid": "567c70fb-fa55-4e78-88aa-ab91baf69fed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73449) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 12:03:37 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-d8d6fa50-0931-48f3-aa98-7f5400a20cc9 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] Converting VIF {"id": "567c70fb-fa55-4e78-88aa-ab91baf69fed", "address": "fa:16:3e:00:89:5f", "network": {"id": "b7788333-c3b8-48e1-9255-5cb74bd3a3be", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-892160259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5ffc03751894a96bebd953bd9fa20ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap567c70fb-fa", "ovs_interfaceid": "567c70fb-fa55-4e78-88aa-ab91baf69fed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 12:03:37 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-d8d6fa50-0931-48f3-aa98-7f5400a20cc9 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:89:5f,bridge_name='br-int',has_traffic_filtering=True,id=567c70fb-fa55-4e78-88aa-ab91baf69fed,network=Network(b7788333-c3b8-48e1-9255-5cb74bd3a3be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap567c70fb-fa') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 12:03:37 user nova-compute[73449]: DEBUG nova.objects.instance [None req-d8d6fa50-0931-48f3-aa98-7f5400a20cc9 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] Lazy-loading 'pci_devices' on Instance uuid 509263cd-9995-4e6b-8b26-461b7eb05ded {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:03:37 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-d8d6fa50-0931-48f3-aa98-7f5400a20cc9 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] [instance: 509263cd-9995-4e6b-8b26-461b7eb05ded] End _get_guest_xml xml=<domain type="kvm">
Aug 17 12:03:37 user nova-compute[73449]:   <uuid>509263cd-9995-4e6b-8b26-461b7eb05ded</uuid>
Aug 17 12:03:37 user nova-compute[73449]:   <name>instance-0000002e</name>
Aug 17 12:03:37 user nova-compute[73449]:   <memory>524288</memory>
Aug 17 12:03:37 user nova-compute[73449]:   <vcpu>1</vcpu>
Aug 17 12:03:37 user nova-compute[73449]:   <metadata>
Aug 17 12:03:37 user nova-compute[73449]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 12:03:37 user nova-compute[73449]:       <nova:package version="0.0.0"/>
Aug 17 12:03:37 user nova-compute[73449]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-2102881955</nova:name>
Aug 17 12:03:37 user nova-compute[73449]:       <nova:creationTime>2023-08-17 12:03:37</nova:creationTime>
Aug 17 12:03:37 user nova-compute[73449]:       <nova:flavor name="m1.tiny">
Aug 17 12:03:37 user nova-compute[73449]:         <nova:memory>512</nova:memory>
Aug 17 12:03:37 user nova-compute[73449]:         <nova:disk>1</nova:disk>
Aug 17 12:03:37 user nova-compute[73449]:         <nova:swap>0</nova:swap>
Aug 17 12:03:37 user nova-compute[73449]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 12:03:37 user nova-compute[73449]:         <nova:vcpus>1</nova:vcpus>
Aug 17 12:03:37 user nova-compute[73449]:       </nova:flavor>
Aug 17 12:03:37 user nova-compute[73449]:       <nova:owner>
Aug 17 12:03:37 user nova-compute[73449]:         <nova:user uuid="c997b7493d6048b083443ca215352322">tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member</nova:user>
Aug 17 12:03:37 user nova-compute[73449]:         <nova:project uuid="f5ffc03751894a96bebd953bd9fa20ed">tempest-TestServerVolumeAttachScenarioOldVersion-2044874997</nova:project>
Aug 17 12:03:37 user nova-compute[73449]:       </nova:owner>
Aug 17 12:03:37 user nova-compute[73449]:       <nova:root type="image" uuid="0a2904ae-083d-41c8-83db-343132b36148"/>
Aug 17 12:03:37 user nova-compute[73449]:       <nova:ports>
Aug 17 12:03:37 user nova-compute[73449]:         <nova:port uuid="567c70fb-fa55-4e78-88aa-ab91baf69fed">
Aug 17 12:03:37 user nova-compute[73449]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 17 12:03:37 user nova-compute[73449]:         </nova:port>
Aug 17 12:03:37 user nova-compute[73449]:       </nova:ports>
Aug 17 12:03:37 user nova-compute[73449]:     </nova:instance>
Aug 17 12:03:37 user nova-compute[73449]:   </metadata>
Aug 17 12:03:37 user nova-compute[73449]:   <sysinfo type="smbios">
Aug 17 12:03:37 user nova-compute[73449]:     <system>
Aug 17 12:03:37 user nova-compute[73449]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 12:03:37 user nova-compute[73449]:       <entry name="product">OpenStack Nova</entry>
Aug 17 12:03:37 user nova-compute[73449]:       <entry name="version">0.0.0</entry>
Aug 17 12:03:37 user nova-compute[73449]:       <entry name="serial">509263cd-9995-4e6b-8b26-461b7eb05ded</entry>
Aug 17 12:03:37 user nova-compute[73449]:       <entry name="uuid">509263cd-9995-4e6b-8b26-461b7eb05ded</entry>
Aug 17 12:03:37 user nova-compute[73449]:       <entry name="family">Virtual Machine</entry>
Aug 17 12:03:37 user nova-compute[73449]:     </system>
Aug 17 12:03:37 user nova-compute[73449]:   </sysinfo>
Aug 17 12:03:37 user nova-compute[73449]:   <os>
Aug 17 12:03:37 user nova-compute[73449]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 12:03:37 user nova-compute[73449]:     <boot dev="hd"/>
Aug 17 12:03:37 user nova-compute[73449]:     <smbios mode="sysinfo"/>
Aug 17 12:03:37 user nova-compute[73449]:   </os>
Aug 17 12:03:37 user nova-compute[73449]:   <features>
Aug 17 12:03:37 user nova-compute[73449]:     <acpi/>
Aug 17 12:03:37 user nova-compute[73449]:     <apic/>
Aug 17 12:03:37 user nova-compute[73449]:     <vmcoreinfo/>
Aug 17 12:03:37 user nova-compute[73449]:   </features>
Aug 17 12:03:37 user nova-compute[73449]:   <clock offset="utc">
Aug 17 12:03:37 user nova-compute[73449]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 12:03:37 user nova-compute[73449]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 12:03:37 user nova-compute[73449]:     <timer name="hpet" present="no"/>
Aug 17 12:03:37 user nova-compute[73449]:   </clock>
Aug 17 12:03:37 user nova-compute[73449]:   <cpu mode="custom" match="exact">
Aug 17 12:03:37 user nova-compute[73449]:     <model>Nehalem</model>
Aug 17 12:03:37 user nova-compute[73449]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 12:03:37 user nova-compute[73449]:   </cpu>
Aug 17 12:03:37 user nova-compute[73449]:   <devices>
Aug 17 12:03:37 user nova-compute[73449]:     <disk type="file" device="disk">
Aug 17 12:03:37 user nova-compute[73449]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 12:03:37 user nova-compute[73449]:       <source file="/opt/stack/data/nova/instances/509263cd-9995-4e6b-8b26-461b7eb05ded/disk"/>
Aug 17 12:03:37 user nova-compute[73449]:       <target dev="vda" bus="virtio"/>
Aug 17 12:03:37 user nova-compute[73449]:     </disk>
Aug 17 12:03:37 user nova-compute[73449]:     <interface type="ethernet">
Aug 17 12:03:37 user nova-compute[73449]:       <mac address="fa:16:3e:00:89:5f"/>
Aug 17 12:03:37 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 12:03:37 user nova-compute[73449]:       <mtu size="1442"/>
Aug 17 12:03:37 user nova-compute[73449]:       <target dev="tap567c70fb-fa"/>
Aug 17 12:03:37 user nova-compute[73449]:     </interface>
Aug 17 12:03:37 user nova-compute[73449]:     <serial type="pty">
Aug 17 12:03:37 user nova-compute[73449]:       <log file="/opt/stack/data/nova/instances/509263cd-9995-4e6b-8b26-461b7eb05ded/console.log" append="off"/>
Aug 17 12:03:37 user nova-compute[73449]:     </serial>
Aug 17 12:03:37 user nova-compute[73449]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 12:03:37 user nova-compute[73449]:     <video>
Aug 17 12:03:37 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 12:03:37 user nova-compute[73449]:     </video>
Aug 17 12:03:37 user nova-compute[73449]:     <rng model="virtio">
Aug 17 12:03:37 user nova-compute[73449]:       <backend model="random">/dev/urandom</backend>
Aug 17 12:03:37 user nova-compute[73449]:     </rng>
Aug 17 12:03:37 user nova-compute[73449]:     <controller type="usb" index="0" model="none"/>
Aug 17 12:03:37 user nova-compute[73449]:     <memballoon model="virtio">
Aug 17 12:03:37 user nova-compute[73449]:       <stats period="10"/>
Aug 17 12:03:37 user nova-compute[73449]:     </memballoon>
Aug 17 12:03:37 user nova-compute[73449]:   </devices>
Aug 17 12:03:37 user nova-compute[73449]: </domain>
Aug 17 12:03:37 user nova-compute[73449]:  {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 12:03:37 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-d8d6fa50-0931-48f3-aa98-7f5400a20cc9 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T12:03:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-2102881955',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-2102881955',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-2102881',id=46,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAxNy6TuQ4l4xcRJjv217M4vcij42l2+NK6bGelYfQBa/t9TQGdwURrbD/kB0UJl7Kino+UpKCFjUX+npEjkdGIj/4N0kg195tXF2jT5P0BNvAM6l6ytNd3T+yCJhAk1NA==',key_name='tempest-keypair-43556598',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f5ffc03751894a96bebd953bd9fa20ed',ramdisk_id='',reservation_id='r-uaydfwkd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-2044874997',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T12:03:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c997b7493d6048b083443ca215352322',uuid=509263cd-9995-4e6b-8b26-461b7eb05ded,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "567c70fb-fa55-4e78-88aa-ab91baf69fed", "address": "fa:16:3e:00:89:5f", "network": {"id": "b7788333-c3b8-48e1-9255-5cb74bd3a3be", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-892160259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5ffc03751894a96bebd953bd9fa20ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap567c70fb-fa", "ovs_interfaceid": "567c70fb-fa55-4e78-88aa-ab91baf69fed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 12:03:37 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-d8d6fa50-0931-48f3-aa98-7f5400a20cc9 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] Converting VIF {"id": "567c70fb-fa55-4e78-88aa-ab91baf69fed", "address": "fa:16:3e:00:89:5f", "network": {"id": "b7788333-c3b8-48e1-9255-5cb74bd3a3be", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-892160259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5ffc03751894a96bebd953bd9fa20ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap567c70fb-fa", "ovs_interfaceid": "567c70fb-fa55-4e78-88aa-ab91baf69fed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 12:03:37 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-d8d6fa50-0931-48f3-aa98-7f5400a20cc9 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:89:5f,bridge_name='br-int',has_traffic_filtering=True,id=567c70fb-fa55-4e78-88aa-ab91baf69fed,network=Network(b7788333-c3b8-48e1-9255-5cb74bd3a3be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap567c70fb-fa') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 12:03:37 user nova-compute[73449]: DEBUG os_vif [None req-d8d6fa50-0931-48f3-aa98-7f5400a20cc9 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:89:5f,bridge_name='br-int',has_traffic_filtering=True,id=567c70fb-fa55-4e78-88aa-ab91baf69fed,network=Network(b7788333-c3b8-48e1-9255-5cb74bd3a3be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap567c70fb-fa') {{(pid=73449) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 12:03:37 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:03:37 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 12:03:37 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 12:03:37 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:03:37 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap567c70fb-fa, may_exist=True, interface_attrs={}) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 12:03:37 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap567c70fb-fa, col_values=(('external_ids', {'iface-id': '567c70fb-fa55-4e78-88aa-ab91baf69fed', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:00:89:5f', 'vm-uuid': '509263cd-9995-4e6b-8b26-461b7eb05ded'}),), if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 12:03:37 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:03:37 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:03:37 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:03:37 user nova-compute[73449]: INFO os_vif [None req-d8d6fa50-0931-48f3-aa98-7f5400a20cc9 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:89:5f,bridge_name='br-int',has_traffic_filtering=True,id=567c70fb-fa55-4e78-88aa-ab91baf69fed,network=Network(b7788333-c3b8-48e1-9255-5cb74bd3a3be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap567c70fb-fa')
Aug 17 12:03:37 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-d8d6fa50-0931-48f3-aa98-7f5400a20cc9 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] No BDM found with device name vda, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 12:03:37 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-d8d6fa50-0931-48f3-aa98-7f5400a20cc9 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] No VIF found with MAC fa:16:3e:00:89:5f, not building metadata {{(pid=73449) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 12:03:38 user nova-compute[73449]: DEBUG nova.network.neutron [req-77fb4fcb-146e-4c6c-8429-c5be7ecaaa87 req-6ef0e6f6-fbcc-49b7-b4be-9ec20a63b087 service nova] [instance: 509263cd-9995-4e6b-8b26-461b7eb05ded] Updated VIF entry in instance network info cache for port 567c70fb-fa55-4e78-88aa-ab91baf69fed. {{(pid=73449) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 12:03:38 user nova-compute[73449]: DEBUG nova.network.neutron [req-77fb4fcb-146e-4c6c-8429-c5be7ecaaa87 req-6ef0e6f6-fbcc-49b7-b4be-9ec20a63b087 service nova] [instance: 509263cd-9995-4e6b-8b26-461b7eb05ded] Updating instance_info_cache with network_info: [{"id": "567c70fb-fa55-4e78-88aa-ab91baf69fed", "address": "fa:16:3e:00:89:5f", "network": {"id": "b7788333-c3b8-48e1-9255-5cb74bd3a3be", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-892160259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5ffc03751894a96bebd953bd9fa20ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap567c70fb-fa", "ovs_interfaceid": "567c70fb-fa55-4e78-88aa-ab91baf69fed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 12:03:38 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-77fb4fcb-146e-4c6c-8429-c5be7ecaaa87 req-6ef0e6f6-fbcc-49b7-b4be-9ec20a63b087 service nova] Releasing lock "refresh_cache-509263cd-9995-4e6b-8b26-461b7eb05ded" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 12:03:38 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:03:39 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:03:39 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:03:39 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:03:39 user nova-compute[73449]: DEBUG nova.compute.manager [req-a9cff312-5fca-4873-9e85-1a8762f5fadc req-3216ceb4-b319-4130-a638-58bc3bda3bd0 service nova] [instance: 509263cd-9995-4e6b-8b26-461b7eb05ded] Received event network-vif-plugged-567c70fb-fa55-4e78-88aa-ab91baf69fed {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:03:39 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-a9cff312-5fca-4873-9e85-1a8762f5fadc req-3216ceb4-b319-4130-a638-58bc3bda3bd0 service nova] Acquiring lock "509263cd-9995-4e6b-8b26-461b7eb05ded-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:03:39 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-a9cff312-5fca-4873-9e85-1a8762f5fadc req-3216ceb4-b319-4130-a638-58bc3bda3bd0 service nova] Lock "509263cd-9995-4e6b-8b26-461b7eb05ded-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:03:39 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-a9cff312-5fca-4873-9e85-1a8762f5fadc req-3216ceb4-b319-4130-a638-58bc3bda3bd0 service nova] Lock "509263cd-9995-4e6b-8b26-461b7eb05ded-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:03:39 user nova-compute[73449]: DEBUG nova.compute.manager [req-a9cff312-5fca-4873-9e85-1a8762f5fadc req-3216ceb4-b319-4130-a638-58bc3bda3bd0 service nova] [instance: 509263cd-9995-4e6b-8b26-461b7eb05ded] No waiting events found dispatching network-vif-plugged-567c70fb-fa55-4e78-88aa-ab91baf69fed {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 12:03:39 user nova-compute[73449]: WARNING nova.compute.manager [req-a9cff312-5fca-4873-9e85-1a8762f5fadc req-3216ceb4-b319-4130-a638-58bc3bda3bd0 service nova] [instance: 509263cd-9995-4e6b-8b26-461b7eb05ded] Received unexpected event network-vif-plugged-567c70fb-fa55-4e78-88aa-ab91baf69fed for instance with vm_state building and task_state spawning.
Aug 17 12:03:39 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:03:39 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:03:39 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:03:41 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692273821.5644448, 509263cd-9995-4e6b-8b26-461b7eb05ded => Resumed> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 12:03:41 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 509263cd-9995-4e6b-8b26-461b7eb05ded] VM Resumed (Lifecycle Event)
Aug 17 12:03:41 user nova-compute[73449]: DEBUG nova.compute.manager [None req-d8d6fa50-0931-48f3-aa98-7f5400a20cc9 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] [instance: 509263cd-9995-4e6b-8b26-461b7eb05ded] Instance event wait completed in 0 seconds for  {{(pid=73449) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 12:03:41 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-d8d6fa50-0931-48f3-aa98-7f5400a20cc9 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] [instance: 509263cd-9995-4e6b-8b26-461b7eb05ded] Guest created on hypervisor {{(pid=73449) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 12:03:41 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: 509263cd-9995-4e6b-8b26-461b7eb05ded] Instance spawned successfully.
Aug 17 12:03:41 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-d8d6fa50-0931-48f3-aa98-7f5400a20cc9 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] [instance: 509263cd-9995-4e6b-8b26-461b7eb05ded] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 12:03:41 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 509263cd-9995-4e6b-8b26-461b7eb05ded] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 12:03:41 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 509263cd-9995-4e6b-8b26-461b7eb05ded] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 12:03:41 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-d8d6fa50-0931-48f3-aa98-7f5400a20cc9 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] [instance: 509263cd-9995-4e6b-8b26-461b7eb05ded] Found default for hw_cdrom_bus of ide {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 12:03:41 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-d8d6fa50-0931-48f3-aa98-7f5400a20cc9 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] [instance: 509263cd-9995-4e6b-8b26-461b7eb05ded] Found default for hw_disk_bus of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 12:03:41 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-d8d6fa50-0931-48f3-aa98-7f5400a20cc9 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] [instance: 509263cd-9995-4e6b-8b26-461b7eb05ded] Found default for hw_input_bus of None {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 12:03:41 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-d8d6fa50-0931-48f3-aa98-7f5400a20cc9 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] [instance: 509263cd-9995-4e6b-8b26-461b7eb05ded] Found default for hw_pointer_model of None {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 12:03:41 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-d8d6fa50-0931-48f3-aa98-7f5400a20cc9 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] [instance: 509263cd-9995-4e6b-8b26-461b7eb05ded] Found default for hw_video_model of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 12:03:41 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-d8d6fa50-0931-48f3-aa98-7f5400a20cc9 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] [instance: 509263cd-9995-4e6b-8b26-461b7eb05ded] Found default for hw_vif_model of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 12:03:41 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 509263cd-9995-4e6b-8b26-461b7eb05ded] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 12:03:41 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692273821.568133, 509263cd-9995-4e6b-8b26-461b7eb05ded => Started> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 12:03:41 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 509263cd-9995-4e6b-8b26-461b7eb05ded] VM Started (Lifecycle Event)
Aug 17 12:03:41 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 509263cd-9995-4e6b-8b26-461b7eb05ded] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 12:03:41 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 509263cd-9995-4e6b-8b26-461b7eb05ded] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 12:03:41 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 509263cd-9995-4e6b-8b26-461b7eb05ded] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 12:03:41 user nova-compute[73449]: DEBUG nova.compute.manager [req-0d2856e9-b693-4fce-adca-a6e0dc6033f3 req-d2275846-7803-4479-af3b-5b80f921e068 service nova] [instance: 509263cd-9995-4e6b-8b26-461b7eb05ded] Received event network-vif-plugged-567c70fb-fa55-4e78-88aa-ab91baf69fed {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:03:41 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-0d2856e9-b693-4fce-adca-a6e0dc6033f3 req-d2275846-7803-4479-af3b-5b80f921e068 service nova] Acquiring lock "509263cd-9995-4e6b-8b26-461b7eb05ded-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:03:41 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-0d2856e9-b693-4fce-adca-a6e0dc6033f3 req-d2275846-7803-4479-af3b-5b80f921e068 service nova] Lock "509263cd-9995-4e6b-8b26-461b7eb05ded-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:03:41 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-0d2856e9-b693-4fce-adca-a6e0dc6033f3 req-d2275846-7803-4479-af3b-5b80f921e068 service nova] Lock "509263cd-9995-4e6b-8b26-461b7eb05ded-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:03:41 user nova-compute[73449]: DEBUG nova.compute.manager [req-0d2856e9-b693-4fce-adca-a6e0dc6033f3 req-d2275846-7803-4479-af3b-5b80f921e068 service nova] [instance: 509263cd-9995-4e6b-8b26-461b7eb05ded] No waiting events found dispatching network-vif-plugged-567c70fb-fa55-4e78-88aa-ab91baf69fed {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 12:03:41 user nova-compute[73449]: WARNING nova.compute.manager [req-0d2856e9-b693-4fce-adca-a6e0dc6033f3 req-d2275846-7803-4479-af3b-5b80f921e068 service nova] [instance: 509263cd-9995-4e6b-8b26-461b7eb05ded] Received unexpected event network-vif-plugged-567c70fb-fa55-4e78-88aa-ab91baf69fed for instance with vm_state building and task_state spawning.
Aug 17 12:03:41 user nova-compute[73449]: INFO nova.compute.manager [None req-d8d6fa50-0931-48f3-aa98-7f5400a20cc9 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] [instance: 509263cd-9995-4e6b-8b26-461b7eb05ded] Took 6.55 seconds to spawn the instance on the hypervisor.
Aug 17 12:03:41 user nova-compute[73449]: DEBUG nova.compute.manager [None req-d8d6fa50-0931-48f3-aa98-7f5400a20cc9 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] [instance: 509263cd-9995-4e6b-8b26-461b7eb05ded] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 12:03:41 user nova-compute[73449]: INFO nova.compute.manager [None req-d8d6fa50-0931-48f3-aa98-7f5400a20cc9 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] [instance: 509263cd-9995-4e6b-8b26-461b7eb05ded] Took 7.30 seconds to build instance.
Aug 17 12:03:41 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-d8d6fa50-0931-48f3-aa98-7f5400a20cc9 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] Lock "509263cd-9995-4e6b-8b26-461b7eb05ded" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.448s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:03:42 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:03:43 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:03:44 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:03:46 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:03:47 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:03:48 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:03:50 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:03:52 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:03:53 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:03:53 user nova-compute[73449]: INFO nova.compute.manager [None req-bdcbe8be-46eb-4e50-8182-adbb9e049dbc tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] Rescuing
Aug 17 12:03:53 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-bdcbe8be-46eb-4e50-8182-adbb9e049dbc tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Acquiring lock "refresh_cache-5a627da9-03a1-4239-8721-cefe99c39ee2" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 12:03:53 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-bdcbe8be-46eb-4e50-8182-adbb9e049dbc tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Acquired lock "refresh_cache-5a627da9-03a1-4239-8721-cefe99c39ee2" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 12:03:53 user nova-compute[73449]: DEBUG nova.network.neutron [None req-bdcbe8be-46eb-4e50-8182-adbb9e049dbc tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] Building network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 12:03:53 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:03:53 user nova-compute[73449]: DEBUG nova.network.neutron [None req-bdcbe8be-46eb-4e50-8182-adbb9e049dbc tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] Updating instance_info_cache with network_info: [{"id": "69831639-3628-4b42-8ddd-fe0965dea4b6", "address": "fa:16:3e:de:22:d6", "network": {"id": "9455bb75-f75a-41ff-8f6f-49f55aa738f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-425274599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec3b0b72e47448ebe99f9fc64119c1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69831639-36", "ovs_interfaceid": "69831639-3628-4b42-8ddd-fe0965dea4b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 12:03:53 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-bdcbe8be-46eb-4e50-8182-adbb9e049dbc tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Releasing lock "refresh_cache-5a627da9-03a1-4239-8721-cefe99c39ee2" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 12:03:54 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:03:54 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:03:54 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:03:54 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:03:54 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] Instance destroyed successfully.
Aug 17 12:03:54 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-bdcbe8be-46eb-4e50-8182-adbb9e049dbc tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] Attempting a stable device rescue
Aug 17 12:03:54 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-bdcbe8be-46eb-4e50-8182-adbb9e049dbc tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73449) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 17 12:03:54 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-bdcbe8be-46eb-4e50-8182-adbb9e049dbc tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] Instance directory exists: not creating {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 17 12:03:54 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-bdcbe8be-46eb-4e50-8182-adbb9e049dbc tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] Creating image(s)
Aug 17 12:03:54 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-bdcbe8be-46eb-4e50-8182-adbb9e049dbc tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Acquiring lock "/opt/stack/data/nova/instances/5a627da9-03a1-4239-8721-cefe99c39ee2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:03:54 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-bdcbe8be-46eb-4e50-8182-adbb9e049dbc tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Lock "/opt/stack/data/nova/instances/5a627da9-03a1-4239-8721-cefe99c39ee2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:03:54 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-bdcbe8be-46eb-4e50-8182-adbb9e049dbc tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Lock "/opt/stack/data/nova/instances/5a627da9-03a1-4239-8721-cefe99c39ee2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:03:54 user nova-compute[73449]: DEBUG nova.objects.instance [None req-bdcbe8be-46eb-4e50-8182-adbb9e049dbc tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Lazy-loading 'trusted_certs' on Instance uuid 5a627da9-03a1-4239-8721-cefe99c39ee2 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:03:54 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-bdcbe8be-46eb-4e50-8182-adbb9e049dbc tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Acquiring lock "2e7d42016eb851c6e49a3a917207d6a39f84a462" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:03:54 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-bdcbe8be-46eb-4e50-8182-adbb9e049dbc tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Lock "2e7d42016eb851c6e49a3a917207d6a39f84a462" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:03:55 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-bdcbe8be-46eb-4e50-8182-adbb9e049dbc tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e7d42016eb851c6e49a3a917207d6a39f84a462.part --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:03:56 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-bdcbe8be-46eb-4e50-8182-adbb9e049dbc tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e7d42016eb851c6e49a3a917207d6a39f84a462.part --force-share --output=json" returned: 0 in 0.202s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:03:56 user nova-compute[73449]: DEBUG nova.virt.images [None req-bdcbe8be-46eb-4e50-8182-adbb9e049dbc tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] b774960e-54b1-4e4a-90bd-429ff45d4039 was qcow2, converting to raw {{(pid=73449) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 17 12:03:56 user nova-compute[73449]: DEBUG nova.privsep.utils [None req-bdcbe8be-46eb-4e50-8182-adbb9e049dbc tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73449) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 12:03:56 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-bdcbe8be-46eb-4e50-8182-adbb9e049dbc tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2e7d42016eb851c6e49a3a917207d6a39f84a462.part /opt/stack/data/nova/instances/_base/2e7d42016eb851c6e49a3a917207d6a39f84a462.converted {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:03:56 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-bdcbe8be-46eb-4e50-8182-adbb9e049dbc tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2e7d42016eb851c6e49a3a917207d6a39f84a462.part /opt/stack/data/nova/instances/_base/2e7d42016eb851c6e49a3a917207d6a39f84a462.converted" returned: 0 in 0.437s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:03:56 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-bdcbe8be-46eb-4e50-8182-adbb9e049dbc tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e7d42016eb851c6e49a3a917207d6a39f84a462.converted --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:03:56 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-bdcbe8be-46eb-4e50-8182-adbb9e049dbc tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e7d42016eb851c6e49a3a917207d6a39f84a462.converted --force-share --output=json" returned: 0 in 0.191s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:03:56 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-bdcbe8be-46eb-4e50-8182-adbb9e049dbc tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Lock "2e7d42016eb851c6e49a3a917207d6a39f84a462" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.040s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:03:56 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-bdcbe8be-46eb-4e50-8182-adbb9e049dbc tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Acquiring lock "2e7d42016eb851c6e49a3a917207d6a39f84a462" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:03:56 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-bdcbe8be-46eb-4e50-8182-adbb9e049dbc tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Lock "2e7d42016eb851c6e49a3a917207d6a39f84a462" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:03:56 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-bdcbe8be-46eb-4e50-8182-adbb9e049dbc tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e7d42016eb851c6e49a3a917207d6a39f84a462 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:03:57 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-bdcbe8be-46eb-4e50-8182-adbb9e049dbc tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e7d42016eb851c6e49a3a917207d6a39f84a462 --force-share --output=json" returned: 0 in 0.174s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:03:57 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-bdcbe8be-46eb-4e50-8182-adbb9e049dbc tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2e7d42016eb851c6e49a3a917207d6a39f84a462,backing_fmt=raw /opt/stack/data/nova/instances/5a627da9-03a1-4239-8721-cefe99c39ee2/disk.rescue {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:03:57 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-bdcbe8be-46eb-4e50-8182-adbb9e049dbc tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2e7d42016eb851c6e49a3a917207d6a39f84a462,backing_fmt=raw /opt/stack/data/nova/instances/5a627da9-03a1-4239-8721-cefe99c39ee2/disk.rescue" returned: 0 in 0.083s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:03:57 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-bdcbe8be-46eb-4e50-8182-adbb9e049dbc tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Lock "2e7d42016eb851c6e49a3a917207d6a39f84a462" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.265s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:03:57 user nova-compute[73449]: DEBUG nova.objects.instance [None req-bdcbe8be-46eb-4e50-8182-adbb9e049dbc tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Lazy-loading 'migration_context' on Instance uuid 5a627da9-03a1-4239-8721-cefe99c39ee2 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:03:57 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-bdcbe8be-46eb-4e50-8182-adbb9e049dbc tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] Created local disks {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 12:03:57 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-bdcbe8be-46eb-4e50-8182-adbb9e049dbc tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] Start _get_guest_xml network_info=[{"id": "69831639-3628-4b42-8ddd-fe0965dea4b6", "address": "fa:16:3e:de:22:d6", "network": {"id": "9455bb75-f75a-41ff-8f6f-49f55aa738f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-425274599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-425274599-network", "vif_mac": "fa:16:3e:de:22:d6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec3b0b72e47448ebe99f9fc64119c1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69831639-36", "ovs_interfaceid": "69831639-3628-4b42-8ddd-fe0965dea4b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T11:36:11Z,direct_url=<?>,disk_format='qcow2',id=0a2904ae-083d-41c8-83db-343132b36148,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7a77880136a54ef195c82e018e1939db',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T11:36:13Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'b774960e-54b1-4e4a-90bd-429ff45d4039', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'attachment_id': '960e2afa-6b32-4db9-8409-7d49a0ada225', 'boot_index': 0, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:8314fb1e-61f9-44b5-b944-5a94677724c8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QnosROjY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '5a627da9-03a1-4239-8721-cefe99c39ee2', 'attached_at': '', 'detached_at': '', 'volume_id': '8314fb1e-61f9-44b5-b944-5a94677724c8', 'serial': '8314fb1e-61f9-44b5-b944-5a94677724c8'}, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 12:03:57 user nova-compute[73449]: DEBUG nova.objects.instance [None req-bdcbe8be-46eb-4e50-8182-adbb9e049dbc tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Lazy-loading 'resources' on Instance uuid 5a627da9-03a1-4239-8721-cefe99c39ee2 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:03:57 user nova-compute[73449]: DEBUG nova.objects.instance [None req-bdcbe8be-46eb-4e50-8182-adbb9e049dbc tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Lazy-loading 'numa_topology' on Instance uuid 5a627da9-03a1-4239-8721-cefe99c39ee2 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:03:57 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-bdcbe8be-46eb-4e50-8182-adbb9e049dbc tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 12:03:57 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-bdcbe8be-46eb-4e50-8182-adbb9e049dbc tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 12:03:57 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-bdcbe8be-46eb-4e50-8182-adbb9e049dbc tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 12:03:57 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-bdcbe8be-46eb-4e50-8182-adbb9e049dbc tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] CPU controller missing on host. {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 12:03:57 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-bdcbe8be-46eb-4e50-8182-adbb9e049dbc tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 12:03:57 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-bdcbe8be-46eb-4e50-8182-adbb9e049dbc tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] CPU controller found on host. {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 12:03:57 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-bdcbe8be-46eb-4e50-8182-adbb9e049dbc tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73449) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 12:03:57 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-bdcbe8be-46eb-4e50-8182-adbb9e049dbc tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T11:35:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T11:36:11Z,direct_url=<?>,disk_format='qcow2',id=0a2904ae-083d-41c8-83db-343132b36148,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7a77880136a54ef195c82e018e1939db',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T11:36:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 12:03:57 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-bdcbe8be-46eb-4e50-8182-adbb9e049dbc tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Flavor limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 12:03:57 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-bdcbe8be-46eb-4e50-8182-adbb9e049dbc tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Image limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 12:03:57 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-bdcbe8be-46eb-4e50-8182-adbb9e049dbc tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Flavor pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 12:03:57 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-bdcbe8be-46eb-4e50-8182-adbb9e049dbc tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Image pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 12:03:57 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-bdcbe8be-46eb-4e50-8182-adbb9e049dbc tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 12:03:57 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-bdcbe8be-46eb-4e50-8182-adbb9e049dbc tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 12:03:57 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-bdcbe8be-46eb-4e50-8182-adbb9e049dbc tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 12:03:57 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-bdcbe8be-46eb-4e50-8182-adbb9e049dbc tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Got 1 possible topologies {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 12:03:57 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-bdcbe8be-46eb-4e50-8182-adbb9e049dbc tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 12:03:57 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-bdcbe8be-46eb-4e50-8182-adbb9e049dbc tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 12:03:57 user nova-compute[73449]: DEBUG nova.objects.instance [None req-bdcbe8be-46eb-4e50-8182-adbb9e049dbc tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5a627da9-03a1-4239-8721-cefe99c39ee2 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:03:57 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bdcbe8be-46eb-4e50-8182-adbb9e049dbc tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] Calling os-brick to attach iSCSI Volume {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 12:03:57 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdcbe8be-46eb-4e50-8182-adbb9e049dbc tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8314fb1e-61f9-44b5-b944-5a94677724c8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QnosROjY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 12:03:57 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-bdcbe8be-46eb-4e50-8182-adbb9e049dbc tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 12:03:57 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-bdcbe8be-46eb-4e50-8182-adbb9e049dbc tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 12:03:57 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-bdcbe8be-46eb-4e50-8182-adbb9e049dbc tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 12:03:57 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-bdcbe8be-46eb-4e50-8182-adbb9e049dbc tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 12:03:57 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-bdcbe8be-46eb-4e50-8182-adbb9e049dbc tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8314fb1e-61f9-44b5-b944-5a94677724c8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 12:03:57 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-bdcbe8be-46eb-4e50-8182-adbb9e049dbc tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8314fb1e-61f9-44b5-b944-5a94677724c8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 12:03:57 user nova-compute[73449]: INFO os_brick.initiator.connectors.iscsi [None req-bdcbe8be-46eb-4e50-8182-adbb9e049dbc tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 12:03:57 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8314fb1e-61f9-44b5-b944-5a94677724c8 -p 172.16.0.220:3260 {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:03:57 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8314fb1e-61f9-44b5-b944-5a94677724c8 -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:03:57 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d35dae7-e8d9-44d0-ab4b-1f100b923dda]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:8314fb1e-61f9-44b5-b944-5a94677724c8\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = QnosROjY\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:03:57 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdcbe8be-46eb-4e50-8182-adbb9e049dbc tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 17 12:03:57 user nova-compute[73449]: node.name = iqn.2010-10.org.openstack:8314fb1e-61f9-44b5-b944-5a94677724c8
Aug 17 12:03:57 user nova-compute[73449]: node.tpgt = -1
Aug 17 12:03:57 user nova-compute[73449]: node.startup = automatic
Aug 17 12:03:57 user nova-compute[73449]: node.leading_login = No
Aug 17 12:03:57 user nova-compute[73449]: iface.iscsi_ifacename = default
Aug 17 12:03:57 user nova-compute[73449]: iface.net_ifacename = <empty>
Aug 17 12:03:57 user nova-compute[73449]: iface.ipaddress = <empty>
Aug 17 12:03:57 user nova-compute[73449]: iface.prefix_len = 0
Aug 17 12:03:57 user nova-compute[73449]: iface.hwaddress = <empty>
Aug 17 12:03:57 user nova-compute[73449]: iface.transport_name = tcp
Aug 17 12:03:57 user nova-compute[73449]: iface.initiatorname = <empty>
Aug 17 12:03:57 user nova-compute[73449]: iface.state = <empty>
Aug 17 12:03:57 user nova-compute[73449]: iface.vlan_id = 0
Aug 17 12:03:57 user nova-compute[73449]: iface.vlan_priority = 0
Aug 17 12:03:57 user nova-compute[73449]: iface.vlan_state = <empty>
Aug 17 12:03:57 user nova-compute[73449]: iface.iface_num = 0
Aug 17 12:03:57 user nova-compute[73449]: iface.mtu = 0
Aug 17 12:03:57 user nova-compute[73449]: iface.port = 0
Aug 17 12:03:57 user nova-compute[73449]: iface.bootproto = <empty>
Aug 17 12:03:57 user nova-compute[73449]: iface.subnet_mask = <empty>
Aug 17 12:03:57 user nova-compute[73449]: iface.gateway = <empty>
Aug 17 12:03:57 user nova-compute[73449]: iface.dhcp_alt_client_id_state = <empty>
Aug 17 12:03:57 user nova-compute[73449]: iface.dhcp_alt_client_id = <empty>
Aug 17 12:03:57 user nova-compute[73449]: iface.dhcp_dns = <empty>
Aug 17 12:03:57 user nova-compute[73449]: iface.dhcp_learn_iqn = <empty>
Aug 17 12:03:57 user nova-compute[73449]: iface.dhcp_req_vendor_id_state = <empty>
Aug 17 12:03:57 user nova-compute[73449]: iface.dhcp_vendor_id_state = <empty>
Aug 17 12:03:57 user nova-compute[73449]: iface.dhcp_vendor_id = <empty>
Aug 17 12:03:57 user nova-compute[73449]: iface.dhcp_slp_da = <empty>
Aug 17 12:03:57 user nova-compute[73449]: iface.fragmentation = <empty>
Aug 17 12:03:57 user nova-compute[73449]: iface.gratuitous_arp = <empty>
Aug 17 12:03:57 user nova-compute[73449]: iface.incoming_forwarding = <empty>
Aug 17 12:03:57 user nova-compute[73449]: iface.tos_state = <empty>
Aug 17 12:03:57 user nova-compute[73449]: iface.tos = 0
Aug 17 12:03:57 user nova-compute[73449]: iface.ttl = 0
Aug 17 12:03:57 user nova-compute[73449]: iface.delayed_ack = <empty>
Aug 17 12:03:57 user nova-compute[73449]: iface.tcp_nagle = <empty>
Aug 17 12:03:57 user nova-compute[73449]: iface.tcp_wsf_state = <empty>
Aug 17 12:03:57 user nova-compute[73449]: iface.tcp_wsf = 0
Aug 17 12:03:57 user nova-compute[73449]: iface.tcp_timer_scale = 0
Aug 17 12:03:57 user nova-compute[73449]: iface.tcp_timestamp = <empty>
Aug 17 12:03:57 user nova-compute[73449]: iface.redirect = <empty>
Aug 17 12:03:57 user nova-compute[73449]: iface.def_task_mgmt_timeout = 0
Aug 17 12:03:57 user nova-compute[73449]: iface.header_digest = <empty>
Aug 17 12:03:57 user nova-compute[73449]: iface.data_digest = <empty>
Aug 17 12:03:57 user nova-compute[73449]: iface.immediate_data = <empty>
Aug 17 12:03:57 user nova-compute[73449]: iface.initial_r2t = <empty>
Aug 17 12:03:57 user nova-compute[73449]: iface.data_seq_inorder = <empty>
Aug 17 12:03:57 user nova-compute[73449]: iface.data_pdu_inorder = <empty>
Aug 17 12:03:57 user nova-compute[73449]: iface.erl = 0
Aug 17 12:03:57 user nova-compute[73449]: iface.max_receive_data_len = 0
Aug 17 12:03:57 user nova-compute[73449]: iface.first_burst_len = 0
Aug 17 12:03:57 user nova-compute[73449]: iface.max_outstanding_r2t = 0
Aug 17 12:03:57 user nova-compute[73449]: iface.max_burst_len = 0
Aug 17 12:03:57 user nova-compute[73449]: iface.chap_auth = <empty>
Aug 17 12:03:57 user nova-compute[73449]: iface.bidi_chap = <empty>
Aug 17 12:03:57 user nova-compute[73449]: iface.strict_login_compliance = <empty>
Aug 17 12:03:57 user nova-compute[73449]: iface.discovery_auth = <empty>
Aug 17 12:03:57 user nova-compute[73449]: iface.discovery_logout = <empty>
Aug 17 12:03:57 user nova-compute[73449]: node.discovery_address = <empty>
Aug 17 12:03:57 user nova-compute[73449]: node.discovery_port = 0
Aug 17 12:03:57 user nova-compute[73449]: node.discovery_type = static
Aug 17 12:03:57 user nova-compute[73449]: node.session.initial_cmdsn = 0
Aug 17 12:03:57 user nova-compute[73449]: node.session.initial_login_retry_max = 8
Aug 17 12:03:57 user nova-compute[73449]: node.session.xmit_thread_priority = -20
Aug 17 12:03:57 user nova-compute[73449]: node.session.cmds_max = 128
Aug 17 12:03:57 user nova-compute[73449]: node.session.queue_depth = 32
Aug 17 12:03:57 user nova-compute[73449]: node.session.nr_sessions = 1
Aug 17 12:03:57 user nova-compute[73449]: node.session.auth.authmethod = CHAP
Aug 17 12:03:57 user nova-compute[73449]: node.session.auth.username = QnosROjY
Aug 17 12:03:57 user nova-compute[73449]: node.session.auth.password = ***
Aug 17 12:03:57 user nova-compute[73449]: node.session.auth.username_in = <empty>
Aug 17 12:03:57 user nova-compute[73449]: node.session.auth.password_in = <empty>
Aug 17 12:03:57 user nova-compute[73449]: node.session.auth.chap_algs = MD5
Aug 17 12:03:57 user nova-compute[73449]: node.session.timeo.replacement_timeout = 120
Aug 17 12:03:57 user nova-compute[73449]: node.session.err_timeo.abort_timeout = 15
Aug 17 12:03:57 user nova-compute[73449]: node.session.err_timeo.lu_reset_timeout = 30
Aug 17 12:03:57 user nova-compute[73449]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 17 12:03:57 user nova-compute[73449]: node.session.err_timeo.host_reset_timeout = 60
Aug 17 12:03:57 user nova-compute[73449]: node.session.iscsi.FastAbort = Yes
Aug 17 12:03:57 user nova-compute[73449]: node.session.iscsi.InitialR2T = No
Aug 17 12:03:57 user nova-compute[73449]: node.session.iscsi.ImmediateData = Yes
Aug 17 12:03:57 user nova-compute[73449]: node.session.iscsi.FirstBurstLength = 262144
Aug 17 12:03:57 user nova-compute[73449]: node.session.iscsi.MaxBurstLength = 16776192
Aug 17 12:03:57 user nova-compute[73449]: node.session.iscsi.DefaultTime2Retain = 0
Aug 17 12:03:57 user nova-compute[73449]: node.session.iscsi.DefaultTime2Wait = 2
Aug 17 12:03:57 user nova-compute[73449]: node.session.iscsi.MaxConnections = 1
Aug 17 12:03:57 user nova-compute[73449]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 17 12:03:57 user nova-compute[73449]: node.session.iscsi.ERL = 0
Aug 17 12:03:57 user nova-compute[73449]: node.session.scan = manual
Aug 17 12:03:57 user nova-compute[73449]: node.session.reopen_max = 0
Aug 17 12:03:57 user nova-compute[73449]: node.conn[0].address = 172.16.0.220
Aug 17 12:03:57 user nova-compute[73449]: node.conn[0].port = 3260
Aug 17 12:03:57 user nova-compute[73449]: node.conn[0].startup = manual
Aug 17 12:03:57 user nova-compute[73449]: node.conn[0].tcp.window_size = 524288
Aug 17 12:03:57 user nova-compute[73449]: node.conn[0].tcp.type_of_service = 0
Aug 17 12:03:57 user nova-compute[73449]: node.conn[0].timeo.logout_timeout = 15
Aug 17 12:03:57 user nova-compute[73449]: node.conn[0].timeo.login_timeout = 15
Aug 17 12:03:57 user nova-compute[73449]: node.conn[0].timeo.auth_timeout = 45
Aug 17 12:03:57 user nova-compute[73449]: node.conn[0].timeo.noop_out_interval = 5
Aug 17 12:03:57 user nova-compute[73449]: node.conn[0].timeo.noop_out_timeout = 5
Aug 17 12:03:57 user nova-compute[73449]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 17 12:03:57 user nova-compute[73449]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 17 12:03:57 user nova-compute[73449]: node.conn[0].iscsi.HeaderDigest = None
Aug 17 12:03:57 user nova-compute[73449]: node.conn[0].iscsi.DataDigest = None
Aug 17 12:03:57 user nova-compute[73449]: node.conn[0].iscsi.IFMarker = No
Aug 17 12:03:57 user nova-compute[73449]: node.conn[0].iscsi.OFMarker = No
Aug 17 12:03:57 user nova-compute[73449]: # END RECORD
Aug 17 12:03:57 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:03:57 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8314fb1e-61f9-44b5-b944-5a94677724c8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:03:57 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8314fb1e-61f9-44b5-b944-5a94677724c8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:03:57 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa41fb7d-265d-4963-a0e9-ab00e166a180]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:03:57 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdcbe8be-46eb-4e50-8182-adbb9e049dbc tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:03:57 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8314fb1e-61f9-44b5-b944-5a94677724c8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:03:57 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8314fb1e-61f9-44b5-b944-5a94677724c8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:03:57 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[67e0950e-2852-423f-bed0-2fe8f8526963]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:03:57 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdcbe8be-46eb-4e50-8182-adbb9e049dbc tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:03:57 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8314fb1e-61f9-44b5-b944-5a94677724c8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QnosROjY {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:03:57 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8314fb1e-61f9-44b5-b944-5a94677724c8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QnosROjY" returned: 0 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:03:57 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceff0044-278c-4775-95dc-33f63ca2150e]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:03:57 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdcbe8be-46eb-4e50-8182-adbb9e049dbc tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QnosROjY'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:03:57 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8314fb1e-61f9-44b5-b944-5a94677724c8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:03:57 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8314fb1e-61f9-44b5-b944-5a94677724c8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:03:57 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ad315e2-4f59-479a-9598-90c3751ba0f7]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:03:57 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdcbe8be-46eb-4e50-8182-adbb9e049dbc tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:03:57 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:03:57 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:03:57 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc82ece0-7580-4207-9257-4fc3998fb186]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8314fb1e-61f9-44b5-b944-5a94677724c8 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:740e623f-bfc7-4776-b6d7-cb30de9535e4 (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:03:57 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6a417df7-6f0d-42f8-8c23-8bc23c874c54 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Acquiring lock "8fdfaf32-0957-453a-b1cf-9a3c19815c45" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:03:57 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6a417df7-6f0d-42f8-8c23-8bc23c874c54 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Lock "8fdfaf32-0957-453a-b1cf-9a3c19815c45" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:03:57 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdcbe8be-46eb-4e50-8182-adbb9e049dbc tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)
Aug 17 12:03:57 user nova-compute[73449]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8314fb1e-61f9-44b5-b944-5a94677724c8 (non-flash)
Aug 17 12:03:57 user nova-compute[73449]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:740e623f-bfc7-4776-b6d7-cb30de9535e4 (non-flash)
Aug 17 12:03:57 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 12:03:57 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdcbe8be-46eb-4e50-8182-adbb9e049dbc tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)
Aug 17 12:03:57 user nova-compute[73449]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8314fb1e-61f9-44b5-b944-5a94677724c8 (non-flash)
Aug 17 12:03:57 user nova-compute[73449]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:740e623f-bfc7-4776-b6d7-cb30de9535e4 (non-flash)
Aug 17 12:03:57 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 12:03:57 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-bdcbe8be-46eb-4e50-8182-adbb9e049dbc tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8314fb1e-61f9-44b5-b944-5a94677724c8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.154s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 12:03:57 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdcbe8be-46eb-4e50-8182-adbb9e049dbc tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Connected to 172.16.0.220:3260 {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 12:03:57 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-bdcbe8be-46eb-4e50-8182-adbb9e049dbc tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] HCTL ('33', '0', '0', 0) found on session 48 with lun 0 {{(pid=73449) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 12:03:57 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-bdcbe8be-46eb-4e50-8182-adbb9e049dbc tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=73449) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 12:03:57 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:03:57 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6a417df7-6f0d-42f8-8c23-8bc23c874c54 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] [instance: 8fdfaf32-0957-453a-b1cf-9a3c19815c45] Starting instance... {{(pid=73449) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 12:03:57 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:03:57 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[198e2c2e-5234-468c-8d84-d80e428217e0]: (4, ('0 0 0', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:03:57 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-bdcbe8be-46eb-4e50-8182-adbb9e049dbc tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Searching for a device in session 48 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=73449) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 12:03:57 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdcbe8be-46eb-4e50-8182-adbb9e049dbc tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QnosROjY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 12:03:57 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-bdcbe8be-46eb-4e50-8182-adbb9e049dbc tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.187s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 12:03:57 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdcbe8be-46eb-4e50-8182-adbb9e049dbc tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] <== connect_volume: return (189ms) {'type': 'block', 'scsi_wwn': '23865313534386439', 'path': '/dev/sdb'} {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 12:03:57 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bdcbe8be-46eb-4e50-8182-adbb9e049dbc tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23865313534386439', 'path': '/dev/sdb'} {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 12:03:57 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-bdcbe8be-46eb-4e50-8182-adbb9e049dbc tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T12:02:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1061317430',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1061317430',id=43,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T12:02:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4ec3b0b72e47448ebe99f9fc64119c1c',ramdisk_id='',reservation_id='r-ibt4mle4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1818019421',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T12:02:31Z,user_data=None,user_id='14eb3826311a4f8f91d8264e87f7b866',uuid=5a627da9-03a1-4239-8721-cefe99c39ee2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "69831639-3628-4b42-8ddd-fe0965dea4b6", "address": "fa:16:3e:de:22:d6", "network": {"id": "9455bb75-f75a-41ff-8f6f-49f55aa738f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-425274599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-425274599-network", "vif_mac": "fa:16:3e:de:22:d6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec3b0b72e47448ebe99f9fc64119c1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69831639-36", "ovs_interfaceid": "69831639-3628-4b42-8ddd-fe0965dea4b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73449) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 12:03:57 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-bdcbe8be-46eb-4e50-8182-adbb9e049dbc tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Converting VIF {"id": "69831639-3628-4b42-8ddd-fe0965dea4b6", "address": "fa:16:3e:de:22:d6", "network": {"id": "9455bb75-f75a-41ff-8f6f-49f55aa738f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-425274599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-425274599-network", "vif_mac": "fa:16:3e:de:22:d6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec3b0b72e47448ebe99f9fc64119c1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69831639-36", "ovs_interfaceid": "69831639-3628-4b42-8ddd-fe0965dea4b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 12:03:57 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-bdcbe8be-46eb-4e50-8182-adbb9e049dbc tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:de:22:d6,bridge_name='br-int',has_traffic_filtering=True,id=69831639-3628-4b42-8ddd-fe0965dea4b6,network=Network(9455bb75-f75a-41ff-8f6f-49f55aa738f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69831639-36') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 12:03:57 user nova-compute[73449]: DEBUG nova.objects.instance [None req-bdcbe8be-46eb-4e50-8182-adbb9e049dbc tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Lazy-loading 'pci_devices' on Instance uuid 5a627da9-03a1-4239-8721-cefe99c39ee2 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:03:57 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-bdcbe8be-46eb-4e50-8182-adbb9e049dbc tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] End _get_guest_xml xml=<domain type="kvm">
Aug 17 12:03:57 user nova-compute[73449]:   <uuid>5a627da9-03a1-4239-8721-cefe99c39ee2</uuid>
Aug 17 12:03:57 user nova-compute[73449]:   <name>instance-0000002b</name>
Aug 17 12:03:57 user nova-compute[73449]:   <memory>524288</memory>
Aug 17 12:03:57 user nova-compute[73449]:   <vcpu>1</vcpu>
Aug 17 12:03:57 user nova-compute[73449]:   <metadata>
Aug 17 12:03:57 user nova-compute[73449]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 12:03:57 user nova-compute[73449]:       <nova:package version="0.0.0"/>
Aug 17 12:03:57 user nova-compute[73449]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1061317430</nova:name>
Aug 17 12:03:57 user nova-compute[73449]:       <nova:creationTime>2023-08-17 12:03:57</nova:creationTime>
Aug 17 12:03:57 user nova-compute[73449]:       <nova:flavor name="m1.tiny">
Aug 17 12:03:57 user nova-compute[73449]:         <nova:memory>512</nova:memory>
Aug 17 12:03:57 user nova-compute[73449]:         <nova:disk>1</nova:disk>
Aug 17 12:03:57 user nova-compute[73449]:         <nova:swap>0</nova:swap>
Aug 17 12:03:57 user nova-compute[73449]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 12:03:57 user nova-compute[73449]:         <nova:vcpus>1</nova:vcpus>
Aug 17 12:03:57 user nova-compute[73449]:       </nova:flavor>
Aug 17 12:03:57 user nova-compute[73449]:       <nova:owner>
Aug 17 12:03:57 user nova-compute[73449]:         <nova:user uuid="14eb3826311a4f8f91d8264e87f7b866">tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member</nova:user>
Aug 17 12:03:57 user nova-compute[73449]:         <nova:project uuid="4ec3b0b72e47448ebe99f9fc64119c1c">tempest-ServerBootFromVolumeStableRescueTest-1818019421</nova:project>
Aug 17 12:03:57 user nova-compute[73449]:       </nova:owner>
Aug 17 12:03:57 user nova-compute[73449]:       <nova:root type="image" uuid="0a2904ae-083d-41c8-83db-343132b36148"/>
Aug 17 12:03:57 user nova-compute[73449]:       <nova:ports>
Aug 17 12:03:57 user nova-compute[73449]:         <nova:port uuid="69831639-3628-4b42-8ddd-fe0965dea4b6">
Aug 17 12:03:57 user nova-compute[73449]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 17 12:03:57 user nova-compute[73449]:         </nova:port>
Aug 17 12:03:57 user nova-compute[73449]:       </nova:ports>
Aug 17 12:03:57 user nova-compute[73449]:     </nova:instance>
Aug 17 12:03:57 user nova-compute[73449]:   </metadata>
Aug 17 12:03:57 user nova-compute[73449]:   <sysinfo type="smbios">
Aug 17 12:03:57 user nova-compute[73449]:     <system>
Aug 17 12:03:57 user nova-compute[73449]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 12:03:57 user nova-compute[73449]:       <entry name="product">OpenStack Nova</entry>
Aug 17 12:03:57 user nova-compute[73449]:       <entry name="version">0.0.0</entry>
Aug 17 12:03:57 user nova-compute[73449]:       <entry name="serial">5a627da9-03a1-4239-8721-cefe99c39ee2</entry>
Aug 17 12:03:57 user nova-compute[73449]:       <entry name="uuid">5a627da9-03a1-4239-8721-cefe99c39ee2</entry>
Aug 17 12:03:57 user nova-compute[73449]:       <entry name="family">Virtual Machine</entry>
Aug 17 12:03:57 user nova-compute[73449]:     </system>
Aug 17 12:03:57 user nova-compute[73449]:   </sysinfo>
Aug 17 12:03:57 user nova-compute[73449]:   <os>
Aug 17 12:03:57 user nova-compute[73449]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 12:03:57 user nova-compute[73449]:     <smbios mode="sysinfo"/>
Aug 17 12:03:57 user nova-compute[73449]:   </os>
Aug 17 12:03:57 user nova-compute[73449]:   <features>
Aug 17 12:03:57 user nova-compute[73449]:     <acpi/>
Aug 17 12:03:57 user nova-compute[73449]:     <apic/>
Aug 17 12:03:57 user nova-compute[73449]:     <vmcoreinfo/>
Aug 17 12:03:57 user nova-compute[73449]:   </features>
Aug 17 12:03:57 user nova-compute[73449]:   <clock offset="utc">
Aug 17 12:03:57 user nova-compute[73449]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 12:03:57 user nova-compute[73449]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 12:03:57 user nova-compute[73449]:     <timer name="hpet" present="no"/>
Aug 17 12:03:57 user nova-compute[73449]:   </clock>
Aug 17 12:03:57 user nova-compute[73449]:   <cpu mode="custom" match="exact">
Aug 17 12:03:57 user nova-compute[73449]:     <model>Nehalem</model>
Aug 17 12:03:57 user nova-compute[73449]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 12:03:57 user nova-compute[73449]:   </cpu>
Aug 17 12:03:57 user nova-compute[73449]:   <devices>
Aug 17 12:03:57 user nova-compute[73449]:     <disk type="block" device="disk">
Aug 17 12:03:57 user nova-compute[73449]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 12:03:57 user nova-compute[73449]:       <source dev="/dev/sdb"/>
Aug 17 12:03:57 user nova-compute[73449]:       <target dev="vda" bus="virtio"/>
Aug 17 12:03:57 user nova-compute[73449]:       <serial>8314fb1e-61f9-44b5-b944-5a94677724c8</serial>
Aug 17 12:03:57 user nova-compute[73449]:     </disk>
Aug 17 12:03:57 user nova-compute[73449]:     <disk type="file" device="disk">
Aug 17 12:03:57 user nova-compute[73449]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 12:03:57 user nova-compute[73449]:       <source file="/opt/stack/data/nova/instances/5a627da9-03a1-4239-8721-cefe99c39ee2/disk.rescue"/>
Aug 17 12:03:57 user nova-compute[73449]:       <target dev="vdb" bus="virtio"/>
Aug 17 12:03:57 user nova-compute[73449]:       <boot order="1"/>
Aug 17 12:03:57 user nova-compute[73449]:     </disk>
Aug 17 12:03:57 user nova-compute[73449]:     <interface type="ethernet">
Aug 17 12:03:57 user nova-compute[73449]:       <mac address="fa:16:3e:de:22:d6"/>
Aug 17 12:03:57 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 12:03:57 user nova-compute[73449]:       <mtu size="1442"/>
Aug 17 12:03:57 user nova-compute[73449]:       <target dev="tap69831639-36"/>
Aug 17 12:03:57 user nova-compute[73449]:     </interface>
Aug 17 12:03:57 user nova-compute[73449]:     <serial type="pty">
Aug 17 12:03:57 user nova-compute[73449]:       <log file="/opt/stack/data/nova/instances/5a627da9-03a1-4239-8721-cefe99c39ee2/console.log" append="off"/>
Aug 17 12:03:57 user nova-compute[73449]:     </serial>
Aug 17 12:03:57 user nova-compute[73449]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 12:03:57 user nova-compute[73449]:     <video>
Aug 17 12:03:57 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 12:03:57 user nova-compute[73449]:     </video>
Aug 17 12:03:57 user nova-compute[73449]:     <rng model="virtio">
Aug 17 12:03:57 user nova-compute[73449]:       <backend model="random">/dev/urandom</backend>
Aug 17 12:03:57 user nova-compute[73449]:     </rng>
Aug 17 12:03:57 user nova-compute[73449]:     <controller type="usb" index="0" model="none"/>
Aug 17 12:03:57 user nova-compute[73449]:     <memballoon model="virtio">
Aug 17 12:03:57 user nova-compute[73449]:       <stats period="10"/>
Aug 17 12:03:57 user nova-compute[73449]:     </memballoon>
Aug 17 12:03:57 user nova-compute[73449]:   </devices>
Aug 17 12:03:57 user nova-compute[73449]: </domain>
Aug 17 12:03:57 user nova-compute[73449]:  {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 12:03:57 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] Instance destroyed successfully.
Aug 17 12:03:57 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6a417df7-6f0d-42f8-8c23-8bc23c874c54 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:03:57 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6a417df7-6f0d-42f8-8c23-8bc23c874c54 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:03:57 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-6a417df7-6f0d-42f8-8c23-8bc23c874c54 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73449) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 12:03:57 user nova-compute[73449]: INFO nova.compute.claims [None req-6a417df7-6f0d-42f8-8c23-8bc23c874c54 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] [instance: 8fdfaf32-0957-453a-b1cf-9a3c19815c45] Claim successful on node user
Aug 17 12:03:57 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-bdcbe8be-46eb-4e50-8182-adbb9e049dbc tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] No BDM found with device name vda, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 12:03:57 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-bdcbe8be-46eb-4e50-8182-adbb9e049dbc tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 12:03:57 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-bdcbe8be-46eb-4e50-8182-adbb9e049dbc tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] No VIF found with MAC fa:16:3e:de:22:d6, not building metadata {{(pid=73449) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 12:03:57 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:03:57 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-6a417df7-6f0d-42f8-8c23-8bc23c874c54 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 12:03:57 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-6a417df7-6f0d-42f8-8c23-8bc23c874c54 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 12:03:58 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6a417df7-6f0d-42f8-8c23-8bc23c874c54 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.372s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:03:58 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6a417df7-6f0d-42f8-8c23-8bc23c874c54 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] [instance: 8fdfaf32-0957-453a-b1cf-9a3c19815c45] Start building networks asynchronously for instance. {{(pid=73449) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 12:03:58 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6a417df7-6f0d-42f8-8c23-8bc23c874c54 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] [instance: 8fdfaf32-0957-453a-b1cf-9a3c19815c45] Allocating IP information in the background. {{(pid=73449) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 12:03:58 user nova-compute[73449]: DEBUG nova.network.neutron [None req-6a417df7-6f0d-42f8-8c23-8bc23c874c54 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] [instance: 8fdfaf32-0957-453a-b1cf-9a3c19815c45] allocate_for_instance() {{(pid=73449) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 12:03:58 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-6a417df7-6f0d-42f8-8c23-8bc23c874c54 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] [instance: 8fdfaf32-0957-453a-b1cf-9a3c19815c45] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 12:03:58 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6a417df7-6f0d-42f8-8c23-8bc23c874c54 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] [instance: 8fdfaf32-0957-453a-b1cf-9a3c19815c45] Start building block device mappings for instance. {{(pid=73449) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 12:03:58 user nova-compute[73449]: DEBUG nova.policy [None req-6a417df7-6f0d-42f8-8c23-8bc23c874c54 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f7ae0aef93334fa599be6d1a4d728595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c9e5daa31ad47e996b59f1b7c5db0d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73449) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 12:03:58 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6a417df7-6f0d-42f8-8c23-8bc23c874c54 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] [instance: 8fdfaf32-0957-453a-b1cf-9a3c19815c45] Start spawning the instance on the hypervisor. {{(pid=73449) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 12:03:58 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6a417df7-6f0d-42f8-8c23-8bc23c874c54 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] [instance: 8fdfaf32-0957-453a-b1cf-9a3c19815c45] Creating instance directory {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 12:03:58 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-6a417df7-6f0d-42f8-8c23-8bc23c874c54 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] [instance: 8fdfaf32-0957-453a-b1cf-9a3c19815c45] Creating image(s)
Aug 17 12:03:58 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6a417df7-6f0d-42f8-8c23-8bc23c874c54 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Acquiring lock "/opt/stack/data/nova/instances/8fdfaf32-0957-453a-b1cf-9a3c19815c45/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:03:58 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6a417df7-6f0d-42f8-8c23-8bc23c874c54 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Lock "/opt/stack/data/nova/instances/8fdfaf32-0957-453a-b1cf-9a3c19815c45/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:03:58 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6a417df7-6f0d-42f8-8c23-8bc23c874c54 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Lock "/opt/stack/data/nova/instances/8fdfaf32-0957-453a-b1cf-9a3c19815c45/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:03:58 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6a417df7-6f0d-42f8-8c23-8bc23c874c54 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:03:58 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6a417df7-6f0d-42f8-8c23-8bc23c874c54 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json" returned: 0 in 0.181s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:03:58 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6a417df7-6f0d-42f8-8c23-8bc23c874c54 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Acquiring lock "7e267a577c062ee862e95ede6b48cfd5632f3ea3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:03:58 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6a417df7-6f0d-42f8-8c23-8bc23c874c54 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Lock "7e267a577c062ee862e95ede6b48cfd5632f3ea3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:03:58 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6a417df7-6f0d-42f8-8c23-8bc23c874c54 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:03:58 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6a417df7-6f0d-42f8-8c23-8bc23c874c54 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json" returned: 0 in 0.192s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:03:58 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6a417df7-6f0d-42f8-8c23-8bc23c874c54 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3,backing_fmt=raw /opt/stack/data/nova/instances/8fdfaf32-0957-453a-b1cf-9a3c19815c45/disk 1073741824 {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:03:58 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6a417df7-6f0d-42f8-8c23-8bc23c874c54 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3,backing_fmt=raw /opt/stack/data/nova/instances/8fdfaf32-0957-453a-b1cf-9a3c19815c45/disk 1073741824" returned: 0 in 0.051s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:03:58 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6a417df7-6f0d-42f8-8c23-8bc23c874c54 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Lock "7e267a577c062ee862e95ede6b48cfd5632f3ea3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:03:58 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6a417df7-6f0d-42f8-8c23-8bc23c874c54 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:03:58 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:03:58 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6a417df7-6f0d-42f8-8c23-8bc23c874c54 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json" returned: 0 in 0.194s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:03:58 user nova-compute[73449]: DEBUG nova.virt.disk.api [None req-6a417df7-6f0d-42f8-8c23-8bc23c874c54 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8fdfaf32-0957-453a-b1cf-9a3c19815c45/disk. size=1073741824 {{(pid=73449) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 12:03:58 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6a417df7-6f0d-42f8-8c23-8bc23c874c54 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fdfaf32-0957-453a-b1cf-9a3c19815c45/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:03:58 user nova-compute[73449]: DEBUG nova.network.neutron [None req-6a417df7-6f0d-42f8-8c23-8bc23c874c54 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] [instance: 8fdfaf32-0957-453a-b1cf-9a3c19815c45] Successfully created port: fb4a2e2a-cbf2-4141-bac3-c6033653bb84 {{(pid=73449) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 12:03:58 user nova-compute[73449]: DEBUG nova.compute.manager [req-ba974707-9437-4159-ba1c-8b670340d928 req-beca52e5-96ca-455b-a081-1cb23b0e23c6 service nova] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] Received event network-vif-unplugged-69831639-3628-4b42-8ddd-fe0965dea4b6 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:03:58 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-ba974707-9437-4159-ba1c-8b670340d928 req-beca52e5-96ca-455b-a081-1cb23b0e23c6 service nova] Acquiring lock "5a627da9-03a1-4239-8721-cefe99c39ee2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:03:58 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-ba974707-9437-4159-ba1c-8b670340d928 req-beca52e5-96ca-455b-a081-1cb23b0e23c6 service nova] Lock "5a627da9-03a1-4239-8721-cefe99c39ee2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:03:58 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-ba974707-9437-4159-ba1c-8b670340d928 req-beca52e5-96ca-455b-a081-1cb23b0e23c6 service nova] Lock "5a627da9-03a1-4239-8721-cefe99c39ee2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:03:58 user nova-compute[73449]: DEBUG nova.compute.manager [req-ba974707-9437-4159-ba1c-8b670340d928 req-beca52e5-96ca-455b-a081-1cb23b0e23c6 service nova] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] No waiting events found dispatching network-vif-unplugged-69831639-3628-4b42-8ddd-fe0965dea4b6 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 12:03:58 user nova-compute[73449]: WARNING nova.compute.manager [req-ba974707-9437-4159-ba1c-8b670340d928 req-beca52e5-96ca-455b-a081-1cb23b0e23c6 service nova] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] Received unexpected event network-vif-unplugged-69831639-3628-4b42-8ddd-fe0965dea4b6 for instance with vm_state active and task_state rescuing.
Aug 17 12:03:58 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:03:58 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:03:58 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:03:59 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6a417df7-6f0d-42f8-8c23-8bc23c874c54 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fdfaf32-0957-453a-b1cf-9a3c19815c45/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:03:59 user nova-compute[73449]: DEBUG nova.virt.disk.api [None req-6a417df7-6f0d-42f8-8c23-8bc23c874c54 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Cannot resize image /opt/stack/data/nova/instances/8fdfaf32-0957-453a-b1cf-9a3c19815c45/disk to a smaller size. {{(pid=73449) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 12:03:59 user nova-compute[73449]: DEBUG nova.objects.instance [None req-6a417df7-6f0d-42f8-8c23-8bc23c874c54 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Lazy-loading 'migration_context' on Instance uuid 8fdfaf32-0957-453a-b1cf-9a3c19815c45 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:03:59 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6a417df7-6f0d-42f8-8c23-8bc23c874c54 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] [instance: 8fdfaf32-0957-453a-b1cf-9a3c19815c45] Created local disks {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 12:03:59 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6a417df7-6f0d-42f8-8c23-8bc23c874c54 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] [instance: 8fdfaf32-0957-453a-b1cf-9a3c19815c45] Ensure instance console log exists: /opt/stack/data/nova/instances/8fdfaf32-0957-453a-b1cf-9a3c19815c45/console.log {{(pid=73449) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 12:03:59 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6a417df7-6f0d-42f8-8c23-8bc23c874c54 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:03:59 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6a417df7-6f0d-42f8-8c23-8bc23c874c54 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:03:59 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6a417df7-6f0d-42f8-8c23-8bc23c874c54 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:03:59 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:03:59 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:04:00 user nova-compute[73449]: DEBUG nova.network.neutron [None req-6a417df7-6f0d-42f8-8c23-8bc23c874c54 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] [instance: 8fdfaf32-0957-453a-b1cf-9a3c19815c45] Successfully updated port: fb4a2e2a-cbf2-4141-bac3-c6033653bb84 {{(pid=73449) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 12:04:00 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6a417df7-6f0d-42f8-8c23-8bc23c874c54 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Acquiring lock "refresh_cache-8fdfaf32-0957-453a-b1cf-9a3c19815c45" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 12:04:00 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6a417df7-6f0d-42f8-8c23-8bc23c874c54 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Acquired lock "refresh_cache-8fdfaf32-0957-453a-b1cf-9a3c19815c45" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 12:04:00 user nova-compute[73449]: DEBUG nova.network.neutron [None req-6a417df7-6f0d-42f8-8c23-8bc23c874c54 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] [instance: 8fdfaf32-0957-453a-b1cf-9a3c19815c45] Building network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 12:04:00 user nova-compute[73449]: DEBUG nova.compute.manager [req-49e99798-ada3-4573-ad11-977d4e0c49c8 req-5ed48679-2861-4346-b1dd-a5b9b57d101a service nova] [instance: 8fdfaf32-0957-453a-b1cf-9a3c19815c45] Received event network-changed-fb4a2e2a-cbf2-4141-bac3-c6033653bb84 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:04:00 user nova-compute[73449]: DEBUG nova.compute.manager [req-49e99798-ada3-4573-ad11-977d4e0c49c8 req-5ed48679-2861-4346-b1dd-a5b9b57d101a service nova] [instance: 8fdfaf32-0957-453a-b1cf-9a3c19815c45] Refreshing instance network info cache due to event network-changed-fb4a2e2a-cbf2-4141-bac3-c6033653bb84. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 12:04:00 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-49e99798-ada3-4573-ad11-977d4e0c49c8 req-5ed48679-2861-4346-b1dd-a5b9b57d101a service nova] Acquiring lock "refresh_cache-8fdfaf32-0957-453a-b1cf-9a3c19815c45" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 12:04:00 user nova-compute[73449]: DEBUG nova.network.neutron [None req-6a417df7-6f0d-42f8-8c23-8bc23c874c54 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] [instance: 8fdfaf32-0957-453a-b1cf-9a3c19815c45] Instance cache missing network info. {{(pid=73449) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 12:04:00 user nova-compute[73449]: DEBUG nova.network.neutron [None req-6a417df7-6f0d-42f8-8c23-8bc23c874c54 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] [instance: 8fdfaf32-0957-453a-b1cf-9a3c19815c45] Updating instance_info_cache with network_info: [{"id": "fb4a2e2a-cbf2-4141-bac3-c6033653bb84", "address": "fa:16:3e:c1:11:0e", "network": {"id": "1e184b35-0ffc-4c89-951b-d97b1961f72f", "bridge": "br-int", "label": "tempest-TestStampPattern-2134909631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c9e5daa31ad47e996b59f1b7c5db0d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb4a2e2a-cb", "ovs_interfaceid": "fb4a2e2a-cbf2-4141-bac3-c6033653bb84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 12:04:00 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6a417df7-6f0d-42f8-8c23-8bc23c874c54 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Releasing lock "refresh_cache-8fdfaf32-0957-453a-b1cf-9a3c19815c45" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 12:04:00 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6a417df7-6f0d-42f8-8c23-8bc23c874c54 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] [instance: 8fdfaf32-0957-453a-b1cf-9a3c19815c45] Instance network_info: |[{"id": "fb4a2e2a-cbf2-4141-bac3-c6033653bb84", "address": "fa:16:3e:c1:11:0e", "network": {"id": "1e184b35-0ffc-4c89-951b-d97b1961f72f", "bridge": "br-int", "label": "tempest-TestStampPattern-2134909631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c9e5daa31ad47e996b59f1b7c5db0d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb4a2e2a-cb", "ovs_interfaceid": "fb4a2e2a-cbf2-4141-bac3-c6033653bb84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73449) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 12:04:00 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-49e99798-ada3-4573-ad11-977d4e0c49c8 req-5ed48679-2861-4346-b1dd-a5b9b57d101a service nova] Acquired lock "refresh_cache-8fdfaf32-0957-453a-b1cf-9a3c19815c45" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 12:04:00 user nova-compute[73449]: DEBUG nova.network.neutron [req-49e99798-ada3-4573-ad11-977d4e0c49c8 req-5ed48679-2861-4346-b1dd-a5b9b57d101a service nova] [instance: 8fdfaf32-0957-453a-b1cf-9a3c19815c45] Refreshing network info cache for port fb4a2e2a-cbf2-4141-bac3-c6033653bb84 {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 12:04:00 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6a417df7-6f0d-42f8-8c23-8bc23c874c54 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] [instance: 8fdfaf32-0957-453a-b1cf-9a3c19815c45] Start _get_guest_xml network_info=[{"id": "fb4a2e2a-cbf2-4141-bac3-c6033653bb84", "address": "fa:16:3e:c1:11:0e", "network": {"id": "1e184b35-0ffc-4c89-951b-d97b1961f72f", "bridge": "br-int", "label": "tempest-TestStampPattern-2134909631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c9e5daa31ad47e996b59f1b7c5db0d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb4a2e2a-cb", "ovs_interfaceid": "fb4a2e2a-cbf2-4141-bac3-c6033653bb84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T11:36:11Z,direct_url=<?>,disk_format='qcow2',id=0a2904ae-083d-41c8-83db-343132b36148,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7a77880136a54ef195c82e018e1939db',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T11:36:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': '0a2904ae-083d-41c8-83db-343132b36148'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 12:04:00 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-6a417df7-6f0d-42f8-8c23-8bc23c874c54 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 12:04:00 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-6a417df7-6f0d-42f8-8c23-8bc23c874c54 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 12:04:00 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-6a417df7-6f0d-42f8-8c23-8bc23c874c54 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 12:04:00 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-6a417df7-6f0d-42f8-8c23-8bc23c874c54 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] CPU controller missing on host. {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 12:04:00 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-6a417df7-6f0d-42f8-8c23-8bc23c874c54 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 12:04:00 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-6a417df7-6f0d-42f8-8c23-8bc23c874c54 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] CPU controller found on host. {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 12:04:00 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6a417df7-6f0d-42f8-8c23-8bc23c874c54 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73449) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 12:04:00 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-6a417df7-6f0d-42f8-8c23-8bc23c874c54 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T11:35:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T11:36:11Z,direct_url=<?>,disk_format='qcow2',id=0a2904ae-083d-41c8-83db-343132b36148,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7a77880136a54ef195c82e018e1939db',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T11:36:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 12:04:00 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-6a417df7-6f0d-42f8-8c23-8bc23c874c54 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Flavor limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 12:04:00 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-6a417df7-6f0d-42f8-8c23-8bc23c874c54 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Image limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 12:04:00 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-6a417df7-6f0d-42f8-8c23-8bc23c874c54 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Flavor pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 12:04:00 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-6a417df7-6f0d-42f8-8c23-8bc23c874c54 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Image pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 12:04:00 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-6a417df7-6f0d-42f8-8c23-8bc23c874c54 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 12:04:00 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-6a417df7-6f0d-42f8-8c23-8bc23c874c54 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 12:04:00 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-6a417df7-6f0d-42f8-8c23-8bc23c874c54 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 12:04:00 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-6a417df7-6f0d-42f8-8c23-8bc23c874c54 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Got 1 possible topologies {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 12:04:00 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-6a417df7-6f0d-42f8-8c23-8bc23c874c54 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 12:04:00 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-6a417df7-6f0d-42f8-8c23-8bc23c874c54 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 12:04:00 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-6a417df7-6f0d-42f8-8c23-8bc23c874c54 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T12:03:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1756393260',display_name='tempest-TestStampPattern-server-1756393260',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1756393260',id=47,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIJ2Eo5DY98v4ABNkSPsmOpSAggLOMtuKT7FC5l8WhxwKHhwEcVH95zEdzfXTi8XjE0vKAypvTBXbrGRvlqVzqU569MwCVfJPBtduUClfPdtl8n174kTkHvx5qjovHToOQ==',key_name='tempest-TestStampPattern-923522805',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3c9e5daa31ad47e996b59f1b7c5db0d4',ramdisk_id='',reservation_id='r-ikb0vnkf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-806391027',owner_user_name='tempest-TestStampPattern-806391027-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T12:03:58Z,user_data=None,user_id='f7ae0aef93334fa599be6d1a4d728595',uuid=8fdfaf32-0957-453a-b1cf-9a3c19815c45,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fb4a2e2a-cbf2-4141-bac3-c6033653bb84", "address": "fa:16:3e:c1:11:0e", "network": {"id": "1e184b35-0ffc-4c89-951b-d97b1961f72f", "bridge": "br-int", "label": "tempest-TestStampPattern-2134909631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c9e5daa31ad47e996b59f1b7c5db0d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb4a2e2a-cb", "ovs_interfaceid": "fb4a2e2a-cbf2-4141-bac3-c6033653bb84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73449) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 12:04:00 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-6a417df7-6f0d-42f8-8c23-8bc23c874c54 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Converting VIF {"id": "fb4a2e2a-cbf2-4141-bac3-c6033653bb84", "address": "fa:16:3e:c1:11:0e", "network": {"id": "1e184b35-0ffc-4c89-951b-d97b1961f72f", "bridge": "br-int", "label": "tempest-TestStampPattern-2134909631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c9e5daa31ad47e996b59f1b7c5db0d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb4a2e2a-cb", "ovs_interfaceid": "fb4a2e2a-cbf2-4141-bac3-c6033653bb84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 12:04:00 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-6a417df7-6f0d-42f8-8c23-8bc23c874c54 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:11:0e,bridge_name='br-int',has_traffic_filtering=True,id=fb4a2e2a-cbf2-4141-bac3-c6033653bb84,network=Network(1e184b35-0ffc-4c89-951b-d97b1961f72f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb4a2e2a-cb') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 12:04:00 user nova-compute[73449]: DEBUG nova.objects.instance [None req-6a417df7-6f0d-42f8-8c23-8bc23c874c54 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Lazy-loading 'pci_devices' on Instance uuid 8fdfaf32-0957-453a-b1cf-9a3c19815c45 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:04:00 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6a417df7-6f0d-42f8-8c23-8bc23c874c54 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] [instance: 8fdfaf32-0957-453a-b1cf-9a3c19815c45] End _get_guest_xml xml=<domain type="kvm">
Aug 17 12:04:00 user nova-compute[73449]:   <uuid>8fdfaf32-0957-453a-b1cf-9a3c19815c45</uuid>
Aug 17 12:04:00 user nova-compute[73449]:   <name>instance-0000002f</name>
Aug 17 12:04:00 user nova-compute[73449]:   <memory>524288</memory>
Aug 17 12:04:00 user nova-compute[73449]:   <vcpu>1</vcpu>
Aug 17 12:04:00 user nova-compute[73449]:   <metadata>
Aug 17 12:04:00 user nova-compute[73449]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 12:04:00 user nova-compute[73449]:       <nova:package version="0.0.0"/>
Aug 17 12:04:00 user nova-compute[73449]:       <nova:name>tempest-TestStampPattern-server-1756393260</nova:name>
Aug 17 12:04:00 user nova-compute[73449]:       <nova:creationTime>2023-08-17 12:04:00</nova:creationTime>
Aug 17 12:04:00 user nova-compute[73449]:       <nova:flavor name="m1.tiny">
Aug 17 12:04:00 user nova-compute[73449]:         <nova:memory>512</nova:memory>
Aug 17 12:04:00 user nova-compute[73449]:         <nova:disk>1</nova:disk>
Aug 17 12:04:00 user nova-compute[73449]:         <nova:swap>0</nova:swap>
Aug 17 12:04:00 user nova-compute[73449]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 12:04:00 user nova-compute[73449]:         <nova:vcpus>1</nova:vcpus>
Aug 17 12:04:00 user nova-compute[73449]:       </nova:flavor>
Aug 17 12:04:00 user nova-compute[73449]:       <nova:owner>
Aug 17 12:04:00 user nova-compute[73449]:         <nova:user uuid="f7ae0aef93334fa599be6d1a4d728595">tempest-TestStampPattern-806391027-project-member</nova:user>
Aug 17 12:04:00 user nova-compute[73449]:         <nova:project uuid="3c9e5daa31ad47e996b59f1b7c5db0d4">tempest-TestStampPattern-806391027</nova:project>
Aug 17 12:04:00 user nova-compute[73449]:       </nova:owner>
Aug 17 12:04:00 user nova-compute[73449]:       <nova:root type="image" uuid="0a2904ae-083d-41c8-83db-343132b36148"/>
Aug 17 12:04:00 user nova-compute[73449]:       <nova:ports>
Aug 17 12:04:00 user nova-compute[73449]:         <nova:port uuid="fb4a2e2a-cbf2-4141-bac3-c6033653bb84">
Aug 17 12:04:00 user nova-compute[73449]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 17 12:04:00 user nova-compute[73449]:         </nova:port>
Aug 17 12:04:00 user nova-compute[73449]:       </nova:ports>
Aug 17 12:04:00 user nova-compute[73449]:     </nova:instance>
Aug 17 12:04:00 user nova-compute[73449]:   </metadata>
Aug 17 12:04:00 user nova-compute[73449]:   <sysinfo type="smbios">
Aug 17 12:04:00 user nova-compute[73449]:     <system>
Aug 17 12:04:00 user nova-compute[73449]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 12:04:00 user nova-compute[73449]:       <entry name="product">OpenStack Nova</entry>
Aug 17 12:04:00 user nova-compute[73449]:       <entry name="version">0.0.0</entry>
Aug 17 12:04:00 user nova-compute[73449]:       <entry name="serial">8fdfaf32-0957-453a-b1cf-9a3c19815c45</entry>
Aug 17 12:04:00 user nova-compute[73449]:       <entry name="uuid">8fdfaf32-0957-453a-b1cf-9a3c19815c45</entry>
Aug 17 12:04:00 user nova-compute[73449]:       <entry name="family">Virtual Machine</entry>
Aug 17 12:04:00 user nova-compute[73449]:     </system>
Aug 17 12:04:00 user nova-compute[73449]:   </sysinfo>
Aug 17 12:04:00 user nova-compute[73449]:   <os>
Aug 17 12:04:00 user nova-compute[73449]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 12:04:00 user nova-compute[73449]:     <boot dev="hd"/>
Aug 17 12:04:00 user nova-compute[73449]:     <smbios mode="sysinfo"/>
Aug 17 12:04:00 user nova-compute[73449]:   </os>
Aug 17 12:04:00 user nova-compute[73449]:   <features>
Aug 17 12:04:00 user nova-compute[73449]:     <acpi/>
Aug 17 12:04:00 user nova-compute[73449]:     <apic/>
Aug 17 12:04:00 user nova-compute[73449]:     <vmcoreinfo/>
Aug 17 12:04:00 user nova-compute[73449]:   </features>
Aug 17 12:04:00 user nova-compute[73449]:   <clock offset="utc">
Aug 17 12:04:00 user nova-compute[73449]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 12:04:00 user nova-compute[73449]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 12:04:00 user nova-compute[73449]:     <timer name="hpet" present="no"/>
Aug 17 12:04:00 user nova-compute[73449]:   </clock>
Aug 17 12:04:00 user nova-compute[73449]:   <cpu mode="custom" match="exact">
Aug 17 12:04:00 user nova-compute[73449]:     <model>Nehalem</model>
Aug 17 12:04:00 user nova-compute[73449]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 12:04:00 user nova-compute[73449]:   </cpu>
Aug 17 12:04:00 user nova-compute[73449]:   <devices>
Aug 17 12:04:00 user nova-compute[73449]:     <disk type="file" device="disk">
Aug 17 12:04:00 user nova-compute[73449]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 12:04:00 user nova-compute[73449]:       <source file="/opt/stack/data/nova/instances/8fdfaf32-0957-453a-b1cf-9a3c19815c45/disk"/>
Aug 17 12:04:00 user nova-compute[73449]:       <target dev="vda" bus="virtio"/>
Aug 17 12:04:00 user nova-compute[73449]:     </disk>
Aug 17 12:04:00 user nova-compute[73449]:     <interface type="ethernet">
Aug 17 12:04:00 user nova-compute[73449]:       <mac address="fa:16:3e:c1:11:0e"/>
Aug 17 12:04:00 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 12:04:00 user nova-compute[73449]:       <mtu size="1442"/>
Aug 17 12:04:00 user nova-compute[73449]:       <target dev="tapfb4a2e2a-cb"/>
Aug 17 12:04:00 user nova-compute[73449]:     </interface>
Aug 17 12:04:00 user nova-compute[73449]:     <serial type="pty">
Aug 17 12:04:00 user nova-compute[73449]:       <log file="/opt/stack/data/nova/instances/8fdfaf32-0957-453a-b1cf-9a3c19815c45/console.log" append="off"/>
Aug 17 12:04:00 user nova-compute[73449]:     </serial>
Aug 17 12:04:00 user nova-compute[73449]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 12:04:00 user nova-compute[73449]:     <video>
Aug 17 12:04:00 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 12:04:00 user nova-compute[73449]:     </video>
Aug 17 12:04:00 user nova-compute[73449]:     <rng model="virtio">
Aug 17 12:04:00 user nova-compute[73449]:       <backend model="random">/dev/urandom</backend>
Aug 17 12:04:00 user nova-compute[73449]:     </rng>
Aug 17 12:04:00 user nova-compute[73449]:     <controller type="usb" index="0" model="none"/>
Aug 17 12:04:00 user nova-compute[73449]:     <memballoon model="virtio">
Aug 17 12:04:00 user nova-compute[73449]:       <stats period="10"/>
Aug 17 12:04:00 user nova-compute[73449]:     </memballoon>
Aug 17 12:04:00 user nova-compute[73449]:   </devices>
Aug 17 12:04:00 user nova-compute[73449]: </domain>
Aug 17 12:04:00 user nova-compute[73449]:  {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 12:04:00 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-6a417df7-6f0d-42f8-8c23-8bc23c874c54 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T12:03:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1756393260',display_name='tempest-TestStampPattern-server-1756393260',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1756393260',id=47,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIJ2Eo5DY98v4ABNkSPsmOpSAggLOMtuKT7FC5l8WhxwKHhwEcVH95zEdzfXTi8XjE0vKAypvTBXbrGRvlqVzqU569MwCVfJPBtduUClfPdtl8n174kTkHvx5qjovHToOQ==',key_name='tempest-TestStampPattern-923522805',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3c9e5daa31ad47e996b59f1b7c5db0d4',ramdisk_id='',reservation_id='r-ikb0vnkf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-806391027',owner_user_name='tempest-TestStampPattern-806391027-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T12:03:58Z,user_data=None,user_id='f7ae0aef93334fa599be6d1a4d728595',uuid=8fdfaf32-0957-453a-b1cf-9a3c19815c45,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fb4a2e2a-cbf2-4141-bac3-c6033653bb84", "address": "fa:16:3e:c1:11:0e", "network": {"id": "1e184b35-0ffc-4c89-951b-d97b1961f72f", "bridge": "br-int", "label": "tempest-TestStampPattern-2134909631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c9e5daa31ad47e996b59f1b7c5db0d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb4a2e2a-cb", "ovs_interfaceid": "fb4a2e2a-cbf2-4141-bac3-c6033653bb84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 12:04:00 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-6a417df7-6f0d-42f8-8c23-8bc23c874c54 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Converting VIF {"id": "fb4a2e2a-cbf2-4141-bac3-c6033653bb84", "address": "fa:16:3e:c1:11:0e", "network": {"id": "1e184b35-0ffc-4c89-951b-d97b1961f72f", "bridge": "br-int", "label": "tempest-TestStampPattern-2134909631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c9e5daa31ad47e996b59f1b7c5db0d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb4a2e2a-cb", "ovs_interfaceid": "fb4a2e2a-cbf2-4141-bac3-c6033653bb84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 12:04:00 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-6a417df7-6f0d-42f8-8c23-8bc23c874c54 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:11:0e,bridge_name='br-int',has_traffic_filtering=True,id=fb4a2e2a-cbf2-4141-bac3-c6033653bb84,network=Network(1e184b35-0ffc-4c89-951b-d97b1961f72f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb4a2e2a-cb') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 12:04:00 user nova-compute[73449]: DEBUG os_vif [None req-6a417df7-6f0d-42f8-8c23-8bc23c874c54 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:11:0e,bridge_name='br-int',has_traffic_filtering=True,id=fb4a2e2a-cbf2-4141-bac3-c6033653bb84,network=Network(1e184b35-0ffc-4c89-951b-d97b1961f72f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb4a2e2a-cb') {{(pid=73449) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 12:04:00 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:04:00 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 12:04:00 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 12:04:00 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:04:00 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfb4a2e2a-cb, may_exist=True, interface_attrs={}) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 12:04:00 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfb4a2e2a-cb, col_values=(('external_ids', {'iface-id': 'fb4a2e2a-cbf2-4141-bac3-c6033653bb84', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c1:11:0e', 'vm-uuid': '8fdfaf32-0957-453a-b1cf-9a3c19815c45'}),), if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 12:04:00 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:04:00 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:04:00 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:04:00 user nova-compute[73449]: INFO os_vif [None req-6a417df7-6f0d-42f8-8c23-8bc23c874c54 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:11:0e,bridge_name='br-int',has_traffic_filtering=True,id=fb4a2e2a-cbf2-4141-bac3-c6033653bb84,network=Network(1e184b35-0ffc-4c89-951b-d97b1961f72f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb4a2e2a-cb')
Aug 17 12:04:00 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6a417df7-6f0d-42f8-8c23-8bc23c874c54 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] No BDM found with device name vda, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 12:04:00 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6a417df7-6f0d-42f8-8c23-8bc23c874c54 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] No VIF found with MAC fa:16:3e:c1:11:0e, not building metadata {{(pid=73449) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 12:04:00 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:04:00 user nova-compute[73449]: DEBUG nova.compute.manager [req-32d28781-b9b2-411b-8f5c-53e9f9160829 req-51e0ec49-aaa4-4bf9-8b10-6da40fc7dda4 service nova] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] Received event network-vif-plugged-69831639-3628-4b42-8ddd-fe0965dea4b6 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:04:00 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-32d28781-b9b2-411b-8f5c-53e9f9160829 req-51e0ec49-aaa4-4bf9-8b10-6da40fc7dda4 service nova] Acquiring lock "5a627da9-03a1-4239-8721-cefe99c39ee2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:04:00 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-32d28781-b9b2-411b-8f5c-53e9f9160829 req-51e0ec49-aaa4-4bf9-8b10-6da40fc7dda4 service nova] Lock "5a627da9-03a1-4239-8721-cefe99c39ee2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:04:00 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-32d28781-b9b2-411b-8f5c-53e9f9160829 req-51e0ec49-aaa4-4bf9-8b10-6da40fc7dda4 service nova] Lock "5a627da9-03a1-4239-8721-cefe99c39ee2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:04:00 user nova-compute[73449]: DEBUG nova.compute.manager [req-32d28781-b9b2-411b-8f5c-53e9f9160829 req-51e0ec49-aaa4-4bf9-8b10-6da40fc7dda4 service nova] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] No waiting events found dispatching network-vif-plugged-69831639-3628-4b42-8ddd-fe0965dea4b6 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 12:04:00 user nova-compute[73449]: WARNING nova.compute.manager [req-32d28781-b9b2-411b-8f5c-53e9f9160829 req-51e0ec49-aaa4-4bf9-8b10-6da40fc7dda4 service nova] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] Received unexpected event network-vif-plugged-69831639-3628-4b42-8ddd-fe0965dea4b6 for instance with vm_state active and task_state rescuing.
Aug 17 12:04:00 user nova-compute[73449]: DEBUG nova.compute.manager [req-32d28781-b9b2-411b-8f5c-53e9f9160829 req-51e0ec49-aaa4-4bf9-8b10-6da40fc7dda4 service nova] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] Received event network-vif-plugged-69831639-3628-4b42-8ddd-fe0965dea4b6 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:04:00 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-32d28781-b9b2-411b-8f5c-53e9f9160829 req-51e0ec49-aaa4-4bf9-8b10-6da40fc7dda4 service nova] Acquiring lock "5a627da9-03a1-4239-8721-cefe99c39ee2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:04:00 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-32d28781-b9b2-411b-8f5c-53e9f9160829 req-51e0ec49-aaa4-4bf9-8b10-6da40fc7dda4 service nova] Lock "5a627da9-03a1-4239-8721-cefe99c39ee2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:04:00 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-32d28781-b9b2-411b-8f5c-53e9f9160829 req-51e0ec49-aaa4-4bf9-8b10-6da40fc7dda4 service nova] Lock "5a627da9-03a1-4239-8721-cefe99c39ee2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:04:00 user nova-compute[73449]: DEBUG nova.compute.manager [req-32d28781-b9b2-411b-8f5c-53e9f9160829 req-51e0ec49-aaa4-4bf9-8b10-6da40fc7dda4 service nova] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] No waiting events found dispatching network-vif-plugged-69831639-3628-4b42-8ddd-fe0965dea4b6 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 12:04:00 user nova-compute[73449]: WARNING nova.compute.manager [req-32d28781-b9b2-411b-8f5c-53e9f9160829 req-51e0ec49-aaa4-4bf9-8b10-6da40fc7dda4 service nova] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] Received unexpected event network-vif-plugged-69831639-3628-4b42-8ddd-fe0965dea4b6 for instance with vm_state active and task_state rescuing.
Aug 17 12:04:00 user nova-compute[73449]: DEBUG nova.compute.manager [req-32d28781-b9b2-411b-8f5c-53e9f9160829 req-51e0ec49-aaa4-4bf9-8b10-6da40fc7dda4 service nova] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] Received event network-vif-plugged-69831639-3628-4b42-8ddd-fe0965dea4b6 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:04:00 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-32d28781-b9b2-411b-8f5c-53e9f9160829 req-51e0ec49-aaa4-4bf9-8b10-6da40fc7dda4 service nova] Acquiring lock "5a627da9-03a1-4239-8721-cefe99c39ee2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:04:00 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-32d28781-b9b2-411b-8f5c-53e9f9160829 req-51e0ec49-aaa4-4bf9-8b10-6da40fc7dda4 service nova] Lock "5a627da9-03a1-4239-8721-cefe99c39ee2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:04:00 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-32d28781-b9b2-411b-8f5c-53e9f9160829 req-51e0ec49-aaa4-4bf9-8b10-6da40fc7dda4 service nova] Lock "5a627da9-03a1-4239-8721-cefe99c39ee2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:04:00 user nova-compute[73449]: DEBUG nova.compute.manager [req-32d28781-b9b2-411b-8f5c-53e9f9160829 req-51e0ec49-aaa4-4bf9-8b10-6da40fc7dda4 service nova] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] No waiting events found dispatching network-vif-plugged-69831639-3628-4b42-8ddd-fe0965dea4b6 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 12:04:00 user nova-compute[73449]: WARNING nova.compute.manager [req-32d28781-b9b2-411b-8f5c-53e9f9160829 req-51e0ec49-aaa4-4bf9-8b10-6da40fc7dda4 service nova] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] Received unexpected event network-vif-plugged-69831639-3628-4b42-8ddd-fe0965dea4b6 for instance with vm_state active and task_state rescuing.
Aug 17 12:04:01 user nova-compute[73449]: DEBUG nova.network.neutron [req-49e99798-ada3-4573-ad11-977d4e0c49c8 req-5ed48679-2861-4346-b1dd-a5b9b57d101a service nova] [instance: 8fdfaf32-0957-453a-b1cf-9a3c19815c45] Updated VIF entry in instance network info cache for port fb4a2e2a-cbf2-4141-bac3-c6033653bb84. {{(pid=73449) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 12:04:01 user nova-compute[73449]: DEBUG nova.network.neutron [req-49e99798-ada3-4573-ad11-977d4e0c49c8 req-5ed48679-2861-4346-b1dd-a5b9b57d101a service nova] [instance: 8fdfaf32-0957-453a-b1cf-9a3c19815c45] Updating instance_info_cache with network_info: [{"id": "fb4a2e2a-cbf2-4141-bac3-c6033653bb84", "address": "fa:16:3e:c1:11:0e", "network": {"id": "1e184b35-0ffc-4c89-951b-d97b1961f72f", "bridge": "br-int", "label": "tempest-TestStampPattern-2134909631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c9e5daa31ad47e996b59f1b7c5db0d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb4a2e2a-cb", "ovs_interfaceid": "fb4a2e2a-cbf2-4141-bac3-c6033653bb84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 12:04:01 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-49e99798-ada3-4573-ad11-977d4e0c49c8 req-5ed48679-2861-4346-b1dd-a5b9b57d101a service nova] Releasing lock "refresh_cache-8fdfaf32-0957-453a-b1cf-9a3c19815c45" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 12:04:01 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Removed pending event for 5a627da9-03a1-4239-8721-cefe99c39ee2 due to event {{(pid=73449) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 17 12:04:01 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692273841.403945, 5a627da9-03a1-4239-8721-cefe99c39ee2 => Resumed> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 12:04:01 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] VM Resumed (Lifecycle Event)
Aug 17 12:04:01 user nova-compute[73449]: DEBUG nova.compute.manager [None req-bdcbe8be-46eb-4e50-8182-adbb9e049dbc tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 12:04:01 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 12:04:01 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 12:04:01 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 17 12:04:01 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692273841.4044456, 5a627da9-03a1-4239-8721-cefe99c39ee2 => Started> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 12:04:01 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] VM Started (Lifecycle Event)
Aug 17 12:04:01 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 12:04:01 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 12:04:02 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:04:02 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:04:02 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:04:02 user nova-compute[73449]: DEBUG nova.compute.manager [req-e7cc902b-fdb3-4c12-b197-508ab3405be8 req-74d6148d-9355-4442-8fd2-e4456ff2ba48 service nova] [instance: 8fdfaf32-0957-453a-b1cf-9a3c19815c45] Received event network-vif-plugged-fb4a2e2a-cbf2-4141-bac3-c6033653bb84 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:04:02 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-e7cc902b-fdb3-4c12-b197-508ab3405be8 req-74d6148d-9355-4442-8fd2-e4456ff2ba48 service nova] Acquiring lock "8fdfaf32-0957-453a-b1cf-9a3c19815c45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:04:02 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-e7cc902b-fdb3-4c12-b197-508ab3405be8 req-74d6148d-9355-4442-8fd2-e4456ff2ba48 service nova] Lock "8fdfaf32-0957-453a-b1cf-9a3c19815c45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:04:02 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-e7cc902b-fdb3-4c12-b197-508ab3405be8 req-74d6148d-9355-4442-8fd2-e4456ff2ba48 service nova] Lock "8fdfaf32-0957-453a-b1cf-9a3c19815c45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:04:02 user nova-compute[73449]: DEBUG nova.compute.manager [req-e7cc902b-fdb3-4c12-b197-508ab3405be8 req-74d6148d-9355-4442-8fd2-e4456ff2ba48 service nova] [instance: 8fdfaf32-0957-453a-b1cf-9a3c19815c45] No waiting events found dispatching network-vif-plugged-fb4a2e2a-cbf2-4141-bac3-c6033653bb84 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 12:04:02 user nova-compute[73449]: WARNING nova.compute.manager [req-e7cc902b-fdb3-4c12-b197-508ab3405be8 req-74d6148d-9355-4442-8fd2-e4456ff2ba48 service nova] [instance: 8fdfaf32-0957-453a-b1cf-9a3c19815c45] Received unexpected event network-vif-plugged-fb4a2e2a-cbf2-4141-bac3-c6033653bb84 for instance with vm_state building and task_state spawning.
Aug 17 12:04:02 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:04:03 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:04:03 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:04:03 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:04:03 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:04:04 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:04:04 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692273844.5292492, 8fdfaf32-0957-453a-b1cf-9a3c19815c45 => Resumed> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 12:04:04 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 8fdfaf32-0957-453a-b1cf-9a3c19815c45] VM Resumed (Lifecycle Event)
Aug 17 12:04:04 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6a417df7-6f0d-42f8-8c23-8bc23c874c54 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] [instance: 8fdfaf32-0957-453a-b1cf-9a3c19815c45] Instance event wait completed in 0 seconds for  {{(pid=73449) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 12:04:04 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6a417df7-6f0d-42f8-8c23-8bc23c874c54 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] [instance: 8fdfaf32-0957-453a-b1cf-9a3c19815c45] Guest created on hypervisor {{(pid=73449) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 12:04:04 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: 8fdfaf32-0957-453a-b1cf-9a3c19815c45] Instance spawned successfully.
Aug 17 12:04:04 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6a417df7-6f0d-42f8-8c23-8bc23c874c54 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] [instance: 8fdfaf32-0957-453a-b1cf-9a3c19815c45] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 12:04:04 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 8fdfaf32-0957-453a-b1cf-9a3c19815c45] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 12:04:04 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 8fdfaf32-0957-453a-b1cf-9a3c19815c45] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 12:04:04 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6a417df7-6f0d-42f8-8c23-8bc23c874c54 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] [instance: 8fdfaf32-0957-453a-b1cf-9a3c19815c45] Found default for hw_cdrom_bus of ide {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 12:04:04 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6a417df7-6f0d-42f8-8c23-8bc23c874c54 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] [instance: 8fdfaf32-0957-453a-b1cf-9a3c19815c45] Found default for hw_disk_bus of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 12:04:04 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6a417df7-6f0d-42f8-8c23-8bc23c874c54 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] [instance: 8fdfaf32-0957-453a-b1cf-9a3c19815c45] Found default for hw_input_bus of None {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 12:04:04 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6a417df7-6f0d-42f8-8c23-8bc23c874c54 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] [instance: 8fdfaf32-0957-453a-b1cf-9a3c19815c45] Found default for hw_pointer_model of None {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 12:04:04 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6a417df7-6f0d-42f8-8c23-8bc23c874c54 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] [instance: 8fdfaf32-0957-453a-b1cf-9a3c19815c45] Found default for hw_video_model of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 12:04:04 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6a417df7-6f0d-42f8-8c23-8bc23c874c54 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] [instance: 8fdfaf32-0957-453a-b1cf-9a3c19815c45] Found default for hw_vif_model of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 12:04:04 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 8fdfaf32-0957-453a-b1cf-9a3c19815c45] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 12:04:04 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692273844.530549, 8fdfaf32-0957-453a-b1cf-9a3c19815c45 => Started> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 12:04:04 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 8fdfaf32-0957-453a-b1cf-9a3c19815c45] VM Started (Lifecycle Event)
Aug 17 12:04:04 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 8fdfaf32-0957-453a-b1cf-9a3c19815c45] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 12:04:04 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 8fdfaf32-0957-453a-b1cf-9a3c19815c45] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 12:04:04 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 8fdfaf32-0957-453a-b1cf-9a3c19815c45] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 12:04:04 user nova-compute[73449]: INFO nova.compute.manager [None req-6a417df7-6f0d-42f8-8c23-8bc23c874c54 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] [instance: 8fdfaf32-0957-453a-b1cf-9a3c19815c45] Took 6.42 seconds to spawn the instance on the hypervisor.
Aug 17 12:04:04 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6a417df7-6f0d-42f8-8c23-8bc23c874c54 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] [instance: 8fdfaf32-0957-453a-b1cf-9a3c19815c45] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 12:04:04 user nova-compute[73449]: DEBUG nova.compute.manager [req-7585df36-2bfa-45d9-b5ac-baf70ca49b84 req-bee30b3b-d412-4f31-8a7e-89772404b0fe service nova] [instance: 8fdfaf32-0957-453a-b1cf-9a3c19815c45] Received event network-vif-plugged-fb4a2e2a-cbf2-4141-bac3-c6033653bb84 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:04:04 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-7585df36-2bfa-45d9-b5ac-baf70ca49b84 req-bee30b3b-d412-4f31-8a7e-89772404b0fe service nova] Acquiring lock "8fdfaf32-0957-453a-b1cf-9a3c19815c45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:04:04 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-7585df36-2bfa-45d9-b5ac-baf70ca49b84 req-bee30b3b-d412-4f31-8a7e-89772404b0fe service nova] Lock "8fdfaf32-0957-453a-b1cf-9a3c19815c45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:04:04 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-7585df36-2bfa-45d9-b5ac-baf70ca49b84 req-bee30b3b-d412-4f31-8a7e-89772404b0fe service nova] Lock "8fdfaf32-0957-453a-b1cf-9a3c19815c45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:04:04 user nova-compute[73449]: DEBUG nova.compute.manager [req-7585df36-2bfa-45d9-b5ac-baf70ca49b84 req-bee30b3b-d412-4f31-8a7e-89772404b0fe service nova] [instance: 8fdfaf32-0957-453a-b1cf-9a3c19815c45] No waiting events found dispatching network-vif-plugged-fb4a2e2a-cbf2-4141-bac3-c6033653bb84 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 12:04:04 user nova-compute[73449]: WARNING nova.compute.manager [req-7585df36-2bfa-45d9-b5ac-baf70ca49b84 req-bee30b3b-d412-4f31-8a7e-89772404b0fe service nova] [instance: 8fdfaf32-0957-453a-b1cf-9a3c19815c45] Received unexpected event network-vif-plugged-fb4a2e2a-cbf2-4141-bac3-c6033653bb84 for instance with vm_state building and task_state spawning.
Aug 17 12:04:04 user nova-compute[73449]: INFO nova.compute.manager [None req-6a417df7-6f0d-42f8-8c23-8bc23c874c54 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] [instance: 8fdfaf32-0957-453a-b1cf-9a3c19815c45] Took 7.14 seconds to build instance.
Aug 17 12:04:04 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6a417df7-6f0d-42f8-8c23-8bc23c874c54 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Lock "8fdfaf32-0957-453a-b1cf-9a3c19815c45" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.279s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:04:06 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:04:06 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:04:06 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:04:06 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73449) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 12:04:08 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:04:08 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:04:09 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:04:11 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:04:11 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:04:11 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:04:11 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:04:11 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:04:11 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:04:11 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=73449) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 12:04:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/712c777e-251b-43d8-b923-8eda693f32ed/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:04:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/712c777e-251b-43d8-b923-8eda693f32ed/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:04:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/712c777e-251b-43d8-b923-8eda693f32ed/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:04:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/712c777e-251b-43d8-b923-8eda693f32ed/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:04:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84763b6d-f33c-43d6-b6af-cac86fe8ea86/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:04:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84763b6d-f33c-43d6-b6af-cac86fe8ea86/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:04:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84763b6d-f33c-43d6-b6af-cac86fe8ea86/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:04:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84763b6d-f33c-43d6-b6af-cac86fe8ea86/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:04:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fdfaf32-0957-453a-b1cf-9a3c19815c45/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:04:13 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fdfaf32-0957-453a-b1cf-9a3c19815c45/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:04:13 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fdfaf32-0957-453a-b1cf-9a3c19815c45/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:04:13 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fdfaf32-0957-453a-b1cf-9a3c19815c45/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:04:13 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/509263cd-9995-4e6b-8b26-461b7eb05ded/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:04:13 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/509263cd-9995-4e6b-8b26-461b7eb05ded/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:04:13 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/509263cd-9995-4e6b-8b26-461b7eb05ded/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:04:13 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/509263cd-9995-4e6b-8b26-461b7eb05ded/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:04:13 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73449) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 12:04:13 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73449) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 12:04:13 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a627da9-03a1-4239-8721-cefe99c39ee2/disk.rescue --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:04:13 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a627da9-03a1-4239-8721-cefe99c39ee2/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:04:13 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a627da9-03a1-4239-8721-cefe99c39ee2/disk.rescue --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:04:14 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a627da9-03a1-4239-8721-cefe99c39ee2/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:04:14 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89440604-1daf-4e7a-a524-2f9c21a9cb96/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:04:14 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89440604-1daf-4e7a-a524-2f9c21a9cb96/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:04:14 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89440604-1daf-4e7a-a524-2f9c21a9cb96/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:04:14 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89440604-1daf-4e7a-a524-2f9c21a9cb96/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:04:14 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61201d5c-26f1-4c6d-a764-be2ee2e533ae/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:04:14 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61201d5c-26f1-4c6d-a764-be2ee2e533ae/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:04:14 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61201d5c-26f1-4c6d-a764-be2ee2e533ae/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:04:14 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61201d5c-26f1-4c6d-a764-be2ee2e533ae/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:04:14 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d160711b-0b77-4f9a-b1d9-f0ac16240d4d/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:04:14 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d160711b-0b77-4f9a-b1d9-f0ac16240d4d/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:04:15 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d160711b-0b77-4f9a-b1d9-f0ac16240d4d/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:04:15 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d160711b-0b77-4f9a-b1d9-f0ac16240d4d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:04:15 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73449) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 12:04:15 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 12:04:15 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 12:04:15 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Hypervisor/Node resource view: name=user free_ram=7584MB free_disk=24.837615966796875GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73449) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 12:04:15 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:04:15 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:04:15 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 89440604-1daf-4e7a-a524-2f9c21a9cb96 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 12:04:15 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 31f5f3d2-41d8-4a26-9eb2-18b891f94734 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 12:04:15 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 712c777e-251b-43d8-b923-8eda693f32ed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 12:04:15 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance d160711b-0b77-4f9a-b1d9-f0ac16240d4d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 12:04:15 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 5a627da9-03a1-4239-8721-cefe99c39ee2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 12:04:15 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 84763b6d-f33c-43d6-b6af-cac86fe8ea86 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 12:04:15 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 61201d5c-26f1-4c6d-a764-be2ee2e533ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 12:04:15 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 509263cd-9995-4e6b-8b26-461b7eb05ded actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 12:04:15 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 8fdfaf32-0957-453a-b1cf-9a3c19815c45 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 12:04:15 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73449) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 12:04:15 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73449) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 12:04:15 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 12:04:15 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 12:04:16 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Compute_service record updated for user:user {{(pid=73449) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 12:04:16 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.433s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:04:16 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:04:16 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:04:16 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73449) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 12:04:16 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:04:16 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:04:16 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:04:18 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:04:19 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:04:19 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Starting heal instance info cache {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 12:04:19 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Rebuilding the list of instances to heal {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 12:04:19 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "refresh_cache-89440604-1daf-4e7a-a524-2f9c21a9cb96" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 12:04:19 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquired lock "refresh_cache-89440604-1daf-4e7a-a524-2f9c21a9cb96" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 12:04:19 user nova-compute[73449]: DEBUG nova.network.neutron [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: 89440604-1daf-4e7a-a524-2f9c21a9cb96] Forcefully refreshing network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 12:04:19 user nova-compute[73449]: DEBUG nova.objects.instance [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lazy-loading 'info_cache' on Instance uuid 89440604-1daf-4e7a-a524-2f9c21a9cb96 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:04:19 user nova-compute[73449]: DEBUG nova.network.neutron [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: 89440604-1daf-4e7a-a524-2f9c21a9cb96] Updating instance_info_cache with network_info: [{"id": "7ebcec20-01ec-4807-876d-d95bff0a8a77", "address": "fa:16:3e:52:45:6e", "network": {"id": "9455bb75-f75a-41ff-8f6f-49f55aa738f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-425274599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec3b0b72e47448ebe99f9fc64119c1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ebcec20-01", "ovs_interfaceid": "7ebcec20-01ec-4807-876d-d95bff0a8a77", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 12:04:19 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Releasing lock "refresh_cache-89440604-1daf-4e7a-a524-2f9c21a9cb96" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 12:04:19 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: 89440604-1daf-4e7a-a524-2f9c21a9cb96] Updated the network info_cache for instance {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 12:04:19 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:04:21 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:04:23 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:04:26 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:04:28 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:04:31 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:04:33 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:04:33 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:04:36 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:04:38 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:04:39 user nova-compute[73449]: DEBUG nova.compute.manager [req-a344ec70-8883-47be-a06f-22cd1454cf89 req-5ae5e881-07bb-4c06-9be5-a97a8dacf31e service nova] [instance: 84763b6d-f33c-43d6-b6af-cac86fe8ea86] Received event network-changed-01b9226a-408b-4422-a876-eff4944132c7 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:04:39 user nova-compute[73449]: DEBUG nova.compute.manager [req-a344ec70-8883-47be-a06f-22cd1454cf89 req-5ae5e881-07bb-4c06-9be5-a97a8dacf31e service nova] [instance: 84763b6d-f33c-43d6-b6af-cac86fe8ea86] Refreshing instance network info cache due to event network-changed-01b9226a-408b-4422-a876-eff4944132c7. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 12:04:39 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-a344ec70-8883-47be-a06f-22cd1454cf89 req-5ae5e881-07bb-4c06-9be5-a97a8dacf31e service nova] Acquiring lock "refresh_cache-84763b6d-f33c-43d6-b6af-cac86fe8ea86" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 12:04:39 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-a344ec70-8883-47be-a06f-22cd1454cf89 req-5ae5e881-07bb-4c06-9be5-a97a8dacf31e service nova] Acquired lock "refresh_cache-84763b6d-f33c-43d6-b6af-cac86fe8ea86" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 12:04:39 user nova-compute[73449]: DEBUG nova.network.neutron [req-a344ec70-8883-47be-a06f-22cd1454cf89 req-5ae5e881-07bb-4c06-9be5-a97a8dacf31e service nova] [instance: 84763b6d-f33c-43d6-b6af-cac86fe8ea86] Refreshing network info cache for port 01b9226a-408b-4422-a876-eff4944132c7 {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 12:04:40 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-5e798859-5e59-40e4-905a-81b8267bc788 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Acquiring lock "84763b6d-f33c-43d6-b6af-cac86fe8ea86" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:04:40 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-5e798859-5e59-40e4-905a-81b8267bc788 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Lock "84763b6d-f33c-43d6-b6af-cac86fe8ea86" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:04:40 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-5e798859-5e59-40e4-905a-81b8267bc788 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Acquiring lock "84763b6d-f33c-43d6-b6af-cac86fe8ea86-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:04:40 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-5e798859-5e59-40e4-905a-81b8267bc788 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Lock "84763b6d-f33c-43d6-b6af-cac86fe8ea86-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:04:40 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-5e798859-5e59-40e4-905a-81b8267bc788 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Lock "84763b6d-f33c-43d6-b6af-cac86fe8ea86-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:04:40 user nova-compute[73449]: INFO nova.compute.manager [None req-5e798859-5e59-40e4-905a-81b8267bc788 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: 84763b6d-f33c-43d6-b6af-cac86fe8ea86] Terminating instance
Aug 17 12:04:40 user nova-compute[73449]: DEBUG nova.compute.manager [None req-5e798859-5e59-40e4-905a-81b8267bc788 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: 84763b6d-f33c-43d6-b6af-cac86fe8ea86] Start destroying the instance on the hypervisor. {{(pid=73449) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 12:04:40 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:04:40 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:04:40 user nova-compute[73449]: DEBUG nova.network.neutron [req-a344ec70-8883-47be-a06f-22cd1454cf89 req-5ae5e881-07bb-4c06-9be5-a97a8dacf31e service nova] [instance: 84763b6d-f33c-43d6-b6af-cac86fe8ea86] Updated VIF entry in instance network info cache for port 01b9226a-408b-4422-a876-eff4944132c7. {{(pid=73449) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 12:04:40 user nova-compute[73449]: DEBUG nova.network.neutron [req-a344ec70-8883-47be-a06f-22cd1454cf89 req-5ae5e881-07bb-4c06-9be5-a97a8dacf31e service nova] [instance: 84763b6d-f33c-43d6-b6af-cac86fe8ea86] Updating instance_info_cache with network_info: [{"id": "01b9226a-408b-4422-a876-eff4944132c7", "address": "fa:16:3e:a1:6c:41", "network": {"id": "71648e1b-cf19-44b7-bae2-9d38543cdee9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-822323626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75aa99e369c54b65aff27adbb1daf2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b9226a-40", "ovs_interfaceid": "01b9226a-408b-4422-a876-eff4944132c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 12:04:40 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-a344ec70-8883-47be-a06f-22cd1454cf89 req-5ae5e881-07bb-4c06-9be5-a97a8dacf31e service nova] Releasing lock "refresh_cache-84763b6d-f33c-43d6-b6af-cac86fe8ea86" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 12:04:40 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:04:40 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:04:40 user nova-compute[73449]: DEBUG nova.compute.manager [req-89b1bbfb-4c1e-4f5c-8402-a6ff4e890e65 req-45835e26-3123-4f5b-a1c2-070c99a63ea1 service nova] [instance: 84763b6d-f33c-43d6-b6af-cac86fe8ea86] Received event network-vif-unplugged-01b9226a-408b-4422-a876-eff4944132c7 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:04:40 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-89b1bbfb-4c1e-4f5c-8402-a6ff4e890e65 req-45835e26-3123-4f5b-a1c2-070c99a63ea1 service nova] Acquiring lock "84763b6d-f33c-43d6-b6af-cac86fe8ea86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:04:40 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-89b1bbfb-4c1e-4f5c-8402-a6ff4e890e65 req-45835e26-3123-4f5b-a1c2-070c99a63ea1 service nova] Lock "84763b6d-f33c-43d6-b6af-cac86fe8ea86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:04:40 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-89b1bbfb-4c1e-4f5c-8402-a6ff4e890e65 req-45835e26-3123-4f5b-a1c2-070c99a63ea1 service nova] Lock "84763b6d-f33c-43d6-b6af-cac86fe8ea86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:04:40 user nova-compute[73449]: DEBUG nova.compute.manager [req-89b1bbfb-4c1e-4f5c-8402-a6ff4e890e65 req-45835e26-3123-4f5b-a1c2-070c99a63ea1 service nova] [instance: 84763b6d-f33c-43d6-b6af-cac86fe8ea86] No waiting events found dispatching network-vif-unplugged-01b9226a-408b-4422-a876-eff4944132c7 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 12:04:40 user nova-compute[73449]: DEBUG nova.compute.manager [req-89b1bbfb-4c1e-4f5c-8402-a6ff4e890e65 req-45835e26-3123-4f5b-a1c2-070c99a63ea1 service nova] [instance: 84763b6d-f33c-43d6-b6af-cac86fe8ea86] Received event network-vif-unplugged-01b9226a-408b-4422-a876-eff4944132c7 for instance with task_state deleting. {{(pid=73449) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 12:04:40 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: 84763b6d-f33c-43d6-b6af-cac86fe8ea86] Instance destroyed successfully.
Aug 17 12:04:40 user nova-compute[73449]: DEBUG nova.objects.instance [None req-5e798859-5e59-40e4-905a-81b8267bc788 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Lazy-loading 'resources' on Instance uuid 84763b6d-f33c-43d6-b6af-cac86fe8ea86 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:04:40 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-5e798859-5e59-40e4-905a-81b8267bc788 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T12:02:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1416254704',display_name='tempest-AttachVolumeNegativeTest-server-1416254704',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1416254704',id=44,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJXZrffYzBvrGoGcvriudgBTLydpnKmJaqhL3s638CRnSGatOnEqfmfk3RBliEdN1tqNfBvU1LpbyRMENj2AIbrE/P52bCPB2FB2WiZ+WdZ9DT1DlroXxY5/DB11w7BbYA==',key_name='tempest-keypair-1841019211',keypairs=<?>,launch_index=0,launched_at=2023-08-17T12:02:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='75aa99e369c54b65aff27adbb1daf2b8',ramdisk_id='',reservation_id='r-plvq6p5i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-165752051',owner_user_name='tempest-AttachVolumeNegativeTest-165752051-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T12:02:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55cde68973ca42d095180b5c0701b49b',uuid=84763b6d-f33c-43d6-b6af-cac86fe8ea86,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "01b9226a-408b-4422-a876-eff4944132c7", "address": "fa:16:3e:a1:6c:41", "network": {"id": "71648e1b-cf19-44b7-bae2-9d38543cdee9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-822323626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75aa99e369c54b65aff27adbb1daf2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b9226a-40", "ovs_interfaceid": "01b9226a-408b-4422-a876-eff4944132c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 12:04:40 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-5e798859-5e59-40e4-905a-81b8267bc788 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Converting VIF {"id": "01b9226a-408b-4422-a876-eff4944132c7", "address": "fa:16:3e:a1:6c:41", "network": {"id": "71648e1b-cf19-44b7-bae2-9d38543cdee9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-822323626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75aa99e369c54b65aff27adbb1daf2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b9226a-40", "ovs_interfaceid": "01b9226a-408b-4422-a876-eff4944132c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 12:04:40 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-5e798859-5e59-40e4-905a-81b8267bc788 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:6c:41,bridge_name='br-int',has_traffic_filtering=True,id=01b9226a-408b-4422-a876-eff4944132c7,network=Network(71648e1b-cf19-44b7-bae2-9d38543cdee9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01b9226a-40') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 12:04:40 user nova-compute[73449]: DEBUG os_vif [None req-5e798859-5e59-40e4-905a-81b8267bc788 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:6c:41,bridge_name='br-int',has_traffic_filtering=True,id=01b9226a-408b-4422-a876-eff4944132c7,network=Network(71648e1b-cf19-44b7-bae2-9d38543cdee9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01b9226a-40') {{(pid=73449) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 12:04:40 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:04:40 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap01b9226a-40, bridge=br-int, if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 12:04:40 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:04:40 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:04:40 user nova-compute[73449]: INFO os_vif [None req-5e798859-5e59-40e4-905a-81b8267bc788 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:6c:41,bridge_name='br-int',has_traffic_filtering=True,id=01b9226a-408b-4422-a876-eff4944132c7,network=Network(71648e1b-cf19-44b7-bae2-9d38543cdee9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01b9226a-40')
Aug 17 12:04:40 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-5e798859-5e59-40e4-905a-81b8267bc788 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: 84763b6d-f33c-43d6-b6af-cac86fe8ea86] Deleting instance files /opt/stack/data/nova/instances/84763b6d-f33c-43d6-b6af-cac86fe8ea86_del
Aug 17 12:04:40 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-5e798859-5e59-40e4-905a-81b8267bc788 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: 84763b6d-f33c-43d6-b6af-cac86fe8ea86] Deletion of /opt/stack/data/nova/instances/84763b6d-f33c-43d6-b6af-cac86fe8ea86_del complete
Aug 17 12:04:40 user nova-compute[73449]: INFO nova.compute.manager [None req-5e798859-5e59-40e4-905a-81b8267bc788 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: 84763b6d-f33c-43d6-b6af-cac86fe8ea86] Took 0.67 seconds to destroy the instance on the hypervisor.
Aug 17 12:04:40 user nova-compute[73449]: DEBUG oslo.service.loopingcall [None req-5e798859-5e59-40e4-905a-81b8267bc788 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73449) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 12:04:40 user nova-compute[73449]: DEBUG nova.compute.manager [-] [instance: 84763b6d-f33c-43d6-b6af-cac86fe8ea86] Deallocating network for instance {{(pid=73449) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 12:04:40 user nova-compute[73449]: DEBUG nova.network.neutron [-] [instance: 84763b6d-f33c-43d6-b6af-cac86fe8ea86] deallocate_for_instance() {{(pid=73449) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 12:04:42 user nova-compute[73449]: DEBUG nova.network.neutron [-] [instance: 84763b6d-f33c-43d6-b6af-cac86fe8ea86] Updating instance_info_cache with network_info: [] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 12:04:42 user nova-compute[73449]: INFO nova.compute.manager [-] [instance: 84763b6d-f33c-43d6-b6af-cac86fe8ea86] Took 1.39 seconds to deallocate network for instance.
Aug 17 12:04:42 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-5e798859-5e59-40e4-905a-81b8267bc788 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:04:42 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-5e798859-5e59-40e4-905a-81b8267bc788 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:04:42 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-5e798859-5e59-40e4-905a-81b8267bc788 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 12:04:42 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-5e798859-5e59-40e4-905a-81b8267bc788 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 12:04:42 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-5e798859-5e59-40e4-905a-81b8267bc788 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.262s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:04:42 user nova-compute[73449]: INFO nova.scheduler.client.report [None req-5e798859-5e59-40e4-905a-81b8267bc788 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Deleted allocations for instance 84763b6d-f33c-43d6-b6af-cac86fe8ea86
Aug 17 12:04:42 user nova-compute[73449]: DEBUG nova.compute.manager [req-321e7b42-e702-4364-8a80-362a2a8e40f0 req-eb3107ef-0f52-402b-b68c-3fd87132b098 service nova] [instance: 84763b6d-f33c-43d6-b6af-cac86fe8ea86] Received event network-vif-plugged-01b9226a-408b-4422-a876-eff4944132c7 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:04:42 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-321e7b42-e702-4364-8a80-362a2a8e40f0 req-eb3107ef-0f52-402b-b68c-3fd87132b098 service nova] Acquiring lock "84763b6d-f33c-43d6-b6af-cac86fe8ea86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:04:42 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-321e7b42-e702-4364-8a80-362a2a8e40f0 req-eb3107ef-0f52-402b-b68c-3fd87132b098 service nova] Lock "84763b6d-f33c-43d6-b6af-cac86fe8ea86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:04:42 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-321e7b42-e702-4364-8a80-362a2a8e40f0 req-eb3107ef-0f52-402b-b68c-3fd87132b098 service nova] Lock "84763b6d-f33c-43d6-b6af-cac86fe8ea86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:04:42 user nova-compute[73449]: DEBUG nova.compute.manager [req-321e7b42-e702-4364-8a80-362a2a8e40f0 req-eb3107ef-0f52-402b-b68c-3fd87132b098 service nova] [instance: 84763b6d-f33c-43d6-b6af-cac86fe8ea86] No waiting events found dispatching network-vif-plugged-01b9226a-408b-4422-a876-eff4944132c7 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 12:04:42 user nova-compute[73449]: WARNING nova.compute.manager [req-321e7b42-e702-4364-8a80-362a2a8e40f0 req-eb3107ef-0f52-402b-b68c-3fd87132b098 service nova] [instance: 84763b6d-f33c-43d6-b6af-cac86fe8ea86] Received unexpected event network-vif-plugged-01b9226a-408b-4422-a876-eff4944132c7 for instance with vm_state deleted and task_state None.
Aug 17 12:04:42 user nova-compute[73449]: DEBUG nova.compute.manager [req-321e7b42-e702-4364-8a80-362a2a8e40f0 req-eb3107ef-0f52-402b-b68c-3fd87132b098 service nova] [instance: 84763b6d-f33c-43d6-b6af-cac86fe8ea86] Received event network-vif-deleted-01b9226a-408b-4422-a876-eff4944132c7 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:04:42 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-5e798859-5e59-40e4-905a-81b8267bc788 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Lock "84763b6d-f33c-43d6-b6af-cac86fe8ea86" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.507s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:04:43 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:04:45 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:04:50 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:04:55 user nova-compute[73449]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692273880.6275675, 84763b6d-f33c-43d6-b6af-cac86fe8ea86 => Stopped> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 12:04:55 user nova-compute[73449]: INFO nova.compute.manager [-] [instance: 84763b6d-f33c-43d6-b6af-cac86fe8ea86] VM Stopped (Lifecycle Event)
Aug 17 12:04:55 user nova-compute[73449]: DEBUG nova.compute.manager [None req-326da858-7e49-40c8-8534-35cfb98f192f None None] [instance: 84763b6d-f33c-43d6-b6af-cac86fe8ea86] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 12:04:55 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:05:00 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:05:00 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:05:00 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5007 ms, sending inactivity probe {{(pid=73449) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 12:05:00 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:05:00 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:05:00 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:05:00 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:05:04 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:05:05 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:05:05 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:05:08 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:05:08 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73449) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 12:05:10 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:05:10 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:05:11 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:05:13 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:05:13 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:05:13 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:05:13 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:05:13 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=73449) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 12:05:14 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/712c777e-251b-43d8-b923-8eda693f32ed/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:05:14 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/712c777e-251b-43d8-b923-8eda693f32ed/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:05:14 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/712c777e-251b-43d8-b923-8eda693f32ed/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:05:14 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/712c777e-251b-43d8-b923-8eda693f32ed/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:05:14 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fdfaf32-0957-453a-b1cf-9a3c19815c45/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:05:14 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fdfaf32-0957-453a-b1cf-9a3c19815c45/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:05:14 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fdfaf32-0957-453a-b1cf-9a3c19815c45/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:05:14 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fdfaf32-0957-453a-b1cf-9a3c19815c45/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:05:14 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/509263cd-9995-4e6b-8b26-461b7eb05ded/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:05:15 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/509263cd-9995-4e6b-8b26-461b7eb05ded/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:05:15 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/509263cd-9995-4e6b-8b26-461b7eb05ded/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:05:15 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/509263cd-9995-4e6b-8b26-461b7eb05ded/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:05:15 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73449) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 12:05:15 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73449) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 12:05:15 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a627da9-03a1-4239-8721-cefe99c39ee2/disk.rescue --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:05:15 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a627da9-03a1-4239-8721-cefe99c39ee2/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:05:15 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a627da9-03a1-4239-8721-cefe99c39ee2/disk.rescue --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:05:15 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a627da9-03a1-4239-8721-cefe99c39ee2/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:05:15 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89440604-1daf-4e7a-a524-2f9c21a9cb96/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:05:15 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:05:15 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89440604-1daf-4e7a-a524-2f9c21a9cb96/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:05:15 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89440604-1daf-4e7a-a524-2f9c21a9cb96/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:05:15 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89440604-1daf-4e7a-a524-2f9c21a9cb96/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:05:15 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61201d5c-26f1-4c6d-a764-be2ee2e533ae/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:05:16 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61201d5c-26f1-4c6d-a764-be2ee2e533ae/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:05:16 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61201d5c-26f1-4c6d-a764-be2ee2e533ae/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:05:16 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61201d5c-26f1-4c6d-a764-be2ee2e533ae/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:05:16 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d160711b-0b77-4f9a-b1d9-f0ac16240d4d/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:05:16 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d160711b-0b77-4f9a-b1d9-f0ac16240d4d/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:05:16 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d160711b-0b77-4f9a-b1d9-f0ac16240d4d/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:05:16 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d160711b-0b77-4f9a-b1d9-f0ac16240d4d/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:05:16 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73449) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 12:05:17 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 12:05:17 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 12:05:17 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Hypervisor/Node resource view: name=user free_ram=7816MB free_disk=24.825870513916016GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73449) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 12:05:17 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:05:17 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:05:17 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 89440604-1daf-4e7a-a524-2f9c21a9cb96 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 12:05:17 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 31f5f3d2-41d8-4a26-9eb2-18b891f94734 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 12:05:17 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 712c777e-251b-43d8-b923-8eda693f32ed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 12:05:17 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance d160711b-0b77-4f9a-b1d9-f0ac16240d4d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 12:05:17 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 5a627da9-03a1-4239-8721-cefe99c39ee2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 12:05:17 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 61201d5c-26f1-4c6d-a764-be2ee2e533ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 12:05:17 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 509263cd-9995-4e6b-8b26-461b7eb05ded actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 12:05:17 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 8fdfaf32-0957-453a-b1cf-9a3c19815c45 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 12:05:17 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=73449) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 12:05:17 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=73449) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 12:05:17 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 12:05:17 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 12:05:17 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Compute_service record updated for user:user {{(pid=73449) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 12:05:17 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.374s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:05:20 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:05:20 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Starting heal instance info cache {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 12:05:20 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:05:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "refresh_cache-31f5f3d2-41d8-4a26-9eb2-18b891f94734" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 12:05:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquired lock "refresh_cache-31f5f3d2-41d8-4a26-9eb2-18b891f94734" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 12:05:20 user nova-compute[73449]: DEBUG nova.network.neutron [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] Forcefully refreshing network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 12:05:21 user nova-compute[73449]: DEBUG nova.network.neutron [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] Updating instance_info_cache with network_info: [{"id": "ea00b08a-3d80-453b-8c1a-9bdc74ac652f", "address": "fa:16:3e:d2:96:e4", "network": {"id": "9455bb75-f75a-41ff-8f6f-49f55aa738f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-425274599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec3b0b72e47448ebe99f9fc64119c1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea00b08a-3d", "ovs_interfaceid": "ea00b08a-3d80-453b-8c1a-9bdc74ac652f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 12:05:21 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Releasing lock "refresh_cache-31f5f3d2-41d8-4a26-9eb2-18b891f94734" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 12:05:21 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] Updated the network info_cache for instance {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 12:05:21 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:05:21 user nova-compute[73449]: DEBUG nova.compute.manager [req-c6fe9d5d-6d10-43be-9dad-66c9fcb4e8b0 req-45ea6bf9-2c43-43d1-9b45-62b0a5109c96 service nova] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Received event network-changed-f9f6066e-ddd2-4e41-b92a-5713cfb9a223 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:05:21 user nova-compute[73449]: DEBUG nova.compute.manager [req-c6fe9d5d-6d10-43be-9dad-66c9fcb4e8b0 req-45ea6bf9-2c43-43d1-9b45-62b0a5109c96 service nova] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Refreshing instance network info cache due to event network-changed-f9f6066e-ddd2-4e41-b92a-5713cfb9a223. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 12:05:21 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-c6fe9d5d-6d10-43be-9dad-66c9fcb4e8b0 req-45ea6bf9-2c43-43d1-9b45-62b0a5109c96 service nova] Acquiring lock "refresh_cache-61201d5c-26f1-4c6d-a764-be2ee2e533ae" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 12:05:21 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-c6fe9d5d-6d10-43be-9dad-66c9fcb4e8b0 req-45ea6bf9-2c43-43d1-9b45-62b0a5109c96 service nova] Acquired lock "refresh_cache-61201d5c-26f1-4c6d-a764-be2ee2e533ae" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 12:05:21 user nova-compute[73449]: DEBUG nova.network.neutron [req-c6fe9d5d-6d10-43be-9dad-66c9fcb4e8b0 req-45ea6bf9-2c43-43d1-9b45-62b0a5109c96 service nova] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Refreshing network info cache for port f9f6066e-ddd2-4e41-b92a-5713cfb9a223 {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 12:05:22 user nova-compute[73449]: DEBUG nova.network.neutron [req-c6fe9d5d-6d10-43be-9dad-66c9fcb4e8b0 req-45ea6bf9-2c43-43d1-9b45-62b0a5109c96 service nova] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Updated VIF entry in instance network info cache for port f9f6066e-ddd2-4e41-b92a-5713cfb9a223. {{(pid=73449) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 12:05:22 user nova-compute[73449]: DEBUG nova.network.neutron [req-c6fe9d5d-6d10-43be-9dad-66c9fcb4e8b0 req-45ea6bf9-2c43-43d1-9b45-62b0a5109c96 service nova] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Updating instance_info_cache with network_info: [{"id": "f9f6066e-ddd2-4e41-b92a-5713cfb9a223", "address": "fa:16:3e:d2:c7:08", "network": {"id": "2ead35b7-4013-4fab-b35f-02f3237fcac1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1887618888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2a2f7faf23147fba5270c844eac051a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9f6066e-dd", "ovs_interfaceid": "f9f6066e-ddd2-4e41-b92a-5713cfb9a223", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 12:05:22 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-c6fe9d5d-6d10-43be-9dad-66c9fcb4e8b0 req-45ea6bf9-2c43-43d1-9b45-62b0a5109c96 service nova] Releasing lock "refresh_cache-61201d5c-26f1-4c6d-a764-be2ee2e533ae" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 12:05:23 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:05:25 user nova-compute[73449]: DEBUG nova.compute.manager [req-c6b9b98e-ee93-4e76-ab5a-bc3e1821b634 req-638dc26b-dde5-4c21-bbc2-64b6418b8998 service nova] [instance: 509263cd-9995-4e6b-8b26-461b7eb05ded] Received event network-changed-567c70fb-fa55-4e78-88aa-ab91baf69fed {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:05:25 user nova-compute[73449]: DEBUG nova.compute.manager [req-c6b9b98e-ee93-4e76-ab5a-bc3e1821b634 req-638dc26b-dde5-4c21-bbc2-64b6418b8998 service nova] [instance: 509263cd-9995-4e6b-8b26-461b7eb05ded] Refreshing instance network info cache due to event network-changed-567c70fb-fa55-4e78-88aa-ab91baf69fed. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 12:05:25 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-c6b9b98e-ee93-4e76-ab5a-bc3e1821b634 req-638dc26b-dde5-4c21-bbc2-64b6418b8998 service nova] Acquiring lock "refresh_cache-509263cd-9995-4e6b-8b26-461b7eb05ded" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 12:05:25 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-c6b9b98e-ee93-4e76-ab5a-bc3e1821b634 req-638dc26b-dde5-4c21-bbc2-64b6418b8998 service nova] Acquired lock "refresh_cache-509263cd-9995-4e6b-8b26-461b7eb05ded" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 12:05:25 user nova-compute[73449]: DEBUG nova.network.neutron [req-c6b9b98e-ee93-4e76-ab5a-bc3e1821b634 req-638dc26b-dde5-4c21-bbc2-64b6418b8998 service nova] [instance: 509263cd-9995-4e6b-8b26-461b7eb05ded] Refreshing network info cache for port 567c70fb-fa55-4e78-88aa-ab91baf69fed {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 12:05:25 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:05:26 user nova-compute[73449]: DEBUG nova.network.neutron [req-c6b9b98e-ee93-4e76-ab5a-bc3e1821b634 req-638dc26b-dde5-4c21-bbc2-64b6418b8998 service nova] [instance: 509263cd-9995-4e6b-8b26-461b7eb05ded] Updated VIF entry in instance network info cache for port 567c70fb-fa55-4e78-88aa-ab91baf69fed. {{(pid=73449) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 12:05:26 user nova-compute[73449]: DEBUG nova.network.neutron [req-c6b9b98e-ee93-4e76-ab5a-bc3e1821b634 req-638dc26b-dde5-4c21-bbc2-64b6418b8998 service nova] [instance: 509263cd-9995-4e6b-8b26-461b7eb05ded] Updating instance_info_cache with network_info: [{"id": "567c70fb-fa55-4e78-88aa-ab91baf69fed", "address": "fa:16:3e:00:89:5f", "network": {"id": "b7788333-c3b8-48e1-9255-5cb74bd3a3be", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-892160259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5ffc03751894a96bebd953bd9fa20ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap567c70fb-fa", "ovs_interfaceid": "567c70fb-fa55-4e78-88aa-ab91baf69fed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 12:05:26 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-c6b9b98e-ee93-4e76-ab5a-bc3e1821b634 req-638dc26b-dde5-4c21-bbc2-64b6418b8998 service nova] Releasing lock "refresh_cache-509263cd-9995-4e6b-8b26-461b7eb05ded" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 12:05:26 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-522f4df8-8452-47ce-b6b4-067e7a3fec4f tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Acquiring lock "61201d5c-26f1-4c6d-a764-be2ee2e533ae" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:05:26 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-522f4df8-8452-47ce-b6b4-067e7a3fec4f tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Lock "61201d5c-26f1-4c6d-a764-be2ee2e533ae" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:05:26 user nova-compute[73449]: DEBUG nova.objects.instance [None req-522f4df8-8452-47ce-b6b4-067e7a3fec4f tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Lazy-loading 'flavor' on Instance uuid 61201d5c-26f1-4c6d-a764-be2ee2e533ae {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:05:26 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-522f4df8-8452-47ce-b6b4-067e7a3fec4f tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Lock "61201d5c-26f1-4c6d-a764-be2ee2e533ae" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:05:26 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-522f4df8-8452-47ce-b6b4-067e7a3fec4f tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Acquiring lock "61201d5c-26f1-4c6d-a764-be2ee2e533ae" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:05:26 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-522f4df8-8452-47ce-b6b4-067e7a3fec4f tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Lock "61201d5c-26f1-4c6d-a764-be2ee2e533ae" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:05:26 user nova-compute[73449]: INFO nova.compute.manager [None req-522f4df8-8452-47ce-b6b4-067e7a3fec4f tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Attaching volume 12aa960e-96d4-4bae-b7eb-209200c9ec49 to /dev/vdb
Aug 17 12:05:27 user nova-compute[73449]: DEBUG os_brick.utils [None req-522f4df8-8452-47ce-b6b4-067e7a3fec4f tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 12:05:27 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:05:27 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:05:27 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a6ad8b6-b774-4f26-8754-8cb0cad5a325]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4d3924302012\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:05:27 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:05:27 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:05:27 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[c54b7f25-53d9-4a6d-aaff-2e2841345c50]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:05:27 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:05:27 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:05:27 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6acf382-63e5-4b42-9f17-bcb85db5cb8e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:05:27 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3f1305c-423b-44df-b741-49eca19f07ca]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:05:27 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-522f4df8-8452-47ce-b6b4-067e7a3fec4f tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Running cmd (subprocess): nvme version {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:05:27 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-522f4df8-8452-47ce-b6b4-067e7a3fec4f tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] 'nvme version' failed. Not Retrying. {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 12:05:27 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.nvmeof [None req-522f4df8-8452-47ce-b6b4-067e7a3fec4f tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] nvme not present on system {{(pid=73449) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 12:05:27 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:05:27 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 12:05:27 user nova-compute[73449]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 12:05:27 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[05f3623a-040c-4845-969d-d05c2d814a6e]: (4, '') {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:05:27 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-522f4df8-8452-47ce-b6b4-067e7a3fec4f tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73449) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 12:05:27 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-522f4df8-8452-47ce-b6b4-067e7a3fec4f tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73449) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 12:05:27 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-522f4df8-8452-47ce-b6b4-067e7a3fec4f tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] LIGHTOS: no hostnqn found. {{(pid=73449) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 12:05:27 user nova-compute[73449]: DEBUG os_brick.utils [None req-522f4df8-8452-47ce-b6b4-067e7a3fec4f tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4d3924302012', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 12:05:27 user nova-compute[73449]: DEBUG nova.virt.block_device [None req-522f4df8-8452-47ce-b6b4-067e7a3fec4f tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Updating existing volume attachment record: 4c530b68-66c3-4084-bba6-faf8c6f92237 {{(pid=73449) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 12:05:28 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:05:30 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:05:30 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-017dc8c1-ee16-488d-854a-41664b0cca92 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] Acquiring lock "509263cd-9995-4e6b-8b26-461b7eb05ded" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:05:30 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-017dc8c1-ee16-488d-854a-41664b0cca92 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] Lock "509263cd-9995-4e6b-8b26-461b7eb05ded" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:05:30 user nova-compute[73449]: DEBUG nova.objects.instance [None req-017dc8c1-ee16-488d-854a-41664b0cca92 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] Lazy-loading 'flavor' on Instance uuid 509263cd-9995-4e6b-8b26-461b7eb05ded {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:05:30 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-017dc8c1-ee16-488d-854a-41664b0cca92 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] Lock "509263cd-9995-4e6b-8b26-461b7eb05ded" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:05:30 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-017dc8c1-ee16-488d-854a-41664b0cca92 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] Acquiring lock "509263cd-9995-4e6b-8b26-461b7eb05ded" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:05:30 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-017dc8c1-ee16-488d-854a-41664b0cca92 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] Lock "509263cd-9995-4e6b-8b26-461b7eb05ded" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:05:30 user nova-compute[73449]: INFO nova.compute.manager [None req-017dc8c1-ee16-488d-854a-41664b0cca92 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] [instance: 509263cd-9995-4e6b-8b26-461b7eb05ded] Attaching volume 50b95d1b-611a-4f7b-bdc2-5c2ebeac5a97 to /dev/vdb
Aug 17 12:05:30 user nova-compute[73449]: DEBUG os_brick.utils [None req-017dc8c1-ee16-488d-854a-41664b0cca92 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 12:05:30 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:05:31 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:05:31 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6397023-3af6-4dd3-8bd3-950dc5318d26]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4d3924302012\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:05:31 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:05:31 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:05:31 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc0188e5-4e2a-4451-8466-f2246318645d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:05:31 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:05:31 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:05:31 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[d61706f2-c600-48da-abee-2556f2037caf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:05:31 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a80e2f4-45d1-4764-a5d8-a38e9726039b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:05:31 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-017dc8c1-ee16-488d-854a-41664b0cca92 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] Running cmd (subprocess): nvme version {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:05:31 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-017dc8c1-ee16-488d-854a-41664b0cca92 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] 'nvme version' failed. Not Retrying. {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 12:05:31 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.nvmeof [None req-017dc8c1-ee16-488d-854a-41664b0cca92 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] nvme not present on system {{(pid=73449) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 12:05:31 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:05:31 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 12:05:31 user nova-compute[73449]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 12:05:31 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[3703af49-be7a-4346-8ace-32c301b93192]: (4, '') {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:05:31 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-017dc8c1-ee16-488d-854a-41664b0cca92 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73449) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 12:05:31 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-017dc8c1-ee16-488d-854a-41664b0cca92 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73449) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 12:05:31 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-017dc8c1-ee16-488d-854a-41664b0cca92 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] LIGHTOS: no hostnqn found. {{(pid=73449) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 12:05:31 user nova-compute[73449]: DEBUG os_brick.utils [None req-017dc8c1-ee16-488d-854a-41664b0cca92 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4d3924302012', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 12:05:31 user nova-compute[73449]: DEBUG nova.virt.block_device [None req-017dc8c1-ee16-488d-854a-41664b0cca92 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] [instance: 509263cd-9995-4e6b-8b26-461b7eb05ded] Updating existing volume attachment record: d2ab454f-2527-479e-96cb-cc9f9134ae49 {{(pid=73449) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 12:05:32 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-95c80e38-7a8c-43ad-b0d8-4348c240c1a0 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Acquiring lock "d160711b-0b77-4f9a-b1d9-f0ac16240d4d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:05:32 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-95c80e38-7a8c-43ad-b0d8-4348c240c1a0 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Lock "d160711b-0b77-4f9a-b1d9-f0ac16240d4d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:05:32 user nova-compute[73449]: INFO nova.compute.manager [None req-95c80e38-7a8c-43ad-b0d8-4348c240c1a0 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: d160711b-0b77-4f9a-b1d9-f0ac16240d4d] Detaching volume 740e623f-bfc7-4776-b6d7-cb30de9535e4
Aug 17 12:05:32 user nova-compute[73449]: INFO nova.virt.block_device [None req-95c80e38-7a8c-43ad-b0d8-4348c240c1a0 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: d160711b-0b77-4f9a-b1d9-f0ac16240d4d] Attempting to driver detach volume 740e623f-bfc7-4776-b6d7-cb30de9535e4 from mountpoint /dev/vdb
Aug 17 12:05:32 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-95c80e38-7a8c-43ad-b0d8-4348c240c1a0 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Attempting to detach device vdb from instance d160711b-0b77-4f9a-b1d9-f0ac16240d4d from the persistent domain config. {{(pid=73449) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 12:05:32 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-95c80e38-7a8c-43ad-b0d8-4348c240c1a0 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 12:05:32 user nova-compute[73449]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 12:05:32 user nova-compute[73449]:   <source dev="/dev/sdc"/>
Aug 17 12:05:32 user nova-compute[73449]:   <target dev="vdb" bus="virtio"/>
Aug 17 12:05:32 user nova-compute[73449]:   <serial>740e623f-bfc7-4776-b6d7-cb30de9535e4</serial>
Aug 17 12:05:32 user nova-compute[73449]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 12:05:32 user nova-compute[73449]: </disk>
Aug 17 12:05:32 user nova-compute[73449]:  {{(pid=73449) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 12:05:32 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-95c80e38-7a8c-43ad-b0d8-4348c240c1a0 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Successfully detached device vdb from instance d160711b-0b77-4f9a-b1d9-f0ac16240d4d from the persistent domain config.
Aug 17 12:05:32 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-95c80e38-7a8c-43ad-b0d8-4348c240c1a0 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d160711b-0b77-4f9a-b1d9-f0ac16240d4d from the live domain config. {{(pid=73449) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 12:05:32 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-95c80e38-7a8c-43ad-b0d8-4348c240c1a0 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 12:05:32 user nova-compute[73449]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 12:05:32 user nova-compute[73449]:   <source dev="/dev/sdc"/>
Aug 17 12:05:32 user nova-compute[73449]:   <target dev="vdb" bus="virtio"/>
Aug 17 12:05:32 user nova-compute[73449]:   <serial>740e623f-bfc7-4776-b6d7-cb30de9535e4</serial>
Aug 17 12:05:32 user nova-compute[73449]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 12:05:32 user nova-compute[73449]: </disk>
Aug 17 12:05:32 user nova-compute[73449]:  {{(pid=73449) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 12:05:32 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Received event <DeviceRemovedEvent: 1692273932.8335836, d160711b-0b77-4f9a-b1d9-f0ac16240d4d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73449) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 12:05:32 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-95c80e38-7a8c-43ad-b0d8-4348c240c1a0 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d160711b-0b77-4f9a-b1d9-f0ac16240d4d {{(pid=73449) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 12:05:32 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-95c80e38-7a8c-43ad-b0d8-4348c240c1a0 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Successfully detached device vdb from instance d160711b-0b77-4f9a-b1d9-f0ac16240d4d from the live domain config.
Aug 17 12:05:32 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95c80e38-7a8c-43ad-b0d8-4348c240c1a0 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: d160711b-0b77-4f9a-b1d9-f0ac16240d4d] calling os-brick to detach iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 12:05:32 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-95c80e38-7a8c-43ad-b0d8-4348c240c1a0 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, {'target_iqns': ['iqn.2010-10.org.openstack:740e623f-bfc7-4776-b6d7-cb30de9535e4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RQmcTMDX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 12:05:32 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-95c80e38-7a8c-43ad-b0d8-4348c240c1a0 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 12:05:32 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-95c80e38-7a8c-43ad-b0d8-4348c240c1a0 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 12:05:32 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-95c80e38-7a8c-43ad-b0d8-4348c240c1a0 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 12:05:32 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-95c80e38-7a8c-43ad-b0d8-4348c240c1a0 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:740e623f-bfc7-4776-b6d7-cb30de9535e4', 0)] {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 12:05:32 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:05:32 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:05:32 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba442077-7bdb-4c9f-a518-2ba3ce629518]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:740e623f-bfc7-4776-b6d7-cb30de9535e4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8314fb1e-61f9-44b5-b944-5a94677724c8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:05:32 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:05:32 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:05:32 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[20d17950-19a3-49e4-8ec3-1893c0e25b51]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8314fb1e-61f9-44b5-b944-5a94677724c8 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:740e623f-bfc7-4776-b6d7-cb30de9535e4 (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:05:32 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-95c80e38-7a8c-43ad-b0d8-4348c240c1a0 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)
Aug 17 12:05:32 user nova-compute[73449]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8314fb1e-61f9-44b5-b944-5a94677724c8 (non-flash)
Aug 17 12:05:32 user nova-compute[73449]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:740e623f-bfc7-4776-b6d7-cb30de9535e4 (non-flash)
Aug 17 12:05:32 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 12:05:32 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-95c80e38-7a8c-43ad-b0d8-4348c240c1a0 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)
Aug 17 12:05:32 user nova-compute[73449]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8314fb1e-61f9-44b5-b944-5a94677724c8 (non-flash)
Aug 17 12:05:32 user nova-compute[73449]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:740e623f-bfc7-4776-b6d7-cb30de9535e4 (non-flash)
Aug 17 12:05:32 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 12:05:32 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-95c80e38-7a8c-43ad-b0d8-4348c240c1a0 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe738607640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:740e623f-bfc7-4776-b6d7-cb30de9535e4'): ({'sdc'}, set())}) {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 12:05:32 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-95c80e38-7a8c-43ad-b0d8-4348c240c1a0 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Removing single pathed devices sdc {{(pid=73449) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 12:05:32 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:05:32 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:05:32 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[e591fe0b-a8fa-4d52-8945-d138d198203f]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:05:32 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:05:32 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:05:32 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e462736-a6ba-406a-adfb-0719c5b5e761]: (4, ('ok\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:05:32 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-95c80e38-7a8c-43ad-b0d8-4348c240c1a0 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Flushing IO for device /dev/sdc {{(pid=73449) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 12:05:32 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:05:32 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:05:32 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b45a72d-0771-4266-a97f-c7b6c90cfe56]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:05:32 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-95c80e38-7a8c-43ad-b0d8-4348c240c1a0 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73449) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 12:05:32 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:05:33 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:05:33 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[8249d50c-1110-4317-945b-7f0ceca45ef8]: (4, ('1', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:05:33 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-95c80e38-7a8c-43ad-b0d8-4348c240c1a0 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73449) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 12:05:33 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-95c80e38-7a8c-43ad-b0d8-4348c240c1a0 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] SCSI volumes sdc have been removed. {{(pid=73449) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 12:05:33 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-95c80e38-7a8c-43ad-b0d8-4348c240c1a0 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:740e623f-bfc7-4776-b6d7-cb30de9535e4')] {{(pid=73449) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 12:05:33 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:740e623f-bfc7-4776-b6d7-cb30de9535e4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:05:33 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:740e623f-bfc7-4776-b6d7-cb30de9535e4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:05:33 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[9137d2d6-5372-4366-9076-b60c03988905]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:05:33 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-95c80e38-7a8c-43ad-b0d8-4348c240c1a0 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:05:33 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:740e623f-bfc7-4776-b6d7-cb30de9535e4 -p 172.16.0.220:3260 --logout {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:05:33 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:740e623f-bfc7-4776-b6d7-cb30de9535e4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:05:33 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccf56801-d968-447d-8b31-8ccb53cfc761]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:740e623f-bfc7-4776-b6d7-cb30de9535e4, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:740e623f-bfc7-4776-b6d7-cb30de9535e4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:05:33 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-95c80e38-7a8c-43ad-b0d8-4348c240c1a0 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:740e623f-bfc7-4776-b6d7-cb30de9535e4, portal: 172.16.0.220,3260]
Aug 17 12:05:33 user nova-compute[73449]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:740e623f-bfc7-4776-b6d7-cb30de9535e4, portal: 172.16.0.220,3260] successful.
Aug 17 12:05:33 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:05:33 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:740e623f-bfc7-4776-b6d7-cb30de9535e4 -p 172.16.0.220:3260 --op delete {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:05:33 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:740e623f-bfc7-4776-b6d7-cb30de9535e4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:05:33 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[23814b4b-992b-4efe-ad58-370b997643da]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:05:33 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-95c80e38-7a8c-43ad-b0d8-4348c240c1a0 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:05:33 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-95c80e38-7a8c-43ad-b0d8-4348c240c1a0 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 12:05:33 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-95c80e38-7a8c-43ad-b0d8-4348c240c1a0 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] <== disconnect_volume: return (293ms) None {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 12:05:33 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95c80e38-7a8c-43ad-b0d8-4348c240c1a0 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: d160711b-0b77-4f9a-b1d9-f0ac16240d4d] Disconnected iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 12:05:33 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:05:33 user nova-compute[73449]: DEBUG nova.objects.instance [None req-95c80e38-7a8c-43ad-b0d8-4348c240c1a0 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Lazy-loading 'flavor' on Instance uuid d160711b-0b77-4f9a-b1d9-f0ac16240d4d {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:05:33 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-95c80e38-7a8c-43ad-b0d8-4348c240c1a0 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Lock "d160711b-0b77-4f9a-b1d9-f0ac16240d4d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.762s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:05:35 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:05:38 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-522f4df8-8452-47ce-b6b4-067e7a3fec4f tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Calling os-brick to attach iSCSI Volume {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 12:05:38 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-522f4df8-8452-47ce-b6b4-067e7a3fec4f tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mOspuxWK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 12:05:38 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-522f4df8-8452-47ce-b6b4-067e7a3fec4f tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 12:05:38 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-522f4df8-8452-47ce-b6b4-067e7a3fec4f tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 12:05:38 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-522f4df8-8452-47ce-b6b4-067e7a3fec4f tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 12:05:38 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-522f4df8-8452-47ce-b6b4-067e7a3fec4f tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 12:05:38 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-522f4df8-8452-47ce-b6b4-067e7a3fec4f tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 12:05:38 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-522f4df8-8452-47ce-b6b4-067e7a3fec4f tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 12:05:38 user nova-compute[73449]: INFO os_brick.initiator.connectors.iscsi [None req-522f4df8-8452-47ce-b6b4-067e7a3fec4f tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 12:05:38 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49 -p 172.16.0.220:3260 {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:05:38 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:05:38 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[30e0ffb3-deaa-4bb8-85e0-477142cefb4e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:05:38 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-522f4df8-8452-47ce-b6b4-067e7a3fec4f tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 12:05:38 user nova-compute[73449]:  {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:05:38 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49 -p 172.16.0.220:3260 --interface default --op new {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:05:38 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:05:38 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[508fda6f-44f9-46c2-9dff-7666e22eef08]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49] added\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:05:38 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-522f4df8-8452-47ce-b6b4-067e7a3fec4f tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49] added
Aug 17 12:05:38 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:05:38 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:05:38 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:05:38 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[05f0a6d6-07a7-444b-a42d-666122ed2774]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:05:38 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-522f4df8-8452-47ce-b6b4-067e7a3fec4f tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:05:38 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:05:38 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:05:38 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[689a5de6-14ac-4e41-8e22-52d1ae99687f]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:05:38 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-522f4df8-8452-47ce-b6b4-067e7a3fec4f tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:05:38 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mOspuxWK {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:05:38 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mOspuxWK" returned: 0 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:05:38 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[51a163ab-8e54-40a1-8cdf-b7d397afc7ed]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:05:38 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-522f4df8-8452-47ce-b6b4-067e7a3fec4f tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mOspuxWK'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:05:38 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:05:38 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:05:38 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[2802dfd8-6097-4ba9-a67a-1538d050d81f]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:05:38 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-522f4df8-8452-47ce-b6b4-067e7a3fec4f tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:05:38 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:05:38 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:05:38 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ca0509d-4698-4f0f-863b-5759025906a8]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8314fb1e-61f9-44b5-b944-5a94677724c8 (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:05:38 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-522f4df8-8452-47ce-b6b4-067e7a3fec4f tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)
Aug 17 12:05:38 user nova-compute[73449]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8314fb1e-61f9-44b5-b944-5a94677724c8 (non-flash)
Aug 17 12:05:38 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 12:05:38 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-522f4df8-8452-47ce-b6b4-067e7a3fec4f tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)
Aug 17 12:05:38 user nova-compute[73449]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8314fb1e-61f9-44b5-b944-5a94677724c8 (non-flash)
Aug 17 12:05:38 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 12:05:38 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49 -p 172.16.0.220:3260 --login {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:05:38 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:05:38 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5e85e6a-b6ee-43c0-a4ed-112b636dbfd8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:05:38 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-522f4df8-8452-47ce-b6b4-067e7a3fec4f tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49, portal: 172.16.0.220,3260]
Aug 17 12:05:38 user nova-compute[73449]: Login to [iface: default, target: iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49, portal: 172.16.0.220,3260] successful.
Aug 17 12:05:38 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:05:38 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:05:38 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:05:38 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[28ab7709-5397-4877-a976-0a3c90e0d679]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:05:38 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-522f4df8-8452-47ce-b6b4-067e7a3fec4f tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:05:38 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:05:38 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:05:38 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[c36c8b13-7ef4-46b4-8f66-3df555b85dfe]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8314fb1e-61f9-44b5-b944-5a94677724c8 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49 (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:05:38 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-522f4df8-8452-47ce-b6b4-067e7a3fec4f tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)
Aug 17 12:05:38 user nova-compute[73449]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8314fb1e-61f9-44b5-b944-5a94677724c8 (non-flash)
Aug 17 12:05:38 user nova-compute[73449]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49 (non-flash)
Aug 17 12:05:38 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 12:05:38 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-522f4df8-8452-47ce-b6b4-067e7a3fec4f tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)
Aug 17 12:05:38 user nova-compute[73449]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8314fb1e-61f9-44b5-b944-5a94677724c8 (non-flash)
Aug 17 12:05:38 user nova-compute[73449]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49 (non-flash)
Aug 17 12:05:38 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 12:05:38 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-522f4df8-8452-47ce-b6b4-067e7a3fec4f tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 12:05:38 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-522f4df8-8452-47ce-b6b4-067e7a3fec4f tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Connected to 172.16.0.220:3260 {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 12:05:38 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-522f4df8-8452-47ce-b6b4-067e7a3fec4f tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] HCTL ('34', '-', '-', 0) found on session 50 with lun 0 {{(pid=73449) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 12:05:38 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-522f4df8-8452-47ce-b6b4-067e7a3fec4f tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73449) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 12:05:38 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:05:38 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:05:38 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9029c09-59f8-47ec-b3b0-ecc28c4ca2e6]: (4, ('- - 0', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:05:38 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-522f4df8-8452-47ce-b6b4-067e7a3fec4f tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Searching for a device in session 50 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73449) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 12:05:38 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-522f4df8-8452-47ce-b6b4-067e7a3fec4f tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mOspuxWK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 12:05:38 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:05:39 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-522f4df8-8452-47ce-b6b4-067e7a3fec4f tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 12:05:39 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-522f4df8-8452-47ce-b6b4-067e7a3fec4f tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] <== connect_volume: return (1313ms) {'type': 'block', 'scsi_wwn': '26639383432346664', 'path': '/dev/sdc'} {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 12:05:39 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-522f4df8-8452-47ce-b6b4-067e7a3fec4f tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26639383432346664', 'path': '/dev/sdc'} {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 12:05:39 user nova-compute[73449]: DEBUG nova.objects.instance [None req-522f4df8-8452-47ce-b6b4-067e7a3fec4f tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Lazy-loading 'flavor' on Instance uuid 61201d5c-26f1-4c6d-a764-be2ee2e533ae {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:05:39 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-522f4df8-8452-47ce-b6b4-067e7a3fec4f tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 12:05:39 user nova-compute[73449]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 12:05:39 user nova-compute[73449]:   <source dev="/dev/sdc"/>
Aug 17 12:05:39 user nova-compute[73449]:   <target dev="vdb" bus="virtio"/>
Aug 17 12:05:39 user nova-compute[73449]:   <serial>12aa960e-96d4-4bae-b7eb-209200c9ec49</serial>
Aug 17 12:05:39 user nova-compute[73449]: </disk>
Aug 17 12:05:39 user nova-compute[73449]:  {{(pid=73449) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 12:05:39 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:05:40 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-522f4df8-8452-47ce-b6b4-067e7a3fec4f tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] No BDM found with device name vda, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 12:05:40 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-522f4df8-8452-47ce-b6b4-067e7a3fec4f tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 12:05:40 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-522f4df8-8452-47ce-b6b4-067e7a3fec4f tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] No VIF found with MAC fa:16:3e:d2:c7:08, not building metadata {{(pid=73449) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 12:05:40 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-522f4df8-8452-47ce-b6b4-067e7a3fec4f tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Lock "61201d5c-26f1-4c6d-a764-be2ee2e533ae" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.306s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:05:40 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:05:40 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6106a65a-6424-4f6a-b87c-67b65aeda862 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Acquiring lock "61201d5c-26f1-4c6d-a764-be2ee2e533ae" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:05:40 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6106a65a-6424-4f6a-b87c-67b65aeda862 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Lock "61201d5c-26f1-4c6d-a764-be2ee2e533ae" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:05:40 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6106a65a-6424-4f6a-b87c-67b65aeda862 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 12:05:40 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6106a65a-6424-4f6a-b87c-67b65aeda862 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=73449) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 17 12:05:40 user nova-compute[73449]: DEBUG nova.objects.instance [None req-6106a65a-6424-4f6a-b87c-67b65aeda862 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Lazy-loading 'flavor' on Instance uuid 61201d5c-26f1-4c6d-a764-be2ee2e533ae {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:05:40 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:05:40 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:05:40 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:05:40 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:05:41 user nova-compute[73449]: DEBUG nova.compute.manager [req-f887a197-e88f-4627-a7c2-3640cc7b5256 req-f2808b6a-960a-4f1a-9e68-49adabe547be service nova] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Received event network-vif-unplugged-f9f6066e-ddd2-4e41-b92a-5713cfb9a223 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:05:41 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-f887a197-e88f-4627-a7c2-3640cc7b5256 req-f2808b6a-960a-4f1a-9e68-49adabe547be service nova] Acquiring lock "61201d5c-26f1-4c6d-a764-be2ee2e533ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:05:41 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-f887a197-e88f-4627-a7c2-3640cc7b5256 req-f2808b6a-960a-4f1a-9e68-49adabe547be service nova] Lock "61201d5c-26f1-4c6d-a764-be2ee2e533ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:05:41 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-f887a197-e88f-4627-a7c2-3640cc7b5256 req-f2808b6a-960a-4f1a-9e68-49adabe547be service nova] Lock "61201d5c-26f1-4c6d-a764-be2ee2e533ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:05:41 user nova-compute[73449]: DEBUG nova.compute.manager [req-f887a197-e88f-4627-a7c2-3640cc7b5256 req-f2808b6a-960a-4f1a-9e68-49adabe547be service nova] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] No waiting events found dispatching network-vif-unplugged-f9f6066e-ddd2-4e41-b92a-5713cfb9a223 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 12:05:41 user nova-compute[73449]: WARNING nova.compute.manager [req-f887a197-e88f-4627-a7c2-3640cc7b5256 req-f2808b6a-960a-4f1a-9e68-49adabe547be service nova] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Received unexpected event network-vif-unplugged-f9f6066e-ddd2-4e41-b92a-5713cfb9a223 for instance with vm_state active and task_state powering-off.
Aug 17 12:05:41 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Instance destroyed successfully.
Aug 17 12:05:41 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6106a65a-6424-4f6a-b87c-67b65aeda862 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 12:05:41 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6106a65a-6424-4f6a-b87c-67b65aeda862 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Lock "61201d5c-26f1-4c6d-a764-be2ee2e533ae" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.870s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:05:42 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-017dc8c1-ee16-488d-854a-41664b0cca92 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] [instance: 509263cd-9995-4e6b-8b26-461b7eb05ded] Calling os-brick to attach iSCSI Volume {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 12:05:42 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-017dc8c1-ee16-488d-854a-41664b0cca92 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:50b95d1b-611a-4f7b-bdc2-5c2ebeac5a97'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GvSRJPtk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 12:05:42 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-017dc8c1-ee16-488d-854a-41664b0cca92 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 12:05:42 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-017dc8c1-ee16-488d-854a-41664b0cca92 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 12:05:42 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-017dc8c1-ee16-488d-854a-41664b0cca92 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 12:05:42 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-017dc8c1-ee16-488d-854a-41664b0cca92 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 12:05:42 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-017dc8c1-ee16-488d-854a-41664b0cca92 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50b95d1b-611a-4f7b-bdc2-5c2ebeac5a97" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 12:05:42 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-017dc8c1-ee16-488d-854a-41664b0cca92 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50b95d1b-611a-4f7b-bdc2-5c2ebeac5a97" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 12:05:42 user nova-compute[73449]: INFO os_brick.initiator.connectors.iscsi [None req-017dc8c1-ee16-488d-854a-41664b0cca92 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 12:05:42 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50b95d1b-611a-4f7b-bdc2-5c2ebeac5a97 -p 172.16.0.220:3260 {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:05:42 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50b95d1b-611a-4f7b-bdc2-5c2ebeac5a97 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:05:42 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[882e5e0d-bc4b-4414-a155-72d719256801]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:05:42 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-017dc8c1-ee16-488d-854a-41664b0cca92 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 12:05:42 user nova-compute[73449]:  {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:05:42 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50b95d1b-611a-4f7b-bdc2-5c2ebeac5a97 -p 172.16.0.220:3260 --interface default --op new {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:05:42 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50b95d1b-611a-4f7b-bdc2-5c2ebeac5a97 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:05:42 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[de00c858-9b00-413a-aa6d-9e57e0e541d1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:50b95d1b-611a-4f7b-bdc2-5c2ebeac5a97] added\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:05:42 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-017dc8c1-ee16-488d-854a-41664b0cca92 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:50b95d1b-611a-4f7b-bdc2-5c2ebeac5a97] added
Aug 17 12:05:42 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:05:42 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50b95d1b-611a-4f7b-bdc2-5c2ebeac5a97 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:05:42 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50b95d1b-611a-4f7b-bdc2-5c2ebeac5a97 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:05:42 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dd0ad19-8ae2-408e-942f-bfc1958bdb77]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:05:42 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-017dc8c1-ee16-488d-854a-41664b0cca92 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:05:42 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50b95d1b-611a-4f7b-bdc2-5c2ebeac5a97 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:05:42 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50b95d1b-611a-4f7b-bdc2-5c2ebeac5a97 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:05:42 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a528917-bf86-4863-b5da-0571df76ea97]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:05:42 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-017dc8c1-ee16-488d-854a-41664b0cca92 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:05:42 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50b95d1b-611a-4f7b-bdc2-5c2ebeac5a97 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GvSRJPtk {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:05:42 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50b95d1b-611a-4f7b-bdc2-5c2ebeac5a97 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GvSRJPtk" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:05:42 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5c2e991-1938-4d33-be4c-fd86a5442f8f]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:05:42 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-017dc8c1-ee16-488d-854a-41664b0cca92 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GvSRJPtk'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:05:42 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50b95d1b-611a-4f7b-bdc2-5c2ebeac5a97 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:05:42 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50b95d1b-611a-4f7b-bdc2-5c2ebeac5a97 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:05:42 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[10b15676-5aa6-421e-bcd7-1266e587503b]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:05:42 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-017dc8c1-ee16-488d-854a-41664b0cca92 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:05:42 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:05:42 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:05:42 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6c420c8-b67b-45f9-b79d-8451d4d1c780]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8314fb1e-61f9-44b5-b944-5a94677724c8 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49 (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:05:42 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-017dc8c1-ee16-488d-854a-41664b0cca92 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)
Aug 17 12:05:42 user nova-compute[73449]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8314fb1e-61f9-44b5-b944-5a94677724c8 (non-flash)
Aug 17 12:05:42 user nova-compute[73449]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49 (non-flash)
Aug 17 12:05:42 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 12:05:42 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-017dc8c1-ee16-488d-854a-41664b0cca92 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)
Aug 17 12:05:42 user nova-compute[73449]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8314fb1e-61f9-44b5-b944-5a94677724c8 (non-flash)
Aug 17 12:05:42 user nova-compute[73449]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49 (non-flash)
Aug 17 12:05:42 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 12:05:42 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50b95d1b-611a-4f7b-bdc2-5c2ebeac5a97 -p 172.16.0.220:3260 --login {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:05:42 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50b95d1b-611a-4f7b-bdc2-5c2ebeac5a97 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:05:42 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[828cf5fb-d41f-4ed6-b51c-524fa6f12c8c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:50b95d1b-611a-4f7b-bdc2-5c2ebeac5a97, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:50b95d1b-611a-4f7b-bdc2-5c2ebeac5a97, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:05:42 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-017dc8c1-ee16-488d-854a-41664b0cca92 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:50b95d1b-611a-4f7b-bdc2-5c2ebeac5a97, portal: 172.16.0.220,3260]
Aug 17 12:05:42 user nova-compute[73449]: Login to [iface: default, target: iqn.2010-10.org.openstack:50b95d1b-611a-4f7b-bdc2-5c2ebeac5a97, portal: 172.16.0.220,3260] successful.
Aug 17 12:05:42 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:05:42 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50b95d1b-611a-4f7b-bdc2-5c2ebeac5a97 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:05:42 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50b95d1b-611a-4f7b-bdc2-5c2ebeac5a97 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:05:42 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1ec1e38-b6f9-41f4-b9db-647003aea331]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:05:42 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-017dc8c1-ee16-488d-854a-41664b0cca92 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:05:42 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:05:42 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:05:42 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[fab92b64-08b2-4547-81c3-820d0928449f]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8314fb1e-61f9-44b5-b944-5a94677724c8 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50b95d1b-611a-4f7b-bdc2-5c2ebeac5a97 (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:05:42 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-017dc8c1-ee16-488d-854a-41664b0cca92 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)
Aug 17 12:05:42 user nova-compute[73449]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8314fb1e-61f9-44b5-b944-5a94677724c8 (non-flash)
Aug 17 12:05:42 user nova-compute[73449]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49 (non-flash)
Aug 17 12:05:42 user nova-compute[73449]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50b95d1b-611a-4f7b-bdc2-5c2ebeac5a97 (non-flash)
Aug 17 12:05:42 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 12:05:42 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-017dc8c1-ee16-488d-854a-41664b0cca92 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)
Aug 17 12:05:42 user nova-compute[73449]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8314fb1e-61f9-44b5-b944-5a94677724c8 (non-flash)
Aug 17 12:05:42 user nova-compute[73449]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49 (non-flash)
Aug 17 12:05:42 user nova-compute[73449]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50b95d1b-611a-4f7b-bdc2-5c2ebeac5a97 (non-flash)
Aug 17 12:05:42 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 12:05:42 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-017dc8c1-ee16-488d-854a-41664b0cca92 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50b95d1b-611a-4f7b-bdc2-5c2ebeac5a97" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 12:05:42 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-017dc8c1-ee16-488d-854a-41664b0cca92 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] Connected to 172.16.0.220:3260 {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 12:05:42 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-017dc8c1-ee16-488d-854a-41664b0cca92 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] HCTL ('35', '-', '-', 0) found on session 51 with lun 0 {{(pid=73449) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 12:05:42 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-017dc8c1-ee16-488d-854a-41664b0cca92 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73449) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 12:05:42 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:05:42 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:05:42 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[51b116f2-2027-4ffb-b381-68d8c044ade7]: (4, ('- - 0', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:05:42 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-017dc8c1-ee16-488d-854a-41664b0cca92 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] Searching for a device in session 51 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73449) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 12:05:42 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-017dc8c1-ee16-488d-854a-41664b0cca92 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GvSRJPtk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 12:05:43 user nova-compute[73449]: DEBUG nova.compute.manager [req-5e206ffe-4731-42f0-ba75-7bb913c46cfb req-3de4dfbd-b779-4956-a555-e763b5571a14 service nova] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Received event network-vif-plugged-f9f6066e-ddd2-4e41-b92a-5713cfb9a223 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:05:43 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-5e206ffe-4731-42f0-ba75-7bb913c46cfb req-3de4dfbd-b779-4956-a555-e763b5571a14 service nova] Acquiring lock "61201d5c-26f1-4c6d-a764-be2ee2e533ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:05:43 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-5e206ffe-4731-42f0-ba75-7bb913c46cfb req-3de4dfbd-b779-4956-a555-e763b5571a14 service nova] Lock "61201d5c-26f1-4c6d-a764-be2ee2e533ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:05:43 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-5e206ffe-4731-42f0-ba75-7bb913c46cfb req-3de4dfbd-b779-4956-a555-e763b5571a14 service nova] Lock "61201d5c-26f1-4c6d-a764-be2ee2e533ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:05:43 user nova-compute[73449]: DEBUG nova.compute.manager [req-5e206ffe-4731-42f0-ba75-7bb913c46cfb req-3de4dfbd-b779-4956-a555-e763b5571a14 service nova] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] No waiting events found dispatching network-vif-plugged-f9f6066e-ddd2-4e41-b92a-5713cfb9a223 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 12:05:43 user nova-compute[73449]: WARNING nova.compute.manager [req-5e206ffe-4731-42f0-ba75-7bb913c46cfb req-3de4dfbd-b779-4956-a555-e763b5571a14 service nova] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Received unexpected event network-vif-plugged-f9f6066e-ddd2-4e41-b92a-5713cfb9a223 for instance with vm_state stopped and task_state None.
Aug 17 12:05:43 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-017dc8c1-ee16-488d-854a-41664b0cca92 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.325s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 12:05:43 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-017dc8c1-ee16-488d-854a-41664b0cca92 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '26630306366376135', 'path': '/dev/sdd'} {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 12:05:43 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-017dc8c1-ee16-488d-854a-41664b0cca92 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] [instance: 509263cd-9995-4e6b-8b26-461b7eb05ded] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26630306366376135', 'path': '/dev/sdd'} {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 12:05:43 user nova-compute[73449]: DEBUG nova.objects.instance [None req-017dc8c1-ee16-488d-854a-41664b0cca92 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] Lazy-loading 'flavor' on Instance uuid 509263cd-9995-4e6b-8b26-461b7eb05ded {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:05:43 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-017dc8c1-ee16-488d-854a-41664b0cca92 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 12:05:43 user nova-compute[73449]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 12:05:43 user nova-compute[73449]:   <source dev="/dev/sdd"/>
Aug 17 12:05:43 user nova-compute[73449]:   <target dev="vdb" bus="virtio"/>
Aug 17 12:05:43 user nova-compute[73449]:   <serial>50b95d1b-611a-4f7b-bdc2-5c2ebeac5a97</serial>
Aug 17 12:05:43 user nova-compute[73449]: </disk>
Aug 17 12:05:43 user nova-compute[73449]:  {{(pid=73449) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 12:05:43 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:05:43 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-017dc8c1-ee16-488d-854a-41664b0cca92 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] No BDM found with device name vda, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 12:05:43 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-017dc8c1-ee16-488d-854a-41664b0cca92 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 12:05:43 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-017dc8c1-ee16-488d-854a-41664b0cca92 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] No VIF found with MAC fa:16:3e:00:89:5f, not building metadata {{(pid=73449) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 12:05:44 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-017dc8c1-ee16-488d-854a-41664b0cca92 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] Lock "509263cd-9995-4e6b-8b26-461b7eb05ded" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.137s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:05:44 user nova-compute[73449]: INFO nova.compute.manager [None req-bd5991ef-63f3-4d3b-9ea4-8910fdc962a2 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] Unrescuing
Aug 17 12:05:44 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-bd5991ef-63f3-4d3b-9ea4-8910fdc962a2 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Acquiring lock "refresh_cache-5a627da9-03a1-4239-8721-cefe99c39ee2" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 12:05:44 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-bd5991ef-63f3-4d3b-9ea4-8910fdc962a2 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Acquired lock "refresh_cache-5a627da9-03a1-4239-8721-cefe99c39ee2" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 12:05:44 user nova-compute[73449]: DEBUG nova.network.neutron [None req-bd5991ef-63f3-4d3b-9ea4-8910fdc962a2 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] Building network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 12:05:44 user nova-compute[73449]: DEBUG nova.network.neutron [None req-bd5991ef-63f3-4d3b-9ea4-8910fdc962a2 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] Updating instance_info_cache with network_info: [{"id": "69831639-3628-4b42-8ddd-fe0965dea4b6", "address": "fa:16:3e:de:22:d6", "network": {"id": "9455bb75-f75a-41ff-8f6f-49f55aa738f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-425274599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec3b0b72e47448ebe99f9fc64119c1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69831639-36", "ovs_interfaceid": "69831639-3628-4b42-8ddd-fe0965dea4b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 12:05:44 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-bd5991ef-63f3-4d3b-9ea4-8910fdc962a2 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Releasing lock "refresh_cache-5a627da9-03a1-4239-8721-cefe99c39ee2" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 12:05:44 user nova-compute[73449]: DEBUG nova.objects.instance [None req-bd5991ef-63f3-4d3b-9ea4-8910fdc962a2 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Lazy-loading 'flavor' on Instance uuid 5a627da9-03a1-4239-8721-cefe99c39ee2 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:05:44 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:05:45 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:05:45 user nova-compute[73449]: DEBUG nova.compute.manager [req-eb9819c3-72f1-44a2-82f6-bacc68d550e7 req-312cc30b-24a5-48da-80f4-3e703411a1f2 service nova] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] Received event network-vif-unplugged-69831639-3628-4b42-8ddd-fe0965dea4b6 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:05:45 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-eb9819c3-72f1-44a2-82f6-bacc68d550e7 req-312cc30b-24a5-48da-80f4-3e703411a1f2 service nova] Acquiring lock "5a627da9-03a1-4239-8721-cefe99c39ee2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:05:45 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-eb9819c3-72f1-44a2-82f6-bacc68d550e7 req-312cc30b-24a5-48da-80f4-3e703411a1f2 service nova] Lock "5a627da9-03a1-4239-8721-cefe99c39ee2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:05:45 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-eb9819c3-72f1-44a2-82f6-bacc68d550e7 req-312cc30b-24a5-48da-80f4-3e703411a1f2 service nova] Lock "5a627da9-03a1-4239-8721-cefe99c39ee2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:05:45 user nova-compute[73449]: DEBUG nova.compute.manager [req-eb9819c3-72f1-44a2-82f6-bacc68d550e7 req-312cc30b-24a5-48da-80f4-3e703411a1f2 service nova] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] No waiting events found dispatching network-vif-unplugged-69831639-3628-4b42-8ddd-fe0965dea4b6 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 12:05:45 user nova-compute[73449]: WARNING nova.compute.manager [req-eb9819c3-72f1-44a2-82f6-bacc68d550e7 req-312cc30b-24a5-48da-80f4-3e703411a1f2 service nova] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] Received unexpected event network-vif-unplugged-69831639-3628-4b42-8ddd-fe0965dea4b6 for instance with vm_state rescued and task_state unrescuing.
Aug 17 12:05:45 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:05:45 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:05:45 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:05:45 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] Instance destroyed successfully.
Aug 17 12:05:46 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-f3ea4aa7-e806-40dc-83b8-ed157a78c594 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] Acquiring lock "509263cd-9995-4e6b-8b26-461b7eb05ded" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:05:46 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-f3ea4aa7-e806-40dc-83b8-ed157a78c594 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] Lock "509263cd-9995-4e6b-8b26-461b7eb05ded" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:05:46 user nova-compute[73449]: INFO nova.compute.manager [None req-f3ea4aa7-e806-40dc-83b8-ed157a78c594 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] [instance: 509263cd-9995-4e6b-8b26-461b7eb05ded] Detaching volume 50b95d1b-611a-4f7b-bdc2-5c2ebeac5a97
Aug 17 12:05:46 user nova-compute[73449]: INFO nova.virt.block_device [None req-f3ea4aa7-e806-40dc-83b8-ed157a78c594 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] [instance: 509263cd-9995-4e6b-8b26-461b7eb05ded] Attempting to driver detach volume 50b95d1b-611a-4f7b-bdc2-5c2ebeac5a97 from mountpoint /dev/vdb
Aug 17 12:05:46 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-f3ea4aa7-e806-40dc-83b8-ed157a78c594 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] Attempting to detach device vdb from instance 509263cd-9995-4e6b-8b26-461b7eb05ded from the persistent domain config. {{(pid=73449) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 12:05:46 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-f3ea4aa7-e806-40dc-83b8-ed157a78c594 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 12:05:46 user nova-compute[73449]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 12:05:46 user nova-compute[73449]:   <source dev="/dev/sdd"/>
Aug 17 12:05:46 user nova-compute[73449]:   <target dev="vdb" bus="virtio"/>
Aug 17 12:05:46 user nova-compute[73449]:   <serial>50b95d1b-611a-4f7b-bdc2-5c2ebeac5a97</serial>
Aug 17 12:05:46 user nova-compute[73449]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 12:05:46 user nova-compute[73449]: </disk>
Aug 17 12:05:46 user nova-compute[73449]:  {{(pid=73449) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 12:05:46 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-f3ea4aa7-e806-40dc-83b8-ed157a78c594 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] Successfully detached device vdb from instance 509263cd-9995-4e6b-8b26-461b7eb05ded from the persistent domain config.
Aug 17 12:05:46 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-f3ea4aa7-e806-40dc-83b8-ed157a78c594 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 509263cd-9995-4e6b-8b26-461b7eb05ded from the live domain config. {{(pid=73449) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 12:05:46 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-f3ea4aa7-e806-40dc-83b8-ed157a78c594 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 12:05:46 user nova-compute[73449]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 12:05:46 user nova-compute[73449]:   <source dev="/dev/sdd"/>
Aug 17 12:05:46 user nova-compute[73449]:   <target dev="vdb" bus="virtio"/>
Aug 17 12:05:46 user nova-compute[73449]:   <serial>50b95d1b-611a-4f7b-bdc2-5c2ebeac5a97</serial>
Aug 17 12:05:46 user nova-compute[73449]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 12:05:46 user nova-compute[73449]: </disk>
Aug 17 12:05:46 user nova-compute[73449]:  {{(pid=73449) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 12:05:46 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Received event <DeviceRemovedEvent: 1692273946.6440458, 509263cd-9995-4e6b-8b26-461b7eb05ded => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73449) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 12:05:46 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-f3ea4aa7-e806-40dc-83b8-ed157a78c594 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 509263cd-9995-4e6b-8b26-461b7eb05ded {{(pid=73449) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 12:05:46 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-f3ea4aa7-e806-40dc-83b8-ed157a78c594 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] Successfully detached device vdb from instance 509263cd-9995-4e6b-8b26-461b7eb05ded from the live domain config.
Aug 17 12:05:46 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3ea4aa7-e806-40dc-83b8-ed157a78c594 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] [instance: 509263cd-9995-4e6b-8b26-461b7eb05ded] calling os-brick to detach iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 12:05:46 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3ea4aa7-e806-40dc-83b8-ed157a78c594 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, {'target_iqns': ['iqn.2010-10.org.openstack:50b95d1b-611a-4f7b-bdc2-5c2ebeac5a97'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GvSRJPtk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 12:05:46 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-f3ea4aa7-e806-40dc-83b8-ed157a78c594 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 12:05:46 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-f3ea4aa7-e806-40dc-83b8-ed157a78c594 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 12:05:46 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-f3ea4aa7-e806-40dc-83b8-ed157a78c594 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 12:05:46 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3ea4aa7-e806-40dc-83b8-ed157a78c594 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:50b95d1b-611a-4f7b-bdc2-5c2ebeac5a97', 0)] {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 12:05:46 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:05:46 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:05:46 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[b53e470b-d004-45c6-9a4e-3db228d5b9ba]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50b95d1b-611a-4f7b-bdc2-5c2ebeac5a97\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8314fb1e-61f9-44b5-b944-5a94677724c8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:05:46 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:05:46 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:05:46 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a090bf5-c0fd-491b-8f34-d15eb6db0d49]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8314fb1e-61f9-44b5-b944-5a94677724c8 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50b95d1b-611a-4f7b-bdc2-5c2ebeac5a97 (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:05:46 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3ea4aa7-e806-40dc-83b8-ed157a78c594 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)
Aug 17 12:05:46 user nova-compute[73449]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8314fb1e-61f9-44b5-b944-5a94677724c8 (non-flash)
Aug 17 12:05:46 user nova-compute[73449]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49 (non-flash)
Aug 17 12:05:46 user nova-compute[73449]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50b95d1b-611a-4f7b-bdc2-5c2ebeac5a97 (non-flash)
Aug 17 12:05:46 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 12:05:46 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3ea4aa7-e806-40dc-83b8-ed157a78c594 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)
Aug 17 12:05:46 user nova-compute[73449]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8314fb1e-61f9-44b5-b944-5a94677724c8 (non-flash)
Aug 17 12:05:46 user nova-compute[73449]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49 (non-flash)
Aug 17 12:05:46 user nova-compute[73449]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50b95d1b-611a-4f7b-bdc2-5c2ebeac5a97 (non-flash)
Aug 17 12:05:46 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 12:05:46 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3ea4aa7-e806-40dc-83b8-ed157a78c594 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe787665a20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:50b95d1b-611a-4f7b-bdc2-5c2ebeac5a97'): ({'sdd'}, set())}) {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 12:05:46 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-f3ea4aa7-e806-40dc-83b8-ed157a78c594 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] Removing single pathed devices sdd {{(pid=73449) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 12:05:46 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:05:46 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:05:46 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3c3fe2a-afe4-41ef-afb9-aa9e0487af5a]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:05:46 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:05:46 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:05:46 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[16e9b8b0-8c3f-4f8a-87de-bb0deea2ec93]: (4, ('ok\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:05:46 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-f3ea4aa7-e806-40dc-83b8-ed157a78c594 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] Flushing IO for device /dev/sdd {{(pid=73449) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 12:05:46 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:05:46 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:05:46 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bd97229-b171-425f-bba4-56036bdff474]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:05:46 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-f3ea4aa7-e806-40dc-83b8-ed157a78c594 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73449) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 12:05:46 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:05:46 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.042s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:05:46 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[5530717e-0903-4082-a61c-3dddab5f9b69]: (4, ('1', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:05:46 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-f3ea4aa7-e806-40dc-83b8-ed157a78c594 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73449) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 12:05:46 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-f3ea4aa7-e806-40dc-83b8-ed157a78c594 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] SCSI volumes sdd have been removed. {{(pid=73449) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 12:05:46 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3ea4aa7-e806-40dc-83b8-ed157a78c594 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:50b95d1b-611a-4f7b-bdc2-5c2ebeac5a97')] {{(pid=73449) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 12:05:46 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50b95d1b-611a-4f7b-bdc2-5c2ebeac5a97 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:05:46 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50b95d1b-611a-4f7b-bdc2-5c2ebeac5a97 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:05:46 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[1875a15c-1145-47d8-b9a2-6f82703e6052]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:05:46 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3ea4aa7-e806-40dc-83b8-ed157a78c594 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:05:46 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50b95d1b-611a-4f7b-bdc2-5c2ebeac5a97 -p 172.16.0.220:3260 --logout {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:05:46 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50b95d1b-611a-4f7b-bdc2-5c2ebeac5a97 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:05:46 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[83637a4f-7767-4330-abbb-38ee69240fa8]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:50b95d1b-611a-4f7b-bdc2-5c2ebeac5a97, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:50b95d1b-611a-4f7b-bdc2-5c2ebeac5a97, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:05:46 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3ea4aa7-e806-40dc-83b8-ed157a78c594 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:50b95d1b-611a-4f7b-bdc2-5c2ebeac5a97, portal: 172.16.0.220,3260]
Aug 17 12:05:46 user nova-compute[73449]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:50b95d1b-611a-4f7b-bdc2-5c2ebeac5a97, portal: 172.16.0.220,3260] successful.
Aug 17 12:05:46 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:05:46 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50b95d1b-611a-4f7b-bdc2-5c2ebeac5a97 -p 172.16.0.220:3260 --op delete {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:05:46 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50b95d1b-611a-4f7b-bdc2-5c2ebeac5a97 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:05:46 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[87ed88e2-743d-4679-b316-07993c8c7af3]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:05:46 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3ea4aa7-e806-40dc-83b8-ed157a78c594 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:05:46 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-f3ea4aa7-e806-40dc-83b8-ed157a78c594 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 12:05:46 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3ea4aa7-e806-40dc-83b8-ed157a78c594 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] <== disconnect_volume: return (309ms) None {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 12:05:46 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3ea4aa7-e806-40dc-83b8-ed157a78c594 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] [instance: 509263cd-9995-4e6b-8b26-461b7eb05ded] Disconnected iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 12:05:47 user nova-compute[73449]: DEBUG nova.compute.manager [req-0164a41c-2bd1-4e1e-92ca-29dd9e75298c req-dc05bf96-6c15-4631-b1f7-a5a60646be85 service nova] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] Received event network-vif-plugged-69831639-3628-4b42-8ddd-fe0965dea4b6 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:05:47 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-0164a41c-2bd1-4e1e-92ca-29dd9e75298c req-dc05bf96-6c15-4631-b1f7-a5a60646be85 service nova] Acquiring lock "5a627da9-03a1-4239-8721-cefe99c39ee2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:05:47 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-0164a41c-2bd1-4e1e-92ca-29dd9e75298c req-dc05bf96-6c15-4631-b1f7-a5a60646be85 service nova] Lock "5a627da9-03a1-4239-8721-cefe99c39ee2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:05:47 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-0164a41c-2bd1-4e1e-92ca-29dd9e75298c req-dc05bf96-6c15-4631-b1f7-a5a60646be85 service nova] Lock "5a627da9-03a1-4239-8721-cefe99c39ee2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:05:47 user nova-compute[73449]: DEBUG nova.compute.manager [req-0164a41c-2bd1-4e1e-92ca-29dd9e75298c req-dc05bf96-6c15-4631-b1f7-a5a60646be85 service nova] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] No waiting events found dispatching network-vif-plugged-69831639-3628-4b42-8ddd-fe0965dea4b6 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 12:05:47 user nova-compute[73449]: WARNING nova.compute.manager [req-0164a41c-2bd1-4e1e-92ca-29dd9e75298c req-dc05bf96-6c15-4631-b1f7-a5a60646be85 service nova] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] Received unexpected event network-vif-plugged-69831639-3628-4b42-8ddd-fe0965dea4b6 for instance with vm_state rescued and task_state unrescuing.
Aug 17 12:05:47 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:05:47 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:05:47 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:05:47 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:05:47 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:05:47 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:05:47 user nova-compute[73449]: DEBUG nova.objects.instance [None req-f3ea4aa7-e806-40dc-83b8-ed157a78c594 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] Lazy-loading 'flavor' on Instance uuid 509263cd-9995-4e6b-8b26-461b7eb05ded {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:05:47 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-f3ea4aa7-e806-40dc-83b8-ed157a78c594 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] Lock "509263cd-9995-4e6b-8b26-461b7eb05ded" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.841s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:05:48 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:05:49 user nova-compute[73449]: DEBUG nova.compute.manager [req-96c73491-7021-46a3-bbd5-7bf2e091056c req-cff4b16d-a903-4466-93c2-54b6bbe2d0d3 service nova] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] Received event network-vif-plugged-69831639-3628-4b42-8ddd-fe0965dea4b6 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:05:49 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-96c73491-7021-46a3-bbd5-7bf2e091056c req-cff4b16d-a903-4466-93c2-54b6bbe2d0d3 service nova] Acquiring lock "5a627da9-03a1-4239-8721-cefe99c39ee2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:05:49 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-96c73491-7021-46a3-bbd5-7bf2e091056c req-cff4b16d-a903-4466-93c2-54b6bbe2d0d3 service nova] Lock "5a627da9-03a1-4239-8721-cefe99c39ee2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:05:49 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-96c73491-7021-46a3-bbd5-7bf2e091056c req-cff4b16d-a903-4466-93c2-54b6bbe2d0d3 service nova] Lock "5a627da9-03a1-4239-8721-cefe99c39ee2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:05:49 user nova-compute[73449]: DEBUG nova.compute.manager [req-96c73491-7021-46a3-bbd5-7bf2e091056c req-cff4b16d-a903-4466-93c2-54b6bbe2d0d3 service nova] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] No waiting events found dispatching network-vif-plugged-69831639-3628-4b42-8ddd-fe0965dea4b6 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 12:05:49 user nova-compute[73449]: WARNING nova.compute.manager [req-96c73491-7021-46a3-bbd5-7bf2e091056c req-cff4b16d-a903-4466-93c2-54b6bbe2d0d3 service nova] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] Received unexpected event network-vif-plugged-69831639-3628-4b42-8ddd-fe0965dea4b6 for instance with vm_state rescued and task_state unrescuing.
Aug 17 12:05:49 user nova-compute[73449]: DEBUG nova.compute.manager [req-96c73491-7021-46a3-bbd5-7bf2e091056c req-cff4b16d-a903-4466-93c2-54b6bbe2d0d3 service nova] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] Received event network-vif-plugged-69831639-3628-4b42-8ddd-fe0965dea4b6 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:05:49 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-96c73491-7021-46a3-bbd5-7bf2e091056c req-cff4b16d-a903-4466-93c2-54b6bbe2d0d3 service nova] Acquiring lock "5a627da9-03a1-4239-8721-cefe99c39ee2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:05:49 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-96c73491-7021-46a3-bbd5-7bf2e091056c req-cff4b16d-a903-4466-93c2-54b6bbe2d0d3 service nova] Lock "5a627da9-03a1-4239-8721-cefe99c39ee2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:05:49 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-96c73491-7021-46a3-bbd5-7bf2e091056c req-cff4b16d-a903-4466-93c2-54b6bbe2d0d3 service nova] Lock "5a627da9-03a1-4239-8721-cefe99c39ee2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:05:49 user nova-compute[73449]: DEBUG nova.compute.manager [req-96c73491-7021-46a3-bbd5-7bf2e091056c req-cff4b16d-a903-4466-93c2-54b6bbe2d0d3 service nova] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] No waiting events found dispatching network-vif-plugged-69831639-3628-4b42-8ddd-fe0965dea4b6 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 12:05:49 user nova-compute[73449]: WARNING nova.compute.manager [req-96c73491-7021-46a3-bbd5-7bf2e091056c req-cff4b16d-a903-4466-93c2-54b6bbe2d0d3 service nova] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] Received unexpected event network-vif-plugged-69831639-3628-4b42-8ddd-fe0965dea4b6 for instance with vm_state rescued and task_state unrescuing.
Aug 17 12:05:49 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Removed pending event for 5a627da9-03a1-4239-8721-cefe99c39ee2 due to event {{(pid=73449) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 17 12:05:49 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692273949.453631, 5a627da9-03a1-4239-8721-cefe99c39ee2 => Resumed> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 12:05:49 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] VM Resumed (Lifecycle Event)
Aug 17 12:05:49 user nova-compute[73449]: DEBUG nova.compute.manager [None req-bd5991ef-63f3-4d3b-9ea4-8910fdc962a2 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 12:05:49 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 12:05:49 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 12:05:49 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 17 12:05:49 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692273949.4586782, 5a627da9-03a1-4239-8721-cefe99c39ee2 => Started> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 12:05:49 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] VM Started (Lifecycle Event)
Aug 17 12:05:49 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 12:05:49 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 12:05:49 user nova-compute[73449]: DEBUG nova.compute.manager [req-8af77bfc-ba3f-4a9f-ba63-7314a65159d3 req-f73c6ec9-4102-4eba-9a56-72d57cc20e61 service nova] [instance: 8fdfaf32-0957-453a-b1cf-9a3c19815c45] Received event network-changed-fb4a2e2a-cbf2-4141-bac3-c6033653bb84 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:05:49 user nova-compute[73449]: DEBUG nova.compute.manager [req-8af77bfc-ba3f-4a9f-ba63-7314a65159d3 req-f73c6ec9-4102-4eba-9a56-72d57cc20e61 service nova] [instance: 8fdfaf32-0957-453a-b1cf-9a3c19815c45] Refreshing instance network info cache due to event network-changed-fb4a2e2a-cbf2-4141-bac3-c6033653bb84. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 12:05:49 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-8af77bfc-ba3f-4a9f-ba63-7314a65159d3 req-f73c6ec9-4102-4eba-9a56-72d57cc20e61 service nova] Acquiring lock "refresh_cache-8fdfaf32-0957-453a-b1cf-9a3c19815c45" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 12:05:49 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-8af77bfc-ba3f-4a9f-ba63-7314a65159d3 req-f73c6ec9-4102-4eba-9a56-72d57cc20e61 service nova] Acquired lock "refresh_cache-8fdfaf32-0957-453a-b1cf-9a3c19815c45" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 12:05:49 user nova-compute[73449]: DEBUG nova.network.neutron [req-8af77bfc-ba3f-4a9f-ba63-7314a65159d3 req-f73c6ec9-4102-4eba-9a56-72d57cc20e61 service nova] [instance: 8fdfaf32-0957-453a-b1cf-9a3c19815c45] Refreshing network info cache for port fb4a2e2a-cbf2-4141-bac3-c6033653bb84 {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 12:05:50 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-04a0d441-ed2e-464c-9358-87d938e42381 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Acquiring lock "8fdfaf32-0957-453a-b1cf-9a3c19815c45" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:05:50 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-04a0d441-ed2e-464c-9358-87d938e42381 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Lock "8fdfaf32-0957-453a-b1cf-9a3c19815c45" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:05:50 user nova-compute[73449]: DEBUG nova.objects.instance [None req-04a0d441-ed2e-464c-9358-87d938e42381 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Lazy-loading 'flavor' on Instance uuid 8fdfaf32-0957-453a-b1cf-9a3c19815c45 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:05:50 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-04a0d441-ed2e-464c-9358-87d938e42381 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Lock "8fdfaf32-0957-453a-b1cf-9a3c19815c45" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:05:50 user nova-compute[73449]: DEBUG nova.network.neutron [req-8af77bfc-ba3f-4a9f-ba63-7314a65159d3 req-f73c6ec9-4102-4eba-9a56-72d57cc20e61 service nova] [instance: 8fdfaf32-0957-453a-b1cf-9a3c19815c45] Updated VIF entry in instance network info cache for port fb4a2e2a-cbf2-4141-bac3-c6033653bb84. {{(pid=73449) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 12:05:50 user nova-compute[73449]: DEBUG nova.network.neutron [req-8af77bfc-ba3f-4a9f-ba63-7314a65159d3 req-f73c6ec9-4102-4eba-9a56-72d57cc20e61 service nova] [instance: 8fdfaf32-0957-453a-b1cf-9a3c19815c45] Updating instance_info_cache with network_info: [{"id": "fb4a2e2a-cbf2-4141-bac3-c6033653bb84", "address": "fa:16:3e:c1:11:0e", "network": {"id": "1e184b35-0ffc-4c89-951b-d97b1961f72f", "bridge": "br-int", "label": "tempest-TestStampPattern-2134909631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c9e5daa31ad47e996b59f1b7c5db0d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb4a2e2a-cb", "ovs_interfaceid": "fb4a2e2a-cbf2-4141-bac3-c6033653bb84", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 12:05:50 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-8af77bfc-ba3f-4a9f-ba63-7314a65159d3 req-f73c6ec9-4102-4eba-9a56-72d57cc20e61 service nova] Releasing lock "refresh_cache-8fdfaf32-0957-453a-b1cf-9a3c19815c45" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 12:05:50 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-04a0d441-ed2e-464c-9358-87d938e42381 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Acquiring lock "8fdfaf32-0957-453a-b1cf-9a3c19815c45" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:05:50 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-04a0d441-ed2e-464c-9358-87d938e42381 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Lock "8fdfaf32-0957-453a-b1cf-9a3c19815c45" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:05:50 user nova-compute[73449]: INFO nova.compute.manager [None req-04a0d441-ed2e-464c-9358-87d938e42381 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] [instance: 8fdfaf32-0957-453a-b1cf-9a3c19815c45] Attaching volume d0b06599-4be4-4c0b-9771-5ce574626901 to /dev/vdb
Aug 17 12:05:50 user nova-compute[73449]: DEBUG os_brick.utils [None req-04a0d441-ed2e-464c-9358-87d938e42381 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 12:05:50 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:05:50 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:05:50 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ee81f7d-1fc1-41ae-a4d6-1164a41dad43]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4d3924302012\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:05:50 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:05:50 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:05:50 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b6979d5-a4ef-4dbd-aac8-a13049fc531a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:05:50 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:05:50 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:05:50 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d79523d-ecbc-48db-810c-3152183a8b91]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:05:50 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce85d530-53af-4eaf-855b-1a7c7f8ba427]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:05:50 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-04a0d441-ed2e-464c-9358-87d938e42381 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Running cmd (subprocess): nvme version {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:05:50 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-04a0d441-ed2e-464c-9358-87d938e42381 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] 'nvme version' failed. Not Retrying. {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 12:05:50 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.nvmeof [None req-04a0d441-ed2e-464c-9358-87d938e42381 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] nvme not present on system {{(pid=73449) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 12:05:50 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:05:50 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 12:05:50 user nova-compute[73449]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 12:05:50 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[36da3991-8251-42f3-8be9-9b89c240880e]: (4, '') {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:05:50 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-04a0d441-ed2e-464c-9358-87d938e42381 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73449) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 12:05:50 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-04a0d441-ed2e-464c-9358-87d938e42381 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73449) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 12:05:50 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-04a0d441-ed2e-464c-9358-87d938e42381 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] LIGHTOS: no hostnqn found. {{(pid=73449) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 12:05:50 user nova-compute[73449]: DEBUG os_brick.utils [None req-04a0d441-ed2e-464c-9358-87d938e42381 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4d3924302012', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 12:05:50 user nova-compute[73449]: DEBUG nova.virt.block_device [None req-04a0d441-ed2e-464c-9358-87d938e42381 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] [instance: 8fdfaf32-0957-453a-b1cf-9a3c19815c45] Updating existing volume attachment record: 6c7d2e3c-6338-4dba-be73-43326b38f44a {{(pid=73449) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 12:05:50 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:05:53 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:05:55 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:05:56 user nova-compute[73449]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692273941.5019312, 61201d5c-26f1-4c6d-a764-be2ee2e533ae => Stopped> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 12:05:56 user nova-compute[73449]: INFO nova.compute.manager [-] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] VM Stopped (Lifecycle Event)
Aug 17 12:05:56 user nova-compute[73449]: DEBUG nova.compute.manager [None req-581c8885-32f9-45a2-85bd-11fbceec7c8f None None] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 12:05:56 user nova-compute[73449]: DEBUG nova.compute.manager [None req-581c8885-32f9-45a2-85bd-11fbceec7c8f None None] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 12:05:58 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:06:00 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:06:01 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04a0d441-ed2e-464c-9358-87d938e42381 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] [instance: 8fdfaf32-0957-453a-b1cf-9a3c19815c45] Calling os-brick to attach iSCSI Volume {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 12:06:01 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-04a0d441-ed2e-464c-9358-87d938e42381 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d0b06599-4be4-4c0b-9771-5ce574626901'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iHlGcgeW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 12:06:01 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-04a0d441-ed2e-464c-9358-87d938e42381 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 12:06:01 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-04a0d441-ed2e-464c-9358-87d938e42381 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 12:06:01 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-04a0d441-ed2e-464c-9358-87d938e42381 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 12:06:01 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-04a0d441-ed2e-464c-9358-87d938e42381 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 12:06:01 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-04a0d441-ed2e-464c-9358-87d938e42381 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d0b06599-4be4-4c0b-9771-5ce574626901" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 12:06:01 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-04a0d441-ed2e-464c-9358-87d938e42381 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d0b06599-4be4-4c0b-9771-5ce574626901" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 12:06:01 user nova-compute[73449]: INFO os_brick.initiator.connectors.iscsi [None req-04a0d441-ed2e-464c-9358-87d938e42381 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 12:06:01 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0b06599-4be4-4c0b-9771-5ce574626901 -p 172.16.0.220:3260 {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:06:01 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0b06599-4be4-4c0b-9771-5ce574626901 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:06:01 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dec1c28-f787-4e42-bfed-a857d448df72]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:06:01 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-04a0d441-ed2e-464c-9358-87d938e42381 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 12:06:01 user nova-compute[73449]:  {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:06:01 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0b06599-4be4-4c0b-9771-5ce574626901 -p 172.16.0.220:3260 --interface default --op new {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:06:01 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0b06599-4be4-4c0b-9771-5ce574626901 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:06:01 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[82476fba-a145-4e1d-ba4e-6b645cd776d3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d0b06599-4be4-4c0b-9771-5ce574626901] added\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:06:01 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-04a0d441-ed2e-464c-9358-87d938e42381 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d0b06599-4be4-4c0b-9771-5ce574626901] added
Aug 17 12:06:01 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:06:01 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0b06599-4be4-4c0b-9771-5ce574626901 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:06:01 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0b06599-4be4-4c0b-9771-5ce574626901 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:06:01 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[71b85845-0a59-452f-a8a9-37c9f3ac15c3]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:06:01 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-04a0d441-ed2e-464c-9358-87d938e42381 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:06:01 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0b06599-4be4-4c0b-9771-5ce574626901 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:06:01 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0b06599-4be4-4c0b-9771-5ce574626901 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:06:01 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ed39e32-a81f-4af4-b39d-40dbbb791848]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:06:01 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-04a0d441-ed2e-464c-9358-87d938e42381 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:06:01 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0b06599-4be4-4c0b-9771-5ce574626901 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iHlGcgeW {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:06:01 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0b06599-4be4-4c0b-9771-5ce574626901 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iHlGcgeW" returned: 0 in 0.027s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:06:01 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6d95f2a-cc3a-4d3a-a6dd-538058ee0f8c]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:06:01 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-04a0d441-ed2e-464c-9358-87d938e42381 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iHlGcgeW'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:06:01 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0b06599-4be4-4c0b-9771-5ce574626901 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:06:01 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0b06599-4be4-4c0b-9771-5ce574626901 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:06:01 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed614e60-176e-4654-81c2-5d0d15591d12]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:06:01 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-04a0d441-ed2e-464c-9358-87d938e42381 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:06:01 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:06:01 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:06:01 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd3e1ad8-d96d-404a-a92e-c2a2b21feade]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8314fb1e-61f9-44b5-b944-5a94677724c8 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49 (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:06:01 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-04a0d441-ed2e-464c-9358-87d938e42381 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)
Aug 17 12:06:01 user nova-compute[73449]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8314fb1e-61f9-44b5-b944-5a94677724c8 (non-flash)
Aug 17 12:06:01 user nova-compute[73449]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49 (non-flash)
Aug 17 12:06:01 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 12:06:01 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-04a0d441-ed2e-464c-9358-87d938e42381 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)
Aug 17 12:06:01 user nova-compute[73449]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8314fb1e-61f9-44b5-b944-5a94677724c8 (non-flash)
Aug 17 12:06:01 user nova-compute[73449]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49 (non-flash)
Aug 17 12:06:01 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 12:06:01 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0b06599-4be4-4c0b-9771-5ce574626901 -p 172.16.0.220:3260 --login {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:06:01 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:06:02 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0b06599-4be4-4c0b-9771-5ce574626901 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:06:02 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e2b6e38-d30c-439b-be50-840cb9946244]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d0b06599-4be4-4c0b-9771-5ce574626901, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d0b06599-4be4-4c0b-9771-5ce574626901, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:06:02 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-04a0d441-ed2e-464c-9358-87d938e42381 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d0b06599-4be4-4c0b-9771-5ce574626901, portal: 172.16.0.220,3260]
Aug 17 12:06:02 user nova-compute[73449]: Login to [iface: default, target: iqn.2010-10.org.openstack:d0b06599-4be4-4c0b-9771-5ce574626901, portal: 172.16.0.220,3260] successful.
Aug 17 12:06:02 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:06:02 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0b06599-4be4-4c0b-9771-5ce574626901 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:06:02 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0b06599-4be4-4c0b-9771-5ce574626901 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:06:02 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d3e251c-f22b-4213-a4b6-432207c585de]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:06:02 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-04a0d441-ed2e-464c-9358-87d938e42381 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:06:02 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:06:02 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:06:02 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[713a5559-b744-4900-9153-e40953347fc3]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8314fb1e-61f9-44b5-b944-5a94677724c8 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b06599-4be4-4c0b-9771-5ce574626901 (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:06:02 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-04a0d441-ed2e-464c-9358-87d938e42381 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)
Aug 17 12:06:02 user nova-compute[73449]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8314fb1e-61f9-44b5-b944-5a94677724c8 (non-flash)
Aug 17 12:06:02 user nova-compute[73449]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49 (non-flash)
Aug 17 12:06:02 user nova-compute[73449]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b06599-4be4-4c0b-9771-5ce574626901 (non-flash)
Aug 17 12:06:02 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 12:06:02 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-04a0d441-ed2e-464c-9358-87d938e42381 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)
Aug 17 12:06:02 user nova-compute[73449]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8314fb1e-61f9-44b5-b944-5a94677724c8 (non-flash)
Aug 17 12:06:02 user nova-compute[73449]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49 (non-flash)
Aug 17 12:06:02 user nova-compute[73449]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b06599-4be4-4c0b-9771-5ce574626901 (non-flash)
Aug 17 12:06:02 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 12:06:02 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-04a0d441-ed2e-464c-9358-87d938e42381 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d0b06599-4be4-4c0b-9771-5ce574626901" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 12:06:02 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-04a0d441-ed2e-464c-9358-87d938e42381 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Connected to 172.16.0.220:3260 {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 12:06:02 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-04a0d441-ed2e-464c-9358-87d938e42381 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] HCTL ('35', '-', '-', 0) found on session 52 with lun 0 {{(pid=73449) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 12:06:02 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-04a0d441-ed2e-464c-9358-87d938e42381 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73449) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 12:06:02 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:06:02 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.029s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:06:02 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[035aaa5e-8579-4de6-b07e-778ef965f7e8]: (4, ('- - 0', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:06:02 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-04a0d441-ed2e-464c-9358-87d938e42381 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Searching for a device in session 52 and hctl ['35', '*', '*', 0] yield: None {{(pid=73449) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 12:06:03 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-04a0d441-ed2e-464c-9358-87d938e42381 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Searching for a device in session 52 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73449) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 12:06:03 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-04a0d441-ed2e-464c-9358-87d938e42381 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iHlGcgeW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 12:06:03 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-04a0d441-ed2e-464c-9358-87d938e42381 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.337s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 12:06:03 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-04a0d441-ed2e-464c-9358-87d938e42381 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] <== connect_volume: return (1338ms) {'type': 'block', 'scsi_wwn': '23266653434373363', 'path': '/dev/sdd'} {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 12:06:03 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04a0d441-ed2e-464c-9358-87d938e42381 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] [instance: 8fdfaf32-0957-453a-b1cf-9a3c19815c45] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23266653434373363', 'path': '/dev/sdd'} {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 12:06:03 user nova-compute[73449]: DEBUG nova.objects.instance [None req-04a0d441-ed2e-464c-9358-87d938e42381 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Lazy-loading 'flavor' on Instance uuid 8fdfaf32-0957-453a-b1cf-9a3c19815c45 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:06:03 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-04a0d441-ed2e-464c-9358-87d938e42381 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 12:06:03 user nova-compute[73449]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 12:06:03 user nova-compute[73449]:   <source dev="/dev/sdd"/>
Aug 17 12:06:03 user nova-compute[73449]:   <target dev="vdb" bus="virtio"/>
Aug 17 12:06:03 user nova-compute[73449]:   <serial>d0b06599-4be4-4c0b-9771-5ce574626901</serial>
Aug 17 12:06:03 user nova-compute[73449]: </disk>
Aug 17 12:06:03 user nova-compute[73449]:  {{(pid=73449) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 12:06:03 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-04a0d441-ed2e-464c-9358-87d938e42381 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] No BDM found with device name vda, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 12:06:03 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-04a0d441-ed2e-464c-9358-87d938e42381 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 12:06:03 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-04a0d441-ed2e-464c-9358-87d938e42381 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] No VIF found with MAC fa:16:3e:c1:11:0e, not building metadata {{(pid=73449) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 12:06:03 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-04a0d441-ed2e-464c-9358-87d938e42381 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Lock "8fdfaf32-0957-453a-b1cf-9a3c19815c45" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.409s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:06:03 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:06:04 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:06:04 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Cleaning up deleted instances {{(pid=73449) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 17 12:06:04 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] There are 0 instances to clean {{(pid=73449) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 17 12:06:05 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:06:05 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-0dc6a19f-6749-4f1e-808e-c41429157d15 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Acquiring lock "8fdfaf32-0957-453a-b1cf-9a3c19815c45" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:06:05 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-0dc6a19f-6749-4f1e-808e-c41429157d15 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Lock "8fdfaf32-0957-453a-b1cf-9a3c19815c45" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:06:05 user nova-compute[73449]: INFO nova.compute.manager [None req-0dc6a19f-6749-4f1e-808e-c41429157d15 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] [instance: 8fdfaf32-0957-453a-b1cf-9a3c19815c45] Detaching volume d0b06599-4be4-4c0b-9771-5ce574626901
Aug 17 12:06:05 user nova-compute[73449]: INFO nova.virt.block_device [None req-0dc6a19f-6749-4f1e-808e-c41429157d15 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] [instance: 8fdfaf32-0957-453a-b1cf-9a3c19815c45] Attempting to driver detach volume d0b06599-4be4-4c0b-9771-5ce574626901 from mountpoint /dev/vdb
Aug 17 12:06:05 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-0dc6a19f-6749-4f1e-808e-c41429157d15 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Attempting to detach device vdb from instance 8fdfaf32-0957-453a-b1cf-9a3c19815c45 from the persistent domain config. {{(pid=73449) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 12:06:05 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-0dc6a19f-6749-4f1e-808e-c41429157d15 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 12:06:05 user nova-compute[73449]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 12:06:05 user nova-compute[73449]:   <source dev="/dev/sdd"/>
Aug 17 12:06:05 user nova-compute[73449]:   <target dev="vdb" bus="virtio"/>
Aug 17 12:06:05 user nova-compute[73449]:   <serial>d0b06599-4be4-4c0b-9771-5ce574626901</serial>
Aug 17 12:06:05 user nova-compute[73449]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 12:06:05 user nova-compute[73449]: </disk>
Aug 17 12:06:05 user nova-compute[73449]:  {{(pid=73449) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 12:06:05 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-0dc6a19f-6749-4f1e-808e-c41429157d15 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Successfully detached device vdb from instance 8fdfaf32-0957-453a-b1cf-9a3c19815c45 from the persistent domain config.
Aug 17 12:06:05 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-0dc6a19f-6749-4f1e-808e-c41429157d15 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8fdfaf32-0957-453a-b1cf-9a3c19815c45 from the live domain config. {{(pid=73449) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 12:06:05 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-0dc6a19f-6749-4f1e-808e-c41429157d15 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 12:06:05 user nova-compute[73449]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 12:06:05 user nova-compute[73449]:   <source dev="/dev/sdd"/>
Aug 17 12:06:05 user nova-compute[73449]:   <target dev="vdb" bus="virtio"/>
Aug 17 12:06:05 user nova-compute[73449]:   <serial>d0b06599-4be4-4c0b-9771-5ce574626901</serial>
Aug 17 12:06:05 user nova-compute[73449]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 12:06:05 user nova-compute[73449]: </disk>
Aug 17 12:06:05 user nova-compute[73449]:  {{(pid=73449) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 12:06:05 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:06:06 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Received event <DeviceRemovedEvent: 1692273966.3383474, 8fdfaf32-0957-453a-b1cf-9a3c19815c45 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73449) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 12:06:06 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-0dc6a19f-6749-4f1e-808e-c41429157d15 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8fdfaf32-0957-453a-b1cf-9a3c19815c45 {{(pid=73449) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 12:06:06 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-0dc6a19f-6749-4f1e-808e-c41429157d15 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Successfully detached device vdb from instance 8fdfaf32-0957-453a-b1cf-9a3c19815c45 from the live domain config.
Aug 17 12:06:06 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0dc6a19f-6749-4f1e-808e-c41429157d15 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] [instance: 8fdfaf32-0957-453a-b1cf-9a3c19815c45] calling os-brick to detach iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 12:06:06 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc6a19f-6749-4f1e-808e-c41429157d15 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, {'target_iqns': ['iqn.2010-10.org.openstack:d0b06599-4be4-4c0b-9771-5ce574626901'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iHlGcgeW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 12:06:06 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-0dc6a19f-6749-4f1e-808e-c41429157d15 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 12:06:06 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-0dc6a19f-6749-4f1e-808e-c41429157d15 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 12:06:06 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-0dc6a19f-6749-4f1e-808e-c41429157d15 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 12:06:06 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc6a19f-6749-4f1e-808e-c41429157d15 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d0b06599-4be4-4c0b-9771-5ce574626901', 0)] {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 12:06:06 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:06:06 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:06:06 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeb30e29-f3dd-484d-acff-1b7b63ae57f2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8314fb1e-61f9-44b5-b944-5a94677724c8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d0b06599-4be4-4c0b-9771-5ce574626901\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:06:06 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:06:06 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:06:06 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[46008477-6bed-449d-8769-80990764af89]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8314fb1e-61f9-44b5-b944-5a94677724c8 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b06599-4be4-4c0b-9771-5ce574626901 (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:06:06 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc6a19f-6749-4f1e-808e-c41429157d15 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)
Aug 17 12:06:06 user nova-compute[73449]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8314fb1e-61f9-44b5-b944-5a94677724c8 (non-flash)
Aug 17 12:06:06 user nova-compute[73449]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49 (non-flash)
Aug 17 12:06:06 user nova-compute[73449]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b06599-4be4-4c0b-9771-5ce574626901 (non-flash)
Aug 17 12:06:06 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 12:06:06 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc6a19f-6749-4f1e-808e-c41429157d15 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)
Aug 17 12:06:06 user nova-compute[73449]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8314fb1e-61f9-44b5-b944-5a94677724c8 (non-flash)
Aug 17 12:06:06 user nova-compute[73449]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49 (non-flash)
Aug 17 12:06:06 user nova-compute[73449]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b06599-4be4-4c0b-9771-5ce574626901 (non-flash)
Aug 17 12:06:06 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 12:06:06 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc6a19f-6749-4f1e-808e-c41429157d15 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe7587be440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d0b06599-4be4-4c0b-9771-5ce574626901'): ({'sdd'}, set())}) {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 12:06:06 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-0dc6a19f-6749-4f1e-808e-c41429157d15 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Removing single pathed devices sdd {{(pid=73449) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 12:06:06 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:06:06 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:06:06 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[18eb9dad-ed5e-4297-ac3a-6cf0cf0e666e]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:06:06 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:06:06 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:06:06 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[50d589de-58a7-4263-b8fc-6029c8f61b10]: (4, ('ok\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:06:06 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-0dc6a19f-6749-4f1e-808e-c41429157d15 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Flushing IO for device /dev/sdd {{(pid=73449) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 12:06:06 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:06:06 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:06:06 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf4784dc-bbb0-4afb-b1fc-7471246bec27]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:06:06 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-0dc6a19f-6749-4f1e-808e-c41429157d15 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73449) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 12:06:06 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:06:06 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.037s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:06:06 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ac95b90-b7a5-426c-a8d6-966622b50d53]: (4, ('1', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:06:06 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-0dc6a19f-6749-4f1e-808e-c41429157d15 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73449) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 12:06:06 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-0dc6a19f-6749-4f1e-808e-c41429157d15 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] SCSI volumes sdd have been removed. {{(pid=73449) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 12:06:06 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc6a19f-6749-4f1e-808e-c41429157d15 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d0b06599-4be4-4c0b-9771-5ce574626901')] {{(pid=73449) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 12:06:06 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0b06599-4be4-4c0b-9771-5ce574626901 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:06:06 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0b06599-4be4-4c0b-9771-5ce574626901 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:06:06 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[354702bc-7ec7-48de-8497-7efb1c31ce79]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:06:06 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc6a19f-6749-4f1e-808e-c41429157d15 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:06:06 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0b06599-4be4-4c0b-9771-5ce574626901 -p 172.16.0.220:3260 --logout {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:06:06 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0b06599-4be4-4c0b-9771-5ce574626901 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:06:06 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[59b49605-001c-4f31-9302-5afa1a62f0a9]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:d0b06599-4be4-4c0b-9771-5ce574626901, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:d0b06599-4be4-4c0b-9771-5ce574626901, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:06:06 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc6a19f-6749-4f1e-808e-c41429157d15 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:d0b06599-4be4-4c0b-9771-5ce574626901, portal: 172.16.0.220,3260]
Aug 17 12:06:06 user nova-compute[73449]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:d0b06599-4be4-4c0b-9771-5ce574626901, portal: 172.16.0.220,3260] successful.
Aug 17 12:06:06 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:06:06 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0b06599-4be4-4c0b-9771-5ce574626901 -p 172.16.0.220:3260 --op delete {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:06:06 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0b06599-4be4-4c0b-9771-5ce574626901 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:06:06 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e172625-83b9-41f1-bb81-91bce591148b]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:06:06 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc6a19f-6749-4f1e-808e-c41429157d15 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:06:06 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-0dc6a19f-6749-4f1e-808e-c41429157d15 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 12:06:06 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc6a19f-6749-4f1e-808e-c41429157d15 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] <== disconnect_volume: return (290ms) None {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 12:06:06 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0dc6a19f-6749-4f1e-808e-c41429157d15 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] [instance: 8fdfaf32-0957-453a-b1cf-9a3c19815c45] Disconnected iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 12:06:06 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:06:07 user nova-compute[73449]: DEBUG nova.objects.instance [None req-0dc6a19f-6749-4f1e-808e-c41429157d15 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Lazy-loading 'flavor' on Instance uuid 8fdfaf32-0957-453a-b1cf-9a3c19815c45 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:06:07 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-0dc6a19f-6749-4f1e-808e-c41429157d15 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Lock "8fdfaf32-0957-453a-b1cf-9a3c19815c45" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.628s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:06:08 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:06:09 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:06:09 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73449) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 12:06:10 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:06:11 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:06:11 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:06:13 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:06:14 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:06:15 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:06:15 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:06:15 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:06:15 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:06:15 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:06:15 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=73449) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 12:06:16 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/712c777e-251b-43d8-b923-8eda693f32ed/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:06:16 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/712c777e-251b-43d8-b923-8eda693f32ed/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:06:16 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/712c777e-251b-43d8-b923-8eda693f32ed/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:06:16 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/712c777e-251b-43d8-b923-8eda693f32ed/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:06:16 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fdfaf32-0957-453a-b1cf-9a3c19815c45/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:06:16 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fdfaf32-0957-453a-b1cf-9a3c19815c45/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:06:16 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fdfaf32-0957-453a-b1cf-9a3c19815c45/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:06:16 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fdfaf32-0957-453a-b1cf-9a3c19815c45/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:06:16 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/509263cd-9995-4e6b-8b26-461b7eb05ded/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:06:17 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/509263cd-9995-4e6b-8b26-461b7eb05ded/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:06:17 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/509263cd-9995-4e6b-8b26-461b7eb05ded/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:06:17 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/509263cd-9995-4e6b-8b26-461b7eb05ded/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:06:17 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73449) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 12:06:17 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73449) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 12:06:17 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89440604-1daf-4e7a-a524-2f9c21a9cb96/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:06:17 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89440604-1daf-4e7a-a524-2f9c21a9cb96/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:06:17 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89440604-1daf-4e7a-a524-2f9c21a9cb96/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:06:17 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89440604-1daf-4e7a-a524-2f9c21a9cb96/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:06:17 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61201d5c-26f1-4c6d-a764-be2ee2e533ae/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:06:17 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61201d5c-26f1-4c6d-a764-be2ee2e533ae/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:06:17 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61201d5c-26f1-4c6d-a764-be2ee2e533ae/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:06:18 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61201d5c-26f1-4c6d-a764-be2ee2e533ae/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:06:18 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73449) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 12:06:18 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d160711b-0b77-4f9a-b1d9-f0ac16240d4d/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:06:18 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d160711b-0b77-4f9a-b1d9-f0ac16240d4d/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:06:18 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d160711b-0b77-4f9a-b1d9-f0ac16240d4d/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:06:18 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d160711b-0b77-4f9a-b1d9-f0ac16240d4d/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:06:18 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:06:18 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 12:06:18 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 12:06:18 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Hypervisor/Node resource view: name=user free_ram=8030MB free_disk=24.823745727539062GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73449) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 12:06:18 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:06:18 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:06:19 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 89440604-1daf-4e7a-a524-2f9c21a9cb96 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 12:06:19 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 31f5f3d2-41d8-4a26-9eb2-18b891f94734 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 12:06:19 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 712c777e-251b-43d8-b923-8eda693f32ed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 12:06:19 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance d160711b-0b77-4f9a-b1d9-f0ac16240d4d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 12:06:19 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 5a627da9-03a1-4239-8721-cefe99c39ee2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 12:06:19 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 61201d5c-26f1-4c6d-a764-be2ee2e533ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 12:06:19 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 509263cd-9995-4e6b-8b26-461b7eb05ded actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 12:06:19 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 8fdfaf32-0957-453a-b1cf-9a3c19815c45 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 12:06:19 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=73449) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 12:06:19 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=73449) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 12:06:19 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 12:06:19 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 12:06:19 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Compute_service record updated for user:user {{(pid=73449) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 12:06:19 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.395s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:06:20 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:06:20 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Starting heal instance info cache {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 12:06:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "refresh_cache-712c777e-251b-43d8-b923-8eda693f32ed" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 12:06:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquired lock "refresh_cache-712c777e-251b-43d8-b923-8eda693f32ed" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 12:06:20 user nova-compute[73449]: DEBUG nova.network.neutron [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: 712c777e-251b-43d8-b923-8eda693f32ed] Forcefully refreshing network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 12:06:20 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:06:20 user nova-compute[73449]: DEBUG nova.network.neutron [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: 712c777e-251b-43d8-b923-8eda693f32ed] Updating instance_info_cache with network_info: [{"id": "b1a278b5-bdf7-4803-bbff-96579cf1fbd8", "address": "fa:16:3e:0e:47:73", "network": {"id": "9455bb75-f75a-41ff-8f6f-49f55aa738f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-425274599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec3b0b72e47448ebe99f9fc64119c1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1a278b5-bd", "ovs_interfaceid": "b1a278b5-bdf7-4803-bbff-96579cf1fbd8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 12:06:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Releasing lock "refresh_cache-712c777e-251b-43d8-b923-8eda693f32ed" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 12:06:20 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: 712c777e-251b-43d8-b923-8eda693f32ed] Updated the network info_cache for instance {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 12:06:20 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:06:20 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:06:20 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:06:22 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-825d1979-6cde-4f7e-b716-8af794ce1603 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Acquiring lock "d160711b-0b77-4f9a-b1d9-f0ac16240d4d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:06:22 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-825d1979-6cde-4f7e-b716-8af794ce1603 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Lock "d160711b-0b77-4f9a-b1d9-f0ac16240d4d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:06:22 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-825d1979-6cde-4f7e-b716-8af794ce1603 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Acquiring lock "d160711b-0b77-4f9a-b1d9-f0ac16240d4d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:06:22 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-825d1979-6cde-4f7e-b716-8af794ce1603 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Lock "d160711b-0b77-4f9a-b1d9-f0ac16240d4d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:06:22 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-825d1979-6cde-4f7e-b716-8af794ce1603 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Lock "d160711b-0b77-4f9a-b1d9-f0ac16240d4d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:06:22 user nova-compute[73449]: INFO nova.compute.manager [None req-825d1979-6cde-4f7e-b716-8af794ce1603 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: d160711b-0b77-4f9a-b1d9-f0ac16240d4d] Terminating instance
Aug 17 12:06:22 user nova-compute[73449]: DEBUG nova.compute.manager [None req-825d1979-6cde-4f7e-b716-8af794ce1603 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: d160711b-0b77-4f9a-b1d9-f0ac16240d4d] Start destroying the instance on the hypervisor. {{(pid=73449) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 12:06:22 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:06:22 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:06:22 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:06:22 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:06:22 user nova-compute[73449]: DEBUG nova.compute.manager [req-74531c8a-85bf-4c43-854f-da01610d256b req-207cde79-9f44-4d33-9fad-b46da73fa854 service nova] [instance: d160711b-0b77-4f9a-b1d9-f0ac16240d4d] Received event network-vif-unplugged-ad3f0bca-081f-47c5-909b-2b2b2e2fe69f {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:06:22 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-74531c8a-85bf-4c43-854f-da01610d256b req-207cde79-9f44-4d33-9fad-b46da73fa854 service nova] Acquiring lock "d160711b-0b77-4f9a-b1d9-f0ac16240d4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:06:22 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-74531c8a-85bf-4c43-854f-da01610d256b req-207cde79-9f44-4d33-9fad-b46da73fa854 service nova] Lock "d160711b-0b77-4f9a-b1d9-f0ac16240d4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:06:22 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-74531c8a-85bf-4c43-854f-da01610d256b req-207cde79-9f44-4d33-9fad-b46da73fa854 service nova] Lock "d160711b-0b77-4f9a-b1d9-f0ac16240d4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:06:22 user nova-compute[73449]: DEBUG nova.compute.manager [req-74531c8a-85bf-4c43-854f-da01610d256b req-207cde79-9f44-4d33-9fad-b46da73fa854 service nova] [instance: d160711b-0b77-4f9a-b1d9-f0ac16240d4d] No waiting events found dispatching network-vif-unplugged-ad3f0bca-081f-47c5-909b-2b2b2e2fe69f {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 12:06:22 user nova-compute[73449]: DEBUG nova.compute.manager [req-74531c8a-85bf-4c43-854f-da01610d256b req-207cde79-9f44-4d33-9fad-b46da73fa854 service nova] [instance: d160711b-0b77-4f9a-b1d9-f0ac16240d4d] Received event network-vif-unplugged-ad3f0bca-081f-47c5-909b-2b2b2e2fe69f for instance with task_state deleting. {{(pid=73449) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 12:06:23 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: d160711b-0b77-4f9a-b1d9-f0ac16240d4d] Instance destroyed successfully.
Aug 17 12:06:23 user nova-compute[73449]: DEBUG nova.objects.instance [None req-825d1979-6cde-4f7e-b716-8af794ce1603 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Lazy-loading 'resources' on Instance uuid d160711b-0b77-4f9a-b1d9-f0ac16240d4d {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:06:23 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-825d1979-6cde-4f7e-b716-8af794ce1603 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T12:00:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1074855423',display_name='tempest-AttachVolumeNegativeTest-server-1074855423',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1074855423',id=42,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCmFkfqS9Dfdq5RHGdGFNtv05KFEl8BQknoOmNzb2vRGjZ225jUWucs3apLskPk8Fn1rbu/P5bCBQGXFav5F4pHSv2IumBeL2E1IGuWjYSsqE29OGnIoR2e2vNHuxbYkOw==',key_name='tempest-keypair-1046412207',keypairs=<?>,launch_index=0,launched_at=2023-08-17T12:00:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='75aa99e369c54b65aff27adbb1daf2b8',ramdisk_id='',reservation_id='r-ml7pzzvw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-165752051',owner_user_name='tempest-AttachVolumeNegativeTest-165752051-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T12:00:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55cde68973ca42d095180b5c0701b49b',uuid=d160711b-0b77-4f9a-b1d9-f0ac16240d4d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ad3f0bca-081f-47c5-909b-2b2b2e2fe69f", "address": "fa:16:3e:d6:cf:c6", "network": {"id": "71648e1b-cf19-44b7-bae2-9d38543cdee9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-822323626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75aa99e369c54b65aff27adbb1daf2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad3f0bca-08", "ovs_interfaceid": "ad3f0bca-081f-47c5-909b-2b2b2e2fe69f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 12:06:23 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-825d1979-6cde-4f7e-b716-8af794ce1603 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Converting VIF {"id": "ad3f0bca-081f-47c5-909b-2b2b2e2fe69f", "address": "fa:16:3e:d6:cf:c6", "network": {"id": "71648e1b-cf19-44b7-bae2-9d38543cdee9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-822323626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75aa99e369c54b65aff27adbb1daf2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad3f0bca-08", "ovs_interfaceid": "ad3f0bca-081f-47c5-909b-2b2b2e2fe69f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 12:06:23 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-825d1979-6cde-4f7e-b716-8af794ce1603 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d6:cf:c6,bridge_name='br-int',has_traffic_filtering=True,id=ad3f0bca-081f-47c5-909b-2b2b2e2fe69f,network=Network(71648e1b-cf19-44b7-bae2-9d38543cdee9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad3f0bca-08') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 12:06:23 user nova-compute[73449]: DEBUG os_vif [None req-825d1979-6cde-4f7e-b716-8af794ce1603 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d6:cf:c6,bridge_name='br-int',has_traffic_filtering=True,id=ad3f0bca-081f-47c5-909b-2b2b2e2fe69f,network=Network(71648e1b-cf19-44b7-bae2-9d38543cdee9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad3f0bca-08') {{(pid=73449) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 12:06:23 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:06:23 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapad3f0bca-08, bridge=br-int, if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 12:06:23 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:06:23 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:06:23 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:06:23 user nova-compute[73449]: INFO os_vif [None req-825d1979-6cde-4f7e-b716-8af794ce1603 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d6:cf:c6,bridge_name='br-int',has_traffic_filtering=True,id=ad3f0bca-081f-47c5-909b-2b2b2e2fe69f,network=Network(71648e1b-cf19-44b7-bae2-9d38543cdee9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad3f0bca-08')
Aug 17 12:06:23 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-825d1979-6cde-4f7e-b716-8af794ce1603 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: d160711b-0b77-4f9a-b1d9-f0ac16240d4d] Deleting instance files /opt/stack/data/nova/instances/d160711b-0b77-4f9a-b1d9-f0ac16240d4d_del
Aug 17 12:06:23 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-825d1979-6cde-4f7e-b716-8af794ce1603 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: d160711b-0b77-4f9a-b1d9-f0ac16240d4d] Deletion of /opt/stack/data/nova/instances/d160711b-0b77-4f9a-b1d9-f0ac16240d4d_del complete
Aug 17 12:06:23 user nova-compute[73449]: INFO nova.compute.manager [None req-825d1979-6cde-4f7e-b716-8af794ce1603 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: d160711b-0b77-4f9a-b1d9-f0ac16240d4d] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 17 12:06:23 user nova-compute[73449]: DEBUG oslo.service.loopingcall [None req-825d1979-6cde-4f7e-b716-8af794ce1603 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73449) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 12:06:23 user nova-compute[73449]: DEBUG nova.compute.manager [-] [instance: d160711b-0b77-4f9a-b1d9-f0ac16240d4d] Deallocating network for instance {{(pid=73449) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 12:06:23 user nova-compute[73449]: DEBUG nova.network.neutron [-] [instance: d160711b-0b77-4f9a-b1d9-f0ac16240d4d] deallocate_for_instance() {{(pid=73449) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 12:06:23 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:06:24 user nova-compute[73449]: DEBUG nova.compute.manager [req-d569cb00-1db5-4b06-88b3-771b158dd3bd req-3c8f46f8-c95f-41fa-b4c6-0ce9888e985f service nova] [instance: d160711b-0b77-4f9a-b1d9-f0ac16240d4d] Received event network-vif-plugged-ad3f0bca-081f-47c5-909b-2b2b2e2fe69f {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:06:24 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-d569cb00-1db5-4b06-88b3-771b158dd3bd req-3c8f46f8-c95f-41fa-b4c6-0ce9888e985f service nova] Acquiring lock "d160711b-0b77-4f9a-b1d9-f0ac16240d4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:06:24 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-d569cb00-1db5-4b06-88b3-771b158dd3bd req-3c8f46f8-c95f-41fa-b4c6-0ce9888e985f service nova] Lock "d160711b-0b77-4f9a-b1d9-f0ac16240d4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:06:24 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-d569cb00-1db5-4b06-88b3-771b158dd3bd req-3c8f46f8-c95f-41fa-b4c6-0ce9888e985f service nova] Lock "d160711b-0b77-4f9a-b1d9-f0ac16240d4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:06:24 user nova-compute[73449]: DEBUG nova.compute.manager [req-d569cb00-1db5-4b06-88b3-771b158dd3bd req-3c8f46f8-c95f-41fa-b4c6-0ce9888e985f service nova] [instance: d160711b-0b77-4f9a-b1d9-f0ac16240d4d] No waiting events found dispatching network-vif-plugged-ad3f0bca-081f-47c5-909b-2b2b2e2fe69f {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 12:06:24 user nova-compute[73449]: WARNING nova.compute.manager [req-d569cb00-1db5-4b06-88b3-771b158dd3bd req-3c8f46f8-c95f-41fa-b4c6-0ce9888e985f service nova] [instance: d160711b-0b77-4f9a-b1d9-f0ac16240d4d] Received unexpected event network-vif-plugged-ad3f0bca-081f-47c5-909b-2b2b2e2fe69f for instance with vm_state active and task_state deleting.
Aug 17 12:06:24 user nova-compute[73449]: DEBUG nova.network.neutron [-] [instance: d160711b-0b77-4f9a-b1d9-f0ac16240d4d] Updating instance_info_cache with network_info: [] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 12:06:24 user nova-compute[73449]: INFO nova.compute.manager [-] [instance: d160711b-0b77-4f9a-b1d9-f0ac16240d4d] Took 1.51 seconds to deallocate network for instance.
Aug 17 12:06:24 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-825d1979-6cde-4f7e-b716-8af794ce1603 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:06:24 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-825d1979-6cde-4f7e-b716-8af794ce1603 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:06:24 user nova-compute[73449]: DEBUG nova.compute.manager [req-d47cbbc0-a36c-4a71-9e53-31deed5c744f req-ed67b898-3ae4-4a80-bfd5-e384078adb6d service nova] [instance: d160711b-0b77-4f9a-b1d9-f0ac16240d4d] Received event network-vif-deleted-ad3f0bca-081f-47c5-909b-2b2b2e2fe69f {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:06:25 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-825d1979-6cde-4f7e-b716-8af794ce1603 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 12:06:25 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-825d1979-6cde-4f7e-b716-8af794ce1603 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 12:06:25 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-825d1979-6cde-4f7e-b716-8af794ce1603 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.283s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:06:25 user nova-compute[73449]: INFO nova.scheduler.client.report [None req-825d1979-6cde-4f7e-b716-8af794ce1603 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Deleted allocations for instance d160711b-0b77-4f9a-b1d9-f0ac16240d4d
Aug 17 12:06:25 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-825d1979-6cde-4f7e-b716-8af794ce1603 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Lock "d160711b-0b77-4f9a-b1d9-f0ac16240d4d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.817s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:06:25 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:06:25 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73449) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 17 12:06:28 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:06:33 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:06:33 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:06:33 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73449) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 12:06:33 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:06:33 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:06:33 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:06:38 user nova-compute[73449]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692273983.3101883, d160711b-0b77-4f9a-b1d9-f0ac16240d4d => Stopped> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 12:06:38 user nova-compute[73449]: INFO nova.compute.manager [-] [instance: d160711b-0b77-4f9a-b1d9-f0ac16240d4d] VM Stopped (Lifecycle Event)
Aug 17 12:06:38 user nova-compute[73449]: DEBUG nova.compute.manager [None req-f8b0374c-ca5f-4ad0-857e-3187576e235e None None] [instance: d160711b-0b77-4f9a-b1d9-f0ac16240d4d] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 12:06:38 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:06:42 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b6887810-dbe1-4242-97fa-ca97a81cdd35 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] Acquiring lock "509263cd-9995-4e6b-8b26-461b7eb05ded" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:06:42 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b6887810-dbe1-4242-97fa-ca97a81cdd35 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] Lock "509263cd-9995-4e6b-8b26-461b7eb05ded" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:06:42 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b6887810-dbe1-4242-97fa-ca97a81cdd35 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] Acquiring lock "509263cd-9995-4e6b-8b26-461b7eb05ded-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:06:42 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b6887810-dbe1-4242-97fa-ca97a81cdd35 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] Lock "509263cd-9995-4e6b-8b26-461b7eb05ded-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:06:42 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b6887810-dbe1-4242-97fa-ca97a81cdd35 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] Lock "509263cd-9995-4e6b-8b26-461b7eb05ded-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:06:42 user nova-compute[73449]: INFO nova.compute.manager [None req-b6887810-dbe1-4242-97fa-ca97a81cdd35 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] [instance: 509263cd-9995-4e6b-8b26-461b7eb05ded] Terminating instance
Aug 17 12:06:42 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b6887810-dbe1-4242-97fa-ca97a81cdd35 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] [instance: 509263cd-9995-4e6b-8b26-461b7eb05ded] Start destroying the instance on the hypervisor. {{(pid=73449) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 12:06:42 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:06:42 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:06:42 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:06:42 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:06:43 user nova-compute[73449]: DEBUG nova.compute.manager [req-3a9d1d7c-de78-4020-8e07-d10676d388f6 req-635dc74d-2546-49f2-a5d3-dcbec4568014 service nova] [instance: 509263cd-9995-4e6b-8b26-461b7eb05ded] Received event network-vif-unplugged-567c70fb-fa55-4e78-88aa-ab91baf69fed {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:06:43 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-3a9d1d7c-de78-4020-8e07-d10676d388f6 req-635dc74d-2546-49f2-a5d3-dcbec4568014 service nova] Acquiring lock "509263cd-9995-4e6b-8b26-461b7eb05ded-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:06:43 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-3a9d1d7c-de78-4020-8e07-d10676d388f6 req-635dc74d-2546-49f2-a5d3-dcbec4568014 service nova] Lock "509263cd-9995-4e6b-8b26-461b7eb05ded-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:06:43 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-3a9d1d7c-de78-4020-8e07-d10676d388f6 req-635dc74d-2546-49f2-a5d3-dcbec4568014 service nova] Lock "509263cd-9995-4e6b-8b26-461b7eb05ded-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:06:43 user nova-compute[73449]: DEBUG nova.compute.manager [req-3a9d1d7c-de78-4020-8e07-d10676d388f6 req-635dc74d-2546-49f2-a5d3-dcbec4568014 service nova] [instance: 509263cd-9995-4e6b-8b26-461b7eb05ded] No waiting events found dispatching network-vif-unplugged-567c70fb-fa55-4e78-88aa-ab91baf69fed {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 12:06:43 user nova-compute[73449]: DEBUG nova.compute.manager [req-3a9d1d7c-de78-4020-8e07-d10676d388f6 req-635dc74d-2546-49f2-a5d3-dcbec4568014 service nova] [instance: 509263cd-9995-4e6b-8b26-461b7eb05ded] Received event network-vif-unplugged-567c70fb-fa55-4e78-88aa-ab91baf69fed for instance with task_state deleting. {{(pid=73449) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 12:06:43 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:06:43 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: 509263cd-9995-4e6b-8b26-461b7eb05ded] Instance destroyed successfully.
Aug 17 12:06:43 user nova-compute[73449]: DEBUG nova.objects.instance [None req-b6887810-dbe1-4242-97fa-ca97a81cdd35 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] Lazy-loading 'resources' on Instance uuid 509263cd-9995-4e6b-8b26-461b7eb05ded {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:06:43 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-b6887810-dbe1-4242-97fa-ca97a81cdd35 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T12:03:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-2102881955',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-2102881955',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-2102881',id=46,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAxNy6TuQ4l4xcRJjv217M4vcij42l2+NK6bGelYfQBa/t9TQGdwURrbD/kB0UJl7Kino+UpKCFjUX+npEjkdGIj/4N0kg195tXF2jT5P0BNvAM6l6ytNd3T+yCJhAk1NA==',key_name='tempest-keypair-43556598',keypairs=<?>,launch_index=0,launched_at=2023-08-17T12:03:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f5ffc03751894a96bebd953bd9fa20ed',ramdisk_id='',reservation_id='r-uaydfwkd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-2044874997',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T12:03:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c997b7493d6048b083443ca215352322',uuid=509263cd-9995-4e6b-8b26-461b7eb05ded,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "567c70fb-fa55-4e78-88aa-ab91baf69fed", "address": "fa:16:3e:00:89:5f", "network": {"id": "b7788333-c3b8-48e1-9255-5cb74bd3a3be", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-892160259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5ffc03751894a96bebd953bd9fa20ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap567c70fb-fa", "ovs_interfaceid": "567c70fb-fa55-4e78-88aa-ab91baf69fed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 12:06:43 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-b6887810-dbe1-4242-97fa-ca97a81cdd35 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] Converting VIF {"id": "567c70fb-fa55-4e78-88aa-ab91baf69fed", "address": "fa:16:3e:00:89:5f", "network": {"id": "b7788333-c3b8-48e1-9255-5cb74bd3a3be", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-892160259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5ffc03751894a96bebd953bd9fa20ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap567c70fb-fa", "ovs_interfaceid": "567c70fb-fa55-4e78-88aa-ab91baf69fed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 12:06:43 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-b6887810-dbe1-4242-97fa-ca97a81cdd35 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:00:89:5f,bridge_name='br-int',has_traffic_filtering=True,id=567c70fb-fa55-4e78-88aa-ab91baf69fed,network=Network(b7788333-c3b8-48e1-9255-5cb74bd3a3be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap567c70fb-fa') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 12:06:43 user nova-compute[73449]: DEBUG os_vif [None req-b6887810-dbe1-4242-97fa-ca97a81cdd35 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:00:89:5f,bridge_name='br-int',has_traffic_filtering=True,id=567c70fb-fa55-4e78-88aa-ab91baf69fed,network=Network(b7788333-c3b8-48e1-9255-5cb74bd3a3be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap567c70fb-fa') {{(pid=73449) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 12:06:43 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:06:43 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap567c70fb-fa, bridge=br-int, if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 12:06:43 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:06:43 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:06:43 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:06:43 user nova-compute[73449]: INFO os_vif [None req-b6887810-dbe1-4242-97fa-ca97a81cdd35 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:00:89:5f,bridge_name='br-int',has_traffic_filtering=True,id=567c70fb-fa55-4e78-88aa-ab91baf69fed,network=Network(b7788333-c3b8-48e1-9255-5cb74bd3a3be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap567c70fb-fa')
Aug 17 12:06:43 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-b6887810-dbe1-4242-97fa-ca97a81cdd35 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] [instance: 509263cd-9995-4e6b-8b26-461b7eb05ded] Deleting instance files /opt/stack/data/nova/instances/509263cd-9995-4e6b-8b26-461b7eb05ded_del
Aug 17 12:06:43 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-b6887810-dbe1-4242-97fa-ca97a81cdd35 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] [instance: 509263cd-9995-4e6b-8b26-461b7eb05ded] Deletion of /opt/stack/data/nova/instances/509263cd-9995-4e6b-8b26-461b7eb05ded_del complete
Aug 17 12:06:43 user nova-compute[73449]: INFO nova.compute.manager [None req-b6887810-dbe1-4242-97fa-ca97a81cdd35 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] [instance: 509263cd-9995-4e6b-8b26-461b7eb05ded] Took 0.85 seconds to destroy the instance on the hypervisor.
Aug 17 12:06:43 user nova-compute[73449]: DEBUG oslo.service.loopingcall [None req-b6887810-dbe1-4242-97fa-ca97a81cdd35 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73449) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 12:06:43 user nova-compute[73449]: DEBUG nova.compute.manager [-] [instance: 509263cd-9995-4e6b-8b26-461b7eb05ded] Deallocating network for instance {{(pid=73449) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 12:06:43 user nova-compute[73449]: DEBUG nova.network.neutron [-] [instance: 509263cd-9995-4e6b-8b26-461b7eb05ded] deallocate_for_instance() {{(pid=73449) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 12:06:44 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:06:44 user nova-compute[73449]: DEBUG nova.network.neutron [-] [instance: 509263cd-9995-4e6b-8b26-461b7eb05ded] Updating instance_info_cache with network_info: [] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 12:06:44 user nova-compute[73449]: INFO nova.compute.manager [-] [instance: 509263cd-9995-4e6b-8b26-461b7eb05ded] Took 0.75 seconds to deallocate network for instance.
Aug 17 12:06:44 user nova-compute[73449]: DEBUG nova.compute.manager [req-77ab7992-be6b-403f-bd55-01bbb48db5fe req-022437c0-768b-48b9-b915-caae5392b169 service nova] [instance: 509263cd-9995-4e6b-8b26-461b7eb05ded] Received event network-vif-deleted-567c70fb-fa55-4e78-88aa-ab91baf69fed {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:06:44 user nova-compute[73449]: INFO nova.compute.manager [req-77ab7992-be6b-403f-bd55-01bbb48db5fe req-022437c0-768b-48b9-b915-caae5392b169 service nova] [instance: 509263cd-9995-4e6b-8b26-461b7eb05ded] Neutron deleted interface 567c70fb-fa55-4e78-88aa-ab91baf69fed; detaching it from the instance and deleting it from the info cache
Aug 17 12:06:44 user nova-compute[73449]: DEBUG nova.network.neutron [req-77ab7992-be6b-403f-bd55-01bbb48db5fe req-022437c0-768b-48b9-b915-caae5392b169 service nova] [instance: 509263cd-9995-4e6b-8b26-461b7eb05ded] Updating instance_info_cache with network_info: [] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 12:06:44 user nova-compute[73449]: DEBUG nova.compute.manager [req-77ab7992-be6b-403f-bd55-01bbb48db5fe req-022437c0-768b-48b9-b915-caae5392b169 service nova] [instance: 509263cd-9995-4e6b-8b26-461b7eb05ded] Detach interface failed, port_id=567c70fb-fa55-4e78-88aa-ab91baf69fed, reason: Instance 509263cd-9995-4e6b-8b26-461b7eb05ded could not be found. {{(pid=73449) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 12:06:44 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b6887810-dbe1-4242-97fa-ca97a81cdd35 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:06:44 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b6887810-dbe1-4242-97fa-ca97a81cdd35 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:06:44 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-b6887810-dbe1-4242-97fa-ca97a81cdd35 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 12:06:44 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-b6887810-dbe1-4242-97fa-ca97a81cdd35 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 12:06:44 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b6887810-dbe1-4242-97fa-ca97a81cdd35 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.231s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:06:44 user nova-compute[73449]: INFO nova.scheduler.client.report [None req-b6887810-dbe1-4242-97fa-ca97a81cdd35 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] Deleted allocations for instance 509263cd-9995-4e6b-8b26-461b7eb05ded
Aug 17 12:06:44 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b6887810-dbe1-4242-97fa-ca97a81cdd35 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997 tempest-TestServerVolumeAttachScenarioOldVersion-2044874997-project-member] Lock "509263cd-9995-4e6b-8b26-461b7eb05ded" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.035s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:06:45 user nova-compute[73449]: DEBUG nova.compute.manager [req-a035a4a4-5aaf-4ea8-b197-4c5a10c68816 req-0470b420-62b4-4822-960e-ce5342d001ff service nova] [instance: 509263cd-9995-4e6b-8b26-461b7eb05ded] Received event network-vif-plugged-567c70fb-fa55-4e78-88aa-ab91baf69fed {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:06:45 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-a035a4a4-5aaf-4ea8-b197-4c5a10c68816 req-0470b420-62b4-4822-960e-ce5342d001ff service nova] Acquiring lock "509263cd-9995-4e6b-8b26-461b7eb05ded-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:06:45 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-a035a4a4-5aaf-4ea8-b197-4c5a10c68816 req-0470b420-62b4-4822-960e-ce5342d001ff service nova] Lock "509263cd-9995-4e6b-8b26-461b7eb05ded-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:06:45 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-a035a4a4-5aaf-4ea8-b197-4c5a10c68816 req-0470b420-62b4-4822-960e-ce5342d001ff service nova] Lock "509263cd-9995-4e6b-8b26-461b7eb05ded-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:06:45 user nova-compute[73449]: DEBUG nova.compute.manager [req-a035a4a4-5aaf-4ea8-b197-4c5a10c68816 req-0470b420-62b4-4822-960e-ce5342d001ff service nova] [instance: 509263cd-9995-4e6b-8b26-461b7eb05ded] No waiting events found dispatching network-vif-plugged-567c70fb-fa55-4e78-88aa-ab91baf69fed {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 12:06:45 user nova-compute[73449]: WARNING nova.compute.manager [req-a035a4a4-5aaf-4ea8-b197-4c5a10c68816 req-0470b420-62b4-4822-960e-ce5342d001ff service nova] [instance: 509263cd-9995-4e6b-8b26-461b7eb05ded] Received unexpected event network-vif-plugged-567c70fb-fa55-4e78-88aa-ab91baf69fed for instance with vm_state deleted and task_state None.
Aug 17 12:06:48 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:06:53 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:06:53 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:06:53 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73449) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 12:06:53 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:06:53 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:06:53 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:06:55 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:06:55 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Triggering sync for uuid 89440604-1daf-4e7a-a524-2f9c21a9cb96 {{(pid=73449) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 12:06:55 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Triggering sync for uuid 31f5f3d2-41d8-4a26-9eb2-18b891f94734 {{(pid=73449) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 12:06:55 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Triggering sync for uuid 712c777e-251b-43d8-b923-8eda693f32ed {{(pid=73449) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 12:06:55 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Triggering sync for uuid 5a627da9-03a1-4239-8721-cefe99c39ee2 {{(pid=73449) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 12:06:55 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Triggering sync for uuid 61201d5c-26f1-4c6d-a764-be2ee2e533ae {{(pid=73449) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 12:06:55 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Triggering sync for uuid 8fdfaf32-0957-453a-b1cf-9a3c19815c45 {{(pid=73449) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 12:06:55 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "89440604-1daf-4e7a-a524-2f9c21a9cb96" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:06:55 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "89440604-1daf-4e7a-a524-2f9c21a9cb96" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:06:55 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "31f5f3d2-41d8-4a26-9eb2-18b891f94734" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:06:55 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "31f5f3d2-41d8-4a26-9eb2-18b891f94734" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:06:55 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "712c777e-251b-43d8-b923-8eda693f32ed" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:06:55 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "712c777e-251b-43d8-b923-8eda693f32ed" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:06:55 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "5a627da9-03a1-4239-8721-cefe99c39ee2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:06:55 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "5a627da9-03a1-4239-8721-cefe99c39ee2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:06:55 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "61201d5c-26f1-4c6d-a764-be2ee2e533ae" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:06:55 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "61201d5c-26f1-4c6d-a764-be2ee2e533ae" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:06:55 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "8fdfaf32-0957-453a-b1cf-9a3c19815c45" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:06:55 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "8fdfaf32-0957-453a-b1cf-9a3c19815c45" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:06:55 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "89440604-1daf-4e7a-a524-2f9c21a9cb96" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.034s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:06:55 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "712c777e-251b-43d8-b923-8eda693f32ed" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.039s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:06:55 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "31f5f3d2-41d8-4a26-9eb2-18b891f94734" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.041s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:06:55 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "5a627da9-03a1-4239-8721-cefe99c39ee2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.041s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:06:55 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "8fdfaf32-0957-453a-b1cf-9a3c19815c45" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.045s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:06:55 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "61201d5c-26f1-4c6d-a764-be2ee2e533ae" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.046s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:06:58 user nova-compute[73449]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692274003.5377245, 509263cd-9995-4e6b-8b26-461b7eb05ded => Stopped> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 12:06:58 user nova-compute[73449]: INFO nova.compute.manager [-] [instance: 509263cd-9995-4e6b-8b26-461b7eb05ded] VM Stopped (Lifecycle Event)
Aug 17 12:06:58 user nova-compute[73449]: DEBUG nova.compute.manager [None req-2806f2a7-6b9e-4026-9203-7278fc082b70 None None] [instance: 509263cd-9995-4e6b-8b26-461b7eb05ded] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 12:06:58 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:07:02 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:07:03 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:07:03 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:07:03 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73449) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 12:07:03 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:07:03 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:07:03 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:07:05 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6fe0deaa-76cc-4997-8fc1-8f1db0eb27aa tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] [instance: 8fdfaf32-0957-453a-b1cf-9a3c19815c45] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 12:07:05 user nova-compute[73449]: INFO nova.compute.manager [None req-6fe0deaa-76cc-4997-8fc1-8f1db0eb27aa tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] [instance: 8fdfaf32-0957-453a-b1cf-9a3c19815c45] instance snapshotting
Aug 17 12:07:05 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-6fe0deaa-76cc-4997-8fc1-8f1db0eb27aa tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] [instance: 8fdfaf32-0957-453a-b1cf-9a3c19815c45] Beginning live snapshot process
Aug 17 12:07:06 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6fe0deaa-76cc-4997-8fc1-8f1db0eb27aa tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fdfaf32-0957-453a-b1cf-9a3c19815c45/disk --force-share --output=json -f qcow2 {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:07:06 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6fe0deaa-76cc-4997-8fc1-8f1db0eb27aa tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fdfaf32-0957-453a-b1cf-9a3c19815c45/disk --force-share --output=json -f qcow2" returned: 0 in 0.173s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:07:06 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6fe0deaa-76cc-4997-8fc1-8f1db0eb27aa tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fdfaf32-0957-453a-b1cf-9a3c19815c45/disk --force-share --output=json -f qcow2 {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:07:06 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6fe0deaa-76cc-4997-8fc1-8f1db0eb27aa tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fdfaf32-0957-453a-b1cf-9a3c19815c45/disk --force-share --output=json -f qcow2" returned: 0 in 0.178s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:07:06 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6fe0deaa-76cc-4997-8fc1-8f1db0eb27aa tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:07:06 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6fe0deaa-76cc-4997-8fc1-8f1db0eb27aa tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json" returned: 0 in 0.175s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:07:06 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6fe0deaa-76cc-4997-8fc1-8f1db0eb27aa tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpe8txlufj/cac3bac1d357416d86736dd4c5757885.delta 1073741824 {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:07:06 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6fe0deaa-76cc-4997-8fc1-8f1db0eb27aa tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpe8txlufj/cac3bac1d357416d86736dd4c5757885.delta 1073741824" returned: 0 in 0.048s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:07:06 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-6fe0deaa-76cc-4997-8fc1-8f1db0eb27aa tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] [instance: 8fdfaf32-0957-453a-b1cf-9a3c19815c45] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 17 12:07:06 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:07:07 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-6fe0deaa-76cc-4997-8fc1-8f1db0eb27aa tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=73449) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 12:07:07 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-6fe0deaa-76cc-4997-8fc1-8f1db0eb27aa tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=73449) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 12:07:07 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-6fe0deaa-76cc-4997-8fc1-8f1db0eb27aa tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] [instance: 8fdfaf32-0957-453a-b1cf-9a3c19815c45] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 17 12:07:07 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:07:07 user nova-compute[73449]: DEBUG nova.privsep.utils [None req-6fe0deaa-76cc-4997-8fc1-8f1db0eb27aa tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73449) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 12:07:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6fe0deaa-76cc-4997-8fc1-8f1db0eb27aa tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpe8txlufj/cac3bac1d357416d86736dd4c5757885.delta /opt/stack/data/nova/instances/snapshots/tmpe8txlufj/cac3bac1d357416d86736dd4c5757885 {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:07:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6fe0deaa-76cc-4997-8fc1-8f1db0eb27aa tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpe8txlufj/cac3bac1d357416d86736dd4c5757885.delta /opt/stack/data/nova/instances/snapshots/tmpe8txlufj/cac3bac1d357416d86736dd4c5757885" returned: 0 in 0.531s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:07:08 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-6fe0deaa-76cc-4997-8fc1-8f1db0eb27aa tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] [instance: 8fdfaf32-0957-453a-b1cf-9a3c19815c45] Snapshot extracted, beginning image upload
Aug 17 12:07:08 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:07:09 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:07:09 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73449) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 12:07:10 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-6fe0deaa-76cc-4997-8fc1-8f1db0eb27aa tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] [instance: 8fdfaf32-0957-453a-b1cf-9a3c19815c45] Snapshot image upload complete
Aug 17 12:07:10 user nova-compute[73449]: INFO nova.compute.manager [None req-6fe0deaa-76cc-4997-8fc1-8f1db0eb27aa tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] [instance: 8fdfaf32-0957-453a-b1cf-9a3c19815c45] Took 5.17 seconds to snapshot the instance on the hypervisor.
Aug 17 12:07:11 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:07:13 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-066668f0-7065-4f91-a15e-d61d0e03a08a tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Acquiring lock "54c69eab-3597-4ca7-b698-169538b73a18" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:07:13 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-066668f0-7065-4f91-a15e-d61d0e03a08a tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Lock "54c69eab-3597-4ca7-b698-169538b73a18" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:07:13 user nova-compute[73449]: DEBUG nova.compute.manager [None req-066668f0-7065-4f91-a15e-d61d0e03a08a tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] [instance: 54c69eab-3597-4ca7-b698-169538b73a18] Starting instance... {{(pid=73449) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 12:07:13 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:07:13 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-066668f0-7065-4f91-a15e-d61d0e03a08a tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:07:13 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-066668f0-7065-4f91-a15e-d61d0e03a08a tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:07:13 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-066668f0-7065-4f91-a15e-d61d0e03a08a tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73449) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 12:07:13 user nova-compute[73449]: INFO nova.compute.claims [None req-066668f0-7065-4f91-a15e-d61d0e03a08a tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] [instance: 54c69eab-3597-4ca7-b698-169538b73a18] Claim successful on node user
Aug 17 12:07:13 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-066668f0-7065-4f91-a15e-d61d0e03a08a tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Refreshing inventories for resource provider 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 17 12:07:13 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-066668f0-7065-4f91-a15e-d61d0e03a08a tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Updating ProviderTree inventory for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 17 12:07:13 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-066668f0-7065-4f91-a15e-d61d0e03a08a tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Updating inventory in ProviderTree for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 12:07:13 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-066668f0-7065-4f91-a15e-d61d0e03a08a tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Refreshing aggregate associations for resource provider 20986bee-3f54-4b89-bec1-f8387ef700c4, aggregates: None {{(pid=73449) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 17 12:07:13 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-066668f0-7065-4f91-a15e-d61d0e03a08a tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Refreshing trait associations for resource provider 20986bee-3f54-4b89-bec1-f8387ef700c4, traits: COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NODE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE42,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSSE3,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_ISO {{(pid=73449) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 17 12:07:13 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:07:14 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-066668f0-7065-4f91-a15e-d61d0e03a08a tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 12:07:14 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-066668f0-7065-4f91-a15e-d61d0e03a08a tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 12:07:14 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-066668f0-7065-4f91-a15e-d61d0e03a08a tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.431s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:07:14 user nova-compute[73449]: DEBUG nova.compute.manager [None req-066668f0-7065-4f91-a15e-d61d0e03a08a tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] [instance: 54c69eab-3597-4ca7-b698-169538b73a18] Start building networks asynchronously for instance. {{(pid=73449) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 12:07:14 user nova-compute[73449]: DEBUG nova.compute.manager [None req-066668f0-7065-4f91-a15e-d61d0e03a08a tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] [instance: 54c69eab-3597-4ca7-b698-169538b73a18] Allocating IP information in the background. {{(pid=73449) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 12:07:14 user nova-compute[73449]: DEBUG nova.network.neutron [None req-066668f0-7065-4f91-a15e-d61d0e03a08a tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] [instance: 54c69eab-3597-4ca7-b698-169538b73a18] allocate_for_instance() {{(pid=73449) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 12:07:14 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-066668f0-7065-4f91-a15e-d61d0e03a08a tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] [instance: 54c69eab-3597-4ca7-b698-169538b73a18] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 12:07:14 user nova-compute[73449]: DEBUG nova.compute.manager [None req-066668f0-7065-4f91-a15e-d61d0e03a08a tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] [instance: 54c69eab-3597-4ca7-b698-169538b73a18] Start building block device mappings for instance. {{(pid=73449) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 12:07:14 user nova-compute[73449]: DEBUG nova.policy [None req-066668f0-7065-4f91-a15e-d61d0e03a08a tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f7ae0aef93334fa599be6d1a4d728595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c9e5daa31ad47e996b59f1b7c5db0d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73449) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 12:07:14 user nova-compute[73449]: DEBUG nova.compute.manager [None req-066668f0-7065-4f91-a15e-d61d0e03a08a tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] [instance: 54c69eab-3597-4ca7-b698-169538b73a18] Start spawning the instance on the hypervisor. {{(pid=73449) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 12:07:14 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-066668f0-7065-4f91-a15e-d61d0e03a08a tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] [instance: 54c69eab-3597-4ca7-b698-169538b73a18] Creating instance directory {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 12:07:14 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-066668f0-7065-4f91-a15e-d61d0e03a08a tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] [instance: 54c69eab-3597-4ca7-b698-169538b73a18] Creating image(s)
Aug 17 12:07:14 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-066668f0-7065-4f91-a15e-d61d0e03a08a tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Acquiring lock "/opt/stack/data/nova/instances/54c69eab-3597-4ca7-b698-169538b73a18/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:07:14 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-066668f0-7065-4f91-a15e-d61d0e03a08a tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Lock "/opt/stack/data/nova/instances/54c69eab-3597-4ca7-b698-169538b73a18/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:07:14 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-066668f0-7065-4f91-a15e-d61d0e03a08a tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Lock "/opt/stack/data/nova/instances/54c69eab-3597-4ca7-b698-169538b73a18/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:07:14 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-066668f0-7065-4f91-a15e-d61d0e03a08a tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Acquiring lock "19f98b3531fde7c04f881ec33a4c365c01dbb77b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:07:14 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-066668f0-7065-4f91-a15e-d61d0e03a08a tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Lock "19f98b3531fde7c04f881ec33a4c365c01dbb77b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:07:15 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-066668f0-7065-4f91-a15e-d61d0e03a08a tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19f98b3531fde7c04f881ec33a4c365c01dbb77b.part --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:07:15 user nova-compute[73449]: DEBUG nova.network.neutron [None req-066668f0-7065-4f91-a15e-d61d0e03a08a tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] [instance: 54c69eab-3597-4ca7-b698-169538b73a18] Successfully created port: 775bc781-860e-4b6f-89f8-1b5cdeb69a8b {{(pid=73449) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 12:07:15 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-066668f0-7065-4f91-a15e-d61d0e03a08a tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19f98b3531fde7c04f881ec33a4c365c01dbb77b.part --force-share --output=json" returned: 0 in 0.282s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:07:15 user nova-compute[73449]: DEBUG nova.virt.images [None req-066668f0-7065-4f91-a15e-d61d0e03a08a tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] a3b04a4b-3e0f-468d-99e3-a58fe1fd12a0 was qcow2, converting to raw {{(pid=73449) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 17 12:07:15 user nova-compute[73449]: DEBUG nova.privsep.utils [None req-066668f0-7065-4f91-a15e-d61d0e03a08a tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73449) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 12:07:15 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-066668f0-7065-4f91-a15e-d61d0e03a08a tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/19f98b3531fde7c04f881ec33a4c365c01dbb77b.part /opt/stack/data/nova/instances/_base/19f98b3531fde7c04f881ec33a4c365c01dbb77b.converted {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:07:16 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-066668f0-7065-4f91-a15e-d61d0e03a08a tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/19f98b3531fde7c04f881ec33a4c365c01dbb77b.part /opt/stack/data/nova/instances/_base/19f98b3531fde7c04f881ec33a4c365c01dbb77b.converted" returned: 0 in 0.437s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:07:16 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-066668f0-7065-4f91-a15e-d61d0e03a08a tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19f98b3531fde7c04f881ec33a4c365c01dbb77b.converted --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:07:16 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-066668f0-7065-4f91-a15e-d61d0e03a08a tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19f98b3531fde7c04f881ec33a4c365c01dbb77b.converted --force-share --output=json" returned: 0 in 0.184s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:07:16 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-066668f0-7065-4f91-a15e-d61d0e03a08a tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Lock "19f98b3531fde7c04f881ec33a4c365c01dbb77b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.793s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:07:16 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-066668f0-7065-4f91-a15e-d61d0e03a08a tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19f98b3531fde7c04f881ec33a4c365c01dbb77b --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:07:16 user nova-compute[73449]: DEBUG nova.network.neutron [None req-066668f0-7065-4f91-a15e-d61d0e03a08a tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] [instance: 54c69eab-3597-4ca7-b698-169538b73a18] Successfully updated port: 775bc781-860e-4b6f-89f8-1b5cdeb69a8b {{(pid=73449) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 12:07:16 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-066668f0-7065-4f91-a15e-d61d0e03a08a tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Acquiring lock "refresh_cache-54c69eab-3597-4ca7-b698-169538b73a18" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 12:07:16 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-066668f0-7065-4f91-a15e-d61d0e03a08a tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Acquired lock "refresh_cache-54c69eab-3597-4ca7-b698-169538b73a18" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 12:07:16 user nova-compute[73449]: DEBUG nova.network.neutron [None req-066668f0-7065-4f91-a15e-d61d0e03a08a tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] [instance: 54c69eab-3597-4ca7-b698-169538b73a18] Building network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 12:07:16 user nova-compute[73449]: DEBUG nova.compute.manager [req-c8648b70-f35c-42f3-afb3-80e7fcf5d00d req-a83c96ee-1c4b-4f7a-93cd-6868d2bbff47 service nova] [instance: 54c69eab-3597-4ca7-b698-169538b73a18] Received event network-changed-775bc781-860e-4b6f-89f8-1b5cdeb69a8b {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:07:16 user nova-compute[73449]: DEBUG nova.compute.manager [req-c8648b70-f35c-42f3-afb3-80e7fcf5d00d req-a83c96ee-1c4b-4f7a-93cd-6868d2bbff47 service nova] [instance: 54c69eab-3597-4ca7-b698-169538b73a18] Refreshing instance network info cache due to event network-changed-775bc781-860e-4b6f-89f8-1b5cdeb69a8b. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 12:07:16 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-c8648b70-f35c-42f3-afb3-80e7fcf5d00d req-a83c96ee-1c4b-4f7a-93cd-6868d2bbff47 service nova] Acquiring lock "refresh_cache-54c69eab-3597-4ca7-b698-169538b73a18" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 12:07:16 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-066668f0-7065-4f91-a15e-d61d0e03a08a tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19f98b3531fde7c04f881ec33a4c365c01dbb77b --force-share --output=json" returned: 0 in 0.177s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:07:16 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-066668f0-7065-4f91-a15e-d61d0e03a08a tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Acquiring lock "19f98b3531fde7c04f881ec33a4c365c01dbb77b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:07:16 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-066668f0-7065-4f91-a15e-d61d0e03a08a tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Lock "19f98b3531fde7c04f881ec33a4c365c01dbb77b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:07:16 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-066668f0-7065-4f91-a15e-d61d0e03a08a tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19f98b3531fde7c04f881ec33a4c365c01dbb77b --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:07:16 user nova-compute[73449]: DEBUG nova.network.neutron [None req-066668f0-7065-4f91-a15e-d61d0e03a08a tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] [instance: 54c69eab-3597-4ca7-b698-169538b73a18] Instance cache missing network info. {{(pid=73449) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 12:07:16 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-066668f0-7065-4f91-a15e-d61d0e03a08a tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19f98b3531fde7c04f881ec33a4c365c01dbb77b --force-share --output=json" returned: 0 in 0.171s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:07:16 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-066668f0-7065-4f91-a15e-d61d0e03a08a tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/19f98b3531fde7c04f881ec33a4c365c01dbb77b,backing_fmt=raw /opt/stack/data/nova/instances/54c69eab-3597-4ca7-b698-169538b73a18/disk 1073741824 {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:07:16 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-066668f0-7065-4f91-a15e-d61d0e03a08a tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/19f98b3531fde7c04f881ec33a4c365c01dbb77b,backing_fmt=raw /opt/stack/data/nova/instances/54c69eab-3597-4ca7-b698-169538b73a18/disk 1073741824" returned: 0 in 0.064s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:07:16 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-066668f0-7065-4f91-a15e-d61d0e03a08a tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Lock "19f98b3531fde7c04f881ec33a4c365c01dbb77b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:07:16 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-066668f0-7065-4f91-a15e-d61d0e03a08a tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19f98b3531fde7c04f881ec33a4c365c01dbb77b --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:07:16 user nova-compute[73449]: DEBUG nova.network.neutron [None req-066668f0-7065-4f91-a15e-d61d0e03a08a tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] [instance: 54c69eab-3597-4ca7-b698-169538b73a18] Updating instance_info_cache with network_info: [{"id": "775bc781-860e-4b6f-89f8-1b5cdeb69a8b", "address": "fa:16:3e:44:28:8d", "network": {"id": "1e184b35-0ffc-4c89-951b-d97b1961f72f", "bridge": "br-int", "label": "tempest-TestStampPattern-2134909631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c9e5daa31ad47e996b59f1b7c5db0d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap775bc781-86", "ovs_interfaceid": "775bc781-860e-4b6f-89f8-1b5cdeb69a8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 12:07:16 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-066668f0-7065-4f91-a15e-d61d0e03a08a tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Releasing lock "refresh_cache-54c69eab-3597-4ca7-b698-169538b73a18" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 12:07:16 user nova-compute[73449]: DEBUG nova.compute.manager [None req-066668f0-7065-4f91-a15e-d61d0e03a08a tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] [instance: 54c69eab-3597-4ca7-b698-169538b73a18] Instance network_info: |[{"id": "775bc781-860e-4b6f-89f8-1b5cdeb69a8b", "address": "fa:16:3e:44:28:8d", "network": {"id": "1e184b35-0ffc-4c89-951b-d97b1961f72f", "bridge": "br-int", "label": "tempest-TestStampPattern-2134909631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c9e5daa31ad47e996b59f1b7c5db0d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap775bc781-86", "ovs_interfaceid": "775bc781-860e-4b6f-89f8-1b5cdeb69a8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73449) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 12:07:16 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-c8648b70-f35c-42f3-afb3-80e7fcf5d00d req-a83c96ee-1c4b-4f7a-93cd-6868d2bbff47 service nova] Acquired lock "refresh_cache-54c69eab-3597-4ca7-b698-169538b73a18" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 12:07:16 user nova-compute[73449]: DEBUG nova.network.neutron [req-c8648b70-f35c-42f3-afb3-80e7fcf5d00d req-a83c96ee-1c4b-4f7a-93cd-6868d2bbff47 service nova] [instance: 54c69eab-3597-4ca7-b698-169538b73a18] Refreshing network info cache for port 775bc781-860e-4b6f-89f8-1b5cdeb69a8b {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 12:07:16 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-066668f0-7065-4f91-a15e-d61d0e03a08a tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19f98b3531fde7c04f881ec33a4c365c01dbb77b --force-share --output=json" returned: 0 in 0.171s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:07:16 user nova-compute[73449]: DEBUG nova.objects.instance [None req-066668f0-7065-4f91-a15e-d61d0e03a08a tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Lazy-loading 'migration_context' on Instance uuid 54c69eab-3597-4ca7-b698-169538b73a18 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:07:16 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-066668f0-7065-4f91-a15e-d61d0e03a08a tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] [instance: 54c69eab-3597-4ca7-b698-169538b73a18] Created local disks {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 12:07:16 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-066668f0-7065-4f91-a15e-d61d0e03a08a tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] [instance: 54c69eab-3597-4ca7-b698-169538b73a18] Ensure instance console log exists: /opt/stack/data/nova/instances/54c69eab-3597-4ca7-b698-169538b73a18/console.log {{(pid=73449) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 12:07:16 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-066668f0-7065-4f91-a15e-d61d0e03a08a tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:07:16 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-066668f0-7065-4f91-a15e-d61d0e03a08a tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:07:16 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-066668f0-7065-4f91-a15e-d61d0e03a08a tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:07:16 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-066668f0-7065-4f91-a15e-d61d0e03a08a tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] [instance: 54c69eab-3597-4ca7-b698-169538b73a18] Start _get_guest_xml network_info=[{"id": "775bc781-860e-4b6f-89f8-1b5cdeb69a8b", "address": "fa:16:3e:44:28:8d", "network": {"id": "1e184b35-0ffc-4c89-951b-d97b1961f72f", "bridge": "br-int", "label": "tempest-TestStampPattern-2134909631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c9e5daa31ad47e996b59f1b7c5db0d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap775bc781-86", "ovs_interfaceid": "775bc781-860e-4b6f-89f8-1b5cdeb69a8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='61be271ed550ed48393952b38cb420b4',container_format='bare',created_at=2023-08-17T12:07:05Z,direct_url=<?>,disk_format='qcow2',id=a3b04a4b-3e0f-468d-99e3-a58fe1fd12a0,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-2129035852',owner='3c9e5daa31ad47e996b59f1b7c5db0d4',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-17T12:07:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': 'a3b04a4b-3e0f-468d-99e3-a58fe1fd12a0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 12:07:16 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-066668f0-7065-4f91-a15e-d61d0e03a08a tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 12:07:16 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-066668f0-7065-4f91-a15e-d61d0e03a08a tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 12:07:16 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-066668f0-7065-4f91-a15e-d61d0e03a08a tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 12:07:16 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-066668f0-7065-4f91-a15e-d61d0e03a08a tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] CPU controller missing on host. {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 12:07:16 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-066668f0-7065-4f91-a15e-d61d0e03a08a tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 12:07:16 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-066668f0-7065-4f91-a15e-d61d0e03a08a tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] CPU controller found on host. {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 12:07:16 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-066668f0-7065-4f91-a15e-d61d0e03a08a tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73449) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 12:07:16 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-066668f0-7065-4f91-a15e-d61d0e03a08a tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T11:35:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='61be271ed550ed48393952b38cb420b4',container_format='bare',created_at=2023-08-17T12:07:05Z,direct_url=<?>,disk_format='qcow2',id=a3b04a4b-3e0f-468d-99e3-a58fe1fd12a0,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-2129035852',owner='3c9e5daa31ad47e996b59f1b7c5db0d4',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-17T12:07:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 12:07:16 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-066668f0-7065-4f91-a15e-d61d0e03a08a tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Flavor limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 12:07:16 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-066668f0-7065-4f91-a15e-d61d0e03a08a tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Image limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 12:07:16 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-066668f0-7065-4f91-a15e-d61d0e03a08a tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Flavor pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 12:07:16 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-066668f0-7065-4f91-a15e-d61d0e03a08a tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Image pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 12:07:16 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-066668f0-7065-4f91-a15e-d61d0e03a08a tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 12:07:16 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-066668f0-7065-4f91-a15e-d61d0e03a08a tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 12:07:16 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-066668f0-7065-4f91-a15e-d61d0e03a08a tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 12:07:16 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-066668f0-7065-4f91-a15e-d61d0e03a08a tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Got 1 possible topologies {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 12:07:16 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-066668f0-7065-4f91-a15e-d61d0e03a08a tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 12:07:16 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-066668f0-7065-4f91-a15e-d61d0e03a08a tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 12:07:16 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-066668f0-7065-4f91-a15e-d61d0e03a08a tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T12:07:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-324664257',display_name='tempest-TestStampPattern-server-324664257',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-324664257',id=48,image_ref='a3b04a4b-3e0f-468d-99e3-a58fe1fd12a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIJ2Eo5DY98v4ABNkSPsmOpSAggLOMtuKT7FC5l8WhxwKHhwEcVH95zEdzfXTi8XjE0vKAypvTBXbrGRvlqVzqU569MwCVfJPBtduUClfPdtl8n174kTkHvx5qjovHToOQ==',key_name='tempest-TestStampPattern-923522805',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3c9e5daa31ad47e996b59f1b7c5db0d4',ramdisk_id='',reservation_id='r-6ovqss7i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='8fdfaf32-0957-453a-b1cf-9a3c19815c45',image_min_disk='1',image_min_ram='0',image_owner_id='3c9e5daa31ad47e996b59f1b7c5db0d4',image_owner_project_name='tempest-TestStampPattern-806391027',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-806391027-project-member',image_user_id='f7ae0aef93334fa599be6d1a4d728595',network_allocated='True',owner_project_name='tempest-TestStampPattern-806391027',owner_user_name='tempest-TestStampPattern-806391027-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T12:07:14Z,user_data=None,user_id='f7ae0aef93334fa599be6d1a4d728595',uuid=54c69eab-3597-4ca7-b698-169538b73a18,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "775bc781-860e-4b6f-89f8-1b5cdeb69a8b", "address": "fa:16:3e:44:28:8d", "network": {"id": "1e184b35-0ffc-4c89-951b-d97b1961f72f", "bridge": "br-int", "label": "tempest-TestStampPattern-2134909631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c9e5daa31ad47e996b59f1b7c5db0d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap775bc781-86", "ovs_interfaceid": "775bc781-860e-4b6f-89f8-1b5cdeb69a8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73449) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 12:07:16 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-066668f0-7065-4f91-a15e-d61d0e03a08a tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Converting VIF {"id": "775bc781-860e-4b6f-89f8-1b5cdeb69a8b", "address": "fa:16:3e:44:28:8d", "network": {"id": "1e184b35-0ffc-4c89-951b-d97b1961f72f", "bridge": "br-int", "label": "tempest-TestStampPattern-2134909631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c9e5daa31ad47e996b59f1b7c5db0d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap775bc781-86", "ovs_interfaceid": "775bc781-860e-4b6f-89f8-1b5cdeb69a8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 12:07:16 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-066668f0-7065-4f91-a15e-d61d0e03a08a tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:28:8d,bridge_name='br-int',has_traffic_filtering=True,id=775bc781-860e-4b6f-89f8-1b5cdeb69a8b,network=Network(1e184b35-0ffc-4c89-951b-d97b1961f72f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap775bc781-86') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 12:07:16 user nova-compute[73449]: DEBUG nova.objects.instance [None req-066668f0-7065-4f91-a15e-d61d0e03a08a tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Lazy-loading 'pci_devices' on Instance uuid 54c69eab-3597-4ca7-b698-169538b73a18 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:07:16 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-066668f0-7065-4f91-a15e-d61d0e03a08a tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] [instance: 54c69eab-3597-4ca7-b698-169538b73a18] End _get_guest_xml xml=<domain type="kvm">
Aug 17 12:07:16 user nova-compute[73449]:   <uuid>54c69eab-3597-4ca7-b698-169538b73a18</uuid>
Aug 17 12:07:16 user nova-compute[73449]:   <name>instance-00000030</name>
Aug 17 12:07:16 user nova-compute[73449]:   <memory>524288</memory>
Aug 17 12:07:16 user nova-compute[73449]:   <vcpu>1</vcpu>
Aug 17 12:07:16 user nova-compute[73449]:   <metadata>
Aug 17 12:07:16 user nova-compute[73449]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 12:07:16 user nova-compute[73449]:       <nova:package version="0.0.0"/>
Aug 17 12:07:16 user nova-compute[73449]:       <nova:name>tempest-TestStampPattern-server-324664257</nova:name>
Aug 17 12:07:16 user nova-compute[73449]:       <nova:creationTime>2023-08-17 12:07:16</nova:creationTime>
Aug 17 12:07:16 user nova-compute[73449]:       <nova:flavor name="m1.tiny">
Aug 17 12:07:16 user nova-compute[73449]:         <nova:memory>512</nova:memory>
Aug 17 12:07:16 user nova-compute[73449]:         <nova:disk>1</nova:disk>
Aug 17 12:07:16 user nova-compute[73449]:         <nova:swap>0</nova:swap>
Aug 17 12:07:16 user nova-compute[73449]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 12:07:16 user nova-compute[73449]:         <nova:vcpus>1</nova:vcpus>
Aug 17 12:07:16 user nova-compute[73449]:       </nova:flavor>
Aug 17 12:07:16 user nova-compute[73449]:       <nova:owner>
Aug 17 12:07:16 user nova-compute[73449]:         <nova:user uuid="f7ae0aef93334fa599be6d1a4d728595">tempest-TestStampPattern-806391027-project-member</nova:user>
Aug 17 12:07:16 user nova-compute[73449]:         <nova:project uuid="3c9e5daa31ad47e996b59f1b7c5db0d4">tempest-TestStampPattern-806391027</nova:project>
Aug 17 12:07:16 user nova-compute[73449]:       </nova:owner>
Aug 17 12:07:16 user nova-compute[73449]:       <nova:root type="image" uuid="a3b04a4b-3e0f-468d-99e3-a58fe1fd12a0"/>
Aug 17 12:07:16 user nova-compute[73449]:       <nova:ports>
Aug 17 12:07:16 user nova-compute[73449]:         <nova:port uuid="775bc781-860e-4b6f-89f8-1b5cdeb69a8b">
Aug 17 12:07:16 user nova-compute[73449]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 17 12:07:16 user nova-compute[73449]:         </nova:port>
Aug 17 12:07:16 user nova-compute[73449]:       </nova:ports>
Aug 17 12:07:16 user nova-compute[73449]:     </nova:instance>
Aug 17 12:07:16 user nova-compute[73449]:   </metadata>
Aug 17 12:07:16 user nova-compute[73449]:   <sysinfo type="smbios">
Aug 17 12:07:16 user nova-compute[73449]:     <system>
Aug 17 12:07:16 user nova-compute[73449]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 12:07:16 user nova-compute[73449]:       <entry name="product">OpenStack Nova</entry>
Aug 17 12:07:16 user nova-compute[73449]:       <entry name="version">0.0.0</entry>
Aug 17 12:07:16 user nova-compute[73449]:       <entry name="serial">54c69eab-3597-4ca7-b698-169538b73a18</entry>
Aug 17 12:07:16 user nova-compute[73449]:       <entry name="uuid">54c69eab-3597-4ca7-b698-169538b73a18</entry>
Aug 17 12:07:16 user nova-compute[73449]:       <entry name="family">Virtual Machine</entry>
Aug 17 12:07:16 user nova-compute[73449]:     </system>
Aug 17 12:07:16 user nova-compute[73449]:   </sysinfo>
Aug 17 12:07:16 user nova-compute[73449]:   <os>
Aug 17 12:07:16 user nova-compute[73449]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 12:07:16 user nova-compute[73449]:     <boot dev="hd"/>
Aug 17 12:07:16 user nova-compute[73449]:     <smbios mode="sysinfo"/>
Aug 17 12:07:16 user nova-compute[73449]:   </os>
Aug 17 12:07:16 user nova-compute[73449]:   <features>
Aug 17 12:07:16 user nova-compute[73449]:     <acpi/>
Aug 17 12:07:16 user nova-compute[73449]:     <apic/>
Aug 17 12:07:16 user nova-compute[73449]:     <vmcoreinfo/>
Aug 17 12:07:16 user nova-compute[73449]:   </features>
Aug 17 12:07:16 user nova-compute[73449]:   <clock offset="utc">
Aug 17 12:07:16 user nova-compute[73449]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 12:07:16 user nova-compute[73449]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 12:07:16 user nova-compute[73449]:     <timer name="hpet" present="no"/>
Aug 17 12:07:16 user nova-compute[73449]:   </clock>
Aug 17 12:07:16 user nova-compute[73449]:   <cpu mode="custom" match="exact">
Aug 17 12:07:16 user nova-compute[73449]:     <model>Nehalem</model>
Aug 17 12:07:16 user nova-compute[73449]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 12:07:16 user nova-compute[73449]:   </cpu>
Aug 17 12:07:16 user nova-compute[73449]:   <devices>
Aug 17 12:07:16 user nova-compute[73449]:     <disk type="file" device="disk">
Aug 17 12:07:16 user nova-compute[73449]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 12:07:16 user nova-compute[73449]:       <source file="/opt/stack/data/nova/instances/54c69eab-3597-4ca7-b698-169538b73a18/disk"/>
Aug 17 12:07:16 user nova-compute[73449]:       <target dev="vda" bus="virtio"/>
Aug 17 12:07:16 user nova-compute[73449]:     </disk>
Aug 17 12:07:16 user nova-compute[73449]:     <interface type="ethernet">
Aug 17 12:07:16 user nova-compute[73449]:       <mac address="fa:16:3e:44:28:8d"/>
Aug 17 12:07:16 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 12:07:16 user nova-compute[73449]:       <mtu size="1442"/>
Aug 17 12:07:16 user nova-compute[73449]:       <target dev="tap775bc781-86"/>
Aug 17 12:07:16 user nova-compute[73449]:     </interface>
Aug 17 12:07:16 user nova-compute[73449]:     <serial type="pty">
Aug 17 12:07:16 user nova-compute[73449]:       <log file="/opt/stack/data/nova/instances/54c69eab-3597-4ca7-b698-169538b73a18/console.log" append="off"/>
Aug 17 12:07:16 user nova-compute[73449]:     </serial>
Aug 17 12:07:16 user nova-compute[73449]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 12:07:16 user nova-compute[73449]:     <video>
Aug 17 12:07:16 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 12:07:16 user nova-compute[73449]:     </video>
Aug 17 12:07:16 user nova-compute[73449]:     <rng model="virtio">
Aug 17 12:07:16 user nova-compute[73449]:       <backend model="random">/dev/urandom</backend>
Aug 17 12:07:16 user nova-compute[73449]:     </rng>
Aug 17 12:07:16 user nova-compute[73449]:     <controller type="usb" index="0" model="none"/>
Aug 17 12:07:16 user nova-compute[73449]:     <memballoon model="virtio">
Aug 17 12:07:16 user nova-compute[73449]:       <stats period="10"/>
Aug 17 12:07:16 user nova-compute[73449]:     </memballoon>
Aug 17 12:07:16 user nova-compute[73449]:   </devices>
Aug 17 12:07:16 user nova-compute[73449]: </domain>
Aug 17 12:07:16 user nova-compute[73449]:  {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 12:07:16 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-066668f0-7065-4f91-a15e-d61d0e03a08a tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T12:07:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-324664257',display_name='tempest-TestStampPattern-server-324664257',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-324664257',id=48,image_ref='a3b04a4b-3e0f-468d-99e3-a58fe1fd12a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIJ2Eo5DY98v4ABNkSPsmOpSAggLOMtuKT7FC5l8WhxwKHhwEcVH95zEdzfXTi8XjE0vKAypvTBXbrGRvlqVzqU569MwCVfJPBtduUClfPdtl8n174kTkHvx5qjovHToOQ==',key_name='tempest-TestStampPattern-923522805',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3c9e5daa31ad47e996b59f1b7c5db0d4',ramdisk_id='',reservation_id='r-6ovqss7i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='8fdfaf32-0957-453a-b1cf-9a3c19815c45',image_min_disk='1',image_min_ram='0',image_owner_id='3c9e5daa31ad47e996b59f1b7c5db0d4',image_owner_project_name='tempest-TestStampPattern-806391027',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-806391027-project-member',image_user_id='f7ae0aef93334fa599be6d1a4d728595',network_allocated='True',owner_project_name='tempest-TestStampPattern-806391027',owner_user_name='tempest-TestStampPattern-806391027-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T12:07:14Z,user_data=None,user_id='f7ae0aef93334fa599be6d1a4d728595',uuid=54c69eab-3597-4ca7-b698-169538b73a18,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "775bc781-860e-4b6f-89f8-1b5cdeb69a8b", "address": "fa:16:3e:44:28:8d", "network": {"id": "1e184b35-0ffc-4c89-951b-d97b1961f72f", "bridge": "br-int", "label": "tempest-TestStampPattern-2134909631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c9e5daa31ad47e996b59f1b7c5db0d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap775bc781-86", "ovs_interfaceid": "775bc781-860e-4b6f-89f8-1b5cdeb69a8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 12:07:16 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-066668f0-7065-4f91-a15e-d61d0e03a08a tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Converting VIF {"id": "775bc781-860e-4b6f-89f8-1b5cdeb69a8b", "address": "fa:16:3e:44:28:8d", "network": {"id": "1e184b35-0ffc-4c89-951b-d97b1961f72f", "bridge": "br-int", "label": "tempest-TestStampPattern-2134909631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c9e5daa31ad47e996b59f1b7c5db0d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap775bc781-86", "ovs_interfaceid": "775bc781-860e-4b6f-89f8-1b5cdeb69a8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 12:07:16 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-066668f0-7065-4f91-a15e-d61d0e03a08a tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:28:8d,bridge_name='br-int',has_traffic_filtering=True,id=775bc781-860e-4b6f-89f8-1b5cdeb69a8b,network=Network(1e184b35-0ffc-4c89-951b-d97b1961f72f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap775bc781-86') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 12:07:16 user nova-compute[73449]: DEBUG os_vif [None req-066668f0-7065-4f91-a15e-d61d0e03a08a tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:28:8d,bridge_name='br-int',has_traffic_filtering=True,id=775bc781-860e-4b6f-89f8-1b5cdeb69a8b,network=Network(1e184b35-0ffc-4c89-951b-d97b1961f72f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap775bc781-86') {{(pid=73449) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 12:07:16 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:07:16 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 12:07:16 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 12:07:16 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:07:16 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:07:16 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap775bc781-86, may_exist=True, interface_attrs={}) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 12:07:16 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap775bc781-86, col_values=(('external_ids', {'iface-id': '775bc781-860e-4b6f-89f8-1b5cdeb69a8b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:44:28:8d', 'vm-uuid': '54c69eab-3597-4ca7-b698-169538b73a18'}),), if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 12:07:16 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:07:16 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:07:16 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:07:16 user nova-compute[73449]: INFO os_vif [None req-066668f0-7065-4f91-a15e-d61d0e03a08a tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:28:8d,bridge_name='br-int',has_traffic_filtering=True,id=775bc781-860e-4b6f-89f8-1b5cdeb69a8b,network=Network(1e184b35-0ffc-4c89-951b-d97b1961f72f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap775bc781-86')
Aug 17 12:07:16 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:07:16 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:07:16 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:07:16 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=73449) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 12:07:17 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-066668f0-7065-4f91-a15e-d61d0e03a08a tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] No BDM found with device name vda, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 12:07:17 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-066668f0-7065-4f91-a15e-d61d0e03a08a tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] No VIF found with MAC fa:16:3e:44:28:8d, not building metadata {{(pid=73449) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 12:07:17 user nova-compute[73449]: DEBUG nova.network.neutron [req-c8648b70-f35c-42f3-afb3-80e7fcf5d00d req-a83c96ee-1c4b-4f7a-93cd-6868d2bbff47 service nova] [instance: 54c69eab-3597-4ca7-b698-169538b73a18] Updated VIF entry in instance network info cache for port 775bc781-860e-4b6f-89f8-1b5cdeb69a8b. {{(pid=73449) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 12:07:17 user nova-compute[73449]: DEBUG nova.network.neutron [req-c8648b70-f35c-42f3-afb3-80e7fcf5d00d req-a83c96ee-1c4b-4f7a-93cd-6868d2bbff47 service nova] [instance: 54c69eab-3597-4ca7-b698-169538b73a18] Updating instance_info_cache with network_info: [{"id": "775bc781-860e-4b6f-89f8-1b5cdeb69a8b", "address": "fa:16:3e:44:28:8d", "network": {"id": "1e184b35-0ffc-4c89-951b-d97b1961f72f", "bridge": "br-int", "label": "tempest-TestStampPattern-2134909631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c9e5daa31ad47e996b59f1b7c5db0d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap775bc781-86", "ovs_interfaceid": "775bc781-860e-4b6f-89f8-1b5cdeb69a8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 12:07:17 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-c8648b70-f35c-42f3-afb3-80e7fcf5d00d req-a83c96ee-1c4b-4f7a-93cd-6868d2bbff47 service nova] Releasing lock "refresh_cache-54c69eab-3597-4ca7-b698-169538b73a18" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 12:07:17 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-d0b97434-2d65-43a4-8949-6c1e081cbe92 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Acquiring lock "f607caf8-0910-4214-b2f7-ccd59cd0307a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:07:17 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-d0b97434-2d65-43a4-8949-6c1e081cbe92 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Lock "f607caf8-0910-4214-b2f7-ccd59cd0307a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:07:17 user nova-compute[73449]: DEBUG nova.compute.manager [None req-d0b97434-2d65-43a4-8949-6c1e081cbe92 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: f607caf8-0910-4214-b2f7-ccd59cd0307a] Starting instance... {{(pid=73449) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 12:07:17 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-d0b97434-2d65-43a4-8949-6c1e081cbe92 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:07:17 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-d0b97434-2d65-43a4-8949-6c1e081cbe92 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:07:17 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-d0b97434-2d65-43a4-8949-6c1e081cbe92 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73449) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 12:07:17 user nova-compute[73449]: INFO nova.compute.claims [None req-d0b97434-2d65-43a4-8949-6c1e081cbe92 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: f607caf8-0910-4214-b2f7-ccd59cd0307a] Claim successful on node user
Aug 17 12:07:17 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-d0b97434-2d65-43a4-8949-6c1e081cbe92 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 12:07:18 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-d0b97434-2d65-43a4-8949-6c1e081cbe92 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 12:07:18 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-d0b97434-2d65-43a4-8949-6c1e081cbe92 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.521s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:07:18 user nova-compute[73449]: DEBUG nova.compute.manager [None req-d0b97434-2d65-43a4-8949-6c1e081cbe92 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: f607caf8-0910-4214-b2f7-ccd59cd0307a] Start building networks asynchronously for instance. {{(pid=73449) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 12:07:18 user nova-compute[73449]: DEBUG nova.compute.manager [None req-d0b97434-2d65-43a4-8949-6c1e081cbe92 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: f607caf8-0910-4214-b2f7-ccd59cd0307a] Allocating IP information in the background. {{(pid=73449) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 12:07:18 user nova-compute[73449]: DEBUG nova.network.neutron [None req-d0b97434-2d65-43a4-8949-6c1e081cbe92 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: f607caf8-0910-4214-b2f7-ccd59cd0307a] allocate_for_instance() {{(pid=73449) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 12:07:18 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-d0b97434-2d65-43a4-8949-6c1e081cbe92 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: f607caf8-0910-4214-b2f7-ccd59cd0307a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 12:07:18 user nova-compute[73449]: DEBUG nova.compute.manager [None req-d0b97434-2d65-43a4-8949-6c1e081cbe92 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: f607caf8-0910-4214-b2f7-ccd59cd0307a] Start building block device mappings for instance. {{(pid=73449) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 12:07:18 user nova-compute[73449]: DEBUG nova.policy [None req-d0b97434-2d65-43a4-8949-6c1e081cbe92 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '55cde68973ca42d095180b5c0701b49b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75aa99e369c54b65aff27adbb1daf2b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73449) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 12:07:18 user nova-compute[73449]: DEBUG nova.compute.manager [None req-d0b97434-2d65-43a4-8949-6c1e081cbe92 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: f607caf8-0910-4214-b2f7-ccd59cd0307a] Start spawning the instance on the hypervisor. {{(pid=73449) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 12:07:18 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-d0b97434-2d65-43a4-8949-6c1e081cbe92 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: f607caf8-0910-4214-b2f7-ccd59cd0307a] Creating instance directory {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 12:07:18 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-d0b97434-2d65-43a4-8949-6c1e081cbe92 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: f607caf8-0910-4214-b2f7-ccd59cd0307a] Creating image(s)
Aug 17 12:07:18 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-d0b97434-2d65-43a4-8949-6c1e081cbe92 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Acquiring lock "/opt/stack/data/nova/instances/f607caf8-0910-4214-b2f7-ccd59cd0307a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:07:18 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-d0b97434-2d65-43a4-8949-6c1e081cbe92 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Lock "/opt/stack/data/nova/instances/f607caf8-0910-4214-b2f7-ccd59cd0307a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:07:18 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-d0b97434-2d65-43a4-8949-6c1e081cbe92 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Lock "/opt/stack/data/nova/instances/f607caf8-0910-4214-b2f7-ccd59cd0307a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:07:18 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-d0b97434-2d65-43a4-8949-6c1e081cbe92 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:07:18 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-d0b97434-2d65-43a4-8949-6c1e081cbe92 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json" returned: 0 in 0.210s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:07:18 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-d0b97434-2d65-43a4-8949-6c1e081cbe92 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Acquiring lock "7e267a577c062ee862e95ede6b48cfd5632f3ea3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:07:18 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-d0b97434-2d65-43a4-8949-6c1e081cbe92 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Lock "7e267a577c062ee862e95ede6b48cfd5632f3ea3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:07:18 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-d0b97434-2d65-43a4-8949-6c1e081cbe92 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:07:18 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:07:18 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:07:18 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:07:18 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-d0b97434-2d65-43a4-8949-6c1e081cbe92 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json" returned: 0 in 0.198s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:07:18 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-d0b97434-2d65-43a4-8949-6c1e081cbe92 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3,backing_fmt=raw /opt/stack/data/nova/instances/f607caf8-0910-4214-b2f7-ccd59cd0307a/disk 1073741824 {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:07:18 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-d0b97434-2d65-43a4-8949-6c1e081cbe92 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3,backing_fmt=raw /opt/stack/data/nova/instances/f607caf8-0910-4214-b2f7-ccd59cd0307a/disk 1073741824" returned: 0 in 0.061s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:07:18 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-d0b97434-2d65-43a4-8949-6c1e081cbe92 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Lock "7e267a577c062ee862e95ede6b48cfd5632f3ea3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.266s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:07:18 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-d0b97434-2d65-43a4-8949-6c1e081cbe92 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:07:18 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:07:19 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:07:19 user nova-compute[73449]: DEBUG nova.compute.manager [req-ac624e22-4563-43cd-a148-845f18f486de req-67c5917e-6461-4a2a-b9db-4fdeb7961005 service nova] [instance: 54c69eab-3597-4ca7-b698-169538b73a18] Received event network-vif-plugged-775bc781-860e-4b6f-89f8-1b5cdeb69a8b {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:07:19 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-ac624e22-4563-43cd-a148-845f18f486de req-67c5917e-6461-4a2a-b9db-4fdeb7961005 service nova] Acquiring lock "54c69eab-3597-4ca7-b698-169538b73a18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:07:19 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-ac624e22-4563-43cd-a148-845f18f486de req-67c5917e-6461-4a2a-b9db-4fdeb7961005 service nova] Lock "54c69eab-3597-4ca7-b698-169538b73a18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:07:19 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-ac624e22-4563-43cd-a148-845f18f486de req-67c5917e-6461-4a2a-b9db-4fdeb7961005 service nova] Lock "54c69eab-3597-4ca7-b698-169538b73a18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:07:19 user nova-compute[73449]: DEBUG nova.compute.manager [req-ac624e22-4563-43cd-a148-845f18f486de req-67c5917e-6461-4a2a-b9db-4fdeb7961005 service nova] [instance: 54c69eab-3597-4ca7-b698-169538b73a18] No waiting events found dispatching network-vif-plugged-775bc781-860e-4b6f-89f8-1b5cdeb69a8b {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 12:07:19 user nova-compute[73449]: WARNING nova.compute.manager [req-ac624e22-4563-43cd-a148-845f18f486de req-67c5917e-6461-4a2a-b9db-4fdeb7961005 service nova] [instance: 54c69eab-3597-4ca7-b698-169538b73a18] Received unexpected event network-vif-plugged-775bc781-860e-4b6f-89f8-1b5cdeb69a8b for instance with vm_state building and task_state spawning.
Aug 17 12:07:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-d0b97434-2d65-43a4-8949-6c1e081cbe92 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json" returned: 0 in 0.232s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:07:19 user nova-compute[73449]: DEBUG nova.virt.disk.api [None req-d0b97434-2d65-43a4-8949-6c1e081cbe92 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f607caf8-0910-4214-b2f7-ccd59cd0307a/disk. size=1073741824 {{(pid=73449) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 12:07:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-d0b97434-2d65-43a4-8949-6c1e081cbe92 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f607caf8-0910-4214-b2f7-ccd59cd0307a/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:07:19 user nova-compute[73449]: DEBUG nova.network.neutron [None req-d0b97434-2d65-43a4-8949-6c1e081cbe92 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: f607caf8-0910-4214-b2f7-ccd59cd0307a] Successfully created port: 3fbe83ab-0b4f-4f6d-9a90-bd564e1e0760 {{(pid=73449) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 12:07:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/712c777e-251b-43d8-b923-8eda693f32ed/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:07:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-d0b97434-2d65-43a4-8949-6c1e081cbe92 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f607caf8-0910-4214-b2f7-ccd59cd0307a/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:07:19 user nova-compute[73449]: DEBUG nova.virt.disk.api [None req-d0b97434-2d65-43a4-8949-6c1e081cbe92 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Cannot resize image /opt/stack/data/nova/instances/f607caf8-0910-4214-b2f7-ccd59cd0307a/disk to a smaller size. {{(pid=73449) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 12:07:19 user nova-compute[73449]: DEBUG nova.objects.instance [None req-d0b97434-2d65-43a4-8949-6c1e081cbe92 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Lazy-loading 'migration_context' on Instance uuid f607caf8-0910-4214-b2f7-ccd59cd0307a {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:07:19 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-d0b97434-2d65-43a4-8949-6c1e081cbe92 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: f607caf8-0910-4214-b2f7-ccd59cd0307a] Created local disks {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 12:07:19 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-d0b97434-2d65-43a4-8949-6c1e081cbe92 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: f607caf8-0910-4214-b2f7-ccd59cd0307a] Ensure instance console log exists: /opt/stack/data/nova/instances/f607caf8-0910-4214-b2f7-ccd59cd0307a/console.log {{(pid=73449) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 12:07:19 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-d0b97434-2d65-43a4-8949-6c1e081cbe92 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:07:19 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-d0b97434-2d65-43a4-8949-6c1e081cbe92 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:07:19 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-d0b97434-2d65-43a4-8949-6c1e081cbe92 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:07:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/712c777e-251b-43d8-b923-8eda693f32ed/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:07:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/712c777e-251b-43d8-b923-8eda693f32ed/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:07:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/712c777e-251b-43d8-b923-8eda693f32ed/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:07:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54c69eab-3597-4ca7-b698-169538b73a18/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:07:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54c69eab-3597-4ca7-b698-169538b73a18/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:07:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54c69eab-3597-4ca7-b698-169538b73a18/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:07:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54c69eab-3597-4ca7-b698-169538b73a18/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:07:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fdfaf32-0957-453a-b1cf-9a3c19815c45/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:07:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fdfaf32-0957-453a-b1cf-9a3c19815c45/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:07:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fdfaf32-0957-453a-b1cf-9a3c19815c45/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:07:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fdfaf32-0957-453a-b1cf-9a3c19815c45/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:07:20 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73449) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 12:07:20 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73449) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 12:07:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89440604-1daf-4e7a-a524-2f9c21a9cb96/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:07:20 user nova-compute[73449]: DEBUG nova.network.neutron [None req-d0b97434-2d65-43a4-8949-6c1e081cbe92 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: f607caf8-0910-4214-b2f7-ccd59cd0307a] Successfully updated port: 3fbe83ab-0b4f-4f6d-9a90-bd564e1e0760 {{(pid=73449) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 12:07:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-d0b97434-2d65-43a4-8949-6c1e081cbe92 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Acquiring lock "refresh_cache-f607caf8-0910-4214-b2f7-ccd59cd0307a" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 12:07:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-d0b97434-2d65-43a4-8949-6c1e081cbe92 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Acquired lock "refresh_cache-f607caf8-0910-4214-b2f7-ccd59cd0307a" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 12:07:20 user nova-compute[73449]: DEBUG nova.network.neutron [None req-d0b97434-2d65-43a4-8949-6c1e081cbe92 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: f607caf8-0910-4214-b2f7-ccd59cd0307a] Building network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 12:07:20 user nova-compute[73449]: DEBUG nova.compute.manager [req-38ce5654-4bdc-4835-9cd7-c0535eb4db3b req-c0cdc569-8583-4546-aaa8-e555f553fc35 service nova] [instance: f607caf8-0910-4214-b2f7-ccd59cd0307a] Received event network-changed-3fbe83ab-0b4f-4f6d-9a90-bd564e1e0760 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:07:20 user nova-compute[73449]: DEBUG nova.compute.manager [req-38ce5654-4bdc-4835-9cd7-c0535eb4db3b req-c0cdc569-8583-4546-aaa8-e555f553fc35 service nova] [instance: f607caf8-0910-4214-b2f7-ccd59cd0307a] Refreshing instance network info cache due to event network-changed-3fbe83ab-0b4f-4f6d-9a90-bd564e1e0760. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 12:07:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-38ce5654-4bdc-4835-9cd7-c0535eb4db3b req-c0cdc569-8583-4546-aaa8-e555f553fc35 service nova] Acquiring lock "refresh_cache-f607caf8-0910-4214-b2f7-ccd59cd0307a" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 12:07:20 user nova-compute[73449]: DEBUG nova.network.neutron [None req-d0b97434-2d65-43a4-8949-6c1e081cbe92 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: f607caf8-0910-4214-b2f7-ccd59cd0307a] Instance cache missing network info. {{(pid=73449) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 12:07:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89440604-1daf-4e7a-a524-2f9c21a9cb96/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:07:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89440604-1daf-4e7a-a524-2f9c21a9cb96/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:07:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89440604-1daf-4e7a-a524-2f9c21a9cb96/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:07:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61201d5c-26f1-4c6d-a764-be2ee2e533ae/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:07:20 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692274040.8785748, 54c69eab-3597-4ca7-b698-169538b73a18 => Resumed> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 12:07:20 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 54c69eab-3597-4ca7-b698-169538b73a18] VM Resumed (Lifecycle Event)
Aug 17 12:07:20 user nova-compute[73449]: DEBUG nova.compute.manager [None req-066668f0-7065-4f91-a15e-d61d0e03a08a tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] [instance: 54c69eab-3597-4ca7-b698-169538b73a18] Instance event wait completed in 0 seconds for  {{(pid=73449) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 12:07:20 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-066668f0-7065-4f91-a15e-d61d0e03a08a tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] [instance: 54c69eab-3597-4ca7-b698-169538b73a18] Guest created on hypervisor {{(pid=73449) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 12:07:20 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: 54c69eab-3597-4ca7-b698-169538b73a18] Instance spawned successfully.
Aug 17 12:07:20 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-066668f0-7065-4f91-a15e-d61d0e03a08a tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] [instance: 54c69eab-3597-4ca7-b698-169538b73a18] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 12:07:20 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-066668f0-7065-4f91-a15e-d61d0e03a08a tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] [instance: 54c69eab-3597-4ca7-b698-169538b73a18] Found default for hw_input_bus of None {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 12:07:20 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-066668f0-7065-4f91-a15e-d61d0e03a08a tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] [instance: 54c69eab-3597-4ca7-b698-169538b73a18] Found default for hw_pointer_model of None {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 12:07:20 user nova-compute[73449]: DEBUG nova.network.neutron [None req-d0b97434-2d65-43a4-8949-6c1e081cbe92 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: f607caf8-0910-4214-b2f7-ccd59cd0307a] Updating instance_info_cache with network_info: [{"id": "3fbe83ab-0b4f-4f6d-9a90-bd564e1e0760", "address": "fa:16:3e:b4:1b:4f", "network": {"id": "71648e1b-cf19-44b7-bae2-9d38543cdee9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-822323626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75aa99e369c54b65aff27adbb1daf2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fbe83ab-0b", "ovs_interfaceid": "3fbe83ab-0b4f-4f6d-9a90-bd564e1e0760", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 12:07:20 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 54c69eab-3597-4ca7-b698-169538b73a18] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 12:07:20 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 54c69eab-3597-4ca7-b698-169538b73a18] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 12:07:20 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 54c69eab-3597-4ca7-b698-169538b73a18] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 12:07:20 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692274040.887195, 54c69eab-3597-4ca7-b698-169538b73a18 => Started> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 12:07:20 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 54c69eab-3597-4ca7-b698-169538b73a18] VM Started (Lifecycle Event)
Aug 17 12:07:20 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 54c69eab-3597-4ca7-b698-169538b73a18] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 12:07:20 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 54c69eab-3597-4ca7-b698-169538b73a18] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 12:07:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61201d5c-26f1-4c6d-a764-be2ee2e533ae/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:07:21 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61201d5c-26f1-4c6d-a764-be2ee2e533ae/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:07:21 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 54c69eab-3597-4ca7-b698-169538b73a18] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 12:07:21 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-d0b97434-2d65-43a4-8949-6c1e081cbe92 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Releasing lock "refresh_cache-f607caf8-0910-4214-b2f7-ccd59cd0307a" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 12:07:21 user nova-compute[73449]: DEBUG nova.compute.manager [None req-d0b97434-2d65-43a4-8949-6c1e081cbe92 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: f607caf8-0910-4214-b2f7-ccd59cd0307a] Instance network_info: |[{"id": "3fbe83ab-0b4f-4f6d-9a90-bd564e1e0760", "address": "fa:16:3e:b4:1b:4f", "network": {"id": "71648e1b-cf19-44b7-bae2-9d38543cdee9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-822323626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75aa99e369c54b65aff27adbb1daf2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fbe83ab-0b", "ovs_interfaceid": "3fbe83ab-0b4f-4f6d-9a90-bd564e1e0760", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73449) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 12:07:21 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-38ce5654-4bdc-4835-9cd7-c0535eb4db3b req-c0cdc569-8583-4546-aaa8-e555f553fc35 service nova] Acquired lock "refresh_cache-f607caf8-0910-4214-b2f7-ccd59cd0307a" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 12:07:21 user nova-compute[73449]: DEBUG nova.network.neutron [req-38ce5654-4bdc-4835-9cd7-c0535eb4db3b req-c0cdc569-8583-4546-aaa8-e555f553fc35 service nova] [instance: f607caf8-0910-4214-b2f7-ccd59cd0307a] Refreshing network info cache for port 3fbe83ab-0b4f-4f6d-9a90-bd564e1e0760 {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 12:07:21 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-d0b97434-2d65-43a4-8949-6c1e081cbe92 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: f607caf8-0910-4214-b2f7-ccd59cd0307a] Start _get_guest_xml network_info=[{"id": "3fbe83ab-0b4f-4f6d-9a90-bd564e1e0760", "address": "fa:16:3e:b4:1b:4f", "network": {"id": "71648e1b-cf19-44b7-bae2-9d38543cdee9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-822323626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75aa99e369c54b65aff27adbb1daf2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fbe83ab-0b", "ovs_interfaceid": "3fbe83ab-0b4f-4f6d-9a90-bd564e1e0760", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T11:36:11Z,direct_url=<?>,disk_format='qcow2',id=0a2904ae-083d-41c8-83db-343132b36148,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7a77880136a54ef195c82e018e1939db',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T11:36:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': '0a2904ae-083d-41c8-83db-343132b36148'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 12:07:21 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-d0b97434-2d65-43a4-8949-6c1e081cbe92 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 12:07:21 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-d0b97434-2d65-43a4-8949-6c1e081cbe92 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 12:07:21 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-d0b97434-2d65-43a4-8949-6c1e081cbe92 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 12:07:21 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-d0b97434-2d65-43a4-8949-6c1e081cbe92 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] CPU controller missing on host. {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 12:07:21 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-d0b97434-2d65-43a4-8949-6c1e081cbe92 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 12:07:21 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-d0b97434-2d65-43a4-8949-6c1e081cbe92 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] CPU controller found on host. {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 12:07:21 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-d0b97434-2d65-43a4-8949-6c1e081cbe92 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73449) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 12:07:21 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-d0b97434-2d65-43a4-8949-6c1e081cbe92 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T11:35:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T11:36:11Z,direct_url=<?>,disk_format='qcow2',id=0a2904ae-083d-41c8-83db-343132b36148,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7a77880136a54ef195c82e018e1939db',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T11:36:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 12:07:21 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-d0b97434-2d65-43a4-8949-6c1e081cbe92 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Flavor limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 12:07:21 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-d0b97434-2d65-43a4-8949-6c1e081cbe92 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Image limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 12:07:21 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-d0b97434-2d65-43a4-8949-6c1e081cbe92 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Flavor pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 12:07:21 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-d0b97434-2d65-43a4-8949-6c1e081cbe92 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Image pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 12:07:21 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-d0b97434-2d65-43a4-8949-6c1e081cbe92 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 12:07:21 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-d0b97434-2d65-43a4-8949-6c1e081cbe92 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 12:07:21 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-d0b97434-2d65-43a4-8949-6c1e081cbe92 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 12:07:21 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-d0b97434-2d65-43a4-8949-6c1e081cbe92 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Got 1 possible topologies {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 12:07:21 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-d0b97434-2d65-43a4-8949-6c1e081cbe92 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 12:07:21 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-d0b97434-2d65-43a4-8949-6c1e081cbe92 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 12:07:21 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-d0b97434-2d65-43a4-8949-6c1e081cbe92 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T12:07:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-290223819',display_name='tempest-AttachVolumeNegativeTest-server-290223819',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-290223819',id=49,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIcdd5aeecIYlkFx2V2bOlocTYxswMy7dyyjzsWB0kPZfZnWdMUqwEO+45ozoejtI2uZXoUirQYe3MBmB0K/Ke1GZ9Stc3w/8DeCRIJRTSZUMGlReyFZm9UfJDMGJ2bh+A==',key_name='tempest-keypair-1929215192',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75aa99e369c54b65aff27adbb1daf2b8',ramdisk_id='',reservation_id='r-gm793uzz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-165752051',owner_user_name='tempest-AttachVolumeNegativeTest-165752051-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T12:07:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55cde68973ca42d095180b5c0701b49b',uuid=f607caf8-0910-4214-b2f7-ccd59cd0307a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3fbe83ab-0b4f-4f6d-9a90-bd564e1e0760", "address": "fa:16:3e:b4:1b:4f", "network": {"id": "71648e1b-cf19-44b7-bae2-9d38543cdee9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-822323626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75aa99e369c54b65aff27adbb1daf2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fbe83ab-0b", "ovs_interfaceid": "3fbe83ab-0b4f-4f6d-9a90-bd564e1e0760", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73449) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 12:07:21 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-d0b97434-2d65-43a4-8949-6c1e081cbe92 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Converting VIF {"id": "3fbe83ab-0b4f-4f6d-9a90-bd564e1e0760", "address": "fa:16:3e:b4:1b:4f", "network": {"id": "71648e1b-cf19-44b7-bae2-9d38543cdee9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-822323626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75aa99e369c54b65aff27adbb1daf2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fbe83ab-0b", "ovs_interfaceid": "3fbe83ab-0b4f-4f6d-9a90-bd564e1e0760", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 12:07:21 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-d0b97434-2d65-43a4-8949-6c1e081cbe92 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:1b:4f,bridge_name='br-int',has_traffic_filtering=True,id=3fbe83ab-0b4f-4f6d-9a90-bd564e1e0760,network=Network(71648e1b-cf19-44b7-bae2-9d38543cdee9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fbe83ab-0b') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 12:07:21 user nova-compute[73449]: DEBUG nova.objects.instance [None req-d0b97434-2d65-43a4-8949-6c1e081cbe92 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Lazy-loading 'pci_devices' on Instance uuid f607caf8-0910-4214-b2f7-ccd59cd0307a {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:07:21 user nova-compute[73449]: DEBUG nova.compute.manager [req-059fb836-327e-4f15-9d77-7858ba487c7c req-5c4d2b7b-e700-4596-807c-65b578a36b21 service nova] [instance: 54c69eab-3597-4ca7-b698-169538b73a18] Received event network-vif-plugged-775bc781-860e-4b6f-89f8-1b5cdeb69a8b {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:07:21 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-059fb836-327e-4f15-9d77-7858ba487c7c req-5c4d2b7b-e700-4596-807c-65b578a36b21 service nova] Acquiring lock "54c69eab-3597-4ca7-b698-169538b73a18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:07:21 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-059fb836-327e-4f15-9d77-7858ba487c7c req-5c4d2b7b-e700-4596-807c-65b578a36b21 service nova] Lock "54c69eab-3597-4ca7-b698-169538b73a18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:07:21 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-059fb836-327e-4f15-9d77-7858ba487c7c req-5c4d2b7b-e700-4596-807c-65b578a36b21 service nova] Lock "54c69eab-3597-4ca7-b698-169538b73a18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:07:21 user nova-compute[73449]: DEBUG nova.compute.manager [req-059fb836-327e-4f15-9d77-7858ba487c7c req-5c4d2b7b-e700-4596-807c-65b578a36b21 service nova] [instance: 54c69eab-3597-4ca7-b698-169538b73a18] No waiting events found dispatching network-vif-plugged-775bc781-860e-4b6f-89f8-1b5cdeb69a8b {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 12:07:21 user nova-compute[73449]: WARNING nova.compute.manager [req-059fb836-327e-4f15-9d77-7858ba487c7c req-5c4d2b7b-e700-4596-807c-65b578a36b21 service nova] [instance: 54c69eab-3597-4ca7-b698-169538b73a18] Received unexpected event network-vif-plugged-775bc781-860e-4b6f-89f8-1b5cdeb69a8b for instance with vm_state building and task_state spawning.
Aug 17 12:07:21 user nova-compute[73449]: INFO nova.compute.manager [None req-066668f0-7065-4f91-a15e-d61d0e03a08a tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] [instance: 54c69eab-3597-4ca7-b698-169538b73a18] Took 6.78 seconds to spawn the instance on the hypervisor.
Aug 17 12:07:21 user nova-compute[73449]: DEBUG nova.compute.manager [None req-066668f0-7065-4f91-a15e-d61d0e03a08a tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] [instance: 54c69eab-3597-4ca7-b698-169538b73a18] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 12:07:21 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-d0b97434-2d65-43a4-8949-6c1e081cbe92 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: f607caf8-0910-4214-b2f7-ccd59cd0307a] End _get_guest_xml xml=<domain type="kvm">
Aug 17 12:07:21 user nova-compute[73449]:   <uuid>f607caf8-0910-4214-b2f7-ccd59cd0307a</uuid>
Aug 17 12:07:21 user nova-compute[73449]:   <name>instance-00000031</name>
Aug 17 12:07:21 user nova-compute[73449]:   <memory>524288</memory>
Aug 17 12:07:21 user nova-compute[73449]:   <vcpu>1</vcpu>
Aug 17 12:07:21 user nova-compute[73449]:   <metadata>
Aug 17 12:07:21 user nova-compute[73449]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 12:07:21 user nova-compute[73449]:       <nova:package version="0.0.0"/>
Aug 17 12:07:21 user nova-compute[73449]:       <nova:name>tempest-AttachVolumeNegativeTest-server-290223819</nova:name>
Aug 17 12:07:21 user nova-compute[73449]:       <nova:creationTime>2023-08-17 12:07:21</nova:creationTime>
Aug 17 12:07:21 user nova-compute[73449]:       <nova:flavor name="m1.tiny">
Aug 17 12:07:21 user nova-compute[73449]:         <nova:memory>512</nova:memory>
Aug 17 12:07:21 user nova-compute[73449]:         <nova:disk>1</nova:disk>
Aug 17 12:07:21 user nova-compute[73449]:         <nova:swap>0</nova:swap>
Aug 17 12:07:21 user nova-compute[73449]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 12:07:21 user nova-compute[73449]:         <nova:vcpus>1</nova:vcpus>
Aug 17 12:07:21 user nova-compute[73449]:       </nova:flavor>
Aug 17 12:07:21 user nova-compute[73449]:       <nova:owner>
Aug 17 12:07:21 user nova-compute[73449]:         <nova:user uuid="55cde68973ca42d095180b5c0701b49b">tempest-AttachVolumeNegativeTest-165752051-project-member</nova:user>
Aug 17 12:07:21 user nova-compute[73449]:         <nova:project uuid="75aa99e369c54b65aff27adbb1daf2b8">tempest-AttachVolumeNegativeTest-165752051</nova:project>
Aug 17 12:07:21 user nova-compute[73449]:       </nova:owner>
Aug 17 12:07:21 user nova-compute[73449]:       <nova:root type="image" uuid="0a2904ae-083d-41c8-83db-343132b36148"/>
Aug 17 12:07:21 user nova-compute[73449]:       <nova:ports>
Aug 17 12:07:21 user nova-compute[73449]:         <nova:port uuid="3fbe83ab-0b4f-4f6d-9a90-bd564e1e0760">
Aug 17 12:07:21 user nova-compute[73449]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 17 12:07:21 user nova-compute[73449]:         </nova:port>
Aug 17 12:07:21 user nova-compute[73449]:       </nova:ports>
Aug 17 12:07:21 user nova-compute[73449]:     </nova:instance>
Aug 17 12:07:21 user nova-compute[73449]:   </metadata>
Aug 17 12:07:21 user nova-compute[73449]:   <sysinfo type="smbios">
Aug 17 12:07:21 user nova-compute[73449]:     <system>
Aug 17 12:07:21 user nova-compute[73449]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 12:07:21 user nova-compute[73449]:       <entry name="product">OpenStack Nova</entry>
Aug 17 12:07:21 user nova-compute[73449]:       <entry name="version">0.0.0</entry>
Aug 17 12:07:21 user nova-compute[73449]:       <entry name="serial">f607caf8-0910-4214-b2f7-ccd59cd0307a</entry>
Aug 17 12:07:21 user nova-compute[73449]:       <entry name="uuid">f607caf8-0910-4214-b2f7-ccd59cd0307a</entry>
Aug 17 12:07:21 user nova-compute[73449]:       <entry name="family">Virtual Machine</entry>
Aug 17 12:07:21 user nova-compute[73449]:     </system>
Aug 17 12:07:21 user nova-compute[73449]:   </sysinfo>
Aug 17 12:07:21 user nova-compute[73449]:   <os>
Aug 17 12:07:21 user nova-compute[73449]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 12:07:21 user nova-compute[73449]:     <boot dev="hd"/>
Aug 17 12:07:21 user nova-compute[73449]:     <smbios mode="sysinfo"/>
Aug 17 12:07:21 user nova-compute[73449]:   </os>
Aug 17 12:07:21 user nova-compute[73449]:   <features>
Aug 17 12:07:21 user nova-compute[73449]:     <acpi/>
Aug 17 12:07:21 user nova-compute[73449]:     <apic/>
Aug 17 12:07:21 user nova-compute[73449]:     <vmcoreinfo/>
Aug 17 12:07:21 user nova-compute[73449]:   </features>
Aug 17 12:07:21 user nova-compute[73449]:   <clock offset="utc">
Aug 17 12:07:21 user nova-compute[73449]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 12:07:21 user nova-compute[73449]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 12:07:21 user nova-compute[73449]:     <timer name="hpet" present="no"/>
Aug 17 12:07:21 user nova-compute[73449]:   </clock>
Aug 17 12:07:21 user nova-compute[73449]:   <cpu mode="custom" match="exact">
Aug 17 12:07:21 user nova-compute[73449]:     <model>Nehalem</model>
Aug 17 12:07:21 user nova-compute[73449]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 12:07:21 user nova-compute[73449]:   </cpu>
Aug 17 12:07:21 user nova-compute[73449]:   <devices>
Aug 17 12:07:21 user nova-compute[73449]:     <disk type="file" device="disk">
Aug 17 12:07:21 user nova-compute[73449]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 12:07:21 user nova-compute[73449]:       <source file="/opt/stack/data/nova/instances/f607caf8-0910-4214-b2f7-ccd59cd0307a/disk"/>
Aug 17 12:07:21 user nova-compute[73449]:       <target dev="vda" bus="virtio"/>
Aug 17 12:07:21 user nova-compute[73449]:     </disk>
Aug 17 12:07:21 user nova-compute[73449]:     <interface type="ethernet">
Aug 17 12:07:21 user nova-compute[73449]:       <mac address="fa:16:3e:b4:1b:4f"/>
Aug 17 12:07:21 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 12:07:21 user nova-compute[73449]:       <mtu size="1442"/>
Aug 17 12:07:21 user nova-compute[73449]:       <target dev="tap3fbe83ab-0b"/>
Aug 17 12:07:21 user nova-compute[73449]:     </interface>
Aug 17 12:07:21 user nova-compute[73449]:     <serial type="pty">
Aug 17 12:07:21 user nova-compute[73449]:       <log file="/opt/stack/data/nova/instances/f607caf8-0910-4214-b2f7-ccd59cd0307a/console.log" append="off"/>
Aug 17 12:07:21 user nova-compute[73449]:     </serial>
Aug 17 12:07:21 user nova-compute[73449]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 12:07:21 user nova-compute[73449]:     <video>
Aug 17 12:07:21 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 12:07:21 user nova-compute[73449]:     </video>
Aug 17 12:07:21 user nova-compute[73449]:     <rng model="virtio">
Aug 17 12:07:21 user nova-compute[73449]:       <backend model="random">/dev/urandom</backend>
Aug 17 12:07:21 user nova-compute[73449]:     </rng>
Aug 17 12:07:21 user nova-compute[73449]:     <controller type="usb" index="0" model="none"/>
Aug 17 12:07:21 user nova-compute[73449]:     <memballoon model="virtio">
Aug 17 12:07:21 user nova-compute[73449]:       <stats period="10"/>
Aug 17 12:07:21 user nova-compute[73449]:     </memballoon>
Aug 17 12:07:21 user nova-compute[73449]:   </devices>
Aug 17 12:07:21 user nova-compute[73449]: </domain>
Aug 17 12:07:21 user nova-compute[73449]:  {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 12:07:21 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-d0b97434-2d65-43a4-8949-6c1e081cbe92 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T12:07:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-290223819',display_name='tempest-AttachVolumeNegativeTest-server-290223819',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-290223819',id=49,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIcdd5aeecIYlkFx2V2bOlocTYxswMy7dyyjzsWB0kPZfZnWdMUqwEO+45ozoejtI2uZXoUirQYe3MBmB0K/Ke1GZ9Stc3w/8DeCRIJRTSZUMGlReyFZm9UfJDMGJ2bh+A==',key_name='tempest-keypair-1929215192',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75aa99e369c54b65aff27adbb1daf2b8',ramdisk_id='',reservation_id='r-gm793uzz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-165752051',owner_user_name='tempest-AttachVolumeNegativeTest-165752051-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T12:07:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55cde68973ca42d095180b5c0701b49b',uuid=f607caf8-0910-4214-b2f7-ccd59cd0307a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3fbe83ab-0b4f-4f6d-9a90-bd564e1e0760", "address": "fa:16:3e:b4:1b:4f", "network": {"id": "71648e1b-cf19-44b7-bae2-9d38543cdee9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-822323626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75aa99e369c54b65aff27adbb1daf2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fbe83ab-0b", "ovs_interfaceid": "3fbe83ab-0b4f-4f6d-9a90-bd564e1e0760", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 12:07:21 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-d0b97434-2d65-43a4-8949-6c1e081cbe92 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Converting VIF {"id": "3fbe83ab-0b4f-4f6d-9a90-bd564e1e0760", "address": "fa:16:3e:b4:1b:4f", "network": {"id": "71648e1b-cf19-44b7-bae2-9d38543cdee9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-822323626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75aa99e369c54b65aff27adbb1daf2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fbe83ab-0b", "ovs_interfaceid": "3fbe83ab-0b4f-4f6d-9a90-bd564e1e0760", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 12:07:21 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-d0b97434-2d65-43a4-8949-6c1e081cbe92 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:1b:4f,bridge_name='br-int',has_traffic_filtering=True,id=3fbe83ab-0b4f-4f6d-9a90-bd564e1e0760,network=Network(71648e1b-cf19-44b7-bae2-9d38543cdee9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fbe83ab-0b') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 12:07:21 user nova-compute[73449]: DEBUG os_vif [None req-d0b97434-2d65-43a4-8949-6c1e081cbe92 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:1b:4f,bridge_name='br-int',has_traffic_filtering=True,id=3fbe83ab-0b4f-4f6d-9a90-bd564e1e0760,network=Network(71648e1b-cf19-44b7-bae2-9d38543cdee9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fbe83ab-0b') {{(pid=73449) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 12:07:21 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61201d5c-26f1-4c6d-a764-be2ee2e533ae/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:07:21 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73449) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 12:07:21 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:07:21 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 12:07:21 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 12:07:21 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:07:21 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3fbe83ab-0b, may_exist=True, interface_attrs={}) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 12:07:21 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3fbe83ab-0b, col_values=(('external_ids', {'iface-id': '3fbe83ab-0b4f-4f6d-9a90-bd564e1e0760', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b4:1b:4f', 'vm-uuid': 'f607caf8-0910-4214-b2f7-ccd59cd0307a'}),), if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 12:07:21 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:07:21 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:07:21 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:07:21 user nova-compute[73449]: INFO os_vif [None req-d0b97434-2d65-43a4-8949-6c1e081cbe92 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:1b:4f,bridge_name='br-int',has_traffic_filtering=True,id=3fbe83ab-0b4f-4f6d-9a90-bd564e1e0760,network=Network(71648e1b-cf19-44b7-bae2-9d38543cdee9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fbe83ab-0b')
Aug 17 12:07:21 user nova-compute[73449]: INFO nova.compute.manager [None req-066668f0-7065-4f91-a15e-d61d0e03a08a tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] [instance: 54c69eab-3597-4ca7-b698-169538b73a18] Took 8.09 seconds to build instance.
Aug 17 12:07:21 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 12:07:21 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 12:07:21 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Hypervisor/Node resource view: name=user free_ram=8241MB free_disk=24.734355926513672GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73449) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 12:07:21 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:07:21 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:07:21 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-d0b97434-2d65-43a4-8949-6c1e081cbe92 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] No BDM found with device name vda, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 12:07:21 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-d0b97434-2d65-43a4-8949-6c1e081cbe92 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] No VIF found with MAC fa:16:3e:b4:1b:4f, not building metadata {{(pid=73449) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 12:07:21 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-066668f0-7065-4f91-a15e-d61d0e03a08a tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Lock "54c69eab-3597-4ca7-b698-169538b73a18" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.213s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:07:21 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 89440604-1daf-4e7a-a524-2f9c21a9cb96 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 12:07:21 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 31f5f3d2-41d8-4a26-9eb2-18b891f94734 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 12:07:21 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 712c777e-251b-43d8-b923-8eda693f32ed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 12:07:21 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 5a627da9-03a1-4239-8721-cefe99c39ee2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 12:07:21 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 61201d5c-26f1-4c6d-a764-be2ee2e533ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 12:07:21 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 8fdfaf32-0957-453a-b1cf-9a3c19815c45 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 12:07:21 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 54c69eab-3597-4ca7-b698-169538b73a18 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 12:07:21 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance f607caf8-0910-4214-b2f7-ccd59cd0307a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 12:07:21 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=73449) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 12:07:21 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=73449) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 12:07:21 user nova-compute[73449]: DEBUG nova.network.neutron [req-38ce5654-4bdc-4835-9cd7-c0535eb4db3b req-c0cdc569-8583-4546-aaa8-e555f553fc35 service nova] [instance: f607caf8-0910-4214-b2f7-ccd59cd0307a] Updated VIF entry in instance network info cache for port 3fbe83ab-0b4f-4f6d-9a90-bd564e1e0760. {{(pid=73449) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 12:07:21 user nova-compute[73449]: DEBUG nova.network.neutron [req-38ce5654-4bdc-4835-9cd7-c0535eb4db3b req-c0cdc569-8583-4546-aaa8-e555f553fc35 service nova] [instance: f607caf8-0910-4214-b2f7-ccd59cd0307a] Updating instance_info_cache with network_info: [{"id": "3fbe83ab-0b4f-4f6d-9a90-bd564e1e0760", "address": "fa:16:3e:b4:1b:4f", "network": {"id": "71648e1b-cf19-44b7-bae2-9d38543cdee9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-822323626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75aa99e369c54b65aff27adbb1daf2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fbe83ab-0b", "ovs_interfaceid": "3fbe83ab-0b4f-4f6d-9a90-bd564e1e0760", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 12:07:21 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-38ce5654-4bdc-4835-9cd7-c0535eb4db3b req-c0cdc569-8583-4546-aaa8-e555f553fc35 service nova] Releasing lock "refresh_cache-f607caf8-0910-4214-b2f7-ccd59cd0307a" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 12:07:22 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 12:07:22 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 12:07:22 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Compute_service record updated for user:user {{(pid=73449) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 12:07:22 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.409s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:07:22 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:07:23 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:07:23 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:07:23 user nova-compute[73449]: DEBUG nova.compute.manager [req-2dec905c-30ab-43e3-b463-5d7e8e261c72 req-4bd89753-3a3d-4dc7-80b3-069d6dc451d4 service nova] [instance: f607caf8-0910-4214-b2f7-ccd59cd0307a] Received event network-vif-plugged-3fbe83ab-0b4f-4f6d-9a90-bd564e1e0760 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:07:23 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-2dec905c-30ab-43e3-b463-5d7e8e261c72 req-4bd89753-3a3d-4dc7-80b3-069d6dc451d4 service nova] Acquiring lock "f607caf8-0910-4214-b2f7-ccd59cd0307a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:07:23 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-2dec905c-30ab-43e3-b463-5d7e8e261c72 req-4bd89753-3a3d-4dc7-80b3-069d6dc451d4 service nova] Lock "f607caf8-0910-4214-b2f7-ccd59cd0307a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:07:23 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-2dec905c-30ab-43e3-b463-5d7e8e261c72 req-4bd89753-3a3d-4dc7-80b3-069d6dc451d4 service nova] Lock "f607caf8-0910-4214-b2f7-ccd59cd0307a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:07:23 user nova-compute[73449]: DEBUG nova.compute.manager [req-2dec905c-30ab-43e3-b463-5d7e8e261c72 req-4bd89753-3a3d-4dc7-80b3-069d6dc451d4 service nova] [instance: f607caf8-0910-4214-b2f7-ccd59cd0307a] No waiting events found dispatching network-vif-plugged-3fbe83ab-0b4f-4f6d-9a90-bd564e1e0760 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 12:07:23 user nova-compute[73449]: WARNING nova.compute.manager [req-2dec905c-30ab-43e3-b463-5d7e8e261c72 req-4bd89753-3a3d-4dc7-80b3-069d6dc451d4 service nova] [instance: f607caf8-0910-4214-b2f7-ccd59cd0307a] Received unexpected event network-vif-plugged-3fbe83ab-0b4f-4f6d-9a90-bd564e1e0760 for instance with vm_state building and task_state spawning.
Aug 17 12:07:23 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:07:23 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:07:23 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:07:23 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:07:23 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:07:24 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:07:24 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Starting heal instance info cache {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 12:07:24 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "refresh_cache-5a627da9-03a1-4239-8721-cefe99c39ee2" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 12:07:24 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquired lock "refresh_cache-5a627da9-03a1-4239-8721-cefe99c39ee2" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 12:07:24 user nova-compute[73449]: DEBUG nova.network.neutron [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] Forcefully refreshing network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 12:07:24 user nova-compute[73449]: DEBUG nova.network.neutron [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] Updating instance_info_cache with network_info: [{"id": "69831639-3628-4b42-8ddd-fe0965dea4b6", "address": "fa:16:3e:de:22:d6", "network": {"id": "9455bb75-f75a-41ff-8f6f-49f55aa738f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-425274599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec3b0b72e47448ebe99f9fc64119c1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69831639-36", "ovs_interfaceid": "69831639-3628-4b42-8ddd-fe0965dea4b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 12:07:24 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Releasing lock "refresh_cache-5a627da9-03a1-4239-8721-cefe99c39ee2" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 12:07:24 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] Updated the network info_cache for instance {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 12:07:24 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:07:25 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692274045.300109, f607caf8-0910-4214-b2f7-ccd59cd0307a => Resumed> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 12:07:25 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: f607caf8-0910-4214-b2f7-ccd59cd0307a] VM Resumed (Lifecycle Event)
Aug 17 12:07:25 user nova-compute[73449]: DEBUG nova.compute.manager [None req-d0b97434-2d65-43a4-8949-6c1e081cbe92 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: f607caf8-0910-4214-b2f7-ccd59cd0307a] Instance event wait completed in 0 seconds for  {{(pid=73449) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 12:07:25 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-d0b97434-2d65-43a4-8949-6c1e081cbe92 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: f607caf8-0910-4214-b2f7-ccd59cd0307a] Guest created on hypervisor {{(pid=73449) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 12:07:25 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: f607caf8-0910-4214-b2f7-ccd59cd0307a] Instance spawned successfully.
Aug 17 12:07:25 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-d0b97434-2d65-43a4-8949-6c1e081cbe92 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: f607caf8-0910-4214-b2f7-ccd59cd0307a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 12:07:25 user nova-compute[73449]: DEBUG nova.compute.manager [req-3af70283-c3f4-47c6-9906-ee8bf713aa8d req-409947de-15cd-49dd-85e7-ec5fa21e8f7a service nova] [instance: f607caf8-0910-4214-b2f7-ccd59cd0307a] Received event network-vif-plugged-3fbe83ab-0b4f-4f6d-9a90-bd564e1e0760 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:07:25 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-3af70283-c3f4-47c6-9906-ee8bf713aa8d req-409947de-15cd-49dd-85e7-ec5fa21e8f7a service nova] Acquiring lock "f607caf8-0910-4214-b2f7-ccd59cd0307a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:07:25 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-3af70283-c3f4-47c6-9906-ee8bf713aa8d req-409947de-15cd-49dd-85e7-ec5fa21e8f7a service nova] Lock "f607caf8-0910-4214-b2f7-ccd59cd0307a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:07:25 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-3af70283-c3f4-47c6-9906-ee8bf713aa8d req-409947de-15cd-49dd-85e7-ec5fa21e8f7a service nova] Lock "f607caf8-0910-4214-b2f7-ccd59cd0307a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:07:25 user nova-compute[73449]: DEBUG nova.compute.manager [req-3af70283-c3f4-47c6-9906-ee8bf713aa8d req-409947de-15cd-49dd-85e7-ec5fa21e8f7a service nova] [instance: f607caf8-0910-4214-b2f7-ccd59cd0307a] No waiting events found dispatching network-vif-plugged-3fbe83ab-0b4f-4f6d-9a90-bd564e1e0760 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 12:07:25 user nova-compute[73449]: WARNING nova.compute.manager [req-3af70283-c3f4-47c6-9906-ee8bf713aa8d req-409947de-15cd-49dd-85e7-ec5fa21e8f7a service nova] [instance: f607caf8-0910-4214-b2f7-ccd59cd0307a] Received unexpected event network-vif-plugged-3fbe83ab-0b4f-4f6d-9a90-bd564e1e0760 for instance with vm_state building and task_state spawning.
Aug 17 12:07:25 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: f607caf8-0910-4214-b2f7-ccd59cd0307a] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 12:07:25 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: f607caf8-0910-4214-b2f7-ccd59cd0307a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 12:07:25 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-d0b97434-2d65-43a4-8949-6c1e081cbe92 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: f607caf8-0910-4214-b2f7-ccd59cd0307a] Found default for hw_cdrom_bus of ide {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 12:07:25 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-d0b97434-2d65-43a4-8949-6c1e081cbe92 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: f607caf8-0910-4214-b2f7-ccd59cd0307a] Found default for hw_disk_bus of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 12:07:25 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-d0b97434-2d65-43a4-8949-6c1e081cbe92 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: f607caf8-0910-4214-b2f7-ccd59cd0307a] Found default for hw_input_bus of None {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 12:07:25 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-d0b97434-2d65-43a4-8949-6c1e081cbe92 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: f607caf8-0910-4214-b2f7-ccd59cd0307a] Found default for hw_pointer_model of None {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 12:07:25 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-d0b97434-2d65-43a4-8949-6c1e081cbe92 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: f607caf8-0910-4214-b2f7-ccd59cd0307a] Found default for hw_video_model of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 12:07:25 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-d0b97434-2d65-43a4-8949-6c1e081cbe92 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: f607caf8-0910-4214-b2f7-ccd59cd0307a] Found default for hw_vif_model of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 12:07:25 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: f607caf8-0910-4214-b2f7-ccd59cd0307a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 12:07:25 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692274045.3047056, f607caf8-0910-4214-b2f7-ccd59cd0307a => Started> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 12:07:25 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: f607caf8-0910-4214-b2f7-ccd59cd0307a] VM Started (Lifecycle Event)
Aug 17 12:07:25 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: f607caf8-0910-4214-b2f7-ccd59cd0307a] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 12:07:25 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: f607caf8-0910-4214-b2f7-ccd59cd0307a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 12:07:25 user nova-compute[73449]: INFO nova.compute.manager [None req-d0b97434-2d65-43a4-8949-6c1e081cbe92 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: f607caf8-0910-4214-b2f7-ccd59cd0307a] Took 7.01 seconds to spawn the instance on the hypervisor.
Aug 17 12:07:25 user nova-compute[73449]: DEBUG nova.compute.manager [None req-d0b97434-2d65-43a4-8949-6c1e081cbe92 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: f607caf8-0910-4214-b2f7-ccd59cd0307a] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 12:07:25 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: f607caf8-0910-4214-b2f7-ccd59cd0307a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 12:07:25 user nova-compute[73449]: INFO nova.compute.manager [None req-d0b97434-2d65-43a4-8949-6c1e081cbe92 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: f607caf8-0910-4214-b2f7-ccd59cd0307a] Took 8.00 seconds to build instance.
Aug 17 12:07:25 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-d0b97434-2d65-43a4-8949-6c1e081cbe92 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Lock "f607caf8-0910-4214-b2f7-ccd59cd0307a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.094s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:07:26 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:07:28 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:07:31 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:07:31 user nova-compute[73449]: DEBUG nova.objects.instance [None req-63102c87-00b7-4894-add5-8417c8588d26 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Lazy-loading 'flavor' on Instance uuid 61201d5c-26f1-4c6d-a764-be2ee2e533ae {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:07:31 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-63102c87-00b7-4894-add5-8417c8588d26 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Acquiring lock "refresh_cache-61201d5c-26f1-4c6d-a764-be2ee2e533ae" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 12:07:31 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-63102c87-00b7-4894-add5-8417c8588d26 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Acquired lock "refresh_cache-61201d5c-26f1-4c6d-a764-be2ee2e533ae" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 12:07:31 user nova-compute[73449]: DEBUG nova.network.neutron [None req-63102c87-00b7-4894-add5-8417c8588d26 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Building network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 12:07:31 user nova-compute[73449]: DEBUG nova.objects.instance [None req-63102c87-00b7-4894-add5-8417c8588d26 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Lazy-loading 'info_cache' on Instance uuid 61201d5c-26f1-4c6d-a764-be2ee2e533ae {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:07:32 user nova-compute[73449]: DEBUG nova.network.neutron [None req-63102c87-00b7-4894-add5-8417c8588d26 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Updating instance_info_cache with network_info: [{"id": "f9f6066e-ddd2-4e41-b92a-5713cfb9a223", "address": "fa:16:3e:d2:c7:08", "network": {"id": "2ead35b7-4013-4fab-b35f-02f3237fcac1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1887618888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2a2f7faf23147fba5270c844eac051a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9f6066e-dd", "ovs_interfaceid": "f9f6066e-ddd2-4e41-b92a-5713cfb9a223", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 12:07:32 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-63102c87-00b7-4894-add5-8417c8588d26 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Releasing lock "refresh_cache-61201d5c-26f1-4c6d-a764-be2ee2e533ae" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 12:07:32 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Instance destroyed successfully.
Aug 17 12:07:32 user nova-compute[73449]: DEBUG nova.objects.instance [None req-63102c87-00b7-4894-add5-8417c8588d26 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Lazy-loading 'resources' on Instance uuid 61201d5c-26f1-4c6d-a764-be2ee2e533ae {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:07:32 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-63102c87-00b7-4894-add5-8417c8588d26 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T12:03:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-460422634',display_name='tempest-AttachVolumeTestJSON-server-460422634',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-460422634',id=45,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNXw3KLSoC9Q0XBnEpzlvGLEU4aQOJ/QynPahuU7gv/dPY1PMhUmMgpw0sT/09d1GxZ/bLO+3BhHXGsw2GJhA2bjtLfUrL+5y9epJ9Io8OYn3n51dk0dquYLKVxFrx0m8Q==',key_name='tempest-keypair-402233619',keypairs=<?>,launch_index=0,launched_at=2023-08-17T12:03:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='f2a2f7faf23147fba5270c844eac051a',ramdisk_id='',reservation_id='r-arnh7g7d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1035899549',owner_user_name='tempest-AttachVolumeTestJSON-1035899549-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T12:05:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9b21e7e411a54be0890ae7b0ca85d80c',uuid=61201d5c-26f1-4c6d-a764-be2ee2e533ae,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "f9f6066e-ddd2-4e41-b92a-5713cfb9a223", "address": "fa:16:3e:d2:c7:08", "network": {"id": "2ead35b7-4013-4fab-b35f-02f3237fcac1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1887618888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2a2f7faf23147fba5270c844eac051a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9f6066e-dd", "ovs_interfaceid": "f9f6066e-ddd2-4e41-b92a-5713cfb9a223", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 12:07:32 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-63102c87-00b7-4894-add5-8417c8588d26 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Converting VIF {"id": "f9f6066e-ddd2-4e41-b92a-5713cfb9a223", "address": "fa:16:3e:d2:c7:08", "network": {"id": "2ead35b7-4013-4fab-b35f-02f3237fcac1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1887618888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2a2f7faf23147fba5270c844eac051a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9f6066e-dd", "ovs_interfaceid": "f9f6066e-ddd2-4e41-b92a-5713cfb9a223", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 12:07:32 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-63102c87-00b7-4894-add5-8417c8588d26 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:c7:08,bridge_name='br-int',has_traffic_filtering=True,id=f9f6066e-ddd2-4e41-b92a-5713cfb9a223,network=Network(2ead35b7-4013-4fab-b35f-02f3237fcac1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9f6066e-dd') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 12:07:32 user nova-compute[73449]: DEBUG os_vif [None req-63102c87-00b7-4894-add5-8417c8588d26 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:c7:08,bridge_name='br-int',has_traffic_filtering=True,id=f9f6066e-ddd2-4e41-b92a-5713cfb9a223,network=Network(2ead35b7-4013-4fab-b35f-02f3237fcac1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9f6066e-dd') {{(pid=73449) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 12:07:32 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:07:32 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf9f6066e-dd, bridge=br-int, if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 12:07:32 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:07:32 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:07:32 user nova-compute[73449]: INFO os_vif [None req-63102c87-00b7-4894-add5-8417c8588d26 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:c7:08,bridge_name='br-int',has_traffic_filtering=True,id=f9f6066e-ddd2-4e41-b92a-5713cfb9a223,network=Network(2ead35b7-4013-4fab-b35f-02f3237fcac1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9f6066e-dd')
Aug 17 12:07:32 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63102c87-00b7-4894-add5-8417c8588d26 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] calling os-brick to detach iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 12:07:32 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-63102c87-00b7-4894-add5-8417c8588d26 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, {'target_iqns': ['iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mOspuxWK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 12:07:32 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-63102c87-00b7-4894-add5-8417c8588d26 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 12:07:32 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-63102c87-00b7-4894-add5-8417c8588d26 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 12:07:32 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-63102c87-00b7-4894-add5-8417c8588d26 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 12:07:32 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-63102c87-00b7-4894-add5-8417c8588d26 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49', 0)] {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 12:07:32 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:07:32 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:07:32 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[878e2e57-127d-415a-aae5-ec11f81f3308]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8314fb1e-61f9-44b5-b944-5a94677724c8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:07:32 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:07:32 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:07:32 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[95245302-a37a-466e-958f-1d877075ea33]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8314fb1e-61f9-44b5-b944-5a94677724c8 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49 (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:07:32 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-63102c87-00b7-4894-add5-8417c8588d26 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)
Aug 17 12:07:32 user nova-compute[73449]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8314fb1e-61f9-44b5-b944-5a94677724c8 (non-flash)
Aug 17 12:07:32 user nova-compute[73449]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49 (non-flash)
Aug 17 12:07:32 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 12:07:32 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-63102c87-00b7-4894-add5-8417c8588d26 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)
Aug 17 12:07:32 user nova-compute[73449]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8314fb1e-61f9-44b5-b944-5a94677724c8 (non-flash)
Aug 17 12:07:32 user nova-compute[73449]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49 (non-flash)
Aug 17 12:07:32 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 12:07:32 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-63102c87-00b7-4894-add5-8417c8588d26 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe738604430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49'): ({'sdc'}, set())}) {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 12:07:32 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-63102c87-00b7-4894-add5-8417c8588d26 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Removing single pathed devices sdc {{(pid=73449) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 12:07:32 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:07:32 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:07:32 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[3559d917-8d13-4e9b-b80b-d965692ce818]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:07:32 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:07:32 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:07:32 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[fddc8f89-72ab-425b-a5d8-dcdcc4cb298c]: (4, ('ok\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:07:32 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-63102c87-00b7-4894-add5-8417c8588d26 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Flushing IO for device /dev/sdc {{(pid=73449) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 12:07:32 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:07:32 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:07:32 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8df13c1-4b88-4ee0-98be-e7a04391b8be]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:07:32 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-63102c87-00b7-4894-add5-8417c8588d26 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73449) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 12:07:32 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:07:32 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.036s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:07:32 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[2954efb3-3ce7-4717-8d75-e612c7a1ab04]: (4, ('1', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:07:32 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-63102c87-00b7-4894-add5-8417c8588d26 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73449) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 12:07:32 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-63102c87-00b7-4894-add5-8417c8588d26 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] SCSI volumes sdc have been removed. {{(pid=73449) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 12:07:32 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-63102c87-00b7-4894-add5-8417c8588d26 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49')] {{(pid=73449) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 12:07:32 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:07:32 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:07:32 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bd93f10-bc45-4988-bcc3-c201f7cfaab0]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:07:32 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-63102c87-00b7-4894-add5-8417c8588d26 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:07:32 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49 -p 172.16.0.220:3260 --logout {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:07:32 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:07:32 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[03b2c718-3057-4c9c-9ce0-4da61908bfb9]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:07:32 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-63102c87-00b7-4894-add5-8417c8588d26 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49, portal: 172.16.0.220,3260]
Aug 17 12:07:32 user nova-compute[73449]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49, portal: 172.16.0.220,3260] successful.
Aug 17 12:07:32 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:07:32 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49 -p 172.16.0.220:3260 --op delete {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:07:32 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:07:32 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[fca73f57-2005-49df-9806-561759cbd06c]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:07:32 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-63102c87-00b7-4894-add5-8417c8588d26 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:07:32 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-63102c87-00b7-4894-add5-8417c8588d26 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.262s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 12:07:32 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-63102c87-00b7-4894-add5-8417c8588d26 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] <== disconnect_volume: return (263ms) None {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 12:07:32 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63102c87-00b7-4894-add5-8417c8588d26 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Disconnected iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 12:07:32 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-63102c87-00b7-4894-add5-8417c8588d26 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Start _get_guest_xml network_info=[{"id": "f9f6066e-ddd2-4e41-b92a-5713cfb9a223", "address": "fa:16:3e:d2:c7:08", "network": {"id": "2ead35b7-4013-4fab-b35f-02f3237fcac1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1887618888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2a2f7faf23147fba5270c844eac051a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9f6066e-dd", "ovs_interfaceid": "f9f6066e-ddd2-4e41-b92a-5713cfb9a223", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=0a2904ae-083d-41c8-83db-343132b36148,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': '0a2904ae-083d-41c8-83db-343132b36148'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'attachment_id': '4c530b68-66c3-4084-bba6-faf8c6f92237', 'boot_index': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mOspuxWK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '61201d5c-26f1-4c6d-a764-be2ee2e533ae', 'attached_at': '', 'detached_at': '', 'volume_id': '12aa960e-96d4-4bae-b7eb-209200c9ec49', 'serial': '12aa960e-96d4-4bae-b7eb-209200c9ec49'}, 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 12:07:32 user nova-compute[73449]: DEBUG nova.objects.instance [None req-63102c87-00b7-4894-add5-8417c8588d26 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Lazy-loading 'numa_topology' on Instance uuid 61201d5c-26f1-4c6d-a764-be2ee2e533ae {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:07:32 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-63102c87-00b7-4894-add5-8417c8588d26 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 12:07:32 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-63102c87-00b7-4894-add5-8417c8588d26 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 12:07:32 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-63102c87-00b7-4894-add5-8417c8588d26 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 12:07:32 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-63102c87-00b7-4894-add5-8417c8588d26 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] CPU controller missing on host. {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 12:07:32 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-63102c87-00b7-4894-add5-8417c8588d26 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 12:07:32 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-63102c87-00b7-4894-add5-8417c8588d26 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] CPU controller found on host. {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 12:07:32 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-63102c87-00b7-4894-add5-8417c8588d26 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73449) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 12:07:32 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-63102c87-00b7-4894-add5-8417c8588d26 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T11:35:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=0a2904ae-083d-41c8-83db-343132b36148,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 12:07:32 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-63102c87-00b7-4894-add5-8417c8588d26 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Flavor limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 12:07:32 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-63102c87-00b7-4894-add5-8417c8588d26 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Image limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 12:07:32 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-63102c87-00b7-4894-add5-8417c8588d26 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Flavor pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 12:07:32 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-63102c87-00b7-4894-add5-8417c8588d26 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Image pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 12:07:32 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-63102c87-00b7-4894-add5-8417c8588d26 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 12:07:32 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-63102c87-00b7-4894-add5-8417c8588d26 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 12:07:32 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-63102c87-00b7-4894-add5-8417c8588d26 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 12:07:32 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-63102c87-00b7-4894-add5-8417c8588d26 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Got 1 possible topologies {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 12:07:32 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-63102c87-00b7-4894-add5-8417c8588d26 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 12:07:32 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-63102c87-00b7-4894-add5-8417c8588d26 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 12:07:32 user nova-compute[73449]: DEBUG nova.objects.instance [None req-63102c87-00b7-4894-add5-8417c8588d26 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Lazy-loading 'vcpu_model' on Instance uuid 61201d5c-26f1-4c6d-a764-be2ee2e533ae {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:07:32 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63102c87-00b7-4894-add5-8417c8588d26 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Calling os-brick to attach iSCSI Volume {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 12:07:32 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-63102c87-00b7-4894-add5-8417c8588d26 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mOspuxWK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 12:07:32 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-63102c87-00b7-4894-add5-8417c8588d26 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 12:07:32 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-63102c87-00b7-4894-add5-8417c8588d26 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 12:07:32 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-63102c87-00b7-4894-add5-8417c8588d26 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 12:07:32 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-63102c87-00b7-4894-add5-8417c8588d26 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 12:07:32 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-63102c87-00b7-4894-add5-8417c8588d26 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 12:07:32 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-63102c87-00b7-4894-add5-8417c8588d26 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 12:07:32 user nova-compute[73449]: INFO os_brick.initiator.connectors.iscsi [None req-63102c87-00b7-4894-add5-8417c8588d26 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 12:07:32 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49 -p 172.16.0.220:3260 {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:07:32 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:07:32 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[434ba7d9-1a50-4a03-9eb6-68607964946a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:07:32 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-63102c87-00b7-4894-add5-8417c8588d26 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 12:07:32 user nova-compute[73449]:  {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:07:32 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49 -p 172.16.0.220:3260 --interface default --op new {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:07:32 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:07:32 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[8522128f-a86a-4c81-8bc1-ef4e0eda2f9c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49] added\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:07:32 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-63102c87-00b7-4894-add5-8417c8588d26 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49] added
Aug 17 12:07:32 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:07:32 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:07:32 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:07:32 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ef283c2-e6f5-46cc-97ef-bfbfbe571c21]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:07:32 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-63102c87-00b7-4894-add5-8417c8588d26 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:07:32 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:07:32 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:07:32 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[e81f1381-7f4d-43b4-aca8-86c010a0ed96]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:07:32 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-63102c87-00b7-4894-add5-8417c8588d26 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:07:32 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mOspuxWK {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:07:32 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mOspuxWK" returned: 0 in 0.017s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:07:32 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac8c8b93-64c3-4204-9dce-c9b6a6a83f20]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:07:32 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-63102c87-00b7-4894-add5-8417c8588d26 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mOspuxWK'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:07:32 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:07:32 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:07:32 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4dd5d4c-13c5-41f5-b3ed-a6660cda930c]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:07:32 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-63102c87-00b7-4894-add5-8417c8588d26 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:07:32 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:07:32 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:07:32 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e64f7cd-1a07-4bab-b7d8-19737df4549e]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8314fb1e-61f9-44b5-b944-5a94677724c8 (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:07:32 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-63102c87-00b7-4894-add5-8417c8588d26 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)
Aug 17 12:07:32 user nova-compute[73449]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8314fb1e-61f9-44b5-b944-5a94677724c8 (non-flash)
Aug 17 12:07:32 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 12:07:32 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-63102c87-00b7-4894-add5-8417c8588d26 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)
Aug 17 12:07:32 user nova-compute[73449]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8314fb1e-61f9-44b5-b944-5a94677724c8 (non-flash)
Aug 17 12:07:32 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 12:07:32 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49 -p 172.16.0.220:3260 --login {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:07:32 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:07:32 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d306de6-98a0-402d-a62e-e4d0cedfc49a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:07:32 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-63102c87-00b7-4894-add5-8417c8588d26 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49, portal: 172.16.0.220,3260]
Aug 17 12:07:32 user nova-compute[73449]: Login to [iface: default, target: iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49, portal: 172.16.0.220,3260] successful.
Aug 17 12:07:32 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:07:32 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:07:32 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:07:32 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[beb0ed28-5f79-461a-a515-545ca9a0e23b]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:07:32 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-63102c87-00b7-4894-add5-8417c8588d26 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:07:32 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:07:32 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:07:32 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[d97b47f8-2cb9-44e0-a613-0145680cc88c]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8314fb1e-61f9-44b5-b944-5a94677724c8 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49 (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:07:32 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-63102c87-00b7-4894-add5-8417c8588d26 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)
Aug 17 12:07:32 user nova-compute[73449]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8314fb1e-61f9-44b5-b944-5a94677724c8 (non-flash)
Aug 17 12:07:32 user nova-compute[73449]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49 (non-flash)
Aug 17 12:07:32 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 12:07:32 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-63102c87-00b7-4894-add5-8417c8588d26 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)
Aug 17 12:07:32 user nova-compute[73449]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8314fb1e-61f9-44b5-b944-5a94677724c8 (non-flash)
Aug 17 12:07:32 user nova-compute[73449]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49 (non-flash)
Aug 17 12:07:32 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 12:07:32 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-63102c87-00b7-4894-add5-8417c8588d26 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 12:07:32 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-63102c87-00b7-4894-add5-8417c8588d26 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Connected to 172.16.0.220:3260 {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 12:07:32 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-63102c87-00b7-4894-add5-8417c8588d26 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] HCTL ('34', '-', '-', 0) found on session 53 with lun 0 {{(pid=73449) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 12:07:32 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-63102c87-00b7-4894-add5-8417c8588d26 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73449) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 12:07:32 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:07:33 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:07:33 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc8b0493-52dc-4396-9c4a-efbb72fad0f4]: (4, ('- - 0', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:07:33 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-63102c87-00b7-4894-add5-8417c8588d26 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Searching for a device in session 53 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73449) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 12:07:33 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-63102c87-00b7-4894-add5-8417c8588d26 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mOspuxWK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 12:07:34 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-63102c87-00b7-4894-add5-8417c8588d26 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 12:07:34 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-63102c87-00b7-4894-add5-8417c8588d26 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] <== connect_volume: return (1323ms) {'type': 'block', 'scsi_wwn': '26639383432346664', 'path': '/dev/sdc'} {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 12:07:34 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63102c87-00b7-4894-add5-8417c8588d26 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26639383432346664', 'path': '/dev/sdc'} {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 12:07:34 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-63102c87-00b7-4894-add5-8417c8588d26 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T12:03:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-460422634',display_name='tempest-AttachVolumeTestJSON-server-460422634',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-460422634',id=45,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNXw3KLSoC9Q0XBnEpzlvGLEU4aQOJ/QynPahuU7gv/dPY1PMhUmMgpw0sT/09d1GxZ/bLO+3BhHXGsw2GJhA2bjtLfUrL+5y9epJ9Io8OYn3n51dk0dquYLKVxFrx0m8Q==',key_name='tempest-keypair-402233619',keypairs=<?>,launch_index=0,launched_at=2023-08-17T12:03:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='f2a2f7faf23147fba5270c844eac051a',ramdisk_id='',reservation_id='r-arnh7g7d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1035899549',owner_user_name='tempest-AttachVolumeTestJSON-1035899549-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T12:05:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9b21e7e411a54be0890ae7b0ca85d80c',uuid=61201d5c-26f1-4c6d-a764-be2ee2e533ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "f9f6066e-ddd2-4e41-b92a-5713cfb9a223", "address": "fa:16:3e:d2:c7:08", "network": {"id": "2ead35b7-4013-4fab-b35f-02f3237fcac1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1887618888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2a2f7faf23147fba5270c844eac051a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9f6066e-dd", "ovs_interfaceid": "f9f6066e-ddd2-4e41-b92a-5713cfb9a223", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73449) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 12:07:34 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-63102c87-00b7-4894-add5-8417c8588d26 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Converting VIF {"id": "f9f6066e-ddd2-4e41-b92a-5713cfb9a223", "address": "fa:16:3e:d2:c7:08", "network": {"id": "2ead35b7-4013-4fab-b35f-02f3237fcac1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1887618888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2a2f7faf23147fba5270c844eac051a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9f6066e-dd", "ovs_interfaceid": "f9f6066e-ddd2-4e41-b92a-5713cfb9a223", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 12:07:34 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-63102c87-00b7-4894-add5-8417c8588d26 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:c7:08,bridge_name='br-int',has_traffic_filtering=True,id=f9f6066e-ddd2-4e41-b92a-5713cfb9a223,network=Network(2ead35b7-4013-4fab-b35f-02f3237fcac1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9f6066e-dd') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 12:07:34 user nova-compute[73449]: DEBUG nova.objects.instance [None req-63102c87-00b7-4894-add5-8417c8588d26 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Lazy-loading 'pci_devices' on Instance uuid 61201d5c-26f1-4c6d-a764-be2ee2e533ae {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:07:34 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-63102c87-00b7-4894-add5-8417c8588d26 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] End _get_guest_xml xml=<domain type="kvm">
Aug 17 12:07:34 user nova-compute[73449]:   <uuid>61201d5c-26f1-4c6d-a764-be2ee2e533ae</uuid>
Aug 17 12:07:34 user nova-compute[73449]:   <name>instance-0000002d</name>
Aug 17 12:07:34 user nova-compute[73449]:   <memory>524288</memory>
Aug 17 12:07:34 user nova-compute[73449]:   <vcpu>1</vcpu>
Aug 17 12:07:34 user nova-compute[73449]:   <metadata>
Aug 17 12:07:34 user nova-compute[73449]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 12:07:34 user nova-compute[73449]:       <nova:package version="0.0.0"/>
Aug 17 12:07:34 user nova-compute[73449]:       <nova:name>tempest-AttachVolumeTestJSON-server-460422634</nova:name>
Aug 17 12:07:34 user nova-compute[73449]:       <nova:creationTime>2023-08-17 12:07:32</nova:creationTime>
Aug 17 12:07:34 user nova-compute[73449]:       <nova:flavor name="m1.tiny">
Aug 17 12:07:34 user nova-compute[73449]:         <nova:memory>512</nova:memory>
Aug 17 12:07:34 user nova-compute[73449]:         <nova:disk>1</nova:disk>
Aug 17 12:07:34 user nova-compute[73449]:         <nova:swap>0</nova:swap>
Aug 17 12:07:34 user nova-compute[73449]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 12:07:34 user nova-compute[73449]:         <nova:vcpus>1</nova:vcpus>
Aug 17 12:07:34 user nova-compute[73449]:       </nova:flavor>
Aug 17 12:07:34 user nova-compute[73449]:       <nova:owner>
Aug 17 12:07:34 user nova-compute[73449]:         <nova:user uuid="9b21e7e411a54be0890ae7b0ca85d80c">tempest-AttachVolumeTestJSON-1035899549-project-member</nova:user>
Aug 17 12:07:34 user nova-compute[73449]:         <nova:project uuid="f2a2f7faf23147fba5270c844eac051a">tempest-AttachVolumeTestJSON-1035899549</nova:project>
Aug 17 12:07:34 user nova-compute[73449]:       </nova:owner>
Aug 17 12:07:34 user nova-compute[73449]:       <nova:root type="image" uuid="0a2904ae-083d-41c8-83db-343132b36148"/>
Aug 17 12:07:34 user nova-compute[73449]:       <nova:ports>
Aug 17 12:07:34 user nova-compute[73449]:         <nova:port uuid="f9f6066e-ddd2-4e41-b92a-5713cfb9a223">
Aug 17 12:07:34 user nova-compute[73449]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 17 12:07:34 user nova-compute[73449]:         </nova:port>
Aug 17 12:07:34 user nova-compute[73449]:       </nova:ports>
Aug 17 12:07:34 user nova-compute[73449]:     </nova:instance>
Aug 17 12:07:34 user nova-compute[73449]:   </metadata>
Aug 17 12:07:34 user nova-compute[73449]:   <sysinfo type="smbios">
Aug 17 12:07:34 user nova-compute[73449]:     <system>
Aug 17 12:07:34 user nova-compute[73449]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 12:07:34 user nova-compute[73449]:       <entry name="product">OpenStack Nova</entry>
Aug 17 12:07:34 user nova-compute[73449]:       <entry name="version">0.0.0</entry>
Aug 17 12:07:34 user nova-compute[73449]:       <entry name="serial">61201d5c-26f1-4c6d-a764-be2ee2e533ae</entry>
Aug 17 12:07:34 user nova-compute[73449]:       <entry name="uuid">61201d5c-26f1-4c6d-a764-be2ee2e533ae</entry>
Aug 17 12:07:34 user nova-compute[73449]:       <entry name="family">Virtual Machine</entry>
Aug 17 12:07:34 user nova-compute[73449]:     </system>
Aug 17 12:07:34 user nova-compute[73449]:   </sysinfo>
Aug 17 12:07:34 user nova-compute[73449]:   <os>
Aug 17 12:07:34 user nova-compute[73449]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 12:07:34 user nova-compute[73449]:     <boot dev="hd"/>
Aug 17 12:07:34 user nova-compute[73449]:     <smbios mode="sysinfo"/>
Aug 17 12:07:34 user nova-compute[73449]:   </os>
Aug 17 12:07:34 user nova-compute[73449]:   <features>
Aug 17 12:07:34 user nova-compute[73449]:     <acpi/>
Aug 17 12:07:34 user nova-compute[73449]:     <apic/>
Aug 17 12:07:34 user nova-compute[73449]:     <vmcoreinfo/>
Aug 17 12:07:34 user nova-compute[73449]:   </features>
Aug 17 12:07:34 user nova-compute[73449]:   <clock offset="utc">
Aug 17 12:07:34 user nova-compute[73449]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 12:07:34 user nova-compute[73449]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 12:07:34 user nova-compute[73449]:     <timer name="hpet" present="no"/>
Aug 17 12:07:34 user nova-compute[73449]:   </clock>
Aug 17 12:07:34 user nova-compute[73449]:   <cpu mode="custom" match="exact">
Aug 17 12:07:34 user nova-compute[73449]:     <model>Nehalem</model>
Aug 17 12:07:34 user nova-compute[73449]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 12:07:34 user nova-compute[73449]:   </cpu>
Aug 17 12:07:34 user nova-compute[73449]:   <devices>
Aug 17 12:07:34 user nova-compute[73449]:     <disk type="file" device="disk">
Aug 17 12:07:34 user nova-compute[73449]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 12:07:34 user nova-compute[73449]:       <source file="/opt/stack/data/nova/instances/61201d5c-26f1-4c6d-a764-be2ee2e533ae/disk"/>
Aug 17 12:07:34 user nova-compute[73449]:       <target dev="vda" bus="virtio"/>
Aug 17 12:07:34 user nova-compute[73449]:     </disk>
Aug 17 12:07:34 user nova-compute[73449]:     <disk type="block" device="disk">
Aug 17 12:07:34 user nova-compute[73449]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 12:07:34 user nova-compute[73449]:       <source dev="/dev/sdc"/>
Aug 17 12:07:34 user nova-compute[73449]:       <target dev="vdb" bus="virtio"/>
Aug 17 12:07:34 user nova-compute[73449]:       <serial>12aa960e-96d4-4bae-b7eb-209200c9ec49</serial>
Aug 17 12:07:34 user nova-compute[73449]:     </disk>
Aug 17 12:07:34 user nova-compute[73449]:     <interface type="ethernet">
Aug 17 12:07:34 user nova-compute[73449]:       <mac address="fa:16:3e:d2:c7:08"/>
Aug 17 12:07:34 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 12:07:34 user nova-compute[73449]:       <mtu size="1442"/>
Aug 17 12:07:34 user nova-compute[73449]:       <target dev="tapf9f6066e-dd"/>
Aug 17 12:07:34 user nova-compute[73449]:     </interface>
Aug 17 12:07:34 user nova-compute[73449]:     <serial type="pty">
Aug 17 12:07:34 user nova-compute[73449]:       <log file="/opt/stack/data/nova/instances/61201d5c-26f1-4c6d-a764-be2ee2e533ae/console.log" append="off"/>
Aug 17 12:07:34 user nova-compute[73449]:     </serial>
Aug 17 12:07:34 user nova-compute[73449]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 12:07:34 user nova-compute[73449]:     <video>
Aug 17 12:07:34 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 12:07:34 user nova-compute[73449]:     </video>
Aug 17 12:07:34 user nova-compute[73449]:     <rng model="virtio">
Aug 17 12:07:34 user nova-compute[73449]:       <backend model="random">/dev/urandom</backend>
Aug 17 12:07:34 user nova-compute[73449]:     </rng>
Aug 17 12:07:34 user nova-compute[73449]:     <controller type="usb" index="0" model="none"/>
Aug 17 12:07:34 user nova-compute[73449]:     <memballoon model="virtio">
Aug 17 12:07:34 user nova-compute[73449]:       <stats period="10"/>
Aug 17 12:07:34 user nova-compute[73449]:     </memballoon>
Aug 17 12:07:34 user nova-compute[73449]:   </devices>
Aug 17 12:07:34 user nova-compute[73449]: </domain>
Aug 17 12:07:34 user nova-compute[73449]:  {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 12:07:34 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-63102c87-00b7-4894-add5-8417c8588d26 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61201d5c-26f1-4c6d-a764-be2ee2e533ae/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:07:34 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-63102c87-00b7-4894-add5-8417c8588d26 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61201d5c-26f1-4c6d-a764-be2ee2e533ae/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:07:34 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-63102c87-00b7-4894-add5-8417c8588d26 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61201d5c-26f1-4c6d-a764-be2ee2e533ae/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:07:34 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-63102c87-00b7-4894-add5-8417c8588d26 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61201d5c-26f1-4c6d-a764-be2ee2e533ae/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:07:34 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-63102c87-00b7-4894-add5-8417c8588d26 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73449) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 12:07:34 user nova-compute[73449]: DEBUG nova.objects.instance [None req-63102c87-00b7-4894-add5-8417c8588d26 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Lazy-loading 'trusted_certs' on Instance uuid 61201d5c-26f1-4c6d-a764-be2ee2e533ae {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:07:34 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-63102c87-00b7-4894-add5-8417c8588d26 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:07:34 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-63102c87-00b7-4894-add5-8417c8588d26 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json" returned: 0 in 0.175s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:07:34 user nova-compute[73449]: DEBUG nova.virt.disk.api [None req-63102c87-00b7-4894-add5-8417c8588d26 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Checking if we can resize image /opt/stack/data/nova/instances/61201d5c-26f1-4c6d-a764-be2ee2e533ae/disk. size=1073741824 {{(pid=73449) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 12:07:34 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-63102c87-00b7-4894-add5-8417c8588d26 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61201d5c-26f1-4c6d-a764-be2ee2e533ae/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:07:34 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-63102c87-00b7-4894-add5-8417c8588d26 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61201d5c-26f1-4c6d-a764-be2ee2e533ae/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:07:34 user nova-compute[73449]: DEBUG nova.virt.disk.api [None req-63102c87-00b7-4894-add5-8417c8588d26 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Cannot resize image /opt/stack/data/nova/instances/61201d5c-26f1-4c6d-a764-be2ee2e533ae/disk to a smaller size. {{(pid=73449) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 12:07:34 user nova-compute[73449]: DEBUG nova.objects.instance [None req-63102c87-00b7-4894-add5-8417c8588d26 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Lazy-loading 'migration_context' on Instance uuid 61201d5c-26f1-4c6d-a764-be2ee2e533ae {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:07:34 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-63102c87-00b7-4894-add5-8417c8588d26 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T12:03:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-460422634',display_name='tempest-AttachVolumeTestJSON-server-460422634',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-460422634',id=45,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNXw3KLSoC9Q0XBnEpzlvGLEU4aQOJ/QynPahuU7gv/dPY1PMhUmMgpw0sT/09d1GxZ/bLO+3BhHXGsw2GJhA2bjtLfUrL+5y9epJ9Io8OYn3n51dk0dquYLKVxFrx0m8Q==',key_name='tempest-keypair-402233619',keypairs=<?>,launch_index=0,launched_at=2023-08-17T12:03:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='f2a2f7faf23147fba5270c844eac051a',ramdisk_id='',reservation_id='r-arnh7g7d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1035899549',owner_user_name='tempest-AttachVolumeTestJSON-1035899549-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T12:05:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9b21e7e411a54be0890ae7b0ca85d80c',uuid=61201d5c-26f1-4c6d-a764-be2ee2e533ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "f9f6066e-ddd2-4e41-b92a-5713cfb9a223", "address": "fa:16:3e:d2:c7:08", "network": {"id": "2ead35b7-4013-4fab-b35f-02f3237fcac1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1887618888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2a2f7faf23147fba5270c844eac051a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9f6066e-dd", "ovs_interfaceid": "f9f6066e-ddd2-4e41-b92a-5713cfb9a223", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 12:07:34 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-63102c87-00b7-4894-add5-8417c8588d26 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Converting VIF {"id": "f9f6066e-ddd2-4e41-b92a-5713cfb9a223", "address": "fa:16:3e:d2:c7:08", "network": {"id": "2ead35b7-4013-4fab-b35f-02f3237fcac1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1887618888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2a2f7faf23147fba5270c844eac051a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9f6066e-dd", "ovs_interfaceid": "f9f6066e-ddd2-4e41-b92a-5713cfb9a223", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 12:07:34 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-63102c87-00b7-4894-add5-8417c8588d26 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:c7:08,bridge_name='br-int',has_traffic_filtering=True,id=f9f6066e-ddd2-4e41-b92a-5713cfb9a223,network=Network(2ead35b7-4013-4fab-b35f-02f3237fcac1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9f6066e-dd') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 12:07:34 user nova-compute[73449]: DEBUG os_vif [None req-63102c87-00b7-4894-add5-8417c8588d26 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:c7:08,bridge_name='br-int',has_traffic_filtering=True,id=f9f6066e-ddd2-4e41-b92a-5713cfb9a223,network=Network(2ead35b7-4013-4fab-b35f-02f3237fcac1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9f6066e-dd') {{(pid=73449) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 12:07:34 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:07:34 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 12:07:34 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 12:07:34 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:07:34 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf9f6066e-dd, may_exist=True, interface_attrs={}) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 12:07:34 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf9f6066e-dd, col_values=(('external_ids', {'iface-id': 'f9f6066e-ddd2-4e41-b92a-5713cfb9a223', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d2:c7:08', 'vm-uuid': '61201d5c-26f1-4c6d-a764-be2ee2e533ae'}),), if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 12:07:34 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:07:34 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:07:34 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:07:34 user nova-compute[73449]: INFO os_vif [None req-63102c87-00b7-4894-add5-8417c8588d26 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:c7:08,bridge_name='br-int',has_traffic_filtering=True,id=f9f6066e-ddd2-4e41-b92a-5713cfb9a223,network=Network(2ead35b7-4013-4fab-b35f-02f3237fcac1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9f6066e-dd')
Aug 17 12:07:35 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-e33f6628-230e-44b1-888e-d03a007b8358 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Acquiring lock "5a627da9-03a1-4239-8721-cefe99c39ee2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:07:35 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-e33f6628-230e-44b1-888e-d03a007b8358 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Lock "5a627da9-03a1-4239-8721-cefe99c39ee2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:07:35 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-e33f6628-230e-44b1-888e-d03a007b8358 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Acquiring lock "5a627da9-03a1-4239-8721-cefe99c39ee2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:07:35 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-e33f6628-230e-44b1-888e-d03a007b8358 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Lock "5a627da9-03a1-4239-8721-cefe99c39ee2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:07:35 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-e33f6628-230e-44b1-888e-d03a007b8358 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Lock "5a627da9-03a1-4239-8721-cefe99c39ee2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:07:35 user nova-compute[73449]: INFO nova.compute.manager [None req-e33f6628-230e-44b1-888e-d03a007b8358 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] Terminating instance
Aug 17 12:07:35 user nova-compute[73449]: DEBUG nova.compute.manager [None req-e33f6628-230e-44b1-888e-d03a007b8358 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] Start destroying the instance on the hypervisor. {{(pid=73449) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 12:07:35 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:07:35 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:07:35 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:07:35 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:07:35 user nova-compute[73449]: DEBUG nova.compute.manager [req-d39a9ee9-0a9d-49f7-b2fb-5eeee1f6ddd6 req-50d93df5-addf-48ae-8be7-6ca3c9f963db service nova] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] Received event network-vif-unplugged-69831639-3628-4b42-8ddd-fe0965dea4b6 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:07:35 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-d39a9ee9-0a9d-49f7-b2fb-5eeee1f6ddd6 req-50d93df5-addf-48ae-8be7-6ca3c9f963db service nova] Acquiring lock "5a627da9-03a1-4239-8721-cefe99c39ee2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:07:35 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-d39a9ee9-0a9d-49f7-b2fb-5eeee1f6ddd6 req-50d93df5-addf-48ae-8be7-6ca3c9f963db service nova] Lock "5a627da9-03a1-4239-8721-cefe99c39ee2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:07:35 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-d39a9ee9-0a9d-49f7-b2fb-5eeee1f6ddd6 req-50d93df5-addf-48ae-8be7-6ca3c9f963db service nova] Lock "5a627da9-03a1-4239-8721-cefe99c39ee2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:07:35 user nova-compute[73449]: DEBUG nova.compute.manager [req-d39a9ee9-0a9d-49f7-b2fb-5eeee1f6ddd6 req-50d93df5-addf-48ae-8be7-6ca3c9f963db service nova] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] No waiting events found dispatching network-vif-unplugged-69831639-3628-4b42-8ddd-fe0965dea4b6 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 12:07:35 user nova-compute[73449]: DEBUG nova.compute.manager [req-d39a9ee9-0a9d-49f7-b2fb-5eeee1f6ddd6 req-50d93df5-addf-48ae-8be7-6ca3c9f963db service nova] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] Received event network-vif-unplugged-69831639-3628-4b42-8ddd-fe0965dea4b6 for instance with task_state deleting. {{(pid=73449) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 12:07:36 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] Instance destroyed successfully.
Aug 17 12:07:36 user nova-compute[73449]: DEBUG nova.objects.instance [None req-e33f6628-230e-44b1-888e-d03a007b8358 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Lazy-loading 'resources' on Instance uuid 5a627da9-03a1-4239-8721-cefe99c39ee2 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:07:36 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-e33f6628-230e-44b1-888e-d03a007b8358 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T12:02:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1061317430',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1061317430',id=43,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T12:04:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4ec3b0b72e47448ebe99f9fc64119c1c',ramdisk_id='',reservation_id='r-ibt4mle4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1818019421',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T12:05:50Z,user_data=None,user_id='14eb3826311a4f8f91d8264e87f7b866',uuid=5a627da9-03a1-4239-8721-cefe99c39ee2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "69831639-3628-4b42-8ddd-fe0965dea4b6", "address": "fa:16:3e:de:22:d6", "network": {"id": "9455bb75-f75a-41ff-8f6f-49f55aa738f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-425274599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec3b0b72e47448ebe99f9fc64119c1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69831639-36", "ovs_interfaceid": "69831639-3628-4b42-8ddd-fe0965dea4b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 12:07:36 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-e33f6628-230e-44b1-888e-d03a007b8358 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Converting VIF {"id": "69831639-3628-4b42-8ddd-fe0965dea4b6", "address": "fa:16:3e:de:22:d6", "network": {"id": "9455bb75-f75a-41ff-8f6f-49f55aa738f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-425274599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec3b0b72e47448ebe99f9fc64119c1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69831639-36", "ovs_interfaceid": "69831639-3628-4b42-8ddd-fe0965dea4b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 12:07:36 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-e33f6628-230e-44b1-888e-d03a007b8358 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:de:22:d6,bridge_name='br-int',has_traffic_filtering=True,id=69831639-3628-4b42-8ddd-fe0965dea4b6,network=Network(9455bb75-f75a-41ff-8f6f-49f55aa738f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69831639-36') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 12:07:36 user nova-compute[73449]: DEBUG os_vif [None req-e33f6628-230e-44b1-888e-d03a007b8358 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:22:d6,bridge_name='br-int',has_traffic_filtering=True,id=69831639-3628-4b42-8ddd-fe0965dea4b6,network=Network(9455bb75-f75a-41ff-8f6f-49f55aa738f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69831639-36') {{(pid=73449) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 12:07:36 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:07:36 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap69831639-36, bridge=br-int, if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 12:07:36 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:07:36 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:07:36 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:07:36 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:07:36 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:07:36 user nova-compute[73449]: INFO os_vif [None req-e33f6628-230e-44b1-888e-d03a007b8358 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:22:d6,bridge_name='br-int',has_traffic_filtering=True,id=69831639-3628-4b42-8ddd-fe0965dea4b6,network=Network(9455bb75-f75a-41ff-8f6f-49f55aa738f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69831639-36')
Aug 17 12:07:36 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e33f6628-230e-44b1-888e-d03a007b8358 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] calling os-brick to detach iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 12:07:36 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-e33f6628-230e-44b1-888e-d03a007b8358 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, {'target_iqns': ['iqn.2010-10.org.openstack:8314fb1e-61f9-44b5-b944-5a94677724c8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QnosROjY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 12:07:36 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-e33f6628-230e-44b1-888e-d03a007b8358 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 12:07:36 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-e33f6628-230e-44b1-888e-d03a007b8358 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 12:07:36 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-e33f6628-230e-44b1-888e-d03a007b8358 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 12:07:36 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-e33f6628-230e-44b1-888e-d03a007b8358 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8314fb1e-61f9-44b5-b944-5a94677724c8', 0)] {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 12:07:36 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:07:36 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:07:36 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[66d1a53f-0733-4203-bdaa-5eb5d52674e9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8314fb1e-61f9-44b5-b944-5a94677724c8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:07:36 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:07:36 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:07:36 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeae33a2-530d-40d8-9f97-23f1fc6efbab]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8314fb1e-61f9-44b5-b944-5a94677724c8 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49 (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:07:36 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-e33f6628-230e-44b1-888e-d03a007b8358 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)
Aug 17 12:07:36 user nova-compute[73449]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8314fb1e-61f9-44b5-b944-5a94677724c8 (non-flash)
Aug 17 12:07:36 user nova-compute[73449]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49 (non-flash)
Aug 17 12:07:36 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 12:07:36 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-e33f6628-230e-44b1-888e-d03a007b8358 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)
Aug 17 12:07:36 user nova-compute[73449]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8314fb1e-61f9-44b5-b944-5a94677724c8 (non-flash)
Aug 17 12:07:36 user nova-compute[73449]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49 (non-flash)
Aug 17 12:07:36 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 12:07:36 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-e33f6628-230e-44b1-888e-d03a007b8358 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe7782af910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8314fb1e-61f9-44b5-b944-5a94677724c8'): ({'sdb'}, set())}) {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 12:07:36 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-e33f6628-230e-44b1-888e-d03a007b8358 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Removing single pathed devices sdb {{(pid=73449) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 12:07:36 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:07:36 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:07:36 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0e41d68-3e65-412c-bd58-a078de2a1060]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:07:36 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:07:36 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:07:36 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfa393d4-868f-49b0-af9a-301d3ac9bb99]: (4, ('ok\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:07:36 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-e33f6628-230e-44b1-888e-d03a007b8358 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Flushing IO for device /dev/sdb {{(pid=73449) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 12:07:36 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:07:36 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:07:36 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[45ffe945-97b4-405f-9c86-35e0b4cce937]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:07:36 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-e33f6628-230e-44b1-888e-d03a007b8358 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73449) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 12:07:36 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:07:36 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.215s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:07:36 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3b91e7c-c657-4b07-96b3-01d3784c8906]: (4, ('1', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:07:36 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-e33f6628-230e-44b1-888e-d03a007b8358 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73449) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 12:07:36 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-e33f6628-230e-44b1-888e-d03a007b8358 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] SCSI volumes sdb have been removed. {{(pid=73449) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 12:07:36 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-e33f6628-230e-44b1-888e-d03a007b8358 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8314fb1e-61f9-44b5-b944-5a94677724c8')] {{(pid=73449) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 12:07:36 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8314fb1e-61f9-44b5-b944-5a94677724c8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:07:37 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8314fb1e-61f9-44b5-b944-5a94677724c8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:07:37 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a40ed8b-56c8-4883-a374-7942c11db9da]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:07:37 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-e33f6628-230e-44b1-888e-d03a007b8358 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:07:37 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8314fb1e-61f9-44b5-b944-5a94677724c8 -p 172.16.0.220:3260 --logout {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:07:37 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8314fb1e-61f9-44b5-b944-5a94677724c8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:07:37 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f7cadd0-27db-43c4-8184-7dc311833fcd]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:8314fb1e-61f9-44b5-b944-5a94677724c8, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:8314fb1e-61f9-44b5-b944-5a94677724c8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:07:37 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-e33f6628-230e-44b1-888e-d03a007b8358 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:8314fb1e-61f9-44b5-b944-5a94677724c8, portal: 172.16.0.220,3260]
Aug 17 12:07:37 user nova-compute[73449]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:8314fb1e-61f9-44b5-b944-5a94677724c8, portal: 172.16.0.220,3260] successful.
Aug 17 12:07:37 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:07:37 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8314fb1e-61f9-44b5-b944-5a94677724c8 -p 172.16.0.220:3260 --op delete {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:07:37 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8314fb1e-61f9-44b5-b944-5a94677724c8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:07:37 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[67d9f7f8-8978-40f1-844e-68361a903b66]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:07:37 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-e33f6628-230e-44b1-888e-d03a007b8358 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:07:37 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-e33f6628-230e-44b1-888e-d03a007b8358 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.522s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 12:07:37 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-e33f6628-230e-44b1-888e-d03a007b8358 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] <== disconnect_volume: return (523ms) None {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 12:07:37 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e33f6628-230e-44b1-888e-d03a007b8358 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] Disconnected iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 12:07:37 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-e33f6628-230e-44b1-888e-d03a007b8358 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] Deleting instance files /opt/stack/data/nova/instances/5a627da9-03a1-4239-8721-cefe99c39ee2_del
Aug 17 12:07:37 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-e33f6628-230e-44b1-888e-d03a007b8358 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] Deletion of /opt/stack/data/nova/instances/5a627da9-03a1-4239-8721-cefe99c39ee2_del complete
Aug 17 12:07:37 user nova-compute[73449]: INFO nova.compute.manager [None req-e33f6628-230e-44b1-888e-d03a007b8358 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] Took 1.83 seconds to destroy the instance on the hypervisor.
Aug 17 12:07:37 user nova-compute[73449]: DEBUG oslo.service.loopingcall [None req-e33f6628-230e-44b1-888e-d03a007b8358 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73449) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 12:07:37 user nova-compute[73449]: DEBUG nova.compute.manager [-] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] Deallocating network for instance {{(pid=73449) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 12:07:37 user nova-compute[73449]: DEBUG nova.network.neutron [-] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] deallocate_for_instance() {{(pid=73449) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 12:07:37 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:07:37 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:07:37 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:07:37 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:07:37 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:07:37 user nova-compute[73449]: DEBUG nova.compute.manager [req-a4890067-5ead-475c-a2a2-5ddebac6ee4d req-584b2968-4ff4-484f-b815-8c68ae6b8ff6 service nova] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] Received event network-vif-plugged-69831639-3628-4b42-8ddd-fe0965dea4b6 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:07:37 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-a4890067-5ead-475c-a2a2-5ddebac6ee4d req-584b2968-4ff4-484f-b815-8c68ae6b8ff6 service nova] Acquiring lock "5a627da9-03a1-4239-8721-cefe99c39ee2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:07:37 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-a4890067-5ead-475c-a2a2-5ddebac6ee4d req-584b2968-4ff4-484f-b815-8c68ae6b8ff6 service nova] Lock "5a627da9-03a1-4239-8721-cefe99c39ee2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:07:37 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-a4890067-5ead-475c-a2a2-5ddebac6ee4d req-584b2968-4ff4-484f-b815-8c68ae6b8ff6 service nova] Lock "5a627da9-03a1-4239-8721-cefe99c39ee2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:07:37 user nova-compute[73449]: DEBUG nova.compute.manager [req-a4890067-5ead-475c-a2a2-5ddebac6ee4d req-584b2968-4ff4-484f-b815-8c68ae6b8ff6 service nova] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] No waiting events found dispatching network-vif-plugged-69831639-3628-4b42-8ddd-fe0965dea4b6 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 12:07:37 user nova-compute[73449]: WARNING nova.compute.manager [req-a4890067-5ead-475c-a2a2-5ddebac6ee4d req-584b2968-4ff4-484f-b815-8c68ae6b8ff6 service nova] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] Received unexpected event network-vif-plugged-69831639-3628-4b42-8ddd-fe0965dea4b6 for instance with vm_state active and task_state deleting.
Aug 17 12:07:37 user nova-compute[73449]: DEBUG nova.compute.manager [req-a4890067-5ead-475c-a2a2-5ddebac6ee4d req-584b2968-4ff4-484f-b815-8c68ae6b8ff6 service nova] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Received event network-vif-plugged-f9f6066e-ddd2-4e41-b92a-5713cfb9a223 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:07:37 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-a4890067-5ead-475c-a2a2-5ddebac6ee4d req-584b2968-4ff4-484f-b815-8c68ae6b8ff6 service nova] Acquiring lock "61201d5c-26f1-4c6d-a764-be2ee2e533ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:07:37 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-a4890067-5ead-475c-a2a2-5ddebac6ee4d req-584b2968-4ff4-484f-b815-8c68ae6b8ff6 service nova] Lock "61201d5c-26f1-4c6d-a764-be2ee2e533ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:07:37 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-a4890067-5ead-475c-a2a2-5ddebac6ee4d req-584b2968-4ff4-484f-b815-8c68ae6b8ff6 service nova] Lock "61201d5c-26f1-4c6d-a764-be2ee2e533ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:07:37 user nova-compute[73449]: DEBUG nova.compute.manager [req-a4890067-5ead-475c-a2a2-5ddebac6ee4d req-584b2968-4ff4-484f-b815-8c68ae6b8ff6 service nova] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] No waiting events found dispatching network-vif-plugged-f9f6066e-ddd2-4e41-b92a-5713cfb9a223 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 12:07:37 user nova-compute[73449]: WARNING nova.compute.manager [req-a4890067-5ead-475c-a2a2-5ddebac6ee4d req-584b2968-4ff4-484f-b815-8c68ae6b8ff6 service nova] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Received unexpected event network-vif-plugged-f9f6066e-ddd2-4e41-b92a-5713cfb9a223 for instance with vm_state stopped and task_state powering-on.
Aug 17 12:07:37 user nova-compute[73449]: DEBUG nova.compute.manager [req-a4890067-5ead-475c-a2a2-5ddebac6ee4d req-584b2968-4ff4-484f-b815-8c68ae6b8ff6 service nova] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Received event network-vif-plugged-f9f6066e-ddd2-4e41-b92a-5713cfb9a223 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:07:37 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-a4890067-5ead-475c-a2a2-5ddebac6ee4d req-584b2968-4ff4-484f-b815-8c68ae6b8ff6 service nova] Acquiring lock "61201d5c-26f1-4c6d-a764-be2ee2e533ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:07:37 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-a4890067-5ead-475c-a2a2-5ddebac6ee4d req-584b2968-4ff4-484f-b815-8c68ae6b8ff6 service nova] Lock "61201d5c-26f1-4c6d-a764-be2ee2e533ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:07:37 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-a4890067-5ead-475c-a2a2-5ddebac6ee4d req-584b2968-4ff4-484f-b815-8c68ae6b8ff6 service nova] Lock "61201d5c-26f1-4c6d-a764-be2ee2e533ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:07:37 user nova-compute[73449]: DEBUG nova.compute.manager [req-a4890067-5ead-475c-a2a2-5ddebac6ee4d req-584b2968-4ff4-484f-b815-8c68ae6b8ff6 service nova] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] No waiting events found dispatching network-vif-plugged-f9f6066e-ddd2-4e41-b92a-5713cfb9a223 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 12:07:37 user nova-compute[73449]: WARNING nova.compute.manager [req-a4890067-5ead-475c-a2a2-5ddebac6ee4d req-584b2968-4ff4-484f-b815-8c68ae6b8ff6 service nova] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Received unexpected event network-vif-plugged-f9f6066e-ddd2-4e41-b92a-5713cfb9a223 for instance with vm_state stopped and task_state powering-on.
Aug 17 12:07:38 user nova-compute[73449]: DEBUG nova.network.neutron [-] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] Updating instance_info_cache with network_info: [] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 12:07:38 user nova-compute[73449]: INFO nova.compute.manager [-] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] Took 0.95 seconds to deallocate network for instance.
Aug 17 12:07:38 user nova-compute[73449]: DEBUG nova.compute.manager [req-3b945aaa-31fc-497c-9e25-0298e60a7d67 req-81c97658-9573-4a63-8664-134926ab54e8 service nova] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] Received event network-vif-deleted-69831639-3628-4b42-8ddd-fe0965dea4b6 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:07:38 user nova-compute[73449]: INFO nova.compute.manager [req-3b945aaa-31fc-497c-9e25-0298e60a7d67 req-81c97658-9573-4a63-8664-134926ab54e8 service nova] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] Neutron deleted interface 69831639-3628-4b42-8ddd-fe0965dea4b6; detaching it from the instance and deleting it from the info cache
Aug 17 12:07:38 user nova-compute[73449]: DEBUG nova.network.neutron [req-3b945aaa-31fc-497c-9e25-0298e60a7d67 req-81c97658-9573-4a63-8664-134926ab54e8 service nova] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] Updating instance_info_cache with network_info: [] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 12:07:38 user nova-compute[73449]: DEBUG nova.compute.manager [req-3b945aaa-31fc-497c-9e25-0298e60a7d67 req-81c97658-9573-4a63-8664-134926ab54e8 service nova] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] Detach interface failed, port_id=69831639-3628-4b42-8ddd-fe0965dea4b6, reason: Instance 5a627da9-03a1-4239-8721-cefe99c39ee2 could not be found. {{(pid=73449) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 12:07:38 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:07:38 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692274058.8871455, 61201d5c-26f1-4c6d-a764-be2ee2e533ae => Resumed> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 12:07:38 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] VM Resumed (Lifecycle Event)
Aug 17 12:07:38 user nova-compute[73449]: DEBUG nova.compute.manager [None req-63102c87-00b7-4894-add5-8417c8588d26 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Instance event wait completed in 0 seconds for  {{(pid=73449) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 12:07:38 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Instance rebooted successfully.
Aug 17 12:07:38 user nova-compute[73449]: DEBUG nova.compute.manager [None req-63102c87-00b7-4894-add5-8417c8588d26 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 12:07:38 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 12:07:38 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 12:07:38 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 17 12:07:38 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692274058.8888807, 61201d5c-26f1-4c6d-a764-be2ee2e533ae => Started> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 12:07:38 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] VM Started (Lifecycle Event)
Aug 17 12:07:38 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 12:07:38 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 12:07:39 user nova-compute[73449]: INFO nova.compute.manager [None req-e33f6628-230e-44b1-888e-d03a007b8358 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] Took 0.84 seconds to detach 1 volumes for instance.
Aug 17 12:07:39 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-e33f6628-230e-44b1-888e-d03a007b8358 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:07:39 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-e33f6628-230e-44b1-888e-d03a007b8358 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:07:39 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-e33f6628-230e-44b1-888e-d03a007b8358 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 12:07:39 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-e33f6628-230e-44b1-888e-d03a007b8358 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 12:07:39 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-e33f6628-230e-44b1-888e-d03a007b8358 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.344s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:07:39 user nova-compute[73449]: INFO nova.scheduler.client.report [None req-e33f6628-230e-44b1-888e-d03a007b8358 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Deleted allocations for instance 5a627da9-03a1-4239-8721-cefe99c39ee2
Aug 17 12:07:39 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-e33f6628-230e-44b1-888e-d03a007b8358 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Lock "5a627da9-03a1-4239-8721-cefe99c39ee2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.161s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:07:40 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:07:41 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:07:43 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:07:46 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:07:48 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:07:51 user nova-compute[73449]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692274056.453062, 5a627da9-03a1-4239-8721-cefe99c39ee2 => Stopped> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 12:07:51 user nova-compute[73449]: INFO nova.compute.manager [-] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] VM Stopped (Lifecycle Event)
Aug 17 12:07:51 user nova-compute[73449]: DEBUG nova.compute.manager [None req-17d0270d-3a2e-480a-ac94-cbb444f4107d None None] [instance: 5a627da9-03a1-4239-8721-cefe99c39ee2] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 12:07:51 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:07:53 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:07:56 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:07:58 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:08:01 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:08:03 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:08:04 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:08:06 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:08:07 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:08:07 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:08:08 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:08:09 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:08:09 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73449) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 12:08:11 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:08:11 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:08:13 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:08:14 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:08:16 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:08:17 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:08:17 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:08:17 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:08:17 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:08:17 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=73449) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 12:08:18 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/712c777e-251b-43d8-b923-8eda693f32ed/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:08:18 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/712c777e-251b-43d8-b923-8eda693f32ed/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:08:18 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/712c777e-251b-43d8-b923-8eda693f32ed/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:08:18 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/712c777e-251b-43d8-b923-8eda693f32ed/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:08:18 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54c69eab-3597-4ca7-b698-169538b73a18/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:08:18 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54c69eab-3597-4ca7-b698-169538b73a18/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:08:18 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54c69eab-3597-4ca7-b698-169538b73a18/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:08:18 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54c69eab-3597-4ca7-b698-169538b73a18/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:08:18 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f607caf8-0910-4214-b2f7-ccd59cd0307a/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:08:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f607caf8-0910-4214-b2f7-ccd59cd0307a/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:08:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f607caf8-0910-4214-b2f7-ccd59cd0307a/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:08:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f607caf8-0910-4214-b2f7-ccd59cd0307a/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:08:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fdfaf32-0957-453a-b1cf-9a3c19815c45/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:08:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fdfaf32-0957-453a-b1cf-9a3c19815c45/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:08:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fdfaf32-0957-453a-b1cf-9a3c19815c45/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:08:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fdfaf32-0957-453a-b1cf-9a3c19815c45/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:08:19 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73449) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 12:08:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89440604-1daf-4e7a-a524-2f9c21a9cb96/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:08:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89440604-1daf-4e7a-a524-2f9c21a9cb96/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:08:19 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89440604-1daf-4e7a-a524-2f9c21a9cb96/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:08:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89440604-1daf-4e7a-a524-2f9c21a9cb96/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:08:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61201d5c-26f1-4c6d-a764-be2ee2e533ae/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:08:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61201d5c-26f1-4c6d-a764-be2ee2e533ae/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:08:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61201d5c-26f1-4c6d-a764-be2ee2e533ae/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:08:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61201d5c-26f1-4c6d-a764-be2ee2e533ae/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:08:20 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73449) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 12:08:20 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 12:08:20 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 12:08:20 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Hypervisor/Node resource view: name=user free_ram=7880MB free_disk=24.69292449951172GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73449) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 12:08:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:08:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:08:21 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 89440604-1daf-4e7a-a524-2f9c21a9cb96 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 12:08:21 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 31f5f3d2-41d8-4a26-9eb2-18b891f94734 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 12:08:21 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 712c777e-251b-43d8-b923-8eda693f32ed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 12:08:21 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 61201d5c-26f1-4c6d-a764-be2ee2e533ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 12:08:21 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 8fdfaf32-0957-453a-b1cf-9a3c19815c45 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 12:08:21 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 54c69eab-3597-4ca7-b698-169538b73a18 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 12:08:21 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance f607caf8-0910-4214-b2f7-ccd59cd0307a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 12:08:21 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=73449) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 12:08:21 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=73449) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 12:08:21 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 12:08:21 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 12:08:21 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Compute_service record updated for user:user {{(pid=73449) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 12:08:21 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.364s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:08:21 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:08:24 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:08:24 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Starting heal instance info cache {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 12:08:24 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "refresh_cache-61201d5c-26f1-4c6d-a764-be2ee2e533ae" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 12:08:24 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquired lock "refresh_cache-61201d5c-26f1-4c6d-a764-be2ee2e533ae" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 12:08:24 user nova-compute[73449]: DEBUG nova.network.neutron [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Forcefully refreshing network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 12:08:25 user nova-compute[73449]: DEBUG nova.network.neutron [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Updating instance_info_cache with network_info: [{"id": "f9f6066e-ddd2-4e41-b92a-5713cfb9a223", "address": "fa:16:3e:d2:c7:08", "network": {"id": "2ead35b7-4013-4fab-b35f-02f3237fcac1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1887618888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2a2f7faf23147fba5270c844eac051a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9f6066e-dd", "ovs_interfaceid": "f9f6066e-ddd2-4e41-b92a-5713cfb9a223", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 12:08:25 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Releasing lock "refresh_cache-61201d5c-26f1-4c6d-a764-be2ee2e533ae" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 12:08:25 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Updated the network info_cache for instance {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 12:08:25 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:08:26 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-f6fb911b-226c-427c-8176-119de3da14c1 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Acquiring lock "712c777e-251b-43d8-b923-8eda693f32ed" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:08:26 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-f6fb911b-226c-427c-8176-119de3da14c1 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Lock "712c777e-251b-43d8-b923-8eda693f32ed" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:08:26 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-f6fb911b-226c-427c-8176-119de3da14c1 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Acquiring lock "712c777e-251b-43d8-b923-8eda693f32ed-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:08:26 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-f6fb911b-226c-427c-8176-119de3da14c1 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Lock "712c777e-251b-43d8-b923-8eda693f32ed-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:08:26 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-f6fb911b-226c-427c-8176-119de3da14c1 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Lock "712c777e-251b-43d8-b923-8eda693f32ed-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:08:26 user nova-compute[73449]: INFO nova.compute.manager [None req-f6fb911b-226c-427c-8176-119de3da14c1 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 712c777e-251b-43d8-b923-8eda693f32ed] Terminating instance
Aug 17 12:08:26 user nova-compute[73449]: DEBUG nova.compute.manager [None req-f6fb911b-226c-427c-8176-119de3da14c1 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 712c777e-251b-43d8-b923-8eda693f32ed] Start destroying the instance on the hypervisor. {{(pid=73449) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 12:08:26 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:08:26 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:08:26 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:08:26 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:08:26 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:08:26 user nova-compute[73449]: DEBUG nova.compute.manager [req-e2f5e7a5-0e01-4295-9ee3-c175bd3a8efe req-816bedf0-6ebf-4622-ae08-67d921f06649 service nova] [instance: 712c777e-251b-43d8-b923-8eda693f32ed] Received event network-vif-unplugged-b1a278b5-bdf7-4803-bbff-96579cf1fbd8 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:08:26 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-e2f5e7a5-0e01-4295-9ee3-c175bd3a8efe req-816bedf0-6ebf-4622-ae08-67d921f06649 service nova] Acquiring lock "712c777e-251b-43d8-b923-8eda693f32ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:08:26 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-e2f5e7a5-0e01-4295-9ee3-c175bd3a8efe req-816bedf0-6ebf-4622-ae08-67d921f06649 service nova] Lock "712c777e-251b-43d8-b923-8eda693f32ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:08:26 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-e2f5e7a5-0e01-4295-9ee3-c175bd3a8efe req-816bedf0-6ebf-4622-ae08-67d921f06649 service nova] Lock "712c777e-251b-43d8-b923-8eda693f32ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:08:26 user nova-compute[73449]: DEBUG nova.compute.manager [req-e2f5e7a5-0e01-4295-9ee3-c175bd3a8efe req-816bedf0-6ebf-4622-ae08-67d921f06649 service nova] [instance: 712c777e-251b-43d8-b923-8eda693f32ed] No waiting events found dispatching network-vif-unplugged-b1a278b5-bdf7-4803-bbff-96579cf1fbd8 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 12:08:26 user nova-compute[73449]: DEBUG nova.compute.manager [req-e2f5e7a5-0e01-4295-9ee3-c175bd3a8efe req-816bedf0-6ebf-4622-ae08-67d921f06649 service nova] [instance: 712c777e-251b-43d8-b923-8eda693f32ed] Received event network-vif-unplugged-b1a278b5-bdf7-4803-bbff-96579cf1fbd8 for instance with task_state deleting. {{(pid=73449) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 12:08:27 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: 712c777e-251b-43d8-b923-8eda693f32ed] Instance destroyed successfully.
Aug 17 12:08:27 user nova-compute[73449]: DEBUG nova.objects.instance [None req-f6fb911b-226c-427c-8176-119de3da14c1 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Lazy-loading 'resources' on Instance uuid 712c777e-251b-43d8-b923-8eda693f32ed {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:08:27 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:08:27 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-f6fb911b-226c-427c-8176-119de3da14c1 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:59:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1778504664',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1778504664',id=40,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T11:59:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4ec3b0b72e47448ebe99f9fc64119c1c',ramdisk_id='',reservation_id='r-ijc8zsq1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1818019421',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T12:01:00Z,user_data=None,user_id='14eb3826311a4f8f91d8264e87f7b866',uuid=712c777e-251b-43d8-b923-8eda693f32ed,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b1a278b5-bdf7-4803-bbff-96579cf1fbd8", "address": "fa:16:3e:0e:47:73", "network": {"id": "9455bb75-f75a-41ff-8f6f-49f55aa738f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-425274599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec3b0b72e47448ebe99f9fc64119c1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1a278b5-bd", "ovs_interfaceid": "b1a278b5-bdf7-4803-bbff-96579cf1fbd8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 12:08:27 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-f6fb911b-226c-427c-8176-119de3da14c1 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Converting VIF {"id": "b1a278b5-bdf7-4803-bbff-96579cf1fbd8", "address": "fa:16:3e:0e:47:73", "network": {"id": "9455bb75-f75a-41ff-8f6f-49f55aa738f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-425274599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec3b0b72e47448ebe99f9fc64119c1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1a278b5-bd", "ovs_interfaceid": "b1a278b5-bdf7-4803-bbff-96579cf1fbd8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 12:08:27 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-f6fb911b-226c-427c-8176-119de3da14c1 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0e:47:73,bridge_name='br-int',has_traffic_filtering=True,id=b1a278b5-bdf7-4803-bbff-96579cf1fbd8,network=Network(9455bb75-f75a-41ff-8f6f-49f55aa738f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1a278b5-bd') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 12:08:27 user nova-compute[73449]: DEBUG os_vif [None req-f6fb911b-226c-427c-8176-119de3da14c1 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0e:47:73,bridge_name='br-int',has_traffic_filtering=True,id=b1a278b5-bdf7-4803-bbff-96579cf1fbd8,network=Network(9455bb75-f75a-41ff-8f6f-49f55aa738f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1a278b5-bd') {{(pid=73449) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 12:08:27 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:08:27 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb1a278b5-bd, bridge=br-int, if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 12:08:27 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:08:27 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:08:27 user nova-compute[73449]: INFO os_vif [None req-f6fb911b-226c-427c-8176-119de3da14c1 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0e:47:73,bridge_name='br-int',has_traffic_filtering=True,id=b1a278b5-bdf7-4803-bbff-96579cf1fbd8,network=Network(9455bb75-f75a-41ff-8f6f-49f55aa738f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1a278b5-bd')
Aug 17 12:08:27 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-f6fb911b-226c-427c-8176-119de3da14c1 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 712c777e-251b-43d8-b923-8eda693f32ed] Deleting instance files /opt/stack/data/nova/instances/712c777e-251b-43d8-b923-8eda693f32ed_del
Aug 17 12:08:27 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-f6fb911b-226c-427c-8176-119de3da14c1 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 712c777e-251b-43d8-b923-8eda693f32ed] Deletion of /opt/stack/data/nova/instances/712c777e-251b-43d8-b923-8eda693f32ed_del complete
Aug 17 12:08:27 user nova-compute[73449]: INFO nova.compute.manager [None req-f6fb911b-226c-427c-8176-119de3da14c1 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 712c777e-251b-43d8-b923-8eda693f32ed] Took 0.93 seconds to destroy the instance on the hypervisor.
Aug 17 12:08:27 user nova-compute[73449]: DEBUG oslo.service.loopingcall [None req-f6fb911b-226c-427c-8176-119de3da14c1 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73449) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 12:08:27 user nova-compute[73449]: DEBUG nova.compute.manager [-] [instance: 712c777e-251b-43d8-b923-8eda693f32ed] Deallocating network for instance {{(pid=73449) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 12:08:27 user nova-compute[73449]: DEBUG nova.network.neutron [-] [instance: 712c777e-251b-43d8-b923-8eda693f32ed] deallocate_for_instance() {{(pid=73449) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 12:08:27 user nova-compute[73449]: DEBUG nova.network.neutron [-] [instance: 712c777e-251b-43d8-b923-8eda693f32ed] Updating instance_info_cache with network_info: [] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 12:08:27 user nova-compute[73449]: INFO nova.compute.manager [-] [instance: 712c777e-251b-43d8-b923-8eda693f32ed] Took 0.60 seconds to deallocate network for instance.
Aug 17 12:08:27 user nova-compute[73449]: DEBUG nova.compute.manager [req-37fbfd46-709e-490a-97a6-f1b9c1276497 req-44cc37b5-8dd2-45c4-83c2-410279be606a service nova] [instance: 712c777e-251b-43d8-b923-8eda693f32ed] Received event network-vif-deleted-b1a278b5-bdf7-4803-bbff-96579cf1fbd8 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:08:27 user nova-compute[73449]: INFO nova.compute.manager [req-37fbfd46-709e-490a-97a6-f1b9c1276497 req-44cc37b5-8dd2-45c4-83c2-410279be606a service nova] [instance: 712c777e-251b-43d8-b923-8eda693f32ed] Neutron deleted interface b1a278b5-bdf7-4803-bbff-96579cf1fbd8; detaching it from the instance and deleting it from the info cache
Aug 17 12:08:27 user nova-compute[73449]: DEBUG nova.network.neutron [req-37fbfd46-709e-490a-97a6-f1b9c1276497 req-44cc37b5-8dd2-45c4-83c2-410279be606a service nova] [instance: 712c777e-251b-43d8-b923-8eda693f32ed] Updating instance_info_cache with network_info: [] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 12:08:27 user nova-compute[73449]: DEBUG nova.compute.manager [req-37fbfd46-709e-490a-97a6-f1b9c1276497 req-44cc37b5-8dd2-45c4-83c2-410279be606a service nova] [instance: 712c777e-251b-43d8-b923-8eda693f32ed] Detach interface failed, port_id=b1a278b5-bdf7-4803-bbff-96579cf1fbd8, reason: Instance 712c777e-251b-43d8-b923-8eda693f32ed could not be found. {{(pid=73449) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 12:08:27 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-f6fb911b-226c-427c-8176-119de3da14c1 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:08:27 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-f6fb911b-226c-427c-8176-119de3da14c1 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:08:28 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-f6fb911b-226c-427c-8176-119de3da14c1 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 12:08:28 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-f6fb911b-226c-427c-8176-119de3da14c1 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 12:08:28 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-f6fb911b-226c-427c-8176-119de3da14c1 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.334s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:08:28 user nova-compute[73449]: INFO nova.scheduler.client.report [None req-f6fb911b-226c-427c-8176-119de3da14c1 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Deleted allocations for instance 712c777e-251b-43d8-b923-8eda693f32ed
Aug 17 12:08:28 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-f6fb911b-226c-427c-8176-119de3da14c1 tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Lock "712c777e-251b-43d8-b923-8eda693f32ed" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.091s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:08:28 user nova-compute[73449]: DEBUG nova.compute.manager [req-601f43bc-0aaf-4c9f-a2db-97122f4f1b3d req-f4834477-fae6-459e-aef7-6e58ab6256c1 service nova] [instance: 712c777e-251b-43d8-b923-8eda693f32ed] Received event network-vif-plugged-b1a278b5-bdf7-4803-bbff-96579cf1fbd8 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:08:28 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-601f43bc-0aaf-4c9f-a2db-97122f4f1b3d req-f4834477-fae6-459e-aef7-6e58ab6256c1 service nova] Acquiring lock "712c777e-251b-43d8-b923-8eda693f32ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:08:28 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-601f43bc-0aaf-4c9f-a2db-97122f4f1b3d req-f4834477-fae6-459e-aef7-6e58ab6256c1 service nova] Lock "712c777e-251b-43d8-b923-8eda693f32ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:08:28 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-601f43bc-0aaf-4c9f-a2db-97122f4f1b3d req-f4834477-fae6-459e-aef7-6e58ab6256c1 service nova] Lock "712c777e-251b-43d8-b923-8eda693f32ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:08:28 user nova-compute[73449]: DEBUG nova.compute.manager [req-601f43bc-0aaf-4c9f-a2db-97122f4f1b3d req-f4834477-fae6-459e-aef7-6e58ab6256c1 service nova] [instance: 712c777e-251b-43d8-b923-8eda693f32ed] No waiting events found dispatching network-vif-plugged-b1a278b5-bdf7-4803-bbff-96579cf1fbd8 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 12:08:28 user nova-compute[73449]: WARNING nova.compute.manager [req-601f43bc-0aaf-4c9f-a2db-97122f4f1b3d req-f4834477-fae6-459e-aef7-6e58ab6256c1 service nova] [instance: 712c777e-251b-43d8-b923-8eda693f32ed] Received unexpected event network-vif-plugged-b1a278b5-bdf7-4803-bbff-96579cf1fbd8 for instance with vm_state deleted and task_state None.
Aug 17 12:08:32 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:08:37 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:08:42 user nova-compute[73449]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692274107.1140354, 712c777e-251b-43d8-b923-8eda693f32ed => Stopped> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 12:08:42 user nova-compute[73449]: INFO nova.compute.manager [-] [instance: 712c777e-251b-43d8-b923-8eda693f32ed] VM Stopped (Lifecycle Event)
Aug 17 12:08:42 user nova-compute[73449]: DEBUG nova.compute.manager [None req-e637a05d-abc6-413d-abd1-d53c9f8b8fa6 None None] [instance: 712c777e-251b-43d8-b923-8eda693f32ed] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 12:08:42 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:08:47 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:08:52 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:08:57 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:08:57 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:08:57 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73449) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 12:08:57 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:08:57 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:08:57 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:09:02 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:09:05 user nova-compute[73449]: DEBUG nova.compute.manager [req-568fbb6b-3b07-4fd3-bdb0-efe246be1c19 req-457691d4-7a97-4a7f-9ec0-790c51483c61 service nova] [instance: 54c69eab-3597-4ca7-b698-169538b73a18] Received event network-changed-775bc781-860e-4b6f-89f8-1b5cdeb69a8b {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:09:05 user nova-compute[73449]: DEBUG nova.compute.manager [req-568fbb6b-3b07-4fd3-bdb0-efe246be1c19 req-457691d4-7a97-4a7f-9ec0-790c51483c61 service nova] [instance: 54c69eab-3597-4ca7-b698-169538b73a18] Refreshing instance network info cache due to event network-changed-775bc781-860e-4b6f-89f8-1b5cdeb69a8b. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 12:09:05 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-568fbb6b-3b07-4fd3-bdb0-efe246be1c19 req-457691d4-7a97-4a7f-9ec0-790c51483c61 service nova] Acquiring lock "refresh_cache-54c69eab-3597-4ca7-b698-169538b73a18" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 12:09:05 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-568fbb6b-3b07-4fd3-bdb0-efe246be1c19 req-457691d4-7a97-4a7f-9ec0-790c51483c61 service nova] Acquired lock "refresh_cache-54c69eab-3597-4ca7-b698-169538b73a18" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 12:09:05 user nova-compute[73449]: DEBUG nova.network.neutron [req-568fbb6b-3b07-4fd3-bdb0-efe246be1c19 req-457691d4-7a97-4a7f-9ec0-790c51483c61 service nova] [instance: 54c69eab-3597-4ca7-b698-169538b73a18] Refreshing network info cache for port 775bc781-860e-4b6f-89f8-1b5cdeb69a8b {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 12:09:05 user nova-compute[73449]: DEBUG nova.network.neutron [req-568fbb6b-3b07-4fd3-bdb0-efe246be1c19 req-457691d4-7a97-4a7f-9ec0-790c51483c61 service nova] [instance: 54c69eab-3597-4ca7-b698-169538b73a18] Updated VIF entry in instance network info cache for port 775bc781-860e-4b6f-89f8-1b5cdeb69a8b. {{(pid=73449) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 12:09:05 user nova-compute[73449]: DEBUG nova.network.neutron [req-568fbb6b-3b07-4fd3-bdb0-efe246be1c19 req-457691d4-7a97-4a7f-9ec0-790c51483c61 service nova] [instance: 54c69eab-3597-4ca7-b698-169538b73a18] Updating instance_info_cache with network_info: [{"id": "775bc781-860e-4b6f-89f8-1b5cdeb69a8b", "address": "fa:16:3e:44:28:8d", "network": {"id": "1e184b35-0ffc-4c89-951b-d97b1961f72f", "bridge": "br-int", "label": "tempest-TestStampPattern-2134909631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c9e5daa31ad47e996b59f1b7c5db0d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap775bc781-86", "ovs_interfaceid": "775bc781-860e-4b6f-89f8-1b5cdeb69a8b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 12:09:05 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-117d222a-cf39-4215-b6e2-975e6ff100db tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Acquiring lock "54c69eab-3597-4ca7-b698-169538b73a18" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:09:05 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-117d222a-cf39-4215-b6e2-975e6ff100db tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Lock "54c69eab-3597-4ca7-b698-169538b73a18" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:09:05 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-568fbb6b-3b07-4fd3-bdb0-efe246be1c19 req-457691d4-7a97-4a7f-9ec0-790c51483c61 service nova] Releasing lock "refresh_cache-54c69eab-3597-4ca7-b698-169538b73a18" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 12:09:05 user nova-compute[73449]: DEBUG nova.objects.instance [None req-117d222a-cf39-4215-b6e2-975e6ff100db tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Lazy-loading 'flavor' on Instance uuid 54c69eab-3597-4ca7-b698-169538b73a18 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:09:05 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:09:05 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-117d222a-cf39-4215-b6e2-975e6ff100db tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Lock "54c69eab-3597-4ca7-b698-169538b73a18" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:09:06 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-117d222a-cf39-4215-b6e2-975e6ff100db tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Acquiring lock "54c69eab-3597-4ca7-b698-169538b73a18" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:09:06 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-117d222a-cf39-4215-b6e2-975e6ff100db tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Lock "54c69eab-3597-4ca7-b698-169538b73a18" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:09:06 user nova-compute[73449]: INFO nova.compute.manager [None req-117d222a-cf39-4215-b6e2-975e6ff100db tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] [instance: 54c69eab-3597-4ca7-b698-169538b73a18] Attaching volume 07e99eb7-0b46-4bc8-9d60-708b6087d4f3 to /dev/vdb
Aug 17 12:09:06 user nova-compute[73449]: DEBUG os_brick.utils [None req-117d222a-cf39-4215-b6e2-975e6ff100db tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 12:09:06 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:09:06 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:09:06 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b188e1a-c54b-486e-9023-15f5027e8f72]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4d3924302012\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:09:06 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:09:06 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:09:06 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[61f495d4-ec63-4f84-bcc1-26544170a233]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:09:06 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:09:06 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:09:06 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[431abc67-aa98-47d4-b78e-526d68045c42]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:09:06 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[a604fdd7-0896-4f32-84d7-22bfa4e645f2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:09:06 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-117d222a-cf39-4215-b6e2-975e6ff100db tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Running cmd (subprocess): nvme version {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:09:06 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-117d222a-cf39-4215-b6e2-975e6ff100db tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] 'nvme version' failed. Not Retrying. {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 12:09:06 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.nvmeof [None req-117d222a-cf39-4215-b6e2-975e6ff100db tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] nvme not present on system {{(pid=73449) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 12:09:06 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:09:06 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 12:09:06 user nova-compute[73449]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 12:09:06 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[6da80efb-f688-4a32-b540-03680030a40a]: (4, '') {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:09:06 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-117d222a-cf39-4215-b6e2-975e6ff100db tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73449) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 12:09:06 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-117d222a-cf39-4215-b6e2-975e6ff100db tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73449) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 12:09:06 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-117d222a-cf39-4215-b6e2-975e6ff100db tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] LIGHTOS: no hostnqn found. {{(pid=73449) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 12:09:06 user nova-compute[73449]: DEBUG os_brick.utils [None req-117d222a-cf39-4215-b6e2-975e6ff100db tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4d3924302012', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 12:09:06 user nova-compute[73449]: DEBUG nova.virt.block_device [None req-117d222a-cf39-4215-b6e2-975e6ff100db tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] [instance: 54c69eab-3597-4ca7-b698-169538b73a18] Updating existing volume attachment record: 6d3147d5-a0f5-43e2-b87f-42c041430a6c {{(pid=73449) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 12:09:07 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:09:08 user nova-compute[73449]: DEBUG nova.compute.manager [req-c38acedb-bfe2-4344-b2b9-1ee4e0bef422 req-c9c3b90d-fa06-48cf-a027-e58d4c3d7fab service nova] [instance: f607caf8-0910-4214-b2f7-ccd59cd0307a] Received event network-changed-3fbe83ab-0b4f-4f6d-9a90-bd564e1e0760 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:09:08 user nova-compute[73449]: DEBUG nova.compute.manager [req-c38acedb-bfe2-4344-b2b9-1ee4e0bef422 req-c9c3b90d-fa06-48cf-a027-e58d4c3d7fab service nova] [instance: f607caf8-0910-4214-b2f7-ccd59cd0307a] Refreshing instance network info cache due to event network-changed-3fbe83ab-0b4f-4f6d-9a90-bd564e1e0760. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 12:09:08 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-c38acedb-bfe2-4344-b2b9-1ee4e0bef422 req-c9c3b90d-fa06-48cf-a027-e58d4c3d7fab service nova] Acquiring lock "refresh_cache-f607caf8-0910-4214-b2f7-ccd59cd0307a" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 12:09:08 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-c38acedb-bfe2-4344-b2b9-1ee4e0bef422 req-c9c3b90d-fa06-48cf-a027-e58d4c3d7fab service nova] Acquired lock "refresh_cache-f607caf8-0910-4214-b2f7-ccd59cd0307a" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 12:09:08 user nova-compute[73449]: DEBUG nova.network.neutron [req-c38acedb-bfe2-4344-b2b9-1ee4e0bef422 req-c9c3b90d-fa06-48cf-a027-e58d4c3d7fab service nova] [instance: f607caf8-0910-4214-b2f7-ccd59cd0307a] Refreshing network info cache for port 3fbe83ab-0b4f-4f6d-9a90-bd564e1e0760 {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 12:09:08 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:09:08 user nova-compute[73449]: DEBUG nova.network.neutron [req-c38acedb-bfe2-4344-b2b9-1ee4e0bef422 req-c9c3b90d-fa06-48cf-a027-e58d4c3d7fab service nova] [instance: f607caf8-0910-4214-b2f7-ccd59cd0307a] Updated VIF entry in instance network info cache for port 3fbe83ab-0b4f-4f6d-9a90-bd564e1e0760. {{(pid=73449) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 12:09:08 user nova-compute[73449]: DEBUG nova.network.neutron [req-c38acedb-bfe2-4344-b2b9-1ee4e0bef422 req-c9c3b90d-fa06-48cf-a027-e58d4c3d7fab service nova] [instance: f607caf8-0910-4214-b2f7-ccd59cd0307a] Updating instance_info_cache with network_info: [{"id": "3fbe83ab-0b4f-4f6d-9a90-bd564e1e0760", "address": "fa:16:3e:b4:1b:4f", "network": {"id": "71648e1b-cf19-44b7-bae2-9d38543cdee9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-822323626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75aa99e369c54b65aff27adbb1daf2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fbe83ab-0b", "ovs_interfaceid": "3fbe83ab-0b4f-4f6d-9a90-bd564e1e0760", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 12:09:09 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-c38acedb-bfe2-4344-b2b9-1ee4e0bef422 req-c9c3b90d-fa06-48cf-a027-e58d4c3d7fab service nova] Releasing lock "refresh_cache-f607caf8-0910-4214-b2f7-ccd59cd0307a" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 12:09:09 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:09:09 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:09:09 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:09:09 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73449) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 12:09:11 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:09:12 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-bbc96784-122d-4609-9e46-84f158293b6a tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Acquiring lock "f607caf8-0910-4214-b2f7-ccd59cd0307a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:09:12 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-bbc96784-122d-4609-9e46-84f158293b6a tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Lock "f607caf8-0910-4214-b2f7-ccd59cd0307a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:09:12 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:09:12 user nova-compute[73449]: DEBUG nova.objects.instance [None req-bbc96784-122d-4609-9e46-84f158293b6a tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Lazy-loading 'flavor' on Instance uuid f607caf8-0910-4214-b2f7-ccd59cd0307a {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:09:12 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-bbc96784-122d-4609-9e46-84f158293b6a tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Lock "f607caf8-0910-4214-b2f7-ccd59cd0307a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:09:12 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-bbc96784-122d-4609-9e46-84f158293b6a tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Acquiring lock "f607caf8-0910-4214-b2f7-ccd59cd0307a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:09:12 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-bbc96784-122d-4609-9e46-84f158293b6a tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Lock "f607caf8-0910-4214-b2f7-ccd59cd0307a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:09:12 user nova-compute[73449]: INFO nova.compute.manager [None req-bbc96784-122d-4609-9e46-84f158293b6a tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: f607caf8-0910-4214-b2f7-ccd59cd0307a] Attaching volume ec501637-ac1a-4722-a427-1dadd1d4ff82 to /dev/vdb
Aug 17 12:09:12 user nova-compute[73449]: DEBUG os_brick.utils [None req-bbc96784-122d-4609-9e46-84f158293b6a tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 12:09:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:09:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:09:12 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[98700fd1-29c2-4b13-97b2-91f4d6b00c6c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4d3924302012\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:09:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:09:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:09:12 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[71f13489-20c4-4ffa-80d8-3e58302564f6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:09:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:09:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:09:12 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4604b38-eb06-4fa7-bd0f-2914d1d6b73f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:09:12 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d427cf7-d8f8-4405-9b52-20fc15c8c437]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:09:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-bbc96784-122d-4609-9e46-84f158293b6a tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Running cmd (subprocess): nvme version {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:09:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-bbc96784-122d-4609-9e46-84f158293b6a tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] 'nvme version' failed. Not Retrying. {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 12:09:12 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bbc96784-122d-4609-9e46-84f158293b6a tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] nvme not present on system {{(pid=73449) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 12:09:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:09:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 12:09:12 user nova-compute[73449]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 12:09:12 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d5ca046-29b4-49dd-b8d5-9ebb12c52dfd]: (4, '') {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:09:12 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-bbc96784-122d-4609-9e46-84f158293b6a tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73449) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 12:09:12 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-bbc96784-122d-4609-9e46-84f158293b6a tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73449) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 12:09:12 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-bbc96784-122d-4609-9e46-84f158293b6a tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] LIGHTOS: no hostnqn found. {{(pid=73449) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 12:09:12 user nova-compute[73449]: DEBUG os_brick.utils [None req-bbc96784-122d-4609-9e46-84f158293b6a tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4d3924302012', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 12:09:12 user nova-compute[73449]: DEBUG nova.virt.block_device [None req-bbc96784-122d-4609-9e46-84f158293b6a tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: f607caf8-0910-4214-b2f7-ccd59cd0307a] Updating existing volume attachment record: 38944a3a-5676-49f6-ad83-335d2dbc437d {{(pid=73449) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 12:09:13 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:09:13 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:09:16 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-117d222a-cf39-4215-b6e2-975e6ff100db tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] [instance: 54c69eab-3597-4ca7-b698-169538b73a18] Calling os-brick to attach iSCSI Volume {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 12:09:16 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-117d222a-cf39-4215-b6e2-975e6ff100db tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:07e99eb7-0b46-4bc8-9d60-708b6087d4f3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jUEIOGNv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 12:09:16 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-117d222a-cf39-4215-b6e2-975e6ff100db tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 12:09:16 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-117d222a-cf39-4215-b6e2-975e6ff100db tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 12:09:16 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-117d222a-cf39-4215-b6e2-975e6ff100db tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 12:09:16 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-117d222a-cf39-4215-b6e2-975e6ff100db tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 12:09:16 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-117d222a-cf39-4215-b6e2-975e6ff100db tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:07e99eb7-0b46-4bc8-9d60-708b6087d4f3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 12:09:16 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-117d222a-cf39-4215-b6e2-975e6ff100db tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:07e99eb7-0b46-4bc8-9d60-708b6087d4f3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 12:09:16 user nova-compute[73449]: INFO os_brick.initiator.connectors.iscsi [None req-117d222a-cf39-4215-b6e2-975e6ff100db tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 12:09:16 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07e99eb7-0b46-4bc8-9d60-708b6087d4f3 -p 172.16.0.220:3260 {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:09:16 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07e99eb7-0b46-4bc8-9d60-708b6087d4f3 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:09:16 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4ead797-70ec-4451-8093-a4d2863f09e5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:09:16 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-117d222a-cf39-4215-b6e2-975e6ff100db tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 12:09:16 user nova-compute[73449]:  {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:09:16 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07e99eb7-0b46-4bc8-9d60-708b6087d4f3 -p 172.16.0.220:3260 --interface default --op new {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:09:16 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07e99eb7-0b46-4bc8-9d60-708b6087d4f3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:09:16 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[75b038a7-e663-413f-83e7-2e12a47981f0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:07e99eb7-0b46-4bc8-9d60-708b6087d4f3] added\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:09:16 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-117d222a-cf39-4215-b6e2-975e6ff100db tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:07e99eb7-0b46-4bc8-9d60-708b6087d4f3] added
Aug 17 12:09:16 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:09:16 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07e99eb7-0b46-4bc8-9d60-708b6087d4f3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:09:16 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07e99eb7-0b46-4bc8-9d60-708b6087d4f3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:09:16 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d5ad469-281f-4764-aebc-55b5027c252e]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:09:16 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-117d222a-cf39-4215-b6e2-975e6ff100db tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:09:16 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07e99eb7-0b46-4bc8-9d60-708b6087d4f3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:09:16 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07e99eb7-0b46-4bc8-9d60-708b6087d4f3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:09:16 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[78da0671-8e80-499b-a89d-74f77f0e214f]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:09:16 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-117d222a-cf39-4215-b6e2-975e6ff100db tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:09:16 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07e99eb7-0b46-4bc8-9d60-708b6087d4f3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jUEIOGNv {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:09:16 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07e99eb7-0b46-4bc8-9d60-708b6087d4f3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jUEIOGNv" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:09:16 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[18a8438d-e428-4863-9518-ab592210cdd0]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:09:16 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-117d222a-cf39-4215-b6e2-975e6ff100db tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jUEIOGNv'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:09:16 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07e99eb7-0b46-4bc8-9d60-708b6087d4f3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:09:16 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07e99eb7-0b46-4bc8-9d60-708b6087d4f3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:09:16 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a96605c-8d3a-4cda-8747-5829c0cd737c]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:09:16 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-117d222a-cf39-4215-b6e2-975e6ff100db tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:09:16 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:09:16 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:09:16 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[50cb79a7-739c-4185-8980-eefebdc12ba1]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49 (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:09:16 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-117d222a-cf39-4215-b6e2-975e6ff100db tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)
Aug 17 12:09:16 user nova-compute[73449]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49 (non-flash)
Aug 17 12:09:16 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 12:09:16 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-117d222a-cf39-4215-b6e2-975e6ff100db tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)
Aug 17 12:09:16 user nova-compute[73449]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49 (non-flash)
Aug 17 12:09:16 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 12:09:16 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07e99eb7-0b46-4bc8-9d60-708b6087d4f3 -p 172.16.0.220:3260 --login {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:09:16 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07e99eb7-0b46-4bc8-9d60-708b6087d4f3 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:09:16 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[814c89ad-6d94-4432-8f75-d76b0e340b40]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:07e99eb7-0b46-4bc8-9d60-708b6087d4f3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:07e99eb7-0b46-4bc8-9d60-708b6087d4f3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:09:16 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-117d222a-cf39-4215-b6e2-975e6ff100db tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:07e99eb7-0b46-4bc8-9d60-708b6087d4f3, portal: 172.16.0.220,3260]
Aug 17 12:09:16 user nova-compute[73449]: Login to [iface: default, target: iqn.2010-10.org.openstack:07e99eb7-0b46-4bc8-9d60-708b6087d4f3, portal: 172.16.0.220,3260] successful.
Aug 17 12:09:16 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:09:16 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07e99eb7-0b46-4bc8-9d60-708b6087d4f3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:09:16 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07e99eb7-0b46-4bc8-9d60-708b6087d4f3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.037s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:09:16 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[c78270f7-06e9-4310-b6f9-b17b88cbec1d]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:09:16 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-117d222a-cf39-4215-b6e2-975e6ff100db tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:09:16 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:09:16 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a12f0f33-b2ac-483b-bd1d-1ac6ade5355e tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Acquiring lock "31f5f3d2-41d8-4a26-9eb2-18b891f94734" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:09:16 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a12f0f33-b2ac-483b-bd1d-1ac6ade5355e tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Lock "31f5f3d2-41d8-4a26-9eb2-18b891f94734" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:09:16 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a12f0f33-b2ac-483b-bd1d-1ac6ade5355e tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Acquiring lock "31f5f3d2-41d8-4a26-9eb2-18b891f94734-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:09:16 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a12f0f33-b2ac-483b-bd1d-1ac6ade5355e tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Lock "31f5f3d2-41d8-4a26-9eb2-18b891f94734-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:09:16 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a12f0f33-b2ac-483b-bd1d-1ac6ade5355e tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Lock "31f5f3d2-41d8-4a26-9eb2-18b891f94734-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:09:16 user nova-compute[73449]: INFO nova.compute.manager [None req-a12f0f33-b2ac-483b-bd1d-1ac6ade5355e tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] Terminating instance
Aug 17 12:09:16 user nova-compute[73449]: DEBUG nova.compute.manager [None req-a12f0f33-b2ac-483b-bd1d-1ac6ade5355e tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] Start destroying the instance on the hypervisor. {{(pid=73449) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 12:09:16 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:09:16 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[5629ba27-9352-4286-b6a2-6e16ceb1f1ef]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e99eb7-0b46-4bc8-9d60-708b6087d4f3 (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:09:16 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-117d222a-cf39-4215-b6e2-975e6ff100db tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)
Aug 17 12:09:16 user nova-compute[73449]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49 (non-flash)
Aug 17 12:09:16 user nova-compute[73449]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e99eb7-0b46-4bc8-9d60-708b6087d4f3 (non-flash)
Aug 17 12:09:16 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 12:09:16 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-117d222a-cf39-4215-b6e2-975e6ff100db tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)
Aug 17 12:09:16 user nova-compute[73449]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49 (non-flash)
Aug 17 12:09:16 user nova-compute[73449]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e99eb7-0b46-4bc8-9d60-708b6087d4f3 (non-flash)
Aug 17 12:09:16 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 12:09:16 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-117d222a-cf39-4215-b6e2-975e6ff100db tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:07e99eb7-0b46-4bc8-9d60-708b6087d4f3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 12:09:16 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-117d222a-cf39-4215-b6e2-975e6ff100db tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Connected to 172.16.0.220:3260 {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 12:09:16 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-117d222a-cf39-4215-b6e2-975e6ff100db tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] HCTL ('33', '-', '-', 0) found on session 54 with lun 0 {{(pid=73449) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 12:09:16 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-117d222a-cf39-4215-b6e2-975e6ff100db tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73449) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 12:09:16 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:09:17 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:09:17 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9284c8c-67fd-4d2a-b43f-995c0a9ee3fe]: (4, ('- - 0', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:09:17 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-117d222a-cf39-4215-b6e2-975e6ff100db tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73449) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 12:09:17 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-117d222a-cf39-4215-b6e2-975e6ff100db tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jUEIOGNv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 12:09:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:09:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:09:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:09:17 user nova-compute[73449]: DEBUG nova.compute.manager [req-0bab300d-75d1-4e8a-aa56-9246e30638a4 req-2ddc9e40-1617-4edd-b3b7-6bf1b656cdfd service nova] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] Received event network-vif-unplugged-ea00b08a-3d80-453b-8c1a-9bdc74ac652f {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:09:17 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-0bab300d-75d1-4e8a-aa56-9246e30638a4 req-2ddc9e40-1617-4edd-b3b7-6bf1b656cdfd service nova] Acquiring lock "31f5f3d2-41d8-4a26-9eb2-18b891f94734-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:09:17 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-0bab300d-75d1-4e8a-aa56-9246e30638a4 req-2ddc9e40-1617-4edd-b3b7-6bf1b656cdfd service nova] Lock "31f5f3d2-41d8-4a26-9eb2-18b891f94734-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:09:17 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-0bab300d-75d1-4e8a-aa56-9246e30638a4 req-2ddc9e40-1617-4edd-b3b7-6bf1b656cdfd service nova] Lock "31f5f3d2-41d8-4a26-9eb2-18b891f94734-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:09:17 user nova-compute[73449]: DEBUG nova.compute.manager [req-0bab300d-75d1-4e8a-aa56-9246e30638a4 req-2ddc9e40-1617-4edd-b3b7-6bf1b656cdfd service nova] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] No waiting events found dispatching network-vif-unplugged-ea00b08a-3d80-453b-8c1a-9bdc74ac652f {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 12:09:17 user nova-compute[73449]: DEBUG nova.compute.manager [req-0bab300d-75d1-4e8a-aa56-9246e30638a4 req-2ddc9e40-1617-4edd-b3b7-6bf1b656cdfd service nova] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] Received event network-vif-unplugged-ea00b08a-3d80-453b-8c1a-9bdc74ac652f for instance with task_state deleting. {{(pid=73449) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 12:09:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:09:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:09:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:09:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:09:17 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] Instance destroyed successfully.
Aug 17 12:09:17 user nova-compute[73449]: DEBUG nova.objects.instance [None req-a12f0f33-b2ac-483b-bd1d-1ac6ade5355e tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Lazy-loading 'resources' on Instance uuid 31f5f3d2-41d8-4a26-9eb2-18b891f94734 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:09:17 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-a12f0f33-b2ac-483b-bd1d-1ac6ade5355e tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:53:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-337335098',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-337335098',id=32,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T11:55:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4ec3b0b72e47448ebe99f9fc64119c1c',ramdisk_id='',reservation_id='r-7gzwba2q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1818019421',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T11:57:17Z,user_data=None,user_id='14eb3826311a4f8f91d8264e87f7b866',uuid=31f5f3d2-41d8-4a26-9eb2-18b891f94734,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ea00b08a-3d80-453b-8c1a-9bdc74ac652f", "address": "fa:16:3e:d2:96:e4", "network": {"id": "9455bb75-f75a-41ff-8f6f-49f55aa738f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-425274599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec3b0b72e47448ebe99f9fc64119c1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea00b08a-3d", "ovs_interfaceid": "ea00b08a-3d80-453b-8c1a-9bdc74ac652f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 12:09:17 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-a12f0f33-b2ac-483b-bd1d-1ac6ade5355e tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Converting VIF {"id": "ea00b08a-3d80-453b-8c1a-9bdc74ac652f", "address": "fa:16:3e:d2:96:e4", "network": {"id": "9455bb75-f75a-41ff-8f6f-49f55aa738f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-425274599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec3b0b72e47448ebe99f9fc64119c1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea00b08a-3d", "ovs_interfaceid": "ea00b08a-3d80-453b-8c1a-9bdc74ac652f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 12:09:17 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-a12f0f33-b2ac-483b-bd1d-1ac6ade5355e tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d2:96:e4,bridge_name='br-int',has_traffic_filtering=True,id=ea00b08a-3d80-453b-8c1a-9bdc74ac652f,network=Network(9455bb75-f75a-41ff-8f6f-49f55aa738f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea00b08a-3d') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 12:09:17 user nova-compute[73449]: DEBUG os_vif [None req-a12f0f33-b2ac-483b-bd1d-1ac6ade5355e tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d2:96:e4,bridge_name='br-int',has_traffic_filtering=True,id=ea00b08a-3d80-453b-8c1a-9bdc74ac652f,network=Network(9455bb75-f75a-41ff-8f6f-49f55aa738f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea00b08a-3d') {{(pid=73449) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 12:09:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:09:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapea00b08a-3d, bridge=br-int, if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 12:09:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:09:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:09:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:09:17 user nova-compute[73449]: INFO os_vif [None req-a12f0f33-b2ac-483b-bd1d-1ac6ade5355e tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d2:96:e4,bridge_name='br-int',has_traffic_filtering=True,id=ea00b08a-3d80-453b-8c1a-9bdc74ac652f,network=Network(9455bb75-f75a-41ff-8f6f-49f55aa738f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea00b08a-3d')
Aug 17 12:09:17 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a12f0f33-b2ac-483b-bd1d-1ac6ade5355e tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] calling os-brick to detach iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 12:09:17 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-a12f0f33-b2ac-483b-bd1d-1ac6ade5355e tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, {'target_iqns': ['iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pRTkFKvC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 12:09:17 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-a12f0f33-b2ac-483b-bd1d-1ac6ade5355e tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 12:09:17 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-a12f0f33-b2ac-483b-bd1d-1ac6ade5355e tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 12:09:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:09:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:09:18 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-117d222a-cf39-4215-b6e2-975e6ff100db tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.312s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 12:09:18 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-117d222a-cf39-4215-b6e2-975e6ff100db tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '23834303235396338', 'path': '/dev/sdb'} {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 12:09:18 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-117d222a-cf39-4215-b6e2-975e6ff100db tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] [instance: 54c69eab-3597-4ca7-b698-169538b73a18] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23834303235396338', 'path': '/dev/sdb'} {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 12:09:18 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-a12f0f33-b2ac-483b-bd1d-1ac6ade5355e tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.229s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 12:09:18 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-a12f0f33-b2ac-483b-bd1d-1ac6ade5355e tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9', 0)] {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 12:09:18 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:09:18 user nova-compute[73449]: DEBUG nova.objects.instance [None req-117d222a-cf39-4215-b6e2-975e6ff100db tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Lazy-loading 'flavor' on Instance uuid 54c69eab-3597-4ca7-b698-169538b73a18 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:09:18 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:09:18 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c833375-3f74-4089-8d74-0916bb56b180]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:07e99eb7-0b46-4bc8-9d60-708b6087d4f3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:09:18 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:09:18 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-117d222a-cf39-4215-b6e2-975e6ff100db tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 12:09:18 user nova-compute[73449]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 12:09:18 user nova-compute[73449]:   <source dev="/dev/sdb"/>
Aug 17 12:09:18 user nova-compute[73449]:   <target dev="vdb" bus="virtio"/>
Aug 17 12:09:18 user nova-compute[73449]:   <serial>07e99eb7-0b46-4bc8-9d60-708b6087d4f3</serial>
Aug 17 12:09:18 user nova-compute[73449]: </disk>
Aug 17 12:09:18 user nova-compute[73449]:  {{(pid=73449) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 12:09:18 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:09:18 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[f024840a-53ab-4a7e-813e-02c4162bf27b]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e99eb7-0b46-4bc8-9d60-708b6087d4f3 (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:09:18 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-a12f0f33-b2ac-483b-bd1d-1ac6ade5355e tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)
Aug 17 12:09:18 user nova-compute[73449]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49 (non-flash)
Aug 17 12:09:18 user nova-compute[73449]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e99eb7-0b46-4bc8-9d60-708b6087d4f3 (non-flash)
Aug 17 12:09:18 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 12:09:18 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-a12f0f33-b2ac-483b-bd1d-1ac6ade5355e tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 (non-flash)
Aug 17 12:09:18 user nova-compute[73449]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49 (non-flash)
Aug 17 12:09:18 user nova-compute[73449]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e99eb7-0b46-4bc8-9d60-708b6087d4f3 (non-flash)
Aug 17 12:09:18 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 12:09:18 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-a12f0f33-b2ac-483b-bd1d-1ac6ade5355e tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe7581043a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9'): ({'sde'}, set())}) {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 12:09:18 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-a12f0f33-b2ac-483b-bd1d-1ac6ade5355e tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Removing single pathed devices sde {{(pid=73449) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 12:09:18 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:09:18 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:09:18 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a257790-dd38-4f56-a9e5-3c537b79030c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:09:18 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:09:18 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.026s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:09:18 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[d62b3469-04a5-4d7d-8055-094ecbc31214]: (4, ('ok\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:09:18 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-a12f0f33-b2ac-483b-bd1d-1ac6ade5355e tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Flushing IO for device /dev/sde {{(pid=73449) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 12:09:18 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:09:18 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:09:18 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a1513cc-bf40-4fff-a3e6-5b8785ca56c3]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:09:18 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-a12f0f33-b2ac-483b-bd1d-1ac6ade5355e tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73449) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 12:09:18 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:09:18 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.038s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:09:18 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfe06613-5510-4b34-af62-f659b157b226]: (4, ('1', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:09:18 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-a12f0f33-b2ac-483b-bd1d-1ac6ade5355e tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73449) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 12:09:18 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-a12f0f33-b2ac-483b-bd1d-1ac6ade5355e tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] SCSI volumes sde have been removed. {{(pid=73449) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 12:09:18 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-a12f0f33-b2ac-483b-bd1d-1ac6ade5355e tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9')] {{(pid=73449) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 12:09:18 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:09:18 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:09:18 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[4674c2c5-21d7-427d-9e8f-15f1d2e01396]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:09:18 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-a12f0f33-b2ac-483b-bd1d-1ac6ade5355e tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:09:18 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 -p 172.16.0.220:3260 --logout {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:09:18 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:09:18 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:09:18 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:09:18 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c08fc61-3c82-4a4d-9db3-02aec4b59cf6]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:09:18 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-a12f0f33-b2ac-483b-bd1d-1ac6ade5355e tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9, portal: 172.16.0.220,3260]
Aug 17 12:09:18 user nova-compute[73449]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9, portal: 172.16.0.220,3260] successful.
Aug 17 12:09:18 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:09:18 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 -p 172.16.0.220:3260 --op delete {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:09:18 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6c52a84-6fd6-4981-90d6-4673350908c9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:09:18 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e650d75-376c-4cdb-964e-36a98f8967b7]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:09:18 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-a12f0f33-b2ac-483b-bd1d-1ac6ade5355e tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:09:18 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-a12f0f33-b2ac-483b-bd1d-1ac6ade5355e tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 12:09:18 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-a12f0f33-b2ac-483b-bd1d-1ac6ade5355e tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] <== disconnect_volume: return (577ms) None {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 12:09:18 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a12f0f33-b2ac-483b-bd1d-1ac6ade5355e tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] Disconnected iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 12:09:18 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-a12f0f33-b2ac-483b-bd1d-1ac6ade5355e tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] Deleting instance files /opt/stack/data/nova/instances/31f5f3d2-41d8-4a26-9eb2-18b891f94734_del
Aug 17 12:09:18 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-a12f0f33-b2ac-483b-bd1d-1ac6ade5355e tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] Deletion of /opt/stack/data/nova/instances/31f5f3d2-41d8-4a26-9eb2-18b891f94734_del complete
Aug 17 12:09:18 user nova-compute[73449]: INFO nova.compute.manager [None req-a12f0f33-b2ac-483b-bd1d-1ac6ade5355e tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] Took 1.50 seconds to destroy the instance on the hypervisor.
Aug 17 12:09:18 user nova-compute[73449]: DEBUG oslo.service.loopingcall [None req-a12f0f33-b2ac-483b-bd1d-1ac6ade5355e tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73449) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 12:09:18 user nova-compute[73449]: DEBUG nova.compute.manager [-] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] Deallocating network for instance {{(pid=73449) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 12:09:18 user nova-compute[73449]: DEBUG nova.network.neutron [-] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] deallocate_for_instance() {{(pid=73449) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 12:09:18 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-117d222a-cf39-4215-b6e2-975e6ff100db tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] No BDM found with device name vda, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 12:09:18 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-117d222a-cf39-4215-b6e2-975e6ff100db tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 12:09:18 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-117d222a-cf39-4215-b6e2-975e6ff100db tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] No VIF found with MAC fa:16:3e:44:28:8d, not building metadata {{(pid=73449) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 12:09:18 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-117d222a-cf39-4215-b6e2-975e6ff100db tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Lock "54c69eab-3597-4ca7-b698-169538b73a18" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.657s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:09:18 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:09:19 user nova-compute[73449]: DEBUG nova.compute.manager [req-23ef17aa-3185-4551-b77a-716c6c9898b0 req-d52d9347-e54e-425f-a9d5-3236d996cb09 service nova] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] Received event network-vif-plugged-ea00b08a-3d80-453b-8c1a-9bdc74ac652f {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:09:19 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-23ef17aa-3185-4551-b77a-716c6c9898b0 req-d52d9347-e54e-425f-a9d5-3236d996cb09 service nova] Acquiring lock "31f5f3d2-41d8-4a26-9eb2-18b891f94734-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:09:19 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-23ef17aa-3185-4551-b77a-716c6c9898b0 req-d52d9347-e54e-425f-a9d5-3236d996cb09 service nova] Lock "31f5f3d2-41d8-4a26-9eb2-18b891f94734-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:09:19 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-23ef17aa-3185-4551-b77a-716c6c9898b0 req-d52d9347-e54e-425f-a9d5-3236d996cb09 service nova] Lock "31f5f3d2-41d8-4a26-9eb2-18b891f94734-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:09:19 user nova-compute[73449]: DEBUG nova.compute.manager [req-23ef17aa-3185-4551-b77a-716c6c9898b0 req-d52d9347-e54e-425f-a9d5-3236d996cb09 service nova] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] No waiting events found dispatching network-vif-plugged-ea00b08a-3d80-453b-8c1a-9bdc74ac652f {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 12:09:19 user nova-compute[73449]: WARNING nova.compute.manager [req-23ef17aa-3185-4551-b77a-716c6c9898b0 req-d52d9347-e54e-425f-a9d5-3236d996cb09 service nova] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] Received unexpected event network-vif-plugged-ea00b08a-3d80-453b-8c1a-9bdc74ac652f for instance with vm_state active and task_state deleting.
Aug 17 12:09:19 user nova-compute[73449]: DEBUG nova.compute.manager [req-23ef17aa-3185-4551-b77a-716c6c9898b0 req-d52d9347-e54e-425f-a9d5-3236d996cb09 service nova] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] Received event network-vif-plugged-ea00b08a-3d80-453b-8c1a-9bdc74ac652f {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:09:19 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-23ef17aa-3185-4551-b77a-716c6c9898b0 req-d52d9347-e54e-425f-a9d5-3236d996cb09 service nova] Acquiring lock "31f5f3d2-41d8-4a26-9eb2-18b891f94734-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:09:19 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-23ef17aa-3185-4551-b77a-716c6c9898b0 req-d52d9347-e54e-425f-a9d5-3236d996cb09 service nova] Lock "31f5f3d2-41d8-4a26-9eb2-18b891f94734-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:09:19 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-23ef17aa-3185-4551-b77a-716c6c9898b0 req-d52d9347-e54e-425f-a9d5-3236d996cb09 service nova] Lock "31f5f3d2-41d8-4a26-9eb2-18b891f94734-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:09:19 user nova-compute[73449]: DEBUG nova.compute.manager [req-23ef17aa-3185-4551-b77a-716c6c9898b0 req-d52d9347-e54e-425f-a9d5-3236d996cb09 service nova] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] No waiting events found dispatching network-vif-plugged-ea00b08a-3d80-453b-8c1a-9bdc74ac652f {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 12:09:19 user nova-compute[73449]: WARNING nova.compute.manager [req-23ef17aa-3185-4551-b77a-716c6c9898b0 req-d52d9347-e54e-425f-a9d5-3236d996cb09 service nova] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] Received unexpected event network-vif-plugged-ea00b08a-3d80-453b-8c1a-9bdc74ac652f for instance with vm_state active and task_state deleting.
Aug 17 12:09:19 user nova-compute[73449]: DEBUG nova.compute.manager [req-23ef17aa-3185-4551-b77a-716c6c9898b0 req-d52d9347-e54e-425f-a9d5-3236d996cb09 service nova] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] Received event network-vif-plugged-ea00b08a-3d80-453b-8c1a-9bdc74ac652f {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:09:19 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-23ef17aa-3185-4551-b77a-716c6c9898b0 req-d52d9347-e54e-425f-a9d5-3236d996cb09 service nova] Acquiring lock "31f5f3d2-41d8-4a26-9eb2-18b891f94734-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:09:19 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-23ef17aa-3185-4551-b77a-716c6c9898b0 req-d52d9347-e54e-425f-a9d5-3236d996cb09 service nova] Lock "31f5f3d2-41d8-4a26-9eb2-18b891f94734-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:09:19 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-23ef17aa-3185-4551-b77a-716c6c9898b0 req-d52d9347-e54e-425f-a9d5-3236d996cb09 service nova] Lock "31f5f3d2-41d8-4a26-9eb2-18b891f94734-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:09:19 user nova-compute[73449]: DEBUG nova.compute.manager [req-23ef17aa-3185-4551-b77a-716c6c9898b0 req-d52d9347-e54e-425f-a9d5-3236d996cb09 service nova] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] No waiting events found dispatching network-vif-plugged-ea00b08a-3d80-453b-8c1a-9bdc74ac652f {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 12:09:19 user nova-compute[73449]: WARNING nova.compute.manager [req-23ef17aa-3185-4551-b77a-716c6c9898b0 req-d52d9347-e54e-425f-a9d5-3236d996cb09 service nova] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] Received unexpected event network-vif-plugged-ea00b08a-3d80-453b-8c1a-9bdc74ac652f for instance with vm_state active and task_state deleting.
Aug 17 12:09:19 user nova-compute[73449]: DEBUG nova.compute.manager [req-23ef17aa-3185-4551-b77a-716c6c9898b0 req-d52d9347-e54e-425f-a9d5-3236d996cb09 service nova] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] Received event network-vif-unplugged-ea00b08a-3d80-453b-8c1a-9bdc74ac652f {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:09:19 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-23ef17aa-3185-4551-b77a-716c6c9898b0 req-d52d9347-e54e-425f-a9d5-3236d996cb09 service nova] Acquiring lock "31f5f3d2-41d8-4a26-9eb2-18b891f94734-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:09:19 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-23ef17aa-3185-4551-b77a-716c6c9898b0 req-d52d9347-e54e-425f-a9d5-3236d996cb09 service nova] Lock "31f5f3d2-41d8-4a26-9eb2-18b891f94734-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:09:19 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-23ef17aa-3185-4551-b77a-716c6c9898b0 req-d52d9347-e54e-425f-a9d5-3236d996cb09 service nova] Lock "31f5f3d2-41d8-4a26-9eb2-18b891f94734-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:09:19 user nova-compute[73449]: DEBUG nova.compute.manager [req-23ef17aa-3185-4551-b77a-716c6c9898b0 req-d52d9347-e54e-425f-a9d5-3236d996cb09 service nova] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] No waiting events found dispatching network-vif-unplugged-ea00b08a-3d80-453b-8c1a-9bdc74ac652f {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 12:09:19 user nova-compute[73449]: DEBUG nova.compute.manager [req-23ef17aa-3185-4551-b77a-716c6c9898b0 req-d52d9347-e54e-425f-a9d5-3236d996cb09 service nova] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] Received event network-vif-unplugged-ea00b08a-3d80-453b-8c1a-9bdc74ac652f for instance with task_state deleting. {{(pid=73449) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 12:09:19 user nova-compute[73449]: DEBUG nova.compute.manager [req-23ef17aa-3185-4551-b77a-716c6c9898b0 req-d52d9347-e54e-425f-a9d5-3236d996cb09 service nova] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] Received event network-vif-plugged-ea00b08a-3d80-453b-8c1a-9bdc74ac652f {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:09:19 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-23ef17aa-3185-4551-b77a-716c6c9898b0 req-d52d9347-e54e-425f-a9d5-3236d996cb09 service nova] Acquiring lock "31f5f3d2-41d8-4a26-9eb2-18b891f94734-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:09:19 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-23ef17aa-3185-4551-b77a-716c6c9898b0 req-d52d9347-e54e-425f-a9d5-3236d996cb09 service nova] Lock "31f5f3d2-41d8-4a26-9eb2-18b891f94734-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:09:19 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-23ef17aa-3185-4551-b77a-716c6c9898b0 req-d52d9347-e54e-425f-a9d5-3236d996cb09 service nova] Lock "31f5f3d2-41d8-4a26-9eb2-18b891f94734-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:09:19 user nova-compute[73449]: DEBUG nova.compute.manager [req-23ef17aa-3185-4551-b77a-716c6c9898b0 req-d52d9347-e54e-425f-a9d5-3236d996cb09 service nova] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] No waiting events found dispatching network-vif-plugged-ea00b08a-3d80-453b-8c1a-9bdc74ac652f {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 12:09:19 user nova-compute[73449]: WARNING nova.compute.manager [req-23ef17aa-3185-4551-b77a-716c6c9898b0 req-d52d9347-e54e-425f-a9d5-3236d996cb09 service nova] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] Received unexpected event network-vif-plugged-ea00b08a-3d80-453b-8c1a-9bdc74ac652f for instance with vm_state active and task_state deleting.
Aug 17 12:09:19 user nova-compute[73449]: DEBUG nova.network.neutron [-] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] Updating instance_info_cache with network_info: [] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 12:09:19 user nova-compute[73449]: INFO nova.compute.manager [-] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] Took 1.02 seconds to deallocate network for instance.
Aug 17 12:09:19 user nova-compute[73449]: DEBUG nova.compute.manager [req-b512d220-e420-462f-b2b3-8ea42e0cb1ab req-eadc5b4e-85bf-45c5-bc2e-fd531f797508 service nova] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] Received event network-vif-deleted-ea00b08a-3d80-453b-8c1a-9bdc74ac652f {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:09:19 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:09:19 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:09:19 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:09:19 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:09:19 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=73449) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 12:09:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54c69eab-3597-4ca7-b698-169538b73a18/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:09:20 user nova-compute[73449]: INFO nova.compute.manager [None req-a12f0f33-b2ac-483b-bd1d-1ac6ade5355e tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] Took 0.84 seconds to detach 1 volumes for instance.
Aug 17 12:09:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a12f0f33-b2ac-483b-bd1d-1ac6ade5355e tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:09:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a12f0f33-b2ac-483b-bd1d-1ac6ade5355e tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:09:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54c69eab-3597-4ca7-b698-169538b73a18/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:09:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54c69eab-3597-4ca7-b698-169538b73a18/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:09:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-e2692b4b-7617-40b8-81e7-2838c0b6cb01 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Acquiring lock "54c69eab-3597-4ca7-b698-169538b73a18" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:09:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-e2692b4b-7617-40b8-81e7-2838c0b6cb01 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Lock "54c69eab-3597-4ca7-b698-169538b73a18" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:09:20 user nova-compute[73449]: INFO nova.compute.manager [None req-e2692b4b-7617-40b8-81e7-2838c0b6cb01 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] [instance: 54c69eab-3597-4ca7-b698-169538b73a18] Detaching volume 07e99eb7-0b46-4bc8-9d60-708b6087d4f3
Aug 17 12:09:20 user nova-compute[73449]: INFO nova.virt.block_device [None req-e2692b4b-7617-40b8-81e7-2838c0b6cb01 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] [instance: 54c69eab-3597-4ca7-b698-169538b73a18] Attempting to driver detach volume 07e99eb7-0b46-4bc8-9d60-708b6087d4f3 from mountpoint /dev/vdb
Aug 17 12:09:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54c69eab-3597-4ca7-b698-169538b73a18/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:09:20 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73449) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 12:09:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f607caf8-0910-4214-b2f7-ccd59cd0307a/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:09:20 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-e2692b4b-7617-40b8-81e7-2838c0b6cb01 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Attempting to detach device vdb from instance 54c69eab-3597-4ca7-b698-169538b73a18 from the persistent domain config. {{(pid=73449) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 12:09:20 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-e2692b4b-7617-40b8-81e7-2838c0b6cb01 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 12:09:20 user nova-compute[73449]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 12:09:20 user nova-compute[73449]:   <source dev="/dev/sdb"/>
Aug 17 12:09:20 user nova-compute[73449]:   <target dev="vdb" bus="virtio"/>
Aug 17 12:09:20 user nova-compute[73449]:   <serial>07e99eb7-0b46-4bc8-9d60-708b6087d4f3</serial>
Aug 17 12:09:20 user nova-compute[73449]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 12:09:20 user nova-compute[73449]: </disk>
Aug 17 12:09:20 user nova-compute[73449]:  {{(pid=73449) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 12:09:20 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-a12f0f33-b2ac-483b-bd1d-1ac6ade5355e tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 12:09:20 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-e2692b4b-7617-40b8-81e7-2838c0b6cb01 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Successfully detached device vdb from instance 54c69eab-3597-4ca7-b698-169538b73a18 from the persistent domain config.
Aug 17 12:09:20 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-e2692b4b-7617-40b8-81e7-2838c0b6cb01 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 54c69eab-3597-4ca7-b698-169538b73a18 from the live domain config. {{(pid=73449) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 12:09:20 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-e2692b4b-7617-40b8-81e7-2838c0b6cb01 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 12:09:20 user nova-compute[73449]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 12:09:20 user nova-compute[73449]:   <source dev="/dev/sdb"/>
Aug 17 12:09:20 user nova-compute[73449]:   <target dev="vdb" bus="virtio"/>
Aug 17 12:09:20 user nova-compute[73449]:   <serial>07e99eb7-0b46-4bc8-9d60-708b6087d4f3</serial>
Aug 17 12:09:20 user nova-compute[73449]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 12:09:20 user nova-compute[73449]: </disk>
Aug 17 12:09:20 user nova-compute[73449]:  {{(pid=73449) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 12:09:20 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-a12f0f33-b2ac-483b-bd1d-1ac6ade5355e tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 12:09:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a12f0f33-b2ac-483b-bd1d-1ac6ade5355e tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.367s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:09:20 user nova-compute[73449]: INFO nova.scheduler.client.report [None req-a12f0f33-b2ac-483b-bd1d-1ac6ade5355e tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Deleted allocations for instance 31f5f3d2-41d8-4a26-9eb2-18b891f94734
Aug 17 12:09:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f607caf8-0910-4214-b2f7-ccd59cd0307a/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:09:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f607caf8-0910-4214-b2f7-ccd59cd0307a/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:09:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a12f0f33-b2ac-483b-bd1d-1ac6ade5355e tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Lock "31f5f3d2-41d8-4a26-9eb2-18b891f94734" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.966s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:09:21 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f607caf8-0910-4214-b2f7-ccd59cd0307a/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:09:21 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fdfaf32-0957-453a-b1cf-9a3c19815c45/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:09:21 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Received event <DeviceRemovedEvent: 1692274161.158882, 54c69eab-3597-4ca7-b698-169538b73a18 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73449) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 12:09:21 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-e2692b4b-7617-40b8-81e7-2838c0b6cb01 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 54c69eab-3597-4ca7-b698-169538b73a18 {{(pid=73449) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 12:09:21 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-e2692b4b-7617-40b8-81e7-2838c0b6cb01 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Successfully detached device vdb from instance 54c69eab-3597-4ca7-b698-169538b73a18 from the live domain config.
Aug 17 12:09:21 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2692b4b-7617-40b8-81e7-2838c0b6cb01 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] [instance: 54c69eab-3597-4ca7-b698-169538b73a18] calling os-brick to detach iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 12:09:21 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2692b4b-7617-40b8-81e7-2838c0b6cb01 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, {'target_iqns': ['iqn.2010-10.org.openstack:07e99eb7-0b46-4bc8-9d60-708b6087d4f3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jUEIOGNv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 12:09:21 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-e2692b4b-7617-40b8-81e7-2838c0b6cb01 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 12:09:21 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-e2692b4b-7617-40b8-81e7-2838c0b6cb01 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 12:09:21 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-e2692b4b-7617-40b8-81e7-2838c0b6cb01 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 12:09:21 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2692b4b-7617-40b8-81e7-2838c0b6cb01 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:07e99eb7-0b46-4bc8-9d60-708b6087d4f3', 0)] {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 12:09:21 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:09:21 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:09:21 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6947bb8-b7c7-487a-b8f0-a08aa25e584c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:07e99eb7-0b46-4bc8-9d60-708b6087d4f3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:09:21 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:09:21 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:09:21 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[f739ba97-8db4-4824-b833-2edd30b01a2d]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e99eb7-0b46-4bc8-9d60-708b6087d4f3 (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:09:21 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2692b4b-7617-40b8-81e7-2838c0b6cb01 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49 (non-flash)
Aug 17 12:09:21 user nova-compute[73449]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e99eb7-0b46-4bc8-9d60-708b6087d4f3 (non-flash)
Aug 17 12:09:21 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 12:09:21 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2692b4b-7617-40b8-81e7-2838c0b6cb01 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49 (non-flash)
Aug 17 12:09:21 user nova-compute[73449]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e99eb7-0b46-4bc8-9d60-708b6087d4f3 (non-flash)
Aug 17 12:09:21 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 12:09:21 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2692b4b-7617-40b8-81e7-2838c0b6cb01 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe738604dc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:07e99eb7-0b46-4bc8-9d60-708b6087d4f3'): ({'sdb'}, set())}) {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 12:09:21 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-e2692b4b-7617-40b8-81e7-2838c0b6cb01 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Removing single pathed devices sdb {{(pid=73449) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 12:09:21 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:09:21 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fdfaf32-0957-453a-b1cf-9a3c19815c45/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:09:21 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fdfaf32-0957-453a-b1cf-9a3c19815c45/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:09:21 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:09:21 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f3e598b-e555-47e9-b613-08d10663bd22]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:09:21 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:09:21 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:09:21 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2992f91-c822-4db0-ae85-df4eee975eef]: (4, ('ok\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:09:21 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-e2692b4b-7617-40b8-81e7-2838c0b6cb01 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Flushing IO for device /dev/sdb {{(pid=73449) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 12:09:21 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:09:21 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:09:21 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[61e44928-7524-4c71-9f75-70acccf523b6]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:09:21 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-e2692b4b-7617-40b8-81e7-2838c0b6cb01 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73449) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 12:09:21 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:09:21 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:09:21 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3f4d308-ac92-44fe-b4eb-98fb9858dda4]: (4, ('1', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:09:21 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-e2692b4b-7617-40b8-81e7-2838c0b6cb01 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73449) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 12:09:21 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-e2692b4b-7617-40b8-81e7-2838c0b6cb01 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] SCSI volumes sdb have been removed. {{(pid=73449) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 12:09:21 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2692b4b-7617-40b8-81e7-2838c0b6cb01 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:07e99eb7-0b46-4bc8-9d60-708b6087d4f3')] {{(pid=73449) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 12:09:21 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07e99eb7-0b46-4bc8-9d60-708b6087d4f3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:09:21 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07e99eb7-0b46-4bc8-9d60-708b6087d4f3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:09:21 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[a50a9f55-f364-4c1f-8880-332deea00ea7]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:09:21 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2692b4b-7617-40b8-81e7-2838c0b6cb01 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:09:21 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07e99eb7-0b46-4bc8-9d60-708b6087d4f3 -p 172.16.0.220:3260 --logout {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:09:21 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fdfaf32-0957-453a-b1cf-9a3c19815c45/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:09:21 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89440604-1daf-4e7a-a524-2f9c21a9cb96/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:09:21 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07e99eb7-0b46-4bc8-9d60-708b6087d4f3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:09:21 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5370dbc-dc23-41c4-be0d-333edb01022b]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:07e99eb7-0b46-4bc8-9d60-708b6087d4f3, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:07e99eb7-0b46-4bc8-9d60-708b6087d4f3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:09:21 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2692b4b-7617-40b8-81e7-2838c0b6cb01 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:07e99eb7-0b46-4bc8-9d60-708b6087d4f3, portal: 172.16.0.220,3260]
Aug 17 12:09:21 user nova-compute[73449]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:07e99eb7-0b46-4bc8-9d60-708b6087d4f3, portal: 172.16.0.220,3260] successful.
Aug 17 12:09:21 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:09:21 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07e99eb7-0b46-4bc8-9d60-708b6087d4f3 -p 172.16.0.220:3260 --op delete {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:09:21 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07e99eb7-0b46-4bc8-9d60-708b6087d4f3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:09:21 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[52fde978-01ac-49e6-a253-dd694cd88d64]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:09:21 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2692b4b-7617-40b8-81e7-2838c0b6cb01 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:09:21 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-e2692b4b-7617-40b8-81e7-2838c0b6cb01 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 12:09:21 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2692b4b-7617-40b8-81e7-2838c0b6cb01 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] <== disconnect_volume: return (334ms) None {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 12:09:21 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2692b4b-7617-40b8-81e7-2838c0b6cb01 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] [instance: 54c69eab-3597-4ca7-b698-169538b73a18] Disconnected iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 12:09:21 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89440604-1daf-4e7a-a524-2f9c21a9cb96/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:09:21 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89440604-1daf-4e7a-a524-2f9c21a9cb96/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:09:21 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89440604-1daf-4e7a-a524-2f9c21a9cb96/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:09:21 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61201d5c-26f1-4c6d-a764-be2ee2e533ae/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:09:22 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61201d5c-26f1-4c6d-a764-be2ee2e533ae/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:09:22 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61201d5c-26f1-4c6d-a764-be2ee2e533ae/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:09:22 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61201d5c-26f1-4c6d-a764-be2ee2e533ae/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:09:22 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73449) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 12:09:22 user nova-compute[73449]: DEBUG nova.objects.instance [None req-e2692b4b-7617-40b8-81e7-2838c0b6cb01 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Lazy-loading 'flavor' on Instance uuid 54c69eab-3597-4ca7-b698-169538b73a18 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:09:22 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 12:09:22 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 12:09:22 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Hypervisor/Node resource view: name=user free_ram=8214MB free_disk=24.81606674194336GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73449) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 12:09:22 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:09:22 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:09:22 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-e2692b4b-7617-40b8-81e7-2838c0b6cb01 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Lock "54c69eab-3597-4ca7-b698-169538b73a18" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.137s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:09:22 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 89440604-1daf-4e7a-a524-2f9c21a9cb96 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 12:09:22 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 61201d5c-26f1-4c6d-a764-be2ee2e533ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 12:09:22 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 8fdfaf32-0957-453a-b1cf-9a3c19815c45 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 12:09:22 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 54c69eab-3597-4ca7-b698-169538b73a18 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 12:09:22 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance f607caf8-0910-4214-b2f7-ccd59cd0307a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 12:09:22 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=73449) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 12:09:22 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=73449) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 12:09:22 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:09:22 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-ba4ef75b-2552-42d0-9a27-f715c0115b12 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Acquiring lock "61201d5c-26f1-4c6d-a764-be2ee2e533ae" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:09:22 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-ba4ef75b-2552-42d0-9a27-f715c0115b12 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Lock "61201d5c-26f1-4c6d-a764-be2ee2e533ae" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:09:22 user nova-compute[73449]: INFO nova.compute.manager [None req-ba4ef75b-2552-42d0-9a27-f715c0115b12 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Detaching volume 12aa960e-96d4-4bae-b7eb-209200c9ec49
Aug 17 12:09:22 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 12:09:22 user nova-compute[73449]: INFO nova.virt.block_device [None req-ba4ef75b-2552-42d0-9a27-f715c0115b12 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Attempting to driver detach volume 12aa960e-96d4-4bae-b7eb-209200c9ec49 from mountpoint /dev/vdb
Aug 17 12:09:22 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 12:09:22 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-ba4ef75b-2552-42d0-9a27-f715c0115b12 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Attempting to detach device vdb from instance 61201d5c-26f1-4c6d-a764-be2ee2e533ae from the persistent domain config. {{(pid=73449) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 12:09:22 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-ba4ef75b-2552-42d0-9a27-f715c0115b12 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 12:09:22 user nova-compute[73449]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 12:09:22 user nova-compute[73449]:   <source dev="/dev/sdc"/>
Aug 17 12:09:22 user nova-compute[73449]:   <target dev="vdb" bus="virtio"/>
Aug 17 12:09:22 user nova-compute[73449]:   <serial>12aa960e-96d4-4bae-b7eb-209200c9ec49</serial>
Aug 17 12:09:22 user nova-compute[73449]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 17 12:09:22 user nova-compute[73449]: </disk>
Aug 17 12:09:22 user nova-compute[73449]:  {{(pid=73449) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 12:09:22 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-ba4ef75b-2552-42d0-9a27-f715c0115b12 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Successfully detached device vdb from instance 61201d5c-26f1-4c6d-a764-be2ee2e533ae from the persistent domain config.
Aug 17 12:09:22 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-ba4ef75b-2552-42d0-9a27-f715c0115b12 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 61201d5c-26f1-4c6d-a764-be2ee2e533ae from the live domain config. {{(pid=73449) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 12:09:22 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-ba4ef75b-2552-42d0-9a27-f715c0115b12 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 12:09:22 user nova-compute[73449]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 12:09:22 user nova-compute[73449]:   <source dev="/dev/sdc"/>
Aug 17 12:09:22 user nova-compute[73449]:   <target dev="vdb" bus="virtio"/>
Aug 17 12:09:22 user nova-compute[73449]:   <serial>12aa960e-96d4-4bae-b7eb-209200c9ec49</serial>
Aug 17 12:09:22 user nova-compute[73449]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 17 12:09:22 user nova-compute[73449]: </disk>
Aug 17 12:09:22 user nova-compute[73449]:  {{(pid=73449) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 12:09:22 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Compute_service record updated for user:user {{(pid=73449) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 12:09:22 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.347s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:09:23 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Received event <DeviceRemovedEvent: 1692274163.450995, 61201d5c-26f1-4c6d-a764-be2ee2e533ae => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73449) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 12:09:23 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-ba4ef75b-2552-42d0-9a27-f715c0115b12 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 61201d5c-26f1-4c6d-a764-be2ee2e533ae {{(pid=73449) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 12:09:23 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-ba4ef75b-2552-42d0-9a27-f715c0115b12 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Successfully detached device vdb from instance 61201d5c-26f1-4c6d-a764-be2ee2e533ae from the live domain config.
Aug 17 12:09:23 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba4ef75b-2552-42d0-9a27-f715c0115b12 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] calling os-brick to detach iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 12:09:23 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba4ef75b-2552-42d0-9a27-f715c0115b12 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, {'target_iqns': ['iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mOspuxWK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 12:09:23 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-ba4ef75b-2552-42d0-9a27-f715c0115b12 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 12:09:23 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-ba4ef75b-2552-42d0-9a27-f715c0115b12 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 12:09:23 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-ba4ef75b-2552-42d0-9a27-f715c0115b12 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 12:09:23 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba4ef75b-2552-42d0-9a27-f715c0115b12 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49', 0)] {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 12:09:23 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:09:23 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:09:23 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[4067de48-a455-4d24-abaa-871d3a4a4b60]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:09:23 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:09:23 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:09:23 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c849543-2978-4c3f-9c71-92bab8927689]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49 (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:09:23 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba4ef75b-2552-42d0-9a27-f715c0115b12 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49 (non-flash)
Aug 17 12:09:23 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 12:09:23 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba4ef75b-2552-42d0-9a27-f715c0115b12 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49 (non-flash)
Aug 17 12:09:23 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 12:09:23 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba4ef75b-2552-42d0-9a27-f715c0115b12 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe758107880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49'): ({'sdc'}, set())}) {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 12:09:23 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-ba4ef75b-2552-42d0-9a27-f715c0115b12 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Removing single pathed devices sdc {{(pid=73449) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 12:09:23 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:09:23 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:09:23 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[d40ccccc-54e1-4a2b-8901-1dcc83a84f02]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:09:23 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:09:23 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:09:23 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[712c9dc4-caaf-401e-aa0d-8bd38e1f5c40]: (4, ('ok\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:09:23 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-ba4ef75b-2552-42d0-9a27-f715c0115b12 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Flushing IO for device /dev/sdc {{(pid=73449) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 12:09:23 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:09:23 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:09:23 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9ad6694-f455-44d1-9f2a-adccedc471aa]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:09:23 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-ba4ef75b-2552-42d0-9a27-f715c0115b12 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73449) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 12:09:23 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:09:23 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:09:23 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[139183bf-fbfc-4da0-83af-d33268389038]: (4, ('1', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:09:23 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-ba4ef75b-2552-42d0-9a27-f715c0115b12 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73449) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 12:09:23 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-ba4ef75b-2552-42d0-9a27-f715c0115b12 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] SCSI volumes sdc have been removed. {{(pid=73449) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 12:09:23 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba4ef75b-2552-42d0-9a27-f715c0115b12 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49')] {{(pid=73449) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 12:09:23 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:09:23 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:09:23 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[eebc9250-61ab-4a48-ad4d-af1b730b3bc1]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:09:23 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba4ef75b-2552-42d0-9a27-f715c0115b12 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:09:23 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49 -p 172.16.0.220:3260 --logout {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:09:23 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:09:23 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c654b7e-568a-423b-ad06-d7570ccd4507]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:09:23 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba4ef75b-2552-42d0-9a27-f715c0115b12 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49, portal: 172.16.0.220,3260]
Aug 17 12:09:23 user nova-compute[73449]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49, portal: 172.16.0.220,3260] successful.
Aug 17 12:09:23 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:09:23 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49 -p 172.16.0.220:3260 --op delete {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:09:23 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12aa960e-96d4-4bae-b7eb-209200c9ec49 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:09:23 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[c01f1eb6-4f27-45e8-b5e7-92732521d2fc]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:09:23 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba4ef75b-2552-42d0-9a27-f715c0115b12 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:09:23 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-ba4ef75b-2552-42d0-9a27-f715c0115b12 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.254s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 12:09:23 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba4ef75b-2552-42d0-9a27-f715c0115b12 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] <== disconnect_volume: return (255ms) None {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 12:09:23 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba4ef75b-2552-42d0-9a27-f715c0115b12 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Disconnected iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 12:09:23 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:09:23 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:09:23 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Starting heal instance info cache {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 12:09:24 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "refresh_cache-8fdfaf32-0957-453a-b1cf-9a3c19815c45" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 12:09:24 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquired lock "refresh_cache-8fdfaf32-0957-453a-b1cf-9a3c19815c45" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 12:09:24 user nova-compute[73449]: DEBUG nova.network.neutron [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: 8fdfaf32-0957-453a-b1cf-9a3c19815c45] Forcefully refreshing network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 12:09:24 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bbc96784-122d-4609-9e46-84f158293b6a tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: f607caf8-0910-4214-b2f7-ccd59cd0307a] Calling os-brick to attach iSCSI Volume {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 12:09:24 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbc96784-122d-4609-9e46-84f158293b6a tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ec501637-ac1a-4722-a427-1dadd1d4ff82'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NcgOTCYo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 12:09:24 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-bbc96784-122d-4609-9e46-84f158293b6a tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 12:09:24 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-bbc96784-122d-4609-9e46-84f158293b6a tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 12:09:24 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-bbc96784-122d-4609-9e46-84f158293b6a tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 12:09:24 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-bbc96784-122d-4609-9e46-84f158293b6a tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 12:09:24 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-bbc96784-122d-4609-9e46-84f158293b6a tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ec501637-ac1a-4722-a427-1dadd1d4ff82" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 12:09:24 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-bbc96784-122d-4609-9e46-84f158293b6a tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ec501637-ac1a-4722-a427-1dadd1d4ff82" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 12:09:24 user nova-compute[73449]: INFO os_brick.initiator.connectors.iscsi [None req-bbc96784-122d-4609-9e46-84f158293b6a tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 12:09:24 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec501637-ac1a-4722-a427-1dadd1d4ff82 -p 172.16.0.220:3260 {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:09:24 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec501637-ac1a-4722-a427-1dadd1d4ff82 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:09:24 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[39edc85f-2223-4dab-b2cb-24db710690aa]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:09:24 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbc96784-122d-4609-9e46-84f158293b6a tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 12:09:24 user nova-compute[73449]:  {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:09:24 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec501637-ac1a-4722-a427-1dadd1d4ff82 -p 172.16.0.220:3260 --interface default --op new {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:09:24 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec501637-ac1a-4722-a427-1dadd1d4ff82 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:09:24 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[3897a403-7d2b-4e87-847e-192cc004d8c2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ec501637-ac1a-4722-a427-1dadd1d4ff82] added\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:09:24 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbc96784-122d-4609-9e46-84f158293b6a tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ec501637-ac1a-4722-a427-1dadd1d4ff82] added
Aug 17 12:09:24 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:09:24 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec501637-ac1a-4722-a427-1dadd1d4ff82 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:09:24 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec501637-ac1a-4722-a427-1dadd1d4ff82 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:09:24 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0028186-cbe5-4865-a57b-2481e4ac63db]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:09:24 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbc96784-122d-4609-9e46-84f158293b6a tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:09:24 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec501637-ac1a-4722-a427-1dadd1d4ff82 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:09:24 user nova-compute[73449]: DEBUG nova.objects.instance [None req-ba4ef75b-2552-42d0-9a27-f715c0115b12 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Lazy-loading 'flavor' on Instance uuid 61201d5c-26f1-4c6d-a764-be2ee2e533ae {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:09:24 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec501637-ac1a-4722-a427-1dadd1d4ff82 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:09:24 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f6ac028-4438-4928-abb2-f64755abafa0]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:09:24 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbc96784-122d-4609-9e46-84f158293b6a tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:09:24 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec501637-ac1a-4722-a427-1dadd1d4ff82 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NcgOTCYo {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:09:24 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec501637-ac1a-4722-a427-1dadd1d4ff82 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NcgOTCYo" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:09:24 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce1d70f1-4f8d-42a5-8c26-bb71e3f72b2c]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:09:24 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbc96784-122d-4609-9e46-84f158293b6a tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NcgOTCYo'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:09:24 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec501637-ac1a-4722-a427-1dadd1d4ff82 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:09:24 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-ba4ef75b-2552-42d0-9a27-f715c0115b12 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Lock "61201d5c-26f1-4c6d-a764-be2ee2e533ae" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.696s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:09:24 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec501637-ac1a-4722-a427-1dadd1d4ff82 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:09:24 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcd45785-b97f-440e-9159-1dee5fe0cc02]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:09:24 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbc96784-122d-4609-9e46-84f158293b6a tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:09:24 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:09:24 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:09:24 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9dffe2f-c069-4667-849c-d1ec3c0a0cf3]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:09:24 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbc96784-122d-4609-9e46-84f158293b6a tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 17 12:09:24 user nova-compute[73449]:  {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 12:09:24 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbc96784-122d-4609-9e46-84f158293b6a tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 17 12:09:24 user nova-compute[73449]:  {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 12:09:24 user nova-compute[73449]: WARNING os_brick.initiator.connectors.iscsi [None req-bbc96784-122d-4609-9e46-84f158293b6a tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 17 12:09:24 user nova-compute[73449]: 
Aug 17 12:09:24 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec501637-ac1a-4722-a427-1dadd1d4ff82 -p 172.16.0.220:3260 --login {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:09:24 user nova-compute[73449]: DEBUG nova.network.neutron [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: 8fdfaf32-0957-453a-b1cf-9a3c19815c45] Updating instance_info_cache with network_info: [{"id": "fb4a2e2a-cbf2-4141-bac3-c6033653bb84", "address": "fa:16:3e:c1:11:0e", "network": {"id": "1e184b35-0ffc-4c89-951b-d97b1961f72f", "bridge": "br-int", "label": "tempest-TestStampPattern-2134909631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c9e5daa31ad47e996b59f1b7c5db0d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb4a2e2a-cb", "ovs_interfaceid": "fb4a2e2a-cbf2-4141-bac3-c6033653bb84", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 12:09:24 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec501637-ac1a-4722-a427-1dadd1d4ff82 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:09:24 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[36421262-a858-400a-a4a0-3c427ceae10a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ec501637-ac1a-4722-a427-1dadd1d4ff82, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ec501637-ac1a-4722-a427-1dadd1d4ff82, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:09:24 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbc96784-122d-4609-9e46-84f158293b6a tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ec501637-ac1a-4722-a427-1dadd1d4ff82, portal: 172.16.0.220,3260]
Aug 17 12:09:24 user nova-compute[73449]: Login to [iface: default, target: iqn.2010-10.org.openstack:ec501637-ac1a-4722-a427-1dadd1d4ff82, portal: 172.16.0.220,3260] successful.
Aug 17 12:09:24 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:09:24 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Releasing lock "refresh_cache-8fdfaf32-0957-453a-b1cf-9a3c19815c45" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 12:09:24 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: 8fdfaf32-0957-453a-b1cf-9a3c19815c45] Updated the network info_cache for instance {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 12:09:24 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec501637-ac1a-4722-a427-1dadd1d4ff82 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:09:24 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:09:24 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec501637-ac1a-4722-a427-1dadd1d4ff82 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:09:24 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ad2d886-7dda-4c2c-99c0-a8e9faa0ce92]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:09:24 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbc96784-122d-4609-9e46-84f158293b6a tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:09:24 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:09:24 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:09:24 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f579fd7-569a-4e0d-a990-2d75f95c6572]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec501637-ac1a-4722-a427-1dadd1d4ff82 (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:09:24 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbc96784-122d-4609-9e46-84f158293b6a tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec501637-ac1a-4722-a427-1dadd1d4ff82 (non-flash)
Aug 17 12:09:24 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 12:09:24 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbc96784-122d-4609-9e46-84f158293b6a tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec501637-ac1a-4722-a427-1dadd1d4ff82 (non-flash)
Aug 17 12:09:24 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 12:09:24 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-bbc96784-122d-4609-9e46-84f158293b6a tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ec501637-ac1a-4722-a427-1dadd1d4ff82" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.265s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 12:09:24 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbc96784-122d-4609-9e46-84f158293b6a tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Connected to 172.16.0.220:3260 {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 12:09:24 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-bbc96784-122d-4609-9e46-84f158293b6a tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] HCTL ('33', '-', '-', 0) found on session 55 with lun 0 {{(pid=73449) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 12:09:24 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-bbc96784-122d-4609-9e46-84f158293b6a tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73449) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 12:09:24 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:09:24 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:09:24 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9ac0a68-cc91-481b-a4de-6dba26f6b065]: (4, ('- - 0', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:09:24 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-bbc96784-122d-4609-9e46-84f158293b6a tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73449) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 12:09:24 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbc96784-122d-4609-9e46-84f158293b6a tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NcgOTCYo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 12:09:25 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-07fc2510-2f6c-48b8-8c4a-fdad47d0ef56 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Acquiring lock "61201d5c-26f1-4c6d-a764-be2ee2e533ae" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:09:25 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-07fc2510-2f6c-48b8-8c4a-fdad47d0ef56 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Lock "61201d5c-26f1-4c6d-a764-be2ee2e533ae" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:09:25 user nova-compute[73449]: DEBUG nova.compute.manager [None req-07fc2510-2f6c-48b8-8c4a-fdad47d0ef56 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 12:09:25 user nova-compute[73449]: DEBUG nova.compute.manager [None req-07fc2510-2f6c-48b8-8c4a-fdad47d0ef56 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=73449) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 17 12:09:25 user nova-compute[73449]: DEBUG nova.objects.instance [None req-07fc2510-2f6c-48b8-8c4a-fdad47d0ef56 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Lazy-loading 'flavor' on Instance uuid 61201d5c-26f1-4c6d-a764-be2ee2e533ae {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:09:25 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:09:25 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:09:25 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:09:25 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:09:25 user nova-compute[73449]: DEBUG nova.compute.manager [req-485d56f7-6a60-4784-84e5-b1f0d6346955 req-31e59335-83d6-4e10-872a-7b79f9da718a service nova] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Received event network-vif-unplugged-f9f6066e-ddd2-4e41-b92a-5713cfb9a223 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:09:25 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-485d56f7-6a60-4784-84e5-b1f0d6346955 req-31e59335-83d6-4e10-872a-7b79f9da718a service nova] Acquiring lock "61201d5c-26f1-4c6d-a764-be2ee2e533ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:09:25 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-485d56f7-6a60-4784-84e5-b1f0d6346955 req-31e59335-83d6-4e10-872a-7b79f9da718a service nova] Lock "61201d5c-26f1-4c6d-a764-be2ee2e533ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:09:25 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-485d56f7-6a60-4784-84e5-b1f0d6346955 req-31e59335-83d6-4e10-872a-7b79f9da718a service nova] Lock "61201d5c-26f1-4c6d-a764-be2ee2e533ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:09:25 user nova-compute[73449]: DEBUG nova.compute.manager [req-485d56f7-6a60-4784-84e5-b1f0d6346955 req-31e59335-83d6-4e10-872a-7b79f9da718a service nova] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] No waiting events found dispatching network-vif-unplugged-f9f6066e-ddd2-4e41-b92a-5713cfb9a223 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 12:09:25 user nova-compute[73449]: WARNING nova.compute.manager [req-485d56f7-6a60-4784-84e5-b1f0d6346955 req-31e59335-83d6-4e10-872a-7b79f9da718a service nova] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Received unexpected event network-vif-unplugged-f9f6066e-ddd2-4e41-b92a-5713cfb9a223 for instance with vm_state active and task_state powering-off.
Aug 17 12:09:25 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-bbc96784-122d-4609-9e46-84f158293b6a tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.295s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 12:09:25 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbc96784-122d-4609-9e46-84f158293b6a tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] <== connect_volume: return (1296ms) {'type': 'block', 'scsi_wwn': '23933343731306530', 'path': '/dev/sdb'} {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 12:09:25 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bbc96784-122d-4609-9e46-84f158293b6a tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: f607caf8-0910-4214-b2f7-ccd59cd0307a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23933343731306530', 'path': '/dev/sdb'} {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 12:09:25 user nova-compute[73449]: DEBUG nova.objects.instance [None req-bbc96784-122d-4609-9e46-84f158293b6a tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Lazy-loading 'flavor' on Instance uuid f607caf8-0910-4214-b2f7-ccd59cd0307a {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:09:25 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-bbc96784-122d-4609-9e46-84f158293b6a tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 12:09:25 user nova-compute[73449]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 12:09:25 user nova-compute[73449]:   <source dev="/dev/sdb"/>
Aug 17 12:09:25 user nova-compute[73449]:   <target dev="vdb" bus="virtio"/>
Aug 17 12:09:25 user nova-compute[73449]:   <serial>ec501637-ac1a-4722-a427-1dadd1d4ff82</serial>
Aug 17 12:09:25 user nova-compute[73449]: </disk>
Aug 17 12:09:25 user nova-compute[73449]:  {{(pid=73449) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 12:09:25 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:09:25 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:09:25 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:09:25 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:09:26 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Instance destroyed successfully.
Aug 17 12:09:26 user nova-compute[73449]: DEBUG nova.compute.manager [None req-07fc2510-2f6c-48b8-8c4a-fdad47d0ef56 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 12:09:26 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-bbc96784-122d-4609-9e46-84f158293b6a tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] No BDM found with device name vda, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 12:09:26 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-bbc96784-122d-4609-9e46-84f158293b6a tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 12:09:26 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-bbc96784-122d-4609-9e46-84f158293b6a tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] No VIF found with MAC fa:16:3e:b4:1b:4f, not building metadata {{(pid=73449) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 12:09:26 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-07fc2510-2f6c-48b8-8c4a-fdad47d0ef56 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Lock "61201d5c-26f1-4c6d-a764-be2ee2e533ae" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.119s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:09:26 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-bbc96784-122d-4609-9e46-84f158293b6a tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Lock "f607caf8-0910-4214-b2f7-ccd59cd0307a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.625s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:09:26 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:09:26 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:09:26 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:09:26 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:09:26 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:09:26 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:09:26 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:09:27 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6a817c0a-02e3-4b21-bcdb-0330e9c8ba02 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Acquiring lock "f607caf8-0910-4214-b2f7-ccd59cd0307a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:09:27 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6a817c0a-02e3-4b21-bcdb-0330e9c8ba02 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Lock "f607caf8-0910-4214-b2f7-ccd59cd0307a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:09:27 user nova-compute[73449]: INFO nova.compute.manager [None req-6a817c0a-02e3-4b21-bcdb-0330e9c8ba02 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: f607caf8-0910-4214-b2f7-ccd59cd0307a] Detaching volume ec501637-ac1a-4722-a427-1dadd1d4ff82
Aug 17 12:09:27 user nova-compute[73449]: INFO nova.virt.block_device [None req-6a817c0a-02e3-4b21-bcdb-0330e9c8ba02 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: f607caf8-0910-4214-b2f7-ccd59cd0307a] Attempting to driver detach volume ec501637-ac1a-4722-a427-1dadd1d4ff82 from mountpoint /dev/vdb
Aug 17 12:09:27 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6a817c0a-02e3-4b21-bcdb-0330e9c8ba02 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Attempting to detach device vdb from instance f607caf8-0910-4214-b2f7-ccd59cd0307a from the persistent domain config. {{(pid=73449) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 12:09:27 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-6a817c0a-02e3-4b21-bcdb-0330e9c8ba02 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 12:09:27 user nova-compute[73449]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 12:09:27 user nova-compute[73449]:   <source dev="/dev/sdb"/>
Aug 17 12:09:27 user nova-compute[73449]:   <target dev="vdb" bus="virtio"/>
Aug 17 12:09:27 user nova-compute[73449]:   <serial>ec501637-ac1a-4722-a427-1dadd1d4ff82</serial>
Aug 17 12:09:27 user nova-compute[73449]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 12:09:27 user nova-compute[73449]: </disk>
Aug 17 12:09:27 user nova-compute[73449]:  {{(pid=73449) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 12:09:27 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-6a817c0a-02e3-4b21-bcdb-0330e9c8ba02 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Successfully detached device vdb from instance f607caf8-0910-4214-b2f7-ccd59cd0307a from the persistent domain config.
Aug 17 12:09:27 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6a817c0a-02e3-4b21-bcdb-0330e9c8ba02 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f607caf8-0910-4214-b2f7-ccd59cd0307a from the live domain config. {{(pid=73449) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 12:09:27 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-6a817c0a-02e3-4b21-bcdb-0330e9c8ba02 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 12:09:27 user nova-compute[73449]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 12:09:27 user nova-compute[73449]:   <source dev="/dev/sdb"/>
Aug 17 12:09:27 user nova-compute[73449]:   <target dev="vdb" bus="virtio"/>
Aug 17 12:09:27 user nova-compute[73449]:   <serial>ec501637-ac1a-4722-a427-1dadd1d4ff82</serial>
Aug 17 12:09:27 user nova-compute[73449]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 12:09:27 user nova-compute[73449]: </disk>
Aug 17 12:09:27 user nova-compute[73449]:  {{(pid=73449) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 12:09:27 user nova-compute[73449]: DEBUG nova.compute.manager [req-771350d3-3b97-44b9-acb0-8d143f97ef63 req-ec7425f2-d85a-47c8-90f3-57092631e93b service nova] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Received event network-vif-plugged-f9f6066e-ddd2-4e41-b92a-5713cfb9a223 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:09:27 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-771350d3-3b97-44b9-acb0-8d143f97ef63 req-ec7425f2-d85a-47c8-90f3-57092631e93b service nova] Acquiring lock "61201d5c-26f1-4c6d-a764-be2ee2e533ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:09:27 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-771350d3-3b97-44b9-acb0-8d143f97ef63 req-ec7425f2-d85a-47c8-90f3-57092631e93b service nova] Lock "61201d5c-26f1-4c6d-a764-be2ee2e533ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:09:27 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-771350d3-3b97-44b9-acb0-8d143f97ef63 req-ec7425f2-d85a-47c8-90f3-57092631e93b service nova] Lock "61201d5c-26f1-4c6d-a764-be2ee2e533ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:09:27 user nova-compute[73449]: DEBUG nova.compute.manager [req-771350d3-3b97-44b9-acb0-8d143f97ef63 req-ec7425f2-d85a-47c8-90f3-57092631e93b service nova] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] No waiting events found dispatching network-vif-plugged-f9f6066e-ddd2-4e41-b92a-5713cfb9a223 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 12:09:27 user nova-compute[73449]: WARNING nova.compute.manager [req-771350d3-3b97-44b9-acb0-8d143f97ef63 req-ec7425f2-d85a-47c8-90f3-57092631e93b service nova] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Received unexpected event network-vif-plugged-f9f6066e-ddd2-4e41-b92a-5713cfb9a223 for instance with vm_state stopped and task_state None.
Aug 17 12:09:27 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Received event <DeviceRemovedEvent: 1692274167.6059337, f607caf8-0910-4214-b2f7-ccd59cd0307a => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73449) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 12:09:27 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6a817c0a-02e3-4b21-bcdb-0330e9c8ba02 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f607caf8-0910-4214-b2f7-ccd59cd0307a {{(pid=73449) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 12:09:27 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-6a817c0a-02e3-4b21-bcdb-0330e9c8ba02 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Successfully detached device vdb from instance f607caf8-0910-4214-b2f7-ccd59cd0307a from the live domain config.
Aug 17 12:09:27 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a817c0a-02e3-4b21-bcdb-0330e9c8ba02 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: f607caf8-0910-4214-b2f7-ccd59cd0307a] calling os-brick to detach iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 12:09:27 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a817c0a-02e3-4b21-bcdb-0330e9c8ba02 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, {'target_iqns': ['iqn.2010-10.org.openstack:ec501637-ac1a-4722-a427-1dadd1d4ff82'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NcgOTCYo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 12:09:27 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-6a817c0a-02e3-4b21-bcdb-0330e9c8ba02 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 12:09:27 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-6a817c0a-02e3-4b21-bcdb-0330e9c8ba02 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 12:09:27 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-6a817c0a-02e3-4b21-bcdb-0330e9c8ba02 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 12:09:27 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a817c0a-02e3-4b21-bcdb-0330e9c8ba02 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ec501637-ac1a-4722-a427-1dadd1d4ff82', 0)] {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 12:09:27 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:09:27 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:09:27 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[391781dd-9e43-4334-a9cb-8b5acdd46c44]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ec501637-ac1a-4722-a427-1dadd1d4ff82\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:09:27 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:09:27 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:09:27 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[82ea3221-7340-49d3-840a-7e266c00a00d]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec501637-ac1a-4722-a427-1dadd1d4ff82 (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:09:27 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a817c0a-02e3-4b21-bcdb-0330e9c8ba02 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec501637-ac1a-4722-a427-1dadd1d4ff82 (non-flash)
Aug 17 12:09:27 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 12:09:27 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a817c0a-02e3-4b21-bcdb-0330e9c8ba02 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec501637-ac1a-4722-a427-1dadd1d4ff82 (non-flash)
Aug 17 12:09:27 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 12:09:27 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a817c0a-02e3-4b21-bcdb-0330e9c8ba02 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe758105120>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ec501637-ac1a-4722-a427-1dadd1d4ff82'): ({'sdb'}, set())}) {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 12:09:27 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-6a817c0a-02e3-4b21-bcdb-0330e9c8ba02 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Removing single pathed devices sdb {{(pid=73449) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 12:09:27 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:09:27 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:09:27 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[f62e765c-57d5-42f1-96bc-85b0138241ec]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:09:27 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:09:27 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:09:27 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[c05fa8d1-6f60-4fa0-9a3c-4fc1efbfd81b]: (4, ('ok\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:09:27 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-6a817c0a-02e3-4b21-bcdb-0330e9c8ba02 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Flushing IO for device /dev/sdb {{(pid=73449) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 12:09:27 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:09:27 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:09:27 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[0967f4ed-ff62-4114-85e6-9e41511070a0]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:09:27 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-6a817c0a-02e3-4b21-bcdb-0330e9c8ba02 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73449) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 12:09:27 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:09:27 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:09:27 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:09:27 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[a76f3dd8-1c05-48aa-a6d7-971635d116c4]: (4, ('1', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:09:27 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-6a817c0a-02e3-4b21-bcdb-0330e9c8ba02 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73449) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 12:09:27 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-6a817c0a-02e3-4b21-bcdb-0330e9c8ba02 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] SCSI volumes sdb have been removed. {{(pid=73449) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 12:09:27 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a817c0a-02e3-4b21-bcdb-0330e9c8ba02 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ec501637-ac1a-4722-a427-1dadd1d4ff82')] {{(pid=73449) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 12:09:27 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec501637-ac1a-4722-a427-1dadd1d4ff82 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:09:27 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec501637-ac1a-4722-a427-1dadd1d4ff82 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:09:27 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a7de461-cd80-4444-832d-824e5e686b35]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:09:27 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a817c0a-02e3-4b21-bcdb-0330e9c8ba02 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:09:27 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec501637-ac1a-4722-a427-1dadd1d4ff82 -p 172.16.0.220:3260 --logout {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:09:27 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec501637-ac1a-4722-a427-1dadd1d4ff82 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:09:27 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[4acabdc2-77a6-415e-90a5-535c169480f5]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:ec501637-ac1a-4722-a427-1dadd1d4ff82, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:ec501637-ac1a-4722-a427-1dadd1d4ff82, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:09:27 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a817c0a-02e3-4b21-bcdb-0330e9c8ba02 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:ec501637-ac1a-4722-a427-1dadd1d4ff82, portal: 172.16.0.220,3260]
Aug 17 12:09:27 user nova-compute[73449]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:ec501637-ac1a-4722-a427-1dadd1d4ff82, portal: 172.16.0.220,3260] successful.
Aug 17 12:09:27 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:09:27 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec501637-ac1a-4722-a427-1dadd1d4ff82 -p 172.16.0.220:3260 --op delete {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:09:27 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec501637-ac1a-4722-a427-1dadd1d4ff82 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:09:27 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[97b9f004-7668-46e2-b427-21afd987a5ba]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:09:27 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a817c0a-02e3-4b21-bcdb-0330e9c8ba02 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:09:27 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-6a817c0a-02e3-4b21-bcdb-0330e9c8ba02 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.264s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 12:09:27 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a817c0a-02e3-4b21-bcdb-0330e9c8ba02 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] <== disconnect_volume: return (265ms) None {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 12:09:27 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a817c0a-02e3-4b21-bcdb-0330e9c8ba02 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: f607caf8-0910-4214-b2f7-ccd59cd0307a] Disconnected iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 12:09:28 user nova-compute[73449]: DEBUG nova.objects.instance [None req-6a817c0a-02e3-4b21-bcdb-0330e9c8ba02 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Lazy-loading 'flavor' on Instance uuid f607caf8-0910-4214-b2f7-ccd59cd0307a {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:09:28 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6a817c0a-02e3-4b21-bcdb-0330e9c8ba02 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Lock "f607caf8-0910-4214-b2f7-ccd59cd0307a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.633s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:09:32 user nova-compute[73449]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692274157.714273, 31f5f3d2-41d8-4a26-9eb2-18b891f94734 => Stopped> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 12:09:32 user nova-compute[73449]: INFO nova.compute.manager [-] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] VM Stopped (Lifecycle Event)
Aug 17 12:09:32 user nova-compute[73449]: DEBUG nova.compute.manager [None req-9e0aa0bc-dc30-490f-9c54-a66bb4fd1a61 None None] [instance: 31f5f3d2-41d8-4a26-9eb2-18b891f94734] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 12:09:32 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:09:32 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:09:32 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73449) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 12:09:32 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:09:32 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:09:32 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:09:37 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:09:37 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:09:37 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73449) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 12:09:37 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:09:37 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:09:37 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:09:38 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:09:41 user nova-compute[73449]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692274166.1443815, 61201d5c-26f1-4c6d-a764-be2ee2e533ae => Stopped> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 12:09:41 user nova-compute[73449]: INFO nova.compute.manager [-] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] VM Stopped (Lifecycle Event)
Aug 17 12:09:41 user nova-compute[73449]: DEBUG nova.compute.manager [None req-3c9180ae-1f49-44d6-b58b-e4277822c066 None None] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 12:09:41 user nova-compute[73449]: DEBUG nova.compute.manager [None req-3c9180ae-1f49-44d6-b58b-e4277822c066 None None] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 12:09:42 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:09:43 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:09:47 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:09:52 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:09:57 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:09:57 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:09:57 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=73449) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 12:09:57 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:09:57 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:09:57 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:10:02 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:10:07 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:10:07 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:10:08 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-ea8dcd79-7692-4ec1-bb62-dea9c4b2614e tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Acquiring lock "89440604-1daf-4e7a-a524-2f9c21a9cb96" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:10:08 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-ea8dcd79-7692-4ec1-bb62-dea9c4b2614e tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Lock "89440604-1daf-4e7a-a524-2f9c21a9cb96" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:10:08 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-ea8dcd79-7692-4ec1-bb62-dea9c4b2614e tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Acquiring lock "89440604-1daf-4e7a-a524-2f9c21a9cb96-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:10:08 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-ea8dcd79-7692-4ec1-bb62-dea9c4b2614e tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Lock "89440604-1daf-4e7a-a524-2f9c21a9cb96-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:10:08 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-ea8dcd79-7692-4ec1-bb62-dea9c4b2614e tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Lock "89440604-1daf-4e7a-a524-2f9c21a9cb96-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:10:08 user nova-compute[73449]: INFO nova.compute.manager [None req-ea8dcd79-7692-4ec1-bb62-dea9c4b2614e tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 89440604-1daf-4e7a-a524-2f9c21a9cb96] Terminating instance
Aug 17 12:10:08 user nova-compute[73449]: DEBUG nova.compute.manager [None req-ea8dcd79-7692-4ec1-bb62-dea9c4b2614e tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 89440604-1daf-4e7a-a524-2f9c21a9cb96] Start destroying the instance on the hypervisor. {{(pid=73449) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 12:10:08 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:10:08 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:10:08 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:10:08 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:10:08 user nova-compute[73449]: DEBUG nova.compute.manager [req-b05b58de-08a6-4d66-a313-bc66fb0c38d4 req-491319b6-9a57-44f7-b533-ce227b4a8a5f service nova] [instance: 89440604-1daf-4e7a-a524-2f9c21a9cb96] Received event network-vif-unplugged-7ebcec20-01ec-4807-876d-d95bff0a8a77 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:10:08 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-b05b58de-08a6-4d66-a313-bc66fb0c38d4 req-491319b6-9a57-44f7-b533-ce227b4a8a5f service nova] Acquiring lock "89440604-1daf-4e7a-a524-2f9c21a9cb96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:10:08 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-b05b58de-08a6-4d66-a313-bc66fb0c38d4 req-491319b6-9a57-44f7-b533-ce227b4a8a5f service nova] Lock "89440604-1daf-4e7a-a524-2f9c21a9cb96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:10:08 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-b05b58de-08a6-4d66-a313-bc66fb0c38d4 req-491319b6-9a57-44f7-b533-ce227b4a8a5f service nova] Lock "89440604-1daf-4e7a-a524-2f9c21a9cb96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:10:08 user nova-compute[73449]: DEBUG nova.compute.manager [req-b05b58de-08a6-4d66-a313-bc66fb0c38d4 req-491319b6-9a57-44f7-b533-ce227b4a8a5f service nova] [instance: 89440604-1daf-4e7a-a524-2f9c21a9cb96] No waiting events found dispatching network-vif-unplugged-7ebcec20-01ec-4807-876d-d95bff0a8a77 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 12:10:08 user nova-compute[73449]: DEBUG nova.compute.manager [req-b05b58de-08a6-4d66-a313-bc66fb0c38d4 req-491319b6-9a57-44f7-b533-ce227b4a8a5f service nova] [instance: 89440604-1daf-4e7a-a524-2f9c21a9cb96] Received event network-vif-unplugged-7ebcec20-01ec-4807-876d-d95bff0a8a77 for instance with task_state deleting. {{(pid=73449) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 12:10:08 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:10:08 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: 89440604-1daf-4e7a-a524-2f9c21a9cb96] Instance destroyed successfully.
Aug 17 12:10:08 user nova-compute[73449]: DEBUG nova.objects.instance [None req-ea8dcd79-7692-4ec1-bb62-dea9c4b2614e tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Lazy-loading 'resources' on Instance uuid 89440604-1daf-4e7a-a524-2f9c21a9cb96 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:10:08 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-ea8dcd79-7692-4ec1-bb62-dea9c4b2614e tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T11:50:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2138348058',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2138348058',id=26,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T11:50:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4ec3b0b72e47448ebe99f9fc64119c1c',ramdisk_id='',reservation_id='r-uvhfpgje',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1818019421',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T11:52:27Z,user_data=None,user_id='14eb3826311a4f8f91d8264e87f7b866',uuid=89440604-1daf-4e7a-a524-2f9c21a9cb96,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7ebcec20-01ec-4807-876d-d95bff0a8a77", "address": "fa:16:3e:52:45:6e", "network": {"id": "9455bb75-f75a-41ff-8f6f-49f55aa738f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-425274599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec3b0b72e47448ebe99f9fc64119c1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ebcec20-01", "ovs_interfaceid": "7ebcec20-01ec-4807-876d-d95bff0a8a77", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 12:10:08 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-ea8dcd79-7692-4ec1-bb62-dea9c4b2614e tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Converting VIF {"id": "7ebcec20-01ec-4807-876d-d95bff0a8a77", "address": "fa:16:3e:52:45:6e", "network": {"id": "9455bb75-f75a-41ff-8f6f-49f55aa738f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-425274599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec3b0b72e47448ebe99f9fc64119c1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ebcec20-01", "ovs_interfaceid": "7ebcec20-01ec-4807-876d-d95bff0a8a77", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 12:10:08 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-ea8dcd79-7692-4ec1-bb62-dea9c4b2614e tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:52:45:6e,bridge_name='br-int',has_traffic_filtering=True,id=7ebcec20-01ec-4807-876d-d95bff0a8a77,network=Network(9455bb75-f75a-41ff-8f6f-49f55aa738f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ebcec20-01') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 12:10:08 user nova-compute[73449]: DEBUG os_vif [None req-ea8dcd79-7692-4ec1-bb62-dea9c4b2614e tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:52:45:6e,bridge_name='br-int',has_traffic_filtering=True,id=7ebcec20-01ec-4807-876d-d95bff0a8a77,network=Network(9455bb75-f75a-41ff-8f6f-49f55aa738f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ebcec20-01') {{(pid=73449) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 12:10:08 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:10:08 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7ebcec20-01, bridge=br-int, if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 12:10:08 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:10:08 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:10:08 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:10:08 user nova-compute[73449]: INFO os_vif [None req-ea8dcd79-7692-4ec1-bb62-dea9c4b2614e tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:52:45:6e,bridge_name='br-int',has_traffic_filtering=True,id=7ebcec20-01ec-4807-876d-d95bff0a8a77,network=Network(9455bb75-f75a-41ff-8f6f-49f55aa738f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ebcec20-01')
Aug 17 12:10:08 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-ea8dcd79-7692-4ec1-bb62-dea9c4b2614e tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 89440604-1daf-4e7a-a524-2f9c21a9cb96] Deleting instance files /opt/stack/data/nova/instances/89440604-1daf-4e7a-a524-2f9c21a9cb96_del
Aug 17 12:10:08 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-ea8dcd79-7692-4ec1-bb62-dea9c4b2614e tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 89440604-1daf-4e7a-a524-2f9c21a9cb96] Deletion of /opt/stack/data/nova/instances/89440604-1daf-4e7a-a524-2f9c21a9cb96_del complete
Aug 17 12:10:08 user nova-compute[73449]: INFO nova.compute.manager [None req-ea8dcd79-7692-4ec1-bb62-dea9c4b2614e tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] [instance: 89440604-1daf-4e7a-a524-2f9c21a9cb96] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 17 12:10:08 user nova-compute[73449]: DEBUG oslo.service.loopingcall [None req-ea8dcd79-7692-4ec1-bb62-dea9c4b2614e tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73449) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 12:10:08 user nova-compute[73449]: DEBUG nova.compute.manager [-] [instance: 89440604-1daf-4e7a-a524-2f9c21a9cb96] Deallocating network for instance {{(pid=73449) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 12:10:08 user nova-compute[73449]: DEBUG nova.network.neutron [-] [instance: 89440604-1daf-4e7a-a524-2f9c21a9cb96] deallocate_for_instance() {{(pid=73449) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 12:10:09 user nova-compute[73449]: DEBUG nova.network.neutron [-] [instance: 89440604-1daf-4e7a-a524-2f9c21a9cb96] Updating instance_info_cache with network_info: [] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 12:10:09 user nova-compute[73449]: INFO nova.compute.manager [-] [instance: 89440604-1daf-4e7a-a524-2f9c21a9cb96] Took 0.49 seconds to deallocate network for instance.
Aug 17 12:10:09 user nova-compute[73449]: DEBUG nova.compute.manager [req-d81fa903-effb-44cc-a051-2f9e64239c39 req-164b552c-069f-4544-b941-a9f949bb9ab5 service nova] [instance: 89440604-1daf-4e7a-a524-2f9c21a9cb96] Received event network-vif-deleted-7ebcec20-01ec-4807-876d-d95bff0a8a77 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:10:09 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-ea8dcd79-7692-4ec1-bb62-dea9c4b2614e tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:10:09 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-ea8dcd79-7692-4ec1-bb62-dea9c4b2614e tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:10:09 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-ea8dcd79-7692-4ec1-bb62-dea9c4b2614e tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 12:10:09 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-ea8dcd79-7692-4ec1-bb62-dea9c4b2614e tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 12:10:09 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-ea8dcd79-7692-4ec1-bb62-dea9c4b2614e tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.195s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:10:09 user nova-compute[73449]: INFO nova.scheduler.client.report [None req-ea8dcd79-7692-4ec1-bb62-dea9c4b2614e tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Deleted allocations for instance 89440604-1daf-4e7a-a524-2f9c21a9cb96
Aug 17 12:10:09 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-ea8dcd79-7692-4ec1-bb62-dea9c4b2614e tempest-ServerBootFromVolumeStableRescueTest-1818019421 tempest-ServerBootFromVolumeStableRescueTest-1818019421-project-member] Lock "89440604-1daf-4e7a-a524-2f9c21a9cb96" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.751s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:10:09 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:10:10 user nova-compute[73449]: DEBUG nova.compute.manager [req-552c61c1-117b-4d30-9e1e-315fe0d88cfa req-db632c4a-af32-4239-b203-cae916f3211d service nova] [instance: 89440604-1daf-4e7a-a524-2f9c21a9cb96] Received event network-vif-plugged-7ebcec20-01ec-4807-876d-d95bff0a8a77 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:10:10 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-552c61c1-117b-4d30-9e1e-315fe0d88cfa req-db632c4a-af32-4239-b203-cae916f3211d service nova] Acquiring lock "89440604-1daf-4e7a-a524-2f9c21a9cb96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:10:10 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-552c61c1-117b-4d30-9e1e-315fe0d88cfa req-db632c4a-af32-4239-b203-cae916f3211d service nova] Lock "89440604-1daf-4e7a-a524-2f9c21a9cb96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:10:10 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-552c61c1-117b-4d30-9e1e-315fe0d88cfa req-db632c4a-af32-4239-b203-cae916f3211d service nova] Lock "89440604-1daf-4e7a-a524-2f9c21a9cb96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:10:10 user nova-compute[73449]: DEBUG nova.compute.manager [req-552c61c1-117b-4d30-9e1e-315fe0d88cfa req-db632c4a-af32-4239-b203-cae916f3211d service nova] [instance: 89440604-1daf-4e7a-a524-2f9c21a9cb96] No waiting events found dispatching network-vif-plugged-7ebcec20-01ec-4807-876d-d95bff0a8a77 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 12:10:10 user nova-compute[73449]: WARNING nova.compute.manager [req-552c61c1-117b-4d30-9e1e-315fe0d88cfa req-db632c4a-af32-4239-b203-cae916f3211d service nova] [instance: 89440604-1daf-4e7a-a524-2f9c21a9cb96] Received unexpected event network-vif-plugged-7ebcec20-01ec-4807-876d-d95bff0a8a77 for instance with vm_state deleted and task_state None.
Aug 17 12:10:10 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:10:11 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-81f8d9ca-6cef-4963-9b8a-a8dc80c57b7c tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Acquiring lock "54c69eab-3597-4ca7-b698-169538b73a18" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:10:11 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-81f8d9ca-6cef-4963-9b8a-a8dc80c57b7c tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Lock "54c69eab-3597-4ca7-b698-169538b73a18" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:10:11 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-81f8d9ca-6cef-4963-9b8a-a8dc80c57b7c tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Acquiring lock "54c69eab-3597-4ca7-b698-169538b73a18-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:10:11 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-81f8d9ca-6cef-4963-9b8a-a8dc80c57b7c tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Lock "54c69eab-3597-4ca7-b698-169538b73a18-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:10:11 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-81f8d9ca-6cef-4963-9b8a-a8dc80c57b7c tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Lock "54c69eab-3597-4ca7-b698-169538b73a18-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:10:11 user nova-compute[73449]: INFO nova.compute.manager [None req-81f8d9ca-6cef-4963-9b8a-a8dc80c57b7c tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] [instance: 54c69eab-3597-4ca7-b698-169538b73a18] Terminating instance
Aug 17 12:10:11 user nova-compute[73449]: DEBUG nova.compute.manager [None req-81f8d9ca-6cef-4963-9b8a-a8dc80c57b7c tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] [instance: 54c69eab-3597-4ca7-b698-169538b73a18] Start destroying the instance on the hypervisor. {{(pid=73449) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 12:10:11 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:10:11 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:10:11 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:10:11 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:10:11 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:10:11 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:10:11 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73449) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 12:10:12 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: 54c69eab-3597-4ca7-b698-169538b73a18] Instance destroyed successfully.
Aug 17 12:10:12 user nova-compute[73449]: DEBUG nova.objects.instance [None req-81f8d9ca-6cef-4963-9b8a-a8dc80c57b7c tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Lazy-loading 'resources' on Instance uuid 54c69eab-3597-4ca7-b698-169538b73a18 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:10:12 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-81f8d9ca-6cef-4963-9b8a-a8dc80c57b7c tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T12:07:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-324664257',display_name='tempest-TestStampPattern-server-324664257',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-324664257',id=48,image_ref='a3b04a4b-3e0f-468d-99e3-a58fe1fd12a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIJ2Eo5DY98v4ABNkSPsmOpSAggLOMtuKT7FC5l8WhxwKHhwEcVH95zEdzfXTi8XjE0vKAypvTBXbrGRvlqVzqU569MwCVfJPBtduUClfPdtl8n174kTkHvx5qjovHToOQ==',key_name='tempest-TestStampPattern-923522805',keypairs=<?>,launch_index=0,launched_at=2023-08-17T12:07:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3c9e5daa31ad47e996b59f1b7c5db0d4',ramdisk_id='',reservation_id='r-6ovqss7i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='8fdfaf32-0957-453a-b1cf-9a3c19815c45',image_min_disk='1',image_min_ram='0',image_owner_id='3c9e5daa31ad47e996b59f1b7c5db0d4',image_owner_project_name='tempest-TestStampPattern-806391027',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-806391027-project-member',image_user_id='f7ae0aef93334fa599be6d1a4d728595',owner_project_name='tempest-TestStampPattern-806391027',owner_user_name='tempest-TestStampPattern-806391027-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T12:07:21Z,user_data=None,user_id='f7ae0aef93334fa599be6d1a4d728595',uuid=54c69eab-3597-4ca7-b698-169538b73a18,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "775bc781-860e-4b6f-89f8-1b5cdeb69a8b", "address": "fa:16:3e:44:28:8d", "network": {"id": "1e184b35-0ffc-4c89-951b-d97b1961f72f", "bridge": "br-int", "label": "tempest-TestStampPattern-2134909631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c9e5daa31ad47e996b59f1b7c5db0d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap775bc781-86", "ovs_interfaceid": "775bc781-860e-4b6f-89f8-1b5cdeb69a8b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 12:10:12 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-81f8d9ca-6cef-4963-9b8a-a8dc80c57b7c tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Converting VIF {"id": "775bc781-860e-4b6f-89f8-1b5cdeb69a8b", "address": "fa:16:3e:44:28:8d", "network": {"id": "1e184b35-0ffc-4c89-951b-d97b1961f72f", "bridge": "br-int", "label": "tempest-TestStampPattern-2134909631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c9e5daa31ad47e996b59f1b7c5db0d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap775bc781-86", "ovs_interfaceid": "775bc781-860e-4b6f-89f8-1b5cdeb69a8b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 12:10:12 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-81f8d9ca-6cef-4963-9b8a-a8dc80c57b7c tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:44:28:8d,bridge_name='br-int',has_traffic_filtering=True,id=775bc781-860e-4b6f-89f8-1b5cdeb69a8b,network=Network(1e184b35-0ffc-4c89-951b-d97b1961f72f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap775bc781-86') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 12:10:12 user nova-compute[73449]: DEBUG os_vif [None req-81f8d9ca-6cef-4963-9b8a-a8dc80c57b7c tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:28:8d,bridge_name='br-int',has_traffic_filtering=True,id=775bc781-860e-4b6f-89f8-1b5cdeb69a8b,network=Network(1e184b35-0ffc-4c89-951b-d97b1961f72f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap775bc781-86') {{(pid=73449) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 12:10:12 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:10:12 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap775bc781-86, bridge=br-int, if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 12:10:12 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:10:12 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:10:12 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:10:12 user nova-compute[73449]: INFO os_vif [None req-81f8d9ca-6cef-4963-9b8a-a8dc80c57b7c tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:28:8d,bridge_name='br-int',has_traffic_filtering=True,id=775bc781-860e-4b6f-89f8-1b5cdeb69a8b,network=Network(1e184b35-0ffc-4c89-951b-d97b1961f72f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap775bc781-86')
Aug 17 12:10:12 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-81f8d9ca-6cef-4963-9b8a-a8dc80c57b7c tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] [instance: 54c69eab-3597-4ca7-b698-169538b73a18] Deleting instance files /opt/stack/data/nova/instances/54c69eab-3597-4ca7-b698-169538b73a18_del
Aug 17 12:10:12 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-81f8d9ca-6cef-4963-9b8a-a8dc80c57b7c tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] [instance: 54c69eab-3597-4ca7-b698-169538b73a18] Deletion of /opt/stack/data/nova/instances/54c69eab-3597-4ca7-b698-169538b73a18_del complete
Aug 17 12:10:12 user nova-compute[73449]: INFO nova.compute.manager [None req-81f8d9ca-6cef-4963-9b8a-a8dc80c57b7c tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] [instance: 54c69eab-3597-4ca7-b698-169538b73a18] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 17 12:10:12 user nova-compute[73449]: DEBUG oslo.service.loopingcall [None req-81f8d9ca-6cef-4963-9b8a-a8dc80c57b7c tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73449) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 12:10:12 user nova-compute[73449]: DEBUG nova.compute.manager [-] [instance: 54c69eab-3597-4ca7-b698-169538b73a18] Deallocating network for instance {{(pid=73449) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 12:10:12 user nova-compute[73449]: DEBUG nova.network.neutron [-] [instance: 54c69eab-3597-4ca7-b698-169538b73a18] deallocate_for_instance() {{(pid=73449) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 12:10:12 user nova-compute[73449]: DEBUG nova.compute.manager [req-72e2fd73-9f8b-4389-b4cc-1112c33416bf req-5013e851-04a1-41fd-a99b-8216a80c883a service nova] [instance: 54c69eab-3597-4ca7-b698-169538b73a18] Received event network-changed-775bc781-860e-4b6f-89f8-1b5cdeb69a8b {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:10:12 user nova-compute[73449]: DEBUG nova.compute.manager [req-72e2fd73-9f8b-4389-b4cc-1112c33416bf req-5013e851-04a1-41fd-a99b-8216a80c883a service nova] [instance: 54c69eab-3597-4ca7-b698-169538b73a18] Refreshing instance network info cache due to event network-changed-775bc781-860e-4b6f-89f8-1b5cdeb69a8b. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 12:10:12 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-72e2fd73-9f8b-4389-b4cc-1112c33416bf req-5013e851-04a1-41fd-a99b-8216a80c883a service nova] Acquiring lock "refresh_cache-54c69eab-3597-4ca7-b698-169538b73a18" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 12:10:12 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-72e2fd73-9f8b-4389-b4cc-1112c33416bf req-5013e851-04a1-41fd-a99b-8216a80c883a service nova] Acquired lock "refresh_cache-54c69eab-3597-4ca7-b698-169538b73a18" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 12:10:12 user nova-compute[73449]: DEBUG nova.network.neutron [req-72e2fd73-9f8b-4389-b4cc-1112c33416bf req-5013e851-04a1-41fd-a99b-8216a80c883a service nova] [instance: 54c69eab-3597-4ca7-b698-169538b73a18] Refreshing network info cache for port 775bc781-860e-4b6f-89f8-1b5cdeb69a8b {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 12:10:12 user nova-compute[73449]: DEBUG nova.network.neutron [-] [instance: 54c69eab-3597-4ca7-b698-169538b73a18] Updating instance_info_cache with network_info: [] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 12:10:12 user nova-compute[73449]: INFO nova.compute.manager [-] [instance: 54c69eab-3597-4ca7-b698-169538b73a18] Took 0.60 seconds to deallocate network for instance.
Aug 17 12:10:12 user nova-compute[73449]: DEBUG nova.network.neutron [req-72e2fd73-9f8b-4389-b4cc-1112c33416bf req-5013e851-04a1-41fd-a99b-8216a80c883a service nova] [instance: 54c69eab-3597-4ca7-b698-169538b73a18] Updated VIF entry in instance network info cache for port 775bc781-860e-4b6f-89f8-1b5cdeb69a8b. {{(pid=73449) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 12:10:12 user nova-compute[73449]: DEBUG nova.network.neutron [req-72e2fd73-9f8b-4389-b4cc-1112c33416bf req-5013e851-04a1-41fd-a99b-8216a80c883a service nova] [instance: 54c69eab-3597-4ca7-b698-169538b73a18] Updating instance_info_cache with network_info: [{"id": "775bc781-860e-4b6f-89f8-1b5cdeb69a8b", "address": "fa:16:3e:44:28:8d", "network": {"id": "1e184b35-0ffc-4c89-951b-d97b1961f72f", "bridge": "br-int", "label": "tempest-TestStampPattern-2134909631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c9e5daa31ad47e996b59f1b7c5db0d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap775bc781-86", "ovs_interfaceid": "775bc781-860e-4b6f-89f8-1b5cdeb69a8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 12:10:12 user nova-compute[73449]: DEBUG nova.compute.manager [req-629427c8-2d7d-4b54-9da0-fa76e07d42b1 req-861cd1c6-6809-4868-b6fd-c6e5d4248bcc service nova] [instance: 54c69eab-3597-4ca7-b698-169538b73a18] Received event network-vif-deleted-775bc781-860e-4b6f-89f8-1b5cdeb69a8b {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:10:12 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-72e2fd73-9f8b-4389-b4cc-1112c33416bf req-5013e851-04a1-41fd-a99b-8216a80c883a service nova] Releasing lock "refresh_cache-54c69eab-3597-4ca7-b698-169538b73a18" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 12:10:12 user nova-compute[73449]: DEBUG nova.compute.manager [req-72e2fd73-9f8b-4389-b4cc-1112c33416bf req-5013e851-04a1-41fd-a99b-8216a80c883a service nova] [instance: 54c69eab-3597-4ca7-b698-169538b73a18] Received event network-vif-unplugged-775bc781-860e-4b6f-89f8-1b5cdeb69a8b {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:10:12 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-72e2fd73-9f8b-4389-b4cc-1112c33416bf req-5013e851-04a1-41fd-a99b-8216a80c883a service nova] Acquiring lock "54c69eab-3597-4ca7-b698-169538b73a18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:10:12 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-72e2fd73-9f8b-4389-b4cc-1112c33416bf req-5013e851-04a1-41fd-a99b-8216a80c883a service nova] Lock "54c69eab-3597-4ca7-b698-169538b73a18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:10:12 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-72e2fd73-9f8b-4389-b4cc-1112c33416bf req-5013e851-04a1-41fd-a99b-8216a80c883a service nova] Lock "54c69eab-3597-4ca7-b698-169538b73a18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:10:12 user nova-compute[73449]: DEBUG nova.compute.manager [req-72e2fd73-9f8b-4389-b4cc-1112c33416bf req-5013e851-04a1-41fd-a99b-8216a80c883a service nova] [instance: 54c69eab-3597-4ca7-b698-169538b73a18] No waiting events found dispatching network-vif-unplugged-775bc781-860e-4b6f-89f8-1b5cdeb69a8b {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 12:10:12 user nova-compute[73449]: DEBUG nova.compute.manager [req-72e2fd73-9f8b-4389-b4cc-1112c33416bf req-5013e851-04a1-41fd-a99b-8216a80c883a service nova] [instance: 54c69eab-3597-4ca7-b698-169538b73a18] Received event network-vif-unplugged-775bc781-860e-4b6f-89f8-1b5cdeb69a8b for instance with task_state deleting. {{(pid=73449) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 12:10:12 user nova-compute[73449]: DEBUG nova.compute.manager [req-72e2fd73-9f8b-4389-b4cc-1112c33416bf req-5013e851-04a1-41fd-a99b-8216a80c883a service nova] [instance: 54c69eab-3597-4ca7-b698-169538b73a18] Received event network-vif-plugged-775bc781-860e-4b6f-89f8-1b5cdeb69a8b {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:10:12 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-72e2fd73-9f8b-4389-b4cc-1112c33416bf req-5013e851-04a1-41fd-a99b-8216a80c883a service nova] Acquiring lock "54c69eab-3597-4ca7-b698-169538b73a18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:10:12 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-72e2fd73-9f8b-4389-b4cc-1112c33416bf req-5013e851-04a1-41fd-a99b-8216a80c883a service nova] Lock "54c69eab-3597-4ca7-b698-169538b73a18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:10:12 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-72e2fd73-9f8b-4389-b4cc-1112c33416bf req-5013e851-04a1-41fd-a99b-8216a80c883a service nova] Lock "54c69eab-3597-4ca7-b698-169538b73a18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:10:12 user nova-compute[73449]: DEBUG nova.compute.manager [req-72e2fd73-9f8b-4389-b4cc-1112c33416bf req-5013e851-04a1-41fd-a99b-8216a80c883a service nova] [instance: 54c69eab-3597-4ca7-b698-169538b73a18] No waiting events found dispatching network-vif-plugged-775bc781-860e-4b6f-89f8-1b5cdeb69a8b {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 12:10:12 user nova-compute[73449]: WARNING nova.compute.manager [req-72e2fd73-9f8b-4389-b4cc-1112c33416bf req-5013e851-04a1-41fd-a99b-8216a80c883a service nova] [instance: 54c69eab-3597-4ca7-b698-169538b73a18] Received unexpected event network-vif-plugged-775bc781-860e-4b6f-89f8-1b5cdeb69a8b for instance with vm_state active and task_state deleting.
Aug 17 12:10:12 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-81f8d9ca-6cef-4963-9b8a-a8dc80c57b7c tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:10:12 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-81f8d9ca-6cef-4963-9b8a-a8dc80c57b7c tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:10:13 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-81f8d9ca-6cef-4963-9b8a-a8dc80c57b7c tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 12:10:13 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-81f8d9ca-6cef-4963-9b8a-a8dc80c57b7c tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 12:10:13 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-81f8d9ca-6cef-4963-9b8a-a8dc80c57b7c tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.172s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:10:13 user nova-compute[73449]: INFO nova.scheduler.client.report [None req-81f8d9ca-6cef-4963-9b8a-a8dc80c57b7c tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Deleted allocations for instance 54c69eab-3597-4ca7-b698-169538b73a18
Aug 17 12:10:13 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-81f8d9ca-6cef-4963-9b8a-a8dc80c57b7c tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Lock "54c69eab-3597-4ca7-b698-169538b73a18" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.818s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:10:14 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:10:15 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:10:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:10:17 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-dc7c7110-1f6c-43c1-be75-dd717c6fd909 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Acquiring lock "f607caf8-0910-4214-b2f7-ccd59cd0307a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:10:17 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-dc7c7110-1f6c-43c1-be75-dd717c6fd909 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Lock "f607caf8-0910-4214-b2f7-ccd59cd0307a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:10:17 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-dc7c7110-1f6c-43c1-be75-dd717c6fd909 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Acquiring lock "f607caf8-0910-4214-b2f7-ccd59cd0307a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:10:17 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-dc7c7110-1f6c-43c1-be75-dd717c6fd909 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Lock "f607caf8-0910-4214-b2f7-ccd59cd0307a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:10:17 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-dc7c7110-1f6c-43c1-be75-dd717c6fd909 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Lock "f607caf8-0910-4214-b2f7-ccd59cd0307a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:10:17 user nova-compute[73449]: INFO nova.compute.manager [None req-dc7c7110-1f6c-43c1-be75-dd717c6fd909 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: f607caf8-0910-4214-b2f7-ccd59cd0307a] Terminating instance
Aug 17 12:10:17 user nova-compute[73449]: DEBUG nova.compute.manager [None req-dc7c7110-1f6c-43c1-be75-dd717c6fd909 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: f607caf8-0910-4214-b2f7-ccd59cd0307a] Start destroying the instance on the hypervisor. {{(pid=73449) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 12:10:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:10:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:10:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:10:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:10:17 user nova-compute[73449]: DEBUG nova.compute.manager [req-91d0a7b5-b1a6-48fe-8d8a-55f7759ff74b req-34ee73b7-4f2d-4ff2-8457-fa5eea023b6c service nova] [instance: f607caf8-0910-4214-b2f7-ccd59cd0307a] Received event network-vif-unplugged-3fbe83ab-0b4f-4f6d-9a90-bd564e1e0760 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:10:17 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-91d0a7b5-b1a6-48fe-8d8a-55f7759ff74b req-34ee73b7-4f2d-4ff2-8457-fa5eea023b6c service nova] Acquiring lock "f607caf8-0910-4214-b2f7-ccd59cd0307a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:10:17 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-91d0a7b5-b1a6-48fe-8d8a-55f7759ff74b req-34ee73b7-4f2d-4ff2-8457-fa5eea023b6c service nova] Lock "f607caf8-0910-4214-b2f7-ccd59cd0307a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:10:17 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-91d0a7b5-b1a6-48fe-8d8a-55f7759ff74b req-34ee73b7-4f2d-4ff2-8457-fa5eea023b6c service nova] Lock "f607caf8-0910-4214-b2f7-ccd59cd0307a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:10:17 user nova-compute[73449]: DEBUG nova.compute.manager [req-91d0a7b5-b1a6-48fe-8d8a-55f7759ff74b req-34ee73b7-4f2d-4ff2-8457-fa5eea023b6c service nova] [instance: f607caf8-0910-4214-b2f7-ccd59cd0307a] No waiting events found dispatching network-vif-unplugged-3fbe83ab-0b4f-4f6d-9a90-bd564e1e0760 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 12:10:17 user nova-compute[73449]: DEBUG nova.compute.manager [req-91d0a7b5-b1a6-48fe-8d8a-55f7759ff74b req-34ee73b7-4f2d-4ff2-8457-fa5eea023b6c service nova] [instance: f607caf8-0910-4214-b2f7-ccd59cd0307a] Received event network-vif-unplugged-3fbe83ab-0b4f-4f6d-9a90-bd564e1e0760 for instance with task_state deleting. {{(pid=73449) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 12:10:18 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: f607caf8-0910-4214-b2f7-ccd59cd0307a] Instance destroyed successfully.
Aug 17 12:10:18 user nova-compute[73449]: DEBUG nova.objects.instance [None req-dc7c7110-1f6c-43c1-be75-dd717c6fd909 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Lazy-loading 'resources' on Instance uuid f607caf8-0910-4214-b2f7-ccd59cd0307a {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:10:18 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-dc7c7110-1f6c-43c1-be75-dd717c6fd909 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T12:07:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-290223819',display_name='tempest-AttachVolumeNegativeTest-server-290223819',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-290223819',id=49,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIcdd5aeecIYlkFx2V2bOlocTYxswMy7dyyjzsWB0kPZfZnWdMUqwEO+45ozoejtI2uZXoUirQYe3MBmB0K/Ke1GZ9Stc3w/8DeCRIJRTSZUMGlReyFZm9UfJDMGJ2bh+A==',key_name='tempest-keypair-1929215192',keypairs=<?>,launch_index=0,launched_at=2023-08-17T12:07:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='75aa99e369c54b65aff27adbb1daf2b8',ramdisk_id='',reservation_id='r-gm793uzz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-165752051',owner_user_name='tempest-AttachVolumeNegativeTest-165752051-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T12:07:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55cde68973ca42d095180b5c0701b49b',uuid=f607caf8-0910-4214-b2f7-ccd59cd0307a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3fbe83ab-0b4f-4f6d-9a90-bd564e1e0760", "address": "fa:16:3e:b4:1b:4f", "network": {"id": "71648e1b-cf19-44b7-bae2-9d38543cdee9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-822323626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75aa99e369c54b65aff27adbb1daf2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fbe83ab-0b", "ovs_interfaceid": "3fbe83ab-0b4f-4f6d-9a90-bd564e1e0760", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 12:10:18 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-dc7c7110-1f6c-43c1-be75-dd717c6fd909 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Converting VIF {"id": "3fbe83ab-0b4f-4f6d-9a90-bd564e1e0760", "address": "fa:16:3e:b4:1b:4f", "network": {"id": "71648e1b-cf19-44b7-bae2-9d38543cdee9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-822323626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75aa99e369c54b65aff27adbb1daf2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fbe83ab-0b", "ovs_interfaceid": "3fbe83ab-0b4f-4f6d-9a90-bd564e1e0760", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 12:10:18 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-dc7c7110-1f6c-43c1-be75-dd717c6fd909 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b4:1b:4f,bridge_name='br-int',has_traffic_filtering=True,id=3fbe83ab-0b4f-4f6d-9a90-bd564e1e0760,network=Network(71648e1b-cf19-44b7-bae2-9d38543cdee9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fbe83ab-0b') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 12:10:18 user nova-compute[73449]: DEBUG os_vif [None req-dc7c7110-1f6c-43c1-be75-dd717c6fd909 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:1b:4f,bridge_name='br-int',has_traffic_filtering=True,id=3fbe83ab-0b4f-4f6d-9a90-bd564e1e0760,network=Network(71648e1b-cf19-44b7-bae2-9d38543cdee9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fbe83ab-0b') {{(pid=73449) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 12:10:18 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:10:18 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3fbe83ab-0b, bridge=br-int, if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 12:10:18 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:10:18 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:10:18 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:10:18 user nova-compute[73449]: INFO os_vif [None req-dc7c7110-1f6c-43c1-be75-dd717c6fd909 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:1b:4f,bridge_name='br-int',has_traffic_filtering=True,id=3fbe83ab-0b4f-4f6d-9a90-bd564e1e0760,network=Network(71648e1b-cf19-44b7-bae2-9d38543cdee9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fbe83ab-0b')
Aug 17 12:10:18 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-dc7c7110-1f6c-43c1-be75-dd717c6fd909 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: f607caf8-0910-4214-b2f7-ccd59cd0307a] Deleting instance files /opt/stack/data/nova/instances/f607caf8-0910-4214-b2f7-ccd59cd0307a_del
Aug 17 12:10:18 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-dc7c7110-1f6c-43c1-be75-dd717c6fd909 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: f607caf8-0910-4214-b2f7-ccd59cd0307a] Deletion of /opt/stack/data/nova/instances/f607caf8-0910-4214-b2f7-ccd59cd0307a_del complete
Aug 17 12:10:18 user nova-compute[73449]: INFO nova.compute.manager [None req-dc7c7110-1f6c-43c1-be75-dd717c6fd909 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: f607caf8-0910-4214-b2f7-ccd59cd0307a] Took 0.95 seconds to destroy the instance on the hypervisor.
Aug 17 12:10:18 user nova-compute[73449]: DEBUG oslo.service.loopingcall [None req-dc7c7110-1f6c-43c1-be75-dd717c6fd909 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73449) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 12:10:18 user nova-compute[73449]: DEBUG nova.compute.manager [-] [instance: f607caf8-0910-4214-b2f7-ccd59cd0307a] Deallocating network for instance {{(pid=73449) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 12:10:18 user nova-compute[73449]: DEBUG nova.network.neutron [-] [instance: f607caf8-0910-4214-b2f7-ccd59cd0307a] deallocate_for_instance() {{(pid=73449) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 12:10:19 user nova-compute[73449]: DEBUG nova.network.neutron [-] [instance: f607caf8-0910-4214-b2f7-ccd59cd0307a] Updating instance_info_cache with network_info: [] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 12:10:19 user nova-compute[73449]: INFO nova.compute.manager [-] [instance: f607caf8-0910-4214-b2f7-ccd59cd0307a] Took 1.02 seconds to deallocate network for instance.
Aug 17 12:10:19 user nova-compute[73449]: DEBUG nova.compute.manager [req-ebdfddbf-86dc-4414-86cd-941b53f9abf4 req-c232b034-8119-4d33-b9dd-26573bdb73ce service nova] [instance: f607caf8-0910-4214-b2f7-ccd59cd0307a] Received event network-vif-deleted-3fbe83ab-0b4f-4f6d-9a90-bd564e1e0760 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:10:19 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-dc7c7110-1f6c-43c1-be75-dd717c6fd909 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:10:19 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-dc7c7110-1f6c-43c1-be75-dd717c6fd909 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:10:19 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-dc7c7110-1f6c-43c1-be75-dd717c6fd909 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 12:10:19 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-dc7c7110-1f6c-43c1-be75-dd717c6fd909 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 12:10:19 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-dc7c7110-1f6c-43c1-be75-dd717c6fd909 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.156s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:10:19 user nova-compute[73449]: INFO nova.scheduler.client.report [None req-dc7c7110-1f6c-43c1-be75-dd717c6fd909 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Deleted allocations for instance f607caf8-0910-4214-b2f7-ccd59cd0307a
Aug 17 12:10:19 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-dc7c7110-1f6c-43c1-be75-dd717c6fd909 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Lock "f607caf8-0910-4214-b2f7-ccd59cd0307a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.299s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:10:19 user nova-compute[73449]: DEBUG nova.compute.manager [req-dd73f221-3ed7-4cfa-a580-91b97219c518 req-2a53519b-a23a-4d16-b821-6ed60d4b5c11 service nova] [instance: f607caf8-0910-4214-b2f7-ccd59cd0307a] Received event network-vif-plugged-3fbe83ab-0b4f-4f6d-9a90-bd564e1e0760 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:10:19 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-dd73f221-3ed7-4cfa-a580-91b97219c518 req-2a53519b-a23a-4d16-b821-6ed60d4b5c11 service nova] Acquiring lock "f607caf8-0910-4214-b2f7-ccd59cd0307a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:10:19 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-dd73f221-3ed7-4cfa-a580-91b97219c518 req-2a53519b-a23a-4d16-b821-6ed60d4b5c11 service nova] Lock "f607caf8-0910-4214-b2f7-ccd59cd0307a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:10:19 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-dd73f221-3ed7-4cfa-a580-91b97219c518 req-2a53519b-a23a-4d16-b821-6ed60d4b5c11 service nova] Lock "f607caf8-0910-4214-b2f7-ccd59cd0307a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:10:19 user nova-compute[73449]: DEBUG nova.compute.manager [req-dd73f221-3ed7-4cfa-a580-91b97219c518 req-2a53519b-a23a-4d16-b821-6ed60d4b5c11 service nova] [instance: f607caf8-0910-4214-b2f7-ccd59cd0307a] No waiting events found dispatching network-vif-plugged-3fbe83ab-0b4f-4f6d-9a90-bd564e1e0760 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 12:10:19 user nova-compute[73449]: WARNING nova.compute.manager [req-dd73f221-3ed7-4cfa-a580-91b97219c518 req-2a53519b-a23a-4d16-b821-6ed60d4b5c11 service nova] [instance: f607caf8-0910-4214-b2f7-ccd59cd0307a] Received unexpected event network-vif-plugged-3fbe83ab-0b4f-4f6d-9a90-bd564e1e0760 for instance with vm_state deleted and task_state None.
Aug 17 12:10:19 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:10:19 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:10:19 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:10:19 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:10:19 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=73449) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 12:10:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61201d5c-26f1-4c6d-a764-be2ee2e533ae/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:10:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61201d5c-26f1-4c6d-a764-be2ee2e533ae/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:10:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61201d5c-26f1-4c6d-a764-be2ee2e533ae/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:10:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61201d5c-26f1-4c6d-a764-be2ee2e533ae/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:10:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fdfaf32-0957-453a-b1cf-9a3c19815c45/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:10:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fdfaf32-0957-453a-b1cf-9a3c19815c45/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:10:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fdfaf32-0957-453a-b1cf-9a3c19815c45/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:10:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fdfaf32-0957-453a-b1cf-9a3c19815c45/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:10:21 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 12:10:21 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 12:10:21 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Hypervisor/Node resource view: name=user free_ram=8598MB free_disk=24.96886444091797GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73449) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 12:10:21 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:10:21 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:10:21 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 61201d5c-26f1-4c6d-a764-be2ee2e533ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 12:10:21 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 8fdfaf32-0957-453a-b1cf-9a3c19815c45 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 12:10:21 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73449) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 12:10:21 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73449) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 12:10:21 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 12:10:21 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 12:10:21 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Compute_service record updated for user:user {{(pid=73449) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 12:10:21 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.217s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:10:23 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:10:23 user nova-compute[73449]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692274208.7729666, 89440604-1daf-4e7a-a524-2f9c21a9cb96 => Stopped> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 12:10:23 user nova-compute[73449]: INFO nova.compute.manager [-] [instance: 89440604-1daf-4e7a-a524-2f9c21a9cb96] VM Stopped (Lifecycle Event)
Aug 17 12:10:23 user nova-compute[73449]: DEBUG nova.compute.manager [None req-1cbf8697-d39c-41d5-bef1-7d61dfc726d2 None None] [instance: 89440604-1daf-4e7a-a524-2f9c21a9cb96] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 12:10:24 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:10:24 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Starting heal instance info cache {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 12:10:24 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Rebuilding the list of instances to heal {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 12:10:24 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "refresh_cache-61201d5c-26f1-4c6d-a764-be2ee2e533ae" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 12:10:24 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquired lock "refresh_cache-61201d5c-26f1-4c6d-a764-be2ee2e533ae" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 12:10:24 user nova-compute[73449]: DEBUG nova.network.neutron [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Forcefully refreshing network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 12:10:24 user nova-compute[73449]: DEBUG nova.objects.instance [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lazy-loading 'info_cache' on Instance uuid 61201d5c-26f1-4c6d-a764-be2ee2e533ae {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:10:25 user nova-compute[73449]: DEBUG nova.network.neutron [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Updating instance_info_cache with network_info: [{"id": "f9f6066e-ddd2-4e41-b92a-5713cfb9a223", "address": "fa:16:3e:d2:c7:08", "network": {"id": "2ead35b7-4013-4fab-b35f-02f3237fcac1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1887618888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2a2f7faf23147fba5270c844eac051a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9f6066e-dd", "ovs_interfaceid": "f9f6066e-ddd2-4e41-b92a-5713cfb9a223", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 12:10:25 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Releasing lock "refresh_cache-61201d5c-26f1-4c6d-a764-be2ee2e533ae" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 12:10:25 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Updated the network info_cache for instance {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 12:10:25 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:10:27 user nova-compute[73449]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692274212.114278, 54c69eab-3597-4ca7-b698-169538b73a18 => Stopped> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 12:10:27 user nova-compute[73449]: INFO nova.compute.manager [-] [instance: 54c69eab-3597-4ca7-b698-169538b73a18] VM Stopped (Lifecycle Event)
Aug 17 12:10:27 user nova-compute[73449]: DEBUG nova.compute.manager [None req-d79b776a-53d4-47d1-b984-788cd72692c1 None None] [instance: 54c69eab-3597-4ca7-b698-169538b73a18] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 12:10:28 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:10:33 user nova-compute[73449]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692274218.2458017, f607caf8-0910-4214-b2f7-ccd59cd0307a => Stopped> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 12:10:33 user nova-compute[73449]: INFO nova.compute.manager [-] [instance: f607caf8-0910-4214-b2f7-ccd59cd0307a] VM Stopped (Lifecycle Event)
Aug 17 12:10:33 user nova-compute[73449]: DEBUG nova.compute.manager [None req-d2eb64f6-44d5-4c90-8329-97ab325ca1ca None None] [instance: f607caf8-0910-4214-b2f7-ccd59cd0307a] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 12:10:33 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:10:38 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:10:43 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:10:48 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:10:53 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:10:58 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:11:01 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:11:03 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:11:07 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:11:08 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:11:08 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:11:10 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:11:10 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Cleaning up deleted instances {{(pid=73449) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 17 12:11:10 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] There are 0 instances to clean {{(pid=73449) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 17 12:11:11 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:11:11 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:11:11 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:11:11 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73449) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 12:11:12 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-8491c5b1-a2d5-4b1c-8526-621eec861efa tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Acquiring lock "731e74ce-bc73-49e6-b74b-4d652952b8cf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:11:12 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-8491c5b1-a2d5-4b1c-8526-621eec861efa tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Lock "731e74ce-bc73-49e6-b74b-4d652952b8cf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:11:12 user nova-compute[73449]: DEBUG nova.compute.manager [None req-8491c5b1-a2d5-4b1c-8526-621eec861efa tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: 731e74ce-bc73-49e6-b74b-4d652952b8cf] Starting instance... {{(pid=73449) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 12:11:12 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-8491c5b1-a2d5-4b1c-8526-621eec861efa tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:11:12 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-8491c5b1-a2d5-4b1c-8526-621eec861efa tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:11:12 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-8491c5b1-a2d5-4b1c-8526-621eec861efa tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73449) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 12:11:12 user nova-compute[73449]: INFO nova.compute.claims [None req-8491c5b1-a2d5-4b1c-8526-621eec861efa tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: 731e74ce-bc73-49e6-b74b-4d652952b8cf] Claim successful on node user
Aug 17 12:11:13 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-8491c5b1-a2d5-4b1c-8526-621eec861efa tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 12:11:13 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-8491c5b1-a2d5-4b1c-8526-621eec861efa tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 12:11:13 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-8491c5b1-a2d5-4b1c-8526-621eec861efa tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.247s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:11:13 user nova-compute[73449]: DEBUG nova.compute.manager [None req-8491c5b1-a2d5-4b1c-8526-621eec861efa tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: 731e74ce-bc73-49e6-b74b-4d652952b8cf] Start building networks asynchronously for instance. {{(pid=73449) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 12:11:13 user nova-compute[73449]: DEBUG nova.compute.manager [None req-8491c5b1-a2d5-4b1c-8526-621eec861efa tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: 731e74ce-bc73-49e6-b74b-4d652952b8cf] Allocating IP information in the background. {{(pid=73449) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 12:11:13 user nova-compute[73449]: DEBUG nova.network.neutron [None req-8491c5b1-a2d5-4b1c-8526-621eec861efa tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: 731e74ce-bc73-49e6-b74b-4d652952b8cf] allocate_for_instance() {{(pid=73449) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 12:11:13 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-8491c5b1-a2d5-4b1c-8526-621eec861efa tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: 731e74ce-bc73-49e6-b74b-4d652952b8cf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 12:11:13 user nova-compute[73449]: DEBUG nova.compute.manager [None req-8491c5b1-a2d5-4b1c-8526-621eec861efa tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: 731e74ce-bc73-49e6-b74b-4d652952b8cf] Start building block device mappings for instance. {{(pid=73449) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 12:11:13 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:11:13 user nova-compute[73449]: DEBUG nova.policy [None req-8491c5b1-a2d5-4b1c-8526-621eec861efa tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '55cde68973ca42d095180b5c0701b49b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75aa99e369c54b65aff27adbb1daf2b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73449) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 12:11:13 user nova-compute[73449]: DEBUG nova.compute.manager [None req-8491c5b1-a2d5-4b1c-8526-621eec861efa tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: 731e74ce-bc73-49e6-b74b-4d652952b8cf] Start spawning the instance on the hypervisor. {{(pid=73449) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 12:11:13 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-8491c5b1-a2d5-4b1c-8526-621eec861efa tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: 731e74ce-bc73-49e6-b74b-4d652952b8cf] Creating instance directory {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 12:11:13 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-8491c5b1-a2d5-4b1c-8526-621eec861efa tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: 731e74ce-bc73-49e6-b74b-4d652952b8cf] Creating image(s)
Aug 17 12:11:13 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-8491c5b1-a2d5-4b1c-8526-621eec861efa tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Acquiring lock "/opt/stack/data/nova/instances/731e74ce-bc73-49e6-b74b-4d652952b8cf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:11:13 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-8491c5b1-a2d5-4b1c-8526-621eec861efa tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Lock "/opt/stack/data/nova/instances/731e74ce-bc73-49e6-b74b-4d652952b8cf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:11:13 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-8491c5b1-a2d5-4b1c-8526-621eec861efa tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Lock "/opt/stack/data/nova/instances/731e74ce-bc73-49e6-b74b-4d652952b8cf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:11:13 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-8491c5b1-a2d5-4b1c-8526-621eec861efa tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:11:13 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-8491c5b1-a2d5-4b1c-8526-621eec861efa tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json" returned: 0 in 0.187s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:11:13 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-8491c5b1-a2d5-4b1c-8526-621eec861efa tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Acquiring lock "7e267a577c062ee862e95ede6b48cfd5632f3ea3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:11:13 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-8491c5b1-a2d5-4b1c-8526-621eec861efa tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Lock "7e267a577c062ee862e95ede6b48cfd5632f3ea3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:11:13 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-8491c5b1-a2d5-4b1c-8526-621eec861efa tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:11:13 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-8491c5b1-a2d5-4b1c-8526-621eec861efa tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json" returned: 0 in 0.186s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:11:13 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-8491c5b1-a2d5-4b1c-8526-621eec861efa tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3,backing_fmt=raw /opt/stack/data/nova/instances/731e74ce-bc73-49e6-b74b-4d652952b8cf/disk 1073741824 {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:11:13 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-8491c5b1-a2d5-4b1c-8526-621eec861efa tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3,backing_fmt=raw /opt/stack/data/nova/instances/731e74ce-bc73-49e6-b74b-4d652952b8cf/disk 1073741824" returned: 0 in 0.051s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:11:13 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-8491c5b1-a2d5-4b1c-8526-621eec861efa tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Lock "7e267a577c062ee862e95ede6b48cfd5632f3ea3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:11:13 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-8491c5b1-a2d5-4b1c-8526-621eec861efa tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:11:13 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:11:14 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-8491c5b1-a2d5-4b1c-8526-621eec861efa tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json" returned: 0 in 0.188s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:11:14 user nova-compute[73449]: DEBUG nova.virt.disk.api [None req-8491c5b1-a2d5-4b1c-8526-621eec861efa tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Checking if we can resize image /opt/stack/data/nova/instances/731e74ce-bc73-49e6-b74b-4d652952b8cf/disk. size=1073741824 {{(pid=73449) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 12:11:14 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-8491c5b1-a2d5-4b1c-8526-621eec861efa tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/731e74ce-bc73-49e6-b74b-4d652952b8cf/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:11:14 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-8491c5b1-a2d5-4b1c-8526-621eec861efa tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/731e74ce-bc73-49e6-b74b-4d652952b8cf/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:11:14 user nova-compute[73449]: DEBUG nova.virt.disk.api [None req-8491c5b1-a2d5-4b1c-8526-621eec861efa tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Cannot resize image /opt/stack/data/nova/instances/731e74ce-bc73-49e6-b74b-4d652952b8cf/disk to a smaller size. {{(pid=73449) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 12:11:14 user nova-compute[73449]: DEBUG nova.objects.instance [None req-8491c5b1-a2d5-4b1c-8526-621eec861efa tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Lazy-loading 'migration_context' on Instance uuid 731e74ce-bc73-49e6-b74b-4d652952b8cf {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:11:14 user nova-compute[73449]: DEBUG nova.network.neutron [None req-8491c5b1-a2d5-4b1c-8526-621eec861efa tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: 731e74ce-bc73-49e6-b74b-4d652952b8cf] Successfully created port: d5640497-17d4-4d8f-b99f-797a8e2b4221 {{(pid=73449) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 12:11:14 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-8491c5b1-a2d5-4b1c-8526-621eec861efa tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: 731e74ce-bc73-49e6-b74b-4d652952b8cf] Created local disks {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 12:11:14 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-8491c5b1-a2d5-4b1c-8526-621eec861efa tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: 731e74ce-bc73-49e6-b74b-4d652952b8cf] Ensure instance console log exists: /opt/stack/data/nova/instances/731e74ce-bc73-49e6-b74b-4d652952b8cf/console.log {{(pid=73449) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 12:11:14 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-8491c5b1-a2d5-4b1c-8526-621eec861efa tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:11:14 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-8491c5b1-a2d5-4b1c-8526-621eec861efa tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:11:14 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-8491c5b1-a2d5-4b1c-8526-621eec861efa tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:11:15 user nova-compute[73449]: DEBUG nova.network.neutron [None req-8491c5b1-a2d5-4b1c-8526-621eec861efa tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: 731e74ce-bc73-49e6-b74b-4d652952b8cf] Successfully updated port: d5640497-17d4-4d8f-b99f-797a8e2b4221 {{(pid=73449) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 12:11:15 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-8491c5b1-a2d5-4b1c-8526-621eec861efa tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Acquiring lock "refresh_cache-731e74ce-bc73-49e6-b74b-4d652952b8cf" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 12:11:15 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-8491c5b1-a2d5-4b1c-8526-621eec861efa tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Acquired lock "refresh_cache-731e74ce-bc73-49e6-b74b-4d652952b8cf" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 12:11:15 user nova-compute[73449]: DEBUG nova.network.neutron [None req-8491c5b1-a2d5-4b1c-8526-621eec861efa tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: 731e74ce-bc73-49e6-b74b-4d652952b8cf] Building network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 12:11:15 user nova-compute[73449]: DEBUG nova.network.neutron [None req-8491c5b1-a2d5-4b1c-8526-621eec861efa tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: 731e74ce-bc73-49e6-b74b-4d652952b8cf] Instance cache missing network info. {{(pid=73449) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 12:11:15 user nova-compute[73449]: DEBUG nova.compute.manager [req-5b7a3bcd-643e-4848-9056-c308b648d60d req-d31a58cf-3820-4548-ac96-0322bdd56876 service nova] [instance: 731e74ce-bc73-49e6-b74b-4d652952b8cf] Received event network-changed-d5640497-17d4-4d8f-b99f-797a8e2b4221 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:11:15 user nova-compute[73449]: DEBUG nova.compute.manager [req-5b7a3bcd-643e-4848-9056-c308b648d60d req-d31a58cf-3820-4548-ac96-0322bdd56876 service nova] [instance: 731e74ce-bc73-49e6-b74b-4d652952b8cf] Refreshing instance network info cache due to event network-changed-d5640497-17d4-4d8f-b99f-797a8e2b4221. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 12:11:15 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-5b7a3bcd-643e-4848-9056-c308b648d60d req-d31a58cf-3820-4548-ac96-0322bdd56876 service nova] Acquiring lock "refresh_cache-731e74ce-bc73-49e6-b74b-4d652952b8cf" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 12:11:15 user nova-compute[73449]: DEBUG nova.objects.instance [None req-09d1f9dd-d441-45d3-9be5-e94a3a2464c7 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Lazy-loading 'flavor' on Instance uuid 61201d5c-26f1-4c6d-a764-be2ee2e533ae {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:11:15 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-09d1f9dd-d441-45d3-9be5-e94a3a2464c7 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Acquiring lock "refresh_cache-61201d5c-26f1-4c6d-a764-be2ee2e533ae" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 12:11:15 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-09d1f9dd-d441-45d3-9be5-e94a3a2464c7 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Acquired lock "refresh_cache-61201d5c-26f1-4c6d-a764-be2ee2e533ae" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 12:11:15 user nova-compute[73449]: DEBUG nova.network.neutron [None req-09d1f9dd-d441-45d3-9be5-e94a3a2464c7 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Building network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 12:11:15 user nova-compute[73449]: DEBUG nova.objects.instance [None req-09d1f9dd-d441-45d3-9be5-e94a3a2464c7 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Lazy-loading 'info_cache' on Instance uuid 61201d5c-26f1-4c6d-a764-be2ee2e533ae {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:11:15 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:11:15 user nova-compute[73449]: DEBUG nova.network.neutron [None req-8491c5b1-a2d5-4b1c-8526-621eec861efa tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: 731e74ce-bc73-49e6-b74b-4d652952b8cf] Updating instance_info_cache with network_info: [{"id": "d5640497-17d4-4d8f-b99f-797a8e2b4221", "address": "fa:16:3e:bd:10:2a", "network": {"id": "71648e1b-cf19-44b7-bae2-9d38543cdee9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-822323626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75aa99e369c54b65aff27adbb1daf2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5640497-17", "ovs_interfaceid": "d5640497-17d4-4d8f-b99f-797a8e2b4221", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 12:11:15 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-8491c5b1-a2d5-4b1c-8526-621eec861efa tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Releasing lock "refresh_cache-731e74ce-bc73-49e6-b74b-4d652952b8cf" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 12:11:15 user nova-compute[73449]: DEBUG nova.compute.manager [None req-8491c5b1-a2d5-4b1c-8526-621eec861efa tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: 731e74ce-bc73-49e6-b74b-4d652952b8cf] Instance network_info: |[{"id": "d5640497-17d4-4d8f-b99f-797a8e2b4221", "address": "fa:16:3e:bd:10:2a", "network": {"id": "71648e1b-cf19-44b7-bae2-9d38543cdee9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-822323626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75aa99e369c54b65aff27adbb1daf2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5640497-17", "ovs_interfaceid": "d5640497-17d4-4d8f-b99f-797a8e2b4221", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73449) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 12:11:15 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-5b7a3bcd-643e-4848-9056-c308b648d60d req-d31a58cf-3820-4548-ac96-0322bdd56876 service nova] Acquired lock "refresh_cache-731e74ce-bc73-49e6-b74b-4d652952b8cf" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 12:11:15 user nova-compute[73449]: DEBUG nova.network.neutron [req-5b7a3bcd-643e-4848-9056-c308b648d60d req-d31a58cf-3820-4548-ac96-0322bdd56876 service nova] [instance: 731e74ce-bc73-49e6-b74b-4d652952b8cf] Refreshing network info cache for port d5640497-17d4-4d8f-b99f-797a8e2b4221 {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 12:11:15 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-8491c5b1-a2d5-4b1c-8526-621eec861efa tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: 731e74ce-bc73-49e6-b74b-4d652952b8cf] Start _get_guest_xml network_info=[{"id": "d5640497-17d4-4d8f-b99f-797a8e2b4221", "address": "fa:16:3e:bd:10:2a", "network": {"id": "71648e1b-cf19-44b7-bae2-9d38543cdee9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-822323626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75aa99e369c54b65aff27adbb1daf2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5640497-17", "ovs_interfaceid": "d5640497-17d4-4d8f-b99f-797a8e2b4221", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T11:36:11Z,direct_url=<?>,disk_format='qcow2',id=0a2904ae-083d-41c8-83db-343132b36148,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7a77880136a54ef195c82e018e1939db',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T11:36:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': '0a2904ae-083d-41c8-83db-343132b36148'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 12:11:15 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-8491c5b1-a2d5-4b1c-8526-621eec861efa tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 12:11:16 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-8491c5b1-a2d5-4b1c-8526-621eec861efa tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 12:11:16 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-8491c5b1-a2d5-4b1c-8526-621eec861efa tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 12:11:16 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-8491c5b1-a2d5-4b1c-8526-621eec861efa tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] CPU controller missing on host. {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 12:11:16 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-8491c5b1-a2d5-4b1c-8526-621eec861efa tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 12:11:16 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-8491c5b1-a2d5-4b1c-8526-621eec861efa tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] CPU controller found on host. {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 12:11:16 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-8491c5b1-a2d5-4b1c-8526-621eec861efa tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73449) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 12:11:16 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-8491c5b1-a2d5-4b1c-8526-621eec861efa tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T11:35:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T11:36:11Z,direct_url=<?>,disk_format='qcow2',id=0a2904ae-083d-41c8-83db-343132b36148,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7a77880136a54ef195c82e018e1939db',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T11:36:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 12:11:16 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-8491c5b1-a2d5-4b1c-8526-621eec861efa tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Flavor limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 12:11:16 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-8491c5b1-a2d5-4b1c-8526-621eec861efa tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Image limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 12:11:16 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-8491c5b1-a2d5-4b1c-8526-621eec861efa tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Flavor pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 12:11:16 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-8491c5b1-a2d5-4b1c-8526-621eec861efa tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Image pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 12:11:16 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-8491c5b1-a2d5-4b1c-8526-621eec861efa tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 12:11:16 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-8491c5b1-a2d5-4b1c-8526-621eec861efa tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 12:11:16 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-8491c5b1-a2d5-4b1c-8526-621eec861efa tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 12:11:16 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-8491c5b1-a2d5-4b1c-8526-621eec861efa tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Got 1 possible topologies {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 12:11:16 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-8491c5b1-a2d5-4b1c-8526-621eec861efa tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 12:11:16 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-8491c5b1-a2d5-4b1c-8526-621eec861efa tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 12:11:16 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-8491c5b1-a2d5-4b1c-8526-621eec861efa tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T12:11:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-817310208',display_name='tempest-AttachVolumeNegativeTest-server-817310208',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-817310208',id=50,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOy5DLspZnAj1djQXj9ZyB40hkOn0T9B1VlovtlAH4KPVg1j7MPJgsS3aQ9Yk3zZQliShPIklN85oG2IdaOaDRPzR9q8wwzbRr11nHZNJMlN2f+cTGo/u1+MBxA23/2xew==',key_name='tempest-keypair-1006997117',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75aa99e369c54b65aff27adbb1daf2b8',ramdisk_id='',reservation_id='r-2ic3nlq0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-165752051',owner_user_name='tempest-AttachVolumeNegativeTest-165752051-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T12:11:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55cde68973ca42d095180b5c0701b49b',uuid=731e74ce-bc73-49e6-b74b-4d652952b8cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d5640497-17d4-4d8f-b99f-797a8e2b4221", "address": "fa:16:3e:bd:10:2a", "network": {"id": "71648e1b-cf19-44b7-bae2-9d38543cdee9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-822323626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75aa99e369c54b65aff27adbb1daf2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5640497-17", "ovs_interfaceid": "d5640497-17d4-4d8f-b99f-797a8e2b4221", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73449) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 12:11:16 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-8491c5b1-a2d5-4b1c-8526-621eec861efa tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Converting VIF {"id": "d5640497-17d4-4d8f-b99f-797a8e2b4221", "address": "fa:16:3e:bd:10:2a", "network": {"id": "71648e1b-cf19-44b7-bae2-9d38543cdee9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-822323626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75aa99e369c54b65aff27adbb1daf2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5640497-17", "ovs_interfaceid": "d5640497-17d4-4d8f-b99f-797a8e2b4221", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 12:11:16 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-8491c5b1-a2d5-4b1c-8526-621eec861efa tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:10:2a,bridge_name='br-int',has_traffic_filtering=True,id=d5640497-17d4-4d8f-b99f-797a8e2b4221,network=Network(71648e1b-cf19-44b7-bae2-9d38543cdee9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5640497-17') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 12:11:16 user nova-compute[73449]: DEBUG nova.objects.instance [None req-8491c5b1-a2d5-4b1c-8526-621eec861efa tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Lazy-loading 'pci_devices' on Instance uuid 731e74ce-bc73-49e6-b74b-4d652952b8cf {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:11:16 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-8491c5b1-a2d5-4b1c-8526-621eec861efa tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: 731e74ce-bc73-49e6-b74b-4d652952b8cf] End _get_guest_xml xml=<domain type="kvm">
Aug 17 12:11:16 user nova-compute[73449]:   <uuid>731e74ce-bc73-49e6-b74b-4d652952b8cf</uuid>
Aug 17 12:11:16 user nova-compute[73449]:   <name>instance-00000032</name>
Aug 17 12:11:16 user nova-compute[73449]:   <memory>524288</memory>
Aug 17 12:11:16 user nova-compute[73449]:   <vcpu>1</vcpu>
Aug 17 12:11:16 user nova-compute[73449]:   <metadata>
Aug 17 12:11:16 user nova-compute[73449]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 12:11:16 user nova-compute[73449]:       <nova:package version="0.0.0"/>
Aug 17 12:11:16 user nova-compute[73449]:       <nova:name>tempest-AttachVolumeNegativeTest-server-817310208</nova:name>
Aug 17 12:11:16 user nova-compute[73449]:       <nova:creationTime>2023-08-17 12:11:16</nova:creationTime>
Aug 17 12:11:16 user nova-compute[73449]:       <nova:flavor name="m1.tiny">
Aug 17 12:11:16 user nova-compute[73449]:         <nova:memory>512</nova:memory>
Aug 17 12:11:16 user nova-compute[73449]:         <nova:disk>1</nova:disk>
Aug 17 12:11:16 user nova-compute[73449]:         <nova:swap>0</nova:swap>
Aug 17 12:11:16 user nova-compute[73449]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 12:11:16 user nova-compute[73449]:         <nova:vcpus>1</nova:vcpus>
Aug 17 12:11:16 user nova-compute[73449]:       </nova:flavor>
Aug 17 12:11:16 user nova-compute[73449]:       <nova:owner>
Aug 17 12:11:16 user nova-compute[73449]:         <nova:user uuid="55cde68973ca42d095180b5c0701b49b">tempest-AttachVolumeNegativeTest-165752051-project-member</nova:user>
Aug 17 12:11:16 user nova-compute[73449]:         <nova:project uuid="75aa99e369c54b65aff27adbb1daf2b8">tempest-AttachVolumeNegativeTest-165752051</nova:project>
Aug 17 12:11:16 user nova-compute[73449]:       </nova:owner>
Aug 17 12:11:16 user nova-compute[73449]:       <nova:root type="image" uuid="0a2904ae-083d-41c8-83db-343132b36148"/>
Aug 17 12:11:16 user nova-compute[73449]:       <nova:ports>
Aug 17 12:11:16 user nova-compute[73449]:         <nova:port uuid="d5640497-17d4-4d8f-b99f-797a8e2b4221">
Aug 17 12:11:16 user nova-compute[73449]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 17 12:11:16 user nova-compute[73449]:         </nova:port>
Aug 17 12:11:16 user nova-compute[73449]:       </nova:ports>
Aug 17 12:11:16 user nova-compute[73449]:     </nova:instance>
Aug 17 12:11:16 user nova-compute[73449]:   </metadata>
Aug 17 12:11:16 user nova-compute[73449]:   <sysinfo type="smbios">
Aug 17 12:11:16 user nova-compute[73449]:     <system>
Aug 17 12:11:16 user nova-compute[73449]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 12:11:16 user nova-compute[73449]:       <entry name="product">OpenStack Nova</entry>
Aug 17 12:11:16 user nova-compute[73449]:       <entry name="version">0.0.0</entry>
Aug 17 12:11:16 user nova-compute[73449]:       <entry name="serial">731e74ce-bc73-49e6-b74b-4d652952b8cf</entry>
Aug 17 12:11:16 user nova-compute[73449]:       <entry name="uuid">731e74ce-bc73-49e6-b74b-4d652952b8cf</entry>
Aug 17 12:11:16 user nova-compute[73449]:       <entry name="family">Virtual Machine</entry>
Aug 17 12:11:16 user nova-compute[73449]:     </system>
Aug 17 12:11:16 user nova-compute[73449]:   </sysinfo>
Aug 17 12:11:16 user nova-compute[73449]:   <os>
Aug 17 12:11:16 user nova-compute[73449]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 12:11:16 user nova-compute[73449]:     <boot dev="hd"/>
Aug 17 12:11:16 user nova-compute[73449]:     <smbios mode="sysinfo"/>
Aug 17 12:11:16 user nova-compute[73449]:   </os>
Aug 17 12:11:16 user nova-compute[73449]:   <features>
Aug 17 12:11:16 user nova-compute[73449]:     <acpi/>
Aug 17 12:11:16 user nova-compute[73449]:     <apic/>
Aug 17 12:11:16 user nova-compute[73449]:     <vmcoreinfo/>
Aug 17 12:11:16 user nova-compute[73449]:   </features>
Aug 17 12:11:16 user nova-compute[73449]:   <clock offset="utc">
Aug 17 12:11:16 user nova-compute[73449]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 12:11:16 user nova-compute[73449]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 12:11:16 user nova-compute[73449]:     <timer name="hpet" present="no"/>
Aug 17 12:11:16 user nova-compute[73449]:   </clock>
Aug 17 12:11:16 user nova-compute[73449]:   <cpu mode="custom" match="exact">
Aug 17 12:11:16 user nova-compute[73449]:     <model>Nehalem</model>
Aug 17 12:11:16 user nova-compute[73449]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 12:11:16 user nova-compute[73449]:   </cpu>
Aug 17 12:11:16 user nova-compute[73449]:   <devices>
Aug 17 12:11:16 user nova-compute[73449]:     <disk type="file" device="disk">
Aug 17 12:11:16 user nova-compute[73449]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 12:11:16 user nova-compute[73449]:       <source file="/opt/stack/data/nova/instances/731e74ce-bc73-49e6-b74b-4d652952b8cf/disk"/>
Aug 17 12:11:16 user nova-compute[73449]:       <target dev="vda" bus="virtio"/>
Aug 17 12:11:16 user nova-compute[73449]:     </disk>
Aug 17 12:11:16 user nova-compute[73449]:     <interface type="ethernet">
Aug 17 12:11:16 user nova-compute[73449]:       <mac address="fa:16:3e:bd:10:2a"/>
Aug 17 12:11:16 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 12:11:16 user nova-compute[73449]:       <mtu size="1442"/>
Aug 17 12:11:16 user nova-compute[73449]:       <target dev="tapd5640497-17"/>
Aug 17 12:11:16 user nova-compute[73449]:     </interface>
Aug 17 12:11:16 user nova-compute[73449]:     <serial type="pty">
Aug 17 12:11:16 user nova-compute[73449]:       <log file="/opt/stack/data/nova/instances/731e74ce-bc73-49e6-b74b-4d652952b8cf/console.log" append="off"/>
Aug 17 12:11:16 user nova-compute[73449]:     </serial>
Aug 17 12:11:16 user nova-compute[73449]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 12:11:16 user nova-compute[73449]:     <video>
Aug 17 12:11:16 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 12:11:16 user nova-compute[73449]:     </video>
Aug 17 12:11:16 user nova-compute[73449]:     <rng model="virtio">
Aug 17 12:11:16 user nova-compute[73449]:       <backend model="random">/dev/urandom</backend>
Aug 17 12:11:16 user nova-compute[73449]:     </rng>
Aug 17 12:11:16 user nova-compute[73449]:     <controller type="usb" index="0" model="none"/>
Aug 17 12:11:16 user nova-compute[73449]:     <memballoon model="virtio">
Aug 17 12:11:16 user nova-compute[73449]:       <stats period="10"/>
Aug 17 12:11:16 user nova-compute[73449]:     </memballoon>
Aug 17 12:11:16 user nova-compute[73449]:   </devices>
Aug 17 12:11:16 user nova-compute[73449]: </domain>
Aug 17 12:11:16 user nova-compute[73449]:  {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 12:11:16 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-8491c5b1-a2d5-4b1c-8526-621eec861efa tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T12:11:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-817310208',display_name='tempest-AttachVolumeNegativeTest-server-817310208',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-817310208',id=50,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOy5DLspZnAj1djQXj9ZyB40hkOn0T9B1VlovtlAH4KPVg1j7MPJgsS3aQ9Yk3zZQliShPIklN85oG2IdaOaDRPzR9q8wwzbRr11nHZNJMlN2f+cTGo/u1+MBxA23/2xew==',key_name='tempest-keypair-1006997117',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75aa99e369c54b65aff27adbb1daf2b8',ramdisk_id='',reservation_id='r-2ic3nlq0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-165752051',owner_user_name='tempest-AttachVolumeNegativeTest-165752051-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T12:11:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55cde68973ca42d095180b5c0701b49b',uuid=731e74ce-bc73-49e6-b74b-4d652952b8cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d5640497-17d4-4d8f-b99f-797a8e2b4221", "address": "fa:16:3e:bd:10:2a", "network": {"id": "71648e1b-cf19-44b7-bae2-9d38543cdee9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-822323626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75aa99e369c54b65aff27adbb1daf2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5640497-17", "ovs_interfaceid": "d5640497-17d4-4d8f-b99f-797a8e2b4221", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 12:11:16 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-8491c5b1-a2d5-4b1c-8526-621eec861efa tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Converting VIF {"id": "d5640497-17d4-4d8f-b99f-797a8e2b4221", "address": "fa:16:3e:bd:10:2a", "network": {"id": "71648e1b-cf19-44b7-bae2-9d38543cdee9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-822323626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75aa99e369c54b65aff27adbb1daf2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5640497-17", "ovs_interfaceid": "d5640497-17d4-4d8f-b99f-797a8e2b4221", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 12:11:16 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-8491c5b1-a2d5-4b1c-8526-621eec861efa tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:10:2a,bridge_name='br-int',has_traffic_filtering=True,id=d5640497-17d4-4d8f-b99f-797a8e2b4221,network=Network(71648e1b-cf19-44b7-bae2-9d38543cdee9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5640497-17') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 12:11:16 user nova-compute[73449]: DEBUG os_vif [None req-8491c5b1-a2d5-4b1c-8526-621eec861efa tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:10:2a,bridge_name='br-int',has_traffic_filtering=True,id=d5640497-17d4-4d8f-b99f-797a8e2b4221,network=Network(71648e1b-cf19-44b7-bae2-9d38543cdee9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5640497-17') {{(pid=73449) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 12:11:16 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:11:16 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 12:11:16 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 12:11:16 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:11:16 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd5640497-17, may_exist=True, interface_attrs={}) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 12:11:16 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd5640497-17, col_values=(('external_ids', {'iface-id': 'd5640497-17d4-4d8f-b99f-797a8e2b4221', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bd:10:2a', 'vm-uuid': '731e74ce-bc73-49e6-b74b-4d652952b8cf'}),), if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 12:11:16 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:11:16 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:11:16 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:11:16 user nova-compute[73449]: INFO os_vif [None req-8491c5b1-a2d5-4b1c-8526-621eec861efa tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:10:2a,bridge_name='br-int',has_traffic_filtering=True,id=d5640497-17d4-4d8f-b99f-797a8e2b4221,network=Network(71648e1b-cf19-44b7-bae2-9d38543cdee9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5640497-17')
Aug 17 12:11:16 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-8491c5b1-a2d5-4b1c-8526-621eec861efa tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] No BDM found with device name vda, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 12:11:16 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-8491c5b1-a2d5-4b1c-8526-621eec861efa tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] No VIF found with MAC fa:16:3e:bd:10:2a, not building metadata {{(pid=73449) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 12:11:16 user nova-compute[73449]: DEBUG nova.network.neutron [None req-09d1f9dd-d441-45d3-9be5-e94a3a2464c7 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Updating instance_info_cache with network_info: [{"id": "f9f6066e-ddd2-4e41-b92a-5713cfb9a223", "address": "fa:16:3e:d2:c7:08", "network": {"id": "2ead35b7-4013-4fab-b35f-02f3237fcac1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1887618888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2a2f7faf23147fba5270c844eac051a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9f6066e-dd", "ovs_interfaceid": "f9f6066e-ddd2-4e41-b92a-5713cfb9a223", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 12:11:16 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-09d1f9dd-d441-45d3-9be5-e94a3a2464c7 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Releasing lock "refresh_cache-61201d5c-26f1-4c6d-a764-be2ee2e533ae" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 12:11:16 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Instance destroyed successfully.
Aug 17 12:11:16 user nova-compute[73449]: DEBUG nova.objects.instance [None req-09d1f9dd-d441-45d3-9be5-e94a3a2464c7 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Lazy-loading 'resources' on Instance uuid 61201d5c-26f1-4c6d-a764-be2ee2e533ae {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:11:16 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-09d1f9dd-d441-45d3-9be5-e94a3a2464c7 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T12:03:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-460422634',display_name='tempest-AttachVolumeTestJSON-server-460422634',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-460422634',id=45,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNXw3KLSoC9Q0XBnEpzlvGLEU4aQOJ/QynPahuU7gv/dPY1PMhUmMgpw0sT/09d1GxZ/bLO+3BhHXGsw2GJhA2bjtLfUrL+5y9epJ9Io8OYn3n51dk0dquYLKVxFrx0m8Q==',key_name='tempest-keypair-402233619',keypairs=<?>,launch_index=0,launched_at=2023-08-17T12:03:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='f2a2f7faf23147fba5270c844eac051a',ramdisk_id='',reservation_id='r-arnh7g7d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1035899549',owner_user_name='tempest-AttachVolumeTestJSON-1035899549-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T12:09:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9b21e7e411a54be0890ae7b0ca85d80c',uuid=61201d5c-26f1-4c6d-a764-be2ee2e533ae,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "f9f6066e-ddd2-4e41-b92a-5713cfb9a223", "address": "fa:16:3e:d2:c7:08", "network": {"id": "2ead35b7-4013-4fab-b35f-02f3237fcac1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1887618888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2a2f7faf23147fba5270c844eac051a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9f6066e-dd", "ovs_interfaceid": "f9f6066e-ddd2-4e41-b92a-5713cfb9a223", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 12:11:16 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-09d1f9dd-d441-45d3-9be5-e94a3a2464c7 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Converting VIF {"id": "f9f6066e-ddd2-4e41-b92a-5713cfb9a223", "address": "fa:16:3e:d2:c7:08", "network": {"id": "2ead35b7-4013-4fab-b35f-02f3237fcac1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1887618888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2a2f7faf23147fba5270c844eac051a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9f6066e-dd", "ovs_interfaceid": "f9f6066e-ddd2-4e41-b92a-5713cfb9a223", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 12:11:16 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-09d1f9dd-d441-45d3-9be5-e94a3a2464c7 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:c7:08,bridge_name='br-int',has_traffic_filtering=True,id=f9f6066e-ddd2-4e41-b92a-5713cfb9a223,network=Network(2ead35b7-4013-4fab-b35f-02f3237fcac1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9f6066e-dd') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 12:11:16 user nova-compute[73449]: DEBUG os_vif [None req-09d1f9dd-d441-45d3-9be5-e94a3a2464c7 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:c7:08,bridge_name='br-int',has_traffic_filtering=True,id=f9f6066e-ddd2-4e41-b92a-5713cfb9a223,network=Network(2ead35b7-4013-4fab-b35f-02f3237fcac1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9f6066e-dd') {{(pid=73449) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 12:11:16 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:11:16 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf9f6066e-dd, bridge=br-int, if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 12:11:16 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:11:16 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:11:16 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:11:16 user nova-compute[73449]: INFO os_vif [None req-09d1f9dd-d441-45d3-9be5-e94a3a2464c7 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:c7:08,bridge_name='br-int',has_traffic_filtering=True,id=f9f6066e-ddd2-4e41-b92a-5713cfb9a223,network=Network(2ead35b7-4013-4fab-b35f-02f3237fcac1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9f6066e-dd')
Aug 17 12:11:16 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-09d1f9dd-d441-45d3-9be5-e94a3a2464c7 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Start _get_guest_xml network_info=[{"id": "f9f6066e-ddd2-4e41-b92a-5713cfb9a223", "address": "fa:16:3e:d2:c7:08", "network": {"id": "2ead35b7-4013-4fab-b35f-02f3237fcac1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1887618888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2a2f7faf23147fba5270c844eac051a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9f6066e-dd", "ovs_interfaceid": "f9f6066e-ddd2-4e41-b92a-5713cfb9a223", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=0a2904ae-083d-41c8-83db-343132b36148,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': '0a2904ae-083d-41c8-83db-343132b36148'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 12:11:16 user nova-compute[73449]: DEBUG nova.objects.instance [None req-09d1f9dd-d441-45d3-9be5-e94a3a2464c7 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Lazy-loading 'numa_topology' on Instance uuid 61201d5c-26f1-4c6d-a764-be2ee2e533ae {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:11:16 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-09d1f9dd-d441-45d3-9be5-e94a3a2464c7 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 12:11:16 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-09d1f9dd-d441-45d3-9be5-e94a3a2464c7 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 12:11:16 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-09d1f9dd-d441-45d3-9be5-e94a3a2464c7 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 12:11:16 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-09d1f9dd-d441-45d3-9be5-e94a3a2464c7 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] CPU controller missing on host. {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 12:11:16 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-09d1f9dd-d441-45d3-9be5-e94a3a2464c7 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 12:11:16 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-09d1f9dd-d441-45d3-9be5-e94a3a2464c7 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] CPU controller found on host. {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 12:11:16 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-09d1f9dd-d441-45d3-9be5-e94a3a2464c7 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73449) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 12:11:16 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-09d1f9dd-d441-45d3-9be5-e94a3a2464c7 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T11:35:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=0a2904ae-083d-41c8-83db-343132b36148,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 12:11:16 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-09d1f9dd-d441-45d3-9be5-e94a3a2464c7 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Flavor limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 12:11:16 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-09d1f9dd-d441-45d3-9be5-e94a3a2464c7 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Image limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 12:11:16 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-09d1f9dd-d441-45d3-9be5-e94a3a2464c7 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Flavor pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 12:11:16 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-09d1f9dd-d441-45d3-9be5-e94a3a2464c7 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Image pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 12:11:16 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-09d1f9dd-d441-45d3-9be5-e94a3a2464c7 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 12:11:16 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-09d1f9dd-d441-45d3-9be5-e94a3a2464c7 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 12:11:16 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-09d1f9dd-d441-45d3-9be5-e94a3a2464c7 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 12:11:16 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-09d1f9dd-d441-45d3-9be5-e94a3a2464c7 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Got 1 possible topologies {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 12:11:16 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-09d1f9dd-d441-45d3-9be5-e94a3a2464c7 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 12:11:16 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-09d1f9dd-d441-45d3-9be5-e94a3a2464c7 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 12:11:16 user nova-compute[73449]: DEBUG nova.objects.instance [None req-09d1f9dd-d441-45d3-9be5-e94a3a2464c7 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Lazy-loading 'vcpu_model' on Instance uuid 61201d5c-26f1-4c6d-a764-be2ee2e533ae {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:11:16 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-09d1f9dd-d441-45d3-9be5-e94a3a2464c7 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T12:03:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-460422634',display_name='tempest-AttachVolumeTestJSON-server-460422634',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-460422634',id=45,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNXw3KLSoC9Q0XBnEpzlvGLEU4aQOJ/QynPahuU7gv/dPY1PMhUmMgpw0sT/09d1GxZ/bLO+3BhHXGsw2GJhA2bjtLfUrL+5y9epJ9Io8OYn3n51dk0dquYLKVxFrx0m8Q==',key_name='tempest-keypair-402233619',keypairs=<?>,launch_index=0,launched_at=2023-08-17T12:03:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='f2a2f7faf23147fba5270c844eac051a',ramdisk_id='',reservation_id='r-arnh7g7d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1035899549',owner_user_name='tempest-AttachVolumeTestJSON-1035899549-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T12:09:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9b21e7e411a54be0890ae7b0ca85d80c',uuid=61201d5c-26f1-4c6d-a764-be2ee2e533ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "f9f6066e-ddd2-4e41-b92a-5713cfb9a223", "address": "fa:16:3e:d2:c7:08", "network": {"id": "2ead35b7-4013-4fab-b35f-02f3237fcac1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1887618888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2a2f7faf23147fba5270c844eac051a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9f6066e-dd", "ovs_interfaceid": "f9f6066e-ddd2-4e41-b92a-5713cfb9a223", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73449) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 12:11:16 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-09d1f9dd-d441-45d3-9be5-e94a3a2464c7 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Converting VIF {"id": "f9f6066e-ddd2-4e41-b92a-5713cfb9a223", "address": "fa:16:3e:d2:c7:08", "network": {"id": "2ead35b7-4013-4fab-b35f-02f3237fcac1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1887618888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2a2f7faf23147fba5270c844eac051a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9f6066e-dd", "ovs_interfaceid": "f9f6066e-ddd2-4e41-b92a-5713cfb9a223", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 12:11:16 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-09d1f9dd-d441-45d3-9be5-e94a3a2464c7 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:c7:08,bridge_name='br-int',has_traffic_filtering=True,id=f9f6066e-ddd2-4e41-b92a-5713cfb9a223,network=Network(2ead35b7-4013-4fab-b35f-02f3237fcac1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9f6066e-dd') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 12:11:16 user nova-compute[73449]: DEBUG nova.objects.instance [None req-09d1f9dd-d441-45d3-9be5-e94a3a2464c7 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Lazy-loading 'pci_devices' on Instance uuid 61201d5c-26f1-4c6d-a764-be2ee2e533ae {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:11:16 user nova-compute[73449]: DEBUG nova.network.neutron [req-5b7a3bcd-643e-4848-9056-c308b648d60d req-d31a58cf-3820-4548-ac96-0322bdd56876 service nova] [instance: 731e74ce-bc73-49e6-b74b-4d652952b8cf] Updated VIF entry in instance network info cache for port d5640497-17d4-4d8f-b99f-797a8e2b4221. {{(pid=73449) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 12:11:16 user nova-compute[73449]: DEBUG nova.network.neutron [req-5b7a3bcd-643e-4848-9056-c308b648d60d req-d31a58cf-3820-4548-ac96-0322bdd56876 service nova] [instance: 731e74ce-bc73-49e6-b74b-4d652952b8cf] Updating instance_info_cache with network_info: [{"id": "d5640497-17d4-4d8f-b99f-797a8e2b4221", "address": "fa:16:3e:bd:10:2a", "network": {"id": "71648e1b-cf19-44b7-bae2-9d38543cdee9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-822323626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75aa99e369c54b65aff27adbb1daf2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5640497-17", "ovs_interfaceid": "d5640497-17d4-4d8f-b99f-797a8e2b4221", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 12:11:16 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-09d1f9dd-d441-45d3-9be5-e94a3a2464c7 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] End _get_guest_xml xml=<domain type="kvm">
Aug 17 12:11:16 user nova-compute[73449]:   <uuid>61201d5c-26f1-4c6d-a764-be2ee2e533ae</uuid>
Aug 17 12:11:16 user nova-compute[73449]:   <name>instance-0000002d</name>
Aug 17 12:11:16 user nova-compute[73449]:   <memory>524288</memory>
Aug 17 12:11:16 user nova-compute[73449]:   <vcpu>1</vcpu>
Aug 17 12:11:16 user nova-compute[73449]:   <metadata>
Aug 17 12:11:16 user nova-compute[73449]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 12:11:16 user nova-compute[73449]:       <nova:package version="0.0.0"/>
Aug 17 12:11:16 user nova-compute[73449]:       <nova:name>tempest-AttachVolumeTestJSON-server-460422634</nova:name>
Aug 17 12:11:16 user nova-compute[73449]:       <nova:creationTime>2023-08-17 12:11:16</nova:creationTime>
Aug 17 12:11:16 user nova-compute[73449]:       <nova:flavor name="m1.tiny">
Aug 17 12:11:16 user nova-compute[73449]:         <nova:memory>512</nova:memory>
Aug 17 12:11:16 user nova-compute[73449]:         <nova:disk>1</nova:disk>
Aug 17 12:11:16 user nova-compute[73449]:         <nova:swap>0</nova:swap>
Aug 17 12:11:16 user nova-compute[73449]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 12:11:16 user nova-compute[73449]:         <nova:vcpus>1</nova:vcpus>
Aug 17 12:11:16 user nova-compute[73449]:       </nova:flavor>
Aug 17 12:11:16 user nova-compute[73449]:       <nova:owner>
Aug 17 12:11:16 user nova-compute[73449]:         <nova:user uuid="9b21e7e411a54be0890ae7b0ca85d80c">tempest-AttachVolumeTestJSON-1035899549-project-member</nova:user>
Aug 17 12:11:16 user nova-compute[73449]:         <nova:project uuid="f2a2f7faf23147fba5270c844eac051a">tempest-AttachVolumeTestJSON-1035899549</nova:project>
Aug 17 12:11:16 user nova-compute[73449]:       </nova:owner>
Aug 17 12:11:16 user nova-compute[73449]:       <nova:root type="image" uuid="0a2904ae-083d-41c8-83db-343132b36148"/>
Aug 17 12:11:16 user nova-compute[73449]:       <nova:ports>
Aug 17 12:11:16 user nova-compute[73449]:         <nova:port uuid="f9f6066e-ddd2-4e41-b92a-5713cfb9a223">
Aug 17 12:11:16 user nova-compute[73449]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 17 12:11:16 user nova-compute[73449]:         </nova:port>
Aug 17 12:11:16 user nova-compute[73449]:       </nova:ports>
Aug 17 12:11:16 user nova-compute[73449]:     </nova:instance>
Aug 17 12:11:16 user nova-compute[73449]:   </metadata>
Aug 17 12:11:16 user nova-compute[73449]:   <sysinfo type="smbios">
Aug 17 12:11:16 user nova-compute[73449]:     <system>
Aug 17 12:11:16 user nova-compute[73449]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 12:11:16 user nova-compute[73449]:       <entry name="product">OpenStack Nova</entry>
Aug 17 12:11:16 user nova-compute[73449]:       <entry name="version">0.0.0</entry>
Aug 17 12:11:16 user nova-compute[73449]:       <entry name="serial">61201d5c-26f1-4c6d-a764-be2ee2e533ae</entry>
Aug 17 12:11:16 user nova-compute[73449]:       <entry name="uuid">61201d5c-26f1-4c6d-a764-be2ee2e533ae</entry>
Aug 17 12:11:16 user nova-compute[73449]:       <entry name="family">Virtual Machine</entry>
Aug 17 12:11:16 user nova-compute[73449]:     </system>
Aug 17 12:11:16 user nova-compute[73449]:   </sysinfo>
Aug 17 12:11:16 user nova-compute[73449]:   <os>
Aug 17 12:11:16 user nova-compute[73449]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 12:11:16 user nova-compute[73449]:     <boot dev="hd"/>
Aug 17 12:11:16 user nova-compute[73449]:     <smbios mode="sysinfo"/>
Aug 17 12:11:16 user nova-compute[73449]:   </os>
Aug 17 12:11:16 user nova-compute[73449]:   <features>
Aug 17 12:11:16 user nova-compute[73449]:     <acpi/>
Aug 17 12:11:16 user nova-compute[73449]:     <apic/>
Aug 17 12:11:16 user nova-compute[73449]:     <vmcoreinfo/>
Aug 17 12:11:16 user nova-compute[73449]:   </features>
Aug 17 12:11:16 user nova-compute[73449]:   <clock offset="utc">
Aug 17 12:11:16 user nova-compute[73449]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 12:11:16 user nova-compute[73449]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 12:11:16 user nova-compute[73449]:     <timer name="hpet" present="no"/>
Aug 17 12:11:16 user nova-compute[73449]:   </clock>
Aug 17 12:11:16 user nova-compute[73449]:   <cpu mode="custom" match="exact">
Aug 17 12:11:16 user nova-compute[73449]:     <model>Nehalem</model>
Aug 17 12:11:16 user nova-compute[73449]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 12:11:16 user nova-compute[73449]:   </cpu>
Aug 17 12:11:16 user nova-compute[73449]:   <devices>
Aug 17 12:11:16 user nova-compute[73449]:     <disk type="file" device="disk">
Aug 17 12:11:16 user nova-compute[73449]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 12:11:16 user nova-compute[73449]:       <source file="/opt/stack/data/nova/instances/61201d5c-26f1-4c6d-a764-be2ee2e533ae/disk"/>
Aug 17 12:11:16 user nova-compute[73449]:       <target dev="vda" bus="virtio"/>
Aug 17 12:11:16 user nova-compute[73449]:     </disk>
Aug 17 12:11:16 user nova-compute[73449]:     <interface type="ethernet">
Aug 17 12:11:16 user nova-compute[73449]:       <mac address="fa:16:3e:d2:c7:08"/>
Aug 17 12:11:16 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 12:11:16 user nova-compute[73449]:       <mtu size="1442"/>
Aug 17 12:11:16 user nova-compute[73449]:       <target dev="tapf9f6066e-dd"/>
Aug 17 12:11:16 user nova-compute[73449]:     </interface>
Aug 17 12:11:16 user nova-compute[73449]:     <serial type="pty">
Aug 17 12:11:16 user nova-compute[73449]:       <log file="/opt/stack/data/nova/instances/61201d5c-26f1-4c6d-a764-be2ee2e533ae/console.log" append="off"/>
Aug 17 12:11:16 user nova-compute[73449]:     </serial>
Aug 17 12:11:16 user nova-compute[73449]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 12:11:16 user nova-compute[73449]:     <video>
Aug 17 12:11:16 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 12:11:16 user nova-compute[73449]:     </video>
Aug 17 12:11:16 user nova-compute[73449]:     <rng model="virtio">
Aug 17 12:11:16 user nova-compute[73449]:       <backend model="random">/dev/urandom</backend>
Aug 17 12:11:16 user nova-compute[73449]:     </rng>
Aug 17 12:11:16 user nova-compute[73449]:     <controller type="usb" index="0" model="none"/>
Aug 17 12:11:16 user nova-compute[73449]:     <memballoon model="virtio">
Aug 17 12:11:16 user nova-compute[73449]:       <stats period="10"/>
Aug 17 12:11:16 user nova-compute[73449]:     </memballoon>
Aug 17 12:11:16 user nova-compute[73449]:   </devices>
Aug 17 12:11:16 user nova-compute[73449]: </domain>
Aug 17 12:11:16 user nova-compute[73449]:  {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 12:11:16 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-09d1f9dd-d441-45d3-9be5-e94a3a2464c7 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61201d5c-26f1-4c6d-a764-be2ee2e533ae/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:11:16 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-5b7a3bcd-643e-4848-9056-c308b648d60d req-d31a58cf-3820-4548-ac96-0322bdd56876 service nova] Releasing lock "refresh_cache-731e74ce-bc73-49e6-b74b-4d652952b8cf" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 12:11:16 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-09d1f9dd-d441-45d3-9be5-e94a3a2464c7 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61201d5c-26f1-4c6d-a764-be2ee2e533ae/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:11:16 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-09d1f9dd-d441-45d3-9be5-e94a3a2464c7 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61201d5c-26f1-4c6d-a764-be2ee2e533ae/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:11:16 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-09d1f9dd-d441-45d3-9be5-e94a3a2464c7 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61201d5c-26f1-4c6d-a764-be2ee2e533ae/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:11:16 user nova-compute[73449]: DEBUG nova.objects.instance [None req-09d1f9dd-d441-45d3-9be5-e94a3a2464c7 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Lazy-loading 'trusted_certs' on Instance uuid 61201d5c-26f1-4c6d-a764-be2ee2e533ae {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:11:16 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-09d1f9dd-d441-45d3-9be5-e94a3a2464c7 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:11:17 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-09d1f9dd-d441-45d3-9be5-e94a3a2464c7 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json" returned: 0 in 0.181s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:11:17 user nova-compute[73449]: DEBUG nova.virt.disk.api [None req-09d1f9dd-d441-45d3-9be5-e94a3a2464c7 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Checking if we can resize image /opt/stack/data/nova/instances/61201d5c-26f1-4c6d-a764-be2ee2e533ae/disk. size=1073741824 {{(pid=73449) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 12:11:17 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-09d1f9dd-d441-45d3-9be5-e94a3a2464c7 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61201d5c-26f1-4c6d-a764-be2ee2e533ae/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:11:17 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-09d1f9dd-d441-45d3-9be5-e94a3a2464c7 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61201d5c-26f1-4c6d-a764-be2ee2e533ae/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:11:17 user nova-compute[73449]: DEBUG nova.virt.disk.api [None req-09d1f9dd-d441-45d3-9be5-e94a3a2464c7 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Cannot resize image /opt/stack/data/nova/instances/61201d5c-26f1-4c6d-a764-be2ee2e533ae/disk to a smaller size. {{(pid=73449) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 12:11:17 user nova-compute[73449]: DEBUG nova.objects.instance [None req-09d1f9dd-d441-45d3-9be5-e94a3a2464c7 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Lazy-loading 'migration_context' on Instance uuid 61201d5c-26f1-4c6d-a764-be2ee2e533ae {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:11:17 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-09d1f9dd-d441-45d3-9be5-e94a3a2464c7 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T12:03:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-460422634',display_name='tempest-AttachVolumeTestJSON-server-460422634',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-460422634',id=45,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNXw3KLSoC9Q0XBnEpzlvGLEU4aQOJ/QynPahuU7gv/dPY1PMhUmMgpw0sT/09d1GxZ/bLO+3BhHXGsw2GJhA2bjtLfUrL+5y9epJ9Io8OYn3n51dk0dquYLKVxFrx0m8Q==',key_name='tempest-keypair-402233619',keypairs=<?>,launch_index=0,launched_at=2023-08-17T12:03:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='f2a2f7faf23147fba5270c844eac051a',ramdisk_id='',reservation_id='r-arnh7g7d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1035899549',owner_user_name='tempest-AttachVolumeTestJSON-1035899549-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T12:09:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9b21e7e411a54be0890ae7b0ca85d80c',uuid=61201d5c-26f1-4c6d-a764-be2ee2e533ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "f9f6066e-ddd2-4e41-b92a-5713cfb9a223", "address": "fa:16:3e:d2:c7:08", "network": {"id": "2ead35b7-4013-4fab-b35f-02f3237fcac1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1887618888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2a2f7faf23147fba5270c844eac051a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9f6066e-dd", "ovs_interfaceid": "f9f6066e-ddd2-4e41-b92a-5713cfb9a223", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 12:11:17 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-09d1f9dd-d441-45d3-9be5-e94a3a2464c7 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Converting VIF {"id": "f9f6066e-ddd2-4e41-b92a-5713cfb9a223", "address": "fa:16:3e:d2:c7:08", "network": {"id": "2ead35b7-4013-4fab-b35f-02f3237fcac1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1887618888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2a2f7faf23147fba5270c844eac051a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9f6066e-dd", "ovs_interfaceid": "f9f6066e-ddd2-4e41-b92a-5713cfb9a223", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 12:11:17 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-09d1f9dd-d441-45d3-9be5-e94a3a2464c7 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:c7:08,bridge_name='br-int',has_traffic_filtering=True,id=f9f6066e-ddd2-4e41-b92a-5713cfb9a223,network=Network(2ead35b7-4013-4fab-b35f-02f3237fcac1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9f6066e-dd') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 12:11:17 user nova-compute[73449]: DEBUG os_vif [None req-09d1f9dd-d441-45d3-9be5-e94a3a2464c7 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:c7:08,bridge_name='br-int',has_traffic_filtering=True,id=f9f6066e-ddd2-4e41-b92a-5713cfb9a223,network=Network(2ead35b7-4013-4fab-b35f-02f3237fcac1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9f6066e-dd') {{(pid=73449) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 12:11:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:11:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 12:11:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 12:11:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:11:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf9f6066e-dd, may_exist=True, interface_attrs={}) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 12:11:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf9f6066e-dd, col_values=(('external_ids', {'iface-id': 'f9f6066e-ddd2-4e41-b92a-5713cfb9a223', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d2:c7:08', 'vm-uuid': '61201d5c-26f1-4c6d-a764-be2ee2e533ae'}),), if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 12:11:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:11:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:11:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:11:17 user nova-compute[73449]: INFO os_vif [None req-09d1f9dd-d441-45d3-9be5-e94a3a2464c7 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:c7:08,bridge_name='br-int',has_traffic_filtering=True,id=f9f6066e-ddd2-4e41-b92a-5713cfb9a223,network=Network(2ead35b7-4013-4fab-b35f-02f3237fcac1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9f6066e-dd')
Aug 17 12:11:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:11:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:11:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:11:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:11:17 user nova-compute[73449]: DEBUG nova.compute.manager [req-1a5554f6-1028-4d24-ab80-7b6fb54f0225 req-5f081bcd-6cb2-4032-a8f0-38f226da4e8f service nova] [instance: 731e74ce-bc73-49e6-b74b-4d652952b8cf] Received event network-vif-plugged-d5640497-17d4-4d8f-b99f-797a8e2b4221 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:11:17 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-1a5554f6-1028-4d24-ab80-7b6fb54f0225 req-5f081bcd-6cb2-4032-a8f0-38f226da4e8f service nova] Acquiring lock "731e74ce-bc73-49e6-b74b-4d652952b8cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:11:17 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-1a5554f6-1028-4d24-ab80-7b6fb54f0225 req-5f081bcd-6cb2-4032-a8f0-38f226da4e8f service nova] Lock "731e74ce-bc73-49e6-b74b-4d652952b8cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:11:17 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-1a5554f6-1028-4d24-ab80-7b6fb54f0225 req-5f081bcd-6cb2-4032-a8f0-38f226da4e8f service nova] Lock "731e74ce-bc73-49e6-b74b-4d652952b8cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:11:17 user nova-compute[73449]: DEBUG nova.compute.manager [req-1a5554f6-1028-4d24-ab80-7b6fb54f0225 req-5f081bcd-6cb2-4032-a8f0-38f226da4e8f service nova] [instance: 731e74ce-bc73-49e6-b74b-4d652952b8cf] No waiting events found dispatching network-vif-plugged-d5640497-17d4-4d8f-b99f-797a8e2b4221 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 12:11:17 user nova-compute[73449]: WARNING nova.compute.manager [req-1a5554f6-1028-4d24-ab80-7b6fb54f0225 req-5f081bcd-6cb2-4032-a8f0-38f226da4e8f service nova] [instance: 731e74ce-bc73-49e6-b74b-4d652952b8cf] Received unexpected event network-vif-plugged-d5640497-17d4-4d8f-b99f-797a8e2b4221 for instance with vm_state building and task_state spawning.
Aug 17 12:11:18 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:11:18 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:11:18 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:11:18 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:11:18 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:11:18 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:11:19 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:11:19 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:11:19 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:11:19 user nova-compute[73449]: DEBUG nova.compute.manager [req-183f1564-e233-4c75-ab0a-aa024bbe2b24 req-f5c03475-b7a4-4037-92b3-b75930c3a051 service nova] [instance: 731e74ce-bc73-49e6-b74b-4d652952b8cf] Received event network-vif-plugged-d5640497-17d4-4d8f-b99f-797a8e2b4221 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:11:19 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-183f1564-e233-4c75-ab0a-aa024bbe2b24 req-f5c03475-b7a4-4037-92b3-b75930c3a051 service nova] Acquiring lock "731e74ce-bc73-49e6-b74b-4d652952b8cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:11:19 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-183f1564-e233-4c75-ab0a-aa024bbe2b24 req-f5c03475-b7a4-4037-92b3-b75930c3a051 service nova] Lock "731e74ce-bc73-49e6-b74b-4d652952b8cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:11:19 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-183f1564-e233-4c75-ab0a-aa024bbe2b24 req-f5c03475-b7a4-4037-92b3-b75930c3a051 service nova] Lock "731e74ce-bc73-49e6-b74b-4d652952b8cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:11:19 user nova-compute[73449]: DEBUG nova.compute.manager [req-183f1564-e233-4c75-ab0a-aa024bbe2b24 req-f5c03475-b7a4-4037-92b3-b75930c3a051 service nova] [instance: 731e74ce-bc73-49e6-b74b-4d652952b8cf] No waiting events found dispatching network-vif-plugged-d5640497-17d4-4d8f-b99f-797a8e2b4221 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 12:11:19 user nova-compute[73449]: WARNING nova.compute.manager [req-183f1564-e233-4c75-ab0a-aa024bbe2b24 req-f5c03475-b7a4-4037-92b3-b75930c3a051 service nova] [instance: 731e74ce-bc73-49e6-b74b-4d652952b8cf] Received unexpected event network-vif-plugged-d5640497-17d4-4d8f-b99f-797a8e2b4221 for instance with vm_state building and task_state spawning.
Aug 17 12:11:19 user nova-compute[73449]: DEBUG nova.compute.manager [req-183f1564-e233-4c75-ab0a-aa024bbe2b24 req-f5c03475-b7a4-4037-92b3-b75930c3a051 service nova] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Received event network-vif-plugged-f9f6066e-ddd2-4e41-b92a-5713cfb9a223 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:11:19 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-183f1564-e233-4c75-ab0a-aa024bbe2b24 req-f5c03475-b7a4-4037-92b3-b75930c3a051 service nova] Acquiring lock "61201d5c-26f1-4c6d-a764-be2ee2e533ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:11:19 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-183f1564-e233-4c75-ab0a-aa024bbe2b24 req-f5c03475-b7a4-4037-92b3-b75930c3a051 service nova] Lock "61201d5c-26f1-4c6d-a764-be2ee2e533ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:11:19 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-183f1564-e233-4c75-ab0a-aa024bbe2b24 req-f5c03475-b7a4-4037-92b3-b75930c3a051 service nova] Lock "61201d5c-26f1-4c6d-a764-be2ee2e533ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:11:19 user nova-compute[73449]: DEBUG nova.compute.manager [req-183f1564-e233-4c75-ab0a-aa024bbe2b24 req-f5c03475-b7a4-4037-92b3-b75930c3a051 service nova] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] No waiting events found dispatching network-vif-plugged-f9f6066e-ddd2-4e41-b92a-5713cfb9a223 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 12:11:19 user nova-compute[73449]: WARNING nova.compute.manager [req-183f1564-e233-4c75-ab0a-aa024bbe2b24 req-f5c03475-b7a4-4037-92b3-b75930c3a051 service nova] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Received unexpected event network-vif-plugged-f9f6066e-ddd2-4e41-b92a-5713cfb9a223 for instance with vm_state stopped and task_state powering-on.
Aug 17 12:11:19 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:11:19 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:11:19 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:11:19 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:11:19 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=73449) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 12:11:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61201d5c-26f1-4c6d-a764-be2ee2e533ae/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:11:20 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:11:20 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:11:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61201d5c-26f1-4c6d-a764-be2ee2e533ae/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:11:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61201d5c-26f1-4c6d-a764-be2ee2e533ae/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:11:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61201d5c-26f1-4c6d-a764-be2ee2e533ae/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:11:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fdfaf32-0957-453a-b1cf-9a3c19815c45/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:11:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fdfaf32-0957-453a-b1cf-9a3c19815c45/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:11:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fdfaf32-0957-453a-b1cf-9a3c19815c45/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:11:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fdfaf32-0957-453a-b1cf-9a3c19815c45/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:11:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/731e74ce-bc73-49e6-b74b-4d652952b8cf/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:11:21 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/731e74ce-bc73-49e6-b74b-4d652952b8cf/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:11:21 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/731e74ce-bc73-49e6-b74b-4d652952b8cf/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:11:21 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/731e74ce-bc73-49e6-b74b-4d652952b8cf/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:11:21 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692274281.4468615, 731e74ce-bc73-49e6-b74b-4d652952b8cf => Resumed> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 12:11:21 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 731e74ce-bc73-49e6-b74b-4d652952b8cf] VM Resumed (Lifecycle Event)
Aug 17 12:11:21 user nova-compute[73449]: DEBUG nova.compute.manager [None req-8491c5b1-a2d5-4b1c-8526-621eec861efa tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: 731e74ce-bc73-49e6-b74b-4d652952b8cf] Instance event wait completed in 0 seconds for  {{(pid=73449) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 12:11:21 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-8491c5b1-a2d5-4b1c-8526-621eec861efa tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: 731e74ce-bc73-49e6-b74b-4d652952b8cf] Guest created on hypervisor {{(pid=73449) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 12:11:21 user nova-compute[73449]: DEBUG nova.compute.manager [None req-09d1f9dd-d441-45d3-9be5-e94a3a2464c7 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Instance event wait completed in 0 seconds for  {{(pid=73449) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 12:11:21 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: 731e74ce-bc73-49e6-b74b-4d652952b8cf] Instance spawned successfully.
Aug 17 12:11:21 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-8491c5b1-a2d5-4b1c-8526-621eec861efa tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: 731e74ce-bc73-49e6-b74b-4d652952b8cf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 12:11:21 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 731e74ce-bc73-49e6-b74b-4d652952b8cf] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 12:11:21 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 12:11:21 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 12:11:21 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Hypervisor/Node resource view: name=user free_ram=8524MB free_disk=25.05571746826172GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73449) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 12:11:21 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:11:21 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:11:21 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Instance rebooted successfully.
Aug 17 12:11:21 user nova-compute[73449]: DEBUG nova.compute.manager [None req-09d1f9dd-d441-45d3-9be5-e94a3a2464c7 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 12:11:21 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 731e74ce-bc73-49e6-b74b-4d652952b8cf] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 12:11:21 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-8491c5b1-a2d5-4b1c-8526-621eec861efa tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: 731e74ce-bc73-49e6-b74b-4d652952b8cf] Found default for hw_cdrom_bus of ide {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 12:11:21 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-8491c5b1-a2d5-4b1c-8526-621eec861efa tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: 731e74ce-bc73-49e6-b74b-4d652952b8cf] Found default for hw_disk_bus of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 12:11:21 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-8491c5b1-a2d5-4b1c-8526-621eec861efa tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: 731e74ce-bc73-49e6-b74b-4d652952b8cf] Found default for hw_input_bus of None {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 12:11:21 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-8491c5b1-a2d5-4b1c-8526-621eec861efa tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: 731e74ce-bc73-49e6-b74b-4d652952b8cf] Found default for hw_pointer_model of None {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 12:11:21 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-8491c5b1-a2d5-4b1c-8526-621eec861efa tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: 731e74ce-bc73-49e6-b74b-4d652952b8cf] Found default for hw_video_model of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 12:11:21 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-8491c5b1-a2d5-4b1c-8526-621eec861efa tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: 731e74ce-bc73-49e6-b74b-4d652952b8cf] Found default for hw_vif_model of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 12:11:21 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 731e74ce-bc73-49e6-b74b-4d652952b8cf] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 12:11:21 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692274281.4484336, 731e74ce-bc73-49e6-b74b-4d652952b8cf => Started> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 12:11:21 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 731e74ce-bc73-49e6-b74b-4d652952b8cf] VM Started (Lifecycle Event)
Aug 17 12:11:21 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 731e74ce-bc73-49e6-b74b-4d652952b8cf] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 12:11:21 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 731e74ce-bc73-49e6-b74b-4d652952b8cf] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 12:11:21 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 731e74ce-bc73-49e6-b74b-4d652952b8cf] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 12:11:21 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692274281.8331673, 61201d5c-26f1-4c6d-a764-be2ee2e533ae => Resumed> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 12:11:21 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] VM Resumed (Lifecycle Event)
Aug 17 12:11:21 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 61201d5c-26f1-4c6d-a764-be2ee2e533ae actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 12:11:21 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 8fdfaf32-0957-453a-b1cf-9a3c19815c45 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 12:11:21 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 731e74ce-bc73-49e6-b74b-4d652952b8cf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 12:11:21 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=73449) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 12:11:21 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=73449) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 12:11:21 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 12:11:22 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 12:11:22 user nova-compute[73449]: DEBUG nova.compute.manager [req-8ecc6cca-7025-4943-a86d-116aad51d8cc req-c3dae025-56eb-4f3f-a126-df9073edac3e service nova] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Received event network-vif-plugged-f9f6066e-ddd2-4e41-b92a-5713cfb9a223 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:11:22 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-8ecc6cca-7025-4943-a86d-116aad51d8cc req-c3dae025-56eb-4f3f-a126-df9073edac3e service nova] Acquiring lock "61201d5c-26f1-4c6d-a764-be2ee2e533ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:11:22 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-8ecc6cca-7025-4943-a86d-116aad51d8cc req-c3dae025-56eb-4f3f-a126-df9073edac3e service nova] Lock "61201d5c-26f1-4c6d-a764-be2ee2e533ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:11:22 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-8ecc6cca-7025-4943-a86d-116aad51d8cc req-c3dae025-56eb-4f3f-a126-df9073edac3e service nova] Lock "61201d5c-26f1-4c6d-a764-be2ee2e533ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:11:22 user nova-compute[73449]: DEBUG nova.compute.manager [req-8ecc6cca-7025-4943-a86d-116aad51d8cc req-c3dae025-56eb-4f3f-a126-df9073edac3e service nova] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] No waiting events found dispatching network-vif-plugged-f9f6066e-ddd2-4e41-b92a-5713cfb9a223 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 12:11:22 user nova-compute[73449]: WARNING nova.compute.manager [req-8ecc6cca-7025-4943-a86d-116aad51d8cc req-c3dae025-56eb-4f3f-a126-df9073edac3e service nova] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Received unexpected event network-vif-plugged-f9f6066e-ddd2-4e41-b92a-5713cfb9a223 for instance with vm_state active and task_state None.
Aug 17 12:11:22 user nova-compute[73449]: INFO nova.compute.manager [None req-8491c5b1-a2d5-4b1c-8526-621eec861efa tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: 731e74ce-bc73-49e6-b74b-4d652952b8cf] Took 8.66 seconds to spawn the instance on the hypervisor.
Aug 17 12:11:22 user nova-compute[73449]: DEBUG nova.compute.manager [None req-8491c5b1-a2d5-4b1c-8526-621eec861efa tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: 731e74ce-bc73-49e6-b74b-4d652952b8cf] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 12:11:22 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692274281.8335855, 61201d5c-26f1-4c6d-a764-be2ee2e533ae => Started> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 12:11:22 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] VM Started (Lifecycle Event)
Aug 17 12:11:22 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 12:11:22 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 12:11:22 user nova-compute[73449]: INFO nova.compute.manager [None req-8491c5b1-a2d5-4b1c-8526-621eec861efa tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: 731e74ce-bc73-49e6-b74b-4d652952b8cf] Took 9.26 seconds to build instance.
Aug 17 12:11:22 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-8491c5b1-a2d5-4b1c-8526-621eec861efa tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Lock "731e74ce-bc73-49e6-b74b-4d652952b8cf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.370s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:11:22 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 12:11:22 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 12:11:22 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Compute_service record updated for user:user {{(pid=73449) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 12:11:22 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.395s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:11:22 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:11:22 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:11:23 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-d3505f0a-214c-4b52-84f5-3854372d65b0 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Acquiring lock "8fdfaf32-0957-453a-b1cf-9a3c19815c45" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:11:23 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-d3505f0a-214c-4b52-84f5-3854372d65b0 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Lock "8fdfaf32-0957-453a-b1cf-9a3c19815c45" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:11:23 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-d3505f0a-214c-4b52-84f5-3854372d65b0 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Acquiring lock "8fdfaf32-0957-453a-b1cf-9a3c19815c45-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:11:23 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-d3505f0a-214c-4b52-84f5-3854372d65b0 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Lock "8fdfaf32-0957-453a-b1cf-9a3c19815c45-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:11:23 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-d3505f0a-214c-4b52-84f5-3854372d65b0 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Lock "8fdfaf32-0957-453a-b1cf-9a3c19815c45-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:11:23 user nova-compute[73449]: INFO nova.compute.manager [None req-d3505f0a-214c-4b52-84f5-3854372d65b0 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] [instance: 8fdfaf32-0957-453a-b1cf-9a3c19815c45] Terminating instance
Aug 17 12:11:23 user nova-compute[73449]: DEBUG nova.compute.manager [None req-d3505f0a-214c-4b52-84f5-3854372d65b0 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] [instance: 8fdfaf32-0957-453a-b1cf-9a3c19815c45] Start destroying the instance on the hypervisor. {{(pid=73449) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 12:11:23 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:11:23 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:11:23 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:11:23 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:11:23 user nova-compute[73449]: DEBUG nova.compute.manager [req-9de99041-8899-4bd1-9c84-6ce06a6fcf97 req-b3fb1705-ffac-412d-9d95-4bf6b3f5c84d service nova] [instance: 8fdfaf32-0957-453a-b1cf-9a3c19815c45] Received event network-vif-unplugged-fb4a2e2a-cbf2-4141-bac3-c6033653bb84 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:11:23 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-9de99041-8899-4bd1-9c84-6ce06a6fcf97 req-b3fb1705-ffac-412d-9d95-4bf6b3f5c84d service nova] Acquiring lock "8fdfaf32-0957-453a-b1cf-9a3c19815c45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:11:23 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-9de99041-8899-4bd1-9c84-6ce06a6fcf97 req-b3fb1705-ffac-412d-9d95-4bf6b3f5c84d service nova] Lock "8fdfaf32-0957-453a-b1cf-9a3c19815c45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:11:23 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-9de99041-8899-4bd1-9c84-6ce06a6fcf97 req-b3fb1705-ffac-412d-9d95-4bf6b3f5c84d service nova] Lock "8fdfaf32-0957-453a-b1cf-9a3c19815c45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:11:23 user nova-compute[73449]: DEBUG nova.compute.manager [req-9de99041-8899-4bd1-9c84-6ce06a6fcf97 req-b3fb1705-ffac-412d-9d95-4bf6b3f5c84d service nova] [instance: 8fdfaf32-0957-453a-b1cf-9a3c19815c45] No waiting events found dispatching network-vif-unplugged-fb4a2e2a-cbf2-4141-bac3-c6033653bb84 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 12:11:23 user nova-compute[73449]: DEBUG nova.compute.manager [req-9de99041-8899-4bd1-9c84-6ce06a6fcf97 req-b3fb1705-ffac-412d-9d95-4bf6b3f5c84d service nova] [instance: 8fdfaf32-0957-453a-b1cf-9a3c19815c45] Received event network-vif-unplugged-fb4a2e2a-cbf2-4141-bac3-c6033653bb84 for instance with task_state deleting. {{(pid=73449) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 12:11:23 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:11:24 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: 8fdfaf32-0957-453a-b1cf-9a3c19815c45] Instance destroyed successfully.
Aug 17 12:11:24 user nova-compute[73449]: DEBUG nova.objects.instance [None req-d3505f0a-214c-4b52-84f5-3854372d65b0 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Lazy-loading 'resources' on Instance uuid 8fdfaf32-0957-453a-b1cf-9a3c19815c45 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:11:24 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-d3505f0a-214c-4b52-84f5-3854372d65b0 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T12:03:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1756393260',display_name='tempest-TestStampPattern-server-1756393260',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1756393260',id=47,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIJ2Eo5DY98v4ABNkSPsmOpSAggLOMtuKT7FC5l8WhxwKHhwEcVH95zEdzfXTi8XjE0vKAypvTBXbrGRvlqVzqU569MwCVfJPBtduUClfPdtl8n174kTkHvx5qjovHToOQ==',key_name='tempest-TestStampPattern-923522805',keypairs=<?>,launch_index=0,launched_at=2023-08-17T12:04:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3c9e5daa31ad47e996b59f1b7c5db0d4',ramdisk_id='',reservation_id='r-ikb0vnkf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-806391027',owner_user_name='tempest-TestStampPattern-806391027-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T12:07:11Z,user_data=None,user_id='f7ae0aef93334fa599be6d1a4d728595',uuid=8fdfaf32-0957-453a-b1cf-9a3c19815c45,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fb4a2e2a-cbf2-4141-bac3-c6033653bb84", "address": "fa:16:3e:c1:11:0e", "network": {"id": "1e184b35-0ffc-4c89-951b-d97b1961f72f", "bridge": "br-int", "label": "tempest-TestStampPattern-2134909631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c9e5daa31ad47e996b59f1b7c5db0d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb4a2e2a-cb", "ovs_interfaceid": "fb4a2e2a-cbf2-4141-bac3-c6033653bb84", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 12:11:24 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-d3505f0a-214c-4b52-84f5-3854372d65b0 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Converting VIF {"id": "fb4a2e2a-cbf2-4141-bac3-c6033653bb84", "address": "fa:16:3e:c1:11:0e", "network": {"id": "1e184b35-0ffc-4c89-951b-d97b1961f72f", "bridge": "br-int", "label": "tempest-TestStampPattern-2134909631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c9e5daa31ad47e996b59f1b7c5db0d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb4a2e2a-cb", "ovs_interfaceid": "fb4a2e2a-cbf2-4141-bac3-c6033653bb84", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 12:11:24 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-d3505f0a-214c-4b52-84f5-3854372d65b0 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c1:11:0e,bridge_name='br-int',has_traffic_filtering=True,id=fb4a2e2a-cbf2-4141-bac3-c6033653bb84,network=Network(1e184b35-0ffc-4c89-951b-d97b1961f72f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb4a2e2a-cb') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 12:11:24 user nova-compute[73449]: DEBUG os_vif [None req-d3505f0a-214c-4b52-84f5-3854372d65b0 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:11:0e,bridge_name='br-int',has_traffic_filtering=True,id=fb4a2e2a-cbf2-4141-bac3-c6033653bb84,network=Network(1e184b35-0ffc-4c89-951b-d97b1961f72f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb4a2e2a-cb') {{(pid=73449) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 12:11:24 user nova-compute[73449]: DEBUG nova.compute.manager [req-9fb5f70e-3cc2-41ea-92a5-891a98d19d47 req-04f38a83-a72b-4df6-b874-27fbcffdb921 service nova] [instance: 8fdfaf32-0957-453a-b1cf-9a3c19815c45] Received event network-changed-fb4a2e2a-cbf2-4141-bac3-c6033653bb84 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:11:24 user nova-compute[73449]: DEBUG nova.compute.manager [req-9fb5f70e-3cc2-41ea-92a5-891a98d19d47 req-04f38a83-a72b-4df6-b874-27fbcffdb921 service nova] [instance: 8fdfaf32-0957-453a-b1cf-9a3c19815c45] Refreshing instance network info cache due to event network-changed-fb4a2e2a-cbf2-4141-bac3-c6033653bb84. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 12:11:24 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-9fb5f70e-3cc2-41ea-92a5-891a98d19d47 req-04f38a83-a72b-4df6-b874-27fbcffdb921 service nova] Acquiring lock "refresh_cache-8fdfaf32-0957-453a-b1cf-9a3c19815c45" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 12:11:24 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-9fb5f70e-3cc2-41ea-92a5-891a98d19d47 req-04f38a83-a72b-4df6-b874-27fbcffdb921 service nova] Acquired lock "refresh_cache-8fdfaf32-0957-453a-b1cf-9a3c19815c45" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 12:11:24 user nova-compute[73449]: DEBUG nova.network.neutron [req-9fb5f70e-3cc2-41ea-92a5-891a98d19d47 req-04f38a83-a72b-4df6-b874-27fbcffdb921 service nova] [instance: 8fdfaf32-0957-453a-b1cf-9a3c19815c45] Refreshing network info cache for port fb4a2e2a-cbf2-4141-bac3-c6033653bb84 {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 12:11:24 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:11:24 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfb4a2e2a-cb, bridge=br-int, if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 12:11:24 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:11:24 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:11:24 user nova-compute[73449]: INFO os_vif [None req-d3505f0a-214c-4b52-84f5-3854372d65b0 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:11:0e,bridge_name='br-int',has_traffic_filtering=True,id=fb4a2e2a-cbf2-4141-bac3-c6033653bb84,network=Network(1e184b35-0ffc-4c89-951b-d97b1961f72f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb4a2e2a-cb')
Aug 17 12:11:24 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-d3505f0a-214c-4b52-84f5-3854372d65b0 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] [instance: 8fdfaf32-0957-453a-b1cf-9a3c19815c45] Deleting instance files /opt/stack/data/nova/instances/8fdfaf32-0957-453a-b1cf-9a3c19815c45_del
Aug 17 12:11:24 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-d3505f0a-214c-4b52-84f5-3854372d65b0 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] [instance: 8fdfaf32-0957-453a-b1cf-9a3c19815c45] Deletion of /opt/stack/data/nova/instances/8fdfaf32-0957-453a-b1cf-9a3c19815c45_del complete
Aug 17 12:11:24 user nova-compute[73449]: INFO nova.compute.manager [None req-d3505f0a-214c-4b52-84f5-3854372d65b0 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] [instance: 8fdfaf32-0957-453a-b1cf-9a3c19815c45] Took 0.93 seconds to destroy the instance on the hypervisor.
Aug 17 12:11:24 user nova-compute[73449]: DEBUG oslo.service.loopingcall [None req-d3505f0a-214c-4b52-84f5-3854372d65b0 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73449) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 12:11:24 user nova-compute[73449]: DEBUG nova.compute.manager [-] [instance: 8fdfaf32-0957-453a-b1cf-9a3c19815c45] Deallocating network for instance {{(pid=73449) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 12:11:24 user nova-compute[73449]: DEBUG nova.network.neutron [-] [instance: 8fdfaf32-0957-453a-b1cf-9a3c19815c45] deallocate_for_instance() {{(pid=73449) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 12:11:24 user nova-compute[73449]: DEBUG nova.network.neutron [req-9fb5f70e-3cc2-41ea-92a5-891a98d19d47 req-04f38a83-a72b-4df6-b874-27fbcffdb921 service nova] [instance: 8fdfaf32-0957-453a-b1cf-9a3c19815c45] Updated VIF entry in instance network info cache for port fb4a2e2a-cbf2-4141-bac3-c6033653bb84. {{(pid=73449) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 12:11:24 user nova-compute[73449]: DEBUG nova.network.neutron [req-9fb5f70e-3cc2-41ea-92a5-891a98d19d47 req-04f38a83-a72b-4df6-b874-27fbcffdb921 service nova] [instance: 8fdfaf32-0957-453a-b1cf-9a3c19815c45] Updating instance_info_cache with network_info: [{"id": "fb4a2e2a-cbf2-4141-bac3-c6033653bb84", "address": "fa:16:3e:c1:11:0e", "network": {"id": "1e184b35-0ffc-4c89-951b-d97b1961f72f", "bridge": "br-int", "label": "tempest-TestStampPattern-2134909631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c9e5daa31ad47e996b59f1b7c5db0d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb4a2e2a-cb", "ovs_interfaceid": "fb4a2e2a-cbf2-4141-bac3-c6033653bb84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 12:11:24 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-9fb5f70e-3cc2-41ea-92a5-891a98d19d47 req-04f38a83-a72b-4df6-b874-27fbcffdb921 service nova] Releasing lock "refresh_cache-8fdfaf32-0957-453a-b1cf-9a3c19815c45" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 12:11:24 user nova-compute[73449]: DEBUG nova.network.neutron [-] [instance: 8fdfaf32-0957-453a-b1cf-9a3c19815c45] Updating instance_info_cache with network_info: [] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 12:11:24 user nova-compute[73449]: INFO nova.compute.manager [-] [instance: 8fdfaf32-0957-453a-b1cf-9a3c19815c45] Took 0.73 seconds to deallocate network for instance.
Aug 17 12:11:25 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-d3505f0a-214c-4b52-84f5-3854372d65b0 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:11:25 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-d3505f0a-214c-4b52-84f5-3854372d65b0 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:11:25 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-d3505f0a-214c-4b52-84f5-3854372d65b0 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 12:11:25 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-d3505f0a-214c-4b52-84f5-3854372d65b0 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 12:11:25 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-d3505f0a-214c-4b52-84f5-3854372d65b0 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.207s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:11:25 user nova-compute[73449]: INFO nova.scheduler.client.report [None req-d3505f0a-214c-4b52-84f5-3854372d65b0 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Deleted allocations for instance 8fdfaf32-0957-453a-b1cf-9a3c19815c45
Aug 17 12:11:25 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:11:25 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Starting heal instance info cache {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 12:11:25 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-d3505f0a-214c-4b52-84f5-3854372d65b0 tempest-TestStampPattern-806391027 tempest-TestStampPattern-806391027-project-member] Lock "8fdfaf32-0957-453a-b1cf-9a3c19815c45" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.128s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:11:25 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "refresh_cache-8fdfaf32-0957-453a-b1cf-9a3c19815c45" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 12:11:25 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquired lock "refresh_cache-8fdfaf32-0957-453a-b1cf-9a3c19815c45" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 12:11:25 user nova-compute[73449]: DEBUG nova.network.neutron [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: 8fdfaf32-0957-453a-b1cf-9a3c19815c45] Forcefully refreshing network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 12:11:25 user nova-compute[73449]: DEBUG nova.compute.utils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: 8fdfaf32-0957-453a-b1cf-9a3c19815c45] Can not refresh info_cache because instance was not found {{(pid=73449) refresh_info_cache_for_instance /opt/stack/nova/nova/compute/utils.py:1010}}
Aug 17 12:11:25 user nova-compute[73449]: DEBUG nova.network.neutron [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: 8fdfaf32-0957-453a-b1cf-9a3c19815c45] Instance cache missing network info. {{(pid=73449) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 12:11:25 user nova-compute[73449]: DEBUG nova.compute.manager [req-a595923e-1aea-4d6d-923a-b18267f7c91f req-5ae891e8-b04e-4f7f-aed0-38f980263bfd service nova] [instance: 8fdfaf32-0957-453a-b1cf-9a3c19815c45] Received event network-vif-plugged-fb4a2e2a-cbf2-4141-bac3-c6033653bb84 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:11:25 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-a595923e-1aea-4d6d-923a-b18267f7c91f req-5ae891e8-b04e-4f7f-aed0-38f980263bfd service nova] Acquiring lock "8fdfaf32-0957-453a-b1cf-9a3c19815c45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:11:25 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-a595923e-1aea-4d6d-923a-b18267f7c91f req-5ae891e8-b04e-4f7f-aed0-38f980263bfd service nova] Lock "8fdfaf32-0957-453a-b1cf-9a3c19815c45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:11:25 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-a595923e-1aea-4d6d-923a-b18267f7c91f req-5ae891e8-b04e-4f7f-aed0-38f980263bfd service nova] Lock "8fdfaf32-0957-453a-b1cf-9a3c19815c45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:11:25 user nova-compute[73449]: DEBUG nova.compute.manager [req-a595923e-1aea-4d6d-923a-b18267f7c91f req-5ae891e8-b04e-4f7f-aed0-38f980263bfd service nova] [instance: 8fdfaf32-0957-453a-b1cf-9a3c19815c45] No waiting events found dispatching network-vif-plugged-fb4a2e2a-cbf2-4141-bac3-c6033653bb84 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 12:11:25 user nova-compute[73449]: WARNING nova.compute.manager [req-a595923e-1aea-4d6d-923a-b18267f7c91f req-5ae891e8-b04e-4f7f-aed0-38f980263bfd service nova] [instance: 8fdfaf32-0957-453a-b1cf-9a3c19815c45] Received unexpected event network-vif-plugged-fb4a2e2a-cbf2-4141-bac3-c6033653bb84 for instance with vm_state deleted and task_state None.
Aug 17 12:11:25 user nova-compute[73449]: DEBUG nova.compute.manager [req-a595923e-1aea-4d6d-923a-b18267f7c91f req-5ae891e8-b04e-4f7f-aed0-38f980263bfd service nova] [instance: 8fdfaf32-0957-453a-b1cf-9a3c19815c45] Received event network-vif-deleted-fb4a2e2a-cbf2-4141-bac3-c6033653bb84 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:11:25 user nova-compute[73449]: DEBUG nova.network.neutron [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: 8fdfaf32-0957-453a-b1cf-9a3c19815c45] Updating instance_info_cache with network_info: [] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 12:11:25 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Releasing lock "refresh_cache-8fdfaf32-0957-453a-b1cf-9a3c19815c45" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 12:11:25 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: 8fdfaf32-0957-453a-b1cf-9a3c19815c45] Updated the network info_cache for instance {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 12:11:25 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:11:29 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:11:34 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:11:38 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:11:39 user nova-compute[73449]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692274284.0498097, 8fdfaf32-0957-453a-b1cf-9a3c19815c45 => Stopped> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 12:11:39 user nova-compute[73449]: INFO nova.compute.manager [-] [instance: 8fdfaf32-0957-453a-b1cf-9a3c19815c45] VM Stopped (Lifecycle Event)
Aug 17 12:11:39 user nova-compute[73449]: DEBUG nova.compute.manager [None req-0cfb07e6-b7f1-47da-9a95-c4deac298c18 None None] [instance: 8fdfaf32-0957-453a-b1cf-9a3c19815c45] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 12:11:39 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:11:39 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:11:39 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73449) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 17 12:11:43 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:11:44 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:11:48 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:11:49 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:11:53 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:11:54 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:11:59 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:12:04 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:12:08 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:12:09 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:12:12 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:12:13 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:12:13 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:12:13 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73449) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 12:12:14 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:12:15 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:12:15 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:12:17 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:12:19 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:12:20 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:12:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:12:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:12:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:12:20 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=73449) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 12:12:21 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61201d5c-26f1-4c6d-a764-be2ee2e533ae/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:12:21 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61201d5c-26f1-4c6d-a764-be2ee2e533ae/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:12:21 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61201d5c-26f1-4c6d-a764-be2ee2e533ae/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:12:21 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61201d5c-26f1-4c6d-a764-be2ee2e533ae/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:12:21 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/731e74ce-bc73-49e6-b74b-4d652952b8cf/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:12:21 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/731e74ce-bc73-49e6-b74b-4d652952b8cf/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:12:21 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/731e74ce-bc73-49e6-b74b-4d652952b8cf/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:12:21 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:12:21 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/731e74ce-bc73-49e6-b74b-4d652952b8cf/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:12:22 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 12:12:22 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 12:12:22 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Hypervisor/Node resource view: name=user free_ram=8513MB free_disk=25.05327606201172GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73449) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 12:12:22 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:12:22 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:12:22 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 61201d5c-26f1-4c6d-a764-be2ee2e533ae actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 12:12:22 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 731e74ce-bc73-49e6-b74b-4d652952b8cf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 12:12:22 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73449) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 12:12:22 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73449) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 12:12:22 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Refreshing inventories for resource provider 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 17 12:12:22 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Updating ProviderTree inventory for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 17 12:12:22 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Updating inventory in ProviderTree for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 12:12:22 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Refreshing aggregate associations for resource provider 20986bee-3f54-4b89-bec1-f8387ef700c4, aggregates: None {{(pid=73449) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 17 12:12:22 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Refreshing trait associations for resource provider 20986bee-3f54-4b89-bec1-f8387ef700c4, traits: COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NODE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE42,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSSE3,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_ISO {{(pid=73449) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 17 12:12:22 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 12:12:22 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 12:12:22 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Compute_service record updated for user:user {{(pid=73449) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 12:12:22 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.498s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:12:24 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:12:24 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:12:25 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:12:25 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Starting heal instance info cache {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 12:12:25 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Rebuilding the list of instances to heal {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 12:12:26 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "refresh_cache-61201d5c-26f1-4c6d-a764-be2ee2e533ae" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 12:12:26 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquired lock "refresh_cache-61201d5c-26f1-4c6d-a764-be2ee2e533ae" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 12:12:26 user nova-compute[73449]: DEBUG nova.network.neutron [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Forcefully refreshing network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 12:12:26 user nova-compute[73449]: DEBUG nova.objects.instance [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lazy-loading 'info_cache' on Instance uuid 61201d5c-26f1-4c6d-a764-be2ee2e533ae {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:12:27 user nova-compute[73449]: DEBUG nova.network.neutron [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Updating instance_info_cache with network_info: [{"id": "f9f6066e-ddd2-4e41-b92a-5713cfb9a223", "address": "fa:16:3e:d2:c7:08", "network": {"id": "2ead35b7-4013-4fab-b35f-02f3237fcac1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1887618888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2a2f7faf23147fba5270c844eac051a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9f6066e-dd", "ovs_interfaceid": "f9f6066e-ddd2-4e41-b92a-5713cfb9a223", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 12:12:27 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Releasing lock "refresh_cache-61201d5c-26f1-4c6d-a764-be2ee2e533ae" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 12:12:27 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Updated the network info_cache for instance {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 12:12:27 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:12:29 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:12:29 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:12:34 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:12:39 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:12:39 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:12:39 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73449) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 12:12:39 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:12:39 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:12:39 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:12:44 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:12:49 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:12:54 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:12:59 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:13:04 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:13:04 user nova-compute[73449]: DEBUG nova.compute.manager [req-097218b5-a20b-4f28-aac2-9659033a1ba2 req-99546b23-0652-4fa8-b688-e1051358a554 service nova] [instance: 731e74ce-bc73-49e6-b74b-4d652952b8cf] Received event network-changed-d5640497-17d4-4d8f-b99f-797a8e2b4221 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:13:04 user nova-compute[73449]: DEBUG nova.compute.manager [req-097218b5-a20b-4f28-aac2-9659033a1ba2 req-99546b23-0652-4fa8-b688-e1051358a554 service nova] [instance: 731e74ce-bc73-49e6-b74b-4d652952b8cf] Refreshing instance network info cache due to event network-changed-d5640497-17d4-4d8f-b99f-797a8e2b4221. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 12:13:04 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-097218b5-a20b-4f28-aac2-9659033a1ba2 req-99546b23-0652-4fa8-b688-e1051358a554 service nova] Acquiring lock "refresh_cache-731e74ce-bc73-49e6-b74b-4d652952b8cf" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 12:13:04 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-097218b5-a20b-4f28-aac2-9659033a1ba2 req-99546b23-0652-4fa8-b688-e1051358a554 service nova] Acquired lock "refresh_cache-731e74ce-bc73-49e6-b74b-4d652952b8cf" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 12:13:04 user nova-compute[73449]: DEBUG nova.network.neutron [req-097218b5-a20b-4f28-aac2-9659033a1ba2 req-99546b23-0652-4fa8-b688-e1051358a554 service nova] [instance: 731e74ce-bc73-49e6-b74b-4d652952b8cf] Refreshing network info cache for port d5640497-17d4-4d8f-b99f-797a8e2b4221 {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 12:13:05 user nova-compute[73449]: DEBUG nova.network.neutron [req-097218b5-a20b-4f28-aac2-9659033a1ba2 req-99546b23-0652-4fa8-b688-e1051358a554 service nova] [instance: 731e74ce-bc73-49e6-b74b-4d652952b8cf] Updated VIF entry in instance network info cache for port d5640497-17d4-4d8f-b99f-797a8e2b4221. {{(pid=73449) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 12:13:05 user nova-compute[73449]: DEBUG nova.network.neutron [req-097218b5-a20b-4f28-aac2-9659033a1ba2 req-99546b23-0652-4fa8-b688-e1051358a554 service nova] [instance: 731e74ce-bc73-49e6-b74b-4d652952b8cf] Updating instance_info_cache with network_info: [{"id": "d5640497-17d4-4d8f-b99f-797a8e2b4221", "address": "fa:16:3e:bd:10:2a", "network": {"id": "71648e1b-cf19-44b7-bae2-9d38543cdee9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-822323626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75aa99e369c54b65aff27adbb1daf2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5640497-17", "ovs_interfaceid": "d5640497-17d4-4d8f-b99f-797a8e2b4221", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 12:13:05 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-097218b5-a20b-4f28-aac2-9659033a1ba2 req-99546b23-0652-4fa8-b688-e1051358a554 service nova] Releasing lock "refresh_cache-731e74ce-bc73-49e6-b74b-4d652952b8cf" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 12:13:06 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b2cb4fd5-0ff9-4d79-9c36-39531b9f7892 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Acquiring lock "61201d5c-26f1-4c6d-a764-be2ee2e533ae" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:13:06 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b2cb4fd5-0ff9-4d79-9c36-39531b9f7892 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Lock "61201d5c-26f1-4c6d-a764-be2ee2e533ae" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:13:06 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b2cb4fd5-0ff9-4d79-9c36-39531b9f7892 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Acquiring lock "61201d5c-26f1-4c6d-a764-be2ee2e533ae-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:13:06 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b2cb4fd5-0ff9-4d79-9c36-39531b9f7892 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Lock "61201d5c-26f1-4c6d-a764-be2ee2e533ae-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:13:06 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b2cb4fd5-0ff9-4d79-9c36-39531b9f7892 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Lock "61201d5c-26f1-4c6d-a764-be2ee2e533ae-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:13:06 user nova-compute[73449]: INFO nova.compute.manager [None req-b2cb4fd5-0ff9-4d79-9c36-39531b9f7892 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Terminating instance
Aug 17 12:13:06 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b2cb4fd5-0ff9-4d79-9c36-39531b9f7892 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Start destroying the instance on the hypervisor. {{(pid=73449) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 12:13:06 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:13:06 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:13:06 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:13:07 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:13:07 user nova-compute[73449]: DEBUG nova.compute.manager [req-e9dc6407-bc40-4bb7-8a5e-7c0a79ac500e req-2e8fc20a-0449-42e0-b301-ddd1f526f765 service nova] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Received event network-vif-unplugged-f9f6066e-ddd2-4e41-b92a-5713cfb9a223 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:13:07 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-e9dc6407-bc40-4bb7-8a5e-7c0a79ac500e req-2e8fc20a-0449-42e0-b301-ddd1f526f765 service nova] Acquiring lock "61201d5c-26f1-4c6d-a764-be2ee2e533ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:13:07 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-e9dc6407-bc40-4bb7-8a5e-7c0a79ac500e req-2e8fc20a-0449-42e0-b301-ddd1f526f765 service nova] Lock "61201d5c-26f1-4c6d-a764-be2ee2e533ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:13:07 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-e9dc6407-bc40-4bb7-8a5e-7c0a79ac500e req-2e8fc20a-0449-42e0-b301-ddd1f526f765 service nova] Lock "61201d5c-26f1-4c6d-a764-be2ee2e533ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:13:07 user nova-compute[73449]: DEBUG nova.compute.manager [req-e9dc6407-bc40-4bb7-8a5e-7c0a79ac500e req-2e8fc20a-0449-42e0-b301-ddd1f526f765 service nova] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] No waiting events found dispatching network-vif-unplugged-f9f6066e-ddd2-4e41-b92a-5713cfb9a223 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 12:13:07 user nova-compute[73449]: DEBUG nova.compute.manager [req-e9dc6407-bc40-4bb7-8a5e-7c0a79ac500e req-2e8fc20a-0449-42e0-b301-ddd1f526f765 service nova] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Received event network-vif-unplugged-f9f6066e-ddd2-4e41-b92a-5713cfb9a223 for instance with task_state deleting. {{(pid=73449) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 12:13:07 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Instance destroyed successfully.
Aug 17 12:13:07 user nova-compute[73449]: DEBUG nova.objects.instance [None req-b2cb4fd5-0ff9-4d79-9c36-39531b9f7892 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Lazy-loading 'resources' on Instance uuid 61201d5c-26f1-4c6d-a764-be2ee2e533ae {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:13:07 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-b2cb4fd5-0ff9-4d79-9c36-39531b9f7892 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T12:03:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-460422634',display_name='tempest-AttachVolumeTestJSON-server-460422634',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-460422634',id=45,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNXw3KLSoC9Q0XBnEpzlvGLEU4aQOJ/QynPahuU7gv/dPY1PMhUmMgpw0sT/09d1GxZ/bLO+3BhHXGsw2GJhA2bjtLfUrL+5y9epJ9Io8OYn3n51dk0dquYLKVxFrx0m8Q==',key_name='tempest-keypair-402233619',keypairs=<?>,launch_index=0,launched_at=2023-08-17T12:03:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f2a2f7faf23147fba5270c844eac051a',ramdisk_id='',reservation_id='r-arnh7g7d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1035899549',owner_user_name='tempest-AttachVolumeTestJSON-1035899549-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T12:11:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9b21e7e411a54be0890ae7b0ca85d80c',uuid=61201d5c-26f1-4c6d-a764-be2ee2e533ae,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f9f6066e-ddd2-4e41-b92a-5713cfb9a223", "address": "fa:16:3e:d2:c7:08", "network": {"id": "2ead35b7-4013-4fab-b35f-02f3237fcac1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1887618888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2a2f7faf23147fba5270c844eac051a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9f6066e-dd", "ovs_interfaceid": "f9f6066e-ddd2-4e41-b92a-5713cfb9a223", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 12:13:07 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-b2cb4fd5-0ff9-4d79-9c36-39531b9f7892 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Converting VIF {"id": "f9f6066e-ddd2-4e41-b92a-5713cfb9a223", "address": "fa:16:3e:d2:c7:08", "network": {"id": "2ead35b7-4013-4fab-b35f-02f3237fcac1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1887618888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2a2f7faf23147fba5270c844eac051a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9f6066e-dd", "ovs_interfaceid": "f9f6066e-ddd2-4e41-b92a-5713cfb9a223", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 12:13:07 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-b2cb4fd5-0ff9-4d79-9c36-39531b9f7892 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d2:c7:08,bridge_name='br-int',has_traffic_filtering=True,id=f9f6066e-ddd2-4e41-b92a-5713cfb9a223,network=Network(2ead35b7-4013-4fab-b35f-02f3237fcac1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9f6066e-dd') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 12:13:07 user nova-compute[73449]: DEBUG os_vif [None req-b2cb4fd5-0ff9-4d79-9c36-39531b9f7892 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d2:c7:08,bridge_name='br-int',has_traffic_filtering=True,id=f9f6066e-ddd2-4e41-b92a-5713cfb9a223,network=Network(2ead35b7-4013-4fab-b35f-02f3237fcac1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9f6066e-dd') {{(pid=73449) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 12:13:07 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:13:07 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf9f6066e-dd, bridge=br-int, if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 12:13:07 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:13:07 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:13:07 user nova-compute[73449]: INFO os_vif [None req-b2cb4fd5-0ff9-4d79-9c36-39531b9f7892 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d2:c7:08,bridge_name='br-int',has_traffic_filtering=True,id=f9f6066e-ddd2-4e41-b92a-5713cfb9a223,network=Network(2ead35b7-4013-4fab-b35f-02f3237fcac1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9f6066e-dd')
Aug 17 12:13:07 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-b2cb4fd5-0ff9-4d79-9c36-39531b9f7892 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Deleting instance files /opt/stack/data/nova/instances/61201d5c-26f1-4c6d-a764-be2ee2e533ae_del
Aug 17 12:13:07 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-b2cb4fd5-0ff9-4d79-9c36-39531b9f7892 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Deletion of /opt/stack/data/nova/instances/61201d5c-26f1-4c6d-a764-be2ee2e533ae_del complete
Aug 17 12:13:07 user nova-compute[73449]: INFO nova.compute.manager [None req-b2cb4fd5-0ff9-4d79-9c36-39531b9f7892 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Took 0.66 seconds to destroy the instance on the hypervisor.
Aug 17 12:13:07 user nova-compute[73449]: DEBUG oslo.service.loopingcall [None req-b2cb4fd5-0ff9-4d79-9c36-39531b9f7892 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73449) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 12:13:07 user nova-compute[73449]: DEBUG nova.compute.manager [-] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Deallocating network for instance {{(pid=73449) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 12:13:07 user nova-compute[73449]: DEBUG nova.network.neutron [-] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] deallocate_for_instance() {{(pid=73449) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 12:13:08 user nova-compute[73449]: DEBUG nova.network.neutron [-] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Updating instance_info_cache with network_info: [] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 12:13:08 user nova-compute[73449]: INFO nova.compute.manager [-] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Took 1.00 seconds to deallocate network for instance.
Aug 17 12:13:08 user nova-compute[73449]: DEBUG nova.compute.manager [req-0120315d-227c-42fb-8009-c121ccc43d14 req-5bd7ab7f-8e84-4f46-87bf-14e211c3d19b service nova] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Received event network-vif-deleted-f9f6066e-ddd2-4e41-b92a-5713cfb9a223 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:13:08 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b2cb4fd5-0ff9-4d79-9c36-39531b9f7892 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:13:08 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b2cb4fd5-0ff9-4d79-9c36-39531b9f7892 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:13:08 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-b2cb4fd5-0ff9-4d79-9c36-39531b9f7892 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 12:13:08 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-b2cb4fd5-0ff9-4d79-9c36-39531b9f7892 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 12:13:08 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b2cb4fd5-0ff9-4d79-9c36-39531b9f7892 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.145s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:13:08 user nova-compute[73449]: INFO nova.scheduler.client.report [None req-b2cb4fd5-0ff9-4d79-9c36-39531b9f7892 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Deleted allocations for instance 61201d5c-26f1-4c6d-a764-be2ee2e533ae
Aug 17 12:13:08 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:13:08 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:13:08 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b2cb4fd5-0ff9-4d79-9c36-39531b9f7892 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Lock "61201d5c-26f1-4c6d-a764-be2ee2e533ae" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.119s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:13:09 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b3211f3e-5af0-40d5-92d8-cdfd25b812ce tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Acquiring lock "731e74ce-bc73-49e6-b74b-4d652952b8cf" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:13:09 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b3211f3e-5af0-40d5-92d8-cdfd25b812ce tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Lock "731e74ce-bc73-49e6-b74b-4d652952b8cf" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:13:09 user nova-compute[73449]: DEBUG nova.objects.instance [None req-b3211f3e-5af0-40d5-92d8-cdfd25b812ce tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Lazy-loading 'flavor' on Instance uuid 731e74ce-bc73-49e6-b74b-4d652952b8cf {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:13:09 user nova-compute[73449]: DEBUG nova.compute.manager [req-d97a5f34-6ddb-4605-b606-852d38320ba9 req-a1b77fb5-a55d-4153-8b65-b02e9645ba9f service nova] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Received event network-vif-plugged-f9f6066e-ddd2-4e41-b92a-5713cfb9a223 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:13:09 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-d97a5f34-6ddb-4605-b606-852d38320ba9 req-a1b77fb5-a55d-4153-8b65-b02e9645ba9f service nova] Acquiring lock "61201d5c-26f1-4c6d-a764-be2ee2e533ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:13:09 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-d97a5f34-6ddb-4605-b606-852d38320ba9 req-a1b77fb5-a55d-4153-8b65-b02e9645ba9f service nova] Lock "61201d5c-26f1-4c6d-a764-be2ee2e533ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:13:09 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-d97a5f34-6ddb-4605-b606-852d38320ba9 req-a1b77fb5-a55d-4153-8b65-b02e9645ba9f service nova] Lock "61201d5c-26f1-4c6d-a764-be2ee2e533ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:13:09 user nova-compute[73449]: DEBUG nova.compute.manager [req-d97a5f34-6ddb-4605-b606-852d38320ba9 req-a1b77fb5-a55d-4153-8b65-b02e9645ba9f service nova] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] No waiting events found dispatching network-vif-plugged-f9f6066e-ddd2-4e41-b92a-5713cfb9a223 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 12:13:09 user nova-compute[73449]: WARNING nova.compute.manager [req-d97a5f34-6ddb-4605-b606-852d38320ba9 req-a1b77fb5-a55d-4153-8b65-b02e9645ba9f service nova] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Received unexpected event network-vif-plugged-f9f6066e-ddd2-4e41-b92a-5713cfb9a223 for instance with vm_state deleted and task_state None.
Aug 17 12:13:09 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b3211f3e-5af0-40d5-92d8-cdfd25b812ce tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Lock "731e74ce-bc73-49e6-b74b-4d652952b8cf" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:13:09 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b3211f3e-5af0-40d5-92d8-cdfd25b812ce tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Acquiring lock "731e74ce-bc73-49e6-b74b-4d652952b8cf" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:13:09 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b3211f3e-5af0-40d5-92d8-cdfd25b812ce tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Lock "731e74ce-bc73-49e6-b74b-4d652952b8cf" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:13:09 user nova-compute[73449]: INFO nova.compute.manager [None req-b3211f3e-5af0-40d5-92d8-cdfd25b812ce tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: 731e74ce-bc73-49e6-b74b-4d652952b8cf] Attaching volume 8c2b6734-801c-4a86-babb-79ccc3942dd9 to /dev/vdb
Aug 17 12:13:09 user nova-compute[73449]: DEBUG os_brick.utils [None req-b3211f3e-5af0-40d5-92d8-cdfd25b812ce tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 12:13:09 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:13:09 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:13:09 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[afc9d845-b207-4a9e-b900-31c43a80df7c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4d3924302012\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:13:09 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:13:09 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:13:09 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0d88e84-46b4-4a03-95eb-2dcae19dd92a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:13:09 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:13:09 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:13:09 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[33c42742-4814-4720-8fb5-357c6fc8481a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:13:09 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[26b4bc27-e032-44d7-b452-78b14ddabaa0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:13:09 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-b3211f3e-5af0-40d5-92d8-cdfd25b812ce tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Running cmd (subprocess): nvme version {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:13:09 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-b3211f3e-5af0-40d5-92d8-cdfd25b812ce tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] 'nvme version' failed. Not Retrying. {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 12:13:09 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b3211f3e-5af0-40d5-92d8-cdfd25b812ce tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] nvme not present on system {{(pid=73449) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 12:13:09 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:13:09 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 12:13:09 user nova-compute[73449]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 12:13:09 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[30e3784e-42a5-4663-8434-802a21c8f18f]: (4, '') {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:13:09 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-b3211f3e-5af0-40d5-92d8-cdfd25b812ce tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73449) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 12:13:09 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-b3211f3e-5af0-40d5-92d8-cdfd25b812ce tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73449) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 12:13:09 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-b3211f3e-5af0-40d5-92d8-cdfd25b812ce tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] LIGHTOS: no hostnqn found. {{(pid=73449) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 12:13:09 user nova-compute[73449]: DEBUG os_brick.utils [None req-b3211f3e-5af0-40d5-92d8-cdfd25b812ce tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4d3924302012', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 12:13:09 user nova-compute[73449]: DEBUG nova.virt.block_device [None req-b3211f3e-5af0-40d5-92d8-cdfd25b812ce tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: 731e74ce-bc73-49e6-b74b-4d652952b8cf] Updating existing volume attachment record: 52853cff-b518-44a0-95ed-0213567311af {{(pid=73449) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 12:13:12 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:13:12 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:13:13 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:13:15 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:13:15 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:13:15 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:13:15 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73449) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 12:13:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:13:17 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:13:18 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:13:20 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3211f3e-5af0-40d5-92d8-cdfd25b812ce tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: 731e74ce-bc73-49e6-b74b-4d652952b8cf] Calling os-brick to attach iSCSI Volume {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 12:13:20 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3211f3e-5af0-40d5-92d8-cdfd25b812ce tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8c2b6734-801c-4a86-babb-79ccc3942dd9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dKTVwlyB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 12:13:20 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-b3211f3e-5af0-40d5-92d8-cdfd25b812ce tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 12:13:20 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-b3211f3e-5af0-40d5-92d8-cdfd25b812ce tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 12:13:20 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-b3211f3e-5af0-40d5-92d8-cdfd25b812ce tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 12:13:20 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-b3211f3e-5af0-40d5-92d8-cdfd25b812ce tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 12:13:20 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-b3211f3e-5af0-40d5-92d8-cdfd25b812ce tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c2b6734-801c-4a86-babb-79ccc3942dd9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 12:13:20 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-b3211f3e-5af0-40d5-92d8-cdfd25b812ce tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c2b6734-801c-4a86-babb-79ccc3942dd9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 12:13:20 user nova-compute[73449]: INFO os_brick.initiator.connectors.iscsi [None req-b3211f3e-5af0-40d5-92d8-cdfd25b812ce tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 12:13:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c2b6734-801c-4a86-babb-79ccc3942dd9 -p 172.16.0.220:3260 {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:13:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c2b6734-801c-4a86-babb-79ccc3942dd9 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:13:20 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e0d5408-07b5-42f4-807a-d17fb8353b37]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:13:20 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3211f3e-5af0-40d5-92d8-cdfd25b812ce tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 12:13:20 user nova-compute[73449]:  {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:13:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c2b6734-801c-4a86-babb-79ccc3942dd9 -p 172.16.0.220:3260 --interface default --op new {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:13:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c2b6734-801c-4a86-babb-79ccc3942dd9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:13:20 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[207f182c-9f17-48cf-854e-992ae382fdf2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8c2b6734-801c-4a86-babb-79ccc3942dd9] added\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:13:20 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3211f3e-5af0-40d5-92d8-cdfd25b812ce tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8c2b6734-801c-4a86-babb-79ccc3942dd9] added
Aug 17 12:13:20 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:13:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c2b6734-801c-4a86-babb-79ccc3942dd9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:13:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c2b6734-801c-4a86-babb-79ccc3942dd9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:13:20 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[eca49ce6-b637-4334-95a7-94282da90aee]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:13:20 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3211f3e-5af0-40d5-92d8-cdfd25b812ce tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:13:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c2b6734-801c-4a86-babb-79ccc3942dd9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:13:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c2b6734-801c-4a86-babb-79ccc3942dd9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:13:20 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ea9064b-9a52-4957-8da4-3b668080782d]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:13:20 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3211f3e-5af0-40d5-92d8-cdfd25b812ce tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:13:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c2b6734-801c-4a86-babb-79ccc3942dd9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dKTVwlyB {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:13:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c2b6734-801c-4a86-babb-79ccc3942dd9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dKTVwlyB" returned: 0 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:13:20 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ce87603-442d-4a06-a9cf-afe5a0f526f0]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:13:20 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3211f3e-5af0-40d5-92d8-cdfd25b812ce tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dKTVwlyB'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:13:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c2b6734-801c-4a86-babb-79ccc3942dd9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:13:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c2b6734-801c-4a86-babb-79ccc3942dd9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:13:20 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[5260f652-32c4-4373-aa1a-a335df17d54b]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:13:20 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3211f3e-5af0-40d5-92d8-cdfd25b812ce tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:13:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:13:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:13:20 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9938cd6-9f58-42fb-a3cb-1b84a2263ceb]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:13:20 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3211f3e-5af0-40d5-92d8-cdfd25b812ce tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 17 12:13:20 user nova-compute[73449]:  {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 12:13:20 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3211f3e-5af0-40d5-92d8-cdfd25b812ce tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 17 12:13:20 user nova-compute[73449]:  {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 12:13:20 user nova-compute[73449]: WARNING os_brick.initiator.connectors.iscsi [None req-b3211f3e-5af0-40d5-92d8-cdfd25b812ce tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 17 12:13:20 user nova-compute[73449]: 
Aug 17 12:13:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c2b6734-801c-4a86-babb-79ccc3942dd9 -p 172.16.0.220:3260 --login {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:13:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c2b6734-801c-4a86-babb-79ccc3942dd9 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:13:20 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0ef3b2d-af80-48c5-bea2-d18b3658f59d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8c2b6734-801c-4a86-babb-79ccc3942dd9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8c2b6734-801c-4a86-babb-79ccc3942dd9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:13:20 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3211f3e-5af0-40d5-92d8-cdfd25b812ce tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8c2b6734-801c-4a86-babb-79ccc3942dd9, portal: 172.16.0.220,3260]
Aug 17 12:13:20 user nova-compute[73449]: Login to [iface: default, target: iqn.2010-10.org.openstack:8c2b6734-801c-4a86-babb-79ccc3942dd9, portal: 172.16.0.220,3260] successful.
Aug 17 12:13:20 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:13:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c2b6734-801c-4a86-babb-79ccc3942dd9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:13:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c2b6734-801c-4a86-babb-79ccc3942dd9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:13:20 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc0b7ca7-0a16-4345-a577-fe71d0ad6953]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:13:20 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3211f3e-5af0-40d5-92d8-cdfd25b812ce tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:13:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:13:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:13:20 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[b68d63ad-9b98-467d-b708-f5fb103deded]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c2b6734-801c-4a86-babb-79ccc3942dd9 (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:13:20 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3211f3e-5af0-40d5-92d8-cdfd25b812ce tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c2b6734-801c-4a86-babb-79ccc3942dd9 (non-flash)
Aug 17 12:13:20 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 12:13:20 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3211f3e-5af0-40d5-92d8-cdfd25b812ce tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c2b6734-801c-4a86-babb-79ccc3942dd9 (non-flash)
Aug 17 12:13:20 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 12:13:20 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-b3211f3e-5af0-40d5-92d8-cdfd25b812ce tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c2b6734-801c-4a86-babb-79ccc3942dd9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 12:13:20 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3211f3e-5af0-40d5-92d8-cdfd25b812ce tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Connected to 172.16.0.220:3260 {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 12:13:20 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-b3211f3e-5af0-40d5-92d8-cdfd25b812ce tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] HCTL ('33', '-', '-', 0) found on session 56 with lun 0 {{(pid=73449) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 12:13:20 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-b3211f3e-5af0-40d5-92d8-cdfd25b812ce tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73449) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 12:13:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:13:20 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:13:20 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6ced6df-c306-4d5c-bcc3-1333cb7b4562]: (4, ('- - 0', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:13:20 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-b3211f3e-5af0-40d5-92d8-cdfd25b812ce tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73449) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 12:13:20 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3211f3e-5af0-40d5-92d8-cdfd25b812ce tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dKTVwlyB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 12:13:21 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-b3211f3e-5af0-40d5-92d8-cdfd25b812ce tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.300s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 12:13:21 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3211f3e-5af0-40d5-92d8-cdfd25b812ce tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] <== connect_volume: return (1302ms) {'type': 'block', 'scsi_wwn': '23530333266653365', 'path': '/dev/sdb'} {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 12:13:21 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3211f3e-5af0-40d5-92d8-cdfd25b812ce tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: 731e74ce-bc73-49e6-b74b-4d652952b8cf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23530333266653365', 'path': '/dev/sdb'} {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 12:13:21 user nova-compute[73449]: DEBUG nova.objects.instance [None req-b3211f3e-5af0-40d5-92d8-cdfd25b812ce tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Lazy-loading 'flavor' on Instance uuid 731e74ce-bc73-49e6-b74b-4d652952b8cf {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:13:21 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-b3211f3e-5af0-40d5-92d8-cdfd25b812ce tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 12:13:21 user nova-compute[73449]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 12:13:21 user nova-compute[73449]:   <source dev="/dev/sdb"/>
Aug 17 12:13:21 user nova-compute[73449]:   <target dev="vdb" bus="virtio"/>
Aug 17 12:13:21 user nova-compute[73449]:   <serial>8c2b6734-801c-4a86-babb-79ccc3942dd9</serial>
Aug 17 12:13:21 user nova-compute[73449]: </disk>
Aug 17 12:13:21 user nova-compute[73449]:  {{(pid=73449) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 12:13:21 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b3211f3e-5af0-40d5-92d8-cdfd25b812ce tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] No BDM found with device name vda, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 12:13:21 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b3211f3e-5af0-40d5-92d8-cdfd25b812ce tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 12:13:21 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b3211f3e-5af0-40d5-92d8-cdfd25b812ce tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] No VIF found with MAC fa:16:3e:bd:10:2a, not building metadata {{(pid=73449) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 12:13:21 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:13:21 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-b3211f3e-5af0-40d5-92d8-cdfd25b812ce tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Lock "731e74ce-bc73-49e6-b74b-4d652952b8cf" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.343s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:13:21 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:13:21 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:13:21 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:13:21 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=73449) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 12:13:22 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/731e74ce-bc73-49e6-b74b-4d652952b8cf/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:13:22 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/731e74ce-bc73-49e6-b74b-4d652952b8cf/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:13:22 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/731e74ce-bc73-49e6-b74b-4d652952b8cf/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:13:22 user nova-compute[73449]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692274387.4372606, 61201d5c-26f1-4c6d-a764-be2ee2e533ae => Stopped> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 12:13:22 user nova-compute[73449]: INFO nova.compute.manager [-] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] VM Stopped (Lifecycle Event)
Aug 17 12:13:22 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/731e74ce-bc73-49e6-b74b-4d652952b8cf/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:13:22 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73449) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 12:13:22 user nova-compute[73449]: DEBUG nova.compute.manager [None req-3a044959-8c32-4b3f-b749-40c14fc2fb8c None None] [instance: 61201d5c-26f1-4c6d-a764-be2ee2e533ae] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 12:13:22 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:13:22 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 12:13:22 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 12:13:22 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Hypervisor/Node resource view: name=user free_ram=8656MB free_disk=25.070499420166016GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73449) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 12:13:22 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:13:22 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:13:22 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 731e74ce-bc73-49e6-b74b-4d652952b8cf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 12:13:22 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73449) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 12:13:22 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73449) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 12:13:22 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-18b5c351-924b-412f-bba3-8c34a142c369 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Acquiring lock "731e74ce-bc73-49e6-b74b-4d652952b8cf" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:13:22 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-18b5c351-924b-412f-bba3-8c34a142c369 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Lock "731e74ce-bc73-49e6-b74b-4d652952b8cf" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:13:22 user nova-compute[73449]: INFO nova.compute.manager [None req-18b5c351-924b-412f-bba3-8c34a142c369 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: 731e74ce-bc73-49e6-b74b-4d652952b8cf] Detaching volume 8c2b6734-801c-4a86-babb-79ccc3942dd9
Aug 17 12:13:23 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 12:13:23 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 12:13:23 user nova-compute[73449]: INFO nova.virt.block_device [None req-18b5c351-924b-412f-bba3-8c34a142c369 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: 731e74ce-bc73-49e6-b74b-4d652952b8cf] Attempting to driver detach volume 8c2b6734-801c-4a86-babb-79ccc3942dd9 from mountpoint /dev/vdb
Aug 17 12:13:23 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Compute_service record updated for user:user {{(pid=73449) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 12:13:23 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.229s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:13:23 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-18b5c351-924b-412f-bba3-8c34a142c369 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Attempting to detach device vdb from instance 731e74ce-bc73-49e6-b74b-4d652952b8cf from the persistent domain config. {{(pid=73449) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 12:13:23 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-18b5c351-924b-412f-bba3-8c34a142c369 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 12:13:23 user nova-compute[73449]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 12:13:23 user nova-compute[73449]:   <source dev="/dev/sdb"/>
Aug 17 12:13:23 user nova-compute[73449]:   <target dev="vdb" bus="virtio"/>
Aug 17 12:13:23 user nova-compute[73449]:   <serial>8c2b6734-801c-4a86-babb-79ccc3942dd9</serial>
Aug 17 12:13:23 user nova-compute[73449]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 12:13:23 user nova-compute[73449]: </disk>
Aug 17 12:13:23 user nova-compute[73449]:  {{(pid=73449) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 12:13:23 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-18b5c351-924b-412f-bba3-8c34a142c369 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Successfully detached device vdb from instance 731e74ce-bc73-49e6-b74b-4d652952b8cf from the persistent domain config.
Aug 17 12:13:23 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-18b5c351-924b-412f-bba3-8c34a142c369 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 731e74ce-bc73-49e6-b74b-4d652952b8cf from the live domain config. {{(pid=73449) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 12:13:23 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-18b5c351-924b-412f-bba3-8c34a142c369 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 12:13:23 user nova-compute[73449]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 12:13:23 user nova-compute[73449]:   <source dev="/dev/sdb"/>
Aug 17 12:13:23 user nova-compute[73449]:   <target dev="vdb" bus="virtio"/>
Aug 17 12:13:23 user nova-compute[73449]:   <serial>8c2b6734-801c-4a86-babb-79ccc3942dd9</serial>
Aug 17 12:13:23 user nova-compute[73449]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 12:13:23 user nova-compute[73449]: </disk>
Aug 17 12:13:23 user nova-compute[73449]:  {{(pid=73449) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 12:13:23 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Received event <DeviceRemovedEvent: 1692274403.528794, 731e74ce-bc73-49e6-b74b-4d652952b8cf => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73449) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 12:13:23 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-18b5c351-924b-412f-bba3-8c34a142c369 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 731e74ce-bc73-49e6-b74b-4d652952b8cf {{(pid=73449) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 12:13:23 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-18b5c351-924b-412f-bba3-8c34a142c369 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Successfully detached device vdb from instance 731e74ce-bc73-49e6-b74b-4d652952b8cf from the live domain config.
Aug 17 12:13:23 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18b5c351-924b-412f-bba3-8c34a142c369 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: 731e74ce-bc73-49e6-b74b-4d652952b8cf] calling os-brick to detach iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 12:13:23 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-18b5c351-924b-412f-bba3-8c34a142c369 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, {'target_iqns': ['iqn.2010-10.org.openstack:8c2b6734-801c-4a86-babb-79ccc3942dd9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dKTVwlyB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 12:13:23 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-18b5c351-924b-412f-bba3-8c34a142c369 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 12:13:23 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-18b5c351-924b-412f-bba3-8c34a142c369 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 12:13:23 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-18b5c351-924b-412f-bba3-8c34a142c369 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 12:13:23 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-18b5c351-924b-412f-bba3-8c34a142c369 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c2b6734-801c-4a86-babb-79ccc3942dd9', 0)] {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 12:13:23 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:13:23 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:13:23 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb1af23c-f4bb-4a56-8be4-008062080916]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c2b6734-801c-4a86-babb-79ccc3942dd9\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:13:23 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:13:23 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:13:23 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b7d35fa-0803-48d4-ab27-1381fb6d6c9c]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c2b6734-801c-4a86-babb-79ccc3942dd9 (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:13:23 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-18b5c351-924b-412f-bba3-8c34a142c369 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c2b6734-801c-4a86-babb-79ccc3942dd9 (non-flash)
Aug 17 12:13:23 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 12:13:23 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-18b5c351-924b-412f-bba3-8c34a142c369 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c2b6734-801c-4a86-babb-79ccc3942dd9 (non-flash)
Aug 17 12:13:23 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 12:13:23 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-18b5c351-924b-412f-bba3-8c34a142c369 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe758128dc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c2b6734-801c-4a86-babb-79ccc3942dd9'): ({'sdb'}, set())}) {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 12:13:23 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-18b5c351-924b-412f-bba3-8c34a142c369 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Removing single pathed devices sdb {{(pid=73449) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 12:13:23 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:13:23 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:13:23 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[4626da76-e960-45f0-b335-17393ffdc978]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:13:23 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:13:23 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:13:23 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[827e41fd-2a58-4664-9030-b4da04b9484f]: (4, ('ok\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:13:23 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-18b5c351-924b-412f-bba3-8c34a142c369 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Flushing IO for device /dev/sdb {{(pid=73449) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 12:13:23 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:13:23 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:13:23 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[d08d7c92-8e60-4d25-aaad-87c1ac579388]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:13:23 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-18b5c351-924b-412f-bba3-8c34a142c369 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73449) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 12:13:23 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:13:23 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:13:23 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[f372bb31-78fd-4b31-aa43-bf1dab583737]: (4, ('1', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:13:23 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-18b5c351-924b-412f-bba3-8c34a142c369 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73449) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 12:13:23 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-18b5c351-924b-412f-bba3-8c34a142c369 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] SCSI volumes sdb have been removed. {{(pid=73449) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 12:13:23 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-18b5c351-924b-412f-bba3-8c34a142c369 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c2b6734-801c-4a86-babb-79ccc3942dd9')] {{(pid=73449) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 12:13:23 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c2b6734-801c-4a86-babb-79ccc3942dd9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:13:23 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c2b6734-801c-4a86-babb-79ccc3942dd9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:13:23 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[96676052-d4f7-4cf3-94d5-b1d08918ce23]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:13:23 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-18b5c351-924b-412f-bba3-8c34a142c369 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:13:23 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c2b6734-801c-4a86-babb-79ccc3942dd9 -p 172.16.0.220:3260 --logout {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:13:23 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c2b6734-801c-4a86-babb-79ccc3942dd9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:13:23 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec8ca85c-4fe5-4fa4-a8f5-dbd00895ce0a]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:8c2b6734-801c-4a86-babb-79ccc3942dd9, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:8c2b6734-801c-4a86-babb-79ccc3942dd9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:13:23 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-18b5c351-924b-412f-bba3-8c34a142c369 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:8c2b6734-801c-4a86-babb-79ccc3942dd9, portal: 172.16.0.220,3260]
Aug 17 12:13:23 user nova-compute[73449]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:8c2b6734-801c-4a86-babb-79ccc3942dd9, portal: 172.16.0.220,3260] successful.
Aug 17 12:13:23 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:13:23 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c2b6734-801c-4a86-babb-79ccc3942dd9 -p 172.16.0.220:3260 --op delete {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:13:23 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c2b6734-801c-4a86-babb-79ccc3942dd9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:13:23 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[f02b1081-7fae-42d8-b159-a21eb25edb13]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:13:23 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-18b5c351-924b-412f-bba3-8c34a142c369 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:13:23 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-18b5c351-924b-412f-bba3-8c34a142c369 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.255s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 12:13:23 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-18b5c351-924b-412f-bba3-8c34a142c369 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] <== disconnect_volume: return (256ms) None {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 12:13:23 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18b5c351-924b-412f-bba3-8c34a142c369 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: 731e74ce-bc73-49e6-b74b-4d652952b8cf] Disconnected iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 12:13:24 user nova-compute[73449]: DEBUG nova.objects.instance [None req-18b5c351-924b-412f-bba3-8c34a142c369 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Lazy-loading 'flavor' on Instance uuid 731e74ce-bc73-49e6-b74b-4d652952b8cf {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:13:24 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-18b5c351-924b-412f-bba3-8c34a142c369 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Lock "731e74ce-bc73-49e6-b74b-4d652952b8cf" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.617s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:13:27 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:13:27 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Starting heal instance info cache {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 12:13:27 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "refresh_cache-731e74ce-bc73-49e6-b74b-4d652952b8cf" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 12:13:27 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquired lock "refresh_cache-731e74ce-bc73-49e6-b74b-4d652952b8cf" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 12:13:27 user nova-compute[73449]: DEBUG nova.network.neutron [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: 731e74ce-bc73-49e6-b74b-4d652952b8cf] Forcefully refreshing network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 12:13:27 user nova-compute[73449]: DEBUG nova.network.neutron [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: 731e74ce-bc73-49e6-b74b-4d652952b8cf] Updating instance_info_cache with network_info: [{"id": "d5640497-17d4-4d8f-b99f-797a8e2b4221", "address": "fa:16:3e:bd:10:2a", "network": {"id": "71648e1b-cf19-44b7-bae2-9d38543cdee9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-822323626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75aa99e369c54b65aff27adbb1daf2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5640497-17", "ovs_interfaceid": "d5640497-17d4-4d8f-b99f-797a8e2b4221", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 12:13:27 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Releasing lock "refresh_cache-731e74ce-bc73-49e6-b74b-4d652952b8cf" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 12:13:27 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: 731e74ce-bc73-49e6-b74b-4d652952b8cf] Updated the network info_cache for instance {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 12:13:27 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:13:27 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:13:32 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:13:37 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:13:38 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:13:42 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:13:47 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:13:52 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:13:55 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:13:57 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:14:00 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:14:01 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-1bffdd42-049b-414b-87a8-3c745707dedc tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Acquiring lock "6d482e2e-e73c-4c13-aead-dacefa7be735" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:14:01 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-1bffdd42-049b-414b-87a8-3c745707dedc tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Lock "6d482e2e-e73c-4c13-aead-dacefa7be735" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:14:01 user nova-compute[73449]: DEBUG nova.compute.manager [None req-1bffdd42-049b-414b-87a8-3c745707dedc tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] [instance: 6d482e2e-e73c-4c13-aead-dacefa7be735] Starting instance... {{(pid=73449) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 12:14:01 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-1bffdd42-049b-414b-87a8-3c745707dedc tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:14:01 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-1bffdd42-049b-414b-87a8-3c745707dedc tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:14:01 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-1bffdd42-049b-414b-87a8-3c745707dedc tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73449) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 12:14:01 user nova-compute[73449]: INFO nova.compute.claims [None req-1bffdd42-049b-414b-87a8-3c745707dedc tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] [instance: 6d482e2e-e73c-4c13-aead-dacefa7be735] Claim successful on node user
Aug 17 12:14:01 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-1bffdd42-049b-414b-87a8-3c745707dedc tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 12:14:01 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-1bffdd42-049b-414b-87a8-3c745707dedc tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 12:14:01 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-1bffdd42-049b-414b-87a8-3c745707dedc tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.259s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:14:01 user nova-compute[73449]: DEBUG nova.compute.manager [None req-1bffdd42-049b-414b-87a8-3c745707dedc tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] [instance: 6d482e2e-e73c-4c13-aead-dacefa7be735] Start building networks asynchronously for instance. {{(pid=73449) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 12:14:01 user nova-compute[73449]: DEBUG nova.compute.manager [None req-1bffdd42-049b-414b-87a8-3c745707dedc tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] [instance: 6d482e2e-e73c-4c13-aead-dacefa7be735] Allocating IP information in the background. {{(pid=73449) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 12:14:01 user nova-compute[73449]: DEBUG nova.network.neutron [None req-1bffdd42-049b-414b-87a8-3c745707dedc tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] [instance: 6d482e2e-e73c-4c13-aead-dacefa7be735] allocate_for_instance() {{(pid=73449) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 12:14:01 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-1bffdd42-049b-414b-87a8-3c745707dedc tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] [instance: 6d482e2e-e73c-4c13-aead-dacefa7be735] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 12:14:01 user nova-compute[73449]: DEBUG nova.compute.manager [None req-1bffdd42-049b-414b-87a8-3c745707dedc tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] [instance: 6d482e2e-e73c-4c13-aead-dacefa7be735] Start building block device mappings for instance. {{(pid=73449) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 12:14:01 user nova-compute[73449]: DEBUG nova.policy [None req-1bffdd42-049b-414b-87a8-3c745707dedc tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9b21e7e411a54be0890ae7b0ca85d80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a2f7faf23147fba5270c844eac051a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73449) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 12:14:01 user nova-compute[73449]: DEBUG nova.compute.manager [None req-1bffdd42-049b-414b-87a8-3c745707dedc tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] [instance: 6d482e2e-e73c-4c13-aead-dacefa7be735] Start spawning the instance on the hypervisor. {{(pid=73449) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 12:14:01 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-1bffdd42-049b-414b-87a8-3c745707dedc tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] [instance: 6d482e2e-e73c-4c13-aead-dacefa7be735] Creating instance directory {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 12:14:01 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-1bffdd42-049b-414b-87a8-3c745707dedc tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] [instance: 6d482e2e-e73c-4c13-aead-dacefa7be735] Creating image(s)
Aug 17 12:14:01 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-1bffdd42-049b-414b-87a8-3c745707dedc tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Acquiring lock "/opt/stack/data/nova/instances/6d482e2e-e73c-4c13-aead-dacefa7be735/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:14:01 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-1bffdd42-049b-414b-87a8-3c745707dedc tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Lock "/opt/stack/data/nova/instances/6d482e2e-e73c-4c13-aead-dacefa7be735/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:14:01 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-1bffdd42-049b-414b-87a8-3c745707dedc tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Lock "/opt/stack/data/nova/instances/6d482e2e-e73c-4c13-aead-dacefa7be735/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:14:01 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-1bffdd42-049b-414b-87a8-3c745707dedc tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:14:02 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-1bffdd42-049b-414b-87a8-3c745707dedc tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json" returned: 0 in 0.185s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:14:02 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-1bffdd42-049b-414b-87a8-3c745707dedc tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Acquiring lock "7e267a577c062ee862e95ede6b48cfd5632f3ea3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:14:02 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-1bffdd42-049b-414b-87a8-3c745707dedc tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Lock "7e267a577c062ee862e95ede6b48cfd5632f3ea3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:14:02 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-1bffdd42-049b-414b-87a8-3c745707dedc tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:14:02 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-1bffdd42-049b-414b-87a8-3c745707dedc tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json" returned: 0 in 0.187s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:14:02 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-1bffdd42-049b-414b-87a8-3c745707dedc tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3,backing_fmt=raw /opt/stack/data/nova/instances/6d482e2e-e73c-4c13-aead-dacefa7be735/disk 1073741824 {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:14:02 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-1bffdd42-049b-414b-87a8-3c745707dedc tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3,backing_fmt=raw /opt/stack/data/nova/instances/6d482e2e-e73c-4c13-aead-dacefa7be735/disk 1073741824" returned: 0 in 0.051s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:14:02 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-1bffdd42-049b-414b-87a8-3c745707dedc tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Lock "7e267a577c062ee862e95ede6b48cfd5632f3ea3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:14:02 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-1bffdd42-049b-414b-87a8-3c745707dedc tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:14:02 user nova-compute[73449]: DEBUG nova.network.neutron [None req-1bffdd42-049b-414b-87a8-3c745707dedc tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] [instance: 6d482e2e-e73c-4c13-aead-dacefa7be735] Successfully created port: 15176341-7f06-4c3a-9501-b2c7518f7119 {{(pid=73449) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 12:14:02 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-1bffdd42-049b-414b-87a8-3c745707dedc tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json" returned: 0 in 0.206s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:14:02 user nova-compute[73449]: DEBUG nova.virt.disk.api [None req-1bffdd42-049b-414b-87a8-3c745707dedc tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6d482e2e-e73c-4c13-aead-dacefa7be735/disk. size=1073741824 {{(pid=73449) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 12:14:02 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-1bffdd42-049b-414b-87a8-3c745707dedc tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d482e2e-e73c-4c13-aead-dacefa7be735/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:14:02 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-1bffdd42-049b-414b-87a8-3c745707dedc tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d482e2e-e73c-4c13-aead-dacefa7be735/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:14:02 user nova-compute[73449]: DEBUG nova.virt.disk.api [None req-1bffdd42-049b-414b-87a8-3c745707dedc tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Cannot resize image /opt/stack/data/nova/instances/6d482e2e-e73c-4c13-aead-dacefa7be735/disk to a smaller size. {{(pid=73449) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 12:14:02 user nova-compute[73449]: DEBUG nova.objects.instance [None req-1bffdd42-049b-414b-87a8-3c745707dedc tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Lazy-loading 'migration_context' on Instance uuid 6d482e2e-e73c-4c13-aead-dacefa7be735 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:14:02 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-1bffdd42-049b-414b-87a8-3c745707dedc tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] [instance: 6d482e2e-e73c-4c13-aead-dacefa7be735] Created local disks {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 12:14:02 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-1bffdd42-049b-414b-87a8-3c745707dedc tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] [instance: 6d482e2e-e73c-4c13-aead-dacefa7be735] Ensure instance console log exists: /opt/stack/data/nova/instances/6d482e2e-e73c-4c13-aead-dacefa7be735/console.log {{(pid=73449) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 12:14:02 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-1bffdd42-049b-414b-87a8-3c745707dedc tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:14:02 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-1bffdd42-049b-414b-87a8-3c745707dedc tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:14:02 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-1bffdd42-049b-414b-87a8-3c745707dedc tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:14:02 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:14:03 user nova-compute[73449]: DEBUG nova.network.neutron [None req-1bffdd42-049b-414b-87a8-3c745707dedc tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] [instance: 6d482e2e-e73c-4c13-aead-dacefa7be735] Successfully updated port: 15176341-7f06-4c3a-9501-b2c7518f7119 {{(pid=73449) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 12:14:03 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-1bffdd42-049b-414b-87a8-3c745707dedc tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Acquiring lock "refresh_cache-6d482e2e-e73c-4c13-aead-dacefa7be735" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 12:14:03 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-1bffdd42-049b-414b-87a8-3c745707dedc tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Acquired lock "refresh_cache-6d482e2e-e73c-4c13-aead-dacefa7be735" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 12:14:03 user nova-compute[73449]: DEBUG nova.network.neutron [None req-1bffdd42-049b-414b-87a8-3c745707dedc tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] [instance: 6d482e2e-e73c-4c13-aead-dacefa7be735] Building network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 12:14:03 user nova-compute[73449]: DEBUG nova.compute.manager [req-f2602da1-d05c-4c49-ba02-adcc1be85364 req-bdf3f941-9fdb-42d0-8f79-c8144d2e50fd service nova] [instance: 6d482e2e-e73c-4c13-aead-dacefa7be735] Received event network-changed-15176341-7f06-4c3a-9501-b2c7518f7119 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:14:03 user nova-compute[73449]: DEBUG nova.compute.manager [req-f2602da1-d05c-4c49-ba02-adcc1be85364 req-bdf3f941-9fdb-42d0-8f79-c8144d2e50fd service nova] [instance: 6d482e2e-e73c-4c13-aead-dacefa7be735] Refreshing instance network info cache due to event network-changed-15176341-7f06-4c3a-9501-b2c7518f7119. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 12:14:03 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-f2602da1-d05c-4c49-ba02-adcc1be85364 req-bdf3f941-9fdb-42d0-8f79-c8144d2e50fd service nova] Acquiring lock "refresh_cache-6d482e2e-e73c-4c13-aead-dacefa7be735" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 12:14:03 user nova-compute[73449]: DEBUG nova.network.neutron [None req-1bffdd42-049b-414b-87a8-3c745707dedc tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] [instance: 6d482e2e-e73c-4c13-aead-dacefa7be735] Instance cache missing network info. {{(pid=73449) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 12:14:03 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:14:03 user nova-compute[73449]: DEBUG nova.network.neutron [None req-1bffdd42-049b-414b-87a8-3c745707dedc tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] [instance: 6d482e2e-e73c-4c13-aead-dacefa7be735] Updating instance_info_cache with network_info: [{"id": "15176341-7f06-4c3a-9501-b2c7518f7119", "address": "fa:16:3e:e1:e1:cd", "network": {"id": "2ead35b7-4013-4fab-b35f-02f3237fcac1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1887618888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2a2f7faf23147fba5270c844eac051a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15176341-7f", "ovs_interfaceid": "15176341-7f06-4c3a-9501-b2c7518f7119", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 12:14:03 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-1bffdd42-049b-414b-87a8-3c745707dedc tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Releasing lock "refresh_cache-6d482e2e-e73c-4c13-aead-dacefa7be735" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 12:14:03 user nova-compute[73449]: DEBUG nova.compute.manager [None req-1bffdd42-049b-414b-87a8-3c745707dedc tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] [instance: 6d482e2e-e73c-4c13-aead-dacefa7be735] Instance network_info: |[{"id": "15176341-7f06-4c3a-9501-b2c7518f7119", "address": "fa:16:3e:e1:e1:cd", "network": {"id": "2ead35b7-4013-4fab-b35f-02f3237fcac1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1887618888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2a2f7faf23147fba5270c844eac051a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15176341-7f", "ovs_interfaceid": "15176341-7f06-4c3a-9501-b2c7518f7119", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73449) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 12:14:03 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-f2602da1-d05c-4c49-ba02-adcc1be85364 req-bdf3f941-9fdb-42d0-8f79-c8144d2e50fd service nova] Acquired lock "refresh_cache-6d482e2e-e73c-4c13-aead-dacefa7be735" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 12:14:03 user nova-compute[73449]: DEBUG nova.network.neutron [req-f2602da1-d05c-4c49-ba02-adcc1be85364 req-bdf3f941-9fdb-42d0-8f79-c8144d2e50fd service nova] [instance: 6d482e2e-e73c-4c13-aead-dacefa7be735] Refreshing network info cache for port 15176341-7f06-4c3a-9501-b2c7518f7119 {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 12:14:03 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-1bffdd42-049b-414b-87a8-3c745707dedc tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] [instance: 6d482e2e-e73c-4c13-aead-dacefa7be735] Start _get_guest_xml network_info=[{"id": "15176341-7f06-4c3a-9501-b2c7518f7119", "address": "fa:16:3e:e1:e1:cd", "network": {"id": "2ead35b7-4013-4fab-b35f-02f3237fcac1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1887618888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2a2f7faf23147fba5270c844eac051a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15176341-7f", "ovs_interfaceid": "15176341-7f06-4c3a-9501-b2c7518f7119", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T11:36:11Z,direct_url=<?>,disk_format='qcow2',id=0a2904ae-083d-41c8-83db-343132b36148,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7a77880136a54ef195c82e018e1939db',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T11:36:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': '0a2904ae-083d-41c8-83db-343132b36148'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 12:14:03 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-1bffdd42-049b-414b-87a8-3c745707dedc tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 12:14:03 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-1bffdd42-049b-414b-87a8-3c745707dedc tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 12:14:03 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-1bffdd42-049b-414b-87a8-3c745707dedc tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 12:14:03 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-1bffdd42-049b-414b-87a8-3c745707dedc tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] CPU controller missing on host. {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 12:14:03 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-1bffdd42-049b-414b-87a8-3c745707dedc tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 12:14:03 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-1bffdd42-049b-414b-87a8-3c745707dedc tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] CPU controller found on host. {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 12:14:03 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-1bffdd42-049b-414b-87a8-3c745707dedc tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73449) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 12:14:03 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-1bffdd42-049b-414b-87a8-3c745707dedc tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T11:35:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T11:36:11Z,direct_url=<?>,disk_format='qcow2',id=0a2904ae-083d-41c8-83db-343132b36148,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7a77880136a54ef195c82e018e1939db',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T11:36:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 12:14:03 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-1bffdd42-049b-414b-87a8-3c745707dedc tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Flavor limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 12:14:03 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-1bffdd42-049b-414b-87a8-3c745707dedc tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Image limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 12:14:03 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-1bffdd42-049b-414b-87a8-3c745707dedc tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Flavor pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 12:14:03 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-1bffdd42-049b-414b-87a8-3c745707dedc tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Image pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 12:14:03 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-1bffdd42-049b-414b-87a8-3c745707dedc tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 12:14:03 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-1bffdd42-049b-414b-87a8-3c745707dedc tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 12:14:03 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-1bffdd42-049b-414b-87a8-3c745707dedc tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 12:14:03 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-1bffdd42-049b-414b-87a8-3c745707dedc tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Got 1 possible topologies {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 12:14:03 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-1bffdd42-049b-414b-87a8-3c745707dedc tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 12:14:03 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-1bffdd42-049b-414b-87a8-3c745707dedc tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 12:14:03 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-1bffdd42-049b-414b-87a8-3c745707dedc tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T12:14:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-86467027',display_name='tempest-AttachVolumeTestJSON-server-86467027',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-86467027',id=51,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD6bs79O4lp/VvLMrCaTVP7F7/4BJnr7AD9elyqqO0Iv9zuyHSfFM6JuUqPVqyM283blqlePiY3Tj4gbqqYMYjtnMaqIrVD3wQxaSUatFm0ZFFPWih48n64P8MCTzEVZTQ==',key_name='tempest-keypair-220674408',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f2a2f7faf23147fba5270c844eac051a',ramdisk_id='',reservation_id='r-0qh71q0x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1035899549',owner_user_name='tempest-AttachVolumeTestJSON-1035899549-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T12:14:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9b21e7e411a54be0890ae7b0ca85d80c',uuid=6d482e2e-e73c-4c13-aead-dacefa7be735,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "15176341-7f06-4c3a-9501-b2c7518f7119", "address": "fa:16:3e:e1:e1:cd", "network": {"id": "2ead35b7-4013-4fab-b35f-02f3237fcac1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1887618888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2a2f7faf23147fba5270c844eac051a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15176341-7f", "ovs_interfaceid": "15176341-7f06-4c3a-9501-b2c7518f7119", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73449) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 12:14:03 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-1bffdd42-049b-414b-87a8-3c745707dedc tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Converting VIF {"id": "15176341-7f06-4c3a-9501-b2c7518f7119", "address": "fa:16:3e:e1:e1:cd", "network": {"id": "2ead35b7-4013-4fab-b35f-02f3237fcac1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1887618888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2a2f7faf23147fba5270c844eac051a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15176341-7f", "ovs_interfaceid": "15176341-7f06-4c3a-9501-b2c7518f7119", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 12:14:03 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-1bffdd42-049b-414b-87a8-3c745707dedc tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:e1:cd,bridge_name='br-int',has_traffic_filtering=True,id=15176341-7f06-4c3a-9501-b2c7518f7119,network=Network(2ead35b7-4013-4fab-b35f-02f3237fcac1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15176341-7f') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 12:14:03 user nova-compute[73449]: DEBUG nova.objects.instance [None req-1bffdd42-049b-414b-87a8-3c745707dedc tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Lazy-loading 'pci_devices' on Instance uuid 6d482e2e-e73c-4c13-aead-dacefa7be735 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:14:03 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-1bffdd42-049b-414b-87a8-3c745707dedc tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] [instance: 6d482e2e-e73c-4c13-aead-dacefa7be735] End _get_guest_xml xml=<domain type="kvm">
Aug 17 12:14:03 user nova-compute[73449]:   <uuid>6d482e2e-e73c-4c13-aead-dacefa7be735</uuid>
Aug 17 12:14:03 user nova-compute[73449]:   <name>instance-00000033</name>
Aug 17 12:14:03 user nova-compute[73449]:   <memory>524288</memory>
Aug 17 12:14:03 user nova-compute[73449]:   <vcpu>1</vcpu>
Aug 17 12:14:03 user nova-compute[73449]:   <metadata>
Aug 17 12:14:03 user nova-compute[73449]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 12:14:03 user nova-compute[73449]:       <nova:package version="0.0.0"/>
Aug 17 12:14:03 user nova-compute[73449]:       <nova:name>tempest-AttachVolumeTestJSON-server-86467027</nova:name>
Aug 17 12:14:03 user nova-compute[73449]:       <nova:creationTime>2023-08-17 12:14:03</nova:creationTime>
Aug 17 12:14:03 user nova-compute[73449]:       <nova:flavor name="m1.tiny">
Aug 17 12:14:03 user nova-compute[73449]:         <nova:memory>512</nova:memory>
Aug 17 12:14:03 user nova-compute[73449]:         <nova:disk>1</nova:disk>
Aug 17 12:14:03 user nova-compute[73449]:         <nova:swap>0</nova:swap>
Aug 17 12:14:03 user nova-compute[73449]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 12:14:03 user nova-compute[73449]:         <nova:vcpus>1</nova:vcpus>
Aug 17 12:14:03 user nova-compute[73449]:       </nova:flavor>
Aug 17 12:14:03 user nova-compute[73449]:       <nova:owner>
Aug 17 12:14:03 user nova-compute[73449]:         <nova:user uuid="9b21e7e411a54be0890ae7b0ca85d80c">tempest-AttachVolumeTestJSON-1035899549-project-member</nova:user>
Aug 17 12:14:03 user nova-compute[73449]:         <nova:project uuid="f2a2f7faf23147fba5270c844eac051a">tempest-AttachVolumeTestJSON-1035899549</nova:project>
Aug 17 12:14:03 user nova-compute[73449]:       </nova:owner>
Aug 17 12:14:03 user nova-compute[73449]:       <nova:root type="image" uuid="0a2904ae-083d-41c8-83db-343132b36148"/>
Aug 17 12:14:03 user nova-compute[73449]:       <nova:ports>
Aug 17 12:14:03 user nova-compute[73449]:         <nova:port uuid="15176341-7f06-4c3a-9501-b2c7518f7119">
Aug 17 12:14:03 user nova-compute[73449]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 17 12:14:03 user nova-compute[73449]:         </nova:port>
Aug 17 12:14:03 user nova-compute[73449]:       </nova:ports>
Aug 17 12:14:03 user nova-compute[73449]:     </nova:instance>
Aug 17 12:14:03 user nova-compute[73449]:   </metadata>
Aug 17 12:14:03 user nova-compute[73449]:   <sysinfo type="smbios">
Aug 17 12:14:03 user nova-compute[73449]:     <system>
Aug 17 12:14:03 user nova-compute[73449]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 12:14:03 user nova-compute[73449]:       <entry name="product">OpenStack Nova</entry>
Aug 17 12:14:03 user nova-compute[73449]:       <entry name="version">0.0.0</entry>
Aug 17 12:14:03 user nova-compute[73449]:       <entry name="serial">6d482e2e-e73c-4c13-aead-dacefa7be735</entry>
Aug 17 12:14:03 user nova-compute[73449]:       <entry name="uuid">6d482e2e-e73c-4c13-aead-dacefa7be735</entry>
Aug 17 12:14:03 user nova-compute[73449]:       <entry name="family">Virtual Machine</entry>
Aug 17 12:14:03 user nova-compute[73449]:     </system>
Aug 17 12:14:03 user nova-compute[73449]:   </sysinfo>
Aug 17 12:14:03 user nova-compute[73449]:   <os>
Aug 17 12:14:03 user nova-compute[73449]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 12:14:03 user nova-compute[73449]:     <boot dev="hd"/>
Aug 17 12:14:03 user nova-compute[73449]:     <smbios mode="sysinfo"/>
Aug 17 12:14:03 user nova-compute[73449]:   </os>
Aug 17 12:14:03 user nova-compute[73449]:   <features>
Aug 17 12:14:03 user nova-compute[73449]:     <acpi/>
Aug 17 12:14:03 user nova-compute[73449]:     <apic/>
Aug 17 12:14:03 user nova-compute[73449]:     <vmcoreinfo/>
Aug 17 12:14:03 user nova-compute[73449]:   </features>
Aug 17 12:14:03 user nova-compute[73449]:   <clock offset="utc">
Aug 17 12:14:03 user nova-compute[73449]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 12:14:03 user nova-compute[73449]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 12:14:03 user nova-compute[73449]:     <timer name="hpet" present="no"/>
Aug 17 12:14:03 user nova-compute[73449]:   </clock>
Aug 17 12:14:03 user nova-compute[73449]:   <cpu mode="custom" match="exact">
Aug 17 12:14:03 user nova-compute[73449]:     <model>Nehalem</model>
Aug 17 12:14:03 user nova-compute[73449]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 12:14:03 user nova-compute[73449]:   </cpu>
Aug 17 12:14:03 user nova-compute[73449]:   <devices>
Aug 17 12:14:03 user nova-compute[73449]:     <disk type="file" device="disk">
Aug 17 12:14:03 user nova-compute[73449]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 12:14:03 user nova-compute[73449]:       <source file="/opt/stack/data/nova/instances/6d482e2e-e73c-4c13-aead-dacefa7be735/disk"/>
Aug 17 12:14:03 user nova-compute[73449]:       <target dev="vda" bus="virtio"/>
Aug 17 12:14:03 user nova-compute[73449]:     </disk>
Aug 17 12:14:03 user nova-compute[73449]:     <interface type="ethernet">
Aug 17 12:14:03 user nova-compute[73449]:       <mac address="fa:16:3e:e1:e1:cd"/>
Aug 17 12:14:03 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 12:14:03 user nova-compute[73449]:       <mtu size="1442"/>
Aug 17 12:14:03 user nova-compute[73449]:       <target dev="tap15176341-7f"/>
Aug 17 12:14:03 user nova-compute[73449]:     </interface>
Aug 17 12:14:03 user nova-compute[73449]:     <serial type="pty">
Aug 17 12:14:03 user nova-compute[73449]:       <log file="/opt/stack/data/nova/instances/6d482e2e-e73c-4c13-aead-dacefa7be735/console.log" append="off"/>
Aug 17 12:14:03 user nova-compute[73449]:     </serial>
Aug 17 12:14:03 user nova-compute[73449]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 12:14:03 user nova-compute[73449]:     <video>
Aug 17 12:14:03 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 12:14:03 user nova-compute[73449]:     </video>
Aug 17 12:14:03 user nova-compute[73449]:     <rng model="virtio">
Aug 17 12:14:03 user nova-compute[73449]:       <backend model="random">/dev/urandom</backend>
Aug 17 12:14:03 user nova-compute[73449]:     </rng>
Aug 17 12:14:03 user nova-compute[73449]:     <controller type="usb" index="0" model="none"/>
Aug 17 12:14:03 user nova-compute[73449]:     <memballoon model="virtio">
Aug 17 12:14:03 user nova-compute[73449]:       <stats period="10"/>
Aug 17 12:14:03 user nova-compute[73449]:     </memballoon>
Aug 17 12:14:03 user nova-compute[73449]:   </devices>
Aug 17 12:14:03 user nova-compute[73449]: </domain>
Aug 17 12:14:03 user nova-compute[73449]:  {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 12:14:03 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-1bffdd42-049b-414b-87a8-3c745707dedc tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T12:14:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-86467027',display_name='tempest-AttachVolumeTestJSON-server-86467027',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-86467027',id=51,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD6bs79O4lp/VvLMrCaTVP7F7/4BJnr7AD9elyqqO0Iv9zuyHSfFM6JuUqPVqyM283blqlePiY3Tj4gbqqYMYjtnMaqIrVD3wQxaSUatFm0ZFFPWih48n64P8MCTzEVZTQ==',key_name='tempest-keypair-220674408',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f2a2f7faf23147fba5270c844eac051a',ramdisk_id='',reservation_id='r-0qh71q0x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1035899549',owner_user_name='tempest-AttachVolumeTestJSON-1035899549-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T12:14:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9b21e7e411a54be0890ae7b0ca85d80c',uuid=6d482e2e-e73c-4c13-aead-dacefa7be735,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "15176341-7f06-4c3a-9501-b2c7518f7119", "address": "fa:16:3e:e1:e1:cd", "network": {"id": "2ead35b7-4013-4fab-b35f-02f3237fcac1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1887618888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2a2f7faf23147fba5270c844eac051a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15176341-7f", "ovs_interfaceid": "15176341-7f06-4c3a-9501-b2c7518f7119", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 12:14:03 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-1bffdd42-049b-414b-87a8-3c745707dedc tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Converting VIF {"id": "15176341-7f06-4c3a-9501-b2c7518f7119", "address": "fa:16:3e:e1:e1:cd", "network": {"id": "2ead35b7-4013-4fab-b35f-02f3237fcac1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1887618888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2a2f7faf23147fba5270c844eac051a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15176341-7f", "ovs_interfaceid": "15176341-7f06-4c3a-9501-b2c7518f7119", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 12:14:03 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-1bffdd42-049b-414b-87a8-3c745707dedc tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:e1:cd,bridge_name='br-int',has_traffic_filtering=True,id=15176341-7f06-4c3a-9501-b2c7518f7119,network=Network(2ead35b7-4013-4fab-b35f-02f3237fcac1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15176341-7f') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 12:14:03 user nova-compute[73449]: DEBUG os_vif [None req-1bffdd42-049b-414b-87a8-3c745707dedc tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:e1:cd,bridge_name='br-int',has_traffic_filtering=True,id=15176341-7f06-4c3a-9501-b2c7518f7119,network=Network(2ead35b7-4013-4fab-b35f-02f3237fcac1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15176341-7f') {{(pid=73449) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 12:14:03 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:14:03 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 12:14:03 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 12:14:03 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:14:03 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap15176341-7f, may_exist=True, interface_attrs={}) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 12:14:03 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap15176341-7f, col_values=(('external_ids', {'iface-id': '15176341-7f06-4c3a-9501-b2c7518f7119', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e1:e1:cd', 'vm-uuid': '6d482e2e-e73c-4c13-aead-dacefa7be735'}),), if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 12:14:03 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:14:03 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:14:03 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:14:03 user nova-compute[73449]: INFO os_vif [None req-1bffdd42-049b-414b-87a8-3c745707dedc tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:e1:cd,bridge_name='br-int',has_traffic_filtering=True,id=15176341-7f06-4c3a-9501-b2c7518f7119,network=Network(2ead35b7-4013-4fab-b35f-02f3237fcac1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15176341-7f')
Aug 17 12:14:03 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-1bffdd42-049b-414b-87a8-3c745707dedc tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] No BDM found with device name vda, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 12:14:03 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-1bffdd42-049b-414b-87a8-3c745707dedc tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] No VIF found with MAC fa:16:3e:e1:e1:cd, not building metadata {{(pid=73449) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 12:14:03 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:14:04 user nova-compute[73449]: DEBUG nova.network.neutron [req-f2602da1-d05c-4c49-ba02-adcc1be85364 req-bdf3f941-9fdb-42d0-8f79-c8144d2e50fd service nova] [instance: 6d482e2e-e73c-4c13-aead-dacefa7be735] Updated VIF entry in instance network info cache for port 15176341-7f06-4c3a-9501-b2c7518f7119. {{(pid=73449) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 12:14:04 user nova-compute[73449]: DEBUG nova.network.neutron [req-f2602da1-d05c-4c49-ba02-adcc1be85364 req-bdf3f941-9fdb-42d0-8f79-c8144d2e50fd service nova] [instance: 6d482e2e-e73c-4c13-aead-dacefa7be735] Updating instance_info_cache with network_info: [{"id": "15176341-7f06-4c3a-9501-b2c7518f7119", "address": "fa:16:3e:e1:e1:cd", "network": {"id": "2ead35b7-4013-4fab-b35f-02f3237fcac1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1887618888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2a2f7faf23147fba5270c844eac051a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15176341-7f", "ovs_interfaceid": "15176341-7f06-4c3a-9501-b2c7518f7119", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 12:14:04 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-f2602da1-d05c-4c49-ba02-adcc1be85364 req-bdf3f941-9fdb-42d0-8f79-c8144d2e50fd service nova] Releasing lock "refresh_cache-6d482e2e-e73c-4c13-aead-dacefa7be735" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 12:14:05 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:14:05 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:14:05 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:14:05 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:14:05 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:14:05 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:14:05 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:14:07 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692274447.3149362, 6d482e2e-e73c-4c13-aead-dacefa7be735 => Resumed> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 12:14:07 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 6d482e2e-e73c-4c13-aead-dacefa7be735] VM Resumed (Lifecycle Event)
Aug 17 12:14:07 user nova-compute[73449]: DEBUG nova.compute.manager [None req-1bffdd42-049b-414b-87a8-3c745707dedc tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] [instance: 6d482e2e-e73c-4c13-aead-dacefa7be735] Instance event wait completed in 0 seconds for  {{(pid=73449) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 12:14:07 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-1bffdd42-049b-414b-87a8-3c745707dedc tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] [instance: 6d482e2e-e73c-4c13-aead-dacefa7be735] Guest created on hypervisor {{(pid=73449) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 12:14:07 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: 6d482e2e-e73c-4c13-aead-dacefa7be735] Instance spawned successfully.
Aug 17 12:14:07 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-1bffdd42-049b-414b-87a8-3c745707dedc tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] [instance: 6d482e2e-e73c-4c13-aead-dacefa7be735] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 12:14:07 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 6d482e2e-e73c-4c13-aead-dacefa7be735] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 12:14:07 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-1bffdd42-049b-414b-87a8-3c745707dedc tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] [instance: 6d482e2e-e73c-4c13-aead-dacefa7be735] Found default for hw_cdrom_bus of ide {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 12:14:07 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-1bffdd42-049b-414b-87a8-3c745707dedc tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] [instance: 6d482e2e-e73c-4c13-aead-dacefa7be735] Found default for hw_disk_bus of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 12:14:07 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-1bffdd42-049b-414b-87a8-3c745707dedc tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] [instance: 6d482e2e-e73c-4c13-aead-dacefa7be735] Found default for hw_input_bus of None {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 12:14:07 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-1bffdd42-049b-414b-87a8-3c745707dedc tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] [instance: 6d482e2e-e73c-4c13-aead-dacefa7be735] Found default for hw_pointer_model of None {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 12:14:07 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-1bffdd42-049b-414b-87a8-3c745707dedc tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] [instance: 6d482e2e-e73c-4c13-aead-dacefa7be735] Found default for hw_video_model of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 12:14:07 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-1bffdd42-049b-414b-87a8-3c745707dedc tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] [instance: 6d482e2e-e73c-4c13-aead-dacefa7be735] Found default for hw_vif_model of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 12:14:07 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 6d482e2e-e73c-4c13-aead-dacefa7be735] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 12:14:07 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 6d482e2e-e73c-4c13-aead-dacefa7be735] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 12:14:07 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692274447.3165145, 6d482e2e-e73c-4c13-aead-dacefa7be735 => Started> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 12:14:07 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 6d482e2e-e73c-4c13-aead-dacefa7be735] VM Started (Lifecycle Event)
Aug 17 12:14:07 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 6d482e2e-e73c-4c13-aead-dacefa7be735] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 12:14:07 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 6d482e2e-e73c-4c13-aead-dacefa7be735] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 12:14:07 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: 6d482e2e-e73c-4c13-aead-dacefa7be735] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 12:14:07 user nova-compute[73449]: INFO nova.compute.manager [None req-1bffdd42-049b-414b-87a8-3c745707dedc tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] [instance: 6d482e2e-e73c-4c13-aead-dacefa7be735] Took 5.56 seconds to spawn the instance on the hypervisor.
Aug 17 12:14:07 user nova-compute[73449]: DEBUG nova.compute.manager [None req-1bffdd42-049b-414b-87a8-3c745707dedc tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] [instance: 6d482e2e-e73c-4c13-aead-dacefa7be735] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 12:14:07 user nova-compute[73449]: INFO nova.compute.manager [None req-1bffdd42-049b-414b-87a8-3c745707dedc tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] [instance: 6d482e2e-e73c-4c13-aead-dacefa7be735] Took 6.14 seconds to build instance.
Aug 17 12:14:07 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-1bffdd42-049b-414b-87a8-3c745707dedc tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Lock "6d482e2e-e73c-4c13-aead-dacefa7be735" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.279s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:14:07 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:14:08 user nova-compute[73449]: DEBUG nova.compute.manager [req-0001dff9-16b3-4d4a-91cf-fb28ce434bb3 req-f9301c98-f815-42af-a1f2-fa855ad774c5 service nova] [instance: 6d482e2e-e73c-4c13-aead-dacefa7be735] Received event network-vif-plugged-15176341-7f06-4c3a-9501-b2c7518f7119 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:14:08 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-0001dff9-16b3-4d4a-91cf-fb28ce434bb3 req-f9301c98-f815-42af-a1f2-fa855ad774c5 service nova] Acquiring lock "6d482e2e-e73c-4c13-aead-dacefa7be735-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:14:08 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-0001dff9-16b3-4d4a-91cf-fb28ce434bb3 req-f9301c98-f815-42af-a1f2-fa855ad774c5 service nova] Lock "6d482e2e-e73c-4c13-aead-dacefa7be735-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:14:08 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-0001dff9-16b3-4d4a-91cf-fb28ce434bb3 req-f9301c98-f815-42af-a1f2-fa855ad774c5 service nova] Lock "6d482e2e-e73c-4c13-aead-dacefa7be735-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:14:08 user nova-compute[73449]: DEBUG nova.compute.manager [req-0001dff9-16b3-4d4a-91cf-fb28ce434bb3 req-f9301c98-f815-42af-a1f2-fa855ad774c5 service nova] [instance: 6d482e2e-e73c-4c13-aead-dacefa7be735] No waiting events found dispatching network-vif-plugged-15176341-7f06-4c3a-9501-b2c7518f7119 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 12:14:08 user nova-compute[73449]: WARNING nova.compute.manager [req-0001dff9-16b3-4d4a-91cf-fb28ce434bb3 req-f9301c98-f815-42af-a1f2-fa855ad774c5 service nova] [instance: 6d482e2e-e73c-4c13-aead-dacefa7be735] Received unexpected event network-vif-plugged-15176341-7f06-4c3a-9501-b2c7518f7119 for instance with vm_state active and task_state None.
Aug 17 12:14:08 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:14:08 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:14:09 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:14:09 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:14:10 user nova-compute[73449]: DEBUG nova.compute.manager [req-995b78cb-84d0-48db-b472-65f1518cec00 req-afa8ffea-e8c6-499b-acd5-58dc27d509ff service nova] [instance: 6d482e2e-e73c-4c13-aead-dacefa7be735] Received event network-vif-plugged-15176341-7f06-4c3a-9501-b2c7518f7119 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:14:10 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-995b78cb-84d0-48db-b472-65f1518cec00 req-afa8ffea-e8c6-499b-acd5-58dc27d509ff service nova] Acquiring lock "6d482e2e-e73c-4c13-aead-dacefa7be735-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:14:10 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-995b78cb-84d0-48db-b472-65f1518cec00 req-afa8ffea-e8c6-499b-acd5-58dc27d509ff service nova] Lock "6d482e2e-e73c-4c13-aead-dacefa7be735-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:14:10 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-995b78cb-84d0-48db-b472-65f1518cec00 req-afa8ffea-e8c6-499b-acd5-58dc27d509ff service nova] Lock "6d482e2e-e73c-4c13-aead-dacefa7be735-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:14:10 user nova-compute[73449]: DEBUG nova.compute.manager [req-995b78cb-84d0-48db-b472-65f1518cec00 req-afa8ffea-e8c6-499b-acd5-58dc27d509ff service nova] [instance: 6d482e2e-e73c-4c13-aead-dacefa7be735] No waiting events found dispatching network-vif-plugged-15176341-7f06-4c3a-9501-b2c7518f7119 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 12:14:10 user nova-compute[73449]: WARNING nova.compute.manager [req-995b78cb-84d0-48db-b472-65f1518cec00 req-afa8ffea-e8c6-499b-acd5-58dc27d509ff service nova] [instance: 6d482e2e-e73c-4c13-aead-dacefa7be735] Received unexpected event network-vif-plugged-15176341-7f06-4c3a-9501-b2c7518f7119 for instance with vm_state active and task_state None.
Aug 17 12:14:13 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-11d43f74-c9ba-4425-9cf2-a9fcb69291c9 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Acquiring lock "731e74ce-bc73-49e6-b74b-4d652952b8cf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:14:13 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-11d43f74-c9ba-4425-9cf2-a9fcb69291c9 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Lock "731e74ce-bc73-49e6-b74b-4d652952b8cf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:14:13 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-11d43f74-c9ba-4425-9cf2-a9fcb69291c9 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Acquiring lock "731e74ce-bc73-49e6-b74b-4d652952b8cf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:14:13 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-11d43f74-c9ba-4425-9cf2-a9fcb69291c9 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Lock "731e74ce-bc73-49e6-b74b-4d652952b8cf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:14:13 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-11d43f74-c9ba-4425-9cf2-a9fcb69291c9 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Lock "731e74ce-bc73-49e6-b74b-4d652952b8cf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:14:13 user nova-compute[73449]: INFO nova.compute.manager [None req-11d43f74-c9ba-4425-9cf2-a9fcb69291c9 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: 731e74ce-bc73-49e6-b74b-4d652952b8cf] Terminating instance
Aug 17 12:14:13 user nova-compute[73449]: DEBUG nova.compute.manager [None req-11d43f74-c9ba-4425-9cf2-a9fcb69291c9 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: 731e74ce-bc73-49e6-b74b-4d652952b8cf] Start destroying the instance on the hypervisor. {{(pid=73449) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 12:14:13 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:14:13 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:14:13 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:14:13 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:14:13 user nova-compute[73449]: DEBUG nova.compute.manager [req-9f5e491c-f6f2-49b0-9e78-fff2be943c2c req-1d367411-f6e0-442e-b222-8e5885f7759a service nova] [instance: 731e74ce-bc73-49e6-b74b-4d652952b8cf] Received event network-vif-unplugged-d5640497-17d4-4d8f-b99f-797a8e2b4221 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:14:13 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-9f5e491c-f6f2-49b0-9e78-fff2be943c2c req-1d367411-f6e0-442e-b222-8e5885f7759a service nova] Acquiring lock "731e74ce-bc73-49e6-b74b-4d652952b8cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:14:13 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-9f5e491c-f6f2-49b0-9e78-fff2be943c2c req-1d367411-f6e0-442e-b222-8e5885f7759a service nova] Lock "731e74ce-bc73-49e6-b74b-4d652952b8cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:14:13 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-9f5e491c-f6f2-49b0-9e78-fff2be943c2c req-1d367411-f6e0-442e-b222-8e5885f7759a service nova] Lock "731e74ce-bc73-49e6-b74b-4d652952b8cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:14:13 user nova-compute[73449]: DEBUG nova.compute.manager [req-9f5e491c-f6f2-49b0-9e78-fff2be943c2c req-1d367411-f6e0-442e-b222-8e5885f7759a service nova] [instance: 731e74ce-bc73-49e6-b74b-4d652952b8cf] No waiting events found dispatching network-vif-unplugged-d5640497-17d4-4d8f-b99f-797a8e2b4221 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 12:14:13 user nova-compute[73449]: DEBUG nova.compute.manager [req-9f5e491c-f6f2-49b0-9e78-fff2be943c2c req-1d367411-f6e0-442e-b222-8e5885f7759a service nova] [instance: 731e74ce-bc73-49e6-b74b-4d652952b8cf] Received event network-vif-unplugged-d5640497-17d4-4d8f-b99f-797a8e2b4221 for instance with task_state deleting. {{(pid=73449) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 12:14:13 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:14:13 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-3de5b7f8-89c1-4986-8a8e-786349fd05c2 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Acquiring lock "ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:14:13 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-3de5b7f8-89c1-4986-8a8e-786349fd05c2 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Lock "ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:14:13 user nova-compute[73449]: DEBUG nova.compute.manager [None req-3de5b7f8-89c1-4986-8a8e-786349fd05c2 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] Starting instance... {{(pid=73449) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 12:14:13 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:14:13 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:14:13 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:14:13 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:14:14 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:14:14 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: 731e74ce-bc73-49e6-b74b-4d652952b8cf] Instance destroyed successfully.
Aug 17 12:14:14 user nova-compute[73449]: DEBUG nova.objects.instance [None req-11d43f74-c9ba-4425-9cf2-a9fcb69291c9 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Lazy-loading 'resources' on Instance uuid 731e74ce-bc73-49e6-b74b-4d652952b8cf {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:14:14 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-3de5b7f8-89c1-4986-8a8e-786349fd05c2 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:14:14 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-3de5b7f8-89c1-4986-8a8e-786349fd05c2 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:14:14 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-11d43f74-c9ba-4425-9cf2-a9fcb69291c9 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T12:11:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-817310208',display_name='tempest-AttachVolumeNegativeTest-server-817310208',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-817310208',id=50,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOy5DLspZnAj1djQXj9ZyB40hkOn0T9B1VlovtlAH4KPVg1j7MPJgsS3aQ9Yk3zZQliShPIklN85oG2IdaOaDRPzR9q8wwzbRr11nHZNJMlN2f+cTGo/u1+MBxA23/2xew==',key_name='tempest-keypair-1006997117',keypairs=<?>,launch_index=0,launched_at=2023-08-17T12:11:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='75aa99e369c54b65aff27adbb1daf2b8',ramdisk_id='',reservation_id='r-2ic3nlq0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-165752051',owner_user_name='tempest-AttachVolumeNegativeTest-165752051-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T12:11:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55cde68973ca42d095180b5c0701b49b',uuid=731e74ce-bc73-49e6-b74b-4d652952b8cf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d5640497-17d4-4d8f-b99f-797a8e2b4221", "address": "fa:16:3e:bd:10:2a", "network": {"id": "71648e1b-cf19-44b7-bae2-9d38543cdee9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-822323626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75aa99e369c54b65aff27adbb1daf2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5640497-17", "ovs_interfaceid": "d5640497-17d4-4d8f-b99f-797a8e2b4221", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 12:14:14 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-11d43f74-c9ba-4425-9cf2-a9fcb69291c9 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Converting VIF {"id": "d5640497-17d4-4d8f-b99f-797a8e2b4221", "address": "fa:16:3e:bd:10:2a", "network": {"id": "71648e1b-cf19-44b7-bae2-9d38543cdee9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-822323626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75aa99e369c54b65aff27adbb1daf2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5640497-17", "ovs_interfaceid": "d5640497-17d4-4d8f-b99f-797a8e2b4221", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 12:14:14 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-11d43f74-c9ba-4425-9cf2-a9fcb69291c9 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bd:10:2a,bridge_name='br-int',has_traffic_filtering=True,id=d5640497-17d4-4d8f-b99f-797a8e2b4221,network=Network(71648e1b-cf19-44b7-bae2-9d38543cdee9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5640497-17') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 12:14:14 user nova-compute[73449]: DEBUG os_vif [None req-11d43f74-c9ba-4425-9cf2-a9fcb69291c9 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bd:10:2a,bridge_name='br-int',has_traffic_filtering=True,id=d5640497-17d4-4d8f-b99f-797a8e2b4221,network=Network(71648e1b-cf19-44b7-bae2-9d38543cdee9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5640497-17') {{(pid=73449) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 12:14:14 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:14:14 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd5640497-17, bridge=br-int, if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 12:14:14 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-3de5b7f8-89c1-4986-8a8e-786349fd05c2 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73449) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 12:14:14 user nova-compute[73449]: INFO nova.compute.claims [None req-3de5b7f8-89c1-4986-8a8e-786349fd05c2 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] Claim successful on node user
Aug 17 12:14:14 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:14:14 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:14:14 user nova-compute[73449]: INFO os_vif [None req-11d43f74-c9ba-4425-9cf2-a9fcb69291c9 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bd:10:2a,bridge_name='br-int',has_traffic_filtering=True,id=d5640497-17d4-4d8f-b99f-797a8e2b4221,network=Network(71648e1b-cf19-44b7-bae2-9d38543cdee9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5640497-17')
Aug 17 12:14:14 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-11d43f74-c9ba-4425-9cf2-a9fcb69291c9 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: 731e74ce-bc73-49e6-b74b-4d652952b8cf] Deleting instance files /opt/stack/data/nova/instances/731e74ce-bc73-49e6-b74b-4d652952b8cf_del
Aug 17 12:14:14 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-11d43f74-c9ba-4425-9cf2-a9fcb69291c9 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: 731e74ce-bc73-49e6-b74b-4d652952b8cf] Deletion of /opt/stack/data/nova/instances/731e74ce-bc73-49e6-b74b-4d652952b8cf_del complete
Aug 17 12:14:14 user nova-compute[73449]: INFO nova.compute.manager [None req-11d43f74-c9ba-4425-9cf2-a9fcb69291c9 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] [instance: 731e74ce-bc73-49e6-b74b-4d652952b8cf] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 17 12:14:14 user nova-compute[73449]: DEBUG oslo.service.loopingcall [None req-11d43f74-c9ba-4425-9cf2-a9fcb69291c9 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73449) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 12:14:14 user nova-compute[73449]: DEBUG nova.compute.manager [-] [instance: 731e74ce-bc73-49e6-b74b-4d652952b8cf] Deallocating network for instance {{(pid=73449) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 12:14:14 user nova-compute[73449]: DEBUG nova.network.neutron [-] [instance: 731e74ce-bc73-49e6-b74b-4d652952b8cf] deallocate_for_instance() {{(pid=73449) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 12:14:14 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-3de5b7f8-89c1-4986-8a8e-786349fd05c2 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 12:14:14 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-3de5b7f8-89c1-4986-8a8e-786349fd05c2 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 12:14:14 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-3de5b7f8-89c1-4986-8a8e-786349fd05c2 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.322s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:14:14 user nova-compute[73449]: DEBUG nova.compute.manager [None req-3de5b7f8-89c1-4986-8a8e-786349fd05c2 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] Start building networks asynchronously for instance. {{(pid=73449) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 12:14:14 user nova-compute[73449]: DEBUG nova.compute.manager [None req-3de5b7f8-89c1-4986-8a8e-786349fd05c2 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] Allocating IP information in the background. {{(pid=73449) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 12:14:14 user nova-compute[73449]: DEBUG nova.network.neutron [None req-3de5b7f8-89c1-4986-8a8e-786349fd05c2 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] allocate_for_instance() {{(pid=73449) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 12:14:14 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-3de5b7f8-89c1-4986-8a8e-786349fd05c2 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 12:14:14 user nova-compute[73449]: DEBUG nova.compute.manager [None req-3de5b7f8-89c1-4986-8a8e-786349fd05c2 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] Start building block device mappings for instance. {{(pid=73449) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 12:14:14 user nova-compute[73449]: DEBUG nova.policy [None req-3de5b7f8-89c1-4986-8a8e-786349fd05c2 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '600c0b4dfa534020a4fee49e6f368ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280c999654434edd8f5288786756f2ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73449) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 12:14:14 user nova-compute[73449]: DEBUG nova.compute.manager [None req-3de5b7f8-89c1-4986-8a8e-786349fd05c2 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] Start spawning the instance on the hypervisor. {{(pid=73449) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 12:14:14 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-3de5b7f8-89c1-4986-8a8e-786349fd05c2 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] Creating instance directory {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 12:14:14 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-3de5b7f8-89c1-4986-8a8e-786349fd05c2 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] Creating image(s)
Aug 17 12:14:14 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-3de5b7f8-89c1-4986-8a8e-786349fd05c2 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Acquiring lock "/opt/stack/data/nova/instances/ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:14:14 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-3de5b7f8-89c1-4986-8a8e-786349fd05c2 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Lock "/opt/stack/data/nova/instances/ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:14:14 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-3de5b7f8-89c1-4986-8a8e-786349fd05c2 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Lock "/opt/stack/data/nova/instances/ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:14:14 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-3de5b7f8-89c1-4986-8a8e-786349fd05c2 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:14:14 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:14:14 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:14:14 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:14:14 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-3de5b7f8-89c1-4986-8a8e-786349fd05c2 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json" returned: 0 in 0.195s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:14:14 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-3de5b7f8-89c1-4986-8a8e-786349fd05c2 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Acquiring lock "7e267a577c062ee862e95ede6b48cfd5632f3ea3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:14:14 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-3de5b7f8-89c1-4986-8a8e-786349fd05c2 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Lock "7e267a577c062ee862e95ede6b48cfd5632f3ea3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.008s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:14:14 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-3de5b7f8-89c1-4986-8a8e-786349fd05c2 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:14:14 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-3de5b7f8-89c1-4986-8a8e-786349fd05c2 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json" returned: 0 in 0.185s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:14:14 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-3de5b7f8-89c1-4986-8a8e-786349fd05c2 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3,backing_fmt=raw /opt/stack/data/nova/instances/ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d/disk 1073741824 {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:14:15 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-3de5b7f8-89c1-4986-8a8e-786349fd05c2 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3,backing_fmt=raw /opt/stack/data/nova/instances/ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d/disk 1073741824" returned: 0 in 0.053s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:14:15 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-3de5b7f8-89c1-4986-8a8e-786349fd05c2 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Lock "7e267a577c062ee862e95ede6b48cfd5632f3ea3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:14:15 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-3de5b7f8-89c1-4986-8a8e-786349fd05c2 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:14:15 user nova-compute[73449]: DEBUG nova.compute.manager [req-350a20f0-2913-460d-bad6-135140da6931 req-b4815467-ece4-4ed8-a353-382edc25bc6d service nova] [instance: 731e74ce-bc73-49e6-b74b-4d652952b8cf] Received event network-vif-deleted-d5640497-17d4-4d8f-b99f-797a8e2b4221 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:14:15 user nova-compute[73449]: INFO nova.compute.manager [req-350a20f0-2913-460d-bad6-135140da6931 req-b4815467-ece4-4ed8-a353-382edc25bc6d service nova] [instance: 731e74ce-bc73-49e6-b74b-4d652952b8cf] Neutron deleted interface d5640497-17d4-4d8f-b99f-797a8e2b4221; detaching it from the instance and deleting it from the info cache
Aug 17 12:14:15 user nova-compute[73449]: DEBUG nova.network.neutron [req-350a20f0-2913-460d-bad6-135140da6931 req-b4815467-ece4-4ed8-a353-382edc25bc6d service nova] [instance: 731e74ce-bc73-49e6-b74b-4d652952b8cf] Updating instance_info_cache with network_info: [] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 12:14:15 user nova-compute[73449]: DEBUG nova.network.neutron [-] [instance: 731e74ce-bc73-49e6-b74b-4d652952b8cf] Updating instance_info_cache with network_info: [] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 12:14:15 user nova-compute[73449]: INFO nova.compute.manager [-] [instance: 731e74ce-bc73-49e6-b74b-4d652952b8cf] Took 1.00 seconds to deallocate network for instance.
Aug 17 12:14:15 user nova-compute[73449]: DEBUG nova.compute.manager [req-350a20f0-2913-460d-bad6-135140da6931 req-b4815467-ece4-4ed8-a353-382edc25bc6d service nova] [instance: 731e74ce-bc73-49e6-b74b-4d652952b8cf] Detach interface failed, port_id=d5640497-17d4-4d8f-b99f-797a8e2b4221, reason: Instance 731e74ce-bc73-49e6-b74b-4d652952b8cf could not be found. {{(pid=73449) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 12:14:15 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-11d43f74-c9ba-4425-9cf2-a9fcb69291c9 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:14:15 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-11d43f74-c9ba-4425-9cf2-a9fcb69291c9 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:14:15 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-3de5b7f8-89c1-4986-8a8e-786349fd05c2 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json" returned: 0 in 0.189s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:14:15 user nova-compute[73449]: DEBUG nova.virt.disk.api [None req-3de5b7f8-89c1-4986-8a8e-786349fd05c2 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d/disk. size=1073741824 {{(pid=73449) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 12:14:15 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-3de5b7f8-89c1-4986-8a8e-786349fd05c2 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:14:15 user nova-compute[73449]: DEBUG nova.network.neutron [None req-3de5b7f8-89c1-4986-8a8e-786349fd05c2 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] Successfully created port: 3360223f-60df-4be9-ba80-3bb2baf444a2 {{(pid=73449) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 12:14:15 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-11d43f74-c9ba-4425-9cf2-a9fcb69291c9 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 12:14:15 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-11d43f74-c9ba-4425-9cf2-a9fcb69291c9 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 12:14:15 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-3de5b7f8-89c1-4986-8a8e-786349fd05c2 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:14:15 user nova-compute[73449]: DEBUG nova.virt.disk.api [None req-3de5b7f8-89c1-4986-8a8e-786349fd05c2 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Cannot resize image /opt/stack/data/nova/instances/ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d/disk to a smaller size. {{(pid=73449) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 12:14:15 user nova-compute[73449]: DEBUG nova.objects.instance [None req-3de5b7f8-89c1-4986-8a8e-786349fd05c2 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Lazy-loading 'migration_context' on Instance uuid ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:14:15 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-3de5b7f8-89c1-4986-8a8e-786349fd05c2 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] Created local disks {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 12:14:15 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-3de5b7f8-89c1-4986-8a8e-786349fd05c2 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] Ensure instance console log exists: /opt/stack/data/nova/instances/ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d/console.log {{(pid=73449) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 12:14:15 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-3de5b7f8-89c1-4986-8a8e-786349fd05c2 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:14:15 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-3de5b7f8-89c1-4986-8a8e-786349fd05c2 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:14:15 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-3de5b7f8-89c1-4986-8a8e-786349fd05c2 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:14:15 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-11d43f74-c9ba-4425-9cf2-a9fcb69291c9 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.275s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:14:15 user nova-compute[73449]: INFO nova.scheduler.client.report [None req-11d43f74-c9ba-4425-9cf2-a9fcb69291c9 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Deleted allocations for instance 731e74ce-bc73-49e6-b74b-4d652952b8cf
Aug 17 12:14:15 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-11d43f74-c9ba-4425-9cf2-a9fcb69291c9 tempest-AttachVolumeNegativeTest-165752051 tempest-AttachVolumeNegativeTest-165752051-project-member] Lock "731e74ce-bc73-49e6-b74b-4d652952b8cf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.378s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:14:15 user nova-compute[73449]: DEBUG nova.compute.manager [req-7aba3539-ee9f-41a6-9ed8-1de148277c26 req-c0ff5ed5-1950-4d5e-9031-0381e43578ec service nova] [instance: 731e74ce-bc73-49e6-b74b-4d652952b8cf] Received event network-vif-plugged-d5640497-17d4-4d8f-b99f-797a8e2b4221 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:14:15 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-7aba3539-ee9f-41a6-9ed8-1de148277c26 req-c0ff5ed5-1950-4d5e-9031-0381e43578ec service nova] Acquiring lock "731e74ce-bc73-49e6-b74b-4d652952b8cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:14:15 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-7aba3539-ee9f-41a6-9ed8-1de148277c26 req-c0ff5ed5-1950-4d5e-9031-0381e43578ec service nova] Lock "731e74ce-bc73-49e6-b74b-4d652952b8cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:14:15 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-7aba3539-ee9f-41a6-9ed8-1de148277c26 req-c0ff5ed5-1950-4d5e-9031-0381e43578ec service nova] Lock "731e74ce-bc73-49e6-b74b-4d652952b8cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:14:15 user nova-compute[73449]: DEBUG nova.compute.manager [req-7aba3539-ee9f-41a6-9ed8-1de148277c26 req-c0ff5ed5-1950-4d5e-9031-0381e43578ec service nova] [instance: 731e74ce-bc73-49e6-b74b-4d652952b8cf] No waiting events found dispatching network-vif-plugged-d5640497-17d4-4d8f-b99f-797a8e2b4221 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 12:14:15 user nova-compute[73449]: WARNING nova.compute.manager [req-7aba3539-ee9f-41a6-9ed8-1de148277c26 req-c0ff5ed5-1950-4d5e-9031-0381e43578ec service nova] [instance: 731e74ce-bc73-49e6-b74b-4d652952b8cf] Received unexpected event network-vif-plugged-d5640497-17d4-4d8f-b99f-797a8e2b4221 for instance with vm_state deleted and task_state None.
Aug 17 12:14:15 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:14:15 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:14:15 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73449) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 12:14:16 user nova-compute[73449]: DEBUG nova.network.neutron [None req-3de5b7f8-89c1-4986-8a8e-786349fd05c2 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] Successfully updated port: 3360223f-60df-4be9-ba80-3bb2baf444a2 {{(pid=73449) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 12:14:16 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-3de5b7f8-89c1-4986-8a8e-786349fd05c2 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Acquiring lock "refresh_cache-ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 12:14:16 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-3de5b7f8-89c1-4986-8a8e-786349fd05c2 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Acquired lock "refresh_cache-ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 12:14:16 user nova-compute[73449]: DEBUG nova.network.neutron [None req-3de5b7f8-89c1-4986-8a8e-786349fd05c2 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] Building network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 12:14:16 user nova-compute[73449]: DEBUG nova.compute.manager [req-c52578ff-ba5f-4870-9ed7-b9fcbba4bf7a req-1dd4a47a-598a-46fe-a197-afd57c1c23c5 service nova] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] Received event network-changed-3360223f-60df-4be9-ba80-3bb2baf444a2 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:14:16 user nova-compute[73449]: DEBUG nova.compute.manager [req-c52578ff-ba5f-4870-9ed7-b9fcbba4bf7a req-1dd4a47a-598a-46fe-a197-afd57c1c23c5 service nova] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] Refreshing instance network info cache due to event network-changed-3360223f-60df-4be9-ba80-3bb2baf444a2. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 12:14:16 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-c52578ff-ba5f-4870-9ed7-b9fcbba4bf7a req-1dd4a47a-598a-46fe-a197-afd57c1c23c5 service nova] Acquiring lock "refresh_cache-ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 12:14:16 user nova-compute[73449]: DEBUG nova.network.neutron [None req-3de5b7f8-89c1-4986-8a8e-786349fd05c2 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] Instance cache missing network info. {{(pid=73449) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 12:14:17 user nova-compute[73449]: DEBUG nova.network.neutron [None req-3de5b7f8-89c1-4986-8a8e-786349fd05c2 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] Updating instance_info_cache with network_info: [{"id": "3360223f-60df-4be9-ba80-3bb2baf444a2", "address": "fa:16:3e:79:15:ac", "network": {"id": "eebeaab2-1a00-4da6-a475-c2eda7a17090", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1522507326-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "280c999654434edd8f5288786756f2ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3360223f-60", "ovs_interfaceid": "3360223f-60df-4be9-ba80-3bb2baf444a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 12:14:17 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-3de5b7f8-89c1-4986-8a8e-786349fd05c2 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Releasing lock "refresh_cache-ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 12:14:17 user nova-compute[73449]: DEBUG nova.compute.manager [None req-3de5b7f8-89c1-4986-8a8e-786349fd05c2 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] Instance network_info: |[{"id": "3360223f-60df-4be9-ba80-3bb2baf444a2", "address": "fa:16:3e:79:15:ac", "network": {"id": "eebeaab2-1a00-4da6-a475-c2eda7a17090", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1522507326-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "280c999654434edd8f5288786756f2ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3360223f-60", "ovs_interfaceid": "3360223f-60df-4be9-ba80-3bb2baf444a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73449) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 12:14:17 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-c52578ff-ba5f-4870-9ed7-b9fcbba4bf7a req-1dd4a47a-598a-46fe-a197-afd57c1c23c5 service nova] Acquired lock "refresh_cache-ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 12:14:17 user nova-compute[73449]: DEBUG nova.network.neutron [req-c52578ff-ba5f-4870-9ed7-b9fcbba4bf7a req-1dd4a47a-598a-46fe-a197-afd57c1c23c5 service nova] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] Refreshing network info cache for port 3360223f-60df-4be9-ba80-3bb2baf444a2 {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 12:14:17 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-3de5b7f8-89c1-4986-8a8e-786349fd05c2 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] Start _get_guest_xml network_info=[{"id": "3360223f-60df-4be9-ba80-3bb2baf444a2", "address": "fa:16:3e:79:15:ac", "network": {"id": "eebeaab2-1a00-4da6-a475-c2eda7a17090", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1522507326-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "280c999654434edd8f5288786756f2ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3360223f-60", "ovs_interfaceid": "3360223f-60df-4be9-ba80-3bb2baf444a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T11:36:11Z,direct_url=<?>,disk_format='qcow2',id=0a2904ae-083d-41c8-83db-343132b36148,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7a77880136a54ef195c82e018e1939db',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T11:36:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': '0a2904ae-083d-41c8-83db-343132b36148'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 12:14:17 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-3de5b7f8-89c1-4986-8a8e-786349fd05c2 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 12:14:17 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-3de5b7f8-89c1-4986-8a8e-786349fd05c2 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 12:14:17 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-3de5b7f8-89c1-4986-8a8e-786349fd05c2 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 12:14:17 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-3de5b7f8-89c1-4986-8a8e-786349fd05c2 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] CPU controller missing on host. {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 12:14:17 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-3de5b7f8-89c1-4986-8a8e-786349fd05c2 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 12:14:17 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-3de5b7f8-89c1-4986-8a8e-786349fd05c2 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] CPU controller found on host. {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 12:14:17 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-3de5b7f8-89c1-4986-8a8e-786349fd05c2 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73449) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 12:14:17 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-3de5b7f8-89c1-4986-8a8e-786349fd05c2 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T11:35:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T11:36:11Z,direct_url=<?>,disk_format='qcow2',id=0a2904ae-083d-41c8-83db-343132b36148,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7a77880136a54ef195c82e018e1939db',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T11:36:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 12:14:17 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-3de5b7f8-89c1-4986-8a8e-786349fd05c2 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Flavor limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 12:14:17 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-3de5b7f8-89c1-4986-8a8e-786349fd05c2 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Image limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 12:14:17 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-3de5b7f8-89c1-4986-8a8e-786349fd05c2 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Flavor pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 12:14:17 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-3de5b7f8-89c1-4986-8a8e-786349fd05c2 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Image pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 12:14:17 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-3de5b7f8-89c1-4986-8a8e-786349fd05c2 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 12:14:17 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-3de5b7f8-89c1-4986-8a8e-786349fd05c2 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 12:14:17 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-3de5b7f8-89c1-4986-8a8e-786349fd05c2 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 12:14:17 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-3de5b7f8-89c1-4986-8a8e-786349fd05c2 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Got 1 possible topologies {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 12:14:17 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-3de5b7f8-89c1-4986-8a8e-786349fd05c2 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 12:14:17 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-3de5b7f8-89c1-4986-8a8e-786349fd05c2 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 12:14:17 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-3de5b7f8-89c1-4986-8a8e-786349fd05c2 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T12:14:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-466894230',display_name='tempest-SnapshotDataIntegrityTests-server-466894230',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-466894230',id=52,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAX1+waXjCYbXqG2I4EczSXOXo8wMJ4BrxT1+2xsDW0nafwwgMEu/4UOBObpH5YjMpEFcxNpkmRPBUf/TcKEn2w35pNLniIw5ExWpMNAQo+gEJO8iAZ2Zn+kjRdM8EuulA==',key_name='tempest-keypair-659724408',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='280c999654434edd8f5288786756f2ec',ramdisk_id='',reservation_id='r-ubz059vn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-2076656233',owner_user_name='tempest-SnapshotDataIntegrityTests-2076656233-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T12:14:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='600c0b4dfa534020a4fee49e6f368ba5',uuid=ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3360223f-60df-4be9-ba80-3bb2baf444a2", "address": "fa:16:3e:79:15:ac", "network": {"id": "eebeaab2-1a00-4da6-a475-c2eda7a17090", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1522507326-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "280c999654434edd8f5288786756f2ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3360223f-60", "ovs_interfaceid": "3360223f-60df-4be9-ba80-3bb2baf444a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73449) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 12:14:17 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-3de5b7f8-89c1-4986-8a8e-786349fd05c2 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Converting VIF {"id": "3360223f-60df-4be9-ba80-3bb2baf444a2", "address": "fa:16:3e:79:15:ac", "network": {"id": "eebeaab2-1a00-4da6-a475-c2eda7a17090", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1522507326-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "280c999654434edd8f5288786756f2ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3360223f-60", "ovs_interfaceid": "3360223f-60df-4be9-ba80-3bb2baf444a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 12:14:17 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-3de5b7f8-89c1-4986-8a8e-786349fd05c2 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:15:ac,bridge_name='br-int',has_traffic_filtering=True,id=3360223f-60df-4be9-ba80-3bb2baf444a2,network=Network(eebeaab2-1a00-4da6-a475-c2eda7a17090),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3360223f-60') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 12:14:17 user nova-compute[73449]: DEBUG nova.objects.instance [None req-3de5b7f8-89c1-4986-8a8e-786349fd05c2 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Lazy-loading 'pci_devices' on Instance uuid ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:14:17 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-3de5b7f8-89c1-4986-8a8e-786349fd05c2 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] End _get_guest_xml xml=<domain type="kvm">
Aug 17 12:14:17 user nova-compute[73449]:   <uuid>ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d</uuid>
Aug 17 12:14:17 user nova-compute[73449]:   <name>instance-00000034</name>
Aug 17 12:14:17 user nova-compute[73449]:   <memory>524288</memory>
Aug 17 12:14:17 user nova-compute[73449]:   <vcpu>1</vcpu>
Aug 17 12:14:17 user nova-compute[73449]:   <metadata>
Aug 17 12:14:17 user nova-compute[73449]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 12:14:17 user nova-compute[73449]:       <nova:package version="0.0.0"/>
Aug 17 12:14:17 user nova-compute[73449]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-466894230</nova:name>
Aug 17 12:14:17 user nova-compute[73449]:       <nova:creationTime>2023-08-17 12:14:17</nova:creationTime>
Aug 17 12:14:17 user nova-compute[73449]:       <nova:flavor name="m1.tiny">
Aug 17 12:14:17 user nova-compute[73449]:         <nova:memory>512</nova:memory>
Aug 17 12:14:17 user nova-compute[73449]:         <nova:disk>1</nova:disk>
Aug 17 12:14:17 user nova-compute[73449]:         <nova:swap>0</nova:swap>
Aug 17 12:14:17 user nova-compute[73449]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 12:14:17 user nova-compute[73449]:         <nova:vcpus>1</nova:vcpus>
Aug 17 12:14:17 user nova-compute[73449]:       </nova:flavor>
Aug 17 12:14:17 user nova-compute[73449]:       <nova:owner>
Aug 17 12:14:17 user nova-compute[73449]:         <nova:user uuid="600c0b4dfa534020a4fee49e6f368ba5">tempest-SnapshotDataIntegrityTests-2076656233-project-member</nova:user>
Aug 17 12:14:17 user nova-compute[73449]:         <nova:project uuid="280c999654434edd8f5288786756f2ec">tempest-SnapshotDataIntegrityTests-2076656233</nova:project>
Aug 17 12:14:17 user nova-compute[73449]:       </nova:owner>
Aug 17 12:14:17 user nova-compute[73449]:       <nova:root type="image" uuid="0a2904ae-083d-41c8-83db-343132b36148"/>
Aug 17 12:14:17 user nova-compute[73449]:       <nova:ports>
Aug 17 12:14:17 user nova-compute[73449]:         <nova:port uuid="3360223f-60df-4be9-ba80-3bb2baf444a2">
Aug 17 12:14:17 user nova-compute[73449]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 17 12:14:17 user nova-compute[73449]:         </nova:port>
Aug 17 12:14:17 user nova-compute[73449]:       </nova:ports>
Aug 17 12:14:17 user nova-compute[73449]:     </nova:instance>
Aug 17 12:14:17 user nova-compute[73449]:   </metadata>
Aug 17 12:14:17 user nova-compute[73449]:   <sysinfo type="smbios">
Aug 17 12:14:17 user nova-compute[73449]:     <system>
Aug 17 12:14:17 user nova-compute[73449]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 12:14:17 user nova-compute[73449]:       <entry name="product">OpenStack Nova</entry>
Aug 17 12:14:17 user nova-compute[73449]:       <entry name="version">0.0.0</entry>
Aug 17 12:14:17 user nova-compute[73449]:       <entry name="serial">ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d</entry>
Aug 17 12:14:17 user nova-compute[73449]:       <entry name="uuid">ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d</entry>
Aug 17 12:14:17 user nova-compute[73449]:       <entry name="family">Virtual Machine</entry>
Aug 17 12:14:17 user nova-compute[73449]:     </system>
Aug 17 12:14:17 user nova-compute[73449]:   </sysinfo>
Aug 17 12:14:17 user nova-compute[73449]:   <os>
Aug 17 12:14:17 user nova-compute[73449]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 12:14:17 user nova-compute[73449]:     <boot dev="hd"/>
Aug 17 12:14:17 user nova-compute[73449]:     <smbios mode="sysinfo"/>
Aug 17 12:14:17 user nova-compute[73449]:   </os>
Aug 17 12:14:17 user nova-compute[73449]:   <features>
Aug 17 12:14:17 user nova-compute[73449]:     <acpi/>
Aug 17 12:14:17 user nova-compute[73449]:     <apic/>
Aug 17 12:14:17 user nova-compute[73449]:     <vmcoreinfo/>
Aug 17 12:14:17 user nova-compute[73449]:   </features>
Aug 17 12:14:17 user nova-compute[73449]:   <clock offset="utc">
Aug 17 12:14:17 user nova-compute[73449]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 12:14:17 user nova-compute[73449]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 12:14:17 user nova-compute[73449]:     <timer name="hpet" present="no"/>
Aug 17 12:14:17 user nova-compute[73449]:   </clock>
Aug 17 12:14:17 user nova-compute[73449]:   <cpu mode="custom" match="exact">
Aug 17 12:14:17 user nova-compute[73449]:     <model>Nehalem</model>
Aug 17 12:14:17 user nova-compute[73449]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 12:14:17 user nova-compute[73449]:   </cpu>
Aug 17 12:14:17 user nova-compute[73449]:   <devices>
Aug 17 12:14:17 user nova-compute[73449]:     <disk type="file" device="disk">
Aug 17 12:14:17 user nova-compute[73449]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 12:14:17 user nova-compute[73449]:       <source file="/opt/stack/data/nova/instances/ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d/disk"/>
Aug 17 12:14:17 user nova-compute[73449]:       <target dev="vda" bus="virtio"/>
Aug 17 12:14:17 user nova-compute[73449]:     </disk>
Aug 17 12:14:17 user nova-compute[73449]:     <interface type="ethernet">
Aug 17 12:14:17 user nova-compute[73449]:       <mac address="fa:16:3e:79:15:ac"/>
Aug 17 12:14:17 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 12:14:17 user nova-compute[73449]:       <mtu size="1442"/>
Aug 17 12:14:17 user nova-compute[73449]:       <target dev="tap3360223f-60"/>
Aug 17 12:14:17 user nova-compute[73449]:     </interface>
Aug 17 12:14:17 user nova-compute[73449]:     <serial type="pty">
Aug 17 12:14:17 user nova-compute[73449]:       <log file="/opt/stack/data/nova/instances/ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d/console.log" append="off"/>
Aug 17 12:14:17 user nova-compute[73449]:     </serial>
Aug 17 12:14:17 user nova-compute[73449]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 12:14:17 user nova-compute[73449]:     <video>
Aug 17 12:14:17 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 12:14:17 user nova-compute[73449]:     </video>
Aug 17 12:14:17 user nova-compute[73449]:     <rng model="virtio">
Aug 17 12:14:17 user nova-compute[73449]:       <backend model="random">/dev/urandom</backend>
Aug 17 12:14:17 user nova-compute[73449]:     </rng>
Aug 17 12:14:17 user nova-compute[73449]:     <controller type="usb" index="0" model="none"/>
Aug 17 12:14:17 user nova-compute[73449]:     <memballoon model="virtio">
Aug 17 12:14:17 user nova-compute[73449]:       <stats period="10"/>
Aug 17 12:14:17 user nova-compute[73449]:     </memballoon>
Aug 17 12:14:17 user nova-compute[73449]:   </devices>
Aug 17 12:14:17 user nova-compute[73449]: </domain>
Aug 17 12:14:17 user nova-compute[73449]:  {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 12:14:17 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-3de5b7f8-89c1-4986-8a8e-786349fd05c2 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T12:14:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-466894230',display_name='tempest-SnapshotDataIntegrityTests-server-466894230',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-466894230',id=52,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAX1+waXjCYbXqG2I4EczSXOXo8wMJ4BrxT1+2xsDW0nafwwgMEu/4UOBObpH5YjMpEFcxNpkmRPBUf/TcKEn2w35pNLniIw5ExWpMNAQo+gEJO8iAZ2Zn+kjRdM8EuulA==',key_name='tempest-keypair-659724408',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='280c999654434edd8f5288786756f2ec',ramdisk_id='',reservation_id='r-ubz059vn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-2076656233',owner_user_name='tempest-SnapshotDataIntegrityTests-2076656233-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T12:14:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='600c0b4dfa534020a4fee49e6f368ba5',uuid=ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3360223f-60df-4be9-ba80-3bb2baf444a2", "address": "fa:16:3e:79:15:ac", "network": {"id": "eebeaab2-1a00-4da6-a475-c2eda7a17090", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1522507326-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "280c999654434edd8f5288786756f2ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3360223f-60", "ovs_interfaceid": "3360223f-60df-4be9-ba80-3bb2baf444a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 12:14:17 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-3de5b7f8-89c1-4986-8a8e-786349fd05c2 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Converting VIF {"id": "3360223f-60df-4be9-ba80-3bb2baf444a2", "address": "fa:16:3e:79:15:ac", "network": {"id": "eebeaab2-1a00-4da6-a475-c2eda7a17090", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1522507326-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "280c999654434edd8f5288786756f2ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3360223f-60", "ovs_interfaceid": "3360223f-60df-4be9-ba80-3bb2baf444a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 12:14:17 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-3de5b7f8-89c1-4986-8a8e-786349fd05c2 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:15:ac,bridge_name='br-int',has_traffic_filtering=True,id=3360223f-60df-4be9-ba80-3bb2baf444a2,network=Network(eebeaab2-1a00-4da6-a475-c2eda7a17090),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3360223f-60') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 12:14:17 user nova-compute[73449]: DEBUG os_vif [None req-3de5b7f8-89c1-4986-8a8e-786349fd05c2 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:15:ac,bridge_name='br-int',has_traffic_filtering=True,id=3360223f-60df-4be9-ba80-3bb2baf444a2,network=Network(eebeaab2-1a00-4da6-a475-c2eda7a17090),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3360223f-60') {{(pid=73449) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 12:14:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:14:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 12:14:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 12:14:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:14:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3360223f-60, may_exist=True, interface_attrs={}) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 12:14:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3360223f-60, col_values=(('external_ids', {'iface-id': '3360223f-60df-4be9-ba80-3bb2baf444a2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:79:15:ac', 'vm-uuid': 'ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d'}),), if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 12:14:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:14:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:14:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:14:17 user nova-compute[73449]: INFO os_vif [None req-3de5b7f8-89c1-4986-8a8e-786349fd05c2 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:15:ac,bridge_name='br-int',has_traffic_filtering=True,id=3360223f-60df-4be9-ba80-3bb2baf444a2,network=Network(eebeaab2-1a00-4da6-a475-c2eda7a17090),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3360223f-60')
Aug 17 12:14:17 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-3de5b7f8-89c1-4986-8a8e-786349fd05c2 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] No BDM found with device name vda, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 12:14:17 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-3de5b7f8-89c1-4986-8a8e-786349fd05c2 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] No VIF found with MAC fa:16:3e:79:15:ac, not building metadata {{(pid=73449) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 12:14:17 user nova-compute[73449]: DEBUG nova.network.neutron [req-c52578ff-ba5f-4870-9ed7-b9fcbba4bf7a req-1dd4a47a-598a-46fe-a197-afd57c1c23c5 service nova] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] Updated VIF entry in instance network info cache for port 3360223f-60df-4be9-ba80-3bb2baf444a2. {{(pid=73449) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 12:14:17 user nova-compute[73449]: DEBUG nova.network.neutron [req-c52578ff-ba5f-4870-9ed7-b9fcbba4bf7a req-1dd4a47a-598a-46fe-a197-afd57c1c23c5 service nova] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] Updating instance_info_cache with network_info: [{"id": "3360223f-60df-4be9-ba80-3bb2baf444a2", "address": "fa:16:3e:79:15:ac", "network": {"id": "eebeaab2-1a00-4da6-a475-c2eda7a17090", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1522507326-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "280c999654434edd8f5288786756f2ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3360223f-60", "ovs_interfaceid": "3360223f-60df-4be9-ba80-3bb2baf444a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 12:14:17 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-c52578ff-ba5f-4870-9ed7-b9fcbba4bf7a req-1dd4a47a-598a-46fe-a197-afd57c1c23c5 service nova] Releasing lock "refresh_cache-ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 12:14:17 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:14:17 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:14:18 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:14:18 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:14:18 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:14:18 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:14:18 user nova-compute[73449]: DEBUG nova.compute.manager [req-da251eae-f410-42e9-a5e4-ca4ced7479be req-d99f38bf-70d9-4a34-b1c4-36c97f4a3ee9 service nova] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] Received event network-vif-plugged-3360223f-60df-4be9-ba80-3bb2baf444a2 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:14:18 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-da251eae-f410-42e9-a5e4-ca4ced7479be req-d99f38bf-70d9-4a34-b1c4-36c97f4a3ee9 service nova] Acquiring lock "ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:14:18 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-da251eae-f410-42e9-a5e4-ca4ced7479be req-d99f38bf-70d9-4a34-b1c4-36c97f4a3ee9 service nova] Lock "ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:14:18 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-da251eae-f410-42e9-a5e4-ca4ced7479be req-d99f38bf-70d9-4a34-b1c4-36c97f4a3ee9 service nova] Lock "ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:14:18 user nova-compute[73449]: DEBUG nova.compute.manager [req-da251eae-f410-42e9-a5e4-ca4ced7479be req-d99f38bf-70d9-4a34-b1c4-36c97f4a3ee9 service nova] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] No waiting events found dispatching network-vif-plugged-3360223f-60df-4be9-ba80-3bb2baf444a2 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 12:14:18 user nova-compute[73449]: WARNING nova.compute.manager [req-da251eae-f410-42e9-a5e4-ca4ced7479be req-d99f38bf-70d9-4a34-b1c4-36c97f4a3ee9 service nova] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] Received unexpected event network-vif-plugged-3360223f-60df-4be9-ba80-3bb2baf444a2 for instance with vm_state building and task_state spawning.
Aug 17 12:14:19 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:14:19 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:14:19 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:14:19 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:14:19 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:14:19 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:14:20 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692274460.8827915, ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d => Resumed> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 12:14:20 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] VM Resumed (Lifecycle Event)
Aug 17 12:14:20 user nova-compute[73449]: DEBUG nova.compute.manager [None req-3de5b7f8-89c1-4986-8a8e-786349fd05c2 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] Instance event wait completed in 0 seconds for  {{(pid=73449) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 12:14:20 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-3de5b7f8-89c1-4986-8a8e-786349fd05c2 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] Guest created on hypervisor {{(pid=73449) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 12:14:20 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] Instance spawned successfully.
Aug 17 12:14:20 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-3de5b7f8-89c1-4986-8a8e-786349fd05c2 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 12:14:20 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 12:14:20 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-3de5b7f8-89c1-4986-8a8e-786349fd05c2 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] Found default for hw_cdrom_bus of ide {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 12:14:20 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-3de5b7f8-89c1-4986-8a8e-786349fd05c2 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] Found default for hw_disk_bus of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 12:14:20 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-3de5b7f8-89c1-4986-8a8e-786349fd05c2 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] Found default for hw_input_bus of None {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 12:14:20 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-3de5b7f8-89c1-4986-8a8e-786349fd05c2 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] Found default for hw_pointer_model of None {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 12:14:20 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-3de5b7f8-89c1-4986-8a8e-786349fd05c2 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] Found default for hw_video_model of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 12:14:20 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-3de5b7f8-89c1-4986-8a8e-786349fd05c2 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] Found default for hw_vif_model of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 12:14:20 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 12:14:20 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 12:14:20 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692274460.8941512, ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d => Started> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 12:14:20 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] VM Started (Lifecycle Event)
Aug 17 12:14:20 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 12:14:20 user nova-compute[73449]: DEBUG nova.compute.manager [req-0702d03e-6143-45f4-b90c-dd0f2e595df3 req-f1e7292a-ea02-4388-8e1f-227012d8992a service nova] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] Received event network-vif-plugged-3360223f-60df-4be9-ba80-3bb2baf444a2 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:14:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-0702d03e-6143-45f4-b90c-dd0f2e595df3 req-f1e7292a-ea02-4388-8e1f-227012d8992a service nova] Acquiring lock "ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:14:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-0702d03e-6143-45f4-b90c-dd0f2e595df3 req-f1e7292a-ea02-4388-8e1f-227012d8992a service nova] Lock "ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:14:20 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-0702d03e-6143-45f4-b90c-dd0f2e595df3 req-f1e7292a-ea02-4388-8e1f-227012d8992a service nova] Lock "ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:14:20 user nova-compute[73449]: DEBUG nova.compute.manager [req-0702d03e-6143-45f4-b90c-dd0f2e595df3 req-f1e7292a-ea02-4388-8e1f-227012d8992a service nova] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] No waiting events found dispatching network-vif-plugged-3360223f-60df-4be9-ba80-3bb2baf444a2 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 12:14:20 user nova-compute[73449]: WARNING nova.compute.manager [req-0702d03e-6143-45f4-b90c-dd0f2e595df3 req-f1e7292a-ea02-4388-8e1f-227012d8992a service nova] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] Received unexpected event network-vif-plugged-3360223f-60df-4be9-ba80-3bb2baf444a2 for instance with vm_state building and task_state spawning.
Aug 17 12:14:20 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 12:14:21 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 12:14:21 user nova-compute[73449]: INFO nova.compute.manager [None req-3de5b7f8-89c1-4986-8a8e-786349fd05c2 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] Took 6.45 seconds to spawn the instance on the hypervisor.
Aug 17 12:14:21 user nova-compute[73449]: DEBUG nova.compute.manager [None req-3de5b7f8-89c1-4986-8a8e-786349fd05c2 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 12:14:21 user nova-compute[73449]: INFO nova.compute.manager [None req-3de5b7f8-89c1-4986-8a8e-786349fd05c2 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] Took 7.10 seconds to build instance.
Aug 17 12:14:21 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-3de5b7f8-89c1-4986-8a8e-786349fd05c2 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Lock "ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.218s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:14:21 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:14:21 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:14:21 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:14:21 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:14:21 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=73449) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 12:14:22 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:14:22 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:14:22 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:14:22 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:14:22 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:14:22 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d482e2e-e73c-4c13-aead-dacefa7be735/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:14:22 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d482e2e-e73c-4c13-aead-dacefa7be735/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:14:22 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d482e2e-e73c-4c13-aead-dacefa7be735/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:14:22 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d482e2e-e73c-4c13-aead-dacefa7be735/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:14:23 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 12:14:23 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 12:14:23 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Hypervisor/Node resource view: name=user free_ram=8541MB free_disk=25.067455291748047GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73449) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 12:14:23 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:14:23 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:14:23 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 6d482e2e-e73c-4c13-aead-dacefa7be735 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 12:14:23 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 12:14:23 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73449) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 12:14:23 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73449) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 12:14:23 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 12:14:23 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 12:14:23 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Compute_service record updated for user:user {{(pid=73449) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 12:14:23 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.210s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:14:24 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:14:27 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:14:27 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:14:27 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Starting heal instance info cache {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 12:14:27 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Rebuilding the list of instances to heal {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 12:14:27 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "refresh_cache-6d482e2e-e73c-4c13-aead-dacefa7be735" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 12:14:27 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquired lock "refresh_cache-6d482e2e-e73c-4c13-aead-dacefa7be735" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 12:14:27 user nova-compute[73449]: DEBUG nova.network.neutron [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: 6d482e2e-e73c-4c13-aead-dacefa7be735] Forcefully refreshing network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 12:14:27 user nova-compute[73449]: DEBUG nova.objects.instance [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lazy-loading 'info_cache' on Instance uuid 6d482e2e-e73c-4c13-aead-dacefa7be735 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:14:27 user nova-compute[73449]: DEBUG nova.network.neutron [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: 6d482e2e-e73c-4c13-aead-dacefa7be735] Updating instance_info_cache with network_info: [{"id": "15176341-7f06-4c3a-9501-b2c7518f7119", "address": "fa:16:3e:e1:e1:cd", "network": {"id": "2ead35b7-4013-4fab-b35f-02f3237fcac1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1887618888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2a2f7faf23147fba5270c844eac051a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15176341-7f", "ovs_interfaceid": "15176341-7f06-4c3a-9501-b2c7518f7119", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 12:14:27 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Releasing lock "refresh_cache-6d482e2e-e73c-4c13-aead-dacefa7be735" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 12:14:27 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: 6d482e2e-e73c-4c13-aead-dacefa7be735] Updated the network info_cache for instance {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 12:14:27 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:14:29 user nova-compute[73449]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692274454.016976, 731e74ce-bc73-49e6-b74b-4d652952b8cf => Stopped> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 12:14:29 user nova-compute[73449]: INFO nova.compute.manager [-] [instance: 731e74ce-bc73-49e6-b74b-4d652952b8cf] VM Stopped (Lifecycle Event)
Aug 17 12:14:29 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:14:29 user nova-compute[73449]: DEBUG nova.compute.manager [None req-4428bb4a-9ea8-4ab4-97ba-9013ec75f4dd None None] [instance: 731e74ce-bc73-49e6-b74b-4d652952b8cf] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 12:14:32 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:14:34 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:14:37 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:14:39 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:14:42 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:14:44 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:14:47 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:14:49 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:14:52 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:14:57 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:14:57 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:14:57 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73449) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 12:14:57 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:14:57 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:14:57 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:15:02 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:15:03 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:15:07 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:15:11 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:15:12 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:15:15 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:15:16 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:15:16 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:15:16 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73449) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 12:15:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:15:17 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:15:18 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:15:22 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:15:22 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:15:22 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:15:22 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:15:22 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:15:22 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=73449) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 12:15:23 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:15:23 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:15:23 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:15:23 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:15:23 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d482e2e-e73c-4c13-aead-dacefa7be735/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:15:23 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d482e2e-e73c-4c13-aead-dacefa7be735/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:15:23 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d482e2e-e73c-4c13-aead-dacefa7be735/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:15:23 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d482e2e-e73c-4c13-aead-dacefa7be735/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:15:24 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 12:15:24 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 12:15:24 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Hypervisor/Node resource view: name=user free_ram=8563MB free_disk=25.036949157714844GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73449) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 12:15:24 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:15:24 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:15:24 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 6d482e2e-e73c-4c13-aead-dacefa7be735 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 12:15:24 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 12:15:24 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73449) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 12:15:24 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73449) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 12:15:24 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 12:15:24 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 12:15:24 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Compute_service record updated for user:user {{(pid=73449) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 12:15:24 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.205s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:15:27 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:15:28 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:15:28 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Starting heal instance info cache {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 12:15:28 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "refresh_cache-ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 12:15:28 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquired lock "refresh_cache-ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 12:15:28 user nova-compute[73449]: DEBUG nova.network.neutron [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] Forcefully refreshing network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 12:15:28 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:15:29 user nova-compute[73449]: DEBUG nova.network.neutron [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] Updating instance_info_cache with network_info: [{"id": "3360223f-60df-4be9-ba80-3bb2baf444a2", "address": "fa:16:3e:79:15:ac", "network": {"id": "eebeaab2-1a00-4da6-a475-c2eda7a17090", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1522507326-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "280c999654434edd8f5288786756f2ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3360223f-60", "ovs_interfaceid": "3360223f-60df-4be9-ba80-3bb2baf444a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 12:15:29 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Releasing lock "refresh_cache-ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 12:15:29 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] Updated the network info_cache for instance {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 12:15:29 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:15:32 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:15:37 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:15:41 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:15:41 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:15:41 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:15:41 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:15:41 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:15:41 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:15:41 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:15:41 user nova-compute[73449]: DEBUG nova.virt.libvirt.imagecache [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Verify base images {{(pid=73449) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Aug 17 12:15:41 user nova-compute[73449]: DEBUG nova.virt.libvirt.imagecache [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Image id 0a2904ae-083d-41c8-83db-343132b36148 yields fingerprint 7e267a577c062ee862e95ede6b48cfd5632f3ea3 {{(pid=73449) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 17 12:15:41 user nova-compute[73449]: INFO nova.virt.libvirt.imagecache [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] image 0a2904ae-083d-41c8-83db-343132b36148 at (/opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3): checking
Aug 17 12:15:41 user nova-compute[73449]: DEBUG nova.virt.libvirt.imagecache [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] image 0a2904ae-083d-41c8-83db-343132b36148 at (/opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3): image is in use {{(pid=73449) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Aug 17 12:15:42 user nova-compute[73449]: DEBUG nova.virt.libvirt.imagecache [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=73449) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 17 12:15:42 user nova-compute[73449]: DEBUG nova.virt.libvirt.imagecache [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] 6d482e2e-e73c-4c13-aead-dacefa7be735 is a valid instance name {{(pid=73449) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 17 12:15:42 user nova-compute[73449]: DEBUG nova.virt.libvirt.imagecache [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] 6d482e2e-e73c-4c13-aead-dacefa7be735 has a disk file {{(pid=73449) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Aug 17 12:15:42 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d482e2e-e73c-4c13-aead-dacefa7be735/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:15:42 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:15:42 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d482e2e-e73c-4c13-aead-dacefa7be735/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:15:42 user nova-compute[73449]: DEBUG nova.virt.libvirt.imagecache [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 6d482e2e-e73c-4c13-aead-dacefa7be735 is backed by 7e267a577c062ee862e95ede6b48cfd5632f3ea3 {{(pid=73449) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Aug 17 12:15:42 user nova-compute[73449]: DEBUG nova.virt.libvirt.imagecache [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d is a valid instance name {{(pid=73449) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 17 12:15:42 user nova-compute[73449]: DEBUG nova.virt.libvirt.imagecache [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d has a disk file {{(pid=73449) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Aug 17 12:15:42 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:15:42 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:15:42 user nova-compute[73449]: DEBUG nova.virt.libvirt.imagecache [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d is backed by 7e267a577c062ee862e95ede6b48cfd5632f3ea3 {{(pid=73449) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Aug 17 12:15:42 user nova-compute[73449]: WARNING nova.virt.libvirt.imagecache [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Unknown base file: /opt/stack/data/nova/instances/_base/aad674915ef11385b52ed3c606275cc7ae0cdb56
Aug 17 12:15:42 user nova-compute[73449]: WARNING nova.virt.libvirt.imagecache [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Unknown base file: /opt/stack/data/nova/instances/_base/2e7d42016eb851c6e49a3a917207d6a39f84a462
Aug 17 12:15:42 user nova-compute[73449]: WARNING nova.virt.libvirt.imagecache [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Unknown base file: /opt/stack/data/nova/instances/_base/19f98b3531fde7c04f881ec33a4c365c01dbb77b
Aug 17 12:15:42 user nova-compute[73449]: WARNING nova.virt.libvirt.imagecache [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Unknown base file: /opt/stack/data/nova/instances/_base/7f0d4cd7fcda04a8cdbc41e5c50fc25768ab8b56
Aug 17 12:15:42 user nova-compute[73449]: WARNING nova.virt.libvirt.imagecache [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Unknown base file: /opt/stack/data/nova/instances/_base/c58b584ce4403ce5407e40fcecaa060c5925dfc6
Aug 17 12:15:42 user nova-compute[73449]: WARNING nova.virt.libvirt.imagecache [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Unknown base file: /opt/stack/data/nova/instances/_base/666f7b25567510f45761a65277e1eb0e52001fde
Aug 17 12:15:42 user nova-compute[73449]: WARNING nova.virt.libvirt.imagecache [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Unknown base file: /opt/stack/data/nova/instances/_base/8745ad4a3db1ce3cd4c7565c7dd7f58f9138e816
Aug 17 12:15:42 user nova-compute[73449]: WARNING nova.virt.libvirt.imagecache [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Unknown base file: /opt/stack/data/nova/instances/_base/a294791ad67d1cbb4d0bc871d0c352e0a0990fb6
Aug 17 12:15:42 user nova-compute[73449]: WARNING nova.virt.libvirt.imagecache [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Unknown base file: /opt/stack/data/nova/instances/_base/ea0ffd0a56891dbaf2860691c9f6b70d163a4869
Aug 17 12:15:42 user nova-compute[73449]: INFO nova.virt.libvirt.imagecache [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Active base files: /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3
Aug 17 12:15:42 user nova-compute[73449]: INFO nova.virt.libvirt.imagecache [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Removable base files: /opt/stack/data/nova/instances/_base/aad674915ef11385b52ed3c606275cc7ae0cdb56 /opt/stack/data/nova/instances/_base/2e7d42016eb851c6e49a3a917207d6a39f84a462 /opt/stack/data/nova/instances/_base/19f98b3531fde7c04f881ec33a4c365c01dbb77b /opt/stack/data/nova/instances/_base/7f0d4cd7fcda04a8cdbc41e5c50fc25768ab8b56 /opt/stack/data/nova/instances/_base/c58b584ce4403ce5407e40fcecaa060c5925dfc6 /opt/stack/data/nova/instances/_base/666f7b25567510f45761a65277e1eb0e52001fde /opt/stack/data/nova/instances/_base/8745ad4a3db1ce3cd4c7565c7dd7f58f9138e816 /opt/stack/data/nova/instances/_base/a294791ad67d1cbb4d0bc871d0c352e0a0990fb6 /opt/stack/data/nova/instances/_base/ea0ffd0a56891dbaf2860691c9f6b70d163a4869
Aug 17 12:15:42 user nova-compute[73449]: INFO nova.virt.libvirt.imagecache [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/aad674915ef11385b52ed3c606275cc7ae0cdb56
Aug 17 12:15:42 user nova-compute[73449]: INFO nova.virt.libvirt.imagecache [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/2e7d42016eb851c6e49a3a917207d6a39f84a462
Aug 17 12:15:42 user nova-compute[73449]: INFO nova.virt.libvirt.imagecache [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/19f98b3531fde7c04f881ec33a4c365c01dbb77b
Aug 17 12:15:42 user nova-compute[73449]: INFO nova.virt.libvirt.imagecache [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/7f0d4cd7fcda04a8cdbc41e5c50fc25768ab8b56
Aug 17 12:15:42 user nova-compute[73449]: INFO nova.virt.libvirt.imagecache [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/c58b584ce4403ce5407e40fcecaa060c5925dfc6
Aug 17 12:15:42 user nova-compute[73449]: INFO nova.virt.libvirt.imagecache [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/666f7b25567510f45761a65277e1eb0e52001fde
Aug 17 12:15:42 user nova-compute[73449]: INFO nova.virt.libvirt.imagecache [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/8745ad4a3db1ce3cd4c7565c7dd7f58f9138e816
Aug 17 12:15:42 user nova-compute[73449]: INFO nova.virt.libvirt.imagecache [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/a294791ad67d1cbb4d0bc871d0c352e0a0990fb6
Aug 17 12:15:42 user nova-compute[73449]: INFO nova.virt.libvirt.imagecache [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/ea0ffd0a56891dbaf2860691c9f6b70d163a4869
Aug 17 12:15:42 user nova-compute[73449]: DEBUG nova.virt.libvirt.imagecache [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Verification complete {{(pid=73449) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Aug 17 12:15:42 user nova-compute[73449]: DEBUG nova.virt.libvirt.imagecache [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Verify swap images {{(pid=73449) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Aug 17 12:15:42 user nova-compute[73449]: DEBUG nova.virt.libvirt.imagecache [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Verify ephemeral images {{(pid=73449) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Aug 17 12:15:47 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:15:52 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:15:52 user nova-compute[73449]: DEBUG nova.compute.manager [req-425a6311-c1e6-45a7-978a-21f37dd064aa req-21a9859a-cb00-4c86-88b6-1a512cc2ae70 service nova] [instance: 6d482e2e-e73c-4c13-aead-dacefa7be735] Received event network-changed-15176341-7f06-4c3a-9501-b2c7518f7119 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:15:52 user nova-compute[73449]: DEBUG nova.compute.manager [req-425a6311-c1e6-45a7-978a-21f37dd064aa req-21a9859a-cb00-4c86-88b6-1a512cc2ae70 service nova] [instance: 6d482e2e-e73c-4c13-aead-dacefa7be735] Refreshing instance network info cache due to event network-changed-15176341-7f06-4c3a-9501-b2c7518f7119. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 12:15:52 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-425a6311-c1e6-45a7-978a-21f37dd064aa req-21a9859a-cb00-4c86-88b6-1a512cc2ae70 service nova] Acquiring lock "refresh_cache-6d482e2e-e73c-4c13-aead-dacefa7be735" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 12:15:52 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-425a6311-c1e6-45a7-978a-21f37dd064aa req-21a9859a-cb00-4c86-88b6-1a512cc2ae70 service nova] Acquired lock "refresh_cache-6d482e2e-e73c-4c13-aead-dacefa7be735" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 12:15:52 user nova-compute[73449]: DEBUG nova.network.neutron [req-425a6311-c1e6-45a7-978a-21f37dd064aa req-21a9859a-cb00-4c86-88b6-1a512cc2ae70 service nova] [instance: 6d482e2e-e73c-4c13-aead-dacefa7be735] Refreshing network info cache for port 15176341-7f06-4c3a-9501-b2c7518f7119 {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 12:15:53 user nova-compute[73449]: DEBUG nova.network.neutron [req-425a6311-c1e6-45a7-978a-21f37dd064aa req-21a9859a-cb00-4c86-88b6-1a512cc2ae70 service nova] [instance: 6d482e2e-e73c-4c13-aead-dacefa7be735] Updated VIF entry in instance network info cache for port 15176341-7f06-4c3a-9501-b2c7518f7119. {{(pid=73449) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 12:15:53 user nova-compute[73449]: DEBUG nova.network.neutron [req-425a6311-c1e6-45a7-978a-21f37dd064aa req-21a9859a-cb00-4c86-88b6-1a512cc2ae70 service nova] [instance: 6d482e2e-e73c-4c13-aead-dacefa7be735] Updating instance_info_cache with network_info: [{"id": "15176341-7f06-4c3a-9501-b2c7518f7119", "address": "fa:16:3e:e1:e1:cd", "network": {"id": "2ead35b7-4013-4fab-b35f-02f3237fcac1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1887618888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2a2f7faf23147fba5270c844eac051a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15176341-7f", "ovs_interfaceid": "15176341-7f06-4c3a-9501-b2c7518f7119", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 12:15:53 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-425a6311-c1e6-45a7-978a-21f37dd064aa req-21a9859a-cb00-4c86-88b6-1a512cc2ae70 service nova] Releasing lock "refresh_cache-6d482e2e-e73c-4c13-aead-dacefa7be735" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 12:15:54 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:15:57 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:15:57 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-ec9fa2fd-496f-4097-adb8-3292e3ed8928 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Acquiring lock "6d482e2e-e73c-4c13-aead-dacefa7be735" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:15:57 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-ec9fa2fd-496f-4097-adb8-3292e3ed8928 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Lock "6d482e2e-e73c-4c13-aead-dacefa7be735" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:15:57 user nova-compute[73449]: DEBUG nova.objects.instance [None req-ec9fa2fd-496f-4097-adb8-3292e3ed8928 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Lazy-loading 'flavor' on Instance uuid 6d482e2e-e73c-4c13-aead-dacefa7be735 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:15:57 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-ec9fa2fd-496f-4097-adb8-3292e3ed8928 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Lock "6d482e2e-e73c-4c13-aead-dacefa7be735" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:15:57 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-ec9fa2fd-496f-4097-adb8-3292e3ed8928 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Acquiring lock "6d482e2e-e73c-4c13-aead-dacefa7be735" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:15:57 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-ec9fa2fd-496f-4097-adb8-3292e3ed8928 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Lock "6d482e2e-e73c-4c13-aead-dacefa7be735" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:15:57 user nova-compute[73449]: INFO nova.compute.manager [None req-ec9fa2fd-496f-4097-adb8-3292e3ed8928 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] [instance: 6d482e2e-e73c-4c13-aead-dacefa7be735] Attaching volume 44f35ffd-ee22-472a-b309-0b477ff29fcf to /dev/vdb
Aug 17 12:15:57 user nova-compute[73449]: DEBUG os_brick.utils [None req-ec9fa2fd-496f-4097-adb8-3292e3ed8928 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 12:15:57 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:15:57 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:15:57 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[8368ad56-0940-4d1d-89d8-54b724f3bdf0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4d3924302012\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:15:57 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:15:57 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:15:57 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[010f5231-d03e-4e3a-97d4-0e2148c0f664]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:15:57 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:15:57 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:15:57 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c328bba-bfdc-413a-b33f-15e1bb7bd774]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:15:57 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e8e9bd4-9ac4-471b-81a7-c28977a04899]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:15:57 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-ec9fa2fd-496f-4097-adb8-3292e3ed8928 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Running cmd (subprocess): nvme version {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:15:57 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-ec9fa2fd-496f-4097-adb8-3292e3ed8928 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] 'nvme version' failed. Not Retrying. {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 12:15:57 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ec9fa2fd-496f-4097-adb8-3292e3ed8928 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] nvme not present on system {{(pid=73449) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 12:15:57 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:15:57 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 12:15:57 user nova-compute[73449]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 12:15:57 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[648426b3-a489-4bef-b9fa-0835f4bbcba3]: (4, '') {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:15:57 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-ec9fa2fd-496f-4097-adb8-3292e3ed8928 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73449) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 12:15:57 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-ec9fa2fd-496f-4097-adb8-3292e3ed8928 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73449) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 12:15:57 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-ec9fa2fd-496f-4097-adb8-3292e3ed8928 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] LIGHTOS: no hostnqn found. {{(pid=73449) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 12:15:57 user nova-compute[73449]: DEBUG os_brick.utils [None req-ec9fa2fd-496f-4097-adb8-3292e3ed8928 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4d3924302012', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 12:15:57 user nova-compute[73449]: DEBUG nova.virt.block_device [None req-ec9fa2fd-496f-4097-adb8-3292e3ed8928 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] [instance: 6d482e2e-e73c-4c13-aead-dacefa7be735] Updating existing volume attachment record: cec8bf16-b1e1-4c68-afa4-32b3f9682758 {{(pid=73449) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 12:15:59 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:16:02 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:16:04 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:16:05 user nova-compute[73449]: DEBUG nova.compute.manager [req-ed5d8c44-31b1-4969-8f1d-7e2aa5be6509 req-f0cd25cf-a5af-41bd-91b8-48cbebcd0820 service nova] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] Received event network-changed-3360223f-60df-4be9-ba80-3bb2baf444a2 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:16:05 user nova-compute[73449]: DEBUG nova.compute.manager [req-ed5d8c44-31b1-4969-8f1d-7e2aa5be6509 req-f0cd25cf-a5af-41bd-91b8-48cbebcd0820 service nova] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] Refreshing instance network info cache due to event network-changed-3360223f-60df-4be9-ba80-3bb2baf444a2. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 12:16:05 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-ed5d8c44-31b1-4969-8f1d-7e2aa5be6509 req-f0cd25cf-a5af-41bd-91b8-48cbebcd0820 service nova] Acquiring lock "refresh_cache-ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 12:16:05 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-ed5d8c44-31b1-4969-8f1d-7e2aa5be6509 req-f0cd25cf-a5af-41bd-91b8-48cbebcd0820 service nova] Acquired lock "refresh_cache-ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 12:16:05 user nova-compute[73449]: DEBUG nova.network.neutron [req-ed5d8c44-31b1-4969-8f1d-7e2aa5be6509 req-f0cd25cf-a5af-41bd-91b8-48cbebcd0820 service nova] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] Refreshing network info cache for port 3360223f-60df-4be9-ba80-3bb2baf444a2 {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 12:16:05 user nova-compute[73449]: DEBUG nova.network.neutron [req-ed5d8c44-31b1-4969-8f1d-7e2aa5be6509 req-f0cd25cf-a5af-41bd-91b8-48cbebcd0820 service nova] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] Updated VIF entry in instance network info cache for port 3360223f-60df-4be9-ba80-3bb2baf444a2. {{(pid=73449) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 12:16:05 user nova-compute[73449]: DEBUG nova.network.neutron [req-ed5d8c44-31b1-4969-8f1d-7e2aa5be6509 req-f0cd25cf-a5af-41bd-91b8-48cbebcd0820 service nova] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] Updating instance_info_cache with network_info: [{"id": "3360223f-60df-4be9-ba80-3bb2baf444a2", "address": "fa:16:3e:79:15:ac", "network": {"id": "eebeaab2-1a00-4da6-a475-c2eda7a17090", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1522507326-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "280c999654434edd8f5288786756f2ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3360223f-60", "ovs_interfaceid": "3360223f-60df-4be9-ba80-3bb2baf444a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 12:16:05 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-ed5d8c44-31b1-4969-8f1d-7e2aa5be6509 req-f0cd25cf-a5af-41bd-91b8-48cbebcd0820 service nova] Releasing lock "refresh_cache-ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 12:16:07 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:16:08 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec9fa2fd-496f-4097-adb8-3292e3ed8928 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] [instance: 6d482e2e-e73c-4c13-aead-dacefa7be735] Calling os-brick to attach iSCSI Volume {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 12:16:08 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec9fa2fd-496f-4097-adb8-3292e3ed8928 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:44f35ffd-ee22-472a-b309-0b477ff29fcf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hwvBgVNQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 12:16:08 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-ec9fa2fd-496f-4097-adb8-3292e3ed8928 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 12:16:08 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-ec9fa2fd-496f-4097-adb8-3292e3ed8928 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 12:16:08 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-ec9fa2fd-496f-4097-adb8-3292e3ed8928 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 12:16:08 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-ec9fa2fd-496f-4097-adb8-3292e3ed8928 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 12:16:08 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-ec9fa2fd-496f-4097-adb8-3292e3ed8928 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:44f35ffd-ee22-472a-b309-0b477ff29fcf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 12:16:08 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-ec9fa2fd-496f-4097-adb8-3292e3ed8928 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:44f35ffd-ee22-472a-b309-0b477ff29fcf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 12:16:08 user nova-compute[73449]: INFO os_brick.initiator.connectors.iscsi [None req-ec9fa2fd-496f-4097-adb8-3292e3ed8928 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 12:16:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44f35ffd-ee22-472a-b309-0b477ff29fcf -p 172.16.0.220:3260 {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:16:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44f35ffd-ee22-472a-b309-0b477ff29fcf -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:16:08 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[76838168-7b9b-45a2-9f12-345aad46966d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:16:08 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec9fa2fd-496f-4097-adb8-3292e3ed8928 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 12:16:08 user nova-compute[73449]:  {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:16:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44f35ffd-ee22-472a-b309-0b477ff29fcf -p 172.16.0.220:3260 --interface default --op new {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:16:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44f35ffd-ee22-472a-b309-0b477ff29fcf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:16:08 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1af4bf8-13e4-409d-af73-5ce83d04e0a3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:44f35ffd-ee22-472a-b309-0b477ff29fcf] added\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:16:08 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec9fa2fd-496f-4097-adb8-3292e3ed8928 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:44f35ffd-ee22-472a-b309-0b477ff29fcf] added
Aug 17 12:16:08 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:16:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44f35ffd-ee22-472a-b309-0b477ff29fcf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:16:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44f35ffd-ee22-472a-b309-0b477ff29fcf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:16:08 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8782983-d54c-459d-b1c4-d9353f55ec9d]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:16:08 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec9fa2fd-496f-4097-adb8-3292e3ed8928 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:16:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44f35ffd-ee22-472a-b309-0b477ff29fcf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:16:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44f35ffd-ee22-472a-b309-0b477ff29fcf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:16:08 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[796f4f67-1bc2-4df4-8db2-c5a38dde0804]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:16:08 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec9fa2fd-496f-4097-adb8-3292e3ed8928 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:16:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44f35ffd-ee22-472a-b309-0b477ff29fcf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hwvBgVNQ {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:16:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44f35ffd-ee22-472a-b309-0b477ff29fcf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hwvBgVNQ" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:16:08 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[630f5ea4-a23e-4de0-bb3c-8ea9d3e5b5d7]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:16:08 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec9fa2fd-496f-4097-adb8-3292e3ed8928 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hwvBgVNQ'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:16:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44f35ffd-ee22-472a-b309-0b477ff29fcf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:16:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44f35ffd-ee22-472a-b309-0b477ff29fcf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:16:08 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[82803fc2-0223-4687-a522-158b6701a07b]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:16:08 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec9fa2fd-496f-4097-adb8-3292e3ed8928 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:16:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:16:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:16:08 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[43f3641c-9399-41f3-8b9d-b068aef2e278]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:767a54f2-509d-45b1-be26-b285df9acb4f (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:16:08 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec9fa2fd-496f-4097-adb8-3292e3ed8928 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:767a54f2-509d-45b1-be26-b285df9acb4f (non-flash)
Aug 17 12:16:08 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 12:16:08 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec9fa2fd-496f-4097-adb8-3292e3ed8928 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:767a54f2-509d-45b1-be26-b285df9acb4f (non-flash)
Aug 17 12:16:08 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 12:16:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44f35ffd-ee22-472a-b309-0b477ff29fcf -p 172.16.0.220:3260 --login {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:16:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44f35ffd-ee22-472a-b309-0b477ff29fcf -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:16:08 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[9247a785-e770-4daf-b759-024dae734967]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:44f35ffd-ee22-472a-b309-0b477ff29fcf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:44f35ffd-ee22-472a-b309-0b477ff29fcf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:16:08 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec9fa2fd-496f-4097-adb8-3292e3ed8928 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:44f35ffd-ee22-472a-b309-0b477ff29fcf, portal: 172.16.0.220,3260]
Aug 17 12:16:08 user nova-compute[73449]: Login to [iface: default, target: iqn.2010-10.org.openstack:44f35ffd-ee22-472a-b309-0b477ff29fcf, portal: 172.16.0.220,3260] successful.
Aug 17 12:16:08 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:16:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44f35ffd-ee22-472a-b309-0b477ff29fcf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:16:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44f35ffd-ee22-472a-b309-0b477ff29fcf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:16:08 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4774e9c-acf1-45ee-abf4-714966ac8c14]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:16:08 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec9fa2fd-496f-4097-adb8-3292e3ed8928 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:16:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:16:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:16:08 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[077d4107-ab5d-4428-831a-0ff561fa459e]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:767a54f2-509d-45b1-be26-b285df9acb4f (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f35ffd-ee22-472a-b309-0b477ff29fcf (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:16:08 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec9fa2fd-496f-4097-adb8-3292e3ed8928 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:767a54f2-509d-45b1-be26-b285df9acb4f (non-flash)
Aug 17 12:16:08 user nova-compute[73449]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f35ffd-ee22-472a-b309-0b477ff29fcf (non-flash)
Aug 17 12:16:08 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 12:16:08 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec9fa2fd-496f-4097-adb8-3292e3ed8928 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:767a54f2-509d-45b1-be26-b285df9acb4f (non-flash)
Aug 17 12:16:08 user nova-compute[73449]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f35ffd-ee22-472a-b309-0b477ff29fcf (non-flash)
Aug 17 12:16:08 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 12:16:08 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-ec9fa2fd-496f-4097-adb8-3292e3ed8928 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:44f35ffd-ee22-472a-b309-0b477ff29fcf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 12:16:08 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec9fa2fd-496f-4097-adb8-3292e3ed8928 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Connected to 172.16.0.220:3260 {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 12:16:08 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-ec9fa2fd-496f-4097-adb8-3292e3ed8928 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] HCTL ('34', '-', '-', 0) found on session 58 with lun 0 {{(pid=73449) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 12:16:08 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-ec9fa2fd-496f-4097-adb8-3292e3ed8928 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73449) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 12:16:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:16:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:16:08 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[74ed729f-9b33-4913-9713-d6739fb903f0]: (4, ('- - 0', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:16:08 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-ec9fa2fd-496f-4097-adb8-3292e3ed8928 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Searching for a device in session 58 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73449) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 12:16:08 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec9fa2fd-496f-4097-adb8-3292e3ed8928 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hwvBgVNQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 12:16:09 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:16:09 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-ec9fa2fd-496f-4097-adb8-3292e3ed8928 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.297s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 12:16:09 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec9fa2fd-496f-4097-adb8-3292e3ed8928 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] <== connect_volume: return (1299ms) {'type': 'block', 'scsi_wwn': '23330613434373132', 'path': '/dev/sdc'} {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 12:16:09 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec9fa2fd-496f-4097-adb8-3292e3ed8928 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] [instance: 6d482e2e-e73c-4c13-aead-dacefa7be735] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23330613434373132', 'path': '/dev/sdc'} {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 12:16:09 user nova-compute[73449]: DEBUG nova.objects.instance [None req-ec9fa2fd-496f-4097-adb8-3292e3ed8928 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Lazy-loading 'flavor' on Instance uuid 6d482e2e-e73c-4c13-aead-dacefa7be735 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:16:09 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-ec9fa2fd-496f-4097-adb8-3292e3ed8928 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 12:16:09 user nova-compute[73449]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 12:16:09 user nova-compute[73449]:   <source dev="/dev/sdc"/>
Aug 17 12:16:09 user nova-compute[73449]:   <target dev="vdb" bus="virtio"/>
Aug 17 12:16:09 user nova-compute[73449]:   <serial>44f35ffd-ee22-472a-b309-0b477ff29fcf</serial>
Aug 17 12:16:09 user nova-compute[73449]: </disk>
Aug 17 12:16:09 user nova-compute[73449]:  {{(pid=73449) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 12:16:09 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-ec9fa2fd-496f-4097-adb8-3292e3ed8928 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] No BDM found with device name vda, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 12:16:09 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-ec9fa2fd-496f-4097-adb8-3292e3ed8928 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 12:16:09 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-ec9fa2fd-496f-4097-adb8-3292e3ed8928 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] No VIF found with MAC fa:16:3e:e1:e1:cd, not building metadata {{(pid=73449) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 12:16:10 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-e0463be6-151f-49fc-bba6-a4c36fded445 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Acquiring lock "ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:16:10 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-e0463be6-151f-49fc-bba6-a4c36fded445 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Lock "ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:16:10 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-ec9fa2fd-496f-4097-adb8-3292e3ed8928 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Lock "6d482e2e-e73c-4c13-aead-dacefa7be735" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.526s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:16:10 user nova-compute[73449]: DEBUG nova.objects.instance [None req-e0463be6-151f-49fc-bba6-a4c36fded445 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Lazy-loading 'flavor' on Instance uuid ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:16:10 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-e0463be6-151f-49fc-bba6-a4c36fded445 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Lock "ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:16:10 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-e0463be6-151f-49fc-bba6-a4c36fded445 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Acquiring lock "ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:16:10 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-e0463be6-151f-49fc-bba6-a4c36fded445 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Lock "ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:16:10 user nova-compute[73449]: INFO nova.compute.manager [None req-e0463be6-151f-49fc-bba6-a4c36fded445 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] Attaching volume 5b06e821-f631-4206-87a5-59bb900062bd to /dev/vdb
Aug 17 12:16:10 user nova-compute[73449]: DEBUG os_brick.utils [None req-e0463be6-151f-49fc-bba6-a4c36fded445 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 12:16:10 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:16:10 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:16:10 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[255d5804-61ea-4e34-943c-cbc19c79d26e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4d3924302012\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:16:10 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:16:10 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:16:10 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ebbc7d7-0c3a-4f8a-bcf4-6df9542479b2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:16:10 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:16:10 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:16:10 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cac91e3-8458-45d9-a1f9-208fe159cfbd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:16:10 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[d72d2f5d-3bfd-4c8f-84b4-5147a74d2055]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:16:10 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-e0463be6-151f-49fc-bba6-a4c36fded445 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Running cmd (subprocess): nvme version {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:16:10 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-e0463be6-151f-49fc-bba6-a4c36fded445 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] 'nvme version' failed. Not Retrying. {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 12:16:10 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e0463be6-151f-49fc-bba6-a4c36fded445 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] nvme not present on system {{(pid=73449) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 12:16:10 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:16:10 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 12:16:10 user nova-compute[73449]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 12:16:10 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[958955d7-4f9f-4a01-a221-af6baad15f16]: (4, '') {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:16:10 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-e0463be6-151f-49fc-bba6-a4c36fded445 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73449) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 12:16:10 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-e0463be6-151f-49fc-bba6-a4c36fded445 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73449) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 12:16:10 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-e0463be6-151f-49fc-bba6-a4c36fded445 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] LIGHTOS: no hostnqn found. {{(pid=73449) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 12:16:10 user nova-compute[73449]: DEBUG os_brick.utils [None req-e0463be6-151f-49fc-bba6-a4c36fded445 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4d3924302012', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 12:16:10 user nova-compute[73449]: DEBUG nova.virt.block_device [None req-e0463be6-151f-49fc-bba6-a4c36fded445 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] Updating existing volume attachment record: 0c6d8f9d-f972-4e97-94af-649dbcf2ac0f {{(pid=73449) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 12:16:12 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:16:14 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:16:14 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:16:16 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:16:16 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:16:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:16:17 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-84f61795-2ea2-48fa-a243-7b5ae314770e tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Acquiring lock "6d482e2e-e73c-4c13-aead-dacefa7be735" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:16:17 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-84f61795-2ea2-48fa-a243-7b5ae314770e tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Lock "6d482e2e-e73c-4c13-aead-dacefa7be735" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:16:17 user nova-compute[73449]: DEBUG nova.objects.instance [None req-84f61795-2ea2-48fa-a243-7b5ae314770e tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Lazy-loading 'flavor' on Instance uuid 6d482e2e-e73c-4c13-aead-dacefa7be735 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:16:17 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-84f61795-2ea2-48fa-a243-7b5ae314770e tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Lock "6d482e2e-e73c-4c13-aead-dacefa7be735" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.069s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:16:17 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-84f61795-2ea2-48fa-a243-7b5ae314770e tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Acquiring lock "6d482e2e-e73c-4c13-aead-dacefa7be735" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:16:17 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-84f61795-2ea2-48fa-a243-7b5ae314770e tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Lock "6d482e2e-e73c-4c13-aead-dacefa7be735" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:16:17 user nova-compute[73449]: INFO nova.compute.manager [None req-84f61795-2ea2-48fa-a243-7b5ae314770e tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] [instance: 6d482e2e-e73c-4c13-aead-dacefa7be735] Attaching volume 4c6cba26-a28d-4c89-82a6-6135d36a1c2a to /dev/vdc
Aug 17 12:16:17 user nova-compute[73449]: DEBUG os_brick.utils [None req-84f61795-2ea2-48fa-a243-7b5ae314770e tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 12:16:17 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:16:17 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:16:17 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d5d51cd-866f-4e27-885a-b73afcdda907]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4d3924302012\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:16:17 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:16:17 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:16:17 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[f366db24-c004-4326-9bcd-40f2ec89efb5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:16:17 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:16:17 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:16:17 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9ea8adf-a941-4267-bbb1-188f31ef3e74]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:16:17 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[578ff514-4115-4b84-b2f4-1059668b053f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:16:17 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-84f61795-2ea2-48fa-a243-7b5ae314770e tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Running cmd (subprocess): nvme version {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:16:17 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-84f61795-2ea2-48fa-a243-7b5ae314770e tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] 'nvme version' failed. Not Retrying. {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 12:16:17 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.nvmeof [None req-84f61795-2ea2-48fa-a243-7b5ae314770e tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] nvme not present on system {{(pid=73449) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 12:16:17 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:16:17 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 12:16:17 user nova-compute[73449]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 12:16:17 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6683108-a2f0-4dc4-97c9-ef5cf0dba64c]: (4, '') {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:16:17 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-84f61795-2ea2-48fa-a243-7b5ae314770e tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73449) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 12:16:17 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-84f61795-2ea2-48fa-a243-7b5ae314770e tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73449) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 12:16:17 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-84f61795-2ea2-48fa-a243-7b5ae314770e tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] LIGHTOS: no hostnqn found. {{(pid=73449) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 12:16:17 user nova-compute[73449]: DEBUG os_brick.utils [None req-84f61795-2ea2-48fa-a243-7b5ae314770e tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4d3924302012', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 12:16:17 user nova-compute[73449]: DEBUG nova.virt.block_device [None req-84f61795-2ea2-48fa-a243-7b5ae314770e tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] [instance: 6d482e2e-e73c-4c13-aead-dacefa7be735] Updating existing volume attachment record: 8b002c99-b8be-413a-a752-f3a8002ddc97 {{(pid=73449) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 12:16:17 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:16:18 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:16:18 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73449) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 12:16:20 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:16:21 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:16:22 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:16:22 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:16:22 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Cleaning up deleted instances {{(pid=73449) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 17 12:16:22 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] There are 0 instances to clean {{(pid=73449) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 17 12:16:24 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:16:24 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:16:24 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:16:24 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:16:24 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:16:25 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=73449) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 12:16:25 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0463be6-151f-49fc-bba6-a4c36fded445 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] Calling os-brick to attach iSCSI Volume {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 12:16:25 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0463be6-151f-49fc-bba6-a4c36fded445 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5b06e821-f631-4206-87a5-59bb900062bd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kueixFlm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 12:16:25 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-e0463be6-151f-49fc-bba6-a4c36fded445 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 12:16:25 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-e0463be6-151f-49fc-bba6-a4c36fded445 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 12:16:25 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-e0463be6-151f-49fc-bba6-a4c36fded445 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 12:16:25 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-e0463be6-151f-49fc-bba6-a4c36fded445 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 12:16:25 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-e0463be6-151f-49fc-bba6-a4c36fded445 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b06e821-f631-4206-87a5-59bb900062bd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 12:16:25 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-e0463be6-151f-49fc-bba6-a4c36fded445 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b06e821-f631-4206-87a5-59bb900062bd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 12:16:25 user nova-compute[73449]: INFO os_brick.initiator.connectors.iscsi [None req-e0463be6-151f-49fc-bba6-a4c36fded445 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 12:16:25 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b06e821-f631-4206-87a5-59bb900062bd -p 172.16.0.220:3260 {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:16:25 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b06e821-f631-4206-87a5-59bb900062bd -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:16:25 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[226e2f97-ffa9-437e-8b43-eebc0c032106]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:16:25 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0463be6-151f-49fc-bba6-a4c36fded445 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 12:16:25 user nova-compute[73449]:  {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:16:25 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b06e821-f631-4206-87a5-59bb900062bd -p 172.16.0.220:3260 --interface default --op new {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:16:25 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b06e821-f631-4206-87a5-59bb900062bd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:16:25 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1a5c24f-0a3d-4925-8ad0-b321b6a0d00b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5b06e821-f631-4206-87a5-59bb900062bd] added\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:16:25 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0463be6-151f-49fc-bba6-a4c36fded445 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5b06e821-f631-4206-87a5-59bb900062bd] added
Aug 17 12:16:25 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:16:25 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b06e821-f631-4206-87a5-59bb900062bd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:16:25 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b06e821-f631-4206-87a5-59bb900062bd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:16:25 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc6045f2-fcdc-4261-b030-f41824de430c]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:16:25 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0463be6-151f-49fc-bba6-a4c36fded445 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:16:25 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b06e821-f631-4206-87a5-59bb900062bd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:16:25 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:16:25 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b06e821-f631-4206-87a5-59bb900062bd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.036s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:16:25 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f6053d1-3dd5-4038-a481-a13dd5757503]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:16:25 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0463be6-151f-49fc-bba6-a4c36fded445 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:16:25 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b06e821-f631-4206-87a5-59bb900062bd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kueixFlm {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:16:25 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b06e821-f631-4206-87a5-59bb900062bd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kueixFlm" returned: 0 in 0.025s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:16:25 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[879b4c0b-3cb2-46e9-a21c-bae4b352a0c0]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:16:25 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0463be6-151f-49fc-bba6-a4c36fded445 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kueixFlm'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:16:25 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b06e821-f631-4206-87a5-59bb900062bd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:16:25 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b06e821-f631-4206-87a5-59bb900062bd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:16:25 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae8bc151-a414-4a65-92c5-ebe7ff578bcb]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:16:25 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0463be6-151f-49fc-bba6-a4c36fded445 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:16:25 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:16:25 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:16:25 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[f596be65-b02c-4186-96ef-3a661b846b27]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f35ffd-ee22-472a-b309-0b477ff29fcf (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:16:25 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0463be6-151f-49fc-bba6-a4c36fded445 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f35ffd-ee22-472a-b309-0b477ff29fcf (non-flash)
Aug 17 12:16:25 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 12:16:25 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0463be6-151f-49fc-bba6-a4c36fded445 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f35ffd-ee22-472a-b309-0b477ff29fcf (non-flash)
Aug 17 12:16:25 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 12:16:25 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b06e821-f631-4206-87a5-59bb900062bd -p 172.16.0.220:3260 --login {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:16:25 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b06e821-f631-4206-87a5-59bb900062bd -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:16:25 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[409ced0c-4f67-4e96-b7a1-007f20d0d251]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5b06e821-f631-4206-87a5-59bb900062bd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5b06e821-f631-4206-87a5-59bb900062bd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:16:25 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0463be6-151f-49fc-bba6-a4c36fded445 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5b06e821-f631-4206-87a5-59bb900062bd, portal: 172.16.0.220,3260]
Aug 17 12:16:25 user nova-compute[73449]: Login to [iface: default, target: iqn.2010-10.org.openstack:5b06e821-f631-4206-87a5-59bb900062bd, portal: 172.16.0.220,3260] successful.
Aug 17 12:16:25 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:16:25 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b06e821-f631-4206-87a5-59bb900062bd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:16:25 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b06e821-f631-4206-87a5-59bb900062bd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:16:25 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[40f2e9d3-8bf2-4732-b94b-5e6cb22b7ebb]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:16:25 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0463be6-151f-49fc-bba6-a4c36fded445 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:16:25 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:16:25 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:16:25 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:16:25 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:16:25 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[05388193-eb48-4cf4-894d-e0f49e12a001]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f35ffd-ee22-472a-b309-0b477ff29fcf (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b06e821-f631-4206-87a5-59bb900062bd (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:16:25 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0463be6-151f-49fc-bba6-a4c36fded445 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f35ffd-ee22-472a-b309-0b477ff29fcf (non-flash)
Aug 17 12:16:25 user nova-compute[73449]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b06e821-f631-4206-87a5-59bb900062bd (non-flash)
Aug 17 12:16:25 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 12:16:25 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0463be6-151f-49fc-bba6-a4c36fded445 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f35ffd-ee22-472a-b309-0b477ff29fcf (non-flash)
Aug 17 12:16:25 user nova-compute[73449]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b06e821-f631-4206-87a5-59bb900062bd (non-flash)
Aug 17 12:16:25 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 12:16:25 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-e0463be6-151f-49fc-bba6-a4c36fded445 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b06e821-f631-4206-87a5-59bb900062bd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.327s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 12:16:25 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0463be6-151f-49fc-bba6-a4c36fded445 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Connected to 172.16.0.220:3260 {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 12:16:25 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-e0463be6-151f-49fc-bba6-a4c36fded445 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] HCTL ('33', '-', '-', 0) found on session 59 with lun 0 {{(pid=73449) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 12:16:25 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-e0463be6-151f-49fc-bba6-a4c36fded445 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73449) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 12:16:25 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:16:25 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:16:25 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[13b44348-02d4-4faf-a45f-083e02c27670]: (4, ('- - 0', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:16:25 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-e0463be6-151f-49fc-bba6-a4c36fded445 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73449) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 12:16:25 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0463be6-151f-49fc-bba6-a4c36fded445 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kueixFlm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 12:16:25 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:16:25 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d482e2e-e73c-4c13-aead-dacefa7be735/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:16:25 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d482e2e-e73c-4c13-aead-dacefa7be735/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:16:25 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d482e2e-e73c-4c13-aead-dacefa7be735/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:16:25 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d482e2e-e73c-4c13-aead-dacefa7be735/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:16:25 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73449) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 12:16:26 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 12:16:26 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 12:16:26 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Hypervisor/Node resource view: name=user free_ram=8571MB free_disk=25.026016235351562GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73449) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 12:16:26 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:16:26 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:16:26 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance 6d482e2e-e73c-4c13-aead-dacefa7be735 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 12:16:26 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 12:16:26 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73449) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 12:16:26 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73449) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 12:16:26 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-e0463be6-151f-49fc-bba6-a4c36fded445 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.363s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 12:16:26 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0463be6-151f-49fc-bba6-a4c36fded445 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] <== connect_volume: return (1366ms) {'type': 'block', 'scsi_wwn': '23837333866646236', 'path': '/dev/sdb'} {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 12:16:26 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0463be6-151f-49fc-bba6-a4c36fded445 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23837333866646236', 'path': '/dev/sdb'} {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 12:16:26 user nova-compute[73449]: DEBUG nova.objects.instance [None req-e0463be6-151f-49fc-bba6-a4c36fded445 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Lazy-loading 'flavor' on Instance uuid ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:16:26 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-e0463be6-151f-49fc-bba6-a4c36fded445 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 12:16:26 user nova-compute[73449]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 12:16:26 user nova-compute[73449]:   <source dev="/dev/sdb"/>
Aug 17 12:16:26 user nova-compute[73449]:   <target dev="vdb" bus="virtio"/>
Aug 17 12:16:26 user nova-compute[73449]:   <serial>5b06e821-f631-4206-87a5-59bb900062bd</serial>
Aug 17 12:16:26 user nova-compute[73449]: </disk>
Aug 17 12:16:26 user nova-compute[73449]:  {{(pid=73449) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 12:16:26 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 12:16:26 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 12:16:26 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Compute_service record updated for user:user {{(pid=73449) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 12:16:26 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.194s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:16:26 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-e0463be6-151f-49fc-bba6-a4c36fded445 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] No BDM found with device name vda, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 12:16:26 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-e0463be6-151f-49fc-bba6-a4c36fded445 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 12:16:26 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-e0463be6-151f-49fc-bba6-a4c36fded445 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] No VIF found with MAC fa:16:3e:79:15:ac, not building metadata {{(pid=73449) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 12:16:26 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-e0463be6-151f-49fc-bba6-a4c36fded445 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Lock "ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.524s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:16:27 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:16:29 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:16:29 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-84f61795-2ea2-48fa-a243-7b5ae314770e tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] [instance: 6d482e2e-e73c-4c13-aead-dacefa7be735] Calling os-brick to attach iSCSI Volume {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 12:16:29 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f61795-2ea2-48fa-a243-7b5ae314770e tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4c6cba26-a28d-4c89-82a6-6135d36a1c2a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xXyEQThW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 12:16:29 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-84f61795-2ea2-48fa-a243-7b5ae314770e tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 12:16:29 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-84f61795-2ea2-48fa-a243-7b5ae314770e tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 12:16:29 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-84f61795-2ea2-48fa-a243-7b5ae314770e tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 12:16:29 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-84f61795-2ea2-48fa-a243-7b5ae314770e tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 12:16:29 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-84f61795-2ea2-48fa-a243-7b5ae314770e tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4c6cba26-a28d-4c89-82a6-6135d36a1c2a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 12:16:29 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-84f61795-2ea2-48fa-a243-7b5ae314770e tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4c6cba26-a28d-4c89-82a6-6135d36a1c2a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 12:16:29 user nova-compute[73449]: INFO os_brick.initiator.connectors.iscsi [None req-84f61795-2ea2-48fa-a243-7b5ae314770e tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 12:16:29 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c6cba26-a28d-4c89-82a6-6135d36a1c2a -p 172.16.0.220:3260 {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:16:29 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c6cba26-a28d-4c89-82a6-6135d36a1c2a -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:16:29 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[71b53a5e-8844-475d-bc4e-2c9122ad7ff7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:16:29 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f61795-2ea2-48fa-a243-7b5ae314770e tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 12:16:29 user nova-compute[73449]:  {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:16:29 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c6cba26-a28d-4c89-82a6-6135d36a1c2a -p 172.16.0.220:3260 --interface default --op new {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:16:29 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c6cba26-a28d-4c89-82a6-6135d36a1c2a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:16:29 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fcbbf05-c0a9-4ad4-8685-f8be713f1b95]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4c6cba26-a28d-4c89-82a6-6135d36a1c2a] added\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:16:29 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f61795-2ea2-48fa-a243-7b5ae314770e tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4c6cba26-a28d-4c89-82a6-6135d36a1c2a] added
Aug 17 12:16:29 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:16:29 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c6cba26-a28d-4c89-82a6-6135d36a1c2a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:16:29 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c6cba26-a28d-4c89-82a6-6135d36a1c2a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:16:29 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3ed7616-a346-4341-bdbe-c4d6f44843d5]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:16:29 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f61795-2ea2-48fa-a243-7b5ae314770e tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:16:29 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c6cba26-a28d-4c89-82a6-6135d36a1c2a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:16:29 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c6cba26-a28d-4c89-82a6-6135d36a1c2a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.059s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:16:29 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea75f115-590b-4c67-8660-39b6c4990df9]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:16:29 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f61795-2ea2-48fa-a243-7b5ae314770e tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:16:29 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c6cba26-a28d-4c89-82a6-6135d36a1c2a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xXyEQThW {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:16:29 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c6cba26-a28d-4c89-82a6-6135d36a1c2a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xXyEQThW" returned: 0 in 0.023s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:16:29 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[91b7d456-8e25-4f7e-8d6a-1ccc05f4a9ff]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:16:29 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f61795-2ea2-48fa-a243-7b5ae314770e tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xXyEQThW'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:16:29 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c6cba26-a28d-4c89-82a6-6135d36a1c2a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:16:29 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c6cba26-a28d-4c89-82a6-6135d36a1c2a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:16:29 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef6fd988-625f-4a4b-af1d-c163390b33f6]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:16:29 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f61795-2ea2-48fa-a243-7b5ae314770e tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:16:29 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:16:29 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:16:29 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[0521cf1c-4867-4cd0-93ba-c6c7ca5468f5]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f35ffd-ee22-472a-b309-0b477ff29fcf (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b06e821-f631-4206-87a5-59bb900062bd (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:16:29 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f61795-2ea2-48fa-a243-7b5ae314770e tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f35ffd-ee22-472a-b309-0b477ff29fcf (non-flash)
Aug 17 12:16:29 user nova-compute[73449]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b06e821-f631-4206-87a5-59bb900062bd (non-flash)
Aug 17 12:16:29 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 12:16:29 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f61795-2ea2-48fa-a243-7b5ae314770e tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f35ffd-ee22-472a-b309-0b477ff29fcf (non-flash)
Aug 17 12:16:29 user nova-compute[73449]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b06e821-f631-4206-87a5-59bb900062bd (non-flash)
Aug 17 12:16:29 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 12:16:29 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c6cba26-a28d-4c89-82a6-6135d36a1c2a -p 172.16.0.220:3260 --login {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:16:29 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c6cba26-a28d-4c89-82a6-6135d36a1c2a -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:16:29 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[224f2a72-1e72-40ac-8968-de19d523490f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4c6cba26-a28d-4c89-82a6-6135d36a1c2a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4c6cba26-a28d-4c89-82a6-6135d36a1c2a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:16:29 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f61795-2ea2-48fa-a243-7b5ae314770e tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4c6cba26-a28d-4c89-82a6-6135d36a1c2a, portal: 172.16.0.220,3260]
Aug 17 12:16:29 user nova-compute[73449]: Login to [iface: default, target: iqn.2010-10.org.openstack:4c6cba26-a28d-4c89-82a6-6135d36a1c2a, portal: 172.16.0.220,3260] successful.
Aug 17 12:16:29 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:16:29 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c6cba26-a28d-4c89-82a6-6135d36a1c2a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:16:29 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c6cba26-a28d-4c89-82a6-6135d36a1c2a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:16:29 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb39da6e-ef75-4be2-96aa-02e4b8ebb909]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:16:29 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f61795-2ea2-48fa-a243-7b5ae314770e tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:16:29 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:16:29 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:16:29 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[7af17a6c-1c50-4873-ab61-b5d827067e35]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f35ffd-ee22-472a-b309-0b477ff29fcf (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b06e821-f631-4206-87a5-59bb900062bd (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c6cba26-a28d-4c89-82a6-6135d36a1c2a (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:16:29 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f61795-2ea2-48fa-a243-7b5ae314770e tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f35ffd-ee22-472a-b309-0b477ff29fcf (non-flash)
Aug 17 12:16:29 user nova-compute[73449]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b06e821-f631-4206-87a5-59bb900062bd (non-flash)
Aug 17 12:16:29 user nova-compute[73449]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c6cba26-a28d-4c89-82a6-6135d36a1c2a (non-flash)
Aug 17 12:16:29 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 12:16:29 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f61795-2ea2-48fa-a243-7b5ae314770e tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f35ffd-ee22-472a-b309-0b477ff29fcf (non-flash)
Aug 17 12:16:29 user nova-compute[73449]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b06e821-f631-4206-87a5-59bb900062bd (non-flash)
Aug 17 12:16:29 user nova-compute[73449]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c6cba26-a28d-4c89-82a6-6135d36a1c2a (non-flash)
Aug 17 12:16:29 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 12:16:29 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-84f61795-2ea2-48fa-a243-7b5ae314770e tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4c6cba26-a28d-4c89-82a6-6135d36a1c2a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 12:16:29 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f61795-2ea2-48fa-a243-7b5ae314770e tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Connected to 172.16.0.220:3260 {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 12:16:29 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-84f61795-2ea2-48fa-a243-7b5ae314770e tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] HCTL ('35', '-', '-', 0) found on session 60 with lun 0 {{(pid=73449) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 12:16:29 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-84f61795-2ea2-48fa-a243-7b5ae314770e tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73449) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 12:16:29 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:16:29 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:16:29 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[098f71b6-a24a-47e1-9f75-9e27967d633c]: (4, ('- - 0', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:16:29 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-84f61795-2ea2-48fa-a243-7b5ae314770e tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Searching for a device in session 60 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73449) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 12:16:29 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f61795-2ea2-48fa-a243-7b5ae314770e tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xXyEQThW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 12:16:29 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:16:29 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Starting heal instance info cache {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 12:16:29 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Rebuilding the list of instances to heal {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 12:16:29 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "refresh_cache-6d482e2e-e73c-4c13-aead-dacefa7be735" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 12:16:29 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquired lock "refresh_cache-6d482e2e-e73c-4c13-aead-dacefa7be735" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 12:16:29 user nova-compute[73449]: DEBUG nova.network.neutron [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: 6d482e2e-e73c-4c13-aead-dacefa7be735] Forcefully refreshing network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 12:16:29 user nova-compute[73449]: DEBUG nova.objects.instance [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lazy-loading 'info_cache' on Instance uuid 6d482e2e-e73c-4c13-aead-dacefa7be735 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:16:30 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-84f61795-2ea2-48fa-a243-7b5ae314770e tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.352s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 12:16:30 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f61795-2ea2-48fa-a243-7b5ae314770e tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] <== connect_volume: return (1354ms) {'type': 'block', 'scsi_wwn': '23738343736393433', 'path': '/dev/sdd'} {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 12:16:30 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-84f61795-2ea2-48fa-a243-7b5ae314770e tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] [instance: 6d482e2e-e73c-4c13-aead-dacefa7be735] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23738343736393433', 'path': '/dev/sdd'} {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 12:16:30 user nova-compute[73449]: DEBUG nova.objects.instance [None req-84f61795-2ea2-48fa-a243-7b5ae314770e tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Lazy-loading 'flavor' on Instance uuid 6d482e2e-e73c-4c13-aead-dacefa7be735 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:16:30 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-84f61795-2ea2-48fa-a243-7b5ae314770e tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 12:16:30 user nova-compute[73449]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 12:16:30 user nova-compute[73449]:   <source dev="/dev/sdd"/>
Aug 17 12:16:30 user nova-compute[73449]:   <target dev="vdc" bus="virtio"/>
Aug 17 12:16:30 user nova-compute[73449]:   <serial>4c6cba26-a28d-4c89-82a6-6135d36a1c2a</serial>
Aug 17 12:16:30 user nova-compute[73449]: </disk>
Aug 17 12:16:30 user nova-compute[73449]:  {{(pid=73449) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 12:16:30 user nova-compute[73449]: DEBUG nova.network.neutron [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: 6d482e2e-e73c-4c13-aead-dacefa7be735] Updating instance_info_cache with network_info: [{"id": "15176341-7f06-4c3a-9501-b2c7518f7119", "address": "fa:16:3e:e1:e1:cd", "network": {"id": "2ead35b7-4013-4fab-b35f-02f3237fcac1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1887618888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2a2f7faf23147fba5270c844eac051a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15176341-7f", "ovs_interfaceid": "15176341-7f06-4c3a-9501-b2c7518f7119", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 12:16:30 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Releasing lock "refresh_cache-6d482e2e-e73c-4c13-aead-dacefa7be735" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 12:16:30 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: 6d482e2e-e73c-4c13-aead-dacefa7be735] Updated the network info_cache for instance {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 12:16:30 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:16:30 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-84f61795-2ea2-48fa-a243-7b5ae314770e tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] No BDM found with device name vda, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 12:16:30 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-84f61795-2ea2-48fa-a243-7b5ae314770e tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 12:16:30 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-84f61795-2ea2-48fa-a243-7b5ae314770e tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 12:16:30 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-84f61795-2ea2-48fa-a243-7b5ae314770e tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] No VIF found with MAC fa:16:3e:e1:e1:cd, not building metadata {{(pid=73449) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 12:16:31 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-84f61795-2ea2-48fa-a243-7b5ae314770e tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Lock "6d482e2e-e73c-4c13-aead-dacefa7be735" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.555s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:16:31 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-fa71cead-199b-4a39-90bd-7369ec1185b7 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Acquiring lock "6d482e2e-e73c-4c13-aead-dacefa7be735" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:16:31 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-fa71cead-199b-4a39-90bd-7369ec1185b7 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Lock "6d482e2e-e73c-4c13-aead-dacefa7be735" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:16:31 user nova-compute[73449]: INFO nova.compute.manager [None req-fa71cead-199b-4a39-90bd-7369ec1185b7 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] [instance: 6d482e2e-e73c-4c13-aead-dacefa7be735] Detaching volume 44f35ffd-ee22-472a-b309-0b477ff29fcf
Aug 17 12:16:32 user nova-compute[73449]: INFO nova.virt.block_device [None req-fa71cead-199b-4a39-90bd-7369ec1185b7 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] [instance: 6d482e2e-e73c-4c13-aead-dacefa7be735] Attempting to driver detach volume 44f35ffd-ee22-472a-b309-0b477ff29fcf from mountpoint /dev/vdb
Aug 17 12:16:32 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-fa71cead-199b-4a39-90bd-7369ec1185b7 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Attempting to detach device vdb from instance 6d482e2e-e73c-4c13-aead-dacefa7be735 from the persistent domain config. {{(pid=73449) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 12:16:32 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-fa71cead-199b-4a39-90bd-7369ec1185b7 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 12:16:32 user nova-compute[73449]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 12:16:32 user nova-compute[73449]:   <source dev="/dev/sdc"/>
Aug 17 12:16:32 user nova-compute[73449]:   <target dev="vdb" bus="virtio"/>
Aug 17 12:16:32 user nova-compute[73449]:   <serial>44f35ffd-ee22-472a-b309-0b477ff29fcf</serial>
Aug 17 12:16:32 user nova-compute[73449]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 12:16:32 user nova-compute[73449]: </disk>
Aug 17 12:16:32 user nova-compute[73449]:  {{(pid=73449) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 12:16:32 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-fa71cead-199b-4a39-90bd-7369ec1185b7 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Successfully detached device vdb from instance 6d482e2e-e73c-4c13-aead-dacefa7be735 from the persistent domain config.
Aug 17 12:16:32 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-fa71cead-199b-4a39-90bd-7369ec1185b7 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6d482e2e-e73c-4c13-aead-dacefa7be735 from the live domain config. {{(pid=73449) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 12:16:32 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-fa71cead-199b-4a39-90bd-7369ec1185b7 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 12:16:32 user nova-compute[73449]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 12:16:32 user nova-compute[73449]:   <source dev="/dev/sdc"/>
Aug 17 12:16:32 user nova-compute[73449]:   <target dev="vdb" bus="virtio"/>
Aug 17 12:16:32 user nova-compute[73449]:   <serial>44f35ffd-ee22-472a-b309-0b477ff29fcf</serial>
Aug 17 12:16:32 user nova-compute[73449]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 12:16:32 user nova-compute[73449]: </disk>
Aug 17 12:16:32 user nova-compute[73449]:  {{(pid=73449) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 12:16:32 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:16:32 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Received event <DeviceRemovedEvent: 1692274592.5262632, 6d482e2e-e73c-4c13-aead-dacefa7be735 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73449) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 12:16:32 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-fa71cead-199b-4a39-90bd-7369ec1185b7 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6d482e2e-e73c-4c13-aead-dacefa7be735 {{(pid=73449) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 12:16:32 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-fa71cead-199b-4a39-90bd-7369ec1185b7 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Successfully detached device vdb from instance 6d482e2e-e73c-4c13-aead-dacefa7be735 from the live domain config.
Aug 17 12:16:32 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa71cead-199b-4a39-90bd-7369ec1185b7 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] [instance: 6d482e2e-e73c-4c13-aead-dacefa7be735] calling os-brick to detach iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 12:16:32 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa71cead-199b-4a39-90bd-7369ec1185b7 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, {'target_iqns': ['iqn.2010-10.org.openstack:44f35ffd-ee22-472a-b309-0b477ff29fcf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hwvBgVNQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 12:16:32 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-fa71cead-199b-4a39-90bd-7369ec1185b7 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 12:16:32 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-fa71cead-199b-4a39-90bd-7369ec1185b7 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 12:16:32 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-fa71cead-199b-4a39-90bd-7369ec1185b7 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 12:16:32 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa71cead-199b-4a39-90bd-7369ec1185b7 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:44f35ffd-ee22-472a-b309-0b477ff29fcf', 0)] {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 12:16:32 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:16:32 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:16:32 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[075485fa-403f-42c7-bf6b-e698bcb9c6e0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44f35ffd-ee22-472a-b309-0b477ff29fcf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4c6cba26-a28d-4c89-82a6-6135d36a1c2a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b06e821-f631-4206-87a5-59bb900062bd\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:16:32 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:16:32 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:16:32 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[1197f038-3cad-4791-9e5f-86ac3cdd4b32]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f35ffd-ee22-472a-b309-0b477ff29fcf (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b06e821-f631-4206-87a5-59bb900062bd (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c6cba26-a28d-4c89-82a6-6135d36a1c2a (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:16:32 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa71cead-199b-4a39-90bd-7369ec1185b7 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f35ffd-ee22-472a-b309-0b477ff29fcf (non-flash)
Aug 17 12:16:32 user nova-compute[73449]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b06e821-f631-4206-87a5-59bb900062bd (non-flash)
Aug 17 12:16:32 user nova-compute[73449]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c6cba26-a28d-4c89-82a6-6135d36a1c2a (non-flash)
Aug 17 12:16:32 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 12:16:32 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa71cead-199b-4a39-90bd-7369ec1185b7 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f35ffd-ee22-472a-b309-0b477ff29fcf (non-flash)
Aug 17 12:16:32 user nova-compute[73449]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b06e821-f631-4206-87a5-59bb900062bd (non-flash)
Aug 17 12:16:32 user nova-compute[73449]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c6cba26-a28d-4c89-82a6-6135d36a1c2a (non-flash)
Aug 17 12:16:32 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 12:16:32 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa71cead-199b-4a39-90bd-7369ec1185b7 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe7582bbb50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:44f35ffd-ee22-472a-b309-0b477ff29fcf'): ({'sdc'}, set())}) {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 12:16:32 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-fa71cead-199b-4a39-90bd-7369ec1185b7 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Removing single pathed devices sdc {{(pid=73449) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 12:16:32 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:16:32 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:16:32 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[61b99bae-9a44-48f9-ada9-c4a7f2866c02]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:16:32 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:16:32 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:16:32 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b7b609d-4d01-4615-ba55-831201a891db]: (4, ('ok\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:16:32 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-fa71cead-199b-4a39-90bd-7369ec1185b7 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Flushing IO for device /dev/sdc {{(pid=73449) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 12:16:32 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:16:32 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:16:32 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[e13354cf-8ac4-40e1-a7a0-be22bddd36eb]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:16:32 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-fa71cead-199b-4a39-90bd-7369ec1185b7 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73449) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 12:16:32 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:16:32 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:16:32 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4a31a94-16c5-4ee5-801f-bd785c8e501b]: (4, ('1', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:16:32 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-fa71cead-199b-4a39-90bd-7369ec1185b7 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73449) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 12:16:32 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-fa71cead-199b-4a39-90bd-7369ec1185b7 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] SCSI volumes sdc have been removed. {{(pid=73449) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 12:16:32 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa71cead-199b-4a39-90bd-7369ec1185b7 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:44f35ffd-ee22-472a-b309-0b477ff29fcf')] {{(pid=73449) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 12:16:32 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44f35ffd-ee22-472a-b309-0b477ff29fcf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:16:32 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44f35ffd-ee22-472a-b309-0b477ff29fcf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:16:32 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4118488-a925-4590-b140-46eb3b834002]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:16:32 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa71cead-199b-4a39-90bd-7369ec1185b7 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:16:32 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44f35ffd-ee22-472a-b309-0b477ff29fcf -p 172.16.0.220:3260 --logout {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:16:32 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44f35ffd-ee22-472a-b309-0b477ff29fcf -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:16:32 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a6b9859-0877-47c9-bd4d-7569c69d3bff]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:44f35ffd-ee22-472a-b309-0b477ff29fcf, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:44f35ffd-ee22-472a-b309-0b477ff29fcf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:16:32 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa71cead-199b-4a39-90bd-7369ec1185b7 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:44f35ffd-ee22-472a-b309-0b477ff29fcf, portal: 172.16.0.220,3260]
Aug 17 12:16:32 user nova-compute[73449]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:44f35ffd-ee22-472a-b309-0b477ff29fcf, portal: 172.16.0.220,3260] successful.
Aug 17 12:16:32 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:16:32 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44f35ffd-ee22-472a-b309-0b477ff29fcf -p 172.16.0.220:3260 --op delete {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:16:32 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44f35ffd-ee22-472a-b309-0b477ff29fcf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:16:32 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1966edf-7c59-4385-85a7-9a51a8d572d9]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:16:32 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa71cead-199b-4a39-90bd-7369ec1185b7 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:16:32 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-fa71cead-199b-4a39-90bd-7369ec1185b7 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.261s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 12:16:32 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa71cead-199b-4a39-90bd-7369ec1185b7 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] <== disconnect_volume: return (262ms) None {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 12:16:32 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa71cead-199b-4a39-90bd-7369ec1185b7 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] [instance: 6d482e2e-e73c-4c13-aead-dacefa7be735] Disconnected iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 12:16:32 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:16:33 user nova-compute[73449]: DEBUG nova.objects.instance [None req-fa71cead-199b-4a39-90bd-7369ec1185b7 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Lazy-loading 'flavor' on Instance uuid 6d482e2e-e73c-4c13-aead-dacefa7be735 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:16:33 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-fa71cead-199b-4a39-90bd-7369ec1185b7 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Lock "6d482e2e-e73c-4c13-aead-dacefa7be735" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.746s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:16:34 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:16:34 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-e5afb063-b0bf-4ad7-99aa-c43358f45343 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Acquiring lock "6d482e2e-e73c-4c13-aead-dacefa7be735" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:16:34 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-e5afb063-b0bf-4ad7-99aa-c43358f45343 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Lock "6d482e2e-e73c-4c13-aead-dacefa7be735" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:16:34 user nova-compute[73449]: INFO nova.compute.manager [None req-e5afb063-b0bf-4ad7-99aa-c43358f45343 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] [instance: 6d482e2e-e73c-4c13-aead-dacefa7be735] Detaching volume 4c6cba26-a28d-4c89-82a6-6135d36a1c2a
Aug 17 12:16:34 user nova-compute[73449]: INFO nova.virt.block_device [None req-e5afb063-b0bf-4ad7-99aa-c43358f45343 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] [instance: 6d482e2e-e73c-4c13-aead-dacefa7be735] Attempting to driver detach volume 4c6cba26-a28d-4c89-82a6-6135d36a1c2a from mountpoint /dev/vdc
Aug 17 12:16:34 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-e5afb063-b0bf-4ad7-99aa-c43358f45343 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Attempting to detach device vdc from instance 6d482e2e-e73c-4c13-aead-dacefa7be735 from the persistent domain config. {{(pid=73449) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 12:16:34 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-e5afb063-b0bf-4ad7-99aa-c43358f45343 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 12:16:34 user nova-compute[73449]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 12:16:34 user nova-compute[73449]:   <source dev="/dev/sdd"/>
Aug 17 12:16:34 user nova-compute[73449]:   <target dev="vdc" bus="virtio"/>
Aug 17 12:16:34 user nova-compute[73449]:   <serial>4c6cba26-a28d-4c89-82a6-6135d36a1c2a</serial>
Aug 17 12:16:34 user nova-compute[73449]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 17 12:16:34 user nova-compute[73449]: </disk>
Aug 17 12:16:34 user nova-compute[73449]:  {{(pid=73449) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 12:16:34 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-e5afb063-b0bf-4ad7-99aa-c43358f45343 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Successfully detached device vdc from instance 6d482e2e-e73c-4c13-aead-dacefa7be735 from the persistent domain config.
Aug 17 12:16:34 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-e5afb063-b0bf-4ad7-99aa-c43358f45343 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 6d482e2e-e73c-4c13-aead-dacefa7be735 from the live domain config. {{(pid=73449) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 12:16:34 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-e5afb063-b0bf-4ad7-99aa-c43358f45343 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 12:16:34 user nova-compute[73449]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 12:16:34 user nova-compute[73449]:   <source dev="/dev/sdd"/>
Aug 17 12:16:34 user nova-compute[73449]:   <target dev="vdc" bus="virtio"/>
Aug 17 12:16:34 user nova-compute[73449]:   <serial>4c6cba26-a28d-4c89-82a6-6135d36a1c2a</serial>
Aug 17 12:16:34 user nova-compute[73449]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 17 12:16:34 user nova-compute[73449]: </disk>
Aug 17 12:16:34 user nova-compute[73449]:  {{(pid=73449) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 12:16:35 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Received event <DeviceRemovedEvent: 1692274595.2745452, 6d482e2e-e73c-4c13-aead-dacefa7be735 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73449) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 12:16:35 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-e5afb063-b0bf-4ad7-99aa-c43358f45343 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 6d482e2e-e73c-4c13-aead-dacefa7be735 {{(pid=73449) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 12:16:35 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-e5afb063-b0bf-4ad7-99aa-c43358f45343 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Successfully detached device vdc from instance 6d482e2e-e73c-4c13-aead-dacefa7be735 from the live domain config.
Aug 17 12:16:35 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5afb063-b0bf-4ad7-99aa-c43358f45343 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] [instance: 6d482e2e-e73c-4c13-aead-dacefa7be735] calling os-brick to detach iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 12:16:35 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5afb063-b0bf-4ad7-99aa-c43358f45343 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, {'target_iqns': ['iqn.2010-10.org.openstack:4c6cba26-a28d-4c89-82a6-6135d36a1c2a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xXyEQThW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 12:16:35 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-e5afb063-b0bf-4ad7-99aa-c43358f45343 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 12:16:35 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-e5afb063-b0bf-4ad7-99aa-c43358f45343 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 12:16:35 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-e5afb063-b0bf-4ad7-99aa-c43358f45343 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 12:16:35 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5afb063-b0bf-4ad7-99aa-c43358f45343 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4c6cba26-a28d-4c89-82a6-6135d36a1c2a', 0)] {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 12:16:35 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:16:35 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:16:35 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ad3547d-e212-4151-9893-dd08795eefe3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4c6cba26-a28d-4c89-82a6-6135d36a1c2a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b06e821-f631-4206-87a5-59bb900062bd\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:16:35 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:16:35 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:16:35 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[420a11e1-0aa9-4a0a-a6ba-b543ec258fd9]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b06e821-f631-4206-87a5-59bb900062bd (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c6cba26-a28d-4c89-82a6-6135d36a1c2a (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:16:35 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5afb063-b0bf-4ad7-99aa-c43358f45343 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b06e821-f631-4206-87a5-59bb900062bd (non-flash)
Aug 17 12:16:35 user nova-compute[73449]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c6cba26-a28d-4c89-82a6-6135d36a1c2a (non-flash)
Aug 17 12:16:35 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 12:16:35 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5afb063-b0bf-4ad7-99aa-c43358f45343 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b06e821-f631-4206-87a5-59bb900062bd (non-flash)
Aug 17 12:16:35 user nova-compute[73449]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c6cba26-a28d-4c89-82a6-6135d36a1c2a (non-flash)
Aug 17 12:16:35 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 12:16:35 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5afb063-b0bf-4ad7-99aa-c43358f45343 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe7582d9360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4c6cba26-a28d-4c89-82a6-6135d36a1c2a'): ({'sdd'}, set())}) {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 12:16:35 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-e5afb063-b0bf-4ad7-99aa-c43358f45343 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Removing single pathed devices sdd {{(pid=73449) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 12:16:35 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:16:35 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:16:35 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a1dbc5d-59ae-4e62-8abb-d407b78c3508]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:16:35 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:16:35 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:16:35 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[69d6ba2f-e95e-411d-861c-fb6f6cda6829]: (4, ('ok\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:16:35 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-e5afb063-b0bf-4ad7-99aa-c43358f45343 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Flushing IO for device /dev/sdd {{(pid=73449) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 12:16:35 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:16:35 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:16:35 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4236755-36c9-4026-812b-ccdf6229d818]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:16:35 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-e5afb063-b0bf-4ad7-99aa-c43358f45343 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73449) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 12:16:35 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:16:35 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.054s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:16:35 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e8af48f-17f0-44b4-97a4-bce882b684ac]: (4, ('1', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:16:35 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-e5afb063-b0bf-4ad7-99aa-c43358f45343 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73449) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 12:16:35 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-e5afb063-b0bf-4ad7-99aa-c43358f45343 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] SCSI volumes sdd have been removed. {{(pid=73449) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 12:16:35 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5afb063-b0bf-4ad7-99aa-c43358f45343 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4c6cba26-a28d-4c89-82a6-6135d36a1c2a')] {{(pid=73449) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 12:16:35 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c6cba26-a28d-4c89-82a6-6135d36a1c2a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:16:35 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c6cba26-a28d-4c89-82a6-6135d36a1c2a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.033s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:16:35 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[285674b7-d412-45d5-9d58-ef6aca8b5822]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:16:35 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5afb063-b0bf-4ad7-99aa-c43358f45343 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:16:35 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c6cba26-a28d-4c89-82a6-6135d36a1c2a -p 172.16.0.220:3260 --logout {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:16:35 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c6cba26-a28d-4c89-82a6-6135d36a1c2a -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:16:35 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[e524c93a-341c-475d-adb1-932bf247c84d]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:4c6cba26-a28d-4c89-82a6-6135d36a1c2a, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:4c6cba26-a28d-4c89-82a6-6135d36a1c2a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:16:35 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5afb063-b0bf-4ad7-99aa-c43358f45343 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:4c6cba26-a28d-4c89-82a6-6135d36a1c2a, portal: 172.16.0.220,3260]
Aug 17 12:16:35 user nova-compute[73449]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:4c6cba26-a28d-4c89-82a6-6135d36a1c2a, portal: 172.16.0.220,3260] successful.
Aug 17 12:16:35 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:16:35 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c6cba26-a28d-4c89-82a6-6135d36a1c2a -p 172.16.0.220:3260 --op delete {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:16:35 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c6cba26-a28d-4c89-82a6-6135d36a1c2a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:16:35 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fc4bc26-e747-44ac-97e0-9d77b9aaa0f1]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:16:35 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5afb063-b0bf-4ad7-99aa-c43358f45343 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:16:35 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-e5afb063-b0bf-4ad7-99aa-c43358f45343 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 12:16:35 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5afb063-b0bf-4ad7-99aa-c43358f45343 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] <== disconnect_volume: return (321ms) None {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 12:16:35 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5afb063-b0bf-4ad7-99aa-c43358f45343 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] [instance: 6d482e2e-e73c-4c13-aead-dacefa7be735] Disconnected iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 12:16:36 user nova-compute[73449]: DEBUG nova.objects.instance [None req-e5afb063-b0bf-4ad7-99aa-c43358f45343 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Lazy-loading 'flavor' on Instance uuid 6d482e2e-e73c-4c13-aead-dacefa7be735 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:16:36 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-e5afb063-b0bf-4ad7-99aa-c43358f45343 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Lock "6d482e2e-e73c-4c13-aead-dacefa7be735" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.814s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:16:37 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:16:37 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-ff7280c7-6b3a-4bc5-bcef-9eda156f9a13 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Acquiring lock "6d482e2e-e73c-4c13-aead-dacefa7be735" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:16:37 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-ff7280c7-6b3a-4bc5-bcef-9eda156f9a13 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Lock "6d482e2e-e73c-4c13-aead-dacefa7be735" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:16:37 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-ff7280c7-6b3a-4bc5-bcef-9eda156f9a13 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Acquiring lock "6d482e2e-e73c-4c13-aead-dacefa7be735-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:16:37 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-ff7280c7-6b3a-4bc5-bcef-9eda156f9a13 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Lock "6d482e2e-e73c-4c13-aead-dacefa7be735-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:16:37 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-ff7280c7-6b3a-4bc5-bcef-9eda156f9a13 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Lock "6d482e2e-e73c-4c13-aead-dacefa7be735-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:16:37 user nova-compute[73449]: INFO nova.compute.manager [None req-ff7280c7-6b3a-4bc5-bcef-9eda156f9a13 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] [instance: 6d482e2e-e73c-4c13-aead-dacefa7be735] Terminating instance
Aug 17 12:16:37 user nova-compute[73449]: DEBUG nova.compute.manager [None req-ff7280c7-6b3a-4bc5-bcef-9eda156f9a13 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] [instance: 6d482e2e-e73c-4c13-aead-dacefa7be735] Start destroying the instance on the hypervisor. {{(pid=73449) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 12:16:37 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:16:37 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:16:37 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:16:37 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:16:37 user nova-compute[73449]: DEBUG nova.compute.manager [req-b42af267-ccf7-4cd1-8e78-7b8f88b894f4 req-89b3a307-183d-49d0-ae86-3c75720d742f service nova] [instance: 6d482e2e-e73c-4c13-aead-dacefa7be735] Received event network-vif-unplugged-15176341-7f06-4c3a-9501-b2c7518f7119 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:16:37 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-b42af267-ccf7-4cd1-8e78-7b8f88b894f4 req-89b3a307-183d-49d0-ae86-3c75720d742f service nova] Acquiring lock "6d482e2e-e73c-4c13-aead-dacefa7be735-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:16:37 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-b42af267-ccf7-4cd1-8e78-7b8f88b894f4 req-89b3a307-183d-49d0-ae86-3c75720d742f service nova] Lock "6d482e2e-e73c-4c13-aead-dacefa7be735-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:16:37 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-b42af267-ccf7-4cd1-8e78-7b8f88b894f4 req-89b3a307-183d-49d0-ae86-3c75720d742f service nova] Lock "6d482e2e-e73c-4c13-aead-dacefa7be735-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:16:37 user nova-compute[73449]: DEBUG nova.compute.manager [req-b42af267-ccf7-4cd1-8e78-7b8f88b894f4 req-89b3a307-183d-49d0-ae86-3c75720d742f service nova] [instance: 6d482e2e-e73c-4c13-aead-dacefa7be735] No waiting events found dispatching network-vif-unplugged-15176341-7f06-4c3a-9501-b2c7518f7119 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 12:16:37 user nova-compute[73449]: DEBUG nova.compute.manager [req-b42af267-ccf7-4cd1-8e78-7b8f88b894f4 req-89b3a307-183d-49d0-ae86-3c75720d742f service nova] [instance: 6d482e2e-e73c-4c13-aead-dacefa7be735] Received event network-vif-unplugged-15176341-7f06-4c3a-9501-b2c7518f7119 for instance with task_state deleting. {{(pid=73449) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 12:16:38 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:16:38 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:16:38 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:16:38 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:16:38 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: 6d482e2e-e73c-4c13-aead-dacefa7be735] Instance destroyed successfully.
Aug 17 12:16:38 user nova-compute[73449]: DEBUG nova.objects.instance [None req-ff7280c7-6b3a-4bc5-bcef-9eda156f9a13 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Lazy-loading 'resources' on Instance uuid 6d482e2e-e73c-4c13-aead-dacefa7be735 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:16:38 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-ff7280c7-6b3a-4bc5-bcef-9eda156f9a13 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T12:14:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-86467027',display_name='tempest-AttachVolumeTestJSON-server-86467027',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-86467027',id=51,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD6bs79O4lp/VvLMrCaTVP7F7/4BJnr7AD9elyqqO0Iv9zuyHSfFM6JuUqPVqyM283blqlePiY3Tj4gbqqYMYjtnMaqIrVD3wQxaSUatFm0ZFFPWih48n64P8MCTzEVZTQ==',key_name='tempest-keypair-220674408',keypairs=<?>,launch_index=0,launched_at=2023-08-17T12:14:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f2a2f7faf23147fba5270c844eac051a',ramdisk_id='',reservation_id='r-0qh71q0x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1035899549',owner_user_name='tempest-AttachVolumeTestJSON-1035899549-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T12:14:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9b21e7e411a54be0890ae7b0ca85d80c',uuid=6d482e2e-e73c-4c13-aead-dacefa7be735,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "15176341-7f06-4c3a-9501-b2c7518f7119", "address": "fa:16:3e:e1:e1:cd", "network": {"id": "2ead35b7-4013-4fab-b35f-02f3237fcac1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1887618888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2a2f7faf23147fba5270c844eac051a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15176341-7f", "ovs_interfaceid": "15176341-7f06-4c3a-9501-b2c7518f7119", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 12:16:38 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-ff7280c7-6b3a-4bc5-bcef-9eda156f9a13 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Converting VIF {"id": "15176341-7f06-4c3a-9501-b2c7518f7119", "address": "fa:16:3e:e1:e1:cd", "network": {"id": "2ead35b7-4013-4fab-b35f-02f3237fcac1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1887618888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2a2f7faf23147fba5270c844eac051a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15176341-7f", "ovs_interfaceid": "15176341-7f06-4c3a-9501-b2c7518f7119", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 12:16:38 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-ff7280c7-6b3a-4bc5-bcef-9eda156f9a13 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e1:e1:cd,bridge_name='br-int',has_traffic_filtering=True,id=15176341-7f06-4c3a-9501-b2c7518f7119,network=Network(2ead35b7-4013-4fab-b35f-02f3237fcac1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15176341-7f') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 12:16:38 user nova-compute[73449]: DEBUG os_vif [None req-ff7280c7-6b3a-4bc5-bcef-9eda156f9a13 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e1:e1:cd,bridge_name='br-int',has_traffic_filtering=True,id=15176341-7f06-4c3a-9501-b2c7518f7119,network=Network(2ead35b7-4013-4fab-b35f-02f3237fcac1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15176341-7f') {{(pid=73449) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 12:16:38 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:16:38 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:16:38 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap15176341-7f, bridge=br-int, if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 12:16:38 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:16:38 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:16:38 user nova-compute[73449]: INFO os_vif [None req-ff7280c7-6b3a-4bc5-bcef-9eda156f9a13 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e1:e1:cd,bridge_name='br-int',has_traffic_filtering=True,id=15176341-7f06-4c3a-9501-b2c7518f7119,network=Network(2ead35b7-4013-4fab-b35f-02f3237fcac1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15176341-7f')
Aug 17 12:16:38 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-ff7280c7-6b3a-4bc5-bcef-9eda156f9a13 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] [instance: 6d482e2e-e73c-4c13-aead-dacefa7be735] Deleting instance files /opt/stack/data/nova/instances/6d482e2e-e73c-4c13-aead-dacefa7be735_del
Aug 17 12:16:38 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-ff7280c7-6b3a-4bc5-bcef-9eda156f9a13 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] [instance: 6d482e2e-e73c-4c13-aead-dacefa7be735] Deletion of /opt/stack/data/nova/instances/6d482e2e-e73c-4c13-aead-dacefa7be735_del complete
Aug 17 12:16:38 user nova-compute[73449]: INFO nova.compute.manager [None req-ff7280c7-6b3a-4bc5-bcef-9eda156f9a13 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] [instance: 6d482e2e-e73c-4c13-aead-dacefa7be735] Took 1.03 seconds to destroy the instance on the hypervisor.
Aug 17 12:16:38 user nova-compute[73449]: DEBUG oslo.service.loopingcall [None req-ff7280c7-6b3a-4bc5-bcef-9eda156f9a13 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73449) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 12:16:38 user nova-compute[73449]: DEBUG nova.compute.manager [-] [instance: 6d482e2e-e73c-4c13-aead-dacefa7be735] Deallocating network for instance {{(pid=73449) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 12:16:38 user nova-compute[73449]: DEBUG nova.network.neutron [-] [instance: 6d482e2e-e73c-4c13-aead-dacefa7be735] deallocate_for_instance() {{(pid=73449) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 12:16:38 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:16:38 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:16:38 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:16:38 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:16:38 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:16:39 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:16:39 user nova-compute[73449]: DEBUG nova.network.neutron [-] [instance: 6d482e2e-e73c-4c13-aead-dacefa7be735] Updating instance_info_cache with network_info: [] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 12:16:39 user nova-compute[73449]: INFO nova.compute.manager [-] [instance: 6d482e2e-e73c-4c13-aead-dacefa7be735] Took 1.24 seconds to deallocate network for instance.
Aug 17 12:16:39 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-ff7280c7-6b3a-4bc5-bcef-9eda156f9a13 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:16:39 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-ff7280c7-6b3a-4bc5-bcef-9eda156f9a13 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:16:39 user nova-compute[73449]: DEBUG nova.compute.manager [req-cfef971c-b619-4c17-8307-f35e14c306e2 req-f186a31a-0e04-4c75-9df7-720d1f0485af service nova] [instance: 6d482e2e-e73c-4c13-aead-dacefa7be735] Received event network-vif-deleted-15176341-7f06-4c3a-9501-b2c7518f7119 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:16:39 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-ff7280c7-6b3a-4bc5-bcef-9eda156f9a13 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 12:16:39 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-ff7280c7-6b3a-4bc5-bcef-9eda156f9a13 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 12:16:39 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-ff7280c7-6b3a-4bc5-bcef-9eda156f9a13 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.152s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:16:39 user nova-compute[73449]: DEBUG nova.compute.manager [req-c0b4cde3-a1d0-4f6d-a0ed-65c6b62740a4 req-72c6ac40-4923-49fc-908d-f1e289d7f784 service nova] [instance: 6d482e2e-e73c-4c13-aead-dacefa7be735] Received event network-vif-plugged-15176341-7f06-4c3a-9501-b2c7518f7119 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:16:39 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-c0b4cde3-a1d0-4f6d-a0ed-65c6b62740a4 req-72c6ac40-4923-49fc-908d-f1e289d7f784 service nova] Acquiring lock "6d482e2e-e73c-4c13-aead-dacefa7be735-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:16:39 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-c0b4cde3-a1d0-4f6d-a0ed-65c6b62740a4 req-72c6ac40-4923-49fc-908d-f1e289d7f784 service nova] Lock "6d482e2e-e73c-4c13-aead-dacefa7be735-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:16:39 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-c0b4cde3-a1d0-4f6d-a0ed-65c6b62740a4 req-72c6ac40-4923-49fc-908d-f1e289d7f784 service nova] Lock "6d482e2e-e73c-4c13-aead-dacefa7be735-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:16:39 user nova-compute[73449]: DEBUG nova.compute.manager [req-c0b4cde3-a1d0-4f6d-a0ed-65c6b62740a4 req-72c6ac40-4923-49fc-908d-f1e289d7f784 service nova] [instance: 6d482e2e-e73c-4c13-aead-dacefa7be735] No waiting events found dispatching network-vif-plugged-15176341-7f06-4c3a-9501-b2c7518f7119 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 12:16:39 user nova-compute[73449]: WARNING nova.compute.manager [req-c0b4cde3-a1d0-4f6d-a0ed-65c6b62740a4 req-72c6ac40-4923-49fc-908d-f1e289d7f784 service nova] [instance: 6d482e2e-e73c-4c13-aead-dacefa7be735] Received unexpected event network-vif-plugged-15176341-7f06-4c3a-9501-b2c7518f7119 for instance with vm_state deleted and task_state None.
Aug 17 12:16:39 user nova-compute[73449]: DEBUG nova.compute.manager [req-c0b4cde3-a1d0-4f6d-a0ed-65c6b62740a4 req-72c6ac40-4923-49fc-908d-f1e289d7f784 service nova] [instance: 6d482e2e-e73c-4c13-aead-dacefa7be735] Received event network-vif-plugged-15176341-7f06-4c3a-9501-b2c7518f7119 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:16:39 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-c0b4cde3-a1d0-4f6d-a0ed-65c6b62740a4 req-72c6ac40-4923-49fc-908d-f1e289d7f784 service nova] Acquiring lock "6d482e2e-e73c-4c13-aead-dacefa7be735-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:16:39 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-c0b4cde3-a1d0-4f6d-a0ed-65c6b62740a4 req-72c6ac40-4923-49fc-908d-f1e289d7f784 service nova] Lock "6d482e2e-e73c-4c13-aead-dacefa7be735-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:16:39 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-c0b4cde3-a1d0-4f6d-a0ed-65c6b62740a4 req-72c6ac40-4923-49fc-908d-f1e289d7f784 service nova] Lock "6d482e2e-e73c-4c13-aead-dacefa7be735-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:16:39 user nova-compute[73449]: DEBUG nova.compute.manager [req-c0b4cde3-a1d0-4f6d-a0ed-65c6b62740a4 req-72c6ac40-4923-49fc-908d-f1e289d7f784 service nova] [instance: 6d482e2e-e73c-4c13-aead-dacefa7be735] No waiting events found dispatching network-vif-plugged-15176341-7f06-4c3a-9501-b2c7518f7119 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 12:16:39 user nova-compute[73449]: WARNING nova.compute.manager [req-c0b4cde3-a1d0-4f6d-a0ed-65c6b62740a4 req-72c6ac40-4923-49fc-908d-f1e289d7f784 service nova] [instance: 6d482e2e-e73c-4c13-aead-dacefa7be735] Received unexpected event network-vif-plugged-15176341-7f06-4c3a-9501-b2c7518f7119 for instance with vm_state deleted and task_state None.
Aug 17 12:16:39 user nova-compute[73449]: DEBUG nova.compute.manager [req-c0b4cde3-a1d0-4f6d-a0ed-65c6b62740a4 req-72c6ac40-4923-49fc-908d-f1e289d7f784 service nova] [instance: 6d482e2e-e73c-4c13-aead-dacefa7be735] Received event network-vif-plugged-15176341-7f06-4c3a-9501-b2c7518f7119 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:16:39 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-c0b4cde3-a1d0-4f6d-a0ed-65c6b62740a4 req-72c6ac40-4923-49fc-908d-f1e289d7f784 service nova] Acquiring lock "6d482e2e-e73c-4c13-aead-dacefa7be735-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:16:39 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-c0b4cde3-a1d0-4f6d-a0ed-65c6b62740a4 req-72c6ac40-4923-49fc-908d-f1e289d7f784 service nova] Lock "6d482e2e-e73c-4c13-aead-dacefa7be735-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:16:39 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-c0b4cde3-a1d0-4f6d-a0ed-65c6b62740a4 req-72c6ac40-4923-49fc-908d-f1e289d7f784 service nova] Lock "6d482e2e-e73c-4c13-aead-dacefa7be735-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:16:39 user nova-compute[73449]: DEBUG nova.compute.manager [req-c0b4cde3-a1d0-4f6d-a0ed-65c6b62740a4 req-72c6ac40-4923-49fc-908d-f1e289d7f784 service nova] [instance: 6d482e2e-e73c-4c13-aead-dacefa7be735] No waiting events found dispatching network-vif-plugged-15176341-7f06-4c3a-9501-b2c7518f7119 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 12:16:39 user nova-compute[73449]: WARNING nova.compute.manager [req-c0b4cde3-a1d0-4f6d-a0ed-65c6b62740a4 req-72c6ac40-4923-49fc-908d-f1e289d7f784 service nova] [instance: 6d482e2e-e73c-4c13-aead-dacefa7be735] Received unexpected event network-vif-plugged-15176341-7f06-4c3a-9501-b2c7518f7119 for instance with vm_state deleted and task_state None.
Aug 17 12:16:39 user nova-compute[73449]: DEBUG nova.compute.manager [req-c0b4cde3-a1d0-4f6d-a0ed-65c6b62740a4 req-72c6ac40-4923-49fc-908d-f1e289d7f784 service nova] [instance: 6d482e2e-e73c-4c13-aead-dacefa7be735] Received event network-vif-unplugged-15176341-7f06-4c3a-9501-b2c7518f7119 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:16:39 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-c0b4cde3-a1d0-4f6d-a0ed-65c6b62740a4 req-72c6ac40-4923-49fc-908d-f1e289d7f784 service nova] Acquiring lock "6d482e2e-e73c-4c13-aead-dacefa7be735-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:16:39 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-c0b4cde3-a1d0-4f6d-a0ed-65c6b62740a4 req-72c6ac40-4923-49fc-908d-f1e289d7f784 service nova] Lock "6d482e2e-e73c-4c13-aead-dacefa7be735-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:16:39 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-c0b4cde3-a1d0-4f6d-a0ed-65c6b62740a4 req-72c6ac40-4923-49fc-908d-f1e289d7f784 service nova] Lock "6d482e2e-e73c-4c13-aead-dacefa7be735-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:16:39 user nova-compute[73449]: DEBUG nova.compute.manager [req-c0b4cde3-a1d0-4f6d-a0ed-65c6b62740a4 req-72c6ac40-4923-49fc-908d-f1e289d7f784 service nova] [instance: 6d482e2e-e73c-4c13-aead-dacefa7be735] No waiting events found dispatching network-vif-unplugged-15176341-7f06-4c3a-9501-b2c7518f7119 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 12:16:39 user nova-compute[73449]: WARNING nova.compute.manager [req-c0b4cde3-a1d0-4f6d-a0ed-65c6b62740a4 req-72c6ac40-4923-49fc-908d-f1e289d7f784 service nova] [instance: 6d482e2e-e73c-4c13-aead-dacefa7be735] Received unexpected event network-vif-unplugged-15176341-7f06-4c3a-9501-b2c7518f7119 for instance with vm_state deleted and task_state None.
Aug 17 12:16:39 user nova-compute[73449]: DEBUG nova.compute.manager [req-c0b4cde3-a1d0-4f6d-a0ed-65c6b62740a4 req-72c6ac40-4923-49fc-908d-f1e289d7f784 service nova] [instance: 6d482e2e-e73c-4c13-aead-dacefa7be735] Received event network-vif-plugged-15176341-7f06-4c3a-9501-b2c7518f7119 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:16:39 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-c0b4cde3-a1d0-4f6d-a0ed-65c6b62740a4 req-72c6ac40-4923-49fc-908d-f1e289d7f784 service nova] Acquiring lock "6d482e2e-e73c-4c13-aead-dacefa7be735-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:16:39 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-c0b4cde3-a1d0-4f6d-a0ed-65c6b62740a4 req-72c6ac40-4923-49fc-908d-f1e289d7f784 service nova] Lock "6d482e2e-e73c-4c13-aead-dacefa7be735-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:16:39 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-c0b4cde3-a1d0-4f6d-a0ed-65c6b62740a4 req-72c6ac40-4923-49fc-908d-f1e289d7f784 service nova] Lock "6d482e2e-e73c-4c13-aead-dacefa7be735-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:16:39 user nova-compute[73449]: DEBUG nova.compute.manager [req-c0b4cde3-a1d0-4f6d-a0ed-65c6b62740a4 req-72c6ac40-4923-49fc-908d-f1e289d7f784 service nova] [instance: 6d482e2e-e73c-4c13-aead-dacefa7be735] No waiting events found dispatching network-vif-plugged-15176341-7f06-4c3a-9501-b2c7518f7119 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 12:16:39 user nova-compute[73449]: WARNING nova.compute.manager [req-c0b4cde3-a1d0-4f6d-a0ed-65c6b62740a4 req-72c6ac40-4923-49fc-908d-f1e289d7f784 service nova] [instance: 6d482e2e-e73c-4c13-aead-dacefa7be735] Received unexpected event network-vif-plugged-15176341-7f06-4c3a-9501-b2c7518f7119 for instance with vm_state deleted and task_state None.
Aug 17 12:16:39 user nova-compute[73449]: INFO nova.scheduler.client.report [None req-ff7280c7-6b3a-4bc5-bcef-9eda156f9a13 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Deleted allocations for instance 6d482e2e-e73c-4c13-aead-dacefa7be735
Aug 17 12:16:39 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-ff7280c7-6b3a-4bc5-bcef-9eda156f9a13 tempest-AttachVolumeTestJSON-1035899549 tempest-AttachVolumeTestJSON-1035899549-project-member] Lock "6d482e2e-e73c-4c13-aead-dacefa7be735" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.630s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:16:43 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:16:48 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:16:49 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:16:51 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:16:51 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73449) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 17 12:16:53 user nova-compute[73449]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692274598.1028242, 6d482e2e-e73c-4c13-aead-dacefa7be735 => Stopped> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 12:16:53 user nova-compute[73449]: INFO nova.compute.manager [-] [instance: 6d482e2e-e73c-4c13-aead-dacefa7be735] VM Stopped (Lifecycle Event)
Aug 17 12:16:53 user nova-compute[73449]: DEBUG nova.compute.manager [None req-16e92916-2b84-47c3-ad74-ca263b93b920 None None] [instance: 6d482e2e-e73c-4c13-aead-dacefa7be735] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 12:16:53 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:16:58 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-f4c39777-b01c-4835-9ae4-ad8cddf367ad tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Acquiring lock "ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:16:58 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-f4c39777-b01c-4835-9ae4-ad8cddf367ad tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Lock "ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:16:58 user nova-compute[73449]: INFO nova.compute.manager [None req-f4c39777-b01c-4835-9ae4-ad8cddf367ad tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] Detaching volume 5b06e821-f631-4206-87a5-59bb900062bd
Aug 17 12:16:58 user nova-compute[73449]: INFO nova.virt.block_device [None req-f4c39777-b01c-4835-9ae4-ad8cddf367ad tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] Attempting to driver detach volume 5b06e821-f631-4206-87a5-59bb900062bd from mountpoint /dev/vdb
Aug 17 12:16:58 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-f4c39777-b01c-4835-9ae4-ad8cddf367ad tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Attempting to detach device vdb from instance ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d from the persistent domain config. {{(pid=73449) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 12:16:58 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-f4c39777-b01c-4835-9ae4-ad8cddf367ad tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 12:16:58 user nova-compute[73449]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 12:16:58 user nova-compute[73449]:   <source dev="/dev/sdb"/>
Aug 17 12:16:58 user nova-compute[73449]:   <target dev="vdb" bus="virtio"/>
Aug 17 12:16:58 user nova-compute[73449]:   <serial>5b06e821-f631-4206-87a5-59bb900062bd</serial>
Aug 17 12:16:58 user nova-compute[73449]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 12:16:58 user nova-compute[73449]: </disk>
Aug 17 12:16:58 user nova-compute[73449]:  {{(pid=73449) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 12:16:58 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-f4c39777-b01c-4835-9ae4-ad8cddf367ad tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Successfully detached device vdb from instance ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d from the persistent domain config.
Aug 17 12:16:58 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-f4c39777-b01c-4835-9ae4-ad8cddf367ad tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d from the live domain config. {{(pid=73449) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 12:16:58 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-f4c39777-b01c-4835-9ae4-ad8cddf367ad tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 12:16:58 user nova-compute[73449]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 12:16:58 user nova-compute[73449]:   <source dev="/dev/sdb"/>
Aug 17 12:16:58 user nova-compute[73449]:   <target dev="vdb" bus="virtio"/>
Aug 17 12:16:58 user nova-compute[73449]:   <serial>5b06e821-f631-4206-87a5-59bb900062bd</serial>
Aug 17 12:16:58 user nova-compute[73449]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 12:16:58 user nova-compute[73449]: </disk>
Aug 17 12:16:58 user nova-compute[73449]:  {{(pid=73449) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 12:16:58 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:16:58 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:16:58 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73449) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 12:16:58 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:16:58 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:16:58 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:16:58 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Received event <DeviceRemovedEvent: 1692274618.543153, ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73449) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 12:16:58 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-f4c39777-b01c-4835-9ae4-ad8cddf367ad tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d {{(pid=73449) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 12:16:58 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-f4c39777-b01c-4835-9ae4-ad8cddf367ad tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Successfully detached device vdb from instance ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d from the live domain config.
Aug 17 12:16:58 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4c39777-b01c-4835-9ae4-ad8cddf367ad tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] calling os-brick to detach iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 12:16:58 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c39777-b01c-4835-9ae4-ad8cddf367ad tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, {'target_iqns': ['iqn.2010-10.org.openstack:5b06e821-f631-4206-87a5-59bb900062bd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kueixFlm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 12:16:58 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-f4c39777-b01c-4835-9ae4-ad8cddf367ad tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 12:16:58 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-f4c39777-b01c-4835-9ae4-ad8cddf367ad tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 12:16:58 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-f4c39777-b01c-4835-9ae4-ad8cddf367ad tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 12:16:58 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c39777-b01c-4835-9ae4-ad8cddf367ad tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b06e821-f631-4206-87a5-59bb900062bd', 0)] {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 12:16:58 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:16:58 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:16:58 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcae9e3a-453f-4611-a097-b509e72d34c0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b06e821-f631-4206-87a5-59bb900062bd\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:16:58 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:16:58 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:16:58 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[54ff601e-caa4-488e-a0c8-4c552fe781c4]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b06e821-f631-4206-87a5-59bb900062bd (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:16:58 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c39777-b01c-4835-9ae4-ad8cddf367ad tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b06e821-f631-4206-87a5-59bb900062bd (non-flash)
Aug 17 12:16:58 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 12:16:58 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c39777-b01c-4835-9ae4-ad8cddf367ad tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b06e821-f631-4206-87a5-59bb900062bd (non-flash)
Aug 17 12:16:58 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 12:16:58 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c39777-b01c-4835-9ae4-ad8cddf367ad tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe7582dacb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b06e821-f631-4206-87a5-59bb900062bd'): ({'sdb'}, set())}) {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 12:16:58 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-f4c39777-b01c-4835-9ae4-ad8cddf367ad tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Removing single pathed devices sdb {{(pid=73449) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 12:16:58 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:16:58 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:16:58 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff5e5754-9467-4f99-b0dc-259da4243782]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:16:58 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:16:58 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:16:58 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[c91451af-d6b1-486f-9b21-20e9320bad2b]: (4, ('ok\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:16:58 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-f4c39777-b01c-4835-9ae4-ad8cddf367ad tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Flushing IO for device /dev/sdb {{(pid=73449) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 12:16:58 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:16:58 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:16:58 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[98122bc2-9d2b-4d67-b4b3-312c3ad3f1ef]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:16:58 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-f4c39777-b01c-4835-9ae4-ad8cddf367ad tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73449) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 12:16:58 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:16:58 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:16:58 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[52e597a4-bfc2-403b-9a8f-9bf10b673c06]: (4, ('1', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:16:58 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-f4c39777-b01c-4835-9ae4-ad8cddf367ad tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73449) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 12:16:58 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-f4c39777-b01c-4835-9ae4-ad8cddf367ad tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] SCSI volumes sdb have been removed. {{(pid=73449) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 12:16:58 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c39777-b01c-4835-9ae4-ad8cddf367ad tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b06e821-f631-4206-87a5-59bb900062bd')] {{(pid=73449) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 12:16:58 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b06e821-f631-4206-87a5-59bb900062bd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:16:58 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b06e821-f631-4206-87a5-59bb900062bd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:16:58 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8d9615c-4239-4743-bba6-599de4f16047]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:16:58 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c39777-b01c-4835-9ae4-ad8cddf367ad tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:16:58 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b06e821-f631-4206-87a5-59bb900062bd -p 172.16.0.220:3260 --logout {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:16:58 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b06e821-f631-4206-87a5-59bb900062bd -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:16:58 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[6973f552-4885-4201-821d-8a84ab81eb45]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:5b06e821-f631-4206-87a5-59bb900062bd, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:5b06e821-f631-4206-87a5-59bb900062bd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:16:58 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c39777-b01c-4835-9ae4-ad8cddf367ad tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:5b06e821-f631-4206-87a5-59bb900062bd, portal: 172.16.0.220,3260]
Aug 17 12:16:58 user nova-compute[73449]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:5b06e821-f631-4206-87a5-59bb900062bd, portal: 172.16.0.220,3260] successful.
Aug 17 12:16:58 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:16:58 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b06e821-f631-4206-87a5-59bb900062bd -p 172.16.0.220:3260 --op delete {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:16:58 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b06e821-f631-4206-87a5-59bb900062bd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:16:58 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[40080fb1-2e8f-442f-91af-f85db2604883]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:16:58 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c39777-b01c-4835-9ae4-ad8cddf367ad tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:16:58 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-f4c39777-b01c-4835-9ae4-ad8cddf367ad tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.259s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 12:16:58 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c39777-b01c-4835-9ae4-ad8cddf367ad tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] <== disconnect_volume: return (261ms) None {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 12:16:58 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4c39777-b01c-4835-9ae4-ad8cddf367ad tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] Disconnected iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 12:16:59 user nova-compute[73449]: DEBUG nova.objects.instance [None req-f4c39777-b01c-4835-9ae4-ad8cddf367ad tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Lazy-loading 'flavor' on Instance uuid ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:16:59 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-f4c39777-b01c-4835-9ae4-ad8cddf367ad tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Lock "ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.590s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:17:03 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:17:08 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:17:08 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:17:08 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73449) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 12:17:08 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:17:08 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:17:08 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:17:10 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:17:10 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Triggering sync for uuid ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d {{(pid=73449) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 12:17:10 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:17:10 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:17:10 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.027s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:17:13 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:17:13 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:17:13 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73449) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 12:17:13 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:17:13 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:17:13 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:17:13 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:17:17 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:17:17 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:17:17 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:17:18 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:17:20 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:17:20 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:17:20 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73449) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 12:17:23 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:17:23 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:17:23 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73449) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 12:17:23 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:17:23 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:17:23 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:17:24 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:17:24 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:17:24 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:17:24 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:17:24 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=73449) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 12:17:25 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:17:25 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:17:25 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:17:25 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:17:25 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 12:17:25 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 12:17:25 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Hypervisor/Node resource view: name=user free_ram=8668MB free_disk=25.05109405517578GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73449) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 12:17:25 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:17:25 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:17:26 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 12:17:26 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73449) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 12:17:26 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73449) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 12:17:26 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Refreshing inventories for resource provider 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 17 12:17:26 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Updating ProviderTree inventory for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 17 12:17:26 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Updating inventory in ProviderTree for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 12:17:26 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Refreshing aggregate associations for resource provider 20986bee-3f54-4b89-bec1-f8387ef700c4, aggregates: None {{(pid=73449) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 17 12:17:26 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Refreshing trait associations for resource provider 20986bee-3f54-4b89-bec1-f8387ef700c4, traits: COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NODE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE42,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSSE3,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_ISO {{(pid=73449) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 17 12:17:26 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 12:17:26 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 12:17:26 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Compute_service record updated for user:user {{(pid=73449) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 12:17:26 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.502s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:17:28 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:17:28 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:17:28 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73449) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 12:17:28 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:17:28 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:17:28 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:17:29 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:17:29 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Starting heal instance info cache {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 12:17:29 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "refresh_cache-ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 12:17:29 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquired lock "refresh_cache-ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 12:17:29 user nova-compute[73449]: DEBUG nova.network.neutron [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] Forcefully refreshing network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 12:17:29 user nova-compute[73449]: DEBUG nova.network.neutron [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] Updating instance_info_cache with network_info: [{"id": "3360223f-60df-4be9-ba80-3bb2baf444a2", "address": "fa:16:3e:79:15:ac", "network": {"id": "eebeaab2-1a00-4da6-a475-c2eda7a17090", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1522507326-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "280c999654434edd8f5288786756f2ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3360223f-60", "ovs_interfaceid": "3360223f-60df-4be9-ba80-3bb2baf444a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 12:17:29 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Releasing lock "refresh_cache-ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 12:17:29 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] Updated the network info_cache for instance {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 12:17:29 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:17:33 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:17:38 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:17:38 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:17:38 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73449) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 12:17:38 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:17:38 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:17:38 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:17:43 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:17:48 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:17:50 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:17:51 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:17:52 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-761c6175-10c4-4384-ac96-9de0aac3553d tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Acquiring lock "ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:17:52 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-761c6175-10c4-4384-ac96-9de0aac3553d tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Lock "ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:17:52 user nova-compute[73449]: DEBUG nova.objects.instance [None req-761c6175-10c4-4384-ac96-9de0aac3553d tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Lazy-loading 'flavor' on Instance uuid ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:17:52 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-761c6175-10c4-4384-ac96-9de0aac3553d tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Lock "ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:17:52 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-761c6175-10c4-4384-ac96-9de0aac3553d tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Acquiring lock "ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:17:52 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-761c6175-10c4-4384-ac96-9de0aac3553d tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Lock "ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:17:52 user nova-compute[73449]: INFO nova.compute.manager [None req-761c6175-10c4-4384-ac96-9de0aac3553d tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] Attaching volume 4c1457ab-113c-4ecf-bbf2-16c2f08de934 to /dev/vdb
Aug 17 12:17:52 user nova-compute[73449]: DEBUG os_brick.utils [None req-761c6175-10c4-4384-ac96-9de0aac3553d tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 12:17:52 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:17:52 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:17:52 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[cecf42af-a8fc-442c-8115-5facb693d1ba]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4d3924302012\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:17:52 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:17:52 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:17:52 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[434ed31e-17a3-4a7a-95f7-86c2fd8d1a76]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:17:52 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:17:52 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:17:52 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eeeec16-1586-44b1-ba33-8ef04f8a96c2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:17:52 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[79898ab2-9c4a-461e-a8b9-b3d129802462]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:17:52 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-761c6175-10c4-4384-ac96-9de0aac3553d tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Running cmd (subprocess): nvme version {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:17:52 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-761c6175-10c4-4384-ac96-9de0aac3553d tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] 'nvme version' failed. Not Retrying. {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 12:17:52 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.nvmeof [None req-761c6175-10c4-4384-ac96-9de0aac3553d tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] nvme not present on system {{(pid=73449) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 12:17:52 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:17:52 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 12:17:52 user nova-compute[73449]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 12:17:52 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[97848c33-3b41-4837-b558-ba78b6f3418b]: (4, '') {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:17:52 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-761c6175-10c4-4384-ac96-9de0aac3553d tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73449) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 12:17:52 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-761c6175-10c4-4384-ac96-9de0aac3553d tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73449) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 12:17:52 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-761c6175-10c4-4384-ac96-9de0aac3553d tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] LIGHTOS: no hostnqn found. {{(pid=73449) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 12:17:52 user nova-compute[73449]: DEBUG os_brick.utils [None req-761c6175-10c4-4384-ac96-9de0aac3553d tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4d3924302012', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 12:17:52 user nova-compute[73449]: DEBUG nova.virt.block_device [None req-761c6175-10c4-4384-ac96-9de0aac3553d tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] Updating existing volume attachment record: 408fd094-e2c5-414f-a09c-32aef89fe7d2 {{(pid=73449) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 12:17:53 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:17:54 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:17:58 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:18:03 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-761c6175-10c4-4384-ac96-9de0aac3553d tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] Calling os-brick to attach iSCSI Volume {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 12:18:03 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-761c6175-10c4-4384-ac96-9de0aac3553d tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4c1457ab-113c-4ecf-bbf2-16c2f08de934'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SCJinNlf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 12:18:03 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-761c6175-10c4-4384-ac96-9de0aac3553d tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 12:18:03 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-761c6175-10c4-4384-ac96-9de0aac3553d tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 12:18:03 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-761c6175-10c4-4384-ac96-9de0aac3553d tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 12:18:03 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-761c6175-10c4-4384-ac96-9de0aac3553d tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 12:18:03 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-761c6175-10c4-4384-ac96-9de0aac3553d tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4c1457ab-113c-4ecf-bbf2-16c2f08de934" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 12:18:03 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-761c6175-10c4-4384-ac96-9de0aac3553d tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4c1457ab-113c-4ecf-bbf2-16c2f08de934" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 12:18:03 user nova-compute[73449]: INFO os_brick.initiator.connectors.iscsi [None req-761c6175-10c4-4384-ac96-9de0aac3553d tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 12:18:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c1457ab-113c-4ecf-bbf2-16c2f08de934 -p 172.16.0.220:3260 {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:18:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c1457ab-113c-4ecf-bbf2-16c2f08de934 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:18:03 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb1e201a-f2da-424e-afdc-44314695152a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:18:03 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-761c6175-10c4-4384-ac96-9de0aac3553d tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 12:18:03 user nova-compute[73449]:  {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:18:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c1457ab-113c-4ecf-bbf2-16c2f08de934 -p 172.16.0.220:3260 --interface default --op new {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:18:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c1457ab-113c-4ecf-bbf2-16c2f08de934 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:18:03 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[41204445-49b4-48a8-a024-8f5b3752714a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4c1457ab-113c-4ecf-bbf2-16c2f08de934] added\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:18:03 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-761c6175-10c4-4384-ac96-9de0aac3553d tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4c1457ab-113c-4ecf-bbf2-16c2f08de934] added
Aug 17 12:18:03 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:18:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c1457ab-113c-4ecf-bbf2-16c2f08de934 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:18:03 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:18:03 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:18:03 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73449) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 12:18:03 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:18:03 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:18:03 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:18:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c1457ab-113c-4ecf-bbf2-16c2f08de934 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:18:03 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[99c46b1b-d5b7-4720-980c-25a918afe21d]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:18:03 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-761c6175-10c4-4384-ac96-9de0aac3553d tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:18:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c1457ab-113c-4ecf-bbf2-16c2f08de934 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:18:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c1457ab-113c-4ecf-bbf2-16c2f08de934 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.037s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:18:03 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab83fe6d-c0bd-4952-96b2-199b507a19cb]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:18:03 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-761c6175-10c4-4384-ac96-9de0aac3553d tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:18:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c1457ab-113c-4ecf-bbf2-16c2f08de934 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SCJinNlf {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:18:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c1457ab-113c-4ecf-bbf2-16c2f08de934 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SCJinNlf" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:18:03 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[898abf5d-a6b9-436a-b61b-34c79c378788]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:18:03 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-761c6175-10c4-4384-ac96-9de0aac3553d tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SCJinNlf'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:18:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c1457ab-113c-4ecf-bbf2-16c2f08de934 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:18:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c1457ab-113c-4ecf-bbf2-16c2f08de934 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:18:03 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4118d97-27c6-4661-82b5-67ef69da6ee1]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:18:03 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-761c6175-10c4-4384-ac96-9de0aac3553d tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:18:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:18:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:18:03 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae14e3a-8711-4afd-87ca-642e4fa06791]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:18:03 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-761c6175-10c4-4384-ac96-9de0aac3553d tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 17 12:18:03 user nova-compute[73449]:  {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 12:18:03 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-761c6175-10c4-4384-ac96-9de0aac3553d tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 17 12:18:03 user nova-compute[73449]:  {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 12:18:03 user nova-compute[73449]: WARNING os_brick.initiator.connectors.iscsi [None req-761c6175-10c4-4384-ac96-9de0aac3553d tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 17 12:18:03 user nova-compute[73449]: 
Aug 17 12:18:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c1457ab-113c-4ecf-bbf2-16c2f08de934 -p 172.16.0.220:3260 --login {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:18:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c1457ab-113c-4ecf-bbf2-16c2f08de934 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:18:03 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaa82771-5c42-4128-bb43-8101badd4e65]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4c1457ab-113c-4ecf-bbf2-16c2f08de934, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4c1457ab-113c-4ecf-bbf2-16c2f08de934, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:18:03 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-761c6175-10c4-4384-ac96-9de0aac3553d tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4c1457ab-113c-4ecf-bbf2-16c2f08de934, portal: 172.16.0.220,3260]
Aug 17 12:18:03 user nova-compute[73449]: Login to [iface: default, target: iqn.2010-10.org.openstack:4c1457ab-113c-4ecf-bbf2-16c2f08de934, portal: 172.16.0.220,3260] successful.
Aug 17 12:18:03 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:18:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c1457ab-113c-4ecf-bbf2-16c2f08de934 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:18:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c1457ab-113c-4ecf-bbf2-16c2f08de934 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:18:03 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0abc439-2d68-4cc1-a024-0159fc59b923]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:18:03 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-761c6175-10c4-4384-ac96-9de0aac3553d tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:18:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:18:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:18:03 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[e68a4ff1-11a8-4288-985b-42e52ceb7c59]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c1457ab-113c-4ecf-bbf2-16c2f08de934 (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:18:03 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-761c6175-10c4-4384-ac96-9de0aac3553d tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c1457ab-113c-4ecf-bbf2-16c2f08de934 (non-flash)
Aug 17 12:18:03 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 12:18:03 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-761c6175-10c4-4384-ac96-9de0aac3553d tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c1457ab-113c-4ecf-bbf2-16c2f08de934 (non-flash)
Aug 17 12:18:03 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 12:18:03 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-761c6175-10c4-4384-ac96-9de0aac3553d tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4c1457ab-113c-4ecf-bbf2-16c2f08de934" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 12:18:03 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-761c6175-10c4-4384-ac96-9de0aac3553d tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Connected to 172.16.0.220:3260 {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 12:18:03 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-761c6175-10c4-4384-ac96-9de0aac3553d tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] HCTL ('33', '-', '-', 0) found on session 61 with lun 0 {{(pid=73449) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 12:18:03 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-761c6175-10c4-4384-ac96-9de0aac3553d tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73449) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 12:18:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:18:03 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:18:03 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ac24271-364b-4598-a095-fe9a79700c79]: (4, ('- - 0', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:18:03 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-761c6175-10c4-4384-ac96-9de0aac3553d tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73449) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 12:18:03 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-761c6175-10c4-4384-ac96-9de0aac3553d tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SCJinNlf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 12:18:04 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-761c6175-10c4-4384-ac96-9de0aac3553d tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 12:18:04 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-761c6175-10c4-4384-ac96-9de0aac3553d tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] <== connect_volume: return (1324ms) {'type': 'block', 'scsi_wwn': '26461636136383466', 'path': '/dev/sdb'} {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 12:18:04 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-761c6175-10c4-4384-ac96-9de0aac3553d tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26461636136383466', 'path': '/dev/sdb'} {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 12:18:04 user nova-compute[73449]: DEBUG nova.objects.instance [None req-761c6175-10c4-4384-ac96-9de0aac3553d tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Lazy-loading 'flavor' on Instance uuid ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:18:04 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-761c6175-10c4-4384-ac96-9de0aac3553d tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 12:18:04 user nova-compute[73449]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 12:18:04 user nova-compute[73449]:   <source dev="/dev/sdb"/>
Aug 17 12:18:04 user nova-compute[73449]:   <target dev="vdb" bus="virtio"/>
Aug 17 12:18:04 user nova-compute[73449]:   <serial>4c1457ab-113c-4ecf-bbf2-16c2f08de934</serial>
Aug 17 12:18:04 user nova-compute[73449]: </disk>
Aug 17 12:18:04 user nova-compute[73449]:  {{(pid=73449) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 12:18:04 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-761c6175-10c4-4384-ac96-9de0aac3553d tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] No BDM found with device name vda, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 12:18:04 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-761c6175-10c4-4384-ac96-9de0aac3553d tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 12:18:04 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-761c6175-10c4-4384-ac96-9de0aac3553d tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] No VIF found with MAC fa:16:3e:79:15:ac, not building metadata {{(pid=73449) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 12:18:05 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-761c6175-10c4-4384-ac96-9de0aac3553d tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Lock "ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.282s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:18:07 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-d1d19f01-4ed2-426d-bbb3-f3bdafd261c7 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Acquiring lock "ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:18:07 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-d1d19f01-4ed2-426d-bbb3-f3bdafd261c7 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Lock "ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:18:07 user nova-compute[73449]: INFO nova.compute.manager [None req-d1d19f01-4ed2-426d-bbb3-f3bdafd261c7 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] Detaching volume 4c1457ab-113c-4ecf-bbf2-16c2f08de934
Aug 17 12:18:07 user nova-compute[73449]: INFO nova.virt.block_device [None req-d1d19f01-4ed2-426d-bbb3-f3bdafd261c7 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] Attempting to driver detach volume 4c1457ab-113c-4ecf-bbf2-16c2f08de934 from mountpoint /dev/vdb
Aug 17 12:18:07 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-d1d19f01-4ed2-426d-bbb3-f3bdafd261c7 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Attempting to detach device vdb from instance ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d from the persistent domain config. {{(pid=73449) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 12:18:07 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-d1d19f01-4ed2-426d-bbb3-f3bdafd261c7 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 12:18:07 user nova-compute[73449]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 12:18:07 user nova-compute[73449]:   <source dev="/dev/sdb"/>
Aug 17 12:18:07 user nova-compute[73449]:   <target dev="vdb" bus="virtio"/>
Aug 17 12:18:07 user nova-compute[73449]:   <serial>4c1457ab-113c-4ecf-bbf2-16c2f08de934</serial>
Aug 17 12:18:07 user nova-compute[73449]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 12:18:07 user nova-compute[73449]: </disk>
Aug 17 12:18:07 user nova-compute[73449]:  {{(pid=73449) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 12:18:07 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-d1d19f01-4ed2-426d-bbb3-f3bdafd261c7 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Successfully detached device vdb from instance ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d from the persistent domain config.
Aug 17 12:18:07 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-d1d19f01-4ed2-426d-bbb3-f3bdafd261c7 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d from the live domain config. {{(pid=73449) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 12:18:07 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-d1d19f01-4ed2-426d-bbb3-f3bdafd261c7 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 12:18:07 user nova-compute[73449]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 12:18:07 user nova-compute[73449]:   <source dev="/dev/sdb"/>
Aug 17 12:18:07 user nova-compute[73449]:   <target dev="vdb" bus="virtio"/>
Aug 17 12:18:07 user nova-compute[73449]:   <serial>4c1457ab-113c-4ecf-bbf2-16c2f08de934</serial>
Aug 17 12:18:07 user nova-compute[73449]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 12:18:07 user nova-compute[73449]: </disk>
Aug 17 12:18:07 user nova-compute[73449]:  {{(pid=73449) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 12:18:08 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Received event <DeviceRemovedEvent: 1692274688.1293874, ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73449) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 12:18:08 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-d1d19f01-4ed2-426d-bbb3-f3bdafd261c7 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d {{(pid=73449) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 12:18:08 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-d1d19f01-4ed2-426d-bbb3-f3bdafd261c7 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Successfully detached device vdb from instance ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d from the live domain config.
Aug 17 12:18:08 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1d19f01-4ed2-426d-bbb3-f3bdafd261c7 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] calling os-brick to detach iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 12:18:08 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1d19f01-4ed2-426d-bbb3-f3bdafd261c7 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, {'target_iqns': ['iqn.2010-10.org.openstack:4c1457ab-113c-4ecf-bbf2-16c2f08de934'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SCJinNlf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 12:18:08 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-d1d19f01-4ed2-426d-bbb3-f3bdafd261c7 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 12:18:08 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-d1d19f01-4ed2-426d-bbb3-f3bdafd261c7 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 12:18:08 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-d1d19f01-4ed2-426d-bbb3-f3bdafd261c7 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 12:18:08 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1d19f01-4ed2-426d-bbb3-f3bdafd261c7 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4c1457ab-113c-4ecf-bbf2-16c2f08de934', 0)] {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 12:18:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:18:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:18:08 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bba0af6-b441-4b27-8b19-0ac0ab330984]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4c1457ab-113c-4ecf-bbf2-16c2f08de934\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:18:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:18:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:18:08 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fee7948-f968-45b9-b331-0177c184533d]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c1457ab-113c-4ecf-bbf2-16c2f08de934 (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:18:08 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1d19f01-4ed2-426d-bbb3-f3bdafd261c7 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c1457ab-113c-4ecf-bbf2-16c2f08de934 (non-flash)
Aug 17 12:18:08 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 12:18:08 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1d19f01-4ed2-426d-bbb3-f3bdafd261c7 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c1457ab-113c-4ecf-bbf2-16c2f08de934 (non-flash)
Aug 17 12:18:08 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 12:18:08 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1d19f01-4ed2-426d-bbb3-f3bdafd261c7 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe7582da5f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4c1457ab-113c-4ecf-bbf2-16c2f08de934'): ({'sdb'}, set())}) {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 12:18:08 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-d1d19f01-4ed2-426d-bbb3-f3bdafd261c7 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Removing single pathed devices sdb {{(pid=73449) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 12:18:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:18:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:18:08 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[a36f754a-3458-4ce1-9832-866ca2a41197]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:18:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:18:08 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:18:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:18:08 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[17115d7a-e1d3-4aeb-a216-ddd2f293aa4e]: (4, ('ok\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:18:08 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-d1d19f01-4ed2-426d-bbb3-f3bdafd261c7 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Flushing IO for device /dev/sdb {{(pid=73449) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 12:18:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:18:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:18:08 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[a33da20f-1d5c-4b08-86d9-bf0d581221d4]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:18:08 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-d1d19f01-4ed2-426d-bbb3-f3bdafd261c7 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73449) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 12:18:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:18:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:18:08 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[185e1ab6-102f-4342-b0b2-562f70318641]: (4, ('1', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:18:08 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-d1d19f01-4ed2-426d-bbb3-f3bdafd261c7 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73449) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 12:18:08 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-d1d19f01-4ed2-426d-bbb3-f3bdafd261c7 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] SCSI volumes sdb have been removed. {{(pid=73449) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 12:18:08 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1d19f01-4ed2-426d-bbb3-f3bdafd261c7 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4c1457ab-113c-4ecf-bbf2-16c2f08de934')] {{(pid=73449) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 12:18:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c1457ab-113c-4ecf-bbf2-16c2f08de934 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:18:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c1457ab-113c-4ecf-bbf2-16c2f08de934 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:18:08 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[917d812c-5ce0-42fd-a6b1-1d815fd3b139]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:18:08 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1d19f01-4ed2-426d-bbb3-f3bdafd261c7 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:18:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c1457ab-113c-4ecf-bbf2-16c2f08de934 -p 172.16.0.220:3260 --logout {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:18:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c1457ab-113c-4ecf-bbf2-16c2f08de934 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:18:08 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[aab488bf-5253-4166-bdc5-2d7f9327f3fa]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:4c1457ab-113c-4ecf-bbf2-16c2f08de934, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:4c1457ab-113c-4ecf-bbf2-16c2f08de934, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:18:08 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1d19f01-4ed2-426d-bbb3-f3bdafd261c7 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:4c1457ab-113c-4ecf-bbf2-16c2f08de934, portal: 172.16.0.220,3260]
Aug 17 12:18:08 user nova-compute[73449]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:4c1457ab-113c-4ecf-bbf2-16c2f08de934, portal: 172.16.0.220,3260] successful.
Aug 17 12:18:08 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:18:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c1457ab-113c-4ecf-bbf2-16c2f08de934 -p 172.16.0.220:3260 --op delete {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:18:08 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c1457ab-113c-4ecf-bbf2-16c2f08de934 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:18:08 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[e10a7623-4cd2-42e6-873e-dd11bc570175]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:18:08 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1d19f01-4ed2-426d-bbb3-f3bdafd261c7 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:18:08 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-d1d19f01-4ed2-426d-bbb3-f3bdafd261c7 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 12:18:08 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1d19f01-4ed2-426d-bbb3-f3bdafd261c7 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] <== disconnect_volume: return (306ms) None {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 12:18:08 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1d19f01-4ed2-426d-bbb3-f3bdafd261c7 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] Disconnected iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 12:18:09 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:18:09 user nova-compute[73449]: DEBUG nova.objects.instance [None req-d1d19f01-4ed2-426d-bbb3-f3bdafd261c7 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Lazy-loading 'flavor' on Instance uuid ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:18:09 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-d1d19f01-4ed2-426d-bbb3-f3bdafd261c7 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Lock "ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.752s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:18:13 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:18:15 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:18:17 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:18:18 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:18:18 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:18:18 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73449) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 12:18:18 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:18:18 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:18:18 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:18:18 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:18:19 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:18:21 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:18:21 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:18:22 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:18:22 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73449) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 12:18:23 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:18:23 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:18:23 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73449) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 12:18:23 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:18:23 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:18:23 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:18:25 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:18:25 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:18:25 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:18:25 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:18:25 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=73449) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 12:18:26 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:18:26 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:18:26 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:18:26 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:18:26 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 12:18:26 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 12:18:26 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Hypervisor/Node resource view: name=user free_ram=8703MB free_disk=25.040176391601562GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73449) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 12:18:26 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:18:26 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:18:26 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 12:18:26 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73449) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 12:18:26 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73449) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 12:18:27 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 12:18:27 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 12:18:27 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Compute_service record updated for user:user {{(pid=73449) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 12:18:27 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.192s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:18:28 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:18:30 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:18:30 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Starting heal instance info cache {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 12:18:30 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Rebuilding the list of instances to heal {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 12:18:30 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "refresh_cache-ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 12:18:30 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquired lock "refresh_cache-ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 12:18:30 user nova-compute[73449]: DEBUG nova.network.neutron [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] Forcefully refreshing network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 12:18:30 user nova-compute[73449]: DEBUG nova.objects.instance [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lazy-loading 'info_cache' on Instance uuid ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:18:30 user nova-compute[73449]: DEBUG nova.network.neutron [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] Updating instance_info_cache with network_info: [{"id": "3360223f-60df-4be9-ba80-3bb2baf444a2", "address": "fa:16:3e:79:15:ac", "network": {"id": "eebeaab2-1a00-4da6-a475-c2eda7a17090", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1522507326-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "280c999654434edd8f5288786756f2ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3360223f-60", "ovs_interfaceid": "3360223f-60df-4be9-ba80-3bb2baf444a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 12:18:30 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Releasing lock "refresh_cache-ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 12:18:30 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] Updated the network info_cache for instance {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 12:18:30 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:18:33 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:18:38 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:18:38 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:18:38 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73449) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 12:18:38 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:18:38 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:18:38 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:18:43 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:18:48 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:18:53 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:18:58 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:18:58 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:18:58 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73449) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 12:18:58 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:18:58 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:18:58 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:19:01 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-f46b7b6f-ec09-415b-b06e-f7bd141812f5 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Acquiring lock "ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:19:01 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-f46b7b6f-ec09-415b-b06e-f7bd141812f5 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Lock "ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:19:01 user nova-compute[73449]: DEBUG nova.objects.instance [None req-f46b7b6f-ec09-415b-b06e-f7bd141812f5 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Lazy-loading 'flavor' on Instance uuid ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:19:01 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-f46b7b6f-ec09-415b-b06e-f7bd141812f5 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Lock "ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:19:01 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-f46b7b6f-ec09-415b-b06e-f7bd141812f5 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Acquiring lock "ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:19:01 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-f46b7b6f-ec09-415b-b06e-f7bd141812f5 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Lock "ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:19:01 user nova-compute[73449]: INFO nova.compute.manager [None req-f46b7b6f-ec09-415b-b06e-f7bd141812f5 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] Attaching volume d80bfcdf-51f8-4175-a774-3d651ac9936e to /dev/vdb
Aug 17 12:19:01 user nova-compute[73449]: DEBUG os_brick.utils [None req-f46b7b6f-ec09-415b-b06e-f7bd141812f5 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 12:19:01 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:19:01 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:19:01 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[91bbc82a-9c64-4daa-9ba6-f9566938727a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4d3924302012\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:19:01 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:19:01 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:19:01 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[666f76b1-7943-45a3-8abc-f4600befd867]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:19:01 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:19:01 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:19:01 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebf170bb-9833-428c-9b3d-932c89ac5ef2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:19:01 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bfbb8c2-5853-4f60-86e2-7fb0b98c9d61]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:19:01 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-f46b7b6f-ec09-415b-b06e-f7bd141812f5 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Running cmd (subprocess): nvme version {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:19:02 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-f46b7b6f-ec09-415b-b06e-f7bd141812f5 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] 'nvme version' failed. Not Retrying. {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 12:19:02 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f46b7b6f-ec09-415b-b06e-f7bd141812f5 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] nvme not present on system {{(pid=73449) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 12:19:02 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:19:02 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 12:19:02 user nova-compute[73449]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 12:19:02 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[9617d2f2-1b22-4131-8091-65d2c66403b0]: (4, '') {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:19:02 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-f46b7b6f-ec09-415b-b06e-f7bd141812f5 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73449) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 12:19:02 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-f46b7b6f-ec09-415b-b06e-f7bd141812f5 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73449) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 12:19:02 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-f46b7b6f-ec09-415b-b06e-f7bd141812f5 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] LIGHTOS: no hostnqn found. {{(pid=73449) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 12:19:02 user nova-compute[73449]: DEBUG os_brick.utils [None req-f46b7b6f-ec09-415b-b06e-f7bd141812f5 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4d3924302012', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 12:19:02 user nova-compute[73449]: DEBUG nova.virt.block_device [None req-f46b7b6f-ec09-415b-b06e-f7bd141812f5 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] Updating existing volume attachment record: 944b64bc-e2e1-4806-8fd4-d3634de28dfc {{(pid=73449) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 12:19:03 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:19:04 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:19:08 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:19:11 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f46b7b6f-ec09-415b-b06e-f7bd141812f5 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] Calling os-brick to attach iSCSI Volume {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 12:19:11 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-f46b7b6f-ec09-415b-b06e-f7bd141812f5 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d80bfcdf-51f8-4175-a774-3d651ac9936e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wOltbkeK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 12:19:11 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-f46b7b6f-ec09-415b-b06e-f7bd141812f5 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 12:19:11 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-f46b7b6f-ec09-415b-b06e-f7bd141812f5 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 12:19:11 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-f46b7b6f-ec09-415b-b06e-f7bd141812f5 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 12:19:11 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-f46b7b6f-ec09-415b-b06e-f7bd141812f5 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 12:19:11 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-f46b7b6f-ec09-415b-b06e-f7bd141812f5 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d80bfcdf-51f8-4175-a774-3d651ac9936e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 12:19:11 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-f46b7b6f-ec09-415b-b06e-f7bd141812f5 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d80bfcdf-51f8-4175-a774-3d651ac9936e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 12:19:11 user nova-compute[73449]: INFO os_brick.initiator.connectors.iscsi [None req-f46b7b6f-ec09-415b-b06e-f7bd141812f5 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 12:19:11 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d80bfcdf-51f8-4175-a774-3d651ac9936e -p 172.16.0.220:3260 {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:19:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d80bfcdf-51f8-4175-a774-3d651ac9936e -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:19:12 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[af4a3d72-4bd1-4620-8d03-8a92e4db71da]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:19:12 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-f46b7b6f-ec09-415b-b06e-f7bd141812f5 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 12:19:12 user nova-compute[73449]:  {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:19:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d80bfcdf-51f8-4175-a774-3d651ac9936e -p 172.16.0.220:3260 --interface default --op new {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:19:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d80bfcdf-51f8-4175-a774-3d651ac9936e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:19:12 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[75ca3999-c7fe-49e5-ac9a-fe05b7ba5e54]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d80bfcdf-51f8-4175-a774-3d651ac9936e] added\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:19:12 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-f46b7b6f-ec09-415b-b06e-f7bd141812f5 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d80bfcdf-51f8-4175-a774-3d651ac9936e] added
Aug 17 12:19:12 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:19:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d80bfcdf-51f8-4175-a774-3d651ac9936e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:19:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d80bfcdf-51f8-4175-a774-3d651ac9936e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:19:12 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5b3f025-0c66-4161-8894-2d3bbca93aaa]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:19:12 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-f46b7b6f-ec09-415b-b06e-f7bd141812f5 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:19:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d80bfcdf-51f8-4175-a774-3d651ac9936e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:19:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d80bfcdf-51f8-4175-a774-3d651ac9936e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:19:12 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d028eeb-ecec-4fae-8de8-5c64ac9bd45b]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:19:12 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-f46b7b6f-ec09-415b-b06e-f7bd141812f5 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:19:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d80bfcdf-51f8-4175-a774-3d651ac9936e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wOltbkeK {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:19:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d80bfcdf-51f8-4175-a774-3d651ac9936e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wOltbkeK" returned: 0 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:19:12 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bef8aaa-6613-4766-8358-5032811e0a72]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:19:12 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-f46b7b6f-ec09-415b-b06e-f7bd141812f5 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wOltbkeK'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:19:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d80bfcdf-51f8-4175-a774-3d651ac9936e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:19:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d80bfcdf-51f8-4175-a774-3d651ac9936e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:19:12 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[29774a0f-5134-4ce9-9680-d476089f3a61]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:19:12 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-f46b7b6f-ec09-415b-b06e-f7bd141812f5 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:19:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:19:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:19:12 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[4798faee-d7cc-45ed-af9e-60ec6fcde41f]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:19:12 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-f46b7b6f-ec09-415b-b06e-f7bd141812f5 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 17 12:19:12 user nova-compute[73449]:  {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 12:19:12 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-f46b7b6f-ec09-415b-b06e-f7bd141812f5 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 17 12:19:12 user nova-compute[73449]:  {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 12:19:12 user nova-compute[73449]: WARNING os_brick.initiator.connectors.iscsi [None req-f46b7b6f-ec09-415b-b06e-f7bd141812f5 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 17 12:19:12 user nova-compute[73449]: 
Aug 17 12:19:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d80bfcdf-51f8-4175-a774-3d651ac9936e -p 172.16.0.220:3260 --login {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:19:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d80bfcdf-51f8-4175-a774-3d651ac9936e -p 172.16.0.220:3260 --login" returned: 0 in 0.042s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:19:12 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[b046c6e6-6ea3-464a-9bd3-8f2d079c1204]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d80bfcdf-51f8-4175-a774-3d651ac9936e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d80bfcdf-51f8-4175-a774-3d651ac9936e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:19:12 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-f46b7b6f-ec09-415b-b06e-f7bd141812f5 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d80bfcdf-51f8-4175-a774-3d651ac9936e, portal: 172.16.0.220,3260]
Aug 17 12:19:12 user nova-compute[73449]: Login to [iface: default, target: iqn.2010-10.org.openstack:d80bfcdf-51f8-4175-a774-3d651ac9936e, portal: 172.16.0.220,3260] successful.
Aug 17 12:19:12 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:19:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d80bfcdf-51f8-4175-a774-3d651ac9936e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:19:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d80bfcdf-51f8-4175-a774-3d651ac9936e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:19:12 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[582cbf47-2dfc-4772-a881-9a2c70ec62d9]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:19:12 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-f46b7b6f-ec09-415b-b06e-f7bd141812f5 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:19:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:19:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:19:12 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[109de3e0-37ba-4cf2-a49a-d4827b1476e8]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d80bfcdf-51f8-4175-a774-3d651ac9936e (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:19:12 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-f46b7b6f-ec09-415b-b06e-f7bd141812f5 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d80bfcdf-51f8-4175-a774-3d651ac9936e (non-flash)
Aug 17 12:19:12 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 12:19:12 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-f46b7b6f-ec09-415b-b06e-f7bd141812f5 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d80bfcdf-51f8-4175-a774-3d651ac9936e (non-flash)
Aug 17 12:19:12 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 12:19:12 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-f46b7b6f-ec09-415b-b06e-f7bd141812f5 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d80bfcdf-51f8-4175-a774-3d651ac9936e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.252s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 12:19:12 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-f46b7b6f-ec09-415b-b06e-f7bd141812f5 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Connected to 172.16.0.220:3260 {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 12:19:12 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-f46b7b6f-ec09-415b-b06e-f7bd141812f5 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] HCTL ('33', '-', '-', 0) found on session 62 with lun 0 {{(pid=73449) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 12:19:12 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-f46b7b6f-ec09-415b-b06e-f7bd141812f5 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73449) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 12:19:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:19:12 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:19:12 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[96163aa6-8240-439b-8c71-db4cf6e5ca4f]: (4, ('- - 0', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:19:12 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-f46b7b6f-ec09-415b-b06e-f7bd141812f5 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73449) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 12:19:12 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-f46b7b6f-ec09-415b-b06e-f7bd141812f5 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wOltbkeK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 12:19:13 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-f46b7b6f-ec09-415b-b06e-f7bd141812f5 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.282s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 12:19:13 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-f46b7b6f-ec09-415b-b06e-f7bd141812f5 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] <== connect_volume: return (1284ms) {'type': 'block', 'scsi_wwn': '23266386631323032', 'path': '/dev/sdb'} {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 12:19:13 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f46b7b6f-ec09-415b-b06e-f7bd141812f5 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23266386631323032', 'path': '/dev/sdb'} {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 12:19:13 user nova-compute[73449]: DEBUG nova.objects.instance [None req-f46b7b6f-ec09-415b-b06e-f7bd141812f5 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Lazy-loading 'flavor' on Instance uuid ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:19:13 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-f46b7b6f-ec09-415b-b06e-f7bd141812f5 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 12:19:13 user nova-compute[73449]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 12:19:13 user nova-compute[73449]:   <source dev="/dev/sdb"/>
Aug 17 12:19:13 user nova-compute[73449]:   <target dev="vdb" bus="virtio"/>
Aug 17 12:19:13 user nova-compute[73449]:   <serial>d80bfcdf-51f8-4175-a774-3d651ac9936e</serial>
Aug 17 12:19:13 user nova-compute[73449]: </disk>
Aug 17 12:19:13 user nova-compute[73449]:  {{(pid=73449) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 12:19:13 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:19:13 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:19:13 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73449) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 12:19:13 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:19:13 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:19:13 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:19:13 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-f46b7b6f-ec09-415b-b06e-f7bd141812f5 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] No BDM found with device name vda, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 12:19:13 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-f46b7b6f-ec09-415b-b06e-f7bd141812f5 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 12:19:13 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-f46b7b6f-ec09-415b-b06e-f7bd141812f5 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] No VIF found with MAC fa:16:3e:79:15:ac, not building metadata {{(pid=73449) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 12:19:13 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-f46b7b6f-ec09-415b-b06e-f7bd141812f5 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Lock "ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.956s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:19:15 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:19:16 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-27c6d966-44cd-4e7b-8cce-6776b8268a71 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Acquiring lock "ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:19:16 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-27c6d966-44cd-4e7b-8cce-6776b8268a71 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Lock "ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:19:16 user nova-compute[73449]: INFO nova.compute.manager [None req-27c6d966-44cd-4e7b-8cce-6776b8268a71 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] Detaching volume d80bfcdf-51f8-4175-a774-3d651ac9936e
Aug 17 12:19:16 user nova-compute[73449]: INFO nova.virt.block_device [None req-27c6d966-44cd-4e7b-8cce-6776b8268a71 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] Attempting to driver detach volume d80bfcdf-51f8-4175-a774-3d651ac9936e from mountpoint /dev/vdb
Aug 17 12:19:16 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-27c6d966-44cd-4e7b-8cce-6776b8268a71 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Attempting to detach device vdb from instance ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d from the persistent domain config. {{(pid=73449) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 12:19:16 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-27c6d966-44cd-4e7b-8cce-6776b8268a71 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 12:19:16 user nova-compute[73449]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 12:19:16 user nova-compute[73449]:   <source dev="/dev/sdb"/>
Aug 17 12:19:16 user nova-compute[73449]:   <target dev="vdb" bus="virtio"/>
Aug 17 12:19:16 user nova-compute[73449]:   <serial>d80bfcdf-51f8-4175-a774-3d651ac9936e</serial>
Aug 17 12:19:16 user nova-compute[73449]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 12:19:16 user nova-compute[73449]: </disk>
Aug 17 12:19:16 user nova-compute[73449]:  {{(pid=73449) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 12:19:16 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-27c6d966-44cd-4e7b-8cce-6776b8268a71 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Successfully detached device vdb from instance ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d from the persistent domain config.
Aug 17 12:19:16 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-27c6d966-44cd-4e7b-8cce-6776b8268a71 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d from the live domain config. {{(pid=73449) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 12:19:16 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-27c6d966-44cd-4e7b-8cce-6776b8268a71 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 12:19:16 user nova-compute[73449]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 12:19:16 user nova-compute[73449]:   <source dev="/dev/sdb"/>
Aug 17 12:19:16 user nova-compute[73449]:   <target dev="vdb" bus="virtio"/>
Aug 17 12:19:16 user nova-compute[73449]:   <serial>d80bfcdf-51f8-4175-a774-3d651ac9936e</serial>
Aug 17 12:19:16 user nova-compute[73449]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 12:19:16 user nova-compute[73449]: </disk>
Aug 17 12:19:16 user nova-compute[73449]:  {{(pid=73449) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 12:19:16 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Received event <DeviceRemovedEvent: 1692274756.786004, ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73449) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 12:19:16 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-27c6d966-44cd-4e7b-8cce-6776b8268a71 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d {{(pid=73449) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 12:19:16 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-27c6d966-44cd-4e7b-8cce-6776b8268a71 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Successfully detached device vdb from instance ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d from the live domain config.
Aug 17 12:19:16 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27c6d966-44cd-4e7b-8cce-6776b8268a71 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] calling os-brick to detach iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 12:19:16 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c6d966-44cd-4e7b-8cce-6776b8268a71 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, {'target_iqns': ['iqn.2010-10.org.openstack:d80bfcdf-51f8-4175-a774-3d651ac9936e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wOltbkeK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 12:19:16 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-27c6d966-44cd-4e7b-8cce-6776b8268a71 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 12:19:16 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-27c6d966-44cd-4e7b-8cce-6776b8268a71 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 12:19:16 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-27c6d966-44cd-4e7b-8cce-6776b8268a71 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 12:19:16 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c6d966-44cd-4e7b-8cce-6776b8268a71 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d80bfcdf-51f8-4175-a774-3d651ac9936e', 0)] {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 12:19:16 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:19:16 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:19:16 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[47eca6af-d2a9-4460-94a1-a22cf0ccefe5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d80bfcdf-51f8-4175-a774-3d651ac9936e\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:19:16 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:19:16 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:19:16 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[329c9d95-9a97-42a0-98a0-d76e9d0471ef]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d80bfcdf-51f8-4175-a774-3d651ac9936e (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:19:16 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c6d966-44cd-4e7b-8cce-6776b8268a71 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d80bfcdf-51f8-4175-a774-3d651ac9936e (non-flash)
Aug 17 12:19:16 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 12:19:16 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c6d966-44cd-4e7b-8cce-6776b8268a71 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d80bfcdf-51f8-4175-a774-3d651ac9936e (non-flash)
Aug 17 12:19:16 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 12:19:16 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c6d966-44cd-4e7b-8cce-6776b8268a71 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe78508e3b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d80bfcdf-51f8-4175-a774-3d651ac9936e'): ({'sdb'}, set())}) {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 12:19:16 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-27c6d966-44cd-4e7b-8cce-6776b8268a71 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Removing single pathed devices sdb {{(pid=73449) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 12:19:16 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:19:16 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:19:16 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7938fde-8bc0-4153-97ff-a32745ea04a3]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:19:16 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:19:16 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:19:16 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[e183930e-0f28-4120-8bf4-4ebce3477f93]: (4, ('ok\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:19:16 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-27c6d966-44cd-4e7b-8cce-6776b8268a71 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Flushing IO for device /dev/sdb {{(pid=73449) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 12:19:16 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:19:16 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:19:16 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[62af6e49-2ad1-430e-bdba-6be0f1e534be]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:19:16 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-27c6d966-44cd-4e7b-8cce-6776b8268a71 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73449) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 12:19:16 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:19:16 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:19:16 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[065d9acf-b5a0-484b-a6a2-8a8da7001109]: (4, ('1', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:19:16 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-27c6d966-44cd-4e7b-8cce-6776b8268a71 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73449) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 12:19:16 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-27c6d966-44cd-4e7b-8cce-6776b8268a71 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] SCSI volumes sdb have been removed. {{(pid=73449) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 12:19:16 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c6d966-44cd-4e7b-8cce-6776b8268a71 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d80bfcdf-51f8-4175-a774-3d651ac9936e')] {{(pid=73449) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 12:19:16 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d80bfcdf-51f8-4175-a774-3d651ac9936e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:19:16 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d80bfcdf-51f8-4175-a774-3d651ac9936e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:19:16 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[62101f9b-87c5-4afd-9e2e-1ff92e37509d]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:19:16 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c6d966-44cd-4e7b-8cce-6776b8268a71 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:19:16 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d80bfcdf-51f8-4175-a774-3d651ac9936e -p 172.16.0.220:3260 --logout {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:19:17 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d80bfcdf-51f8-4175-a774-3d651ac9936e -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:19:17 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8d01efe-eac3-427c-af6d-3b84029d4fdb]: (4, ('Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:d80bfcdf-51f8-4175-a774-3d651ac9936e, portal: 172.16.0.220,3260]\nLogout of [sid: 62, target: iqn.2010-10.org.openstack:d80bfcdf-51f8-4175-a774-3d651ac9936e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:19:17 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c6d966-44cd-4e7b-8cce-6776b8268a71 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:d80bfcdf-51f8-4175-a774-3d651ac9936e, portal: 172.16.0.220,3260]
Aug 17 12:19:17 user nova-compute[73449]: Logout of [sid: 62, target: iqn.2010-10.org.openstack:d80bfcdf-51f8-4175-a774-3d651ac9936e, portal: 172.16.0.220,3260] successful.
Aug 17 12:19:17 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:19:17 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d80bfcdf-51f8-4175-a774-3d651ac9936e -p 172.16.0.220:3260 --op delete {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:19:17 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d80bfcdf-51f8-4175-a774-3d651ac9936e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:19:17 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[584894c5-0f16-4cbd-b5f0-a0db3ae475b8]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:19:17 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c6d966-44cd-4e7b-8cce-6776b8268a71 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:19:17 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-27c6d966-44cd-4e7b-8cce-6776b8268a71 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.250s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 12:19:17 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c6d966-44cd-4e7b-8cce-6776b8268a71 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] <== disconnect_volume: return (251ms) None {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 12:19:17 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27c6d966-44cd-4e7b-8cce-6776b8268a71 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] Disconnected iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 12:19:17 user nova-compute[73449]: DEBUG nova.objects.instance [None req-27c6d966-44cd-4e7b-8cce-6776b8268a71 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Lazy-loading 'flavor' on Instance uuid ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:19:17 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-27c6d966-44cd-4e7b-8cce-6776b8268a71 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Lock "ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.540s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:19:18 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:19:18 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:19:18 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73449) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 12:19:18 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:19:18 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:19:18 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:19:18 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:19:19 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:19:20 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:19:20 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:19:23 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:19:23 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:19:24 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:19:24 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73449) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 12:19:27 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:19:27 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:19:27 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:19:27 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:19:27 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=73449) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 12:19:28 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:19:28 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:19:28 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:19:28 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:19:28 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:19:28 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 12:19:28 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 12:19:28 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Hypervisor/Node resource view: name=user free_ram=8765MB free_disk=25.03882598876953GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73449) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 12:19:28 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:19:28 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:19:28 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 12:19:28 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73449) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 12:19:28 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73449) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 12:19:28 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 12:19:28 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 12:19:28 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Compute_service record updated for user:user {{(pid=73449) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 12:19:29 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.173s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:19:30 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:19:30 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Starting heal instance info cache {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 12:19:30 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Rebuilding the list of instances to heal {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 12:19:30 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "refresh_cache-ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 12:19:30 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquired lock "refresh_cache-ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 12:19:30 user nova-compute[73449]: DEBUG nova.network.neutron [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] Forcefully refreshing network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 12:19:30 user nova-compute[73449]: DEBUG nova.objects.instance [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lazy-loading 'info_cache' on Instance uuid ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:19:31 user nova-compute[73449]: DEBUG nova.network.neutron [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] Updating instance_info_cache with network_info: [{"id": "3360223f-60df-4be9-ba80-3bb2baf444a2", "address": "fa:16:3e:79:15:ac", "network": {"id": "eebeaab2-1a00-4da6-a475-c2eda7a17090", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1522507326-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "280c999654434edd8f5288786756f2ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3360223f-60", "ovs_interfaceid": "3360223f-60df-4be9-ba80-3bb2baf444a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 12:19:31 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Releasing lock "refresh_cache-ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 12:19:31 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] Updated the network info_cache for instance {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 12:19:31 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:19:33 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:19:38 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:19:38 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:19:38 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73449) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 12:19:38 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:19:38 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:19:38 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:19:43 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:19:43 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:19:43 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73449) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 12:19:43 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:19:43 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:19:43 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:19:48 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:19:53 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:19:53 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:19:53 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73449) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 12:19:53 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:19:53 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:19:53 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:19:58 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:19:58 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:19:58 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73449) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 12:19:58 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:19:58 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:19:58 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:20:03 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:20:08 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:20:08 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:20:08 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73449) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 12:20:08 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:20:08 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:20:08 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:20:10 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-80d7f687-23e1-460a-a9ec-2410bf63985d tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Acquiring lock "ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:20:10 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-80d7f687-23e1-460a-a9ec-2410bf63985d tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Lock "ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:20:10 user nova-compute[73449]: DEBUG nova.objects.instance [None req-80d7f687-23e1-460a-a9ec-2410bf63985d tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Lazy-loading 'flavor' on Instance uuid ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:20:10 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-80d7f687-23e1-460a-a9ec-2410bf63985d tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Lock "ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:20:11 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-80d7f687-23e1-460a-a9ec-2410bf63985d tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Acquiring lock "ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:20:11 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-80d7f687-23e1-460a-a9ec-2410bf63985d tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Lock "ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:20:11 user nova-compute[73449]: INFO nova.compute.manager [None req-80d7f687-23e1-460a-a9ec-2410bf63985d tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] Attaching volume 84db5209-e7c4-4e87-8fbe-e396d7c876d2 to /dev/vdb
Aug 17 12:20:11 user nova-compute[73449]: DEBUG os_brick.utils [None req-80d7f687-23e1-460a-a9ec-2410bf63985d tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 12:20:11 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:20:11 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:20:11 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[5020beab-ce97-40e1-95bf-7b5377ff0f62]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4d3924302012\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:20:11 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:20:11 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:20:11 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[33a8fd1b-bd1a-45f2-a48b-cbdfa6b78c47]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:20:11 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:20:11 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:20:11 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccb6fe43-c25c-46e8-b6fa-567621e64055]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:20:11 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[9de8e2e5-a25b-4a3c-8555-85e8a1362a5f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:20:11 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-80d7f687-23e1-460a-a9ec-2410bf63985d tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Running cmd (subprocess): nvme version {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:20:11 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-80d7f687-23e1-460a-a9ec-2410bf63985d tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] 'nvme version' failed. Not Retrying. {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 12:20:11 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.nvmeof [None req-80d7f687-23e1-460a-a9ec-2410bf63985d tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] nvme not present on system {{(pid=73449) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 12:20:11 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:20:11 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 12:20:11 user nova-compute[73449]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 12:20:11 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc6ec33-71d5-4371-80da-7f3e3d8d7084]: (4, '') {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:20:11 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-80d7f687-23e1-460a-a9ec-2410bf63985d tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73449) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 12:20:11 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-80d7f687-23e1-460a-a9ec-2410bf63985d tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73449) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 12:20:11 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-80d7f687-23e1-460a-a9ec-2410bf63985d tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] LIGHTOS: no hostnqn found. {{(pid=73449) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 12:20:11 user nova-compute[73449]: DEBUG os_brick.utils [None req-80d7f687-23e1-460a-a9ec-2410bf63985d tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4d3924302012', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 12:20:11 user nova-compute[73449]: DEBUG nova.virt.block_device [None req-80d7f687-23e1-460a-a9ec-2410bf63985d tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] Updating existing volume attachment record: 251d45dc-835e-4e63-80d6-c9f1b78c7224 {{(pid=73449) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 12:20:13 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:20:13 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:20:13 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73449) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 12:20:13 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:20:13 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:20:13 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:20:14 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:20:15 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:20:18 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:20:18 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:20:20 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:20:21 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80d7f687-23e1-460a-a9ec-2410bf63985d tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] Calling os-brick to attach iSCSI Volume {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 12:20:21 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-80d7f687-23e1-460a-a9ec-2410bf63985d tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:84db5209-e7c4-4e87-8fbe-e396d7c876d2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UNTkdSuM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 12:20:21 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-80d7f687-23e1-460a-a9ec-2410bf63985d tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 12:20:21 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-80d7f687-23e1-460a-a9ec-2410bf63985d tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 12:20:21 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-80d7f687-23e1-460a-a9ec-2410bf63985d tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 12:20:21 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-80d7f687-23e1-460a-a9ec-2410bf63985d tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 12:20:21 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-80d7f687-23e1-460a-a9ec-2410bf63985d tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84db5209-e7c4-4e87-8fbe-e396d7c876d2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 12:20:21 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-80d7f687-23e1-460a-a9ec-2410bf63985d tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84db5209-e7c4-4e87-8fbe-e396d7c876d2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 12:20:21 user nova-compute[73449]: INFO os_brick.initiator.connectors.iscsi [None req-80d7f687-23e1-460a-a9ec-2410bf63985d tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 12:20:21 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84db5209-e7c4-4e87-8fbe-e396d7c876d2 -p 172.16.0.220:3260 {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:20:21 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84db5209-e7c4-4e87-8fbe-e396d7c876d2 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:20:21 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[a81b6105-e3ec-4464-98ad-64e5c6151b9c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:20:21 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-80d7f687-23e1-460a-a9ec-2410bf63985d tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 12:20:21 user nova-compute[73449]:  {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:20:21 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84db5209-e7c4-4e87-8fbe-e396d7c876d2 -p 172.16.0.220:3260 --interface default --op new {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:20:21 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84db5209-e7c4-4e87-8fbe-e396d7c876d2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:20:21 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f29de63-e1e0-4137-a3e1-3fc7319d18e5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:84db5209-e7c4-4e87-8fbe-e396d7c876d2] added\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:20:21 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-80d7f687-23e1-460a-a9ec-2410bf63985d tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:84db5209-e7c4-4e87-8fbe-e396d7c876d2] added
Aug 17 12:20:21 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:20:21 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84db5209-e7c4-4e87-8fbe-e396d7c876d2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:20:21 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84db5209-e7c4-4e87-8fbe-e396d7c876d2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:20:21 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d0644fe-d01c-4b0c-878d-19479b037eea]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:20:21 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-80d7f687-23e1-460a-a9ec-2410bf63985d tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:20:21 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84db5209-e7c4-4e87-8fbe-e396d7c876d2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:20:21 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:20:21 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:20:21 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84db5209-e7c4-4e87-8fbe-e396d7c876d2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:20:21 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[d95d46bb-870e-4a5b-b2a1-9a979e583fb4]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:20:21 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-80d7f687-23e1-460a-a9ec-2410bf63985d tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:20:21 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84db5209-e7c4-4e87-8fbe-e396d7c876d2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UNTkdSuM {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:20:21 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84db5209-e7c4-4e87-8fbe-e396d7c876d2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UNTkdSuM" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:20:21 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0cea47f-17c9-4157-83ed-76e3cdb0dd59]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:20:21 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-80d7f687-23e1-460a-a9ec-2410bf63985d tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UNTkdSuM'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:20:21 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84db5209-e7c4-4e87-8fbe-e396d7c876d2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:20:22 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84db5209-e7c4-4e87-8fbe-e396d7c876d2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:20:22 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc772772-6970-4926-af74-7d831a743a5e]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:20:22 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-80d7f687-23e1-460a-a9ec-2410bf63985d tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:20:22 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:20:22 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:20:22 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a1cc53a-a475-4272-9265-8648b74ad717]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:20:22 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-80d7f687-23e1-460a-a9ec-2410bf63985d tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 17 12:20:22 user nova-compute[73449]:  {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 12:20:22 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-80d7f687-23e1-460a-a9ec-2410bf63985d tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 17 12:20:22 user nova-compute[73449]:  {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 12:20:22 user nova-compute[73449]: WARNING os_brick.initiator.connectors.iscsi [None req-80d7f687-23e1-460a-a9ec-2410bf63985d tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 17 12:20:22 user nova-compute[73449]: 
Aug 17 12:20:22 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84db5209-e7c4-4e87-8fbe-e396d7c876d2 -p 172.16.0.220:3260 --login {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:20:22 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84db5209-e7c4-4e87-8fbe-e396d7c876d2 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:20:22 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5414144-ba7d-4726-bddc-b7dc15d58f04]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:84db5209-e7c4-4e87-8fbe-e396d7c876d2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:84db5209-e7c4-4e87-8fbe-e396d7c876d2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:20:22 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-80d7f687-23e1-460a-a9ec-2410bf63985d tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:84db5209-e7c4-4e87-8fbe-e396d7c876d2, portal: 172.16.0.220,3260]
Aug 17 12:20:22 user nova-compute[73449]: Login to [iface: default, target: iqn.2010-10.org.openstack:84db5209-e7c4-4e87-8fbe-e396d7c876d2, portal: 172.16.0.220,3260] successful.
Aug 17 12:20:22 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:20:22 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84db5209-e7c4-4e87-8fbe-e396d7c876d2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:20:22 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84db5209-e7c4-4e87-8fbe-e396d7c876d2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:20:22 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[e458c604-eceb-43bb-9257-b91931859cec]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:20:22 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-80d7f687-23e1-460a-a9ec-2410bf63985d tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:20:22 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:20:22 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:20:22 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[79c62810-88c8-4321-8e27-0679bfccd5c9]: (4, ('tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84db5209-e7c4-4e87-8fbe-e396d7c876d2 (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:20:22 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-80d7f687-23e1-460a-a9ec-2410bf63985d tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84db5209-e7c4-4e87-8fbe-e396d7c876d2 (non-flash)
Aug 17 12:20:22 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 12:20:22 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-80d7f687-23e1-460a-a9ec-2410bf63985d tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] iscsi session list stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84db5209-e7c4-4e87-8fbe-e396d7c876d2 (non-flash)
Aug 17 12:20:22 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 12:20:22 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-80d7f687-23e1-460a-a9ec-2410bf63985d tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84db5209-e7c4-4e87-8fbe-e396d7c876d2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.256s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 12:20:22 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-80d7f687-23e1-460a-a9ec-2410bf63985d tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Connected to 172.16.0.220:3260 {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 12:20:22 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-80d7f687-23e1-460a-a9ec-2410bf63985d tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] HCTL ('33', '-', '-', 0) found on session 63 with lun 0 {{(pid=73449) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 12:20:22 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-80d7f687-23e1-460a-a9ec-2410bf63985d tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73449) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 12:20:22 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:20:22 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:20:22 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4139553-d3d2-4e01-90bf-05b4009c31b5]: (4, ('- - 0', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:20:22 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-80d7f687-23e1-460a-a9ec-2410bf63985d tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Searching for a device in session 63 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73449) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 12:20:22 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-80d7f687-23e1-460a-a9ec-2410bf63985d tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UNTkdSuM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 12:20:23 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-80d7f687-23e1-460a-a9ec-2410bf63985d tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.287s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 12:20:23 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-80d7f687-23e1-460a-a9ec-2410bf63985d tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] <== connect_volume: return (1289ms) {'type': 'block', 'scsi_wwn': '23662643865626636', 'path': '/dev/sdb'} {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 12:20:23 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80d7f687-23e1-460a-a9ec-2410bf63985d tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23662643865626636', 'path': '/dev/sdb'} {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 12:20:23 user nova-compute[73449]: DEBUG nova.objects.instance [None req-80d7f687-23e1-460a-a9ec-2410bf63985d tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Lazy-loading 'flavor' on Instance uuid ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:20:23 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-80d7f687-23e1-460a-a9ec-2410bf63985d tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 12:20:23 user nova-compute[73449]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 12:20:23 user nova-compute[73449]:   <source dev="/dev/sdb"/>
Aug 17 12:20:23 user nova-compute[73449]:   <target dev="vdb" bus="virtio"/>
Aug 17 12:20:23 user nova-compute[73449]:   <serial>84db5209-e7c4-4e87-8fbe-e396d7c876d2</serial>
Aug 17 12:20:23 user nova-compute[73449]: </disk>
Aug 17 12:20:23 user nova-compute[73449]:  {{(pid=73449) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 12:20:23 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:20:23 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:20:23 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73449) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 12:20:23 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:20:23 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:20:23 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:20:23 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-80d7f687-23e1-460a-a9ec-2410bf63985d tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] No BDM found with device name vda, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 12:20:23 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-80d7f687-23e1-460a-a9ec-2410bf63985d tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 12:20:23 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-80d7f687-23e1-460a-a9ec-2410bf63985d tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] No VIF found with MAC fa:16:3e:79:15:ac, not building metadata {{(pid=73449) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 12:20:23 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-80d7f687-23e1-460a-a9ec-2410bf63985d tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Lock "ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.363s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:20:24 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:20:24 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:20:24 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:20:24 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73449) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 12:20:25 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d87d68a-5b44-4a45-b892-a5508b006b5f tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Acquiring lock "ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:20:25 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d87d68a-5b44-4a45-b892-a5508b006b5f tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Lock "ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:20:25 user nova-compute[73449]: INFO nova.compute.manager [None req-6d87d68a-5b44-4a45-b892-a5508b006b5f tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] Detaching volume 84db5209-e7c4-4e87-8fbe-e396d7c876d2
Aug 17 12:20:26 user nova-compute[73449]: INFO nova.virt.block_device [None req-6d87d68a-5b44-4a45-b892-a5508b006b5f tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] Attempting to driver detach volume 84db5209-e7c4-4e87-8fbe-e396d7c876d2 from mountpoint /dev/vdb
Aug 17 12:20:26 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6d87d68a-5b44-4a45-b892-a5508b006b5f tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Attempting to detach device vdb from instance ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d from the persistent domain config. {{(pid=73449) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 12:20:26 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-6d87d68a-5b44-4a45-b892-a5508b006b5f tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 12:20:26 user nova-compute[73449]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 12:20:26 user nova-compute[73449]:   <source dev="/dev/sdb"/>
Aug 17 12:20:26 user nova-compute[73449]:   <target dev="vdb" bus="virtio"/>
Aug 17 12:20:26 user nova-compute[73449]:   <serial>84db5209-e7c4-4e87-8fbe-e396d7c876d2</serial>
Aug 17 12:20:26 user nova-compute[73449]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 12:20:26 user nova-compute[73449]: </disk>
Aug 17 12:20:26 user nova-compute[73449]:  {{(pid=73449) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 12:20:26 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-6d87d68a-5b44-4a45-b892-a5508b006b5f tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Successfully detached device vdb from instance ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d from the persistent domain config.
Aug 17 12:20:26 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6d87d68a-5b44-4a45-b892-a5508b006b5f tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d from the live domain config. {{(pid=73449) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 12:20:26 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-6d87d68a-5b44-4a45-b892-a5508b006b5f tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 12:20:26 user nova-compute[73449]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 12:20:26 user nova-compute[73449]:   <source dev="/dev/sdb"/>
Aug 17 12:20:26 user nova-compute[73449]:   <target dev="vdb" bus="virtio"/>
Aug 17 12:20:26 user nova-compute[73449]:   <serial>84db5209-e7c4-4e87-8fbe-e396d7c876d2</serial>
Aug 17 12:20:26 user nova-compute[73449]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 12:20:26 user nova-compute[73449]: </disk>
Aug 17 12:20:26 user nova-compute[73449]:  {{(pid=73449) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 12:20:26 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Received event <DeviceRemovedEvent: 1692274826.4529014, ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73449) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 12:20:26 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-6d87d68a-5b44-4a45-b892-a5508b006b5f tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d {{(pid=73449) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 12:20:26 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-6d87d68a-5b44-4a45-b892-a5508b006b5f tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Successfully detached device vdb from instance ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d from the live domain config.
Aug 17 12:20:26 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d87d68a-5b44-4a45-b892-a5508b006b5f tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] calling os-brick to detach iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 12:20:26 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d87d68a-5b44-4a45-b892-a5508b006b5f tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, {'target_iqns': ['iqn.2010-10.org.openstack:84db5209-e7c4-4e87-8fbe-e396d7c876d2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UNTkdSuM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 12:20:26 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-6d87d68a-5b44-4a45-b892-a5508b006b5f tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 12:20:26 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-6d87d68a-5b44-4a45-b892-a5508b006b5f tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 12:20:26 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-6d87d68a-5b44-4a45-b892-a5508b006b5f tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 12:20:26 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d87d68a-5b44-4a45-b892-a5508b006b5f tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84db5209-e7c4-4e87-8fbe-e396d7c876d2', 0)] {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 12:20:26 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:20:26 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:20:26 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8cdd253-8893-433e-9ad0-d3609560b1ed]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84db5209-e7c4-4e87-8fbe-e396d7c876d2\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:20:26 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:20:26 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:20:26 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc2c265d-713f-454e-bc25-4ed87b5cd2fd]: (4, ('tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84db5209-e7c4-4e87-8fbe-e396d7c876d2 (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:20:26 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d87d68a-5b44-4a45-b892-a5508b006b5f tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84db5209-e7c4-4e87-8fbe-e396d7c876d2 (non-flash)
Aug 17 12:20:26 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 12:20:26 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d87d68a-5b44-4a45-b892-a5508b006b5f tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] iscsi session list stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84db5209-e7c4-4e87-8fbe-e396d7c876d2 (non-flash)
Aug 17 12:20:26 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 12:20:26 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d87d68a-5b44-4a45-b892-a5508b006b5f tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe758571b40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84db5209-e7c4-4e87-8fbe-e396d7c876d2'): ({'sdb'}, set())}) {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 12:20:26 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-6d87d68a-5b44-4a45-b892-a5508b006b5f tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Removing single pathed devices sdb {{(pid=73449) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 12:20:26 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:20:26 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:20:26 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[04a99a5f-7aa8-47c6-89d2-244a5dd93de8]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:20:26 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:20:26 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:20:26 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[6146c5b0-486c-4eb9-a5de-3bad12f58c4a]: (4, ('ok\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:20:26 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-6d87d68a-5b44-4a45-b892-a5508b006b5f tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Flushing IO for device /dev/sdb {{(pid=73449) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 12:20:26 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:20:26 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:20:26 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e5536f0-541b-404f-ba30-58fad02208f3]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:20:26 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-6d87d68a-5b44-4a45-b892-a5508b006b5f tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73449) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 12:20:26 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:20:26 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.032s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:20:26 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[703143b2-99be-4494-aea2-ee45e4f5a930]: (4, ('1', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:20:26 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-6d87d68a-5b44-4a45-b892-a5508b006b5f tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73449) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 12:20:26 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-6d87d68a-5b44-4a45-b892-a5508b006b5f tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] SCSI volumes sdb have been removed. {{(pid=73449) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 12:20:26 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d87d68a-5b44-4a45-b892-a5508b006b5f tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84db5209-e7c4-4e87-8fbe-e396d7c876d2')] {{(pid=73449) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 12:20:26 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84db5209-e7c4-4e87-8fbe-e396d7c876d2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:20:26 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84db5209-e7c4-4e87-8fbe-e396d7c876d2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:20:26 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[288814d4-f7f7-4b62-a4d8-f1e2abea2d1f]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:20:26 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d87d68a-5b44-4a45-b892-a5508b006b5f tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:20:26 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84db5209-e7c4-4e87-8fbe-e396d7c876d2 -p 172.16.0.220:3260 --logout {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:20:26 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84db5209-e7c4-4e87-8fbe-e396d7c876d2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:20:26 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a42f3a6-7f8e-42e3-8c5c-a2034d23f479]: (4, ('Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:84db5209-e7c4-4e87-8fbe-e396d7c876d2, portal: 172.16.0.220,3260]\nLogout of [sid: 63, target: iqn.2010-10.org.openstack:84db5209-e7c4-4e87-8fbe-e396d7c876d2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:20:26 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d87d68a-5b44-4a45-b892-a5508b006b5f tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:84db5209-e7c4-4e87-8fbe-e396d7c876d2, portal: 172.16.0.220,3260]
Aug 17 12:20:26 user nova-compute[73449]: Logout of [sid: 63, target: iqn.2010-10.org.openstack:84db5209-e7c4-4e87-8fbe-e396d7c876d2, portal: 172.16.0.220,3260] successful.
Aug 17 12:20:26 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:20:26 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84db5209-e7c4-4e87-8fbe-e396d7c876d2 -p 172.16.0.220:3260 --op delete {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:20:26 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84db5209-e7c4-4e87-8fbe-e396d7c876d2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:20:26 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1711802-fcf3-4fa8-8433-d283e2482ece]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:20:26 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d87d68a-5b44-4a45-b892-a5508b006b5f tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:20:26 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-6d87d68a-5b44-4a45-b892-a5508b006b5f tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.241s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 12:20:26 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d87d68a-5b44-4a45-b892-a5508b006b5f tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] <== disconnect_volume: return (242ms) None {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 12:20:26 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d87d68a-5b44-4a45-b892-a5508b006b5f tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] Disconnected iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 12:20:27 user nova-compute[73449]: DEBUG nova.objects.instance [None req-6d87d68a-5b44-4a45-b892-a5508b006b5f tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Lazy-loading 'flavor' on Instance uuid ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:20:27 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d87d68a-5b44-4a45-b892-a5508b006b5f tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Lock "ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.607s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:20:28 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:20:29 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:20:29 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:20:29 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:20:29 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:20:29 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:20:29 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=73449) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 12:20:30 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:20:30 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:20:30 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:20:30 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:20:30 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 12:20:30 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 12:20:30 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Hypervisor/Node resource view: name=user free_ram=8753MB free_disk=25.03778076171875GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73449) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 12:20:30 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:20:30 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:20:30 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 12:20:30 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73449) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 12:20:30 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73449) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 12:20:30 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 12:20:30 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 12:20:31 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Compute_service record updated for user:user {{(pid=73449) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 12:20:31 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.160s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:20:32 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:20:32 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Starting heal instance info cache {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 12:20:32 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Rebuilding the list of instances to heal {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 12:20:32 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "refresh_cache-ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 12:20:32 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquired lock "refresh_cache-ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 12:20:32 user nova-compute[73449]: DEBUG nova.network.neutron [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] Forcefully refreshing network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 12:20:32 user nova-compute[73449]: DEBUG nova.objects.instance [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lazy-loading 'info_cache' on Instance uuid ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:20:32 user nova-compute[73449]: DEBUG nova.network.neutron [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] Updating instance_info_cache with network_info: [{"id": "3360223f-60df-4be9-ba80-3bb2baf444a2", "address": "fa:16:3e:79:15:ac", "network": {"id": "eebeaab2-1a00-4da6-a475-c2eda7a17090", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1522507326-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "280c999654434edd8f5288786756f2ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3360223f-60", "ovs_interfaceid": "3360223f-60df-4be9-ba80-3bb2baf444a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 12:20:32 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Releasing lock "refresh_cache-ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 12:20:32 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] Updated the network info_cache for instance {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 12:20:32 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:20:33 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:20:38 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:20:43 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:20:48 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:20:53 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:20:58 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:20:58 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:20:58 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73449) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 12:20:58 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:20:58 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:20:58 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:21:03 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:21:08 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:21:13 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:21:15 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:21:18 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:21:18 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:21:18 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73449) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 12:21:18 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:21:18 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:21:18 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:21:20 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:21:21 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:21:22 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:21:23 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:21:23 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:21:23 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73449) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 12:21:23 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:21:23 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:21:23 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:21:24 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:21:24 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73449) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 12:21:24 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:21:24 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Cleaning up deleted instances {{(pid=73449) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 17 12:21:24 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] There are 0 instances to clean {{(pid=73449) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 17 12:21:26 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:21:28 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:21:28 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:21:28 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73449) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 12:21:28 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:21:28 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:21:28 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:21:29 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:21:29 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:21:29 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:21:29 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:21:29 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=73449) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 12:21:30 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:21:30 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:21:30 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:21:30 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:21:30 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 12:21:30 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 12:21:30 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Hypervisor/Node resource view: name=user free_ram=8770MB free_disk=25.03707504272461GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73449) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 12:21:30 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:21:30 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:21:30 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 12:21:30 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73449) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 12:21:30 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73449) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 12:21:31 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 12:21:31 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 12:21:31 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Compute_service record updated for user:user {{(pid=73449) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 12:21:31 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.243s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:21:33 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:21:34 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:21:34 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Starting heal instance info cache {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 12:21:34 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Rebuilding the list of instances to heal {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 12:21:34 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "refresh_cache-ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 12:21:34 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquired lock "refresh_cache-ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 12:21:34 user nova-compute[73449]: DEBUG nova.network.neutron [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] Forcefully refreshing network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 12:21:34 user nova-compute[73449]: DEBUG nova.objects.instance [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lazy-loading 'info_cache' on Instance uuid ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:21:34 user nova-compute[73449]: DEBUG nova.network.neutron [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] Updating instance_info_cache with network_info: [{"id": "3360223f-60df-4be9-ba80-3bb2baf444a2", "address": "fa:16:3e:79:15:ac", "network": {"id": "eebeaab2-1a00-4da6-a475-c2eda7a17090", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1522507326-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "280c999654434edd8f5288786756f2ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3360223f-60", "ovs_interfaceid": "3360223f-60df-4be9-ba80-3bb2baf444a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 12:21:34 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Releasing lock "refresh_cache-ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 12:21:34 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] Updated the network info_cache for instance {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 12:21:34 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:21:35 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:21:38 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:21:38 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:21:38 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73449) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 12:21:38 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:21:38 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:21:38 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:21:43 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:21:43 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:21:43 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73449) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 12:21:43 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:21:43 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:21:43 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:21:48 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:21:48 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:21:48 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73449) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 12:21:48 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:21:48 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:21:48 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:21:53 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:21:58 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:21:58 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:21:58 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73449) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 12:21:58 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:21:58 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:21:58 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:22:01 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a4ce78b3-572a-464b-b244-d76cc61197b9 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Acquiring lock "ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:22:01 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a4ce78b3-572a-464b-b244-d76cc61197b9 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Lock "ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:22:01 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a4ce78b3-572a-464b-b244-d76cc61197b9 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Acquiring lock "ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:22:01 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a4ce78b3-572a-464b-b244-d76cc61197b9 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Lock "ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:22:01 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a4ce78b3-572a-464b-b244-d76cc61197b9 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Lock "ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:22:01 user nova-compute[73449]: INFO nova.compute.manager [None req-a4ce78b3-572a-464b-b244-d76cc61197b9 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] Terminating instance
Aug 17 12:22:01 user nova-compute[73449]: DEBUG nova.compute.manager [None req-a4ce78b3-572a-464b-b244-d76cc61197b9 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] Start destroying the instance on the hypervisor. {{(pid=73449) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 12:22:01 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:22:01 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:22:01 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:22:01 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:22:01 user nova-compute[73449]: DEBUG nova.compute.manager [req-44edab5a-5464-4592-ade1-695f37caffe9 req-0ec017f1-55e3-472e-a53a-58f8827f6c69 service nova] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] Received event network-vif-unplugged-3360223f-60df-4be9-ba80-3bb2baf444a2 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:22:01 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-44edab5a-5464-4592-ade1-695f37caffe9 req-0ec017f1-55e3-472e-a53a-58f8827f6c69 service nova] Acquiring lock "ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:22:01 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-44edab5a-5464-4592-ade1-695f37caffe9 req-0ec017f1-55e3-472e-a53a-58f8827f6c69 service nova] Lock "ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:22:01 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-44edab5a-5464-4592-ade1-695f37caffe9 req-0ec017f1-55e3-472e-a53a-58f8827f6c69 service nova] Lock "ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:22:01 user nova-compute[73449]: DEBUG nova.compute.manager [req-44edab5a-5464-4592-ade1-695f37caffe9 req-0ec017f1-55e3-472e-a53a-58f8827f6c69 service nova] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] No waiting events found dispatching network-vif-unplugged-3360223f-60df-4be9-ba80-3bb2baf444a2 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 12:22:01 user nova-compute[73449]: DEBUG nova.compute.manager [req-44edab5a-5464-4592-ade1-695f37caffe9 req-0ec017f1-55e3-472e-a53a-58f8827f6c69 service nova] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] Received event network-vif-unplugged-3360223f-60df-4be9-ba80-3bb2baf444a2 for instance with task_state deleting. {{(pid=73449) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 12:22:01 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:22:02 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:22:02 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:22:02 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:22:02 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] Instance destroyed successfully.
Aug 17 12:22:02 user nova-compute[73449]: DEBUG nova.objects.instance [None req-a4ce78b3-572a-464b-b244-d76cc61197b9 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Lazy-loading 'resources' on Instance uuid ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:22:02 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:22:02 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-a4ce78b3-572a-464b-b244-d76cc61197b9 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T12:14:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-466894230',display_name='tempest-SnapshotDataIntegrityTests-server-466894230',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-466894230',id=52,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAX1+waXjCYbXqG2I4EczSXOXo8wMJ4BrxT1+2xsDW0nafwwgMEu/4UOBObpH5YjMpEFcxNpkmRPBUf/TcKEn2w35pNLniIw5ExWpMNAQo+gEJO8iAZ2Zn+kjRdM8EuulA==',key_name='tempest-keypair-659724408',keypairs=<?>,launch_index=0,launched_at=2023-08-17T12:14:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='280c999654434edd8f5288786756f2ec',ramdisk_id='',reservation_id='r-ubz059vn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-2076656233',owner_user_name='tempest-SnapshotDataIntegrityTests-2076656233-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T12:14:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='600c0b4dfa534020a4fee49e6f368ba5',uuid=ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3360223f-60df-4be9-ba80-3bb2baf444a2", "address": "fa:16:3e:79:15:ac", "network": {"id": "eebeaab2-1a00-4da6-a475-c2eda7a17090", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1522507326-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "280c999654434edd8f5288786756f2ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3360223f-60", "ovs_interfaceid": "3360223f-60df-4be9-ba80-3bb2baf444a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 12:22:02 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-a4ce78b3-572a-464b-b244-d76cc61197b9 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Converting VIF {"id": "3360223f-60df-4be9-ba80-3bb2baf444a2", "address": "fa:16:3e:79:15:ac", "network": {"id": "eebeaab2-1a00-4da6-a475-c2eda7a17090", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1522507326-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "280c999654434edd8f5288786756f2ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3360223f-60", "ovs_interfaceid": "3360223f-60df-4be9-ba80-3bb2baf444a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 12:22:02 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-a4ce78b3-572a-464b-b244-d76cc61197b9 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:79:15:ac,bridge_name='br-int',has_traffic_filtering=True,id=3360223f-60df-4be9-ba80-3bb2baf444a2,network=Network(eebeaab2-1a00-4da6-a475-c2eda7a17090),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3360223f-60') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 12:22:02 user nova-compute[73449]: DEBUG os_vif [None req-a4ce78b3-572a-464b-b244-d76cc61197b9 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:79:15:ac,bridge_name='br-int',has_traffic_filtering=True,id=3360223f-60df-4be9-ba80-3bb2baf444a2,network=Network(eebeaab2-1a00-4da6-a475-c2eda7a17090),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3360223f-60') {{(pid=73449) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 12:22:02 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:22:02 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3360223f-60, bridge=br-int, if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 12:22:02 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:22:02 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:22:02 user nova-compute[73449]: INFO os_vif [None req-a4ce78b3-572a-464b-b244-d76cc61197b9 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:79:15:ac,bridge_name='br-int',has_traffic_filtering=True,id=3360223f-60df-4be9-ba80-3bb2baf444a2,network=Network(eebeaab2-1a00-4da6-a475-c2eda7a17090),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3360223f-60')
Aug 17 12:22:02 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-a4ce78b3-572a-464b-b244-d76cc61197b9 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] Deleting instance files /opt/stack/data/nova/instances/ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d_del
Aug 17 12:22:02 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-a4ce78b3-572a-464b-b244-d76cc61197b9 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] Deletion of /opt/stack/data/nova/instances/ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d_del complete
Aug 17 12:22:02 user nova-compute[73449]: INFO nova.compute.manager [None req-a4ce78b3-572a-464b-b244-d76cc61197b9 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] Took 1.10 seconds to destroy the instance on the hypervisor.
Aug 17 12:22:02 user nova-compute[73449]: DEBUG oslo.service.loopingcall [None req-a4ce78b3-572a-464b-b244-d76cc61197b9 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73449) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 12:22:02 user nova-compute[73449]: DEBUG nova.compute.manager [-] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] Deallocating network for instance {{(pid=73449) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 12:22:02 user nova-compute[73449]: DEBUG nova.network.neutron [-] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] deallocate_for_instance() {{(pid=73449) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 12:22:02 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:22:02 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:22:02 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:22:03 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:22:03 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:22:03 user nova-compute[73449]: DEBUG nova.network.neutron [-] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] Updating instance_info_cache with network_info: [] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 12:22:03 user nova-compute[73449]: INFO nova.compute.manager [-] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] Took 1.28 seconds to deallocate network for instance.
Aug 17 12:22:03 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a4ce78b3-572a-464b-b244-d76cc61197b9 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:22:03 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a4ce78b3-572a-464b-b244-d76cc61197b9 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:22:03 user nova-compute[73449]: DEBUG nova.compute.manager [req-0e04ea8f-ac64-4895-84ef-9a6de04b13ec req-7a14ef87-435d-4de7-b8a0-c41a54a4ced4 service nova] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] Received event network-vif-plugged-3360223f-60df-4be9-ba80-3bb2baf444a2 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:22:03 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-0e04ea8f-ac64-4895-84ef-9a6de04b13ec req-7a14ef87-435d-4de7-b8a0-c41a54a4ced4 service nova] Acquiring lock "ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:22:03 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-0e04ea8f-ac64-4895-84ef-9a6de04b13ec req-7a14ef87-435d-4de7-b8a0-c41a54a4ced4 service nova] Lock "ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:22:03 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-0e04ea8f-ac64-4895-84ef-9a6de04b13ec req-7a14ef87-435d-4de7-b8a0-c41a54a4ced4 service nova] Lock "ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:22:03 user nova-compute[73449]: DEBUG nova.compute.manager [req-0e04ea8f-ac64-4895-84ef-9a6de04b13ec req-7a14ef87-435d-4de7-b8a0-c41a54a4ced4 service nova] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] No waiting events found dispatching network-vif-plugged-3360223f-60df-4be9-ba80-3bb2baf444a2 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 12:22:03 user nova-compute[73449]: WARNING nova.compute.manager [req-0e04ea8f-ac64-4895-84ef-9a6de04b13ec req-7a14ef87-435d-4de7-b8a0-c41a54a4ced4 service nova] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] Received unexpected event network-vif-plugged-3360223f-60df-4be9-ba80-3bb2baf444a2 for instance with vm_state deleted and task_state None.
Aug 17 12:22:03 user nova-compute[73449]: DEBUG nova.compute.manager [req-0e04ea8f-ac64-4895-84ef-9a6de04b13ec req-7a14ef87-435d-4de7-b8a0-c41a54a4ced4 service nova] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] Received event network-vif-plugged-3360223f-60df-4be9-ba80-3bb2baf444a2 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:22:03 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-0e04ea8f-ac64-4895-84ef-9a6de04b13ec req-7a14ef87-435d-4de7-b8a0-c41a54a4ced4 service nova] Acquiring lock "ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:22:03 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-0e04ea8f-ac64-4895-84ef-9a6de04b13ec req-7a14ef87-435d-4de7-b8a0-c41a54a4ced4 service nova] Lock "ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:22:03 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-0e04ea8f-ac64-4895-84ef-9a6de04b13ec req-7a14ef87-435d-4de7-b8a0-c41a54a4ced4 service nova] Lock "ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:22:03 user nova-compute[73449]: DEBUG nova.compute.manager [req-0e04ea8f-ac64-4895-84ef-9a6de04b13ec req-7a14ef87-435d-4de7-b8a0-c41a54a4ced4 service nova] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] No waiting events found dispatching network-vif-plugged-3360223f-60df-4be9-ba80-3bb2baf444a2 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 12:22:03 user nova-compute[73449]: WARNING nova.compute.manager [req-0e04ea8f-ac64-4895-84ef-9a6de04b13ec req-7a14ef87-435d-4de7-b8a0-c41a54a4ced4 service nova] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] Received unexpected event network-vif-plugged-3360223f-60df-4be9-ba80-3bb2baf444a2 for instance with vm_state deleted and task_state None.
Aug 17 12:22:03 user nova-compute[73449]: DEBUG nova.compute.manager [req-0e04ea8f-ac64-4895-84ef-9a6de04b13ec req-7a14ef87-435d-4de7-b8a0-c41a54a4ced4 service nova] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] Received event network-vif-plugged-3360223f-60df-4be9-ba80-3bb2baf444a2 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:22:03 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-0e04ea8f-ac64-4895-84ef-9a6de04b13ec req-7a14ef87-435d-4de7-b8a0-c41a54a4ced4 service nova] Acquiring lock "ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:22:03 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-0e04ea8f-ac64-4895-84ef-9a6de04b13ec req-7a14ef87-435d-4de7-b8a0-c41a54a4ced4 service nova] Lock "ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:22:03 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-0e04ea8f-ac64-4895-84ef-9a6de04b13ec req-7a14ef87-435d-4de7-b8a0-c41a54a4ced4 service nova] Lock "ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:22:03 user nova-compute[73449]: DEBUG nova.compute.manager [req-0e04ea8f-ac64-4895-84ef-9a6de04b13ec req-7a14ef87-435d-4de7-b8a0-c41a54a4ced4 service nova] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] No waiting events found dispatching network-vif-plugged-3360223f-60df-4be9-ba80-3bb2baf444a2 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 12:22:03 user nova-compute[73449]: WARNING nova.compute.manager [req-0e04ea8f-ac64-4895-84ef-9a6de04b13ec req-7a14ef87-435d-4de7-b8a0-c41a54a4ced4 service nova] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] Received unexpected event network-vif-plugged-3360223f-60df-4be9-ba80-3bb2baf444a2 for instance with vm_state deleted and task_state None.
Aug 17 12:22:03 user nova-compute[73449]: DEBUG nova.compute.manager [req-0e04ea8f-ac64-4895-84ef-9a6de04b13ec req-7a14ef87-435d-4de7-b8a0-c41a54a4ced4 service nova] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] Received event network-vif-unplugged-3360223f-60df-4be9-ba80-3bb2baf444a2 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:22:03 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-0e04ea8f-ac64-4895-84ef-9a6de04b13ec req-7a14ef87-435d-4de7-b8a0-c41a54a4ced4 service nova] Acquiring lock "ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:22:03 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-0e04ea8f-ac64-4895-84ef-9a6de04b13ec req-7a14ef87-435d-4de7-b8a0-c41a54a4ced4 service nova] Lock "ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:22:03 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-0e04ea8f-ac64-4895-84ef-9a6de04b13ec req-7a14ef87-435d-4de7-b8a0-c41a54a4ced4 service nova] Lock "ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:22:03 user nova-compute[73449]: DEBUG nova.compute.manager [req-0e04ea8f-ac64-4895-84ef-9a6de04b13ec req-7a14ef87-435d-4de7-b8a0-c41a54a4ced4 service nova] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] No waiting events found dispatching network-vif-unplugged-3360223f-60df-4be9-ba80-3bb2baf444a2 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 12:22:03 user nova-compute[73449]: WARNING nova.compute.manager [req-0e04ea8f-ac64-4895-84ef-9a6de04b13ec req-7a14ef87-435d-4de7-b8a0-c41a54a4ced4 service nova] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] Received unexpected event network-vif-unplugged-3360223f-60df-4be9-ba80-3bb2baf444a2 for instance with vm_state deleted and task_state None.
Aug 17 12:22:03 user nova-compute[73449]: DEBUG nova.compute.manager [req-0e04ea8f-ac64-4895-84ef-9a6de04b13ec req-7a14ef87-435d-4de7-b8a0-c41a54a4ced4 service nova] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] Received event network-vif-plugged-3360223f-60df-4be9-ba80-3bb2baf444a2 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:22:03 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-0e04ea8f-ac64-4895-84ef-9a6de04b13ec req-7a14ef87-435d-4de7-b8a0-c41a54a4ced4 service nova] Acquiring lock "ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:22:03 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-0e04ea8f-ac64-4895-84ef-9a6de04b13ec req-7a14ef87-435d-4de7-b8a0-c41a54a4ced4 service nova] Lock "ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:22:03 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-0e04ea8f-ac64-4895-84ef-9a6de04b13ec req-7a14ef87-435d-4de7-b8a0-c41a54a4ced4 service nova] Lock "ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:22:03 user nova-compute[73449]: DEBUG nova.compute.manager [req-0e04ea8f-ac64-4895-84ef-9a6de04b13ec req-7a14ef87-435d-4de7-b8a0-c41a54a4ced4 service nova] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] No waiting events found dispatching network-vif-plugged-3360223f-60df-4be9-ba80-3bb2baf444a2 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 12:22:03 user nova-compute[73449]: WARNING nova.compute.manager [req-0e04ea8f-ac64-4895-84ef-9a6de04b13ec req-7a14ef87-435d-4de7-b8a0-c41a54a4ced4 service nova] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] Received unexpected event network-vif-plugged-3360223f-60df-4be9-ba80-3bb2baf444a2 for instance with vm_state deleted and task_state None.
Aug 17 12:22:03 user nova-compute[73449]: DEBUG nova.compute.manager [req-75a2902c-c132-470b-9cf9-eae54af5ba64 req-70a6f132-b5d1-4327-b454-d0c37df54855 service nova] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] Received event network-vif-deleted-3360223f-60df-4be9-ba80-3bb2baf444a2 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:22:03 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-a4ce78b3-572a-464b-b244-d76cc61197b9 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 12:22:03 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-a4ce78b3-572a-464b-b244-d76cc61197b9 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 12:22:03 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a4ce78b3-572a-464b-b244-d76cc61197b9 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.111s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:22:03 user nova-compute[73449]: INFO nova.scheduler.client.report [None req-a4ce78b3-572a-464b-b244-d76cc61197b9 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Deleted allocations for instance ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d
Aug 17 12:22:04 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a4ce78b3-572a-464b-b244-d76cc61197b9 tempest-SnapshotDataIntegrityTests-2076656233 tempest-SnapshotDataIntegrityTests-2076656233-project-member] Lock "ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.669s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:22:05 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:22:05 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73449) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 17 12:22:07 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:22:12 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:22:12 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:22:12 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73449) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 12:22:12 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:22:12 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:22:12 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:22:15 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:22:17 user nova-compute[73449]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692274922.3794982, ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d => Stopped> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 12:22:17 user nova-compute[73449]: INFO nova.compute.manager [-] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] VM Stopped (Lifecycle Event)
Aug 17 12:22:17 user nova-compute[73449]: DEBUG nova.compute.manager [None req-47e2957c-15ce-4b9f-aed8-35a5f4c93acc None None] [instance: ffc42db0-bd9a-4d8b-8fe4-b44a05b5ec7d] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 12:22:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:22:21 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:22:22 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:22:22 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:22:22 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:22:24 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:22:24 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:22:24 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73449) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 12:22:27 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:22:27 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:22:27 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73449) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 12:22:27 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:22:27 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:22:27 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:22:28 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:22:30 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:22:30 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:22:30 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:22:30 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:22:30 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=73449) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 12:22:31 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 12:22:31 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 12:22:31 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Hypervisor/Node resource view: name=user free_ram=8887MB free_disk=25.064117431640625GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73449) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 12:22:31 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:22:31 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:22:31 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73449) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 12:22:31 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73449) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 12:22:31 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Refreshing inventories for resource provider 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 17 12:22:31 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Updating ProviderTree inventory for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 17 12:22:31 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Updating inventory in ProviderTree for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 12:22:31 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Refreshing aggregate associations for resource provider 20986bee-3f54-4b89-bec1-f8387ef700c4, aggregates: None {{(pid=73449) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 17 12:22:31 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Refreshing trait associations for resource provider 20986bee-3f54-4b89-bec1-f8387ef700c4, traits: COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NODE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE42,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSSE3,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_ISO {{(pid=73449) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 17 12:22:31 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 12:22:31 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 12:22:31 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Compute_service record updated for user:user {{(pid=73449) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 12:22:31 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.393s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:22:32 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:22:34 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:22:35 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:22:35 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Starting heal instance info cache {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 12:22:35 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Rebuilding the list of instances to heal {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 12:22:35 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Didn't find any instances for network info cache update. {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 12:22:37 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:22:42 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:22:42 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:22:42 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73449) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 12:22:42 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:22:42 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:22:42 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:22:47 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:22:52 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:22:52 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:22:55 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:22:57 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:22:59 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:23:02 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:23:07 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:23:12 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:23:15 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:23:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:23:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:23:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73449) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 12:23:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:23:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:23:17 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:23:21 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:23:22 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:23:23 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:23:23 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:23:26 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:23:26 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:23:26 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73449) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 12:23:27 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:23:29 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:23:29 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:23:30 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:23:30 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:23:30 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:23:30 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:23:30 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:23:30 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=73449) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 12:23:31 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 12:23:31 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 12:23:31 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Hypervisor/Node resource view: name=user free_ram=8629MB free_disk=25.059600830078125GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73449) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 12:23:31 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:23:31 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:23:31 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73449) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 12:23:31 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73449) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 12:23:31 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 12:23:31 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 12:23:31 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Compute_service record updated for user:user {{(pid=73449) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 12:23:31 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.151s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:23:32 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:23:34 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:23:35 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:23:36 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:23:36 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:23:37 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:23:37 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:23:37 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Starting heal instance info cache {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 12:23:37 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Rebuilding the list of instances to heal {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 12:23:37 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Didn't find any instances for network info cache update. {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 12:23:38 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:23:39 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:23:42 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:23:44 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:23:45 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-689b5c98-53dd-439a-b22e-d09b008ec618 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Acquiring lock "a762749b-0aa6-4e11-912f-76d8daaf3488" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:23:45 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-689b5c98-53dd-439a-b22e-d09b008ec618 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Lock "a762749b-0aa6-4e11-912f-76d8daaf3488" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:23:45 user nova-compute[73449]: DEBUG nova.compute.manager [None req-689b5c98-53dd-439a-b22e-d09b008ec618 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] Starting instance... {{(pid=73449) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 12:23:45 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-689b5c98-53dd-439a-b22e-d09b008ec618 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:23:45 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-689b5c98-53dd-439a-b22e-d09b008ec618 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:23:45 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-689b5c98-53dd-439a-b22e-d09b008ec618 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73449) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 12:23:45 user nova-compute[73449]: INFO nova.compute.claims [None req-689b5c98-53dd-439a-b22e-d09b008ec618 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] Claim successful on node user
Aug 17 12:23:45 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-689b5c98-53dd-439a-b22e-d09b008ec618 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 12:23:45 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-689b5c98-53dd-439a-b22e-d09b008ec618 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 12:23:45 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-689b5c98-53dd-439a-b22e-d09b008ec618 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.245s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:23:45 user nova-compute[73449]: DEBUG nova.compute.manager [None req-689b5c98-53dd-439a-b22e-d09b008ec618 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] Start building networks asynchronously for instance. {{(pid=73449) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 12:23:45 user nova-compute[73449]: DEBUG nova.compute.manager [None req-689b5c98-53dd-439a-b22e-d09b008ec618 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] Allocating IP information in the background. {{(pid=73449) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 12:23:45 user nova-compute[73449]: DEBUG nova.network.neutron [None req-689b5c98-53dd-439a-b22e-d09b008ec618 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] allocate_for_instance() {{(pid=73449) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 12:23:45 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-689b5c98-53dd-439a-b22e-d09b008ec618 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 12:23:45 user nova-compute[73449]: DEBUG nova.compute.manager [None req-689b5c98-53dd-439a-b22e-d09b008ec618 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] Start building block device mappings for instance. {{(pid=73449) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 12:23:45 user nova-compute[73449]: DEBUG nova.compute.manager [None req-689b5c98-53dd-439a-b22e-d09b008ec618 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] Start spawning the instance on the hypervisor. {{(pid=73449) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 12:23:45 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-689b5c98-53dd-439a-b22e-d09b008ec618 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] Creating instance directory {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 12:23:45 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-689b5c98-53dd-439a-b22e-d09b008ec618 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] Creating image(s)
Aug 17 12:23:45 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-689b5c98-53dd-439a-b22e-d09b008ec618 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Acquiring lock "/opt/stack/data/nova/instances/a762749b-0aa6-4e11-912f-76d8daaf3488/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:23:45 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-689b5c98-53dd-439a-b22e-d09b008ec618 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Lock "/opt/stack/data/nova/instances/a762749b-0aa6-4e11-912f-76d8daaf3488/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:23:45 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-689b5c98-53dd-439a-b22e-d09b008ec618 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Lock "/opt/stack/data/nova/instances/a762749b-0aa6-4e11-912f-76d8daaf3488/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.020s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:23:45 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-689b5c98-53dd-439a-b22e-d09b008ec618 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:23:45 user nova-compute[73449]: DEBUG nova.policy [None req-689b5c98-53dd-439a-b22e-d09b008ec618 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dc5d7521089c400aa89522f1d0f7e19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f2957934dd4930883815ec6a1b18a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73449) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 12:23:45 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-689b5c98-53dd-439a-b22e-d09b008ec618 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json" returned: 0 in 0.198s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:23:45 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-689b5c98-53dd-439a-b22e-d09b008ec618 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Acquiring lock "7e267a577c062ee862e95ede6b48cfd5632f3ea3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:23:45 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-689b5c98-53dd-439a-b22e-d09b008ec618 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Lock "7e267a577c062ee862e95ede6b48cfd5632f3ea3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:23:45 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-689b5c98-53dd-439a-b22e-d09b008ec618 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:23:46 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-689b5c98-53dd-439a-b22e-d09b008ec618 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json" returned: 0 in 0.209s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:23:46 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-689b5c98-53dd-439a-b22e-d09b008ec618 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3,backing_fmt=raw /opt/stack/data/nova/instances/a762749b-0aa6-4e11-912f-76d8daaf3488/disk 1073741824 {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:23:46 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-689b5c98-53dd-439a-b22e-d09b008ec618 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3,backing_fmt=raw /opt/stack/data/nova/instances/a762749b-0aa6-4e11-912f-76d8daaf3488/disk 1073741824" returned: 0 in 0.049s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:23:46 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-689b5c98-53dd-439a-b22e-d09b008ec618 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Lock "7e267a577c062ee862e95ede6b48cfd5632f3ea3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.265s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:23:46 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-689b5c98-53dd-439a-b22e-d09b008ec618 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:23:46 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-689b5c98-53dd-439a-b22e-d09b008ec618 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e267a577c062ee862e95ede6b48cfd5632f3ea3 --force-share --output=json" returned: 0 in 0.178s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:23:46 user nova-compute[73449]: DEBUG nova.virt.disk.api [None req-689b5c98-53dd-439a-b22e-d09b008ec618 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a762749b-0aa6-4e11-912f-76d8daaf3488/disk. size=1073741824 {{(pid=73449) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 12:23:46 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-689b5c98-53dd-439a-b22e-d09b008ec618 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a762749b-0aa6-4e11-912f-76d8daaf3488/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:23:46 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-689b5c98-53dd-439a-b22e-d09b008ec618 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a762749b-0aa6-4e11-912f-76d8daaf3488/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:23:46 user nova-compute[73449]: DEBUG nova.virt.disk.api [None req-689b5c98-53dd-439a-b22e-d09b008ec618 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Cannot resize image /opt/stack/data/nova/instances/a762749b-0aa6-4e11-912f-76d8daaf3488/disk to a smaller size. {{(pid=73449) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 12:23:46 user nova-compute[73449]: DEBUG nova.objects.instance [None req-689b5c98-53dd-439a-b22e-d09b008ec618 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Lazy-loading 'migration_context' on Instance uuid a762749b-0aa6-4e11-912f-76d8daaf3488 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:23:46 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-689b5c98-53dd-439a-b22e-d09b008ec618 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] Created local disks {{(pid=73449) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 12:23:46 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-689b5c98-53dd-439a-b22e-d09b008ec618 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] Ensure instance console log exists: /opt/stack/data/nova/instances/a762749b-0aa6-4e11-912f-76d8daaf3488/console.log {{(pid=73449) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 12:23:46 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-689b5c98-53dd-439a-b22e-d09b008ec618 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:23:46 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-689b5c98-53dd-439a-b22e-d09b008ec618 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:23:46 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-689b5c98-53dd-439a-b22e-d09b008ec618 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:23:47 user nova-compute[73449]: DEBUG nova.network.neutron [None req-689b5c98-53dd-439a-b22e-d09b008ec618 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] Successfully created port: e153fc04-33de-4636-a657-8638ec48f960 {{(pid=73449) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 12:23:47 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:23:48 user nova-compute[73449]: DEBUG nova.network.neutron [None req-689b5c98-53dd-439a-b22e-d09b008ec618 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] Successfully updated port: e153fc04-33de-4636-a657-8638ec48f960 {{(pid=73449) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 12:23:48 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-689b5c98-53dd-439a-b22e-d09b008ec618 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Acquiring lock "refresh_cache-a762749b-0aa6-4e11-912f-76d8daaf3488" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 12:23:48 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-689b5c98-53dd-439a-b22e-d09b008ec618 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Acquired lock "refresh_cache-a762749b-0aa6-4e11-912f-76d8daaf3488" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 12:23:48 user nova-compute[73449]: DEBUG nova.network.neutron [None req-689b5c98-53dd-439a-b22e-d09b008ec618 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] Building network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 12:23:48 user nova-compute[73449]: DEBUG nova.compute.manager [req-9af062ee-6c60-4df8-a1cd-c71d13b3f0e8 req-dada1a8b-2807-4d65-9c5d-8382bdcf1e78 service nova] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] Received event network-changed-e153fc04-33de-4636-a657-8638ec48f960 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:23:48 user nova-compute[73449]: DEBUG nova.compute.manager [req-9af062ee-6c60-4df8-a1cd-c71d13b3f0e8 req-dada1a8b-2807-4d65-9c5d-8382bdcf1e78 service nova] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] Refreshing instance network info cache due to event network-changed-e153fc04-33de-4636-a657-8638ec48f960. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 12:23:48 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-9af062ee-6c60-4df8-a1cd-c71d13b3f0e8 req-dada1a8b-2807-4d65-9c5d-8382bdcf1e78 service nova] Acquiring lock "refresh_cache-a762749b-0aa6-4e11-912f-76d8daaf3488" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 12:23:48 user nova-compute[73449]: DEBUG nova.network.neutron [None req-689b5c98-53dd-439a-b22e-d09b008ec618 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] Instance cache missing network info. {{(pid=73449) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 12:23:48 user nova-compute[73449]: DEBUG nova.network.neutron [None req-689b5c98-53dd-439a-b22e-d09b008ec618 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] Updating instance_info_cache with network_info: [{"id": "e153fc04-33de-4636-a657-8638ec48f960", "address": "fa:16:3e:19:b7:c0", "network": {"id": "8c856a2a-08b3-4f78-9ed6-425371ba0c33", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1378352798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06f2957934dd4930883815ec6a1b18a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape153fc04-33", "ovs_interfaceid": "e153fc04-33de-4636-a657-8638ec48f960", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 12:23:48 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-689b5c98-53dd-439a-b22e-d09b008ec618 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Releasing lock "refresh_cache-a762749b-0aa6-4e11-912f-76d8daaf3488" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 12:23:48 user nova-compute[73449]: DEBUG nova.compute.manager [None req-689b5c98-53dd-439a-b22e-d09b008ec618 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] Instance network_info: |[{"id": "e153fc04-33de-4636-a657-8638ec48f960", "address": "fa:16:3e:19:b7:c0", "network": {"id": "8c856a2a-08b3-4f78-9ed6-425371ba0c33", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1378352798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06f2957934dd4930883815ec6a1b18a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape153fc04-33", "ovs_interfaceid": "e153fc04-33de-4636-a657-8638ec48f960", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73449) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 12:23:48 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-9af062ee-6c60-4df8-a1cd-c71d13b3f0e8 req-dada1a8b-2807-4d65-9c5d-8382bdcf1e78 service nova] Acquired lock "refresh_cache-a762749b-0aa6-4e11-912f-76d8daaf3488" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 12:23:48 user nova-compute[73449]: DEBUG nova.network.neutron [req-9af062ee-6c60-4df8-a1cd-c71d13b3f0e8 req-dada1a8b-2807-4d65-9c5d-8382bdcf1e78 service nova] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] Refreshing network info cache for port e153fc04-33de-4636-a657-8638ec48f960 {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 12:23:48 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-689b5c98-53dd-439a-b22e-d09b008ec618 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] Start _get_guest_xml network_info=[{"id": "e153fc04-33de-4636-a657-8638ec48f960", "address": "fa:16:3e:19:b7:c0", "network": {"id": "8c856a2a-08b3-4f78-9ed6-425371ba0c33", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1378352798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06f2957934dd4930883815ec6a1b18a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape153fc04-33", "ovs_interfaceid": "e153fc04-33de-4636-a657-8638ec48f960", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T11:36:11Z,direct_url=<?>,disk_format='qcow2',id=0a2904ae-083d-41c8-83db-343132b36148,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7a77880136a54ef195c82e018e1939db',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T11:36:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': '0a2904ae-083d-41c8-83db-343132b36148'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 12:23:48 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-689b5c98-53dd-439a-b22e-d09b008ec618 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 12:23:48 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-689b5c98-53dd-439a-b22e-d09b008ec618 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 12:23:48 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-689b5c98-53dd-439a-b22e-d09b008ec618 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 12:23:48 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-689b5c98-53dd-439a-b22e-d09b008ec618 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] CPU controller missing on host. {{(pid=73449) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 12:23:48 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-689b5c98-53dd-439a-b22e-d09b008ec618 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 12:23:48 user nova-compute[73449]: DEBUG nova.virt.libvirt.host [None req-689b5c98-53dd-439a-b22e-d09b008ec618 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] CPU controller found on host. {{(pid=73449) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 12:23:48 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-689b5c98-53dd-439a-b22e-d09b008ec618 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73449) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 12:23:48 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-689b5c98-53dd-439a-b22e-d09b008ec618 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T11:35:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T11:36:11Z,direct_url=<?>,disk_format='qcow2',id=0a2904ae-083d-41c8-83db-343132b36148,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7a77880136a54ef195c82e018e1939db',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T11:36:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 12:23:48 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-689b5c98-53dd-439a-b22e-d09b008ec618 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Flavor limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 12:23:48 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-689b5c98-53dd-439a-b22e-d09b008ec618 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Image limits 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 12:23:48 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-689b5c98-53dd-439a-b22e-d09b008ec618 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Flavor pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 12:23:48 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-689b5c98-53dd-439a-b22e-d09b008ec618 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Image pref 0:0:0 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 12:23:48 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-689b5c98-53dd-439a-b22e-d09b008ec618 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 12:23:48 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-689b5c98-53dd-439a-b22e-d09b008ec618 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 12:23:48 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-689b5c98-53dd-439a-b22e-d09b008ec618 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 12:23:48 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-689b5c98-53dd-439a-b22e-d09b008ec618 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Got 1 possible topologies {{(pid=73449) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 12:23:48 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-689b5c98-53dd-439a-b22e-d09b008ec618 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 12:23:48 user nova-compute[73449]: DEBUG nova.virt.hardware [None req-689b5c98-53dd-439a-b22e-d09b008ec618 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73449) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 12:23:48 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-689b5c98-53dd-439a-b22e-d09b008ec618 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T12:23:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-693333408',display_name='tempest-SnapshotDataIntegrityTests-server-693333408',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-693333408',id=53,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBASduBFDp9fhTht5sR5q0Ab9f4uTlIvl0a1PY0AE0RFUo1o/JqOETOIkmb3PBaQcZpGHJG4JmOYqb2GZa7+71UsKHTiJT0sPdHoW8en4uGDlF9QQvP9winLcltLATiB8XA==',key_name='tempest-keypair-1952481270',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='06f2957934dd4930883815ec6a1b18a1',ramdisk_id='',reservation_id='r-tl7hro4o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-927060233',owner_user_name='tempest-SnapshotDataIntegrityTests-927060233-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T12:23:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dc5d7521089c400aa89522f1d0f7e19e',uuid=a762749b-0aa6-4e11-912f-76d8daaf3488,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e153fc04-33de-4636-a657-8638ec48f960", "address": "fa:16:3e:19:b7:c0", "network": {"id": "8c856a2a-08b3-4f78-9ed6-425371ba0c33", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1378352798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06f2957934dd4930883815ec6a1b18a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape153fc04-33", "ovs_interfaceid": "e153fc04-33de-4636-a657-8638ec48f960", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73449) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 12:23:48 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-689b5c98-53dd-439a-b22e-d09b008ec618 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Converting VIF {"id": "e153fc04-33de-4636-a657-8638ec48f960", "address": "fa:16:3e:19:b7:c0", "network": {"id": "8c856a2a-08b3-4f78-9ed6-425371ba0c33", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1378352798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06f2957934dd4930883815ec6a1b18a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape153fc04-33", "ovs_interfaceid": "e153fc04-33de-4636-a657-8638ec48f960", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 12:23:48 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-689b5c98-53dd-439a-b22e-d09b008ec618 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:b7:c0,bridge_name='br-int',has_traffic_filtering=True,id=e153fc04-33de-4636-a657-8638ec48f960,network=Network(8c856a2a-08b3-4f78-9ed6-425371ba0c33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape153fc04-33') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 12:23:48 user nova-compute[73449]: DEBUG nova.objects.instance [None req-689b5c98-53dd-439a-b22e-d09b008ec618 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Lazy-loading 'pci_devices' on Instance uuid a762749b-0aa6-4e11-912f-76d8daaf3488 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:23:48 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-689b5c98-53dd-439a-b22e-d09b008ec618 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] End _get_guest_xml xml=<domain type="kvm">
Aug 17 12:23:48 user nova-compute[73449]:   <uuid>a762749b-0aa6-4e11-912f-76d8daaf3488</uuid>
Aug 17 12:23:48 user nova-compute[73449]:   <name>instance-00000035</name>
Aug 17 12:23:48 user nova-compute[73449]:   <memory>524288</memory>
Aug 17 12:23:48 user nova-compute[73449]:   <vcpu>1</vcpu>
Aug 17 12:23:48 user nova-compute[73449]:   <metadata>
Aug 17 12:23:48 user nova-compute[73449]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 12:23:48 user nova-compute[73449]:       <nova:package version="0.0.0"/>
Aug 17 12:23:48 user nova-compute[73449]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-693333408</nova:name>
Aug 17 12:23:48 user nova-compute[73449]:       <nova:creationTime>2023-08-17 12:23:48</nova:creationTime>
Aug 17 12:23:48 user nova-compute[73449]:       <nova:flavor name="m1.tiny">
Aug 17 12:23:48 user nova-compute[73449]:         <nova:memory>512</nova:memory>
Aug 17 12:23:48 user nova-compute[73449]:         <nova:disk>1</nova:disk>
Aug 17 12:23:48 user nova-compute[73449]:         <nova:swap>0</nova:swap>
Aug 17 12:23:48 user nova-compute[73449]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 12:23:48 user nova-compute[73449]:         <nova:vcpus>1</nova:vcpus>
Aug 17 12:23:48 user nova-compute[73449]:       </nova:flavor>
Aug 17 12:23:48 user nova-compute[73449]:       <nova:owner>
Aug 17 12:23:48 user nova-compute[73449]:         <nova:user uuid="dc5d7521089c400aa89522f1d0f7e19e">tempest-SnapshotDataIntegrityTests-927060233-project-member</nova:user>
Aug 17 12:23:48 user nova-compute[73449]:         <nova:project uuid="06f2957934dd4930883815ec6a1b18a1">tempest-SnapshotDataIntegrityTests-927060233</nova:project>
Aug 17 12:23:48 user nova-compute[73449]:       </nova:owner>
Aug 17 12:23:48 user nova-compute[73449]:       <nova:root type="image" uuid="0a2904ae-083d-41c8-83db-343132b36148"/>
Aug 17 12:23:48 user nova-compute[73449]:       <nova:ports>
Aug 17 12:23:48 user nova-compute[73449]:         <nova:port uuid="e153fc04-33de-4636-a657-8638ec48f960">
Aug 17 12:23:48 user nova-compute[73449]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 17 12:23:48 user nova-compute[73449]:         </nova:port>
Aug 17 12:23:48 user nova-compute[73449]:       </nova:ports>
Aug 17 12:23:48 user nova-compute[73449]:     </nova:instance>
Aug 17 12:23:48 user nova-compute[73449]:   </metadata>
Aug 17 12:23:48 user nova-compute[73449]:   <sysinfo type="smbios">
Aug 17 12:23:48 user nova-compute[73449]:     <system>
Aug 17 12:23:48 user nova-compute[73449]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 12:23:48 user nova-compute[73449]:       <entry name="product">OpenStack Nova</entry>
Aug 17 12:23:48 user nova-compute[73449]:       <entry name="version">0.0.0</entry>
Aug 17 12:23:48 user nova-compute[73449]:       <entry name="serial">a762749b-0aa6-4e11-912f-76d8daaf3488</entry>
Aug 17 12:23:48 user nova-compute[73449]:       <entry name="uuid">a762749b-0aa6-4e11-912f-76d8daaf3488</entry>
Aug 17 12:23:48 user nova-compute[73449]:       <entry name="family">Virtual Machine</entry>
Aug 17 12:23:48 user nova-compute[73449]:     </system>
Aug 17 12:23:48 user nova-compute[73449]:   </sysinfo>
Aug 17 12:23:48 user nova-compute[73449]:   <os>
Aug 17 12:23:48 user nova-compute[73449]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 12:23:48 user nova-compute[73449]:     <boot dev="hd"/>
Aug 17 12:23:48 user nova-compute[73449]:     <smbios mode="sysinfo"/>
Aug 17 12:23:48 user nova-compute[73449]:   </os>
Aug 17 12:23:48 user nova-compute[73449]:   <features>
Aug 17 12:23:48 user nova-compute[73449]:     <acpi/>
Aug 17 12:23:48 user nova-compute[73449]:     <apic/>
Aug 17 12:23:48 user nova-compute[73449]:     <vmcoreinfo/>
Aug 17 12:23:48 user nova-compute[73449]:   </features>
Aug 17 12:23:48 user nova-compute[73449]:   <clock offset="utc">
Aug 17 12:23:48 user nova-compute[73449]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 12:23:48 user nova-compute[73449]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 12:23:48 user nova-compute[73449]:     <timer name="hpet" present="no"/>
Aug 17 12:23:48 user nova-compute[73449]:   </clock>
Aug 17 12:23:48 user nova-compute[73449]:   <cpu mode="custom" match="exact">
Aug 17 12:23:48 user nova-compute[73449]:     <model>Nehalem</model>
Aug 17 12:23:48 user nova-compute[73449]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 12:23:48 user nova-compute[73449]:   </cpu>
Aug 17 12:23:48 user nova-compute[73449]:   <devices>
Aug 17 12:23:48 user nova-compute[73449]:     <disk type="file" device="disk">
Aug 17 12:23:48 user nova-compute[73449]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 12:23:48 user nova-compute[73449]:       <source file="/opt/stack/data/nova/instances/a762749b-0aa6-4e11-912f-76d8daaf3488/disk"/>
Aug 17 12:23:48 user nova-compute[73449]:       <target dev="vda" bus="virtio"/>
Aug 17 12:23:48 user nova-compute[73449]:     </disk>
Aug 17 12:23:48 user nova-compute[73449]:     <interface type="ethernet">
Aug 17 12:23:48 user nova-compute[73449]:       <mac address="fa:16:3e:19:b7:c0"/>
Aug 17 12:23:48 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 12:23:48 user nova-compute[73449]:       <mtu size="1442"/>
Aug 17 12:23:48 user nova-compute[73449]:       <target dev="tape153fc04-33"/>
Aug 17 12:23:48 user nova-compute[73449]:     </interface>
Aug 17 12:23:48 user nova-compute[73449]:     <serial type="pty">
Aug 17 12:23:48 user nova-compute[73449]:       <log file="/opt/stack/data/nova/instances/a762749b-0aa6-4e11-912f-76d8daaf3488/console.log" append="off"/>
Aug 17 12:23:48 user nova-compute[73449]:     </serial>
Aug 17 12:23:48 user nova-compute[73449]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 12:23:48 user nova-compute[73449]:     <video>
Aug 17 12:23:48 user nova-compute[73449]:       <model type="virtio"/>
Aug 17 12:23:48 user nova-compute[73449]:     </video>
Aug 17 12:23:48 user nova-compute[73449]:     <rng model="virtio">
Aug 17 12:23:48 user nova-compute[73449]:       <backend model="random">/dev/urandom</backend>
Aug 17 12:23:48 user nova-compute[73449]:     </rng>
Aug 17 12:23:48 user nova-compute[73449]:     <controller type="usb" index="0" model="none"/>
Aug 17 12:23:48 user nova-compute[73449]:     <memballoon model="virtio">
Aug 17 12:23:48 user nova-compute[73449]:       <stats period="10"/>
Aug 17 12:23:48 user nova-compute[73449]:     </memballoon>
Aug 17 12:23:48 user nova-compute[73449]:   </devices>
Aug 17 12:23:48 user nova-compute[73449]: </domain>
Aug 17 12:23:48 user nova-compute[73449]:  {{(pid=73449) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 12:23:48 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-689b5c98-53dd-439a-b22e-d09b008ec618 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T12:23:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-693333408',display_name='tempest-SnapshotDataIntegrityTests-server-693333408',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-693333408',id=53,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBASduBFDp9fhTht5sR5q0Ab9f4uTlIvl0a1PY0AE0RFUo1o/JqOETOIkmb3PBaQcZpGHJG4JmOYqb2GZa7+71UsKHTiJT0sPdHoW8en4uGDlF9QQvP9winLcltLATiB8XA==',key_name='tempest-keypair-1952481270',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='06f2957934dd4930883815ec6a1b18a1',ramdisk_id='',reservation_id='r-tl7hro4o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-927060233',owner_user_name='tempest-SnapshotDataIntegrityTests-927060233-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T12:23:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dc5d7521089c400aa89522f1d0f7e19e',uuid=a762749b-0aa6-4e11-912f-76d8daaf3488,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e153fc04-33de-4636-a657-8638ec48f960", "address": "fa:16:3e:19:b7:c0", "network": {"id": "8c856a2a-08b3-4f78-9ed6-425371ba0c33", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1378352798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06f2957934dd4930883815ec6a1b18a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape153fc04-33", "ovs_interfaceid": "e153fc04-33de-4636-a657-8638ec48f960", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 12:23:48 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-689b5c98-53dd-439a-b22e-d09b008ec618 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Converting VIF {"id": "e153fc04-33de-4636-a657-8638ec48f960", "address": "fa:16:3e:19:b7:c0", "network": {"id": "8c856a2a-08b3-4f78-9ed6-425371ba0c33", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1378352798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06f2957934dd4930883815ec6a1b18a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape153fc04-33", "ovs_interfaceid": "e153fc04-33de-4636-a657-8638ec48f960", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 12:23:48 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-689b5c98-53dd-439a-b22e-d09b008ec618 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:b7:c0,bridge_name='br-int',has_traffic_filtering=True,id=e153fc04-33de-4636-a657-8638ec48f960,network=Network(8c856a2a-08b3-4f78-9ed6-425371ba0c33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape153fc04-33') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 12:23:48 user nova-compute[73449]: DEBUG os_vif [None req-689b5c98-53dd-439a-b22e-d09b008ec618 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:b7:c0,bridge_name='br-int',has_traffic_filtering=True,id=e153fc04-33de-4636-a657-8638ec48f960,network=Network(8c856a2a-08b3-4f78-9ed6-425371ba0c33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape153fc04-33') {{(pid=73449) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 12:23:48 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:23:48 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 12:23:48 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 12:23:48 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:23:48 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape153fc04-33, may_exist=True, interface_attrs={}) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 12:23:48 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape153fc04-33, col_values=(('external_ids', {'iface-id': 'e153fc04-33de-4636-a657-8638ec48f960', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:19:b7:c0', 'vm-uuid': 'a762749b-0aa6-4e11-912f-76d8daaf3488'}),), if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 12:23:48 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:23:48 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:23:48 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:23:48 user nova-compute[73449]: INFO os_vif [None req-689b5c98-53dd-439a-b22e-d09b008ec618 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:b7:c0,bridge_name='br-int',has_traffic_filtering=True,id=e153fc04-33de-4636-a657-8638ec48f960,network=Network(8c856a2a-08b3-4f78-9ed6-425371ba0c33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape153fc04-33')
Aug 17 12:23:48 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-689b5c98-53dd-439a-b22e-d09b008ec618 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] No BDM found with device name vda, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 12:23:48 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-689b5c98-53dd-439a-b22e-d09b008ec618 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] No VIF found with MAC fa:16:3e:19:b7:c0, not building metadata {{(pid=73449) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 12:23:49 user nova-compute[73449]: DEBUG nova.network.neutron [req-9af062ee-6c60-4df8-a1cd-c71d13b3f0e8 req-dada1a8b-2807-4d65-9c5d-8382bdcf1e78 service nova] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] Updated VIF entry in instance network info cache for port e153fc04-33de-4636-a657-8638ec48f960. {{(pid=73449) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 12:23:49 user nova-compute[73449]: DEBUG nova.network.neutron [req-9af062ee-6c60-4df8-a1cd-c71d13b3f0e8 req-dada1a8b-2807-4d65-9c5d-8382bdcf1e78 service nova] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] Updating instance_info_cache with network_info: [{"id": "e153fc04-33de-4636-a657-8638ec48f960", "address": "fa:16:3e:19:b7:c0", "network": {"id": "8c856a2a-08b3-4f78-9ed6-425371ba0c33", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1378352798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06f2957934dd4930883815ec6a1b18a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape153fc04-33", "ovs_interfaceid": "e153fc04-33de-4636-a657-8638ec48f960", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 12:23:49 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-9af062ee-6c60-4df8-a1cd-c71d13b3f0e8 req-dada1a8b-2807-4d65-9c5d-8382bdcf1e78 service nova] Releasing lock "refresh_cache-a762749b-0aa6-4e11-912f-76d8daaf3488" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 12:23:50 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:23:50 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:23:50 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:23:50 user nova-compute[73449]: DEBUG nova.compute.manager [req-0d56a558-05f1-4265-bdb3-6696a5824fba req-e5784ee0-ca99-4fde-a3e5-03d57b9cf1d8 service nova] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] Received event network-vif-plugged-e153fc04-33de-4636-a657-8638ec48f960 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:23:50 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-0d56a558-05f1-4265-bdb3-6696a5824fba req-e5784ee0-ca99-4fde-a3e5-03d57b9cf1d8 service nova] Acquiring lock "a762749b-0aa6-4e11-912f-76d8daaf3488-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:23:50 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-0d56a558-05f1-4265-bdb3-6696a5824fba req-e5784ee0-ca99-4fde-a3e5-03d57b9cf1d8 service nova] Lock "a762749b-0aa6-4e11-912f-76d8daaf3488-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:23:50 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-0d56a558-05f1-4265-bdb3-6696a5824fba req-e5784ee0-ca99-4fde-a3e5-03d57b9cf1d8 service nova] Lock "a762749b-0aa6-4e11-912f-76d8daaf3488-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:23:50 user nova-compute[73449]: DEBUG nova.compute.manager [req-0d56a558-05f1-4265-bdb3-6696a5824fba req-e5784ee0-ca99-4fde-a3e5-03d57b9cf1d8 service nova] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] No waiting events found dispatching network-vif-plugged-e153fc04-33de-4636-a657-8638ec48f960 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 12:23:50 user nova-compute[73449]: WARNING nova.compute.manager [req-0d56a558-05f1-4265-bdb3-6696a5824fba req-e5784ee0-ca99-4fde-a3e5-03d57b9cf1d8 service nova] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] Received unexpected event network-vif-plugged-e153fc04-33de-4636-a657-8638ec48f960 for instance with vm_state building and task_state spawning.
Aug 17 12:23:50 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:23:50 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:23:50 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:23:52 user nova-compute[73449]: DEBUG nova.compute.manager [req-48d310e5-3c88-4811-9ff9-a12272457630 req-f65e58d1-26dd-4193-a8c8-206d4402203a service nova] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] Received event network-vif-plugged-e153fc04-33de-4636-a657-8638ec48f960 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:23:52 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-48d310e5-3c88-4811-9ff9-a12272457630 req-f65e58d1-26dd-4193-a8c8-206d4402203a service nova] Acquiring lock "a762749b-0aa6-4e11-912f-76d8daaf3488-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:23:52 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-48d310e5-3c88-4811-9ff9-a12272457630 req-f65e58d1-26dd-4193-a8c8-206d4402203a service nova] Lock "a762749b-0aa6-4e11-912f-76d8daaf3488-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:23:52 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-48d310e5-3c88-4811-9ff9-a12272457630 req-f65e58d1-26dd-4193-a8c8-206d4402203a service nova] Lock "a762749b-0aa6-4e11-912f-76d8daaf3488-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:23:52 user nova-compute[73449]: DEBUG nova.compute.manager [req-48d310e5-3c88-4811-9ff9-a12272457630 req-f65e58d1-26dd-4193-a8c8-206d4402203a service nova] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] No waiting events found dispatching network-vif-plugged-e153fc04-33de-4636-a657-8638ec48f960 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 12:23:52 user nova-compute[73449]: WARNING nova.compute.manager [req-48d310e5-3c88-4811-9ff9-a12272457630 req-f65e58d1-26dd-4193-a8c8-206d4402203a service nova] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] Received unexpected event network-vif-plugged-e153fc04-33de-4636-a657-8638ec48f960 for instance with vm_state building and task_state spawning.
Aug 17 12:23:52 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692275032.6050386, a762749b-0aa6-4e11-912f-76d8daaf3488 => Resumed> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 12:23:52 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] VM Resumed (Lifecycle Event)
Aug 17 12:23:52 user nova-compute[73449]: DEBUG nova.compute.manager [None req-689b5c98-53dd-439a-b22e-d09b008ec618 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] Instance event wait completed in 0 seconds for  {{(pid=73449) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 12:23:52 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-689b5c98-53dd-439a-b22e-d09b008ec618 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] Guest created on hypervisor {{(pid=73449) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 12:23:52 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] Instance spawned successfully.
Aug 17 12:23:52 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-689b5c98-53dd-439a-b22e-d09b008ec618 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 12:23:52 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 12:23:52 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 12:23:52 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-689b5c98-53dd-439a-b22e-d09b008ec618 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] Found default for hw_cdrom_bus of ide {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 12:23:52 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-689b5c98-53dd-439a-b22e-d09b008ec618 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] Found default for hw_disk_bus of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 12:23:52 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-689b5c98-53dd-439a-b22e-d09b008ec618 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] Found default for hw_input_bus of None {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 12:23:52 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-689b5c98-53dd-439a-b22e-d09b008ec618 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] Found default for hw_pointer_model of None {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 12:23:52 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-689b5c98-53dd-439a-b22e-d09b008ec618 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] Found default for hw_video_model of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 12:23:52 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-689b5c98-53dd-439a-b22e-d09b008ec618 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] Found default for hw_vif_model of virtio {{(pid=73449) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 12:23:52 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 12:23:52 user nova-compute[73449]: DEBUG nova.virt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Emitting event <LifecycleEvent: 1692275032.6064544, a762749b-0aa6-4e11-912f-76d8daaf3488 => Started> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 12:23:52 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] VM Started (Lifecycle Event)
Aug 17 12:23:52 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 12:23:52 user nova-compute[73449]: DEBUG nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73449) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 12:23:52 user nova-compute[73449]: INFO nova.compute.manager [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 12:23:52 user nova-compute[73449]: INFO nova.compute.manager [None req-689b5c98-53dd-439a-b22e-d09b008ec618 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] Took 7.01 seconds to spawn the instance on the hypervisor.
Aug 17 12:23:52 user nova-compute[73449]: DEBUG nova.compute.manager [None req-689b5c98-53dd-439a-b22e-d09b008ec618 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 12:23:52 user nova-compute[73449]: INFO nova.compute.manager [None req-689b5c98-53dd-439a-b22e-d09b008ec618 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] Took 7.65 seconds to build instance.
Aug 17 12:23:52 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-689b5c98-53dd-439a-b22e-d09b008ec618 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Lock "a762749b-0aa6-4e11-912f-76d8daaf3488" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.764s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:23:53 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:23:54 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:23:58 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:23:59 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:24:03 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:24:08 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:24:08 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:24:08 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73449) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 12:24:08 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:24:08 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:24:08 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:24:09 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:24:13 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:24:14 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:24:16 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:24:18 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:24:19 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:24:22 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:24:23 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:24:24 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:24:24 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:24:25 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:24:28 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:24:28 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:24:28 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:24:28 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73449) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 12:24:30 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:24:30 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:24:30 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:24:30 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:24:30 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:24:30 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=73449) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 12:24:31 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a762749b-0aa6-4e11-912f-76d8daaf3488/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:24:31 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a762749b-0aa6-4e11-912f-76d8daaf3488/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:24:31 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a762749b-0aa6-4e11-912f-76d8daaf3488/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:24:31 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a762749b-0aa6-4e11-912f-76d8daaf3488/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:24:31 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 12:24:31 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 12:24:31 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Hypervisor/Node resource view: name=user free_ram=8503MB free_disk=25.018268585205078GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73449) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 12:24:31 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:24:31 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:24:31 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance a762749b-0aa6-4e11-912f-76d8daaf3488 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 12:24:31 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73449) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 12:24:31 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73449) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 12:24:32 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 12:24:32 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 12:24:32 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Compute_service record updated for user:user {{(pid=73449) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 12:24:32 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.208s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:24:33 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:24:34 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:24:38 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:24:39 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:24:39 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Starting heal instance info cache {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 12:24:39 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Rebuilding the list of instances to heal {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 12:24:39 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "refresh_cache-a762749b-0aa6-4e11-912f-76d8daaf3488" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 12:24:39 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquired lock "refresh_cache-a762749b-0aa6-4e11-912f-76d8daaf3488" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 12:24:39 user nova-compute[73449]: DEBUG nova.network.neutron [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] Forcefully refreshing network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 12:24:39 user nova-compute[73449]: DEBUG nova.objects.instance [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lazy-loading 'info_cache' on Instance uuid a762749b-0aa6-4e11-912f-76d8daaf3488 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:24:39 user nova-compute[73449]: DEBUG nova.network.neutron [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] Updating instance_info_cache with network_info: [{"id": "e153fc04-33de-4636-a657-8638ec48f960", "address": "fa:16:3e:19:b7:c0", "network": {"id": "8c856a2a-08b3-4f78-9ed6-425371ba0c33", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1378352798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06f2957934dd4930883815ec6a1b18a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape153fc04-33", "ovs_interfaceid": "e153fc04-33de-4636-a657-8638ec48f960", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 12:24:39 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Releasing lock "refresh_cache-a762749b-0aa6-4e11-912f-76d8daaf3488" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 12:24:39 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] Updated the network info_cache for instance {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 12:24:39 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:24:43 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:24:48 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:24:48 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:24:48 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73449) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 12:24:48 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:24:48 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:24:48 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:24:53 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:24:58 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:25:03 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:25:08 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:25:13 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:25:16 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:25:17 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:25:18 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:25:23 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:25:23 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:25:24 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:25:25 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:25:28 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:25:29 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:25:29 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73449) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 12:25:30 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:25:30 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:25:30 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:25:30 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:25:30 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=73449) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 12:25:31 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a762749b-0aa6-4e11-912f-76d8daaf3488/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:25:31 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a762749b-0aa6-4e11-912f-76d8daaf3488/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:25:31 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a762749b-0aa6-4e11-912f-76d8daaf3488/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:25:31 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a762749b-0aa6-4e11-912f-76d8daaf3488/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:25:31 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 12:25:31 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 12:25:31 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Hypervisor/Node resource view: name=user free_ram=8742MB free_disk=25.016098022460938GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73449) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 12:25:31 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:25:31 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:25:31 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance a762749b-0aa6-4e11-912f-76d8daaf3488 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 12:25:31 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73449) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 12:25:31 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73449) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 12:25:32 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 12:25:32 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 12:25:32 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Compute_service record updated for user:user {{(pid=73449) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 12:25:32 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.177s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:25:33 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:25:33 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:25:36 user nova-compute[73449]: DEBUG nova.compute.manager [req-ed518177-e672-4493-b7b5-494b8a1c1f93 req-0e0ec397-8e53-4430-adfd-8698fb30cbb4 service nova] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] Received event network-changed-e153fc04-33de-4636-a657-8638ec48f960 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:25:36 user nova-compute[73449]: DEBUG nova.compute.manager [req-ed518177-e672-4493-b7b5-494b8a1c1f93 req-0e0ec397-8e53-4430-adfd-8698fb30cbb4 service nova] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] Refreshing instance network info cache due to event network-changed-e153fc04-33de-4636-a657-8638ec48f960. {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 12:25:36 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-ed518177-e672-4493-b7b5-494b8a1c1f93 req-0e0ec397-8e53-4430-adfd-8698fb30cbb4 service nova] Acquiring lock "refresh_cache-a762749b-0aa6-4e11-912f-76d8daaf3488" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 12:25:36 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-ed518177-e672-4493-b7b5-494b8a1c1f93 req-0e0ec397-8e53-4430-adfd-8698fb30cbb4 service nova] Acquired lock "refresh_cache-a762749b-0aa6-4e11-912f-76d8daaf3488" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 12:25:36 user nova-compute[73449]: DEBUG nova.network.neutron [req-ed518177-e672-4493-b7b5-494b8a1c1f93 req-0e0ec397-8e53-4430-adfd-8698fb30cbb4 service nova] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] Refreshing network info cache for port e153fc04-33de-4636-a657-8638ec48f960 {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 12:25:37 user nova-compute[73449]: DEBUG nova.network.neutron [req-ed518177-e672-4493-b7b5-494b8a1c1f93 req-0e0ec397-8e53-4430-adfd-8698fb30cbb4 service nova] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] Updated VIF entry in instance network info cache for port e153fc04-33de-4636-a657-8638ec48f960. {{(pid=73449) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 12:25:37 user nova-compute[73449]: DEBUG nova.network.neutron [req-ed518177-e672-4493-b7b5-494b8a1c1f93 req-0e0ec397-8e53-4430-adfd-8698fb30cbb4 service nova] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] Updating instance_info_cache with network_info: [{"id": "e153fc04-33de-4636-a657-8638ec48f960", "address": "fa:16:3e:19:b7:c0", "network": {"id": "8c856a2a-08b3-4f78-9ed6-425371ba0c33", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1378352798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06f2957934dd4930883815ec6a1b18a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape153fc04-33", "ovs_interfaceid": "e153fc04-33de-4636-a657-8638ec48f960", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 12:25:37 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-ed518177-e672-4493-b7b5-494b8a1c1f93 req-0e0ec397-8e53-4430-adfd-8698fb30cbb4 service nova] Releasing lock "refresh_cache-a762749b-0aa6-4e11-912f-76d8daaf3488" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 12:25:38 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:25:38 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:25:38 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73449) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 12:25:38 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:25:38 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:25:38 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:25:38 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:25:39 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:25:39 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:25:39 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Starting heal instance info cache {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 12:25:39 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Rebuilding the list of instances to heal {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 12:25:40 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "refresh_cache-a762749b-0aa6-4e11-912f-76d8daaf3488" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 12:25:40 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquired lock "refresh_cache-a762749b-0aa6-4e11-912f-76d8daaf3488" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 12:25:40 user nova-compute[73449]: DEBUG nova.network.neutron [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] Forcefully refreshing network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 12:25:40 user nova-compute[73449]: DEBUG nova.objects.instance [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lazy-loading 'info_cache' on Instance uuid a762749b-0aa6-4e11-912f-76d8daaf3488 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:25:40 user nova-compute[73449]: DEBUG nova.network.neutron [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] Updating instance_info_cache with network_info: [{"id": "e153fc04-33de-4636-a657-8638ec48f960", "address": "fa:16:3e:19:b7:c0", "network": {"id": "8c856a2a-08b3-4f78-9ed6-425371ba0c33", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1378352798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06f2957934dd4930883815ec6a1b18a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape153fc04-33", "ovs_interfaceid": "e153fc04-33de-4636-a657-8638ec48f960", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 12:25:40 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Releasing lock "refresh_cache-a762749b-0aa6-4e11-912f-76d8daaf3488" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 12:25:40 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] Updated the network info_cache for instance {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 12:25:41 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-f330275e-01f5-4740-8a10-39abd22e99d0 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Acquiring lock "a762749b-0aa6-4e11-912f-76d8daaf3488" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:25:41 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-f330275e-01f5-4740-8a10-39abd22e99d0 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Lock "a762749b-0aa6-4e11-912f-76d8daaf3488" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:25:41 user nova-compute[73449]: DEBUG nova.objects.instance [None req-f330275e-01f5-4740-8a10-39abd22e99d0 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Lazy-loading 'flavor' on Instance uuid a762749b-0aa6-4e11-912f-76d8daaf3488 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:25:41 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-f330275e-01f5-4740-8a10-39abd22e99d0 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Lock "a762749b-0aa6-4e11-912f-76d8daaf3488" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:25:41 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-f330275e-01f5-4740-8a10-39abd22e99d0 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Acquiring lock "a762749b-0aa6-4e11-912f-76d8daaf3488" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:25:41 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-f330275e-01f5-4740-8a10-39abd22e99d0 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Lock "a762749b-0aa6-4e11-912f-76d8daaf3488" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:25:41 user nova-compute[73449]: INFO nova.compute.manager [None req-f330275e-01f5-4740-8a10-39abd22e99d0 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] Attaching volume 33f390e5-e0f8-4ca7-bdd1-97ad2f351dac to /dev/vdb
Aug 17 12:25:41 user nova-compute[73449]: DEBUG os_brick.utils [None req-f330275e-01f5-4740-8a10-39abd22e99d0 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 12:25:41 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:25:41 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:25:41 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[d16027cd-2555-4294-9019-92f5cd0683ae]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4d3924302012\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:25:41 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:25:41 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:25:41 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a4bc8a8-087c-4752-a871-707a24e72005]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:25:41 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:25:41 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:25:41 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[370c0c88-6f09-4fd0-94fc-b0096677539e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:25:41 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[eda4ce93-6642-4db6-b070-92b5882777bb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:25:41 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-f330275e-01f5-4740-8a10-39abd22e99d0 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Running cmd (subprocess): nvme version {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:25:41 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-f330275e-01f5-4740-8a10-39abd22e99d0 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] 'nvme version' failed. Not Retrying. {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 12:25:41 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f330275e-01f5-4740-8a10-39abd22e99d0 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] nvme not present on system {{(pid=73449) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 12:25:41 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:25:41 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 12:25:41 user nova-compute[73449]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 12:25:41 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fcd5a8e-c1c7-40ad-a564-2d898248a66c]: (4, '') {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:25:41 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-f330275e-01f5-4740-8a10-39abd22e99d0 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73449) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 12:25:41 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-f330275e-01f5-4740-8a10-39abd22e99d0 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73449) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 12:25:41 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-f330275e-01f5-4740-8a10-39abd22e99d0 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] LIGHTOS: no hostnqn found. {{(pid=73449) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 12:25:41 user nova-compute[73449]: DEBUG os_brick.utils [None req-f330275e-01f5-4740-8a10-39abd22e99d0 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4d3924302012', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 12:25:41 user nova-compute[73449]: DEBUG nova.virt.block_device [None req-f330275e-01f5-4740-8a10-39abd22e99d0 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] Updating existing volume attachment record: 7a14ef7a-1221-42c6-99cd-ae56b4421eb0 {{(pid=73449) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 12:25:43 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:25:44 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:25:48 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:25:51 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f330275e-01f5-4740-8a10-39abd22e99d0 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] Calling os-brick to attach iSCSI Volume {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 12:25:51 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-f330275e-01f5-4740-8a10-39abd22e99d0 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:33f390e5-e0f8-4ca7-bdd1-97ad2f351dac'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YQWTaosZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 12:25:51 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-f330275e-01f5-4740-8a10-39abd22e99d0 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 12:25:51 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-f330275e-01f5-4740-8a10-39abd22e99d0 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 12:25:51 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-f330275e-01f5-4740-8a10-39abd22e99d0 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 12:25:51 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-f330275e-01f5-4740-8a10-39abd22e99d0 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 12:25:51 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-f330275e-01f5-4740-8a10-39abd22e99d0 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33f390e5-e0f8-4ca7-bdd1-97ad2f351dac" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 12:25:51 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-f330275e-01f5-4740-8a10-39abd22e99d0 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33f390e5-e0f8-4ca7-bdd1-97ad2f351dac" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 12:25:51 user nova-compute[73449]: INFO os_brick.initiator.connectors.iscsi [None req-f330275e-01f5-4740-8a10-39abd22e99d0 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 12:25:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33f390e5-e0f8-4ca7-bdd1-97ad2f351dac -p 172.16.0.220:3260 {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:25:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33f390e5-e0f8-4ca7-bdd1-97ad2f351dac -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:25:51 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[116e7187-e2ae-477e-bbba-1dab06bfb154]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:25:51 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-f330275e-01f5-4740-8a10-39abd22e99d0 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 12:25:51 user nova-compute[73449]:  {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:25:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33f390e5-e0f8-4ca7-bdd1-97ad2f351dac -p 172.16.0.220:3260 --interface default --op new {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:25:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33f390e5-e0f8-4ca7-bdd1-97ad2f351dac -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:25:51 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[133b1771-7110-4b48-96e5-fce5fba69f65]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:33f390e5-e0f8-4ca7-bdd1-97ad2f351dac] added\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:25:51 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-f330275e-01f5-4740-8a10-39abd22e99d0 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:33f390e5-e0f8-4ca7-bdd1-97ad2f351dac] added
Aug 17 12:25:51 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:25:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33f390e5-e0f8-4ca7-bdd1-97ad2f351dac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:25:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33f390e5-e0f8-4ca7-bdd1-97ad2f351dac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:25:51 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[6105b30b-fc3b-4a75-9209-9d05cde88f45]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:25:51 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-f330275e-01f5-4740-8a10-39abd22e99d0 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:25:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33f390e5-e0f8-4ca7-bdd1-97ad2f351dac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:25:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33f390e5-e0f8-4ca7-bdd1-97ad2f351dac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.035s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:25:51 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[034486f2-2fb6-4f59-8de6-609b958a2984]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:25:51 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-f330275e-01f5-4740-8a10-39abd22e99d0 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:25:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33f390e5-e0f8-4ca7-bdd1-97ad2f351dac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YQWTaosZ {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:25:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33f390e5-e0f8-4ca7-bdd1-97ad2f351dac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YQWTaosZ" returned: 0 in 0.017s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:25:51 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dc78d24-7670-4117-8513-d2bf55e19084]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:25:51 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-f330275e-01f5-4740-8a10-39abd22e99d0 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YQWTaosZ'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:25:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33f390e5-e0f8-4ca7-bdd1-97ad2f351dac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:25:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33f390e5-e0f8-4ca7-bdd1-97ad2f351dac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:25:51 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[92620746-53fb-42e2-a138-edf08f900839]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:25:51 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-f330275e-01f5-4740-8a10-39abd22e99d0 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:25:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:25:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:25:51 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[15815311-4470-4496-8a24-0d2e48788dac]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:25:51 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-f330275e-01f5-4740-8a10-39abd22e99d0 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 17 12:25:51 user nova-compute[73449]:  {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 12:25:51 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-f330275e-01f5-4740-8a10-39abd22e99d0 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 17 12:25:51 user nova-compute[73449]:  {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 12:25:51 user nova-compute[73449]: WARNING os_brick.initiator.connectors.iscsi [None req-f330275e-01f5-4740-8a10-39abd22e99d0 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 17 12:25:51 user nova-compute[73449]: 
Aug 17 12:25:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33f390e5-e0f8-4ca7-bdd1-97ad2f351dac -p 172.16.0.220:3260 --login {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:25:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33f390e5-e0f8-4ca7-bdd1-97ad2f351dac -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:25:51 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5b79a1d-5a5f-4117-b9ff-57ef2628f34a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:33f390e5-e0f8-4ca7-bdd1-97ad2f351dac, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:33f390e5-e0f8-4ca7-bdd1-97ad2f351dac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:25:51 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-f330275e-01f5-4740-8a10-39abd22e99d0 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:33f390e5-e0f8-4ca7-bdd1-97ad2f351dac, portal: 172.16.0.220,3260]
Aug 17 12:25:51 user nova-compute[73449]: Login to [iface: default, target: iqn.2010-10.org.openstack:33f390e5-e0f8-4ca7-bdd1-97ad2f351dac, portal: 172.16.0.220,3260] successful.
Aug 17 12:25:51 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:25:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33f390e5-e0f8-4ca7-bdd1-97ad2f351dac -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:25:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33f390e5-e0f8-4ca7-bdd1-97ad2f351dac -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:25:51 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[db8510cd-477b-4608-a0b7-37d6b60970fd]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:25:51 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-f330275e-01f5-4740-8a10-39abd22e99d0 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:25:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:25:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:25:51 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c1f88f9-d694-4af1-9fb2-dc782f106c75]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33f390e5-e0f8-4ca7-bdd1-97ad2f351dac (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:25:51 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-f330275e-01f5-4740-8a10-39abd22e99d0 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33f390e5-e0f8-4ca7-bdd1-97ad2f351dac (non-flash)
Aug 17 12:25:51 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 12:25:51 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-f330275e-01f5-4740-8a10-39abd22e99d0 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33f390e5-e0f8-4ca7-bdd1-97ad2f351dac (non-flash)
Aug 17 12:25:51 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 12:25:51 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-f330275e-01f5-4740-8a10-39abd22e99d0 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33f390e5-e0f8-4ca7-bdd1-97ad2f351dac" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 12:25:51 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-f330275e-01f5-4740-8a10-39abd22e99d0 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Connected to 172.16.0.220:3260 {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 12:25:51 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-f330275e-01f5-4740-8a10-39abd22e99d0 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] HCTL ('33', '-', '-', 0) found on session 67 with lun 0 {{(pid=73449) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 12:25:51 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-f330275e-01f5-4740-8a10-39abd22e99d0 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73449) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 12:25:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:25:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:25:51 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[645397b3-2881-4df4-987b-29a01a1a3922]: (4, ('- - 0', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:25:51 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-f330275e-01f5-4740-8a10-39abd22e99d0 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73449) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 12:25:51 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-f330275e-01f5-4740-8a10-39abd22e99d0 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YQWTaosZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 12:25:52 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-f330275e-01f5-4740-8a10-39abd22e99d0 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.301s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 12:25:52 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-f330275e-01f5-4740-8a10-39abd22e99d0 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] <== connect_volume: return (1303ms) {'type': 'block', 'scsi_wwn': '23532326164643032', 'path': '/dev/sdb'} {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 12:25:52 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f330275e-01f5-4740-8a10-39abd22e99d0 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23532326164643032', 'path': '/dev/sdb'} {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 12:25:52 user nova-compute[73449]: DEBUG nova.objects.instance [None req-f330275e-01f5-4740-8a10-39abd22e99d0 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Lazy-loading 'flavor' on Instance uuid a762749b-0aa6-4e11-912f-76d8daaf3488 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:25:52 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-f330275e-01f5-4740-8a10-39abd22e99d0 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 12:25:52 user nova-compute[73449]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 12:25:52 user nova-compute[73449]:   <source dev="/dev/sdb"/>
Aug 17 12:25:52 user nova-compute[73449]:   <target dev="vdb" bus="virtio"/>
Aug 17 12:25:52 user nova-compute[73449]:   <serial>33f390e5-e0f8-4ca7-bdd1-97ad2f351dac</serial>
Aug 17 12:25:52 user nova-compute[73449]: </disk>
Aug 17 12:25:52 user nova-compute[73449]:  {{(pid=73449) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 12:25:53 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-f330275e-01f5-4740-8a10-39abd22e99d0 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] No BDM found with device name vda, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 12:25:53 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-f330275e-01f5-4740-8a10-39abd22e99d0 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 12:25:53 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-f330275e-01f5-4740-8a10-39abd22e99d0 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] No VIF found with MAC fa:16:3e:19:b7:c0, not building metadata {{(pid=73449) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 12:25:53 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-f330275e-01f5-4740-8a10-39abd22e99d0 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Lock "a762749b-0aa6-4e11-912f-76d8daaf3488" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.114s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:25:53 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:25:53 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:25:53 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73449) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 12:25:53 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:25:53 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:25:53 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:25:54 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:25:58 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:25:59 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:26:03 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:26:08 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:26:08 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:26:08 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73449) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 12:26:08 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:26:08 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:26:08 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:26:09 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:26:13 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:26:14 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:26:18 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:26:18 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:26:19 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:26:22 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-ccfdd18c-24c7-4a26-93f1-592f10154222 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Acquiring lock "a762749b-0aa6-4e11-912f-76d8daaf3488" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:26:22 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-ccfdd18c-24c7-4a26-93f1-592f10154222 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Lock "a762749b-0aa6-4e11-912f-76d8daaf3488" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:26:22 user nova-compute[73449]: INFO nova.compute.manager [None req-ccfdd18c-24c7-4a26-93f1-592f10154222 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] Detaching volume 33f390e5-e0f8-4ca7-bdd1-97ad2f351dac
Aug 17 12:26:23 user nova-compute[73449]: INFO nova.virt.block_device [None req-ccfdd18c-24c7-4a26-93f1-592f10154222 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] Attempting to driver detach volume 33f390e5-e0f8-4ca7-bdd1-97ad2f351dac from mountpoint /dev/vdb
Aug 17 12:26:23 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-ccfdd18c-24c7-4a26-93f1-592f10154222 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Attempting to detach device vdb from instance a762749b-0aa6-4e11-912f-76d8daaf3488 from the persistent domain config. {{(pid=73449) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 12:26:23 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-ccfdd18c-24c7-4a26-93f1-592f10154222 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 12:26:23 user nova-compute[73449]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 12:26:23 user nova-compute[73449]:   <source dev="/dev/sdb"/>
Aug 17 12:26:23 user nova-compute[73449]:   <target dev="vdb" bus="virtio"/>
Aug 17 12:26:23 user nova-compute[73449]:   <serial>33f390e5-e0f8-4ca7-bdd1-97ad2f351dac</serial>
Aug 17 12:26:23 user nova-compute[73449]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 12:26:23 user nova-compute[73449]: </disk>
Aug 17 12:26:23 user nova-compute[73449]:  {{(pid=73449) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 12:26:23 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-ccfdd18c-24c7-4a26-93f1-592f10154222 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Successfully detached device vdb from instance a762749b-0aa6-4e11-912f-76d8daaf3488 from the persistent domain config.
Aug 17 12:26:23 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-ccfdd18c-24c7-4a26-93f1-592f10154222 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a762749b-0aa6-4e11-912f-76d8daaf3488 from the live domain config. {{(pid=73449) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 12:26:23 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-ccfdd18c-24c7-4a26-93f1-592f10154222 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 12:26:23 user nova-compute[73449]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 12:26:23 user nova-compute[73449]:   <source dev="/dev/sdb"/>
Aug 17 12:26:23 user nova-compute[73449]:   <target dev="vdb" bus="virtio"/>
Aug 17 12:26:23 user nova-compute[73449]:   <serial>33f390e5-e0f8-4ca7-bdd1-97ad2f351dac</serial>
Aug 17 12:26:23 user nova-compute[73449]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 12:26:23 user nova-compute[73449]: </disk>
Aug 17 12:26:23 user nova-compute[73449]:  {{(pid=73449) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 12:26:23 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Received event <DeviceRemovedEvent: 1692275183.4786751, a762749b-0aa6-4e11-912f-76d8daaf3488 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73449) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 12:26:23 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-ccfdd18c-24c7-4a26-93f1-592f10154222 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a762749b-0aa6-4e11-912f-76d8daaf3488 {{(pid=73449) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 12:26:23 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-ccfdd18c-24c7-4a26-93f1-592f10154222 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Successfully detached device vdb from instance a762749b-0aa6-4e11-912f-76d8daaf3488 from the live domain config.
Aug 17 12:26:23 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ccfdd18c-24c7-4a26-93f1-592f10154222 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] calling os-brick to detach iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 12:26:23 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccfdd18c-24c7-4a26-93f1-592f10154222 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, {'target_iqns': ['iqn.2010-10.org.openstack:33f390e5-e0f8-4ca7-bdd1-97ad2f351dac'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YQWTaosZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 12:26:23 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-ccfdd18c-24c7-4a26-93f1-592f10154222 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 12:26:23 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-ccfdd18c-24c7-4a26-93f1-592f10154222 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 12:26:23 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-ccfdd18c-24c7-4a26-93f1-592f10154222 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 12:26:23 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccfdd18c-24c7-4a26-93f1-592f10154222 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:33f390e5-e0f8-4ca7-bdd1-97ad2f351dac', 0)] {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 12:26:23 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:26:23 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:26:23 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf956d97-3112-4299-8b49-5a686580987f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33f390e5-e0f8-4ca7-bdd1-97ad2f351dac\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:26:23 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:26:23 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:26:23 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c866809-c224-451f-96b6-b5f6205eda07]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33f390e5-e0f8-4ca7-bdd1-97ad2f351dac (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:26:23 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccfdd18c-24c7-4a26-93f1-592f10154222 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33f390e5-e0f8-4ca7-bdd1-97ad2f351dac (non-flash)
Aug 17 12:26:23 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 12:26:23 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccfdd18c-24c7-4a26-93f1-592f10154222 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33f390e5-e0f8-4ca7-bdd1-97ad2f351dac (non-flash)
Aug 17 12:26:23 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 12:26:23 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccfdd18c-24c7-4a26-93f1-592f10154222 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe73871bf40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:33f390e5-e0f8-4ca7-bdd1-97ad2f351dac'): ({'sdb'}, set())}) {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 12:26:23 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-ccfdd18c-24c7-4a26-93f1-592f10154222 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Removing single pathed devices sdb {{(pid=73449) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 12:26:23 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:26:23 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:26:23 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd40c59e-77ac-4d41-88dd-da1edf1600dd]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:26:23 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:26:23 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:26:23 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[a04d17a2-559f-4859-a03a-dd61599c1951]: (4, ('ok\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:26:23 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-ccfdd18c-24c7-4a26-93f1-592f10154222 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Flushing IO for device /dev/sdb {{(pid=73449) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 12:26:23 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:26:23 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:26:23 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9fc166d-a949-452f-85ed-fc60d76e9df1]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:26:23 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-ccfdd18c-24c7-4a26-93f1-592f10154222 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73449) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 12:26:23 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:26:23 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:26:23 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7321ba2-eb13-46d8-a9e5-0cff65690096]: (4, ('1', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:26:23 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-ccfdd18c-24c7-4a26-93f1-592f10154222 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73449) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 12:26:23 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-ccfdd18c-24c7-4a26-93f1-592f10154222 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] SCSI volumes sdb have been removed. {{(pid=73449) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 12:26:23 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccfdd18c-24c7-4a26-93f1-592f10154222 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:33f390e5-e0f8-4ca7-bdd1-97ad2f351dac')] {{(pid=73449) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 12:26:23 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33f390e5-e0f8-4ca7-bdd1-97ad2f351dac -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:26:23 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33f390e5-e0f8-4ca7-bdd1-97ad2f351dac -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:26:23 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[0482e29c-48e8-4de8-b148-a13fd3ccf3ca]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:26:23 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccfdd18c-24c7-4a26-93f1-592f10154222 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:26:23 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33f390e5-e0f8-4ca7-bdd1-97ad2f351dac -p 172.16.0.220:3260 --logout {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:26:23 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33f390e5-e0f8-4ca7-bdd1-97ad2f351dac -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:26:23 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0dfa775-023c-459c-a91f-15e0c5a33af9]: (4, ('Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:33f390e5-e0f8-4ca7-bdd1-97ad2f351dac, portal: 172.16.0.220,3260]\nLogout of [sid: 67, target: iqn.2010-10.org.openstack:33f390e5-e0f8-4ca7-bdd1-97ad2f351dac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:26:23 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccfdd18c-24c7-4a26-93f1-592f10154222 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:33f390e5-e0f8-4ca7-bdd1-97ad2f351dac, portal: 172.16.0.220,3260]
Aug 17 12:26:23 user nova-compute[73449]: Logout of [sid: 67, target: iqn.2010-10.org.openstack:33f390e5-e0f8-4ca7-bdd1-97ad2f351dac, portal: 172.16.0.220,3260] successful.
Aug 17 12:26:23 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:26:23 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33f390e5-e0f8-4ca7-bdd1-97ad2f351dac -p 172.16.0.220:3260 --op delete {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:26:23 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33f390e5-e0f8-4ca7-bdd1-97ad2f351dac -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:26:23 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5665461-7cc0-46ed-a147-645e732c1d96]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:26:23 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccfdd18c-24c7-4a26-93f1-592f10154222 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:26:23 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-ccfdd18c-24c7-4a26-93f1-592f10154222 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.279s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 12:26:23 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccfdd18c-24c7-4a26-93f1-592f10154222 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] <== disconnect_volume: return (280ms) None {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 12:26:23 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ccfdd18c-24c7-4a26-93f1-592f10154222 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] Disconnected iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 12:26:23 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:26:23 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:26:24 user nova-compute[73449]: DEBUG nova.objects.instance [None req-ccfdd18c-24c7-4a26-93f1-592f10154222 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Lazy-loading 'flavor' on Instance uuid a762749b-0aa6-4e11-912f-76d8daaf3488 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:26:24 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-ccfdd18c-24c7-4a26-93f1-592f10154222 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Lock "a762749b-0aa6-4e11-912f-76d8daaf3488" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.673s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:26:25 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:26:26 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:26:28 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:26:28 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:26:28 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73449) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 12:26:28 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:26:28 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:26:28 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:26:28 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:26:28 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Cleaning up deleted instances {{(pid=73449) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 17 12:26:28 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] There are 0 instances to clean {{(pid=73449) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 17 12:26:31 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:26:31 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73449) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 12:26:31 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:26:31 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:26:31 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:26:31 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:26:31 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=73449) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 12:26:32 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a762749b-0aa6-4e11-912f-76d8daaf3488/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:26:32 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a762749b-0aa6-4e11-912f-76d8daaf3488/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:26:32 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a762749b-0aa6-4e11-912f-76d8daaf3488/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:26:32 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a762749b-0aa6-4e11-912f-76d8daaf3488/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:26:32 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 12:26:32 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 12:26:32 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Hypervisor/Node resource view: name=user free_ram=8802MB free_disk=25.014556884765625GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73449) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 12:26:32 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:26:32 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:26:32 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance a762749b-0aa6-4e11-912f-76d8daaf3488 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 12:26:32 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73449) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 12:26:32 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73449) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 12:26:32 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 12:26:32 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 12:26:32 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Compute_service record updated for user:user {{(pid=73449) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 12:26:32 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.177s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:26:33 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:26:33 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:26:33 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:26:35 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:26:38 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:26:39 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:26:41 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:26:41 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Starting heal instance info cache {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 12:26:41 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Rebuilding the list of instances to heal {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 12:26:42 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "refresh_cache-a762749b-0aa6-4e11-912f-76d8daaf3488" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 12:26:42 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquired lock "refresh_cache-a762749b-0aa6-4e11-912f-76d8daaf3488" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 12:26:42 user nova-compute[73449]: DEBUG nova.network.neutron [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] Forcefully refreshing network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 12:26:42 user nova-compute[73449]: DEBUG nova.objects.instance [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lazy-loading 'info_cache' on Instance uuid a762749b-0aa6-4e11-912f-76d8daaf3488 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:26:42 user nova-compute[73449]: DEBUG nova.network.neutron [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] Updating instance_info_cache with network_info: [{"id": "e153fc04-33de-4636-a657-8638ec48f960", "address": "fa:16:3e:19:b7:c0", "network": {"id": "8c856a2a-08b3-4f78-9ed6-425371ba0c33", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1378352798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06f2957934dd4930883815ec6a1b18a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape153fc04-33", "ovs_interfaceid": "e153fc04-33de-4636-a657-8638ec48f960", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 12:26:42 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Releasing lock "refresh_cache-a762749b-0aa6-4e11-912f-76d8daaf3488" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 12:26:42 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] Updated the network info_cache for instance {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 12:26:43 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:26:43 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:26:43 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73449) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 12:26:43 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:26:43 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:26:43 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:26:48 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:26:48 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:26:48 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73449) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 12:26:48 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:26:48 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:26:48 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:26:53 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:26:53 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:26:53 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73449) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 12:26:53 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:26:53 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:26:53 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:26:58 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:27:03 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:27:03 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:27:03 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73449) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 12:27:03 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:27:03 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:27:03 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:27:08 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:27:08 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:27:08 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73449) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 12:27:08 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:27:08 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:27:08 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:27:09 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:27:09 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73449) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 17 12:27:13 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:27:17 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-649ae139-cb68-4e43-9396-dbe77d19054d tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Acquiring lock "a762749b-0aa6-4e11-912f-76d8daaf3488" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:27:17 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-649ae139-cb68-4e43-9396-dbe77d19054d tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Lock "a762749b-0aa6-4e11-912f-76d8daaf3488" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:27:17 user nova-compute[73449]: DEBUG nova.objects.instance [None req-649ae139-cb68-4e43-9396-dbe77d19054d tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Lazy-loading 'flavor' on Instance uuid a762749b-0aa6-4e11-912f-76d8daaf3488 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:27:17 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-649ae139-cb68-4e43-9396-dbe77d19054d tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Lock "a762749b-0aa6-4e11-912f-76d8daaf3488" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:27:17 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-649ae139-cb68-4e43-9396-dbe77d19054d tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Acquiring lock "a762749b-0aa6-4e11-912f-76d8daaf3488" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:27:17 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-649ae139-cb68-4e43-9396-dbe77d19054d tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Lock "a762749b-0aa6-4e11-912f-76d8daaf3488" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:27:17 user nova-compute[73449]: INFO nova.compute.manager [None req-649ae139-cb68-4e43-9396-dbe77d19054d tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] Attaching volume 0768de0d-3fe5-49b5-bd31-aaef1690deab to /dev/vdb
Aug 17 12:27:17 user nova-compute[73449]: DEBUG os_brick.utils [None req-649ae139-cb68-4e43-9396-dbe77d19054d tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 12:27:17 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:27:17 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:27:17 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[c64163b7-8a50-465a-96c2-45b7111e95d0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4d3924302012\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:27:17 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:27:17 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:27:17 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4ba94c0-9a12-43c7-b7da-99b088498c80]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:27:17 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:27:17 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:27:17 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[be34a398-5225-4259-b193-2b67f2326201]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:27:17 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[43c813b9-ada2-44cc-b675-830b01dda69d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:27:17 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-649ae139-cb68-4e43-9396-dbe77d19054d tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Running cmd (subprocess): nvme version {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:27:17 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-649ae139-cb68-4e43-9396-dbe77d19054d tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] 'nvme version' failed. Not Retrying. {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 12:27:17 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.nvmeof [None req-649ae139-cb68-4e43-9396-dbe77d19054d tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] nvme not present on system {{(pid=73449) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 12:27:17 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:27:17 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 12:27:17 user nova-compute[73449]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 12:27:17 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa9eb133-151d-4145-b753-bd765202ed69]: (4, '') {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:27:17 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-649ae139-cb68-4e43-9396-dbe77d19054d tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73449) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 12:27:17 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-649ae139-cb68-4e43-9396-dbe77d19054d tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73449) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 12:27:17 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-649ae139-cb68-4e43-9396-dbe77d19054d tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] LIGHTOS: no hostnqn found. {{(pid=73449) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 12:27:17 user nova-compute[73449]: DEBUG os_brick.utils [None req-649ae139-cb68-4e43-9396-dbe77d19054d tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] <== get_connector_properties: return (155ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4d3924302012', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 12:27:17 user nova-compute[73449]: DEBUG nova.virt.block_device [None req-649ae139-cb68-4e43-9396-dbe77d19054d tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] Updating existing volume attachment record: 1fc8ce81-a245-493f-bba2-d6258cd660f8 {{(pid=73449) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 12:27:18 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:27:18 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:27:18 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73449) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 12:27:18 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:27:18 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:27:18 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:27:19 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:27:19 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:27:23 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:27:25 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:27:25 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:27:26 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:27:28 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:27:31 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:27:31 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Triggering sync for uuid a762749b-0aa6-4e11-912f-76d8daaf3488 {{(pid=73449) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 12:27:31 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "a762749b-0aa6-4e11-912f-76d8daaf3488" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:27:32 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:27:32 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:27:32 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73449) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 12:27:32 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:27:32 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:27:32 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:27:32 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:27:32 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=73449) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 12:27:33 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a762749b-0aa6-4e11-912f-76d8daaf3488/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:27:33 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a762749b-0aa6-4e11-912f-76d8daaf3488/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:27:33 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a762749b-0aa6-4e11-912f-76d8daaf3488/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:27:33 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a762749b-0aa6-4e11-912f-76d8daaf3488/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:27:33 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 12:27:33 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 12:27:33 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Hypervisor/Node resource view: name=user free_ram=8810MB free_disk=25.0137939453125GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73449) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 12:27:33 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:27:33 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:27:33 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:27:34 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance a762749b-0aa6-4e11-912f-76d8daaf3488 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 12:27:34 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73449) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 12:27:34 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73449) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 12:27:34 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Refreshing inventories for resource provider 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 17 12:27:34 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Updating ProviderTree inventory for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 17 12:27:34 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Updating inventory in ProviderTree for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 12:27:34 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Refreshing aggregate associations for resource provider 20986bee-3f54-4b89-bec1-f8387ef700c4, aggregates: None {{(pid=73449) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 17 12:27:34 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-649ae139-cb68-4e43-9396-dbe77d19054d tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] Calling os-brick to attach iSCSI Volume {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 12:27:34 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-649ae139-cb68-4e43-9396-dbe77d19054d tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0768de0d-3fe5-49b5-bd31-aaef1690deab'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GDsMJlOp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 12:27:34 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-649ae139-cb68-4e43-9396-dbe77d19054d tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 12:27:34 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-649ae139-cb68-4e43-9396-dbe77d19054d tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 12:27:34 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-649ae139-cb68-4e43-9396-dbe77d19054d tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 12:27:34 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-649ae139-cb68-4e43-9396-dbe77d19054d tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 12:27:34 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-649ae139-cb68-4e43-9396-dbe77d19054d tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0768de0d-3fe5-49b5-bd31-aaef1690deab" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 12:27:34 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-649ae139-cb68-4e43-9396-dbe77d19054d tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0768de0d-3fe5-49b5-bd31-aaef1690deab" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 12:27:34 user nova-compute[73449]: INFO os_brick.initiator.connectors.iscsi [None req-649ae139-cb68-4e43-9396-dbe77d19054d tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 12:27:34 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0768de0d-3fe5-49b5-bd31-aaef1690deab -p 172.16.0.220:3260 {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:27:34 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Refreshing trait associations for resource provider 20986bee-3f54-4b89-bec1-f8387ef700c4, traits: COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NODE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE42,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSSE3,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_ISO {{(pid=73449) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 17 12:27:34 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0768de0d-3fe5-49b5-bd31-aaef1690deab -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:27:34 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bac2260-bfbb-4147-bb90-cea5e6ea8e7f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:27:34 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-649ae139-cb68-4e43-9396-dbe77d19054d tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 12:27:34 user nova-compute[73449]:  {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:27:34 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0768de0d-3fe5-49b5-bd31-aaef1690deab -p 172.16.0.220:3260 --interface default --op new {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:27:34 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0768de0d-3fe5-49b5-bd31-aaef1690deab -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:27:34 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3c9a93d-464f-4b9b-ba84-cbabbe192883]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0768de0d-3fe5-49b5-bd31-aaef1690deab] added\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:27:34 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-649ae139-cb68-4e43-9396-dbe77d19054d tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0768de0d-3fe5-49b5-bd31-aaef1690deab] added
Aug 17 12:27:34 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:27:34 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0768de0d-3fe5-49b5-bd31-aaef1690deab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:27:34 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 12:27:34 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0768de0d-3fe5-49b5-bd31-aaef1690deab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:27:34 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa201aca-8320-4c3b-9a09-49c3c440da8a]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:27:34 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-649ae139-cb68-4e43-9396-dbe77d19054d tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:27:34 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0768de0d-3fe5-49b5-bd31-aaef1690deab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:27:34 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 12:27:34 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Compute_service record updated for user:user {{(pid=73449) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 12:27:34 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.448s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:27:34 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0768de0d-3fe5-49b5-bd31-aaef1690deab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:27:34 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab18a284-39eb-475a-ad30-d36f4b2b3e02]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:27:34 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-649ae139-cb68-4e43-9396-dbe77d19054d tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:27:34 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0768de0d-3fe5-49b5-bd31-aaef1690deab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GDsMJlOp {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:27:34 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0768de0d-3fe5-49b5-bd31-aaef1690deab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GDsMJlOp" returned: 0 in 0.025s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:27:34 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[638147fa-f4a4-42e0-8077-c998cb1290bb]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:27:34 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-649ae139-cb68-4e43-9396-dbe77d19054d tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GDsMJlOp'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:27:34 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0768de0d-3fe5-49b5-bd31-aaef1690deab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:27:34 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0768de0d-3fe5-49b5-bd31-aaef1690deab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:27:34 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[acb125df-fa8e-4ce2-b992-f99c5d9aa3c3]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:27:34 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-649ae139-cb68-4e43-9396-dbe77d19054d tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:27:34 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:27:34 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:27:34 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[75e38e92-fa1c-44d4-aac2-1a248f6fc8ec]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:27:34 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-649ae139-cb68-4e43-9396-dbe77d19054d tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 17 12:27:34 user nova-compute[73449]:  {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 12:27:34 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-649ae139-cb68-4e43-9396-dbe77d19054d tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 17 12:27:34 user nova-compute[73449]:  {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 12:27:34 user nova-compute[73449]: WARNING os_brick.initiator.connectors.iscsi [None req-649ae139-cb68-4e43-9396-dbe77d19054d tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 17 12:27:34 user nova-compute[73449]: 
Aug 17 12:27:34 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0768de0d-3fe5-49b5-bd31-aaef1690deab -p 172.16.0.220:3260 --login {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:27:34 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0768de0d-3fe5-49b5-bd31-aaef1690deab -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:27:34 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6021e83-548e-45e6-bc22-7a8fc7b996c1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0768de0d-3fe5-49b5-bd31-aaef1690deab, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0768de0d-3fe5-49b5-bd31-aaef1690deab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:27:34 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-649ae139-cb68-4e43-9396-dbe77d19054d tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0768de0d-3fe5-49b5-bd31-aaef1690deab, portal: 172.16.0.220,3260]
Aug 17 12:27:34 user nova-compute[73449]: Login to [iface: default, target: iqn.2010-10.org.openstack:0768de0d-3fe5-49b5-bd31-aaef1690deab, portal: 172.16.0.220,3260] successful.
Aug 17 12:27:34 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:27:34 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0768de0d-3fe5-49b5-bd31-aaef1690deab -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:27:34 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0768de0d-3fe5-49b5-bd31-aaef1690deab -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:27:34 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf23e4d3-9c80-41ba-ae13-5773e24c776f]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:27:34 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-649ae139-cb68-4e43-9396-dbe77d19054d tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:27:34 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:27:34 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:27:34 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[18efd289-30e1-43fc-968c-d8b0be4652ef]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0768de0d-3fe5-49b5-bd31-aaef1690deab (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:27:34 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-649ae139-cb68-4e43-9396-dbe77d19054d tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0768de0d-3fe5-49b5-bd31-aaef1690deab (non-flash)
Aug 17 12:27:34 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 12:27:34 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-649ae139-cb68-4e43-9396-dbe77d19054d tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0768de0d-3fe5-49b5-bd31-aaef1690deab (non-flash)
Aug 17 12:27:34 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 12:27:34 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-649ae139-cb68-4e43-9396-dbe77d19054d tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0768de0d-3fe5-49b5-bd31-aaef1690deab" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 12:27:34 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-649ae139-cb68-4e43-9396-dbe77d19054d tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Connected to 172.16.0.220:3260 {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 12:27:34 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-649ae139-cb68-4e43-9396-dbe77d19054d tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] HCTL ('33', '-', '-', 0) found on session 68 with lun 0 {{(pid=73449) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 12:27:34 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-649ae139-cb68-4e43-9396-dbe77d19054d tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73449) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 12:27:34 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:27:34 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:27:34 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[44e6444d-a2bb-478d-85b1-f48b8df37c36]: (4, ('- - 0', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:27:34 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-649ae139-cb68-4e43-9396-dbe77d19054d tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73449) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 12:27:34 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-649ae139-cb68-4e43-9396-dbe77d19054d tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GDsMJlOp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 12:27:35 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-649ae139-cb68-4e43-9396-dbe77d19054d tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 12:27:35 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-649ae139-cb68-4e43-9396-dbe77d19054d tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] <== connect_volume: return (1307ms) {'type': 'block', 'scsi_wwn': '26564653831613161', 'path': '/dev/sdb'} {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 12:27:35 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-649ae139-cb68-4e43-9396-dbe77d19054d tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26564653831613161', 'path': '/dev/sdb'} {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 12:27:35 user nova-compute[73449]: DEBUG nova.objects.instance [None req-649ae139-cb68-4e43-9396-dbe77d19054d tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Lazy-loading 'flavor' on Instance uuid a762749b-0aa6-4e11-912f-76d8daaf3488 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:27:35 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-649ae139-cb68-4e43-9396-dbe77d19054d tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 12:27:35 user nova-compute[73449]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 12:27:35 user nova-compute[73449]:   <source dev="/dev/sdb"/>
Aug 17 12:27:35 user nova-compute[73449]:   <target dev="vdb" bus="virtio"/>
Aug 17 12:27:35 user nova-compute[73449]:   <serial>0768de0d-3fe5-49b5-bd31-aaef1690deab</serial>
Aug 17 12:27:35 user nova-compute[73449]: </disk>
Aug 17 12:27:35 user nova-compute[73449]:  {{(pid=73449) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 12:27:35 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-649ae139-cb68-4e43-9396-dbe77d19054d tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] No BDM found with device name vda, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 12:27:35 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-649ae139-cb68-4e43-9396-dbe77d19054d tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 12:27:35 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-649ae139-cb68-4e43-9396-dbe77d19054d tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] No VIF found with MAC fa:16:3e:19:b7:c0, not building metadata {{(pid=73449) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 12:27:35 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-649ae139-cb68-4e43-9396-dbe77d19054d tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Lock "a762749b-0aa6-4e11-912f-76d8daaf3488" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.638s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:27:35 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "a762749b-0aa6-4e11-912f-76d8daaf3488" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 4.618s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:27:36 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "a762749b-0aa6-4e11-912f-76d8daaf3488" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.024s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:27:38 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-fbd6cb25-a19e-43e7-9a53-59002ade871e tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Acquiring lock "a762749b-0aa6-4e11-912f-76d8daaf3488" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:27:38 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-fbd6cb25-a19e-43e7-9a53-59002ade871e tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Lock "a762749b-0aa6-4e11-912f-76d8daaf3488" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:27:38 user nova-compute[73449]: INFO nova.compute.manager [None req-fbd6cb25-a19e-43e7-9a53-59002ade871e tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] Detaching volume 0768de0d-3fe5-49b5-bd31-aaef1690deab
Aug 17 12:27:38 user nova-compute[73449]: INFO nova.virt.block_device [None req-fbd6cb25-a19e-43e7-9a53-59002ade871e tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] Attempting to driver detach volume 0768de0d-3fe5-49b5-bd31-aaef1690deab from mountpoint /dev/vdb
Aug 17 12:27:38 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-fbd6cb25-a19e-43e7-9a53-59002ade871e tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Attempting to detach device vdb from instance a762749b-0aa6-4e11-912f-76d8daaf3488 from the persistent domain config. {{(pid=73449) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 12:27:38 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-fbd6cb25-a19e-43e7-9a53-59002ade871e tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 12:27:38 user nova-compute[73449]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 12:27:38 user nova-compute[73449]:   <source dev="/dev/sdb"/>
Aug 17 12:27:38 user nova-compute[73449]:   <target dev="vdb" bus="virtio"/>
Aug 17 12:27:38 user nova-compute[73449]:   <serial>0768de0d-3fe5-49b5-bd31-aaef1690deab</serial>
Aug 17 12:27:38 user nova-compute[73449]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 12:27:38 user nova-compute[73449]: </disk>
Aug 17 12:27:38 user nova-compute[73449]:  {{(pid=73449) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 12:27:38 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-fbd6cb25-a19e-43e7-9a53-59002ade871e tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Successfully detached device vdb from instance a762749b-0aa6-4e11-912f-76d8daaf3488 from the persistent domain config.
Aug 17 12:27:38 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-fbd6cb25-a19e-43e7-9a53-59002ade871e tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a762749b-0aa6-4e11-912f-76d8daaf3488 from the live domain config. {{(pid=73449) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 12:27:38 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-fbd6cb25-a19e-43e7-9a53-59002ade871e tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 12:27:38 user nova-compute[73449]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 12:27:38 user nova-compute[73449]:   <source dev="/dev/sdb"/>
Aug 17 12:27:38 user nova-compute[73449]:   <target dev="vdb" bus="virtio"/>
Aug 17 12:27:38 user nova-compute[73449]:   <serial>0768de0d-3fe5-49b5-bd31-aaef1690deab</serial>
Aug 17 12:27:38 user nova-compute[73449]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 12:27:38 user nova-compute[73449]: </disk>
Aug 17 12:27:38 user nova-compute[73449]:  {{(pid=73449) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 12:27:38 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Received event <DeviceRemovedEvent: 1692275258.8573418, a762749b-0aa6-4e11-912f-76d8daaf3488 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73449) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 12:27:38 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-fbd6cb25-a19e-43e7-9a53-59002ade871e tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a762749b-0aa6-4e11-912f-76d8daaf3488 {{(pid=73449) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 12:27:38 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-fbd6cb25-a19e-43e7-9a53-59002ade871e tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Successfully detached device vdb from instance a762749b-0aa6-4e11-912f-76d8daaf3488 from the live domain config.
Aug 17 12:27:38 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fbd6cb25-a19e-43e7-9a53-59002ade871e tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] calling os-brick to detach iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 12:27:38 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbd6cb25-a19e-43e7-9a53-59002ade871e tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, {'target_iqns': ['iqn.2010-10.org.openstack:0768de0d-3fe5-49b5-bd31-aaef1690deab'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GDsMJlOp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 12:27:38 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-fbd6cb25-a19e-43e7-9a53-59002ade871e tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 12:27:38 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-fbd6cb25-a19e-43e7-9a53-59002ade871e tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 12:27:38 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-fbd6cb25-a19e-43e7-9a53-59002ade871e tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 12:27:38 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbd6cb25-a19e-43e7-9a53-59002ade871e tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0768de0d-3fe5-49b5-bd31-aaef1690deab', 0)] {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 12:27:38 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:27:38 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:27:38 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:27:38 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[237b8752-1b79-4a79-97ec-e93c722bcf9a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0768de0d-3fe5-49b5-bd31-aaef1690deab\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:27:38 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:27:38 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:27:38 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9e0ec11-45f2-43f9-aff8-8609f393229a]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0768de0d-3fe5-49b5-bd31-aaef1690deab (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:27:38 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbd6cb25-a19e-43e7-9a53-59002ade871e tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0768de0d-3fe5-49b5-bd31-aaef1690deab (non-flash)
Aug 17 12:27:38 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 12:27:38 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbd6cb25-a19e-43e7-9a53-59002ade871e tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0768de0d-3fe5-49b5-bd31-aaef1690deab (non-flash)
Aug 17 12:27:38 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 12:27:38 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbd6cb25-a19e-43e7-9a53-59002ade871e tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe7585720e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0768de0d-3fe5-49b5-bd31-aaef1690deab'): ({'sdb'}, set())}) {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 12:27:38 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-fbd6cb25-a19e-43e7-9a53-59002ade871e tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Removing single pathed devices sdb {{(pid=73449) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 12:27:38 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:27:38 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:27:38 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[650eba10-153b-4eca-8bb2-216201d21008]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:27:38 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:27:38 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:27:38 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cafe2a9-6d57-4a4f-b06c-69ce2084adc8]: (4, ('ok\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:27:38 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-fbd6cb25-a19e-43e7-9a53-59002ade871e tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Flushing IO for device /dev/sdb {{(pid=73449) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 12:27:38 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:27:38 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:27:38 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[7107c351-81f5-400c-b2ac-5a5f1ca24f46]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:27:38 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-fbd6cb25-a19e-43e7-9a53-59002ade871e tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73449) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 12:27:38 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:27:39 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:27:39 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc2400f8-c558-46f1-9cd5-c957cf4afc06]: (4, ('1', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:27:39 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-fbd6cb25-a19e-43e7-9a53-59002ade871e tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73449) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 12:27:39 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-fbd6cb25-a19e-43e7-9a53-59002ade871e tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] SCSI volumes sdb have been removed. {{(pid=73449) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 12:27:39 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbd6cb25-a19e-43e7-9a53-59002ade871e tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0768de0d-3fe5-49b5-bd31-aaef1690deab')] {{(pid=73449) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 12:27:39 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0768de0d-3fe5-49b5-bd31-aaef1690deab -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:27:39 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0768de0d-3fe5-49b5-bd31-aaef1690deab -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:27:39 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f6bbafa-d551-4dd7-8772-8bacb33b8bf8]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:27:39 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbd6cb25-a19e-43e7-9a53-59002ade871e tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:27:39 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0768de0d-3fe5-49b5-bd31-aaef1690deab -p 172.16.0.220:3260 --logout {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:27:39 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0768de0d-3fe5-49b5-bd31-aaef1690deab -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:27:39 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[470c3fd4-b907-4310-a780-bd66d8c70615]: (4, ('Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:0768de0d-3fe5-49b5-bd31-aaef1690deab, portal: 172.16.0.220,3260]\nLogout of [sid: 68, target: iqn.2010-10.org.openstack:0768de0d-3fe5-49b5-bd31-aaef1690deab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:27:39 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbd6cb25-a19e-43e7-9a53-59002ade871e tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:0768de0d-3fe5-49b5-bd31-aaef1690deab, portal: 172.16.0.220,3260]
Aug 17 12:27:39 user nova-compute[73449]: Logout of [sid: 68, target: iqn.2010-10.org.openstack:0768de0d-3fe5-49b5-bd31-aaef1690deab, portal: 172.16.0.220,3260] successful.
Aug 17 12:27:39 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:27:39 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0768de0d-3fe5-49b5-bd31-aaef1690deab -p 172.16.0.220:3260 --op delete {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:27:39 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0768de0d-3fe5-49b5-bd31-aaef1690deab -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:27:39 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[55250092-2da6-48ff-9ec7-754cf021325a]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:27:39 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbd6cb25-a19e-43e7-9a53-59002ade871e tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:27:39 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-fbd6cb25-a19e-43e7-9a53-59002ade871e tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.265s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 12:27:39 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbd6cb25-a19e-43e7-9a53-59002ade871e tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] <== disconnect_volume: return (266ms) None {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 12:27:39 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fbd6cb25-a19e-43e7-9a53-59002ade871e tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] Disconnected iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 12:27:39 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:27:39 user nova-compute[73449]: DEBUG nova.objects.instance [None req-fbd6cb25-a19e-43e7-9a53-59002ade871e tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Lazy-loading 'flavor' on Instance uuid a762749b-0aa6-4e11-912f-76d8daaf3488 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:27:39 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-fbd6cb25-a19e-43e7-9a53-59002ade871e tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Lock "a762749b-0aa6-4e11-912f-76d8daaf3488" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.688s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:27:41 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:27:43 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:27:43 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:27:43 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Starting heal instance info cache {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 12:27:43 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Rebuilding the list of instances to heal {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 12:27:44 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "refresh_cache-a762749b-0aa6-4e11-912f-76d8daaf3488" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 12:27:44 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquired lock "refresh_cache-a762749b-0aa6-4e11-912f-76d8daaf3488" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 12:27:44 user nova-compute[73449]: DEBUG nova.network.neutron [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] Forcefully refreshing network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 12:27:44 user nova-compute[73449]: DEBUG nova.objects.instance [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lazy-loading 'info_cache' on Instance uuid a762749b-0aa6-4e11-912f-76d8daaf3488 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:27:44 user nova-compute[73449]: DEBUG nova.network.neutron [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] Updating instance_info_cache with network_info: [{"id": "e153fc04-33de-4636-a657-8638ec48f960", "address": "fa:16:3e:19:b7:c0", "network": {"id": "8c856a2a-08b3-4f78-9ed6-425371ba0c33", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1378352798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06f2957934dd4930883815ec6a1b18a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape153fc04-33", "ovs_interfaceid": "e153fc04-33de-4636-a657-8638ec48f960", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 12:27:44 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Releasing lock "refresh_cache-a762749b-0aa6-4e11-912f-76d8daaf3488" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 12:27:44 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] Updated the network info_cache for instance {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 12:27:48 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:27:48 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:27:48 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73449) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 12:27:48 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:27:48 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:27:48 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:27:53 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:27:53 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:27:53 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73449) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 12:27:53 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:27:53 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:27:53 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:27:58 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:27:58 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:27:58 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73449) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 12:27:58 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:27:58 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:27:58 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:28:03 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:28:03 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:28:03 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73449) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 12:28:03 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:28:03 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:28:03 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:28:08 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:28:13 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:28:18 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:28:18 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:28:18 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73449) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 12:28:18 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:28:18 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:28:18 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:28:21 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:28:23 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:28:25 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:28:25 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:28:28 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:28:28 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:28:28 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73449) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 12:28:28 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:28:28 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:28:28 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:28:28 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:28:32 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a44c1e56-08c7-4422-8574-de4382e98cca tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Acquiring lock "a762749b-0aa6-4e11-912f-76d8daaf3488" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:28:32 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a44c1e56-08c7-4422-8574-de4382e98cca tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Lock "a762749b-0aa6-4e11-912f-76d8daaf3488" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:28:32 user nova-compute[73449]: DEBUG nova.objects.instance [None req-a44c1e56-08c7-4422-8574-de4382e98cca tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Lazy-loading 'flavor' on Instance uuid a762749b-0aa6-4e11-912f-76d8daaf3488 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:28:32 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a44c1e56-08c7-4422-8574-de4382e98cca tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Lock "a762749b-0aa6-4e11-912f-76d8daaf3488" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:28:32 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a44c1e56-08c7-4422-8574-de4382e98cca tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Acquiring lock "a762749b-0aa6-4e11-912f-76d8daaf3488" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:28:32 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a44c1e56-08c7-4422-8574-de4382e98cca tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Lock "a762749b-0aa6-4e11-912f-76d8daaf3488" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:28:32 user nova-compute[73449]: INFO nova.compute.manager [None req-a44c1e56-08c7-4422-8574-de4382e98cca tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] Attaching volume 0c5a9f50-8e5c-4961-845a-ec8a724accbd to /dev/vdb
Aug 17 12:28:32 user nova-compute[73449]: DEBUG os_brick.utils [None req-a44c1e56-08c7-4422-8574-de4382e98cca tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 12:28:32 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:28:32 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:28:32 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[99f8f66e-7c65-4ad1-b18c-9f9fc474530a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4d3924302012\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:28:32 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:28:32 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:28:32 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e000733-8e27-43cb-be87-1fd987366a16]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:28:32 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:28:32 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:28:32 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[f68e4ea0-66ca-4bcb-b981-1cf3d5f6740e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:28:32 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ac16962-1bdd-4aab-b25f-0bc1e06c7b1b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:28:32 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-a44c1e56-08c7-4422-8574-de4382e98cca tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Running cmd (subprocess): nvme version {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:28:32 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-a44c1e56-08c7-4422-8574-de4382e98cca tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] 'nvme version' failed. Not Retrying. {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 12:28:32 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a44c1e56-08c7-4422-8574-de4382e98cca tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] nvme not present on system {{(pid=73449) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 12:28:32 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:28:32 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 12:28:32 user nova-compute[73449]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 12:28:32 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e25f0c0-364a-46e0-8b61-a07e8220ead3]: (4, '') {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:28:32 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-a44c1e56-08c7-4422-8574-de4382e98cca tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73449) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 12:28:32 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-a44c1e56-08c7-4422-8574-de4382e98cca tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73449) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 12:28:32 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-a44c1e56-08c7-4422-8574-de4382e98cca tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] LIGHTOS: no hostnqn found. {{(pid=73449) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 12:28:32 user nova-compute[73449]: DEBUG os_brick.utils [None req-a44c1e56-08c7-4422-8574-de4382e98cca tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4d3924302012', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 12:28:32 user nova-compute[73449]: DEBUG nova.virt.block_device [None req-a44c1e56-08c7-4422-8574-de4382e98cca tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] Updating existing volume attachment record: f8321106-5eba-4795-99ae-0b0d587b4309 {{(pid=73449) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 12:28:32 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:28:32 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:28:32 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:28:32 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:28:32 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:28:32 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=73449) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 12:28:33 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a762749b-0aa6-4e11-912f-76d8daaf3488/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:28:33 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a762749b-0aa6-4e11-912f-76d8daaf3488/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:28:33 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a762749b-0aa6-4e11-912f-76d8daaf3488/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:28:33 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a762749b-0aa6-4e11-912f-76d8daaf3488/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:28:33 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 12:28:33 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 12:28:33 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Hypervisor/Node resource view: name=user free_ram=8789MB free_disk=25.005001068115234GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73449) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 12:28:33 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:28:33 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:28:33 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:28:34 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance a762749b-0aa6-4e11-912f-76d8daaf3488 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 12:28:34 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73449) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 12:28:34 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73449) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 12:28:34 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 12:28:34 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 12:28:34 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Compute_service record updated for user:user {{(pid=73449) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 12:28:34 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.183s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:28:34 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:28:36 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:28:36 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:28:36 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73449) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 12:28:38 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:28:41 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:28:42 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a44c1e56-08c7-4422-8574-de4382e98cca tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] Calling os-brick to attach iSCSI Volume {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 12:28:42 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44c1e56-08c7-4422-8574-de4382e98cca tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0c5a9f50-8e5c-4961-845a-ec8a724accbd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CEkjhQTc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 12:28:42 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-a44c1e56-08c7-4422-8574-de4382e98cca tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 12:28:42 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-a44c1e56-08c7-4422-8574-de4382e98cca tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 12:28:42 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-a44c1e56-08c7-4422-8574-de4382e98cca tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 12:28:42 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-a44c1e56-08c7-4422-8574-de4382e98cca tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 12:28:42 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-a44c1e56-08c7-4422-8574-de4382e98cca tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c5a9f50-8e5c-4961-845a-ec8a724accbd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 12:28:42 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-a44c1e56-08c7-4422-8574-de4382e98cca tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c5a9f50-8e5c-4961-845a-ec8a724accbd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 12:28:42 user nova-compute[73449]: INFO os_brick.initiator.connectors.iscsi [None req-a44c1e56-08c7-4422-8574-de4382e98cca tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 12:28:42 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c5a9f50-8e5c-4961-845a-ec8a724accbd -p 172.16.0.220:3260 {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:28:42 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c5a9f50-8e5c-4961-845a-ec8a724accbd -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:28:42 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[21327b5b-1c6f-447b-8cd5-b9c8644e3346]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:28:42 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44c1e56-08c7-4422-8574-de4382e98cca tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 12:28:42 user nova-compute[73449]:  {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:28:42 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c5a9f50-8e5c-4961-845a-ec8a724accbd -p 172.16.0.220:3260 --interface default --op new {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:28:42 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c5a9f50-8e5c-4961-845a-ec8a724accbd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:28:42 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[c90dd0f9-53f7-481a-ac71-763acf2701d6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0c5a9f50-8e5c-4961-845a-ec8a724accbd] added\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:28:42 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44c1e56-08c7-4422-8574-de4382e98cca tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0c5a9f50-8e5c-4961-845a-ec8a724accbd] added
Aug 17 12:28:42 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:28:42 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c5a9f50-8e5c-4961-845a-ec8a724accbd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:28:42 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c5a9f50-8e5c-4961-845a-ec8a724accbd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:28:42 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdfd9005-b699-49e1-bc02-bab7e74b1d98]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:28:42 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44c1e56-08c7-4422-8574-de4382e98cca tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:28:42 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c5a9f50-8e5c-4961-845a-ec8a724accbd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:28:42 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c5a9f50-8e5c-4961-845a-ec8a724accbd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:28:42 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[536fea75-6510-4ec7-af4b-2b9f10d68bc5]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:28:42 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44c1e56-08c7-4422-8574-de4382e98cca tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:28:42 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c5a9f50-8e5c-4961-845a-ec8a724accbd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CEkjhQTc {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:28:42 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c5a9f50-8e5c-4961-845a-ec8a724accbd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CEkjhQTc" returned: 0 in 0.023s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:28:42 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1046000-0764-413c-adae-99fc228568f2]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:28:42 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44c1e56-08c7-4422-8574-de4382e98cca tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CEkjhQTc'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:28:42 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c5a9f50-8e5c-4961-845a-ec8a724accbd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:28:42 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c5a9f50-8e5c-4961-845a-ec8a724accbd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:28:42 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a62b7e9-6fd5-477d-bff1-3c0f5d21c7b1]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:28:42 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44c1e56-08c7-4422-8574-de4382e98cca tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:28:42 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:28:42 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:28:42 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dd5a25f-a3d0-4b2e-9e53-1aa9e7b9fa42]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:28:42 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44c1e56-08c7-4422-8574-de4382e98cca tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 17 12:28:42 user nova-compute[73449]:  {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 12:28:42 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44c1e56-08c7-4422-8574-de4382e98cca tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 17 12:28:42 user nova-compute[73449]:  {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 12:28:42 user nova-compute[73449]: WARNING os_brick.initiator.connectors.iscsi [None req-a44c1e56-08c7-4422-8574-de4382e98cca tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 17 12:28:42 user nova-compute[73449]: 
Aug 17 12:28:42 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c5a9f50-8e5c-4961-845a-ec8a724accbd -p 172.16.0.220:3260 --login {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:28:42 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c5a9f50-8e5c-4961-845a-ec8a724accbd -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:28:42 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[7585f963-b837-4d56-b748-69c23b874121]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0c5a9f50-8e5c-4961-845a-ec8a724accbd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0c5a9f50-8e5c-4961-845a-ec8a724accbd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:28:42 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44c1e56-08c7-4422-8574-de4382e98cca tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0c5a9f50-8e5c-4961-845a-ec8a724accbd, portal: 172.16.0.220,3260]
Aug 17 12:28:42 user nova-compute[73449]: Login to [iface: default, target: iqn.2010-10.org.openstack:0c5a9f50-8e5c-4961-845a-ec8a724accbd, portal: 172.16.0.220,3260] successful.
Aug 17 12:28:42 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:28:42 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c5a9f50-8e5c-4961-845a-ec8a724accbd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:28:42 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c5a9f50-8e5c-4961-845a-ec8a724accbd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:28:42 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[53c4d0d9-6eec-49a5-9a30-a369e500f3f1]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:28:42 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44c1e56-08c7-4422-8574-de4382e98cca tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:28:42 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:28:42 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:28:42 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec375db8-f928-408e-9b24-622c9599d34b]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c5a9f50-8e5c-4961-845a-ec8a724accbd (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:28:42 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44c1e56-08c7-4422-8574-de4382e98cca tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c5a9f50-8e5c-4961-845a-ec8a724accbd (non-flash)
Aug 17 12:28:42 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 12:28:42 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44c1e56-08c7-4422-8574-de4382e98cca tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c5a9f50-8e5c-4961-845a-ec8a724accbd (non-flash)
Aug 17 12:28:42 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 12:28:42 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-a44c1e56-08c7-4422-8574-de4382e98cca tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c5a9f50-8e5c-4961-845a-ec8a724accbd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.258s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 12:28:42 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44c1e56-08c7-4422-8574-de4382e98cca tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Connected to 172.16.0.220:3260 {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 12:28:42 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-a44c1e56-08c7-4422-8574-de4382e98cca tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] HCTL ('33', '-', '-', 0) found on session 69 with lun 0 {{(pid=73449) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 12:28:42 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-a44c1e56-08c7-4422-8574-de4382e98cca tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73449) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 12:28:42 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:28:42 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:28:42 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[096dcad6-39bf-4415-9f59-8ad07212c7b8]: (4, ('- - 0', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:28:42 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-a44c1e56-08c7-4422-8574-de4382e98cca tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73449) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 12:28:42 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44c1e56-08c7-4422-8574-de4382e98cca tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CEkjhQTc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 12:28:43 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:28:43 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:28:43 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73449) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 12:28:43 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:28:43 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:28:43 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-a44c1e56-08c7-4422-8574-de4382e98cca tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.290s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 12:28:43 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44c1e56-08c7-4422-8574-de4382e98cca tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] <== connect_volume: return (1291ms) {'type': 'block', 'scsi_wwn': '23631393532643538', 'path': '/dev/sdb'} {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 12:28:43 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a44c1e56-08c7-4422-8574-de4382e98cca tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23631393532643538', 'path': '/dev/sdb'} {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 12:28:43 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:28:43 user nova-compute[73449]: DEBUG nova.objects.instance [None req-a44c1e56-08c7-4422-8574-de4382e98cca tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Lazy-loading 'flavor' on Instance uuid a762749b-0aa6-4e11-912f-76d8daaf3488 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:28:43 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-a44c1e56-08c7-4422-8574-de4382e98cca tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 12:28:43 user nova-compute[73449]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 12:28:43 user nova-compute[73449]:   <source dev="/dev/sdb"/>
Aug 17 12:28:43 user nova-compute[73449]:   <target dev="vdb" bus="virtio"/>
Aug 17 12:28:43 user nova-compute[73449]:   <serial>0c5a9f50-8e5c-4961-845a-ec8a724accbd</serial>
Aug 17 12:28:43 user nova-compute[73449]: </disk>
Aug 17 12:28:43 user nova-compute[73449]:  {{(pid=73449) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 12:28:44 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-a44c1e56-08c7-4422-8574-de4382e98cca tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] No BDM found with device name vda, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 12:28:44 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-a44c1e56-08c7-4422-8574-de4382e98cca tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 12:28:44 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-a44c1e56-08c7-4422-8574-de4382e98cca tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] No VIF found with MAC fa:16:3e:19:b7:c0, not building metadata {{(pid=73449) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 12:28:44 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-a44c1e56-08c7-4422-8574-de4382e98cca tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Lock "a762749b-0aa6-4e11-912f-76d8daaf3488" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.930s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:28:45 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:28:45 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Starting heal instance info cache {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 12:28:45 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Rebuilding the list of instances to heal {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 12:28:46 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "refresh_cache-a762749b-0aa6-4e11-912f-76d8daaf3488" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 12:28:46 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquired lock "refresh_cache-a762749b-0aa6-4e11-912f-76d8daaf3488" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 12:28:46 user nova-compute[73449]: DEBUG nova.network.neutron [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] Forcefully refreshing network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 12:28:46 user nova-compute[73449]: DEBUG nova.objects.instance [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lazy-loading 'info_cache' on Instance uuid a762749b-0aa6-4e11-912f-76d8daaf3488 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:28:46 user nova-compute[73449]: DEBUG nova.network.neutron [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] Updating instance_info_cache with network_info: [{"id": "e153fc04-33de-4636-a657-8638ec48f960", "address": "fa:16:3e:19:b7:c0", "network": {"id": "8c856a2a-08b3-4f78-9ed6-425371ba0c33", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1378352798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06f2957934dd4930883815ec6a1b18a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape153fc04-33", "ovs_interfaceid": "e153fc04-33de-4636-a657-8638ec48f960", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 12:28:46 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Releasing lock "refresh_cache-a762749b-0aa6-4e11-912f-76d8daaf3488" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 12:28:46 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] Updated the network info_cache for instance {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 12:28:47 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-bd6bf107-fded-4562-98c9-3a31388e0acb tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Acquiring lock "a762749b-0aa6-4e11-912f-76d8daaf3488" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:28:47 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-bd6bf107-fded-4562-98c9-3a31388e0acb tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Lock "a762749b-0aa6-4e11-912f-76d8daaf3488" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:28:47 user nova-compute[73449]: INFO nova.compute.manager [None req-bd6bf107-fded-4562-98c9-3a31388e0acb tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] Detaching volume 0c5a9f50-8e5c-4961-845a-ec8a724accbd
Aug 17 12:28:47 user nova-compute[73449]: INFO nova.virt.block_device [None req-bd6bf107-fded-4562-98c9-3a31388e0acb tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] Attempting to driver detach volume 0c5a9f50-8e5c-4961-845a-ec8a724accbd from mountpoint /dev/vdb
Aug 17 12:28:47 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-bd6bf107-fded-4562-98c9-3a31388e0acb tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Attempting to detach device vdb from instance a762749b-0aa6-4e11-912f-76d8daaf3488 from the persistent domain config. {{(pid=73449) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 12:28:47 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-bd6bf107-fded-4562-98c9-3a31388e0acb tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 12:28:47 user nova-compute[73449]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 12:28:47 user nova-compute[73449]:   <source dev="/dev/sdb"/>
Aug 17 12:28:47 user nova-compute[73449]:   <target dev="vdb" bus="virtio"/>
Aug 17 12:28:47 user nova-compute[73449]:   <serial>0c5a9f50-8e5c-4961-845a-ec8a724accbd</serial>
Aug 17 12:28:47 user nova-compute[73449]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 12:28:47 user nova-compute[73449]: </disk>
Aug 17 12:28:47 user nova-compute[73449]:  {{(pid=73449) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 12:28:47 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-bd6bf107-fded-4562-98c9-3a31388e0acb tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Successfully detached device vdb from instance a762749b-0aa6-4e11-912f-76d8daaf3488 from the persistent domain config.
Aug 17 12:28:47 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-bd6bf107-fded-4562-98c9-3a31388e0acb tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a762749b-0aa6-4e11-912f-76d8daaf3488 from the live domain config. {{(pid=73449) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 12:28:47 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-bd6bf107-fded-4562-98c9-3a31388e0acb tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 12:28:47 user nova-compute[73449]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 12:28:47 user nova-compute[73449]:   <source dev="/dev/sdb"/>
Aug 17 12:28:47 user nova-compute[73449]:   <target dev="vdb" bus="virtio"/>
Aug 17 12:28:47 user nova-compute[73449]:   <serial>0c5a9f50-8e5c-4961-845a-ec8a724accbd</serial>
Aug 17 12:28:47 user nova-compute[73449]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 12:28:47 user nova-compute[73449]: </disk>
Aug 17 12:28:47 user nova-compute[73449]:  {{(pid=73449) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 12:28:47 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Received event <DeviceRemovedEvent: 1692275327.7658355, a762749b-0aa6-4e11-912f-76d8daaf3488 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73449) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 12:28:47 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-bd6bf107-fded-4562-98c9-3a31388e0acb tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a762749b-0aa6-4e11-912f-76d8daaf3488 {{(pid=73449) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 12:28:47 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-bd6bf107-fded-4562-98c9-3a31388e0acb tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Successfully detached device vdb from instance a762749b-0aa6-4e11-912f-76d8daaf3488 from the live domain config.
Aug 17 12:28:47 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd6bf107-fded-4562-98c9-3a31388e0acb tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] calling os-brick to detach iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 12:28:47 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd6bf107-fded-4562-98c9-3a31388e0acb tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, {'target_iqns': ['iqn.2010-10.org.openstack:0c5a9f50-8e5c-4961-845a-ec8a724accbd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CEkjhQTc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 12:28:47 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-bd6bf107-fded-4562-98c9-3a31388e0acb tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 12:28:47 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-bd6bf107-fded-4562-98c9-3a31388e0acb tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 12:28:47 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-bd6bf107-fded-4562-98c9-3a31388e0acb tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 12:28:47 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd6bf107-fded-4562-98c9-3a31388e0acb tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0c5a9f50-8e5c-4961-845a-ec8a724accbd', 0)] {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 12:28:47 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:28:47 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:28:47 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ea5bc6d-a0f3-4c05-a3b2-35dca0f8369a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c5a9f50-8e5c-4961-845a-ec8a724accbd\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:28:47 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:28:47 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:28:47 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[93294e4f-2e61-4941-bf5d-e6a9b731ea03]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c5a9f50-8e5c-4961-845a-ec8a724accbd (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:28:47 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd6bf107-fded-4562-98c9-3a31388e0acb tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c5a9f50-8e5c-4961-845a-ec8a724accbd (non-flash)
Aug 17 12:28:47 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 12:28:47 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd6bf107-fded-4562-98c9-3a31388e0acb tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c5a9f50-8e5c-4961-845a-ec8a724accbd (non-flash)
Aug 17 12:28:47 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 12:28:47 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd6bf107-fded-4562-98c9-3a31388e0acb tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe7587e5e10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0c5a9f50-8e5c-4961-845a-ec8a724accbd'): ({'sdb'}, set())}) {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 12:28:47 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-bd6bf107-fded-4562-98c9-3a31388e0acb tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Removing single pathed devices sdb {{(pid=73449) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 12:28:47 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:28:47 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:28:47 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[564f29bb-9ed6-48ee-a44f-d53ad6fc9dfa]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:28:47 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:28:47 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:28:47 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d664486-6c8a-40ae-b4e4-1359d7657a0c]: (4, ('ok\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:28:47 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-bd6bf107-fded-4562-98c9-3a31388e0acb tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Flushing IO for device /dev/sdb {{(pid=73449) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 12:28:47 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:28:47 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:28:47 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b616f90-4c99-41cd-a07c-ffe428a26256]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:28:47 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-bd6bf107-fded-4562-98c9-3a31388e0acb tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73449) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 12:28:47 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:28:47 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:28:47 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d90f02b-9b6f-4b73-aad1-c3e6f329d7a7]: (4, ('1', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:28:47 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-bd6bf107-fded-4562-98c9-3a31388e0acb tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73449) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 12:28:47 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-bd6bf107-fded-4562-98c9-3a31388e0acb tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] SCSI volumes sdb have been removed. {{(pid=73449) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 12:28:47 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd6bf107-fded-4562-98c9-3a31388e0acb tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0c5a9f50-8e5c-4961-845a-ec8a724accbd')] {{(pid=73449) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 12:28:47 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c5a9f50-8e5c-4961-845a-ec8a724accbd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:28:47 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c5a9f50-8e5c-4961-845a-ec8a724accbd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:28:47 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[e41b3a3f-a789-437f-91ab-deb1e6705d59]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:28:47 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd6bf107-fded-4562-98c9-3a31388e0acb tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:28:47 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c5a9f50-8e5c-4961-845a-ec8a724accbd -p 172.16.0.220:3260 --logout {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:28:48 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c5a9f50-8e5c-4961-845a-ec8a724accbd -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:28:48 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[993db1f8-b3ee-4e92-928e-e6496554fe21]: (4, ('Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:0c5a9f50-8e5c-4961-845a-ec8a724accbd, portal: 172.16.0.220,3260]\nLogout of [sid: 69, target: iqn.2010-10.org.openstack:0c5a9f50-8e5c-4961-845a-ec8a724accbd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:28:48 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd6bf107-fded-4562-98c9-3a31388e0acb tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:0c5a9f50-8e5c-4961-845a-ec8a724accbd, portal: 172.16.0.220,3260]
Aug 17 12:28:48 user nova-compute[73449]: Logout of [sid: 69, target: iqn.2010-10.org.openstack:0c5a9f50-8e5c-4961-845a-ec8a724accbd, portal: 172.16.0.220,3260] successful.
Aug 17 12:28:48 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:28:48 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c5a9f50-8e5c-4961-845a-ec8a724accbd -p 172.16.0.220:3260 --op delete {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:28:48 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c5a9f50-8e5c-4961-845a-ec8a724accbd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:28:48 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[81fd9938-b590-4a65-8976-30dc890b3494]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:28:48 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd6bf107-fded-4562-98c9-3a31388e0acb tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:28:48 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-bd6bf107-fded-4562-98c9-3a31388e0acb tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.262s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 12:28:48 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd6bf107-fded-4562-98c9-3a31388e0acb tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] <== disconnect_volume: return (263ms) None {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 12:28:48 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd6bf107-fded-4562-98c9-3a31388e0acb tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] Disconnected iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 12:28:48 user nova-compute[73449]: DEBUG nova.objects.instance [None req-bd6bf107-fded-4562-98c9-3a31388e0acb tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Lazy-loading 'flavor' on Instance uuid a762749b-0aa6-4e11-912f-76d8daaf3488 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:28:48 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-bd6bf107-fded-4562-98c9-3a31388e0acb tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Lock "a762749b-0aa6-4e11-912f-76d8daaf3488" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.594s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:28:48 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:28:49 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:28:53 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:28:58 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:28:58 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:28:58 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73449) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 12:28:58 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:28:58 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:28:58 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:29:03 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:29:03 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:29:03 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73449) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 12:29:03 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:29:03 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:29:03 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:29:08 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:29:13 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:29:13 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:29:13 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73449) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 12:29:13 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:29:13 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:29:13 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:29:18 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4996-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:29:18 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:29:18 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73449) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 12:29:18 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:29:18 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:29:18 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:29:21 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:29:23 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:29:23 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:29:23 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73449) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 12:29:23 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:29:23 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:29:23 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:29:26 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:29:27 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:29:28 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:29:28 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:29:28 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73449) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 12:29:28 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:29:28 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:29:28 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:29:29 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:29:33 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:29:33 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:29:33 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:29:33 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73449) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 12:29:33 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:29:33 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:29:33 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:29:33 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:29:33 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:29:33 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:29:33 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=73449) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 12:29:34 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a762749b-0aa6-4e11-912f-76d8daaf3488/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:29:34 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a762749b-0aa6-4e11-912f-76d8daaf3488/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:29:34 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a762749b-0aa6-4e11-912f-76d8daaf3488/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:29:34 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a762749b-0aa6-4e11-912f-76d8daaf3488/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:29:34 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 12:29:34 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 12:29:34 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Hypervisor/Node resource view: name=user free_ram=8811MB free_disk=25.004169464111328GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73449) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 12:29:34 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:29:34 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:29:34 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance a762749b-0aa6-4e11-912f-76d8daaf3488 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 12:29:34 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73449) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 12:29:34 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73449) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 12:29:34 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 12:29:34 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 12:29:34 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Compute_service record updated for user:user {{(pid=73449) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 12:29:34 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.168s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:29:36 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:29:36 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:29:36 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73449) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 12:29:38 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:29:41 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-3991b224-445f-40b7-ac91-3902470beeca tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Acquiring lock "a762749b-0aa6-4e11-912f-76d8daaf3488" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:29:41 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-3991b224-445f-40b7-ac91-3902470beeca tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Lock "a762749b-0aa6-4e11-912f-76d8daaf3488" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:29:41 user nova-compute[73449]: DEBUG nova.objects.instance [None req-3991b224-445f-40b7-ac91-3902470beeca tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Lazy-loading 'flavor' on Instance uuid a762749b-0aa6-4e11-912f-76d8daaf3488 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:29:41 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-3991b224-445f-40b7-ac91-3902470beeca tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Lock "a762749b-0aa6-4e11-912f-76d8daaf3488" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:29:41 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-3991b224-445f-40b7-ac91-3902470beeca tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Acquiring lock "a762749b-0aa6-4e11-912f-76d8daaf3488" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:29:41 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-3991b224-445f-40b7-ac91-3902470beeca tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Lock "a762749b-0aa6-4e11-912f-76d8daaf3488" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:29:41 user nova-compute[73449]: INFO nova.compute.manager [None req-3991b224-445f-40b7-ac91-3902470beeca tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] Attaching volume 17173712-83ad-4c7a-b806-88c3ce1df6f3 to /dev/vdb
Aug 17 12:29:41 user nova-compute[73449]: DEBUG os_brick.utils [None req-3991b224-445f-40b7-ac91-3902470beeca tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 12:29:41 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:29:41 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:29:41 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[22ca634a-3cf5-4392-b5dc-109355f9ce7c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4d3924302012\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:29:41 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:29:41 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:29:41 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[dba3046d-b3e9-48ed-83bf-d7c30e9a90cf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:29:41 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:29:41 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:29:41 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[11194cfb-c28d-4588-9186-44341e391f13]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:29:41 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[479625ab-7a73-460b-ae99-e18f42642fc8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:29:41 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-3991b224-445f-40b7-ac91-3902470beeca tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Running cmd (subprocess): nvme version {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:29:41 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-3991b224-445f-40b7-ac91-3902470beeca tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] 'nvme version' failed. Not Retrying. {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 12:29:41 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3991b224-445f-40b7-ac91-3902470beeca tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] nvme not present on system {{(pid=73449) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 12:29:41 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:29:41 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 12:29:41 user nova-compute[73449]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 12:29:41 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fc9fb85-e59a-41d6-81a3-74039f97e2f2]: (4, '') {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:29:41 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-3991b224-445f-40b7-ac91-3902470beeca tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73449) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 12:29:41 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-3991b224-445f-40b7-ac91-3902470beeca tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73449) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 12:29:41 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.lightos [None req-3991b224-445f-40b7-ac91-3902470beeca tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] LIGHTOS: no hostnqn found. {{(pid=73449) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 12:29:41 user nova-compute[73449]: DEBUG os_brick.utils [None req-3991b224-445f-40b7-ac91-3902470beeca tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4d3924302012', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 12:29:41 user nova-compute[73449]: DEBUG nova.virt.block_device [None req-3991b224-445f-40b7-ac91-3902470beeca tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] Updating existing volume attachment record: 1cda256e-87f2-4672-9fb9-f4e5f78a9120 {{(pid=73449) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 12:29:41 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:29:43 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:29:44 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:29:45 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:29:45 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Starting heal instance info cache {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 12:29:45 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Rebuilding the list of instances to heal {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 12:29:46 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "refresh_cache-a762749b-0aa6-4e11-912f-76d8daaf3488" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 12:29:46 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquired lock "refresh_cache-a762749b-0aa6-4e11-912f-76d8daaf3488" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 12:29:46 user nova-compute[73449]: DEBUG nova.network.neutron [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] Forcefully refreshing network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 12:29:46 user nova-compute[73449]: DEBUG nova.objects.instance [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lazy-loading 'info_cache' on Instance uuid a762749b-0aa6-4e11-912f-76d8daaf3488 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:29:46 user nova-compute[73449]: DEBUG nova.network.neutron [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] Updating instance_info_cache with network_info: [{"id": "e153fc04-33de-4636-a657-8638ec48f960", "address": "fa:16:3e:19:b7:c0", "network": {"id": "8c856a2a-08b3-4f78-9ed6-425371ba0c33", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1378352798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06f2957934dd4930883815ec6a1b18a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape153fc04-33", "ovs_interfaceid": "e153fc04-33de-4636-a657-8638ec48f960", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 12:29:46 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Releasing lock "refresh_cache-a762749b-0aa6-4e11-912f-76d8daaf3488" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 12:29:46 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] Updated the network info_cache for instance {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 12:29:48 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:29:51 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3991b224-445f-40b7-ac91-3902470beeca tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] Calling os-brick to attach iSCSI Volume {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 12:29:51 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-3991b224-445f-40b7-ac91-3902470beeca tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:17173712-83ad-4c7a-b806-88c3ce1df6f3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PYrAkcZH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 12:29:51 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-3991b224-445f-40b7-ac91-3902470beeca tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 12:29:51 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-3991b224-445f-40b7-ac91-3902470beeca tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 12:29:51 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-3991b224-445f-40b7-ac91-3902470beeca tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 12:29:51 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-3991b224-445f-40b7-ac91-3902470beeca tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 12:29:51 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-3991b224-445f-40b7-ac91-3902470beeca tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:17173712-83ad-4c7a-b806-88c3ce1df6f3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 12:29:51 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-3991b224-445f-40b7-ac91-3902470beeca tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:17173712-83ad-4c7a-b806-88c3ce1df6f3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 12:29:51 user nova-compute[73449]: INFO os_brick.initiator.connectors.iscsi [None req-3991b224-445f-40b7-ac91-3902470beeca tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 12:29:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17173712-83ad-4c7a-b806-88c3ce1df6f3 -p 172.16.0.220:3260 {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:29:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17173712-83ad-4c7a-b806-88c3ce1df6f3 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:29:51 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9b4fce5-5ceb-4605-a8d8-58e525297371]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:29:51 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-3991b224-445f-40b7-ac91-3902470beeca tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 12:29:51 user nova-compute[73449]:  {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:29:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17173712-83ad-4c7a-b806-88c3ce1df6f3 -p 172.16.0.220:3260 --interface default --op new {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:29:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17173712-83ad-4c7a-b806-88c3ce1df6f3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:29:51 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a62c2f1-7c39-4bc5-adc0-b960a6db374c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:17173712-83ad-4c7a-b806-88c3ce1df6f3] added\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:29:51 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-3991b224-445f-40b7-ac91-3902470beeca tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:17173712-83ad-4c7a-b806-88c3ce1df6f3] added
Aug 17 12:29:51 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:29:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17173712-83ad-4c7a-b806-88c3ce1df6f3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:29:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17173712-83ad-4c7a-b806-88c3ce1df6f3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:29:51 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[dad1fa54-1957-4736-9e25-6ac4b4e926c8]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:29:51 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-3991b224-445f-40b7-ac91-3902470beeca tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:29:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17173712-83ad-4c7a-b806-88c3ce1df6f3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:29:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17173712-83ad-4c7a-b806-88c3ce1df6f3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:29:51 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cba73ce-df8f-4c32-bae6-914fd42554b4]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:29:51 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-3991b224-445f-40b7-ac91-3902470beeca tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:29:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17173712-83ad-4c7a-b806-88c3ce1df6f3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PYrAkcZH {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:29:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17173712-83ad-4c7a-b806-88c3ce1df6f3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PYrAkcZH" returned: 0 in 0.024s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:29:51 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eb951de-672a-40f4-ae17-d5ee9f9c5401]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:29:51 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-3991b224-445f-40b7-ac91-3902470beeca tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PYrAkcZH'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:29:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17173712-83ad-4c7a-b806-88c3ce1df6f3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:29:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17173712-83ad-4c7a-b806-88c3ce1df6f3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:29:51 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[b26493ca-3957-44eb-896d-348fcb76e6d3]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:29:51 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-3991b224-445f-40b7-ac91-3902470beeca tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:29:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:29:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:29:51 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[1770c29c-86bc-4a82-845e-830695afc0a9]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:29:51 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-3991b224-445f-40b7-ac91-3902470beeca tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 17 12:29:51 user nova-compute[73449]:  {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 12:29:51 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-3991b224-445f-40b7-ac91-3902470beeca tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 17 12:29:51 user nova-compute[73449]:  {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 12:29:51 user nova-compute[73449]: WARNING os_brick.initiator.connectors.iscsi [None req-3991b224-445f-40b7-ac91-3902470beeca tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 17 12:29:51 user nova-compute[73449]: 
Aug 17 12:29:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17173712-83ad-4c7a-b806-88c3ce1df6f3 -p 172.16.0.220:3260 --login {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:29:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17173712-83ad-4c7a-b806-88c3ce1df6f3 -p 172.16.0.220:3260 --login" returned: 0 in 0.042s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:29:51 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f50e790-889f-4483-9f4f-c324f2a383af]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:17173712-83ad-4c7a-b806-88c3ce1df6f3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:17173712-83ad-4c7a-b806-88c3ce1df6f3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:29:51 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-3991b224-445f-40b7-ac91-3902470beeca tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:17173712-83ad-4c7a-b806-88c3ce1df6f3, portal: 172.16.0.220,3260]
Aug 17 12:29:51 user nova-compute[73449]: Login to [iface: default, target: iqn.2010-10.org.openstack:17173712-83ad-4c7a-b806-88c3ce1df6f3, portal: 172.16.0.220,3260] successful.
Aug 17 12:29:51 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:29:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17173712-83ad-4c7a-b806-88c3ce1df6f3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:29:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17173712-83ad-4c7a-b806-88c3ce1df6f3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:29:51 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a6aa820-b472-4fe3-9a40-986eebf73f54]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:29:51 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-3991b224-445f-40b7-ac91-3902470beeca tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:29:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:29:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:29:51 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[df7bde52-092b-4b67-a1d1-6284ecf0c6bf]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17173712-83ad-4c7a-b806-88c3ce1df6f3 (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:29:51 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-3991b224-445f-40b7-ac91-3902470beeca tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17173712-83ad-4c7a-b806-88c3ce1df6f3 (non-flash)
Aug 17 12:29:51 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 12:29:51 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-3991b224-445f-40b7-ac91-3902470beeca tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17173712-83ad-4c7a-b806-88c3ce1df6f3 (non-flash)
Aug 17 12:29:51 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 12:29:51 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-3991b224-445f-40b7-ac91-3902470beeca tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:17173712-83ad-4c7a-b806-88c3ce1df6f3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.265s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 12:29:51 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-3991b224-445f-40b7-ac91-3902470beeca tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Connected to 172.16.0.220:3260 {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 12:29:51 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-3991b224-445f-40b7-ac91-3902470beeca tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] HCTL ('33', '-', '-', 0) found on session 70 with lun 0 {{(pid=73449) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 12:29:51 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-3991b224-445f-40b7-ac91-3902470beeca tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73449) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 12:29:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:29:51 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:29:51 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1ee1047-e4ed-4712-af72-7acfda1cfba7]: (4, ('- - 0', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:29:51 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-3991b224-445f-40b7-ac91-3902470beeca tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73449) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 12:29:51 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-3991b224-445f-40b7-ac91-3902470beeca tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PYrAkcZH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73449) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 12:29:52 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-3991b224-445f-40b7-ac91-3902470beeca tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.295s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 12:29:52 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-3991b224-445f-40b7-ac91-3902470beeca tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] <== connect_volume: return (1296ms) {'type': 'block', 'scsi_wwn': '23332613239333334', 'path': '/dev/sdb'} {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 12:29:52 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3991b224-445f-40b7-ac91-3902470beeca tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23332613239333334', 'path': '/dev/sdb'} {{(pid=73449) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 12:29:52 user nova-compute[73449]: DEBUG nova.objects.instance [None req-3991b224-445f-40b7-ac91-3902470beeca tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Lazy-loading 'flavor' on Instance uuid a762749b-0aa6-4e11-912f-76d8daaf3488 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:29:52 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-3991b224-445f-40b7-ac91-3902470beeca tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 12:29:52 user nova-compute[73449]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 12:29:52 user nova-compute[73449]:   <source dev="/dev/sdb"/>
Aug 17 12:29:52 user nova-compute[73449]:   <target dev="vdb" bus="virtio"/>
Aug 17 12:29:52 user nova-compute[73449]:   <serial>17173712-83ad-4c7a-b806-88c3ce1df6f3</serial>
Aug 17 12:29:52 user nova-compute[73449]: </disk>
Aug 17 12:29:52 user nova-compute[73449]:  {{(pid=73449) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 12:29:53 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-3991b224-445f-40b7-ac91-3902470beeca tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] No BDM found with device name vda, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 12:29:53 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-3991b224-445f-40b7-ac91-3902470beeca tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73449) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 12:29:53 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-3991b224-445f-40b7-ac91-3902470beeca tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] No VIF found with MAC fa:16:3e:19:b7:c0, not building metadata {{(pid=73449) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 12:29:53 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-3991b224-445f-40b7-ac91-3902470beeca tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Lock "a762749b-0aa6-4e11-912f-76d8daaf3488" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.978s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:29:53 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:29:56 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-2914a9dd-7ba0-4c75-b40d-a3dd9569f545 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Acquiring lock "a762749b-0aa6-4e11-912f-76d8daaf3488" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:29:56 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-2914a9dd-7ba0-4c75-b40d-a3dd9569f545 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Lock "a762749b-0aa6-4e11-912f-76d8daaf3488" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:29:56 user nova-compute[73449]: INFO nova.compute.manager [None req-2914a9dd-7ba0-4c75-b40d-a3dd9569f545 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] Detaching volume 17173712-83ad-4c7a-b806-88c3ce1df6f3
Aug 17 12:29:56 user nova-compute[73449]: INFO nova.virt.block_device [None req-2914a9dd-7ba0-4c75-b40d-a3dd9569f545 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] Attempting to driver detach volume 17173712-83ad-4c7a-b806-88c3ce1df6f3 from mountpoint /dev/vdb
Aug 17 12:29:56 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-2914a9dd-7ba0-4c75-b40d-a3dd9569f545 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Attempting to detach device vdb from instance a762749b-0aa6-4e11-912f-76d8daaf3488 from the persistent domain config. {{(pid=73449) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 12:29:56 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-2914a9dd-7ba0-4c75-b40d-a3dd9569f545 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 12:29:56 user nova-compute[73449]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 12:29:56 user nova-compute[73449]:   <source dev="/dev/sdb"/>
Aug 17 12:29:56 user nova-compute[73449]:   <target dev="vdb" bus="virtio"/>
Aug 17 12:29:56 user nova-compute[73449]:   <serial>17173712-83ad-4c7a-b806-88c3ce1df6f3</serial>
Aug 17 12:29:56 user nova-compute[73449]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 12:29:56 user nova-compute[73449]: </disk>
Aug 17 12:29:56 user nova-compute[73449]:  {{(pid=73449) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 12:29:56 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-2914a9dd-7ba0-4c75-b40d-a3dd9569f545 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Successfully detached device vdb from instance a762749b-0aa6-4e11-912f-76d8daaf3488 from the persistent domain config.
Aug 17 12:29:56 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-2914a9dd-7ba0-4c75-b40d-a3dd9569f545 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a762749b-0aa6-4e11-912f-76d8daaf3488 from the live domain config. {{(pid=73449) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 12:29:56 user nova-compute[73449]: DEBUG nova.virt.libvirt.guest [None req-2914a9dd-7ba0-4c75-b40d-a3dd9569f545 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 12:29:56 user nova-compute[73449]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 12:29:56 user nova-compute[73449]:   <source dev="/dev/sdb"/>
Aug 17 12:29:56 user nova-compute[73449]:   <target dev="vdb" bus="virtio"/>
Aug 17 12:29:56 user nova-compute[73449]:   <serial>17173712-83ad-4c7a-b806-88c3ce1df6f3</serial>
Aug 17 12:29:56 user nova-compute[73449]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 12:29:56 user nova-compute[73449]: </disk>
Aug 17 12:29:56 user nova-compute[73449]:  {{(pid=73449) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 12:29:56 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-b01458c2-1275-4e47-857e-b9e47f223363 None None] Received event <DeviceRemovedEvent: 1692275396.6993973, a762749b-0aa6-4e11-912f-76d8daaf3488 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73449) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 12:29:56 user nova-compute[73449]: DEBUG nova.virt.libvirt.driver [None req-2914a9dd-7ba0-4c75-b40d-a3dd9569f545 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a762749b-0aa6-4e11-912f-76d8daaf3488 {{(pid=73449) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 12:29:56 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-2914a9dd-7ba0-4c75-b40d-a3dd9569f545 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Successfully detached device vdb from instance a762749b-0aa6-4e11-912f-76d8daaf3488 from the live domain config.
Aug 17 12:29:56 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2914a9dd-7ba0-4c75-b40d-a3dd9569f545 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] calling os-brick to detach iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 12:29:56 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-2914a9dd-7ba0-4c75-b40d-a3dd9569f545 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe7586b4fa0>, {'target_iqns': ['iqn.2010-10.org.openstack:17173712-83ad-4c7a-b806-88c3ce1df6f3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PYrAkcZH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 12:29:56 user nova-compute[73449]: WARNING os_brick.initiator.connectors.base [None req-2914a9dd-7ba0-4c75-b40d-a3dd9569f545 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 12:29:56 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-2914a9dd-7ba0-4c75-b40d-a3dd9569f545 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 12:29:56 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-2914a9dd-7ba0-4c75-b40d-a3dd9569f545 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 12:29:56 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-2914a9dd-7ba0-4c75-b40d-a3dd9569f545 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:17173712-83ad-4c7a-b806-88c3ce1df6f3', 0)] {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 12:29:56 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:29:56 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:29:56 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[45a136f2-4bd1-4523-ada7-006a3042533a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:17173712-83ad-4c7a-b806-88c3ce1df6f3\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:29:56 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:29:56 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:29:56 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5054fa0-23be-4ae2-81a9-feee01efdf6b]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17173712-83ad-4c7a-b806-88c3ce1df6f3 (non-flash)\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:29:56 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-2914a9dd-7ba0-4c75-b40d-a3dd9569f545 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17173712-83ad-4c7a-b806-88c3ce1df6f3 (non-flash)
Aug 17 12:29:56 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 12:29:56 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-2914a9dd-7ba0-4c75-b40d-a3dd9569f545 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17173712-83ad-4c7a-b806-88c3ce1df6f3 (non-flash)
Aug 17 12:29:56 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 12:29:56 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-2914a9dd-7ba0-4c75-b40d-a3dd9569f545 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe7781ed1b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:17173712-83ad-4c7a-b806-88c3ce1df6f3'): ({'sdb'}, set())}) {{(pid=73449) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 12:29:56 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-2914a9dd-7ba0-4c75-b40d-a3dd9569f545 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Removing single pathed devices sdb {{(pid=73449) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 12:29:56 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:29:56 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:29:56 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f47bd96-f9de-4b2a-a046-a5b87ae646d0]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:29:56 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:29:56 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:29:56 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[18d262f5-c84a-438e-859d-c61678144a25]: (4, ('ok\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:29:56 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-2914a9dd-7ba0-4c75-b40d-a3dd9569f545 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Flushing IO for device /dev/sdb {{(pid=73449) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 12:29:56 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:29:56 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:29:56 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[712bdbba-3006-47ac-9c35-5008c80c5ecc]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:29:56 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-2914a9dd-7ba0-4c75-b40d-a3dd9569f545 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73449) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 12:29:56 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:29:56 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.053s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:29:56 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd4d1fe3-e20a-44c5-bc48-ea032157b932]: (4, ('1', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:29:56 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-2914a9dd-7ba0-4c75-b40d-a3dd9569f545 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73449) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 12:29:56 user nova-compute[73449]: DEBUG os_brick.initiator.linuxscsi [None req-2914a9dd-7ba0-4c75-b40d-a3dd9569f545 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] SCSI volumes sdb have been removed. {{(pid=73449) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 12:29:56 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-2914a9dd-7ba0-4c75-b40d-a3dd9569f545 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:17173712-83ad-4c7a-b806-88c3ce1df6f3')] {{(pid=73449) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 12:29:56 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17173712-83ad-4c7a-b806-88c3ce1df6f3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:29:56 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17173712-83ad-4c7a-b806-88c3ce1df6f3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:29:56 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bc98381-0165-4a98-92e1-ca136f329623]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:29:56 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-2914a9dd-7ba0-4c75-b40d-a3dd9569f545 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:29:56 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17173712-83ad-4c7a-b806-88c3ce1df6f3 -p 172.16.0.220:3260 --logout {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:29:56 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17173712-83ad-4c7a-b806-88c3ce1df6f3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:29:56 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[2731107c-1fc5-4af7-9eda-065169c953b9]: (4, ('Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:17173712-83ad-4c7a-b806-88c3ce1df6f3, portal: 172.16.0.220,3260]\nLogout of [sid: 70, target: iqn.2010-10.org.openstack:17173712-83ad-4c7a-b806-88c3ce1df6f3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:29:56 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-2914a9dd-7ba0-4c75-b40d-a3dd9569f545 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:17173712-83ad-4c7a-b806-88c3ce1df6f3, portal: 172.16.0.220,3260]
Aug 17 12:29:56 user nova-compute[73449]: Logout of [sid: 70, target: iqn.2010-10.org.openstack:17173712-83ad-4c7a-b806-88c3ce1df6f3, portal: 172.16.0.220,3260] successful.
Aug 17 12:29:56 user nova-compute[73449]:  stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:29:56 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17173712-83ad-4c7a-b806-88c3ce1df6f3 -p 172.16.0.220:3260 --op delete {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:29:56 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17173712-83ad-4c7a-b806-88c3ce1df6f3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84309) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:29:56 user nova-compute[73449]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccd0b3da-ba4c-4995-9678-c85bb0358471]: (4, ('', '')) {{(pid=84309) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 12:29:56 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-2914a9dd-7ba0-4c75-b40d-a3dd9569f545 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73449) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 12:29:56 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.base [None req-2914a9dd-7ba0-4c75-b40d-a3dd9569f545 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.279s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 12:29:56 user nova-compute[73449]: DEBUG os_brick.initiator.connectors.iscsi [None req-2914a9dd-7ba0-4c75-b40d-a3dd9569f545 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] <== disconnect_volume: return (280ms) None {{(pid=73449) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 12:29:56 user nova-compute[73449]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2914a9dd-7ba0-4c75-b40d-a3dd9569f545 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] Disconnected iSCSI Volume {{(pid=73449) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 12:29:57 user nova-compute[73449]: DEBUG nova.objects.instance [None req-2914a9dd-7ba0-4c75-b40d-a3dd9569f545 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Lazy-loading 'flavor' on Instance uuid a762749b-0aa6-4e11-912f-76d8daaf3488 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:29:57 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-2914a9dd-7ba0-4c75-b40d-a3dd9569f545 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Lock "a762749b-0aa6-4e11-912f-76d8daaf3488" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.717s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:29:58 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:29:58 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:29:58 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73449) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 12:29:58 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:29:58 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:29:58 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:29:59 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:30:03 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:30:08 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:30:08 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:30:08 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73449) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 12:30:08 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:30:08 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:30:08 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:30:13 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:30:18 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:30:19 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:30:19 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73449) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 12:30:19 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:30:19 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:30:19 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:30:23 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:30:24 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:30:24 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:30:24 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73449) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 12:30:24 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:30:24 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:30:24 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:30:28 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:30:29 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:30:29 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:30:30 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:30:34 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:30:34 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:30:34 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73449) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 12:30:34 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:30:34 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:30:34 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:30:34 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:30:34 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:30:34 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:30:34 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:30:34 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=73449) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 12:30:35 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a762749b-0aa6-4e11-912f-76d8daaf3488/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:30:35 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a762749b-0aa6-4e11-912f-76d8daaf3488/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:30:35 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a762749b-0aa6-4e11-912f-76d8daaf3488/disk --force-share --output=json {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 12:30:35 user nova-compute[73449]: DEBUG oslo_concurrency.processutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a762749b-0aa6-4e11-912f-76d8daaf3488/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 12:30:35 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 12:30:35 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 12:30:35 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Hypervisor/Node resource view: name=user free_ram=8794MB free_disk=25.003128051757812GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73449) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 12:30:35 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:30:35 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:30:35 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Instance a762749b-0aa6-4e11-912f-76d8daaf3488 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73449) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 12:30:35 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73449) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 12:30:35 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73449) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 12:30:35 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 12:30:35 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 12:30:35 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Compute_service record updated for user:user {{(pid=73449) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 12:30:35 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.168s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:30:37 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:30:37 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73449) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 12:30:37 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:30:38 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:30:39 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:30:43 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:30:44 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:30:46 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:30:46 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Starting heal instance info cache {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 12:30:46 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Rebuilding the list of instances to heal {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 12:30:47 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "refresh_cache-a762749b-0aa6-4e11-912f-76d8daaf3488" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 12:30:47 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquired lock "refresh_cache-a762749b-0aa6-4e11-912f-76d8daaf3488" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 12:30:47 user nova-compute[73449]: DEBUG nova.network.neutron [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] Forcefully refreshing network info cache for instance {{(pid=73449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 12:30:47 user nova-compute[73449]: DEBUG nova.objects.instance [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lazy-loading 'info_cache' on Instance uuid a762749b-0aa6-4e11-912f-76d8daaf3488 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:30:48 user nova-compute[73449]: DEBUG nova.network.neutron [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] Updating instance_info_cache with network_info: [{"id": "e153fc04-33de-4636-a657-8638ec48f960", "address": "fa:16:3e:19:b7:c0", "network": {"id": "8c856a2a-08b3-4f78-9ed6-425371ba0c33", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1378352798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06f2957934dd4930883815ec6a1b18a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape153fc04-33", "ovs_interfaceid": "e153fc04-33de-4636-a657-8638ec48f960", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 12:30:48 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Releasing lock "refresh_cache-a762749b-0aa6-4e11-912f-76d8daaf3488" {{(pid=73449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 12:30:48 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] Updated the network info_cache for instance {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 12:30:49 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:30:49 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:30:49 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73449) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 12:30:49 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:30:49 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:30:49 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:30:54 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:30:54 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:30:54 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73449) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 12:30:54 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:30:54 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:30:54 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:30:59 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:30:59 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:30:59 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73449) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 12:30:59 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:30:59 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:30:59 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:31:04 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:31:04 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:31:04 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73449) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 12:31:04 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:31:04 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:31:04 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:31:09 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:31:09 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:31:09 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73449) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 12:31:09 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:31:09 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:31:09 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:31:14 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:31:19 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:31:19 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:31:19 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73449) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 12:31:19 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:31:19 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:31:19 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:31:24 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:31:24 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:31:24 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73449) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 12:31:24 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:31:24 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:31:24 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:31:25 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:31:29 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:31:29 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:31:30 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:31:31 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:31:31 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:31:31 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Cleaning up deleted instances {{(pid=73449) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 17 12:31:31 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] There are 0 instances to clean {{(pid=73449) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 17 12:31:32 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-f30f595e-58b6-476f-a3a2-5a7238cfbd37 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Acquiring lock "a762749b-0aa6-4e11-912f-76d8daaf3488" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:31:32 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-f30f595e-58b6-476f-a3a2-5a7238cfbd37 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Lock "a762749b-0aa6-4e11-912f-76d8daaf3488" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:31:32 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-f30f595e-58b6-476f-a3a2-5a7238cfbd37 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Acquiring lock "a762749b-0aa6-4e11-912f-76d8daaf3488-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:31:32 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-f30f595e-58b6-476f-a3a2-5a7238cfbd37 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Lock "a762749b-0aa6-4e11-912f-76d8daaf3488-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:31:32 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-f30f595e-58b6-476f-a3a2-5a7238cfbd37 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Lock "a762749b-0aa6-4e11-912f-76d8daaf3488-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:31:32 user nova-compute[73449]: INFO nova.compute.manager [None req-f30f595e-58b6-476f-a3a2-5a7238cfbd37 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] Terminating instance
Aug 17 12:31:32 user nova-compute[73449]: DEBUG nova.compute.manager [None req-f30f595e-58b6-476f-a3a2-5a7238cfbd37 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] Start destroying the instance on the hypervisor. {{(pid=73449) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 12:31:32 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:31:32 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:31:32 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:31:32 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:31:33 user nova-compute[73449]: DEBUG nova.compute.manager [req-7933aa7b-b08b-409b-8b96-02c90c91270e req-2f1c705e-c1e7-422b-bd49-8d9a5498a4b2 service nova] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] Received event network-vif-unplugged-e153fc04-33de-4636-a657-8638ec48f960 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:31:33 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-7933aa7b-b08b-409b-8b96-02c90c91270e req-2f1c705e-c1e7-422b-bd49-8d9a5498a4b2 service nova] Acquiring lock "a762749b-0aa6-4e11-912f-76d8daaf3488-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:31:33 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-7933aa7b-b08b-409b-8b96-02c90c91270e req-2f1c705e-c1e7-422b-bd49-8d9a5498a4b2 service nova] Lock "a762749b-0aa6-4e11-912f-76d8daaf3488-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:31:33 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-7933aa7b-b08b-409b-8b96-02c90c91270e req-2f1c705e-c1e7-422b-bd49-8d9a5498a4b2 service nova] Lock "a762749b-0aa6-4e11-912f-76d8daaf3488-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:31:33 user nova-compute[73449]: DEBUG nova.compute.manager [req-7933aa7b-b08b-409b-8b96-02c90c91270e req-2f1c705e-c1e7-422b-bd49-8d9a5498a4b2 service nova] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] No waiting events found dispatching network-vif-unplugged-e153fc04-33de-4636-a657-8638ec48f960 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 12:31:33 user nova-compute[73449]: DEBUG nova.compute.manager [req-7933aa7b-b08b-409b-8b96-02c90c91270e req-2f1c705e-c1e7-422b-bd49-8d9a5498a4b2 service nova] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] Received event network-vif-unplugged-e153fc04-33de-4636-a657-8638ec48f960 for instance with task_state deleting. {{(pid=73449) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 12:31:33 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:31:33 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:31:33 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:31:33 user nova-compute[73449]: INFO nova.virt.libvirt.driver [-] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] Instance destroyed successfully.
Aug 17 12:31:33 user nova-compute[73449]: DEBUG nova.objects.instance [None req-f30f595e-58b6-476f-a3a2-5a7238cfbd37 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Lazy-loading 'resources' on Instance uuid a762749b-0aa6-4e11-912f-76d8daaf3488 {{(pid=73449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 12:31:33 user nova-compute[73449]: DEBUG nova.virt.libvirt.vif [None req-f30f595e-58b6-476f-a3a2-5a7238cfbd37 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T12:23:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-693333408',display_name='tempest-SnapshotDataIntegrityTests-server-693333408',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-693333408',id=53,image_ref='0a2904ae-083d-41c8-83db-343132b36148',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBASduBFDp9fhTht5sR5q0Ab9f4uTlIvl0a1PY0AE0RFUo1o/JqOETOIkmb3PBaQcZpGHJG4JmOYqb2GZa7+71UsKHTiJT0sPdHoW8en4uGDlF9QQvP9winLcltLATiB8XA==',key_name='tempest-keypair-1952481270',keypairs=<?>,launch_index=0,launched_at=2023-08-17T12:23:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='06f2957934dd4930883815ec6a1b18a1',ramdisk_id='',reservation_id='r-tl7hro4o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a2904ae-083d-41c8-83db-343132b36148',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-927060233',owner_user_name='tempest-SnapshotDataIntegrityTests-927060233-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T12:23:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dc5d7521089c400aa89522f1d0f7e19e',uuid=a762749b-0aa6-4e11-912f-76d8daaf3488,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e153fc04-33de-4636-a657-8638ec48f960", "address": "fa:16:3e:19:b7:c0", "network": {"id": "8c856a2a-08b3-4f78-9ed6-425371ba0c33", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1378352798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06f2957934dd4930883815ec6a1b18a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape153fc04-33", "ovs_interfaceid": "e153fc04-33de-4636-a657-8638ec48f960", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 12:31:33 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-f30f595e-58b6-476f-a3a2-5a7238cfbd37 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Converting VIF {"id": "e153fc04-33de-4636-a657-8638ec48f960", "address": "fa:16:3e:19:b7:c0", "network": {"id": "8c856a2a-08b3-4f78-9ed6-425371ba0c33", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1378352798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06f2957934dd4930883815ec6a1b18a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape153fc04-33", "ovs_interfaceid": "e153fc04-33de-4636-a657-8638ec48f960", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 12:31:33 user nova-compute[73449]: DEBUG nova.network.os_vif_util [None req-f30f595e-58b6-476f-a3a2-5a7238cfbd37 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:19:b7:c0,bridge_name='br-int',has_traffic_filtering=True,id=e153fc04-33de-4636-a657-8638ec48f960,network=Network(8c856a2a-08b3-4f78-9ed6-425371ba0c33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape153fc04-33') {{(pid=73449) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 12:31:33 user nova-compute[73449]: DEBUG os_vif [None req-f30f595e-58b6-476f-a3a2-5a7238cfbd37 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:19:b7:c0,bridge_name='br-int',has_traffic_filtering=True,id=e153fc04-33de-4636-a657-8638ec48f960,network=Network(8c856a2a-08b3-4f78-9ed6-425371ba0c33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape153fc04-33') {{(pid=73449) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 12:31:33 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:31:33 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape153fc04-33, bridge=br-int, if_exists=True) {{(pid=73449) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 12:31:33 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:31:33 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:31:33 user nova-compute[73449]: INFO os_vif [None req-f30f595e-58b6-476f-a3a2-5a7238cfbd37 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:19:b7:c0,bridge_name='br-int',has_traffic_filtering=True,id=e153fc04-33de-4636-a657-8638ec48f960,network=Network(8c856a2a-08b3-4f78-9ed6-425371ba0c33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape153fc04-33')
Aug 17 12:31:33 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-f30f595e-58b6-476f-a3a2-5a7238cfbd37 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] Deleting instance files /opt/stack/data/nova/instances/a762749b-0aa6-4e11-912f-76d8daaf3488_del
Aug 17 12:31:33 user nova-compute[73449]: INFO nova.virt.libvirt.driver [None req-f30f595e-58b6-476f-a3a2-5a7238cfbd37 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] Deletion of /opt/stack/data/nova/instances/a762749b-0aa6-4e11-912f-76d8daaf3488_del complete
Aug 17 12:31:33 user nova-compute[73449]: INFO nova.compute.manager [None req-f30f595e-58b6-476f-a3a2-5a7238cfbd37 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 17 12:31:33 user nova-compute[73449]: DEBUG oslo.service.loopingcall [None req-f30f595e-58b6-476f-a3a2-5a7238cfbd37 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73449) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 12:31:33 user nova-compute[73449]: DEBUG nova.compute.manager [-] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] Deallocating network for instance {{(pid=73449) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 12:31:33 user nova-compute[73449]: DEBUG nova.network.neutron [-] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] deallocate_for_instance() {{(pid=73449) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 12:31:34 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:31:34 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:31:34 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:31:34 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:31:34 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:31:34 user nova-compute[73449]: DEBUG nova.network.neutron [-] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] Updating instance_info_cache with network_info: [] {{(pid=73449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 12:31:34 user nova-compute[73449]: INFO nova.compute.manager [-] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] Took 0.89 seconds to deallocate network for instance.
Aug 17 12:31:34 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-f30f595e-58b6-476f-a3a2-5a7238cfbd37 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:31:34 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-f30f595e-58b6-476f-a3a2-5a7238cfbd37 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:31:34 user nova-compute[73449]: DEBUG nova.compute.manager [req-d5222b3f-1074-4d1b-ae4e-9b754ccc61b8 req-5de6da52-9f90-482c-a17a-faabfb7bc7f4 service nova] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] Received event network-vif-deleted-e153fc04-33de-4636-a657-8638ec48f960 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:31:34 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-f30f595e-58b6-476f-a3a2-5a7238cfbd37 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 12:31:34 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-f30f595e-58b6-476f-a3a2-5a7238cfbd37 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 12:31:34 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-f30f595e-58b6-476f-a3a2-5a7238cfbd37 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.114s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:31:34 user nova-compute[73449]: INFO nova.scheduler.client.report [None req-f30f595e-58b6-476f-a3a2-5a7238cfbd37 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Deleted allocations for instance a762749b-0aa6-4e11-912f-76d8daaf3488
Aug 17 12:31:34 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-f30f595e-58b6-476f-a3a2-5a7238cfbd37 tempest-SnapshotDataIntegrityTests-927060233 tempest-SnapshotDataIntegrityTests-927060233-project-member] Lock "a762749b-0aa6-4e11-912f-76d8daaf3488" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.069s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:31:34 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:31:34 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:31:34 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:31:34 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:31:35 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=73449) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 12:31:35 user nova-compute[73449]: DEBUG nova.compute.manager [req-59adbeba-fbe1-4e9f-887d-30f34915eaed req-ac1c3724-6edb-46c5-8a23-ddc066fd4672 service nova] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] Received event network-vif-plugged-e153fc04-33de-4636-a657-8638ec48f960 {{(pid=73449) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 12:31:35 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-59adbeba-fbe1-4e9f-887d-30f34915eaed req-ac1c3724-6edb-46c5-8a23-ddc066fd4672 service nova] Acquiring lock "a762749b-0aa6-4e11-912f-76d8daaf3488-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:31:35 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-59adbeba-fbe1-4e9f-887d-30f34915eaed req-ac1c3724-6edb-46c5-8a23-ddc066fd4672 service nova] Lock "a762749b-0aa6-4e11-912f-76d8daaf3488-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:31:35 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [req-59adbeba-fbe1-4e9f-887d-30f34915eaed req-ac1c3724-6edb-46c5-8a23-ddc066fd4672 service nova] Lock "a762749b-0aa6-4e11-912f-76d8daaf3488-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:31:35 user nova-compute[73449]: DEBUG nova.compute.manager [req-59adbeba-fbe1-4e9f-887d-30f34915eaed req-ac1c3724-6edb-46c5-8a23-ddc066fd4672 service nova] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] No waiting events found dispatching network-vif-plugged-e153fc04-33de-4636-a657-8638ec48f960 {{(pid=73449) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 12:31:35 user nova-compute[73449]: WARNING nova.compute.manager [req-59adbeba-fbe1-4e9f-887d-30f34915eaed req-ac1c3724-6edb-46c5-8a23-ddc066fd4672 service nova] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] Received unexpected event network-vif-plugged-e153fc04-33de-4636-a657-8638ec48f960 for instance with vm_state deleted and task_state None.
Aug 17 12:31:35 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 12:31:35 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 12:31:35 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Hypervisor/Node resource view: name=user free_ram=8868MB free_disk=25.030128479003906GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73449) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 12:31:35 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:31:35 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:31:35 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73449) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 12:31:35 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73449) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 12:31:35 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 12:31:35 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 12:31:35 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Compute_service record updated for user:user {{(pid=73449) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 12:31:35 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.185s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:31:36 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:31:36 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73449) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 12:31:38 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:31:38 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:31:43 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:31:43 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:31:43 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73449) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 12:31:43 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:31:43 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:31:43 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:31:43 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:31:47 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:31:47 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Starting heal instance info cache {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 12:31:47 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Rebuilding the list of instances to heal {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 12:31:47 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Didn't find any instances for network info cache update. {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 12:31:47 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:31:48 user nova-compute[73449]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692275493.4978626, a762749b-0aa6-4e11-912f-76d8daaf3488 => Stopped> {{(pid=73449) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 12:31:48 user nova-compute[73449]: INFO nova.compute.manager [-] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] VM Stopped (Lifecycle Event)
Aug 17 12:31:48 user nova-compute[73449]: DEBUG nova.compute.manager [None req-79539587-fda3-4211-866b-9d80bf9e2fc5 None None] [instance: a762749b-0aa6-4e11-912f-76d8daaf3488] Checking state {{(pid=73449) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 12:31:48 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:31:48 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:31:48 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73449) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 12:31:48 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:31:48 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:31:48 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:31:53 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:31:53 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:31:53 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73449) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 12:31:53 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:31:53 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:31:53 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:31:58 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:31:58 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:31:58 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73449) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 12:31:58 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:31:58 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:31:58 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:32:03 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:32:08 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:32:13 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:32:16 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:32:16 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73449) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 17 12:32:18 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:32:18 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:32:18 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73449) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 12:32:18 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:32:18 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:32:18 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:32:23 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:32:25 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:32:25 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:32:26 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:32:28 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:32:30 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:32:31 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:32:31 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:32:31 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:32:33 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:32:35 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:32:35 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:32:35 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:32:35 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:32:35 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=73449) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 12:32:36 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 12:32:36 user nova-compute[73449]: WARNING nova.virt.libvirt.driver [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 12:32:36 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Hypervisor/Node resource view: name=user free_ram=9041MB free_disk=25.028839111328125GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73449) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 12:32:36 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 12:32:36 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 12:32:36 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73449) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 12:32:36 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73449) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 12:32:36 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Refreshing inventories for resource provider 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 17 12:32:36 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Updating ProviderTree inventory for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 17 12:32:36 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Updating inventory in ProviderTree for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 12:32:36 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Refreshing aggregate associations for resource provider 20986bee-3f54-4b89-bec1-f8387ef700c4, aggregates: None {{(pid=73449) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 17 12:32:36 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Refreshing trait associations for resource provider 20986bee-3f54-4b89-bec1-f8387ef700c4, traits: COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NODE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE42,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSSE3,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_ISO {{(pid=73449) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 17 12:32:36 user nova-compute[73449]: DEBUG nova.compute.provider_tree [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Inventory has not changed in ProviderTree for provider: 20986bee-3f54-4b89-bec1-f8387ef700c4 {{(pid=73449) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 12:32:36 user nova-compute[73449]: DEBUG nova.scheduler.client.report [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Inventory has not changed for provider 20986bee-3f54-4b89-bec1-f8387ef700c4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73449) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 12:32:36 user nova-compute[73449]: DEBUG nova.compute.resource_tracker [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Compute_service record updated for user:user {{(pid=73449) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 12:32:36 user nova-compute[73449]: DEBUG oslo_concurrency.lockutils [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.406s {{(pid=73449) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 12:32:37 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:32:37 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73449) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 12:32:38 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:32:38 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:32:38 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73449) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 12:32:38 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:32:38 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:32:38 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:32:38 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:32:40 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:32:43 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:32:44 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:32:48 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 12:32:48 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:32:48 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73449) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 12:32:48 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:32:48 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73449) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 12:32:48 user nova-compute[73449]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73449) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 12:32:49 user nova-compute[73449]: DEBUG oslo_service.periodic_task [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 12:32:49 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Starting heal instance info cache {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 12:32:49 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Rebuilding the list of instances to heal {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 12:32:49 user nova-compute[73449]: DEBUG nova.compute.manager [None req-6d852dde-508f-4c1a-81a4-ed0b3ab7b7b8 None None] Didn't find any instances for network info cache update. {{(pid=73449) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}